Use an Azure Managed Identity for Fluent Bit’s Azure Data Explorer output plugin on Azure Kubernetes Service https://www.danielstechblog.io/use-an-azure-managed-identity-for-fluent-bits-azure-data-explorer-output-plugin-on-azure-kubernetes-service/ #Azure #AKS #AzureKubernetesService #Kubernetes #AzureDataExplorer #ADX #KQL #FluentBit

Use Fluent Bit for Kubernetes events gathering on Azure Kubernetes Service https://www.danielstechblog.io/use-fluent-bit-for-kubernetes-events-gathering-on-azure-kubernetes-service/ #Azure #AKS #AzureKubernetesService #Kubernetes #AzureDataExplorer #ADX #KQL #FluentBit

New Fluent Bit Azure Data Explorer output plugin version available https://www.danielstechblog.io/new-fluent-bit-azure-data-explorer-output-plugin-version-available/ #Azure #AKS #AzureKubernetesService #Kubernetes #AzureDataExplorer #ADX #KQL #FluentBit

Retrieve Kubernetes Pods IP addresses with Fluent Bit https://www.danielstechblog.io/retrieve-kubernetes-pods-ip-addresses-with-fluent-bit/ #Azure #AKS #AzureKubernetesService #Kubernetes #AzureDataExplorer #ADX #KQL #FluentBit

Export Azure Kubernetes Service control plane logs to Azure Data Explorer https://www.danielstechblog.io/export-azure-kubernetes-service-control-plane-logs-to-azure-data-explorer/ #Azure #AKS #AzureKubernetesService #Kubernetes #AzureDataExplorer #ADX #KQL #FluentBit

Sneak peek into the new Fluent Bit Azure Data Explorer output plugin version https://www.danielstechblog.io/sneak-peek-into-the-new-fluent-bit-azure-data-explorer-output-plugin-version/ #Azure #AKS #AzureKubernetesService #Kubernetes #AzureDataExplorer #ADX #KQL #FluentBit

Using Azure Data Explorer as logging backend for Fluent Bit https://www.danielstechblog.io/using-azure-data-explorer-as-logging-backend-for-fluent-bit/ #Azure #AKS #AzureKubernetesService #Kubernetes #AzureDataExplorer #ADX #KQL #FluentBit

Ingesting Azure Diagnostic Logs into Azure Data Explorer https://www.danielstechblog.io/ingesting-azure-diagnostic-logs-into-azure-data-explorer/ #AzureDataExplorer #ADX #KQL #Azure

🚀 Weekly Blog Post Highlights! 📚

🤝Discover the power of #AzureDataExplorer in building a self-serve analytics platform.

🌐 Unlock valuable insights into customer lifetime value (CLV) using the Lakehouse architecture.

🎯 Databricks acquire MosaicML to enhance #generativeAI capabilities for enterprises.

🤝 Dive into the top sessions from #Kafka Summit London 2023!

📊 ACERTUS & Confluent to provide real-time order notifications.

🚚 Don't miss Data Saturday Durban

👉 https://nielsberglund.com/post/2023-07-23-interesting-stuff---week-29-2023/

🌟 Exciting discoveries in this week's blog post! 🌟

🔍 Azure Data Explorer & Kusto Detective Academy #azuredataexplorer #kql

📚 GPT4Readability, for creating README.md files using GPT-3.5 & GPT-4. #python

🚀 Uncover the integration of #Kafka, Debezium, and BentoML

📊 RisingWave vs. Flink #ApacheFlink #RisingWave

🎉 Data Saturday Durban 2023 is just around the corner!

Read all about it here 👉 https://nielsberglund.com/post/2023-07-16-interesting-stuff---week-28-2023/

New post: "Interesting Stuff - Week 19, 2023".

This week:

* @azuredataexplorer as Vector DB! How cool is that!
* Rust Polars; high-performance data analysis.
* Langchain LLM with Streamlit and Pinecone.
* PandasAI, the love child between ChatGPT and Pandas.
* Hubert's next post about the real-time streaming ecosystem. Awesome!
* Real-time sentiment analysis using Kafka and Spark Streaming.

Read all about it:

https://nielsberglund.com/post/2023-05-14-interesting-stuff---week-19-2023/

#AI #ML #kafka #azuredataexplorer #Python

New post: "Interesting Stuff - Week 18, 2023".

This week:

* AI improving their programming abilities using self-play!
* Build ML-driven segmentation using chatbots, ChatGPT and LangChain.
* Use diffusion models to mimic human behaviour.
* Inferring rewards through interaction. Use of IGL-P!
* Confluent Platform 7.4 released. Cool!
* Niels is busy with @azuredataexplorer post

Read all about it:

https://nielsberglund.com/post/2023-05-07-interesting-stuff---week-18-2023/

#AI #ML #kafka #azuredataexplorer #openai

New post: "Interesting Stuff - Week 17, 2023".

This week:

* The gambler that beat roulette!
* I finally created a repo covering how to stream data from Kafka to @azuredataexplorer.
* Real-time ML pipelines.
* Databricks and Hugging Face, love is in the air.
* Very interesting about the real-time streaming ecosystem by Hubert.

Read all about it:

https://nielsberglund.com/post/2023-04-30-interesting-stuff---week-17-2023/

#AI #ML #streaming #kafka #databricks #azuredataexplorer

New post: "Interesting Stuff - Week 16, 2023".

This week:

* How to optimize the Azure Databricks Delta Engine.
* Link to my post about the multi-platform Docker Image for @azuredataexplorer Kusto Sink and Kafka Connect.
* Create Synthetic Data using Generative AI.
* Databricks SQL and the ability to call LLMs!

Read all about it:

https://nielsberglund.com/post/2023-04-23-interesting-stuff---week-16-2023/

#AI #ML #openai #databricks #azuredataexplorer

New post: "Cross-Platform Compatibility Made Easy with Multi-Platform Docker Images: Azure Data Explorer Sink Connector & Kafka Connect"

Docker has revolutionized the way we package and deploy software applications.

However, it's challenging to maintain a single image that can work across multiple platforms.

This blog post explores the steps required to build and deploy multi-platform Docker images.

https://nielsberglund.com/post/2023-04-17-cross-platform-compatibility-made-easy-with-multi-platform-docker-images-azure-data-explorer-sink-connector--kafka-connect/

#kafka #azuredataexplorer #kusto #kafkaconnect

New post: "Interesting Stuff - Week 15, 2023".

This week:

* Generative AI and focus shift from tech-driven dev to product-driven dev.
* Game analytics solution for Game Studios!
* Late arriving events in Flink and ways to handle them.
* Very cool around materialized views.
* Me plugging an upcoming post about how to build multi-platform Docker images.

Read all about it:

https://nielsberglund.com/post/2023-04-16-interesting-stuff---week-15-2023/

#kafka #flink #AI #ML #openai #databricks #azuredataexplorer

New post: "Develop a Real-Time Leaderboard Using Kafka and Azure Data Explorer - II"

This is the third post about using Kafka and @azuredataexplorer (ADX) to develop a real-time leaderboard for online gaming.

In this post, you will see more about ingesting data into ADX and some "cool stuff" related to that. Specifically, what to do if you need to update/transform the data you ingest.

https://nielsberglund.com/post/2023-04-03-develop-a-real-time-leaderboard-using-kafka-and-azure-data-explorer---ii/

#kafka #azuredataexplorer #kql #kusto

New post: "Interesting Stuff - Week 13, 2023".

This week:

* Cool post about Polars vs Pandas.
* How to ingest data into @azuredataexplorer. Must read!
* How do you do canary releases for data streaming?
* Data streaming and AI/ML - very interesting

Read all about it:

https://nielsberglund.com/post/2023-04-02-interesting-stuff---week-13-2023/

#kafka #python #azuredataexplorer

New post: "Develop a Real-Time Leaderboard Using Kafka and Azure Data Explorer - I"

The second post in a series about using Kafka and @azuredataexplorer
(ADX) to develop a real-time leaderboard for online gaming.

In this post, you will learn more about ADX and why it is an excellent choice for near real-time applications, how to "hook up" Kafka to ADX and how to ingest data into an ADX database using streaming ingestion.

https://nielsberglund.com/post/2023-03-19-develop-a-real-time-leaderboard-using-kafka-and-azure-data-explorer---i/

#kafka #python #docker #azuredataexplorer

New post: "Interesting Stuff - Week 11, 2023".

This week:

* Learn all about @azuredataexplorer and #Kusto, thanks to Akshay Dixit.
* I finally finished the second post in the Leaderboard, Kafka, and ADX series
* ChatGPT and dialogue prompting. Very interesting
* An old colleague of mine -Ted Neward - ponders the impact of AI on developers.
* Where has all the Big Data gone?

Read all about it:

https://nielsberglund.com/post/2023-03-19-interesting-stuff---week-11-2023/

#AzureDataExplorer #KQL #kafka #kafkaconnect #AI #ml #openai