To assist those who are interested in how to get data to Microsoft Fabric from Redpanda, we’re proud to offer this handy guide with the help of DevOps Engineer Dezydery Czupryński.
To skip further background info and get started, the complete guide can be found on GitHub here.
What Is Redpanda?
Built with developers in mind, Redpanda is a Kafka API-compatible streaming data platform with a focus on performance, resilience, and connectivity. The platform also champions itself as offering a faster and more economical route to market than Apache Kafka-based solutions, along with the scalability to suit small projects to vast, global endeavors. Redpanda is a popular data platform solution, along with competitors like Apache Kafka, Google Pub/Sub, Amazon Kinesis, and WarpStream.
What Is Microsoft Fabric?
Microsoft Fabric is presented as a successor to Azure Synapse and aims to present an “end-to-end” data and analytics platform with advanced AI capabilities. Its features enable Data engineering, data warehousing, data lakes, real-time analytics, and business intelligence. Its competitors include Snowflake and Databricks, which offer similar data and analytics solutions.
How To Get Data To Microsoft Fabric From Redpanda
As Redpanda is amongst the most popular streaming platforms available, and Microsoft remains an institution in numerous software sectors, there’s a high likelihood that data developers will find themselves looking to integrate Redpanda with Fabric now or in the future.
Fortunately, DevOps Engineer Dezydery Czupryński has developed a useful step-by-step guide to ingest data from Redpanda to Azure Fabric using a self-contained Docker setup to simplify the Redpanda cluster and Redpanda connector cluster setup. This will enable data loading to Azure from Redpanda.
At gravity9, we encourage and celebrate knowledge sharing; we want to thank Dezydery for his effort and initiative in making this guide publicly available on GitHub, and we hope it proves useful to developers now and in the future!
Click here to access the guide.
