Compatibility of Azure HDInsight Kafka

Question

Can you provide clarity on whether Azure HDInsight Kafka works with Azure Event Registry? Additionally, I’m interested in any compatibility details or constraints that might apply. Could you share more on this integration?

Answer 1

Hi @Stephen-5002

Welcome to Microsoft Q&A platform and thanks for posting your query here.

Azure HDInsight Kafka and Azure Event Registry do not directly integrate in a seamless manner, as they are designed for different purposes within Azure's event and streaming ecosystem. While Azure Event Hubs offers Kafka API compatibility, allowing Kafka producers to send data to Event Hubs, it is not a full replacement for a Kafka service like Azure HDInsight Kafka. Event Hubs supports some Kafka APIs but lacks full Kafka version compatibility and certain advanced features like transaction support.

If you are specifically looking to use Azure Kafka with other Azure services, such as Azure Data Explorer, there are integration solutions available. For instance, the KafkaConnect Kusto Sink Connector enables the ingestion of Kafka data into Azure Data Explorer, providing a robust solution for integrating streaming data from Kafka to Azure for analytics.

For your scenario involving Azure Event Registry, I would recommend exploring how Event Hubs can interact with Kafka APIs, but if your use case relies heavily on Apache Kafka's full capabilities, you might want to consider using Azure HDInsight Kafka or Confluent Kafka for better integration.

Reference:

• Kafka ingestion
• When to Choose Apache Kafka vs Other

Hope this helps. Do let us know if you any further queries.

---

If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.