Kafka 1.1 support on Azure HDInsight
Published date: August 20, 2018
Azure HDInsight now supports Kafka 1.1. You can choose the Kafka version that you want during cluster creation in the Azure portal.
Kafka 1.1 comes with several new features, improvements, and bug fixes. Improvements to the Kafka controller will speed up controlled shutdown, so you can restart brokers and recover from issues faster. Improvements in the FetchRequests logic enables you to have more partitions (and hence more topics) on the cluster. Kafka Connect now supports record headers and regular expressions for topics.
Check out the release notes of Apache Kafka 1.1 for a complete list of updates.
To get started with Kafka on Azure HDInsight, see the quickstart article. Follow us on @AzureHDInsight or HDInsight blog for the latest updates. For questions and feedback, reach out to AskHDInsight@microsoft.com.