Kafka for HDInsight is an enterprise-grade, open-source, streaming ingestion service that is cost-effective and easy to provision, manage, and use. This service enables you to build real-time solutions like IoT, fraud detection, click-stream analysis, financial alerts, and social analytics.
Process massive amounts of data produced by your real-time applications with Kafka for HDInsight. Apache Kafka is the most popular open source stream-ingestion broker and can handle large numbers of reads and writes per second from thousands of clients. Architect powerful streaming pipelines to drive intelligent real-time actions using out-of-the-box integration with Apache Storm for HDInsight or Apache Spark for HDInsight.
Gain visibility and control over your real-time solution with threat detection, monitoring, and management through Microsoft Operations Management Suite. Capture log, event, and JMX metrics to define pre-emptive actions, and set alerts with Azure Automation runbooks. Plus, get the power to perform statistical aggregations and build rich visualizations for reporting and monitoring.
Kafka for HDInsight is managed and supported by Microsoft with 24x7 enterprise support and cluster monitoring. At general availability, HDInsight will guarantee 99.9% up time for your Kafka clusters.
With Kafka for HDInsight, there’s no time-consuming installation or setup—Azure does it for you. Deploy a managed Kafka cluster of your configuration using the full-featured portal or through simple JSON templates. Your cluster will be up and running in minutes, ingesting low-latency, high throughput data. You pay only for the compute and storage you use, with no need to buy new hardware or incur other up-front costs.