Public Preview of tighter integration of Azure Data Explorer with Python and Spark

Posted on Monday, May 6, 2019

Azure Data Explorer, the recently announced data analytics service, is a fast, fully managed data analytics service for real-time analysis on large volumes of streaming data. Azure Data Explorer offers built-in capability to perform advanced analytics such as Anomaly detection, forecasting, etc.  At Build, we are happy to announce a Spark Connector for Azure Data Explorer and the ability to run inline Python and R as part of the query: 

  • Azure Data Explorer Spark connector will enable customers to seamlessly read data from Azure Data Explorer into a Spark dataframe as well as ingest data from a dataframe into an Azure Data Explorer table.
  • Azure Data Explorer Python and R plugins will enable customers to embed Python and R code as part of the query.

These capabilities enables building a machine learning model in Spark over data in Azure Data Explorer and use that model for fast scoring of data streaming into Azure Data Explorer. 

Learn more about these exciting new features by visiting our blog

 

Related feedback