Big Data

Run your PySpark Interactive Query and batch job in Visual Studio Code

maandag 27 november 2017

We are excited to introduce the integration of HDInsight PySpark into Visual Studio Code (VSCode), which allows developers to easily edit Python scripts and submit PySpark statements to HDInsight clusters. This interactivity brings the best properties of Python and Spark to developers and empowers you to gain faster insights.

Principal Program Manager, Big Data Team

Highlighting 3 New Features in Azure Data Factory V2

woensdag 25 oktober 2017

Having just announced the V2 preview availability of Azure Data Factory at Ignite in Orlando, I'm going to start a new blog series focusing on three new features in Azure Data Factory for different types of data integration users. These features are all available now, in preview, in the ADF V2 service. So, for part one of this series, I’ll focus on Data Engineers who build and maintain ETL processes.

Sr. Program Manager

Azure Service Bus and Azure Event Hubs Geo-disaster recovery preview released

donderdag 19 oktober 2017

The two long standing, well known and appreciated Azure Core Services (Azure Service Bus and Azure Event Hubs) just released a preview of an upcoming generally available Geo-disaster recovery feature. With the help of this feature, no client needs to manage Geo-disaster recovery scenarios anymore via code, but can instead rely on the services doing the metadata synchronization between two independent namespaces. At this time, data replication is not yet supported and will be added at a later (post General Availability) point in time.

Program Manager

Azure Data Lake Tools for Visual Studio Code (VSCode) October Updates

woensdag 18 oktober 2017

We are happy to share a few key updates for VSCode Azure Data Lake Tools, a cross-platform code editor to allow you easily author and submit USQL file to Azure Data Lake Analytics (ADLA). We have refined the architecture of Azure Data Lake Tools for more reliable integration with Azure Data Lake Storage (ADLS), allowing you to easily preview files, list storage path, download and upload files with great performance.

Principal Program Manager, Big Data Team