HDInsight Tooling has new capabilities
Posted on Wednesday, January 23, 2019
Azure HDInsight Tools for VSCode
The Azure HDInsight Tools for VSCode are now generally available. They provide you with best-in-class authoring experiences for Apache Hive batch jobs, interactive Hive queries, and PySpark jobs. HDInsight Tools for VSCode feature a cross-platform, lightweight, keyboard-focused code editor which removes constraints and dependencies on a platform. It can be run smoothly on Windows, Linux and Mac.
Spark diagnosis and debugging toolkit
A number of enhancements have been added to the rich development and debugging capabilities of HDInsight for Spark developers, including:
- Job graph with playback and heatmap identifying read/write bottlenecks.
- Executor usage analysis showing executors’ utilization and job execution efficiency.
- Data skew detection and analysis.
- Job specific data management including data preview, download, and copy.