We are pleased to announce the integration of VSCode Python extension to handle PySpark interactive for HDInsight in VSCode. The Azure HDInsight Tools for VSCode leverages the Python extension to provide enhanced python editing experience, Jupyter Notebook integration and the Notebook-like PySpark interactive query.
With this integration, you can enjoy native Python programming experiences such as linting, debugging support, language service and so on. You can import/export an IPYNB Notebook and perform Notebook-like queries, including ‘Run Cell’, ‘Run Above’ and ‘Run Below’, in addition to the current functionalities of run current line, run highlighted lines and run all. With this integration, the interactive experience is much improved. Your source code and markdown comments are displayed in the interactive results window along with the running results and output. You can manipulate the output window by removing the unneeded sections. You can also enter comments or input additional code in the interactive results window. Moreover, you can visualise your results in a graphic format through matplotlib like Jupyter Notebook.
How to install or update
First, install Visual Studio Code and download Mono 4.2.x (for Linux and Mac). Then get the latest Azure HDInsight Tools by going to the VSCode Extension repository or the VSCode Marketplace and searching for HDInsight.
For more information about HDInsight Tools for VSCode, please use the following resources:
If you have questions, feedback, comments or bug reports, please use the comments below or send a note to firstname.lastname@example.org.