{"id":3490,"date":"2017-09-25T00:00:00","date_gmt":"2017-09-25T00:00:00","guid":{"rendered":""},"modified":"2025-06-25T08:44:39","modified_gmt":"2025-06-25T15:44:39","slug":"diving-deep-into-what-s-new-with-azure-machine-learning","status":"publish","type":"post","link":"https:\/\/azure.microsoft.com\/en-us\/blog\/diving-deep-into-what-s-new-with-azure-machine-learning\/","title":{"rendered":"Diving deep into what\u2019s new with Azure Machine Learning"},"content":{"rendered":"\n<p class=\"wp-block-paragraph\">Earlier today, we disclosed a set of major updates to\u00a0<a href=\"https:\/\/aka.ms\/aml-preview-page\" target=\"_blank\" rel=\"noreferrer noopener\">Azure Machine Learning<\/a>\u00a0designed for data scientists to build, deploy, manage, and monitor models at any scale. This has been in private preview for the last 6 months, with over 100 companies, and we\u2019re incredibly excited to share these updates with you today. This post covers the learnings we\u2019ve had with Azure Machine Learning so far, the trends we\u2019re seeing from our customers today, the key design points we\u2019ve considered in building these new features, and dive into the new capabilities.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"learnings-so-far\">Learnings so far<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">We launched Azure Machine Learning Studio three years ago, designed to enable established data scientists and those new to the space to easily compose and deploy ML models. Before the term was in use, we enabled serverless training of experiments built by graphically composing from a rich set of modules, and then deploying these as a web service with the push of a button. The service serves billions of scoring requests on top of hundreds of thousands of models built by data scientists. It has been incredibly rewarding to see how the service has been used by our customers including:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li class=\"wp-block-list-item\"><a href=\"https:\/\/www.youtube.com\/watch?v=QRylfZVpar0\" target=\"_blank\" rel=\"noreferrer noopener\">Teaching Data Science in high school at the Australian School for Girls<\/a>\u00a0<\/li>\n\n\n\n<li class=\"wp-block-list-item\"><a href=\"https:\/\/azure.microsoft.com\/en-us\/resources\/videos\/rolls-royce-and-microsoft-collaborate-to-create-new-digital-capabilities\/\" target=\"_blank\" rel=\"noreferrer noopener\">Predictive maintenance at Rolls-Royce<\/a><\/li>\n\n\n\n<li class=\"wp-block-list-item\"><a href=\"https:\/\/blogs.technet.microsoft.com\/machinelearning\/2017\/06\/27\/saving-snow-leopards-with-deep-learning-and-computer-vision-on-spark\/\" target=\"_blank\" rel=\"noreferrer noopener\">Recognition of snow leopards from remote camera stations with the Snow Leopard Trust<\/a><\/li>\n<\/ul>\n\n\n\n<p class=\"wp-block-paragraph\">Over time we\u2019ve worked with many customers who are looking for the next level of power and control and the capabilities we announced today address those desires. As we look at the data science workflow, we see customers walking through the following stages:<\/p>\n\n\n<figure class=\"wp-block-image size-full\"><img decoding=\"async\" src=\"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-content\/uploads\/2017\/09\/35c66879-a6b2-4fb8-8777-b7b5691ee24a.webp\" alt=\"diagram\" class=\"wp-image-11078 webp-format\" data-orig-src=\"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-content\/uploads\/2017\/09\/35c66879-a6b2-4fb8-8777-b7b5691ee24a.webp\"><\/figure>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"key-trends\">Key trends<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Over the last few years, we\u2019ve interacted with customers in every industry, with varying amounts of experience with ML, solving problems across every domain. Reflecting on those engagements, we see the following trends:<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Accelerating adoption of ML and AI by developers \u2013<\/strong>&nbsp;When we talk with developers, they are looking to create immersive, personalized, and productive experiences for their customers. More and more, we are seeing ML and AI capabilities becoming part of the way apps are being written. Within Microsoft, it\u2019s been exciting to see how developers across the company are using AI in the applications we\u2019re building. Two of my favorite examples come from the PowerPoint team. They have leveraged&nbsp;<a href=\"https:\/\/microsoft.com\/cognitive\" target=\"_blank\" rel=\"noreferrer noopener\">Microsoft Cognitive Services<\/a>&nbsp;to build real-time translation and captioning capabilities and language understanding tools to&nbsp;<a href=\"https:\/\/www.pcmag.com\/article\/355434\/microsoft-office-users-are-getting-ai-but-may-not-know-it\" target=\"_blank\" rel=\"noreferrer noopener\">transform bullet point lists into timelines<\/a>. The Microsoft Cognitive Services, a set of 30 ready-to-use AI APIs, have been used by hundreds of thousands of developers looking to enhance their applications. This demand for AI by developers will only increase, further pushing organizations to provide easy to consume AI built on their data, as the way we write software evolves around these new capabilities.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Hybrid training and scoring \u2013<\/strong>&nbsp;Every customer has a unique set of requirements on their data. Compliance, cost, regulation, physics, and existing processes and applications are all factors in where data and decisions can live. This poses a data management and movement challenge, as well as a need for tools, services, and frameworks that can operate across all data. Additionally, we need the ability to deploy the model in many places. While we see customers consolidating large amounts of data into data lakes and using tools like Spark for preparing and analyzing their data, the models they produce need to be deployed to a variety of form factors. We\u2019ve seen two common hybrid patterns. The first involves sensitive data residing in an on-premises system being used to train a model that then gets deployed to the cloud or an application. The second involves training models on vast amounts of data ingested into the cloud (such as an IOT application), and then deploying that model on-premises or in a disconnected environment.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Scoring as close to the event as possible \u2013<\/strong>&nbsp;Following on the above point, it is becoming more important for developers to be able to consume models everywhere, and we see a rise in edge and on-device based scoring. Recently, our Custom Vision Service enabled the ability to output a trained recognition model to&nbsp;<a href=\"https:\/\/azure.microsoft.com\/en-us\/blog\/custom-vision-service-introduces-classifier-export-starting-with-coreml-for-ios-11\/\" target=\"_blank\" rel=\"noreferrer noopener\">CoreML for consumption directly within iOS<\/a>. Customers in the IOT space are looking to put models directly onto devices, or onto gateway devices that can operate independently. Whether looking to address latency or the ability to support scoring even while disconnected, customers want the flexibility to train a model anywhere but control their deployment to place scoring as close to the event as possible.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Accelerating diversification of hardware, frameworks, and tools \u2013<\/strong>&nbsp;One of the most exciting aspects of working in this space is the pace of innovation that we\u2019re seeing across every layer of the stack. There is a dizzying array of tools to choose from, each being used in amazing ways. At the hardware layer, we see exponential increases in processing capabilities across CPU, GPU, FPGAs, and more. Over time, this innovation will result in mature toolchains, all the way to the hardware level that are optimized for specific workloads, letting customers tune and tradeoff cost, latency, and control. In the short term, we see customers experimenting to discover the best set of tools for their use case.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"design-points\">Design points<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Given the learnings we\u2019ve had, we\u2019ve anchored our design on the following four points to shape these new capabilities<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"machine-learning-at-scale\">Machine Learning at scale<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">The services and tools we build must operate at scale, and we see customers encountering challenges with at least five different dimensions of \u201cscale.\u201d<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Operating across all data \u2013<\/strong>&nbsp;Customers must be able to have access to all their data to use building models at scale. In many cases, this means being able to use tools like Spark on increasing amounts of data in a data lake, but this is only part of the challenge. Customers need to be able to find and acquire the data, and then they need to be able to understand and shape the data. None of those stages can be bottlenecked as data sizes increase, so our tools need to scale from a local CSV file to petabyte-scale data lakes in the cloud.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Operating at increased compute needs (up and out) \u2013<\/strong>&nbsp;Beyond the expansion of data, the techniques we\u2019re using require scaling our processing power. Customers must be scale up onto machines that can fit huge datasets directly in memory, or machines with the latest GPUs for deep learning. Customers will scale out for problem sets on top of distributed data infrastructures like Spark, or for massively parallel processing in hyperparameter sweeps and model evaluation on top of our Azure Batch service. These two forces combine as we look to do deep learning at scale, requiring many scaled up machines.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Scaling the number of models and experiments you have \u2013<\/strong>&nbsp;As teams increase the rate of experimentation, the number of experiments being run, and models being produced will increase. It becomes critical to be able to manage, monitor, and maintain those models. Teams need the ability to pinpoint and recreate any version of a model, and the number of artifacts that need to be tracked scales as organizations power more decisions with AI.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Scaling the consumption of models \u2013<\/strong>&nbsp;Models produced, using any tools and frameworks, must be deployed in ways that enable easy scaling to serve any number of requests. For us, this means embracing container based deployment of models to enable customers fine-grained control, as well as being able to use services such as Azure Container Service to provide a scalable hosting layer in Azure.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Scaling the team \u2013<\/strong>&nbsp;Data science teams are not teams of one. Our tools and services must enable collaboration and sharing, in a secure fashion, across all stages of the data science lifecycle. Much as source control systems have evolved for software development to flexibly support a variety of teams and processes, our system needs to support the AI development lifecycle as teams continue to grow.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"building-with-the-tools-you-re-using-today\">Building with the tools you\u2019re using today<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">There is no one framework or toolchain which rules them all. Given the rapid diversification of the ecosystem, our customers can experiment and choose the tools that will work best for them. The acceleration of innovation in the ecosystem also means that the tools and frameworks and techniques today are going to be different than those in six months\u2019 time. Any service and tool that we build needs to enable data scientists to pick and choose from the ecosystem and use those tools, and we must build it in a way that provides a consistent experience for training, deployment, and management as these evolve.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">One side effect of this expansion in the tools space is a challenge with reproducibility. In 12 months\u2019 time, how will you recreate an experiment given that the tools have changed? Much like software developers needing to checkpoint a verified set of dependencies, our system needs to ensure that as frameworks come and go, you can reliably reproduce the results.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"increasing-the-rate-of-experimentation\">Increasing the rate of experimentation<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">When we look at the key areas of friction for data science teams, we consistently hear about challenges in:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li class=\"wp-block-list-item\">Acquiring, prepping, and understanding data<\/li>\n\n\n\n<li class=\"wp-block-list-item\">Reliably scaling training, from rapid local prototyping and scaling to larger data sets<\/li>\n\n\n\n<li class=\"wp-block-list-item\">Comparing and selecting models trained with different tools and techniques<\/li>\n\n\n\n<li class=\"wp-block-list-item\">Deploying models to production<\/li>\n\n\n\n<li class=\"wp-block-list-item\">Getting telemetry back from the deployed models to learn and improve the model<\/li>\n<\/ul>\n\n\n\n<p class=\"wp-block-paragraph\">We believe that by eliminating the friction in each of these steps, and between these steps, teams will be able to increase their rate of experimentation. This lets them create better models more quickly, ultimately providing more value for their customers and increasing the efficiency of the team. The services and tools must reduce these key points of friction, while still preserving the flexibility and control required.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"models-everywhere\">Models everywhere<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Finally, the service we\u2019re building must enable the deployment, management, and monitoring of models everywhere. It\u2019s critical that our customers can have flexibility in their deployment form factor, including:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li class=\"wp-block-list-item\">Deploying to the cloud, for scalable web services for consumption by millions of devices or apps<\/li>\n\n\n\n<li class=\"wp-block-list-item\">Deploying to a data lake, for processing data at scale in batch, interactive, and real-time streaming pipelines<\/li>\n\n\n\n<li class=\"wp-block-list-item\">Deploying to a data engine, like SQL Server 2017, for scoring data inline for transaction processing and data warehousing<\/li>\n\n\n\n<li class=\"wp-block-list-item\">Deploying to the edge, for moving the scoring as close to the event as possible and supporting disconnected scenarios<\/li>\n<\/ul>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"diving-into-our-new-capabilities\">Diving into our new capabilities<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Given these design points, we\u2019ve released the following new capabilities for Azure Machine Learning<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"experimentation\">Experimentation<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">The Azure Machine Learning Experimentation service allows developers and data scientists to increase their rate of experimentation. With every project backed by a Git repository, and with a simple command line tool for managing experimentation and training runs, every execution can track the code, configuration, and data that\u2019s used for the run. More importantly, the outputs of that experiment, from model files, log output, and key metrics are tracked, giving you a powerful repository with the history of how your model evolves over time.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The Experimentation service is built to allow you to leverage any Python tools and frameworks that you want to use. The experiments can run locally, inside of a Docker container locally or remotely, or scaling out on top of Spark. The power of Apache Spark in HDInsight enables data preparation and transformation, as well as training, across large amounts of your data. Deep learning based experimentation can occur on GPU accelerated virtual machines using any framework such the&nbsp;<a href=\"https:\/\/www.microsoft.com\/en-us\/cognitive-toolkit\/\" target=\"_blank\" rel=\"noreferrer noopener\">Microsoft Cognitive Toolkit<\/a>,&nbsp;<a href=\"https:\/\/www.tensorflow.org\/\" target=\"_blank\" rel=\"noreferrer noopener\">Tensorflow<\/a>,&nbsp;<a href=\"https:\/\/caffe2.ai\/\" target=\"_blank\" rel=\"noreferrer noopener\">Caffe<\/a>,&nbsp;<a href=\"https:\/\/pytorch.org\/\" target=\"_blank\" rel=\"noreferrer noopener\">PyTorch<\/a>, and more. Going forward, the&nbsp;<a href=\"https:\/\/batchaitraining.azure.com\/\" target=\"_blank\" rel=\"noreferrer noopener\">Azure Batch AI<\/a>&nbsp;service can be used to provide massive scaled out training, and then operationalized through the Model Management service.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Python libraries from Machine Learning Server (<a href=\"https:\/\/docs.microsoft.com\/en-us\/sql\/advanced-analytics\/python\/what-is-revoscalepy\" target=\"_blank\" rel=\"noreferrer noopener\">revoscalepy<\/a>&nbsp;and&nbsp;<a href=\"https:\/\/docs.microsoft.com\/en-us\/r-server\/python-reference\/microsoftml\/microsoftml-package\" target=\"_blank\" rel=\"noreferrer noopener\">microsoftml<\/a>) available with Azure Machine Learning include the Pythonic versions of Microsoft\u2019s Parallel External Memory Algorithms (linear and logistic regression, decision tree, boosted tree and random forest) and the battle tested ML algorithms and transforms (deep neural net, one class SVM, fast tree, forest, linear and logistic regressions). In addition, these libraries contain a rich set of APIs for connecting with remote data sources and deployment targets. Using these libraries, one can train a model with the Experimentation Service and operationalize these models wherever Machine Learning Server runs \u2013 SQL Server, HD Insight, Windows Server, Linux, and all three distributions of Spark; this power of training and operationalization is available for virtually every Python toolkit. This gives you the incredible power to build your models and operationalize them in the production data platforms right from your favorite data science environment.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">We know that data science isn\u2019t a linear process, and the Experimentation service lets you look back in time to compare experiments that produced the right results. When you find the right version, it\u2019s easy to set your project to the exact code, configuration, and data that were used so you can start development from any point in history. Finally, by tracking the environment configuration, the Experimentation service makes it easy to quickly set up and configure new environments with exactly the same configuration. The Experimentation service manages training on your local machine, in Docker containers running locally or in the cloud, or on scale-out engines in Azure like Spark on HDInsight. By changing a command line parameter, you can easily move my job from local execution to the cloud.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"model-management\">Model Management<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">The Model Management service provides deployment, hosting, versioning, management, and monitoring for models in Azure, on-premises, and to IOT Edge devices. We\u2019ve taken a key bet on Docker as the vehicle to provide customers with control, flexibility, and the convenience of containers as the mechanism for hosting models. With containers, you get a repeatable and consistent environment for hosting your models. Models are exposed via web services written in Python, giving you the ability to add more advanced logic, custom logging, state management, or other code into the web service execution pipeline. That logic is packaged up to construct a container which can be registered in your Azure Container Registry and then deployed using any standard Docker toolchain.&nbsp; When deploying models at scale on an Azure Container Service cluster, we\u2019ve built a hosting infrastructure optimized for model serving, that handles automatic scaling of containers, as well as efficiently routing requests to available containers.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Deployed models and services can be monitored through Application Insights, giving you details on model execution, including specific model metrics, on a per-decision level. With deployed models, versions are tracked, enabling a link back to the specific code, configuration, and data used to create the model. Support is provided for managing deployments of model upgrades, enabling no-downtime while reliably deploying new versions, and allowing rollback to previous versions if required. Retraining scenarios, where a deployed model is monitored and then updated after being trained on new data, are possible, enabling continuous improvement of models based on new data.<\/p>\n\n\n<figure class=\"wp-block-image size-full\"><img decoding=\"async\" src=\"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-content\/uploads\/2017\/09\/9950fb99-1a0c-43a5-b68a-c6b2acd2fd60.webp\" alt=\"graphical user interface, application\" class=\"wp-image-11080 webp-format\" data-orig-src=\"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-content\/uploads\/2017\/09\/9950fb99-1a0c-43a5-b68a-c6b2acd2fd60.webp\"><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\">One key benefit of this model is that it gives you full control over the deployment profile. Do you want to have a single cluster that is the host for all of your models? Do you want to deploy a cluster per department or customer? Do you have a single model that needs to support high call volumes during the day and scale down at night? Our goal is to give you control of the container hosting infrastructure in order to have the control and customization that have heard you ask for. You have full flexibility to choose the VM type and deployment profile, and we\u2019ve made it easy to get started with the Data Science Virtual Machine as a single instance for development and testing before deploying to a cluster.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Models deployed through the Model Management service also surface swagger as an easy mechanism to consume the services from your code. Our partners in Excel are using this capability to make it incredibly easy to discover and consume models directly from Excel.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The Experimentation and Model Management services work together to provide governance and lineage of deployed models all the way back to the training job used to create the model. With telemetry enabled on a deployed model, this gives you visibility into any decision and the ability to trace the decision back to the experiment that created the model. This gives you a debugging and diagnostics story across the end to end lifecycle of a model.<\/p>\n\n\n<figure class=\"wp-block-image size-full\"><img decoding=\"async\" src=\"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-content\/uploads\/2017\/09\/5c4e1254-dfb2-486c-ac56-1a6fec44a677.webp\" alt=\"graphical user interface, application, table, Excel\" class=\"wp-image-11082 webp-format\" data-orig-src=\"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-content\/uploads\/2017\/09\/5c4e1254-dfb2-486c-ac56-1a6fec44a677.webp\"><\/figure>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"workbench\">Workbench<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">When we started working on this, we worked to ensure that our service is fully operable from the command line. But we also heard that there were challenges with environment set up, data wrangling, and visualizing run comparison. We\u2019ve built the Azure Machine Learning Workbench as a companion application to your current development process, and we\u2019re excited to get your feedback. The Azure Machine Learning Workbench is a client application that runs on Windows and Macs. It has an easy set-up and installation and will install a configured Python environment, complete with conda, Jupyter, and more, along with connectivity to all of the backend services in Azure. We intend it to be a control panel for your development lifecycle and a great way to get started using the services.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">We\u2019ve also put a rich set of samples into the application, with single-click training using a range of tools and techniques. You can see these by clicking \u201cNew Project.\u201d The experimentation history management mentioned as part of the Experimentation service is shown below. You can get a glance of the evolution of key metrics over the history of your runs, get a detailed view of any individual run, and compare the performance side by side.<\/p>\n\n\n<figure class=\"wp-block-image size-full\"><img decoding=\"async\" src=\"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-content\/uploads\/2017\/09\/a903e2f8-f00f-4d6a-b996-e97821543256.webp\" alt=\"graphical user interface, application\" class=\"wp-image-11084 webp-format\" data-orig-src=\"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-content\/uploads\/2017\/09\/a903e2f8-f00f-4d6a-b996-e97821543256.webp\"><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\">Any visualization you\u2019ve built in your code, using matplotlib, for instance, will be archived and stored as part of the details of the run. In the screenshot below, you can see the wordclouds being emitted following some document analysis. Also, note that the Git commit id is included, enabling you to easily checkout from that commit if you want to pick up and start editing from where you were with this experiment.<\/p>\n\n\n<figure class=\"wp-block-image size-full\"><img decoding=\"async\" src=\"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-content\/uploads\/2017\/09\/d007e29e-99b5-4fea-8adb-95907b815c42.webp\" alt=\"graphical user interface\" class=\"wp-image-11086 webp-format\" data-orig-src=\"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-content\/uploads\/2017\/09\/d007e29e-99b5-4fea-8adb-95907b815c42.webp\"><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\">Finally, runs can be compared and evaluated side by side:<\/p>\n\n\n<figure class=\"wp-block-image size-full\"><img decoding=\"async\" src=\"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-content\/uploads\/2017\/09\/6bf89edd-8c87-4b0c-b299-2207094a4592.webp\" alt=\"graphical user interface\" class=\"wp-image-11088 webp-format\" data-orig-src=\"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-content\/uploads\/2017\/09\/6bf89edd-8c87-4b0c-b299-2207094a4592.webp\"><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\">The Azure Machine Learning Workbench also hosts Jupyter notebooks that can be configured to target local or remote kernels, enabling iterative development within the notebook on your laptop, or hooked up to a massive Spark cluster running on HDInsight.<br><\/p>\n\n\n<figure class=\"wp-block-image size-full\"><img decoding=\"async\" src=\"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-content\/uploads\/2017\/09\/4e36be56-fb7c-474a-b30e-2af0a958b300.webp\" alt=\"Graphical User Interface\" class=\"wp-image-11090 webp-format\" data-orig-src=\"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-content\/uploads\/2017\/09\/4e36be56-fb7c-474a-b30e-2af0a958b300.webp\"><\/figure>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"ai-powered-data-wrangling\">AI powered data wrangling<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">We know that one of the biggest areas where time is spent is in data preparation. We have consistent feedback on the challenges (and time spent) getting data, shaping it, and preparing it, and we are looking to make that better. We want to reduce the time and effort to acquire data for modeling, and we want to fundamentally change the pace with which data scientists can prepare and understand data, and accelerate the time to get to \u201cdoing data science.\u201d As part of the Azure Machine Learning Workbench, we\u2019re introducing a new set of data wrangling technology, powered by AI to make you more productive preparing data. We have combined a variety of techniques, using advanced research from Microsoft Research on\u00a0<a href=\"https:\/\/microsoft.github.io\/prose\/\" target=\"_blank\" rel=\"noreferrer noopener\">program synthesis (PROSE)<\/a>\u00a0and\u00a0<a href=\"https:\/\/www.microsoft.com\/en-us\/research\/project\/data-cleaning\/?from=http%3A%2F%2Fresearch.microsoft.com%2Fen-us%2Fprojects%2Fdatacleaning%2F\" target=\"_blank\" rel=\"noreferrer noopener\">data cleaning<\/a>, to create a data wrangling experience that drastically reduces the time that needs to be spent getting data prepared. With the inclusion of a simple set of libraries for handling data sources, data scientists can focus on their code, not on changing file paths and dependencies when they move between environments. By building these experiences together, the data scientist can leverage the same tools in the small and in the large, as they scale out transparently across our cloud compute engines, simply by choosing target environments for execution.<\/p>\n\n\n<figure class=\"wp-block-image size-full\"><img decoding=\"async\" src=\"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-content\/uploads\/2017\/09\/02635b00-1f98-457c-ba05-00d9a1af5c47.webp\" alt=\"Graphical User Interface\" class=\"wp-image-11092 webp-format\" data-orig-src=\"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-content\/uploads\/2017\/09\/02635b00-1f98-457c-ba05-00d9a1af5c47.webp\"><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\">One of the most powerful capabilities of this data wrangling tool is building your data transformations by example. We know that a lot of time is spent on formats and transformations of numbers and dates, and have made it simple to transform data by providing examples. Here I\u2019m taking a datetime string and changing it into a day of week + 2 hour bucket that I can later use to join or summarize my data set. If the transformations provided don\u2019t fit what I need, it\u2019s also easy to inject custom python code or libraries which can be used to filter or transform the data.<\/p>\n\n\n<figure class=\"wp-block-image size-full\"><img decoding=\"async\" src=\"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-content\/uploads\/2017\/09\/b4e88cae-5431-44a2-bf39-3e5e7d1e0cf5.webp\" alt=\"table\" class=\"wp-image-11094 webp-format\" data-orig-src=\"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-content\/uploads\/2017\/09\/b4e88cae-5431-44a2-bf39-3e5e7d1e0cf5.webp\"><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\">The data transformations you build can easily be incorporated into your Python code by easily returning a pandas dataframe containing the results of the transformation.<\/p>\n\n\n<figure class=\"wp-block-image size-full\"><img decoding=\"async\" src=\"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-content\/uploads\/2017\/09\/a5ab54c3-3df4-472e-91b7-3e6e370494b8.webp\" alt=\"graphical user interface, table\" class=\"wp-image-11096 webp-format\" data-orig-src=\"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-content\/uploads\/2017\/09\/a5ab54c3-3df4-472e-91b7-3e6e370494b8.webp\"><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\">Generating the dataframe creates the following code:<\/p>\n\n\n<div class=\"wp-block-syntaxhighlighter-code \"><pre class=\"brush: plain; auto-links: false; gutter: false; title: ; quick-code: false; notranslate\" title=\"\">\n# Use the Azure Machine Learning data wrangling package\nfrom azureml.dataprep import package\n# Use the Azure Machine Learning data collector to log various metrics\nfrom azureml.logging import get_azureml_logger\nlogger = get_azureml_logger()\n# This call will load the referenced package and return a DataFrame.\n# If run in a PySpark environment, this call returns a\n# Spark DataFrame. If not, it will return a Pandas DataFrame.\ndf = package.run('bikes.dprep', dataflow_idx=0)\n# Remove this line and add code that uses the DataFrame\ndf.head(10)\n<\/pre><\/div>\n\n\n<h2 class=\"wp-block-heading\" id=\"visual-studio-code-tools-for-ai\">Visual Studio Code Tools for AI<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Finally, we know that it\u2019s important for you to use the development tools of your choice, and we want to make that experience work seamlessly with our new services in Azure. We\u2019re pleased to announce our first editor integration with the release of the\u00a0<a href=\"https:\/\/marketplace.visualstudio.com\/items?itemName=ms-toolsai.vscode-ai#overview\">Visual Studio Code Tools for AI<\/a>. This extension provides a rich set of capabilities for building models with deep learning frameworks including\u00a0<a href=\"https:\/\/www.microsoft.com\/en-us\/cognitive-toolkit\/\" target=\"_blank\" rel=\"noreferrer noopener\">Microsoft Cognitive Toolkit (CNTK)<\/a>,\u00a0<a href=\"https:\/\/www.tensorflow.org\/\" target=\"_blank\" rel=\"noreferrer noopener\">Google TensorFlow<\/a>, Theano,\u00a0<a href=\"https:\/\/keras.io\/\" target=\"_blank\" rel=\"noreferrer noopener\">Keras<\/a>\u00a0and\u00a0<a href=\"https:\/\/caffe2.ai\/\" target=\"_blank\" rel=\"noreferrer noopener\">Caffe2<\/a>, while integrating with the Experimentation service for executing jobs locally and in the cloud, and for deployment with the Model Management services. \u00a0<\/p>\n\n\n<figure class=\"wp-block-image size-full\"><img decoding=\"async\" src=\"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-content\/uploads\/2017\/09\/aa2b485c-00a8-46de-ab42-4dce8db98cae.webp\" alt=\"graphical user interface, text, website\" class=\"wp-image-11098 webp-format\" data-orig-src=\"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-content\/uploads\/2017\/09\/aa2b485c-00a8-46de-ab42-4dce8db98cae.webp\"><\/figure>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"getting-started\">Getting started<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">If you\u2019re interested in learning more, head over and check out our documentation on how to deploy a new account in Azure. You can also find a great set of quick start guides, as well as detailed tutorials walking through the features of the service.<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li class=\"wp-block-list-item\"><a href=\"https:\/\/aka.ms\/aml-blog-setup\" target=\"_blank\" rel=\"noreferrer noopener\">Setup and installation<\/a><\/li>\n\n\n\n<li class=\"wp-block-list-item\"><a href=\"https:\/\/aka.ms\/aml-blog-iris\" target=\"_blank\" rel=\"noreferrer noopener\">Quick start sample \u2013 Iris<\/a>\u00a0<\/li>\n\n\n\n<li class=\"wp-block-list-item\"><a href=\"https:\/\/aka.ms\/aml-blog-more-iris\" target=\"_blank\" rel=\"noreferrer noopener\">In depth, three part Iris classification tutorial<\/a>\u00a0<\/li>\n\n\n\n<li class=\"wp-block-list-item\"><a href=\"https:\/\/aka.ms\/aml-blog-data-prep\" target=\"_blank\" rel=\"noreferrer noopener\">In depth data wrangling tutorial<\/a><\/li>\n<\/ul>\n\n\n\n<p class=\"wp-block-paragraph\">Data scientists on our team have put together detailed scenario walkthroughs, complete with sample data, for you to get started on some interesting challenges or adapt their techniques to your next problem, including:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li class=\"wp-block-list-item\"><a href=\"https:\/\/aka.ms\/aml-blog-image-class\" target=\"_blank\" rel=\"noreferrer noopener\">Aerial image classification<\/a><\/li>\n\n\n\n<li class=\"wp-block-list-item\"><a href=\"https:\/\/aka.ms\/aml-blog-document-analysis\" target=\"_blank\" rel=\"noreferrer noopener\">Document collection analysis<\/a><\/li>\n\n\n\n<li class=\"wp-block-list-item\"><a href=\"https:\/\/aka.ms\/aml-blog-predictive-maintenance\" target=\"_blank\" rel=\"noreferrer noopener\">Predictive maintenance<\/a><\/li>\n\n\n\n<li class=\"wp-block-list-item\"><a href=\"https:\/\/aka.ms\/aml-blog-time-series\" target=\"_blank\" rel=\"noreferrer noopener\">Time series based forecasting<\/a><\/li>\n<\/ul>\n\n\n\n<p class=\"wp-block-paragraph\">We\u2019re constantly working on and refreshing the documentation, if you have a comment or suggestion, please let us know.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"what-s-next\">What\u2019s next<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Today, these services and tools are available as a public preview in Azure. In the coming months, we will bring the service to GA while we continue to work with customers and use their feedback to guide the key features, updates, and global rollout. We invite you to engage with the team through our&nbsp;<a href=\"https:\/\/feedback.azure.com\/forums\/257792-machine-learning\" target=\"_blank\" rel=\"noreferrer noopener\">feedback site<\/a>, on our&nbsp;<a href=\"https:\/\/social.msdn.microsoft.com\/forums\/azure\/en-US\/home?forum=MachineLearning\" target=\"_blank\" rel=\"noreferrer noopener\">MSDN forum<\/a>, or tag us on twitter with the&nbsp;<a href=\"https:\/\/twitter.com\/search?q=%23AzureML&amp;src=typd\" target=\"_blank\" rel=\"noreferrer noopener\">#AzureML<\/a>. Senior PM Ted Way will be presenting a&nbsp;<a href=\"https:\/\/na01.safelinks.protection.outlook.com\/?url=https%3A%2F%2Finfo.microsoft.com%2Fbuilding-ai-applications.html&amp;data=02%7C01%7Ctedway%40microsoft.com%7Cb20082a1ab514d4eb16608d4fafc4d8a%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C636409408943049382&amp;sdata=YFNhwzeD3ApDzv1GDER%2BnaUpP4Pr1pBmDbEHmgdhu%2F4%3D&amp;reserved=0\" target=\"_blank\" rel=\"noreferrer noopener\">webinar<\/a>&nbsp;on October 4, 2017 if you\u2019re interested in learning more.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">This is the start of an exciting journey, and we can\u2019t wait to work with you on it!<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Earlier today, we disclosed a set of major updates to Azure Machine Learning designed for data scientists to build, deploy, manage, and monitor models at any scale.<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"ms_queue_id":[],"ep_exclude_from_search":false,"_classifai_error":"","_classifai_text_to_speech_error":"","_alt_title":"","footnotes":"","msx_community_cta_settings":[]},"categories":[1454,1485],"tags":[],"audience":[3057,3055,3053,3056],"content-type":[],"product":[1493],"tech-community":[],"topic":[],"coauthors":[1026],"class_list":["post-3490","post","type-post","status-publish","format-standard","hentry","category-ai-machine-learning","category-internet-of-things","audience-data-professionals","audience-developers","audience-it-decision-makers","audience-it-implementors","product-azure-machine-learning","review-flag-1680286581-364","review-flag-2-1680286581-601","review-flag-4-1680286581-250","review-flag-6-1680286581-909","review-flag-anywh-1680286580-635","review-flag-ga-1680286584-289","review-flag-iot-1680286585-835","review-flag-lever-1680286579-649","review-flag-machi-1680286585-314","review-flag-microsofts","review-flag-ml-1680286585-776","review-flag-new-1680286579-546","review-flag-priva-1680286584-258","review-flag-publi-1680286584-566","review-flag-vm-1680286585-143"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.2 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Diving deep into what\u2019s new with Azure Machine Learning | Microsoft Azure Blog<\/title>\n<meta name=\"description\" content=\"Earlier today, we disclosed a set of major updates to Azure Machine Learning designed for data scientists to build, deploy, manage, and monitor models at any scale. This has been in private preview\u2026\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/azure.microsoft.com\/en-us\/blog\/diving-deep-into-what-s-new-with-azure-machine-learning\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Diving deep into what\u2019s new with Azure Machine Learning | Microsoft Azure Blog\" \/>\n<meta property=\"og:description\" content=\"Earlier today, we disclosed a set of major updates to Azure Machine Learning designed for data scientists to build, deploy, manage, and monitor models at any scale. This has been in private preview\u2026\" \/>\n<meta property=\"og:url\" content=\"https:\/\/azure.microsoft.com\/en-us\/blog\/diving-deep-into-what-s-new-with-azure-machine-learning\/\" \/>\n<meta property=\"og:site_name\" content=\"Microsoft Azure Blog\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/microsoftazure\" \/>\n<meta property=\"article:published_time\" content=\"2017-09-25T00:00:00+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2025-06-25T15:44:39+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-content\/uploads\/2017\/09\/35c66879-a6b2-4fb8-8777-b7b5691ee24a.png\" \/>\n<meta name=\"author\" content=\"Matt Winkler\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@azure\" \/>\n<meta name=\"twitter:site\" content=\"@azure\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Matt Winkler\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"19 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/diving-deep-into-what-s-new-with-azure-machine-learning\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/diving-deep-into-what-s-new-with-azure-machine-learning\/\"},\"author\":[{\"@id\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/author\/matt-winkler\/\",\"@type\":\"Person\",\"@name\":\"Matt Winkler\"}],\"headline\":\"Diving deep into what\u2019s new with Azure Machine Learning\",\"datePublished\":\"2017-09-25T00:00:00+00:00\",\"dateModified\":\"2025-06-25T15:44:39+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/diving-deep-into-what-s-new-with-azure-machine-learning\/\"},\"wordCount\":3800,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/#organization\"},\"image\":{\"@id\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/diving-deep-into-what-s-new-with-azure-machine-learning\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-content\/uploads\/2017\/09\/35c66879-a6b2-4fb8-8777-b7b5691ee24a.png\",\"articleSection\":[\"AI + machine learning\",\"Internet of things\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\/\/azure.microsoft.com\/en-us\/blog\/diving-deep-into-what-s-new-with-azure-machine-learning\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/diving-deep-into-what-s-new-with-azure-machine-learning\/\",\"url\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/diving-deep-into-what-s-new-with-azure-machine-learning\/\",\"name\":\"Diving deep into what\u2019s new with Azure Machine Learning | Microsoft Azure Blog\",\"isPartOf\":{\"@id\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/diving-deep-into-what-s-new-with-azure-machine-learning\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/diving-deep-into-what-s-new-with-azure-machine-learning\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-content\/uploads\/2017\/09\/35c66879-a6b2-4fb8-8777-b7b5691ee24a.png\",\"datePublished\":\"2017-09-25T00:00:00+00:00\",\"dateModified\":\"2025-06-25T15:44:39+00:00\",\"description\":\"Earlier today, we disclosed a set of major updates to Azure Machine Learning designed for data scientists to build, deploy, manage, and monitor models at any scale. This has been in private preview\u2026\",\"breadcrumb\":{\"@id\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/diving-deep-into-what-s-new-with-azure-machine-learning\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/azure.microsoft.com\/en-us\/blog\/diving-deep-into-what-s-new-with-azure-machine-learning\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/diving-deep-into-what-s-new-with-azure-machine-learning\/#primaryimage\",\"url\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-content\/uploads\/2017\/09\/35c66879-a6b2-4fb8-8777-b7b5691ee24a.webp\",\"contentUrl\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-content\/uploads\/2017\/09\/35c66879-a6b2-4fb8-8777-b7b5691ee24a.webp\",\"width\":2447,\"height\":827,\"caption\":\"diagram\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/diving-deep-into-what-s-new-with-azure-machine-learning\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Blog home\",\"item\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"AI + machine learning\",\"item\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/category\/ai-machine-learning\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"Diving deep into what\u2019s new with Azure Machine Learning\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/#website\",\"url\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/\",\"name\":\"Microsoft Azure Blog\",\"description\":\"Get the latest Azure news, updates, and announcements from the Azure blog. From product updates to hot topics, hear from the Azure experts.\",\"publisher\":{\"@id\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/#organization\",\"name\":\"Microsoft Azure Blog\",\"url\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-content\/uploads\/2024\/06\/microsoft_logo.webp\",\"contentUrl\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-content\/uploads\/2024\/06\/microsoft_logo.webp\",\"width\":512,\"height\":512,\"caption\":\"Microsoft Azure Blog\"},\"image\":{\"@id\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"https:\/\/www.facebook.com\/microsoftazure\",\"https:\/\/x.com\/azure\",\"https:\/\/www.instagram.com\/microsoftdeveloper\/\",\"https:\/\/www.linkedin.com\/company\/16188386\",\"https:\/\/www.youtube.com\/user\/windowsazure\"]},{\"@type\":\"Person\",\"@id\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/#\/schema\/person\/c702e5edd662b328b49b7e1180cab117\",\"name\":\"shakir\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/secure.gravatar.com\/avatar\/9342c7c05bb16548741bc5cd3a3e3b7ee0c8e746844ad2cc582db5beb5514c6f?s=96&d=mm&r=g7664e653ea371ce16eaf75e9fa8952c4\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/9342c7c05bb16548741bc5cd3a3e3b7ee0c8e746844ad2cc582db5beb5514c6f?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/9342c7c05bb16548741bc5cd3a3e3b7ee0c8e746844ad2cc582db5beb5514c6f?s=96&d=mm&r=g\",\"caption\":\"shakir\"},\"sameAs\":[\"https:\/\/azure.microsoft.com\"],\"url\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/author\/shakir\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Diving deep into what\u2019s new with Azure Machine Learning | Microsoft Azure Blog","description":"Earlier today, we disclosed a set of major updates to Azure Machine Learning designed for data scientists to build, deploy, manage, and monitor models at any scale. This has been in private preview\u2026","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/azure.microsoft.com\/en-us\/blog\/diving-deep-into-what-s-new-with-azure-machine-learning\/","og_locale":"en_US","og_type":"article","og_title":"Diving deep into what\u2019s new with Azure Machine Learning | Microsoft Azure Blog","og_description":"Earlier today, we disclosed a set of major updates to Azure Machine Learning designed for data scientists to build, deploy, manage, and monitor models at any scale. This has been in private preview\u2026","og_url":"https:\/\/azure.microsoft.com\/en-us\/blog\/diving-deep-into-what-s-new-with-azure-machine-learning\/","og_site_name":"Microsoft Azure Blog","article_publisher":"https:\/\/www.facebook.com\/microsoftazure","article_published_time":"2017-09-25T00:00:00+00:00","article_modified_time":"2025-06-25T15:44:39+00:00","og_image":[{"url":"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-content\/uploads\/2017\/09\/35c66879-a6b2-4fb8-8777-b7b5691ee24a.png","type":"","width":"","height":""}],"author":"Matt Winkler","twitter_card":"summary_large_image","twitter_creator":"@azure","twitter_site":"@azure","twitter_misc":{"Written by":"Matt Winkler","Est. reading time":"19 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/azure.microsoft.com\/en-us\/blog\/diving-deep-into-what-s-new-with-azure-machine-learning\/#article","isPartOf":{"@id":"https:\/\/azure.microsoft.com\/en-us\/blog\/diving-deep-into-what-s-new-with-azure-machine-learning\/"},"author":[{"@id":"https:\/\/azure.microsoft.com\/en-us\/blog\/author\/matt-winkler\/","@type":"Person","@name":"Matt Winkler"}],"headline":"Diving deep into what\u2019s new with Azure Machine Learning","datePublished":"2017-09-25T00:00:00+00:00","dateModified":"2025-06-25T15:44:39+00:00","mainEntityOfPage":{"@id":"https:\/\/azure.microsoft.com\/en-us\/blog\/diving-deep-into-what-s-new-with-azure-machine-learning\/"},"wordCount":3800,"commentCount":0,"publisher":{"@id":"https:\/\/azure.microsoft.com\/en-us\/blog\/#organization"},"image":{"@id":"https:\/\/azure.microsoft.com\/en-us\/blog\/diving-deep-into-what-s-new-with-azure-machine-learning\/#primaryimage"},"thumbnailUrl":"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-content\/uploads\/2017\/09\/35c66879-a6b2-4fb8-8777-b7b5691ee24a.png","articleSection":["AI + machine learning","Internet of things"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/azure.microsoft.com\/en-us\/blog\/diving-deep-into-what-s-new-with-azure-machine-learning\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/azure.microsoft.com\/en-us\/blog\/diving-deep-into-what-s-new-with-azure-machine-learning\/","url":"https:\/\/azure.microsoft.com\/en-us\/blog\/diving-deep-into-what-s-new-with-azure-machine-learning\/","name":"Diving deep into what\u2019s new with Azure Machine Learning | Microsoft Azure Blog","isPartOf":{"@id":"https:\/\/azure.microsoft.com\/en-us\/blog\/#website"},"primaryImageOfPage":{"@id":"https:\/\/azure.microsoft.com\/en-us\/blog\/diving-deep-into-what-s-new-with-azure-machine-learning\/#primaryimage"},"image":{"@id":"https:\/\/azure.microsoft.com\/en-us\/blog\/diving-deep-into-what-s-new-with-azure-machine-learning\/#primaryimage"},"thumbnailUrl":"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-content\/uploads\/2017\/09\/35c66879-a6b2-4fb8-8777-b7b5691ee24a.png","datePublished":"2017-09-25T00:00:00+00:00","dateModified":"2025-06-25T15:44:39+00:00","description":"Earlier today, we disclosed a set of major updates to Azure Machine Learning designed for data scientists to build, deploy, manage, and monitor models at any scale. This has been in private preview\u2026","breadcrumb":{"@id":"https:\/\/azure.microsoft.com\/en-us\/blog\/diving-deep-into-what-s-new-with-azure-machine-learning\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/azure.microsoft.com\/en-us\/blog\/diving-deep-into-what-s-new-with-azure-machine-learning\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/azure.microsoft.com\/en-us\/blog\/diving-deep-into-what-s-new-with-azure-machine-learning\/#primaryimage","url":"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-content\/uploads\/2017\/09\/35c66879-a6b2-4fb8-8777-b7b5691ee24a.webp","contentUrl":"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-content\/uploads\/2017\/09\/35c66879-a6b2-4fb8-8777-b7b5691ee24a.webp","width":2447,"height":827,"caption":"diagram"},{"@type":"BreadcrumbList","@id":"https:\/\/azure.microsoft.com\/en-us\/blog\/diving-deep-into-what-s-new-with-azure-machine-learning\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Blog home","item":"https:\/\/azure.microsoft.com\/en-us\/blog\/"},{"@type":"ListItem","position":2,"name":"AI + machine learning","item":"https:\/\/azure.microsoft.com\/en-us\/blog\/category\/ai-machine-learning\/"},{"@type":"ListItem","position":3,"name":"Diving deep into what\u2019s new with Azure Machine Learning"}]},{"@type":"WebSite","@id":"https:\/\/azure.microsoft.com\/en-us\/blog\/#website","url":"https:\/\/azure.microsoft.com\/en-us\/blog\/","name":"Microsoft Azure Blog","description":"Get the latest Azure news, updates, and announcements from the Azure blog. From product updates to hot topics, hear from the Azure experts.","publisher":{"@id":"https:\/\/azure.microsoft.com\/en-us\/blog\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/azure.microsoft.com\/en-us\/blog\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/azure.microsoft.com\/en-us\/blog\/#organization","name":"Microsoft Azure Blog","url":"https:\/\/azure.microsoft.com\/en-us\/blog\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/azure.microsoft.com\/en-us\/blog\/#\/schema\/logo\/image\/","url":"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-content\/uploads\/2024\/06\/microsoft_logo.webp","contentUrl":"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-content\/uploads\/2024\/06\/microsoft_logo.webp","width":512,"height":512,"caption":"Microsoft Azure Blog"},"image":{"@id":"https:\/\/azure.microsoft.com\/en-us\/blog\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/microsoftazure","https:\/\/x.com\/azure","https:\/\/www.instagram.com\/microsoftdeveloper\/","https:\/\/www.linkedin.com\/company\/16188386","https:\/\/www.youtube.com\/user\/windowsazure"]},{"@type":"Person","@id":"https:\/\/azure.microsoft.com\/en-us\/blog\/#\/schema\/person\/c702e5edd662b328b49b7e1180cab117","name":"shakir","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/9342c7c05bb16548741bc5cd3a3e3b7ee0c8e746844ad2cc582db5beb5514c6f?s=96&d=mm&r=g7664e653ea371ce16eaf75e9fa8952c4","url":"https:\/\/secure.gravatar.com\/avatar\/9342c7c05bb16548741bc5cd3a3e3b7ee0c8e746844ad2cc582db5beb5514c6f?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/9342c7c05bb16548741bc5cd3a3e3b7ee0c8e746844ad2cc582db5beb5514c6f?s=96&d=mm&r=g","caption":"shakir"},"sameAs":["https:\/\/azure.microsoft.com"],"url":"https:\/\/azure.microsoft.com\/en-us\/blog\/author\/shakir\/"}]}},"msxcm_display_generated_audio":false,"msxcm_animated_featured_image":null,"distributor_meta":false,"distributor_terms":false,"distributor_media":false,"distributor_original_site_name":"Microsoft Azure Blog","distributor_original_site_url":"https:\/\/azure.microsoft.com\/en-us\/blog","push-errors":false,"_links":{"self":[{"href":"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-json\/wp\/v2\/posts\/3490","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-json\/wp\/v2\/comments?post=3490"}],"version-history":[{"count":1,"href":"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-json\/wp\/v2\/posts\/3490\/revisions"}],"predecessor-version":[{"id":43403,"href":"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-json\/wp\/v2\/posts\/3490\/revisions\/43403"}],"wp:attachment":[{"href":"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-json\/wp\/v2\/media?parent=3490"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-json\/wp\/v2\/categories?post=3490"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-json\/wp\/v2\/tags?post=3490"},{"taxonomy":"audience","embeddable":true,"href":"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-json\/wp\/v2\/audience?post=3490"},{"taxonomy":"content-type","embeddable":true,"href":"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-json\/wp\/v2\/content-type?post=3490"},{"taxonomy":"product","embeddable":true,"href":"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-json\/wp\/v2\/product?post=3490"},{"taxonomy":"tech-community","embeddable":true,"href":"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-json\/wp\/v2\/tech-community?post=3490"},{"taxonomy":"topic","embeddable":true,"href":"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-json\/wp\/v2\/topic?post=3490"},{"taxonomy":"author","embeddable":true,"href":"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-json\/wp\/v2\/coauthors?post=3490"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}