General availability: Azure Machine Learning Output Datasets
Published date: January 28, 2021
Output Datasets in Azure Machine Learning can help read data in the cloud in a secure manner, with capabilities like versioning and lineage for tracking and audit. Datasets create a reference to the data source location along with a copy of metadata, prevents duplication of data, brings no extra storage costs, and provides integrity of data source, while enabling reproducibility.
View the API Reference.
Sample notebook:
https://aka.ms/pipeline-with-dataset