Azure Data Lake Analytics introduces capabilities to manage pipelines and recurring jobs

Monday, October 2, 2017

The Azure Data Lake Analytics service can now help you easily organize, manage, and gain insights from Data Lake Analytics jobs that are running as part of pipelines or on a recurring basis. New capabilities enable you to:

  • Quickly identify jobs in pipelines that might have failed or taken longer than expected.
  • Get the aggregated statistics (job counts, successful and failed AU hours, and so on) for a pipeline or a recurring instance so you can better understand the resource consumption and cost trends.

For detailed use cases, technical documentation, and information on how to get started with these capabilities, see:

Data Lake Analytics jobs submitted as part of Azure Data Factory V2 pipelines automatically benefit from the new capabilities with no additional work on your part. If you are using Azure Data Factory V1 to create pipelines composed of one or more Data Lake Analytics activities (or are looking for a data movement and job orchestration service on Azure), we recommend reviewing Data Factory V2.

Free account

Get $200 in Azure credits and 12 months of popular services—free

Start free

Visual Studio

Subscribers get up to $1800 per year of Azure services

Activate now

Startups

Join the BizSpark program and get free Azure services

Learn more