Data Factory
Hybrid data integration, at global scale
- Create, schedule and monitor data pipelines
- Fully managed ETL service in the cloud
- Run your SQL Server Integration Services packages directly in Azure
- Accelerate your data integration with multiple native data connectors
- Modernise your data warehouse with big data integration
- Orchestrate your data integration workflows wherever your data lives
Overview
Create, schedule and manage your data integration at scale with Azure Data Factory – a hybrid data integration (ETL) service. Work with data wherever it lives, in the cloud or on-premises, with enterprise-grade security.
Accelerate your data integration projects by taking advantage of over 70 available data source connectors. Use the graphical user interface to build and manage your data pipelines. Transform raw data into finished, shaped data ready for consumption by business intelligence tools or custom applications. Easily lift your SQL Server Integration Services (SSIS) packages to Azure, and let Azure Data Factory manage your resources for you so you can increase productivity and lower your total cost of ownership (TCO).
Customers using Azure Data Factory:
Why Azure Data Factory?
Productive
Build automated data integration solutions with a visual drag-and-drop UI. Move data seamlessly from over 60 sources without writing code.
Hybrid
Build data integration pipelines that span on-premises and cloud. Easily lift your SQL Server Integration Services (SSIS) packages to Azure.
Trusted
Data movement using Azure Data Factory has been certified by HIPAA/HITECH, ISO/IEC 27001, ISO/IEC 27018 and CSA STAR.
Scalable
Build serverless, cloud-based data integration with no infrastructure to manage. Take advantage of elastic capabilities to scale out with your customer growth.
What comes with Azure Data Factory?
Visual drag-and-drop UI
Maximise productivity by getting pipelines up and running quickly. Use the code-free drag-and-drop interface to build, deploy, monitor and manage your data integration. Connect this visual tool directly to your Git repository for a seamless development workflow.
Multiple language support
Use the visual interface or write your own code in Python, .NET or ARM to build pipelines using your existing skills. Choose from a wide range of processing services and put them into managed data pipelines to use the best tool for the job, or insert custom code as a processing step in any pipeline.
SSIS package execution in Azure
Easily execute and schedule your SSIS packages in managed execution environment. Gain high availability, scalability and lower TCO by lifting your SSIS packages to Azure.
Code-free data movement
Improve your TCO with more than 70 natively supported connectors including Azure data services, AWS S3 and Redshift, Google BigQuery, SAP HANA, Oracle, DB2, MongoDB and many more across multiple global points of presence.
Comprehensive control flow
Facilitate looping, branching, conditional constructs, on-demand executions and flexible scheduling with extensive control flow constructs.
Data integration with Azure Data Factory
Step 1: Access and ingest data with built-in connectors
Move data from on-premises and cloud sources to a centralised data store in the cloud for further analysis by using the Copy Data activity in a data pipeline.
Step 2: Build scalable data flow with codeless UI, or write your own code
Build data integration, and easily transform and integrate big data processing and machine learning with the visual interface.
Step 3: Schedule, run and monitor your pipelines
Invoke pipelines with on-demand and trigger-based scheduling. Visually monitor pipeline activity with logging and pipeline history, and track error sources.
What can you do with Azure Data Factory?
Modernise your data warehouse
Integrate structured and unstructured data from on-premises and cloud data sources, transform data in big data and data warehouse engines, then load your data marts into Azure SQL Data Warehouse for business analytics.
Modern data-driven applications
Build custom data-driven cloud applications that embed a data integration experience with global scale.
SSIS package execution in Azure
Easily execute and schedule your SSIS packages in managed execution environment. Gain high availability, scalability and lower TCO by lifting your SSIS packages to Azure.
Get up and running on Azure Data Factory with a hands-on lab
You’ll learn how to:
- Lift SSIS packages to Azure.
- Modernise your data warehouse.
- Schedule and monitor your Data Factory pipelines.
Read this e-book to learn how to lift your SQL Server Integration Services packages to Azure with Data Factory.
Read the e-bookRead this Data Factory whitepaper and learn how to build Data Factory pipelines in order to:
- Modernise your data warehouse.
- Build intelligent data-driven applications.
- Lift your SQL Server Integration Services packages to Azure.
Related products and services
SQL Data Warehouse
Elastic data warehouse as a service with enterprise-class features
Azure Databricks
Fast, easy and collaborative Apache Spark-based analytics platform
Azure Cosmos DB
Globally distributed, multi-model database for any scale
Resources
Service updates