{"id":1526,"date":"2019-03-25T00:00:00","date_gmt":"2019-03-25T00:00:00","guid":{"rendered":""},"modified":"2025-06-18T13:46:30","modified_gmt":"2025-06-18T20:46:30","slug":"incrementally-copy-new-files-by-lastmodifieddate-with-azure-data-factory","status":"publish","type":"post","link":"https:\/\/azure.microsoft.com\/en-us\/blog\/incrementally-copy-new-files-by-lastmodifieddate-with-azure-data-factory\/","title":{"rendered":"Incrementally copy new files by LastModifiedDate with Azure Data Factory"},"content":{"rendered":"\n<p class=\"wp-block-paragraph\"><a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/data-factory\/\" target=\"_blank\" rel=\"noopener\">Azure Data Factory<\/a> (ADF) is the fully-managed data integration service for analytics workloads in Azure. Using ADF, users can load the lake from <a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/data-factory\/copy-activity-overview#supported-data-stores-and-formats\" target=\"_blank\" rel=\"noopener\">80 plus data sources<\/a> on-premises and in the cloud, use a <a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/data-factory\/transform-data\" target=\"_blank\" rel=\"noopener\">rich set of transform activities<\/a> to prep, cleanse, and process the data using Azure analytics engines, while also landing the curated data into a data warehouse for getting innovative analytics and insights.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">When you start to build the end to end data integration flow the first challenge is to extract data from different data stores, where incrementally (or delta) loading data after an initial full load is widely used at this stage. Now, ADF provides a new capability for you to incrementally copy new or changed files only by <strong>LastModifiedDate<\/strong> from a file-based store. By using this new feature, you do not need to partition the data by time-based folder or file name. The new or changed file will be automatically selected by its metadata<strong> LastModifiedDate<\/strong> and copied to the destination store.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The feature is available when loading data from <a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/data-factory\/connector-azure-blob-storage\" target=\"_blank\" rel=\"noopener\">Azure Blob Storage<\/a>, <a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/data-factory\/connector-azure-data-lake-store\" target=\"_blank\" rel=\"noopener\">Azure Data Lake Storage Gen1<\/a>, <a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/data-factory\/connector-azure-data-lake-storage\" target=\"_blank\" rel=\"noopener\">Azure Data Lake Storage Gen2<\/a>, <a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/data-factory\/connector-amazon-simple-storage-service\" target=\"_blank\" rel=\"noopener\">Amazon S3<\/a>, <a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/data-factory\/connector-file-system\" target=\"_blank\" rel=\"noopener\">File System<\/a>, <a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/data-factory\/connector-sftp\" target=\"_blank\" rel=\"noopener\">SFTP<\/a>, and <a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/data-factory\/connector-hdfs\">HDFS<\/a>.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The resources for this feature are as follows:<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">1. You can visit our tutorial, \u201c<a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/data-factory\/tutorial-incremental-copy-lastmodified-copy-data-tool\" target=\"_blank\" rel=\"noopener\">Incrementally copy new and changed files based on LastModifiedDate by using the Copy Data tool<\/a>\u201d to help you get your first pipeline with incrementally copying new and changed files only based on their <strong>LastModifiedDate<\/strong> from Azure Blob storage to Azure Blob storage by using copy data tool.<\/p>\n\n\n\n<figure class=\"wp-block-image has-custom-border\"><img decoding=\"async\" src=\"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-content\/uploads\/2019\/03\/copy-wizard-3.webp\" alt=\"\" style=\"border-radius:0px\" \/><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\">2. You can also leverage our template from template gallery, \u201c<a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/data-factory\/solution-template-copy-new-files-lastmodifieddate\" target=\"_blank\" rel=\"noopener\">Copy new and changed files by LastModifiedDate with Azure Data Factory<\/a>\u201d to increase your time to solution and provide you enough flexibility to build a pipeline with the capability of incrementally copying new and changed files only based on their <strong>LastModifiedDate<\/strong>.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-content\/uploads\/2019\/03\/Solution_Template.webp\" alt=\"\" width=\"640\" height=\"466\">3. You can also start from scratch to get that feature from ADF UI.<\/p>\n\n\n\n<figure class=\"wp-block-image has-custom-border\"><img decoding=\"async\" src=\"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-content\/uploads\/2019\/03\/UI-1.webp\" alt=\"\" style=\"border-radius:0px\" \/><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\">4. You can write code to get that feature from ADF SDK.<\/p>\n\n\n\n<figure class=\"wp-block-image has-custom-border\"><img decoding=\"async\" src=\"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-content\/uploads\/2019\/03\/SDK.webp\" alt=\"\" style=\"border-radius:0px\" \/><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\">You are encouraged to give these additions a try and provide us with feedback. We hope you find them helpful in your scenarios. Please post your questions on <a href=\"https:\/\/social.msdn.microsoft.com\/Forums\/azure\/en-US\/home?forum=AzureDataFactory\" target=\"_blank\" rel=\"noopener\">Azure Data Factory forum<\/a> or share your thoughts with us on <a href=\"https:\/\/feedback.azure.com\/forums\/270578-data-factory\" target=\"_blank\" rel=\"noopener\">Data Factory feedback site<\/a>.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Azure Data Factory (ADF) is the fully-managed data integration service for analytics workloads in Azure.<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"ms_queue_id":[],"ep_exclude_from_search":false,"_classifai_error":"","_classifai_text_to_speech_error":"","_alt_title":"","footnotes":"","msx_community_cta_settings":[]},"categories":[1474,1473],"tags":[48],"audience":[3054,3057,3053],"content-type":[],"product":[1821],"tech-community":[],"topic":[],"coauthors":[589],"class_list":["post-1526","post","type-post","status-publish","format-standard","hentry","category-analytics","category-databases","tag-big-data","audience-business-decision-makers","audience-data-professionals","audience-it-decision-makers","product-azure-data-factory","review-flag-1-1680286581-825","review-flag-2-1680286581-601","review-flag-3-1680286581-173","review-flag-4-1680286581-250","review-flag-lever-1680286579-649","review-flag-new-1680286579-546"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.2 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Incrementally copy new files by LastModifiedDate with Azure Data Factory | Microsoft Azure Blog<\/title>\n<meta name=\"description\" content=\"Learn how Azure Data Factory enables incremental copying of new or changed files based on LastModifiedDate.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/azure.microsoft.com\/en-us\/blog\/incrementally-copy-new-files-by-lastmodifieddate-with-azure-data-factory\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Incrementally copy new files by LastModifiedDate with Azure Data Factory | Microsoft Azure Blog\" \/>\n<meta property=\"og:description\" content=\"Learn how Azure Data Factory enables incremental copying of new or changed files based on LastModifiedDate.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/azure.microsoft.com\/en-us\/blog\/incrementally-copy-new-files-by-lastmodifieddate-with-azure-data-factory\/\" \/>\n<meta property=\"og:site_name\" content=\"Microsoft Azure Blog\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/microsoftazure\" \/>\n<meta property=\"article:published_time\" content=\"2019-03-25T00:00:00+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2025-06-18T20:46:30+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-content\/uploads\/2019\/03\/copy-wizard-3.webp\" \/>\n<meta name=\"author\" content=\"Ye Xu\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@azure\" \/>\n<meta name=\"twitter:site\" content=\"@azure\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Ye Xu\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/incrementally-copy-new-files-by-lastmodifieddate-with-azure-data-factory\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/incrementally-copy-new-files-by-lastmodifieddate-with-azure-data-factory\/\"},\"author\":[{\"@id\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/author\/ye-xu\/\",\"@type\":\"Person\",\"@name\":\"Ye Xu\"}],\"headline\":\"Incrementally copy new files by LastModifiedDate with Azure Data Factory\",\"datePublished\":\"2019-03-25T00:00:00+00:00\",\"dateModified\":\"2025-06-18T20:46:30+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/incrementally-copy-new-files-by-lastmodifieddate-with-azure-data-factory\/\"},\"wordCount\":380,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/#organization\"},\"image\":{\"@id\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/incrementally-copy-new-files-by-lastmodifieddate-with-azure-data-factory\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-content\/uploads\/2019\/03\/copy-wizard-3.webp\",\"keywords\":[\"Big Data\"],\"articleSection\":[\"Analytics\",\"Databases\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\/\/azure.microsoft.com\/en-us\/blog\/incrementally-copy-new-files-by-lastmodifieddate-with-azure-data-factory\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/incrementally-copy-new-files-by-lastmodifieddate-with-azure-data-factory\/\",\"url\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/incrementally-copy-new-files-by-lastmodifieddate-with-azure-data-factory\/\",\"name\":\"Incrementally copy new files by LastModifiedDate with Azure Data Factory | Microsoft Azure Blog\",\"isPartOf\":{\"@id\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/incrementally-copy-new-files-by-lastmodifieddate-with-azure-data-factory\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/incrementally-copy-new-files-by-lastmodifieddate-with-azure-data-factory\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-content\/uploads\/2019\/03\/copy-wizard-3.webp\",\"datePublished\":\"2019-03-25T00:00:00+00:00\",\"dateModified\":\"2025-06-18T20:46:30+00:00\",\"description\":\"Learn how Azure Data Factory enables incremental copying of new or changed files based on LastModifiedDate.\",\"breadcrumb\":{\"@id\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/incrementally-copy-new-files-by-lastmodifieddate-with-azure-data-factory\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/azure.microsoft.com\/en-us\/blog\/incrementally-copy-new-files-by-lastmodifieddate-with-azure-data-factory\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/incrementally-copy-new-files-by-lastmodifieddate-with-azure-data-factory\/#primaryimage\",\"url\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-content\/uploads\/2019\/03\/copy-wizard-3.webp\",\"contentUrl\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-content\/uploads\/2019\/03\/copy-wizard-3.webp\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/incrementally-copy-new-files-by-lastmodifieddate-with-azure-data-factory\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Blog home\",\"item\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Analytics\",\"item\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/category\/analytics\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"Incrementally copy new files by LastModifiedDate with Azure Data Factory\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/#website\",\"url\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/\",\"name\":\"Microsoft Azure Blog\",\"description\":\"Get the latest Azure news, updates, and announcements from the Azure blog. From product updates to hot topics, hear from the Azure experts.\",\"publisher\":{\"@id\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/#organization\",\"name\":\"Microsoft Azure Blog\",\"url\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-content\/uploads\/2024\/06\/microsoft_logo.webp\",\"contentUrl\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-content\/uploads\/2024\/06\/microsoft_logo.webp\",\"width\":512,\"height\":512,\"caption\":\"Microsoft Azure Blog\"},\"image\":{\"@id\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"https:\/\/www.facebook.com\/microsoftazure\",\"https:\/\/x.com\/azure\",\"https:\/\/www.instagram.com\/microsoftdeveloper\/\",\"https:\/\/www.linkedin.com\/company\/16188386\",\"https:\/\/www.youtube.com\/user\/windowsazure\"]},{\"@type\":\"Person\",\"@id\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/#\/schema\/person\/c702e5edd662b328b49b7e1180cab117\",\"name\":\"shakir\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/secure.gravatar.com\/avatar\/9342c7c05bb16548741bc5cd3a3e3b7ee0c8e746844ad2cc582db5beb5514c6f?s=96&d=mm&r=g7664e653ea371ce16eaf75e9fa8952c4\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/9342c7c05bb16548741bc5cd3a3e3b7ee0c8e746844ad2cc582db5beb5514c6f?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/9342c7c05bb16548741bc5cd3a3e3b7ee0c8e746844ad2cc582db5beb5514c6f?s=96&d=mm&r=g\",\"caption\":\"shakir\"},\"sameAs\":[\"https:\/\/azure.microsoft.com\"],\"url\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/author\/shakir\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Incrementally copy new files by LastModifiedDate with Azure Data Factory | Microsoft Azure Blog","description":"Learn how Azure Data Factory enables incremental copying of new or changed files based on LastModifiedDate.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/azure.microsoft.com\/en-us\/blog\/incrementally-copy-new-files-by-lastmodifieddate-with-azure-data-factory\/","og_locale":"en_US","og_type":"article","og_title":"Incrementally copy new files by LastModifiedDate with Azure Data Factory | Microsoft Azure Blog","og_description":"Learn how Azure Data Factory enables incremental copying of new or changed files based on LastModifiedDate.","og_url":"https:\/\/azure.microsoft.com\/en-us\/blog\/incrementally-copy-new-files-by-lastmodifieddate-with-azure-data-factory\/","og_site_name":"Microsoft Azure Blog","article_publisher":"https:\/\/www.facebook.com\/microsoftazure","article_published_time":"2019-03-25T00:00:00+00:00","article_modified_time":"2025-06-18T20:46:30+00:00","og_image":[{"url":"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-content\/uploads\/2019\/03\/copy-wizard-3.webp","type":"","width":"","height":""}],"author":"Ye Xu","twitter_card":"summary_large_image","twitter_creator":"@azure","twitter_site":"@azure","twitter_misc":{"Written by":"Ye Xu","Est. reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/azure.microsoft.com\/en-us\/blog\/incrementally-copy-new-files-by-lastmodifieddate-with-azure-data-factory\/#article","isPartOf":{"@id":"https:\/\/azure.microsoft.com\/en-us\/blog\/incrementally-copy-new-files-by-lastmodifieddate-with-azure-data-factory\/"},"author":[{"@id":"https:\/\/azure.microsoft.com\/en-us\/blog\/author\/ye-xu\/","@type":"Person","@name":"Ye Xu"}],"headline":"Incrementally copy new files by LastModifiedDate with Azure Data Factory","datePublished":"2019-03-25T00:00:00+00:00","dateModified":"2025-06-18T20:46:30+00:00","mainEntityOfPage":{"@id":"https:\/\/azure.microsoft.com\/en-us\/blog\/incrementally-copy-new-files-by-lastmodifieddate-with-azure-data-factory\/"},"wordCount":380,"commentCount":0,"publisher":{"@id":"https:\/\/azure.microsoft.com\/en-us\/blog\/#organization"},"image":{"@id":"https:\/\/azure.microsoft.com\/en-us\/blog\/incrementally-copy-new-files-by-lastmodifieddate-with-azure-data-factory\/#primaryimage"},"thumbnailUrl":"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-content\/uploads\/2019\/03\/copy-wizard-3.webp","keywords":["Big Data"],"articleSection":["Analytics","Databases"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/azure.microsoft.com\/en-us\/blog\/incrementally-copy-new-files-by-lastmodifieddate-with-azure-data-factory\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/azure.microsoft.com\/en-us\/blog\/incrementally-copy-new-files-by-lastmodifieddate-with-azure-data-factory\/","url":"https:\/\/azure.microsoft.com\/en-us\/blog\/incrementally-copy-new-files-by-lastmodifieddate-with-azure-data-factory\/","name":"Incrementally copy new files by LastModifiedDate with Azure Data Factory | Microsoft Azure Blog","isPartOf":{"@id":"https:\/\/azure.microsoft.com\/en-us\/blog\/#website"},"primaryImageOfPage":{"@id":"https:\/\/azure.microsoft.com\/en-us\/blog\/incrementally-copy-new-files-by-lastmodifieddate-with-azure-data-factory\/#primaryimage"},"image":{"@id":"https:\/\/azure.microsoft.com\/en-us\/blog\/incrementally-copy-new-files-by-lastmodifieddate-with-azure-data-factory\/#primaryimage"},"thumbnailUrl":"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-content\/uploads\/2019\/03\/copy-wizard-3.webp","datePublished":"2019-03-25T00:00:00+00:00","dateModified":"2025-06-18T20:46:30+00:00","description":"Learn how Azure Data Factory enables incremental copying of new or changed files based on LastModifiedDate.","breadcrumb":{"@id":"https:\/\/azure.microsoft.com\/en-us\/blog\/incrementally-copy-new-files-by-lastmodifieddate-with-azure-data-factory\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/azure.microsoft.com\/en-us\/blog\/incrementally-copy-new-files-by-lastmodifieddate-with-azure-data-factory\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/azure.microsoft.com\/en-us\/blog\/incrementally-copy-new-files-by-lastmodifieddate-with-azure-data-factory\/#primaryimage","url":"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-content\/uploads\/2019\/03\/copy-wizard-3.webp","contentUrl":"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-content\/uploads\/2019\/03\/copy-wizard-3.webp"},{"@type":"BreadcrumbList","@id":"https:\/\/azure.microsoft.com\/en-us\/blog\/incrementally-copy-new-files-by-lastmodifieddate-with-azure-data-factory\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Blog home","item":"https:\/\/azure.microsoft.com\/en-us\/blog\/"},{"@type":"ListItem","position":2,"name":"Analytics","item":"https:\/\/azure.microsoft.com\/en-us\/blog\/category\/analytics\/"},{"@type":"ListItem","position":3,"name":"Incrementally copy new files by LastModifiedDate with Azure Data Factory"}]},{"@type":"WebSite","@id":"https:\/\/azure.microsoft.com\/en-us\/blog\/#website","url":"https:\/\/azure.microsoft.com\/en-us\/blog\/","name":"Microsoft Azure Blog","description":"Get the latest Azure news, updates, and announcements from the Azure blog. From product updates to hot topics, hear from the Azure experts.","publisher":{"@id":"https:\/\/azure.microsoft.com\/en-us\/blog\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/azure.microsoft.com\/en-us\/blog\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/azure.microsoft.com\/en-us\/blog\/#organization","name":"Microsoft Azure Blog","url":"https:\/\/azure.microsoft.com\/en-us\/blog\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/azure.microsoft.com\/en-us\/blog\/#\/schema\/logo\/image\/","url":"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-content\/uploads\/2024\/06\/microsoft_logo.webp","contentUrl":"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-content\/uploads\/2024\/06\/microsoft_logo.webp","width":512,"height":512,"caption":"Microsoft Azure Blog"},"image":{"@id":"https:\/\/azure.microsoft.com\/en-us\/blog\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/microsoftazure","https:\/\/x.com\/azure","https:\/\/www.instagram.com\/microsoftdeveloper\/","https:\/\/www.linkedin.com\/company\/16188386","https:\/\/www.youtube.com\/user\/windowsazure"]},{"@type":"Person","@id":"https:\/\/azure.microsoft.com\/en-us\/blog\/#\/schema\/person\/c702e5edd662b328b49b7e1180cab117","name":"shakir","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/9342c7c05bb16548741bc5cd3a3e3b7ee0c8e746844ad2cc582db5beb5514c6f?s=96&d=mm&r=g7664e653ea371ce16eaf75e9fa8952c4","url":"https:\/\/secure.gravatar.com\/avatar\/9342c7c05bb16548741bc5cd3a3e3b7ee0c8e746844ad2cc582db5beb5514c6f?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/9342c7c05bb16548741bc5cd3a3e3b7ee0c8e746844ad2cc582db5beb5514c6f?s=96&d=mm&r=g","caption":"shakir"},"sameAs":["https:\/\/azure.microsoft.com"],"url":"https:\/\/azure.microsoft.com\/en-us\/blog\/author\/shakir\/"}]}},"msxcm_display_generated_audio":false,"msxcm_animated_featured_image":null,"distributor_meta":false,"distributor_terms":false,"distributor_media":false,"distributor_original_site_name":"Microsoft Azure Blog","distributor_original_site_url":"https:\/\/azure.microsoft.com\/en-us\/blog","push-errors":false,"_links":{"self":[{"href":"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-json\/wp\/v2\/posts\/1526","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-json\/wp\/v2\/comments?post=1526"}],"version-history":[{"count":1,"href":"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-json\/wp\/v2\/posts\/1526\/revisions"}],"predecessor-version":[{"id":42411,"href":"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-json\/wp\/v2\/posts\/1526\/revisions\/42411"}],"wp:attachment":[{"href":"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-json\/wp\/v2\/media?parent=1526"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-json\/wp\/v2\/categories?post=1526"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-json\/wp\/v2\/tags?post=1526"},{"taxonomy":"audience","embeddable":true,"href":"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-json\/wp\/v2\/audience?post=1526"},{"taxonomy":"content-type","embeddable":true,"href":"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-json\/wp\/v2\/content-type?post=1526"},{"taxonomy":"product","embeddable":true,"href":"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-json\/wp\/v2\/product?post=1526"},{"taxonomy":"tech-community","embeddable":true,"href":"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-json\/wp\/v2\/tech-community?post=1526"},{"taxonomy":"topic","embeddable":true,"href":"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-json\/wp\/v2\/topic?post=1526"},{"taxonomy":"author","embeddable":true,"href":"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-json\/wp\/v2\/coauthors?post=1526"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}