Data Factory adds Flatten transformation, single-row lookups, and updated UI for container activities
Published date: March 04, 2020
Azure Data Factory adds new updates to Data Flow transformations
A new Flatten transformation has been introduced and will light-up next week in Data Flows. This will allow you to take arrays inside of hierarchical data structures like JSON, and denormalize the values into individual rows with repeating values, essentially flattening or unrolling the array.
A new update to the Lookup transformation allows you to now select single row point-based lookups instead of the current behavior, which is always returning all matches via left outer. Now you can select first, last, or any individual row matches.
ADF updates to the UI for container activities
To make is easier for you, as a pipeline designer, to visualize the activities inside of container objects, we’ve updated the UI to display the activities inside of the IF, UNTIL, FOREACH, SWITCH activities.