Microsoft open sources Data Accelerator, an easy-to-configure pipeline for streaming at scale
Standing up a data pipeline for the first time can be a challenge and decisions you make at the start of a project can limit your choices long after the initial deployment has been rolled out.