AI with big data: Data science at massive scale with Apache Spark in Azure Databricks
The data science process is a well understood flow for data scientists. Azure Databricks brings unique capabilities of tying a scale-out analytics engine to a collaborative and streamlined data science environment enabling implementation of the data science process with seamless power. With Azure Databricks you can create, train, evaluate, and publish models built on massive amounts of data, in a span of minutes. This session discusses the core concepts of such pipelines and walks through the optimal practices to make them efficient and accurate. We cover example that show building pipelines with machine learning and operationalizing those pipelines.