Skip Navigation

Posts by: Jenny Jiang

Powerful Debugging Tools for Spark for Azure HDInsight

Thursday, September 6, 2018

Microsoft runs one of the largest big data cluster in the world – internally called “Cosmos”. This runs millions of jobs across hundreds of thousands of servers over multiple Exabytes of data. Being able to run and manage jobs of this scale by developers was a huge challenge.

Principal Program Manager, Big Data Team