ナビゲーションをスキップする

このビデオは 日本語 ではご利用いただけません。このビデオは English (US) でご利用いただけます。

2020 PyTorch Developer Day - DeepSpeed & ONNX Runtime

In this talk, Yuxiong He, partner research manager at Microsoft, presented DeepSpeed, an open-source deep learning training optimization library compatible with PyTorch. DeepSpeed introduces system and algorithmic innovations, such as ZeRO, 3D parallelism, 1-bit Adam, etc. It vastly advances large model training by improving scale, speed, cost, and usability, while democratizing it for everyone in need.