Este vídeo no está disponible en Español. El vídeo no está disponible en English (US).
2020 PyTorch Developer Day - DeepSpeed & ONNX Runtime
In this talk, Yuxiong He, partner research manager at Microsoft, presented DeepSpeed, an open-source deep learning training optimization library compatible with PyTorch. DeepSpeed introduces system and algorithmic innovations, such as ZeRO, 3D parallelism, 1-bit Adam, etc. It vastly advances large model training by improving scale, speed, cost, and usability, while democratizing it for everyone in need.