Passer la navigation

Cette vidéo n’est pas disponible en Français. Cette vidéo est disponible en English (US).

2020 PyTorch Developer Day - DeepSpeed & ONNX Runtime

In this talk, Yuxiong He, partner research manager at Microsoft, presented DeepSpeed, an open-source deep learning training optimization library compatible with PyTorch. DeepSpeed introduces system and algorithmic innovations, such as ZeRO, 3D parallelism, 1-bit Adam, etc. It vastly advances large model training by improving scale, speed, cost, and usability, while democratizing it for everyone in need.