DeepSpeed: Accelerating large-scale model inference and training via system optimizations and compression - Microsoft Research

Last month, the DeepSpeed Team announced ZeRO-Infinity, a step forward in training models with tens of trillions of parameters. In addition to creating optimizations for scale, our team strives to introduce features that also improve speed, cost, and usability. As the DeepSpeed optimization library evolves, we are listening to the growing DeepSpeed community to learn […]

DeepSpeed: Accelerating large-scale model inference and training via system optimizations and compression - Microsoft Research

DeepSpeed Compression: A composable library for extreme compression and zero-cost quantization - Microsoft Research

ZeRO-Infinity and DeepSpeed: Unlocking unprecedented model scale for deep learning training - Microsoft Research

DeepSpeed: Extreme-scale model training for everyone - Microsoft Research

Pre-trained models: Past, present and future - ScienceDirect

Shaden Smith on LinkedIn: dfasdf

Improving Pre-trained Language Models

Deploy large models on SageMaker using DJLServing and DeepSpeed model parallel inference

A Fascinating Prisoner's Exploring Different Approaches To, 44% OFF

GitHub - microsoft/DeepSpeed: DeepSpeed is a deep learning