DeepSpeed: Accelerating large-scale model inference and training

DeepSpeed: Accelerating large-scale model inference and training

GitHub - microsoft/DeepSpeed: DeepSpeed is a deep learning

DeepSpeed - Make distributed training easy, efficient, and effective

DeepSpeed for Large Model Training and Inference

Optimization Strategies for Large-Scale DL Training Workloads

2201.05596] DeepSpeed-MoE: Advancing Mixture-of-Experts Inference and Training to Power Next-Generation AI Scale

engineering.fb.com/wp-content/uploads/2021/07/FSDP

Samyam Rajbhandari (@samyamrb) / X

Accelerated Inference for Large Transformer Models Using NVIDIA

PyTorch Lightning vs DeepSpeed vs FSDP vs FFCV vs …

SW/HW Co-optimization Strategy for LLMs — Part 2 (Software), by Liz Li

Deep Speed, PDF, Computer Architecture

LLM（十二）：DeepSpeed Inference 在LLM 推理上的优化探究- 知乎