DeepSpeed is a deep learning optimization library that makes distributed training easy, efficient, and effective.
分布式训练框架,优化大模型训练效率