deepspeedai/DeepSpeed

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

★ 42.8K Stars

⑂ 4.9K Forks

○ 42.8K Watchers

✖ 1.3K Issues

Python

billion-parameters compression data-parallelism deep-learning gpu inference machine-learning mixture-of-experts model-parallelism pipeline-parallelism pytorch trillion-parameters zero

Last push: 5h ago

Created:

↗ View on GitHub

Loading additional information…