DeepSpeed API#

In this guide, you’ll learn how to use the DeepSpeed API.

Visit the API reference

det.pytorch.deepspeed API Reference

DeepSpeed is a Microsoft library that supports large-scale, distributed learning with sharded optimizer state training and pipeline parallelism. Determined supports DeepSpeed with the DeepSpeedTrial API. DeepSpeedTrial provides a way to use an automated training loop with DeepSpeed.

Determined DeepSpeed documentation: