Large Models on PyTorch Using DeepSpeed

The following sections provide the basic steps and knowledge for using DeepSpeed with Gaudi. You can use the Getting Started Guide to run a simple DeepSpeed training model. Then, for installing and integrating DeepSpeed with Gaudi for inference or training, you can use the DeepSpeed user guides.

• Getting Started with DeepSpeed
• DeepSpeed Training
• DeepSpeed Inference