Large Models on PyTorch Using DeepSpeed
Large Models on PyTorch Using DeepSpeed¶
The following sections provide the basic steps and knowledge for using DeepSpeed with Gaudi. You can use the Getting Started Guide to run a simple DeepSpeed training model. Then, for installing and integrating DeepSpeed with Gaudi for inference or training, you can use the DeepSpeed user guides.