Large Models on PyTorch Using DeepSpeed

The following sections provide the basic steps and knowledge for using DeepSpeed with Intel® Gaudi® AI accelerator. You can use the Getting Started guide to run a simple DeepSpeed training model. Then, for installing and integrating DeepSpeed with Gaudi for inference or training, you can use the DeepSpeed user guides.

• Getting Started with DeepSpeed

• DeepSpeed User Guide for Training

• Optimizing Large Language Models

• Inference Using DeepSpeed