Training on PyTorch

Intel® Gaudi® software is integrated with PyTorch and optimized for Intel Gaudi AI accelerator. The software works under the hood, so as a developer you can still enjoy the same experience in PyTorch that you are accustomed to today.

Getting Started and Model Porting

• Getting Started with Training on Intel Gaudi

• PyTorch Model Porting

Features Support

• Mixed Precision Training with PyTorch Autocast

• Intel Gaudi Media Loader

• FP8 Training with Intel Gaudi Transformer Engine

• Distributed Training with PyTorch

• Using Fully Sharded Data Parallel (FSDP) with Intel Gaudi

• Using DistributedTensor with Intel Gaudi