Model Performance Optimization Guide

This document provides multiple methods that can be implemented in order to achieve the best performance using the Intel® Gaudi® AI accelerator for training your PyTorch models. Start with the Optimization Checklist to review the three main steps for model optimization.

• Model Optimization Checklist

• General Model Optimizations

• Inference Optimizations

• Handling Dynamic Shapes

• Handling Custom Ops

• Using HPU Graphs for Training

• Optimizing Training Platform