Model Performance Optimization Guide for PyTorch

This document provides multiple methods that can be implemented in order to achieve the best performance using the Habana® Gaudi® accelerator for training your PyTorch models.

• Optimizing PyTorch Models
• Handling Dynamic Shapes
• Handling Custom Habana Ops for PyTorch
• Using HPU Graphs for Training
• Optimizing Training Using PyTorch Lightning
• Optimizing Training Platform
• Best Practices for Model Training with Gaudi