PyTorch

Habana SynapseAI is integrated with PyTorch and optimized for Habana Gaudi HPU. SynapseAI works under the hood, so as a developer you can still enjoy the same experience in PyTorch that you are accustomed to today.

Getting Started and Model Porting

• Getting Started with PyTorch and Gaudi

• PyTorch Model Porting

Features Support

• Mixed Precision Training with PyTorch Autocast

• FP8 Training with Habana Transformer Engine

• Distributed Training with PyTorch

• Habana Media Loader

• Large Models on PyTorch Using DeepSpeed

• Inference on PyTorch

• Enabling Multiple Tenants on PyTorch

• Model Performance Optimization Guide for PyTorch

• Debugging and Troubleshooting Guide

Reference Material

• Runtime Environment Variables

• Habana PyTorch Python API (habana_frameworks.torch)

• PyTorch Operators

• PyTorch CustomOp API

• PyTorch Gaudi Theory of Operations