Intel Gaudi Profiler User Guide

If you are already using PyTorch with TensorBoard, you can easily start using the Intel® Gaudi® Profiler for both model development and profiling by replacing GPU with HPU in your sources. For a brief overview of the basic steps for PyTorch, refer to Profiling with PyTorch. For low-level focused profiling or writing models in Intel Gaudi software without a framework, refer to Profiling with Intel Gaudi Software.

• Profiling with PyTorch
• Profiling with Intel Gaudi Software
• Profiling Architecture
• Tips and Tricks to Accelerate the Training

Note

Unless otherwise specified, the terms step and batch are used interchangeably throughout this chapter.