Intel Gaudi Software Installers

The table below describes the Intel Gaudi software installers that are included in the installation.

Package

Description

habanalabs-graph

Installs the graph compiler and the runtime.

habanalabs-thunk

Installs the Thunk library.

habanalabs-dkms

Installs the habanalabs, habanalabs_cn, habanalabs_en, and habanalabs_ib drivers. The habanalabs_ib driver is supported on Gaudi 2 and Gaudi 3 only.

habanalabs-rdma-core

Installs IBVerbs libraries which provide Intel Gaudi’s libhlib along with libibverbs.

habanalabs-firmware

Installs the Gaudi firmware.

habanalabs-firmware-tools

Installs various firmware tools (hlml, hl-smi, etc).

habanalabs-firmware-odm

Installs the ODM firmware tools (SPI flash and hl_fw_loader).

habanalabs-qual

Installs the qualification application package.

Note

To install each installer separately, refer to the detailed instructions in Custom Driver and Software Installation.

Intel Gaudi PyTorch Packages

The table below describes the Intel Gaudi PyTorch packages that are included in the installation.

Package

Description

torch

PyTorch framework package with Gaudi support.

habana-torch-plugin

Libraries and modules needed to execute PyTorch on single card, single-server and multi-server setup.

habana-torch-dataloader

Gaudi multi-threaded dataloader package.

torchvision and torchaudio

Torchvision and Torchaudio packages compiled in torch environment. No Gaudi-specific changes in this package.

torch-tb-profiler

The Tensorboard plugin used to display Gaudi-specific information on TensorBoard.

neural_compressor.torch.quantization

Provides model measurement and quantization capabilities for FP8 in PyTorch models with Gaudi 2 and Gaudi 3.