Intel Gaudi Software Installers

The table below describes the Intel Gaudi software installers that are included in the installation.

Package

Description

habanalabs-graph

Installs the graph compiler and the runtime.

habanalabs-thunk

Installs the thunk library.

habanalabs-dkms

Installs the habanalabs, habanalabs_cn, habanalabs_en, and habanalabs_ib drivers. The habanalabs_ib driver is supported on Gaudi 2 and Gaudi 3 only.

habanalabs-rdma-core

Installs IBVerbs libraries which provide Intel Gaudi’s libhlib along with libibverbs.

habanalabs-firmware

Installs the Gaudi firmware.

habanalabs-firmware-tools

Installs various firmware tools (hlml, hl-smi, etc).

habanalabs-qual

Installs the qualification application package.

Note

To install each installer separately, refer to the detailed instructions in Installing Intel Gaudi SW Packages Individually.

Intel Gaudi PyTorch Packages

The table below describes the Intel Gaudi PyTorch packages that are included in the installation.

Package

Description

torch

PyTorch framework package with Gaudi support.

habana-torch-plugin

Libraries and modules needed to execute PyTorch on single card, single-server and multi-server setup.

habana-torch-dataloader

Gaudi multi-threaded dataloader package.

torchvision and torchaudio

Torchvision and Torchaudio packages compiled in torch environment. No Gaudi-specific changes in this package.

habana-gpu-migration

The library for the GPU Migration toolkit.

torch-tb-profiler

The Tensorboard plugin used to display Gaudi-specific information on TensorBoard.

neural_compressor.torch.quantization

Provides model measurement and quantization capabilities for FP8 in PyTorch models with Gaudi 2 and Gaudi 3.