Support Matrix

Note

For previous versions of the Support Matrix, please refer to Previous Support Matrix.

Supported Configurations and Components

The tables below detail the configurations and versions supported for first-gen Intel® Gaudi® AI accelerator, Intel® Gaudi® 2 AI accelerator, and Intel® Gaudi® 3 AI accelerator.

Gaudi 3

Intel Gaudi Software	1.21.1
Operating System	Ubuntu		RHEL9	SUSE	TencentOS
Version	22.04.5	24.04.2	9.4	15.5	3.1
Kernel	5.15 and above	6.8.0	5.14 and above	5.14.21-150500.55.88.1	5.4.0 and above
Python	3.10, 3.11 1	3.12	3.11, 3.12 2	3.11	3.10
OpenShift	4.16, 4.17, 4.18
Kubernetes	1.30, 1.31, 1.32
Slurm	Forked from 24.11.0-0rc1 of the official Slurm
Docker	25.0.1
PyTorch	2.6.0 - For a list of supported features, see PyTorch Support Matrix.
PyTorch Lightning or Lightning	2.5.1
lightning-habana	1.6.0
Ray	2.32.0
DeepSpeed	Forked from 0.14.4 of the official DeepSpeed. For a list of supported features, see DeepSpeed.
Megatron-LM	Forked from the official Megatron-LM, core_r0.10.0
Intel Neural Compressor (INC)	v3.4
Open MPI	4.1.6
Libfabric	General support: 1.16.1 and above Gaudi Direct with Verbs: 1.20.0
Optimum for Intel Gaudi 3	1.16.0
Text Generation Inference	2.3.2 with Optimum for Intel Gaudi 1.16.0
Transformers	4.45.2 with Optimum for Intel Gaudi 1.16.0
vLLM	Forked from v0.7.2 of the official vLLM

1

Ubuntu 22.04.5 with Python version 3.11 is functional on a specific PyTorch Docker.

2

RHEL 9.4 with Python version 3.12 is functional on a specific PyTorch Docker.

3

Refer to Optimum for Intel Gaudi release notes for more details on the release.

Gaudi 3 On-Prem

	Components	Version
Intel Gaudi Software	Build Number	1.21.1-16
SVN	SVN Version	sec-2
HL-325L	SPI Firmware	1.21.1-fw-59.2.3
	OS	1.21.1-fw-59.2.3
	CPLD	03 04 (secured CPLD)
	eROM	1.21.1-fw-59.2.3
HL-338A	SPI Firmware	1.21.1-fw-59.2.3
	OS	1.21.1-fw-59.2.3
	CPLD	01_TS67B64F7B
	eROM	1.21.1-fw-59.2.3
HLB-325	PCIe Retimer Firmware	2.12.26
	SerDes Retimer Firmware	D0_06
	CPLD	0x15 (Primary) 0x02 (Secondary)

Gaudi 2

Intel Gaudi Software	1.21.1
Operating Systems	Ubuntu		RHEL8	RHEL9		TencentOS
Version	22.04.5	24.04.2	8.6	9.2	9.4	3.1
Kernel	5.15 and above	6.8.0	4.18.0	5.14 and above	5.14 and above	5.4.0 and above
Python	3.10	3.12	3.11	3.10	3.11	3.10
OpenShift	4.16, 4.17, 4.18
Kubernetes	1.30, 1.31, 1.32
Slurm	Forked from 24.11.0-0rc1 of the official Slurm
Docker	25.0.1
PyTorch	2.6.0 - For a list of supported features, see PyTorch Support Matrix.
PyTorch Lightning or Lightning	2.5.1
lightning-habana	1.6.0
Ray	2.32.0
DeepSpeed	Forked from 0.14.4 of the official DeepSpeed. For a list of supported features, see DeepSpeed.
Megatron-LM	Forked from the official Megatron-LM, core_r0.10.0
Intel Neural Compressor (INC)	v3.4
Open MPI	4.1.6
Libfabric	General support: 1.16.1 and above Gaudi Direct with Verbs: 1.20.0
Optimum for Intel Gaudi 4	1.16.0
Text Generation Inference	2.3.2 with Optimum for Intel Gaudi 1.16.0
Transformers	4.45.2 with Optimum for Intel Gaudi 1.16.0
vLLM	Forked from v0.7.2 of the official vLLM

4

Refer to Optimum for Intel Gaudi release notes for more details on the release.

Gaudi 2 On-Prem

	Components	Version
Intel Gaudi Software	Build Number	1.21.1-16
SVN	SVN Version	sec-9
HL-225H	SPI Firmware	1.20.1-fw-58.2.6
	FIT	1.20.1-fw-58.2.6
	CPLD	0X10
	eROM	1.12.1-fw-46.0.5 and above
HLBA-225	PCIe Retimer Firmware	2.2
	SerDes Retimer Firmware	0xD00A
	CPLD	A01 (HLS users) A02SA (non-HLS users)
HLS-Gaudi 2	JC BMC	4.0
	HIB BMC	3.04
	PCIe Switch	002104

First-gen Gaudi

Intel Gaudi Software	1.21.1
Gaudi Firmware	1.2.3
Gaudi SPI Firmware	1.1.0
Operating Systems	Ubuntu
Version	22.04.5
Kernel	5.15 and above
Python	3.10
Kubernetes	1.30, 1.31, 1.32
Slurm	Forked from 24.11.0-0rc1 of the official Slurm
Docker	25.0.1
PyTorch	2.6.0 - For a list of supported features, see PyTorch Support Matrix.
PyTorch Lightning or Lightning	2.5.1
lightning-habana	1.6.0
DeepSpeed	Forked from 0.14.4 of the official DeepSpeed. For a list of supported features, see DeepSpeed.
Open MPI	4.1.6
Libfabric	1.16.1 and above
Optimum for Intel Gaudi 5	1.16.0
Transformers	4.45.2 with Optimum for Intel Gaudi 1.16.0

5

Refer to Optimum for Intel Gaudi release notes for more details on the release.

Backward/Forward Compatibility

The following is validated on Ubuntu 22.04.5.

Gaudi 3

Note

The driver version should be equal or higher than the Docker version.

Docker Image Version	Driver	SPI Firmware
1.21.0	1.21.0	1.21.0
		1.20.1
1.20.1	1.20.1	1.21.0
		1.20.x
1.20.0	1.20.0	1.20.0
		1.19.x
1.19.x	1.19.x	1.20.0
		1.19.x

Gaudi 2

Note

• The driver version should be equal or higher than the Docker version.

• Validation is performed only for the latest version and the two preceding versions.

Docker Image Version	Driver	SPI Firmware
1.21.0, 1.20.1	1.21.0, 1.20.1	1.20.1
		1.19.x
1.20.0	1.20.0	1.20.0
		1.19.x
		1.18.0
1.19.x	1.19.x, 1.20.0	1.20.0
		1.19.x
		1.18.0
		1.17.x 6
1.18.0	1.18.0, 1.19.x	1.19.x
		1.18.0
		1.17.x
		1.16.0
		1.15.2
1.17.1	1.19.x	1.18.0
	1.18.0, 1.19.x	1.17.x
	1.18.0, 1.17.1	1.15.2
1.16.2	1.18.0, 1.17.1, 1.16.2	1.18.0
	1.18.0, 1.17.1, 1.16.2	1.17.x
	1.16.2	1.15.2

6

Not validated with the 1.20.0 driver version.