Support Matrix

Note

For previous versions of the Support Matrix, please refer to Previous Support Matrix.

Supported Configurations and Components

The tables below detail the configurations and versions supported for Intel® Gaudi® 2 AI accelerator, and Intel® Gaudi® 3 AI accelerator.

Gaudi 3

Intel Gaudi Software	1.22.1
Operating System	Ubuntu		RHEL9		SUSE	TencentOS	OpenCloudOS
Version	22.04.5	24.04.2	9.4	9.6	15.5	3.1	9.2
Kernel	5.15 and above	6.8.0	5.14 and above	5.14.0	5.14.21-150500.55.88.1	5.4.0 and above	6.6.63
Python	3.10, 3.11 1	3.12	3.11, 3.12 2	3.12	3.11	3.10	3.11
OpenShift	4.17, 4.18, 4.19
Kubernetes	1.30, 1.31, 1.32
Slurm	Forked from 25.05 of the official Slurm
Docker	25.0.1
PyTorch	2.7 - For a list of supported features, see PyTorch Support Matrix.
lightning-habana	1.6.0
Ray	2.32.0
DeepSpeed	Forked from 0.14.4 of the official DeepSpeed. For a list of supported features, see DeepSpeed.
Megatron-LM	Forked from the official Megatron-LM, core_r0.11.0
Intel Neural Compressor (INC)	v3.5
Open MPI	4.1.6
Libfabric	General support: 1.16.1 and above Gaudi Direct with Verbs: 1.20.0
Optimum for Intel Gaudi 3	1.19.0
Text Generation Inference	3.3.2
Transformers	4.49.0 with Optimum for Intel Gaudi 1.19.0
vLLM	Forked from v0.9.0.1 of the official vLLM

1

Ubuntu 22.04.5 with Python version 3.11 is functional on a specific PyTorch Docker.

2

RHEL 9.4 with Python version 3.12 is functional on a specific PyTorch Docker.

3

Refer to Optimum for Intel Gaudi release notes for more details on the release.

Gaudi 3 On-Prem

	Components	Version
Intel Gaudi Software	Build Number	1.22.1-6
SVN	SVN Version	sec-3
HL-325L	SPI Firmware	1.22.0-fw-61.3.2
	OS	1.22.0-fw-61.3.2
	CPLD	03 04 (secured CPLD)
	eROM	1.22.0-fw-61.3.2
HL-338A	SPI Firmware	1.22.0-fw-61.3.2
	OS	1.22.0-fw-61.3.2
	CPLD	01_TS67B64F7B
	eROM	1.22.0-fw-61.3.2
HLB-325	PCIe Retimer Firmware	2.12.26
	SerDes Retimer Firmware	D0_06
	CPLD	0x17 (Primary) 0x02 (Secondary)

Gaudi 2

Intel Gaudi Software	1.22.1
Operating Systems	Ubuntu		RHEL8	RHEL9			TencentOS	OpenCloudOS	Navix
Version	22.04.5	24.04.2	8.6	9.2	9.4	9.6	3.1	9.2	9.4
Kernel	5.15 and above	6.8.0	4.18.0	5.14 and above	5.14 and above	5.14.0	5.4.0 and above	6.6.63	5.14.0
Python	3.10	3.12	3.11	3.10	3.11	3.12	3.10	3.11	3.12
OpenShift	4.17, 4.18, 4.19
Kubernetes	1.30, 1.31, 1.32
Slurm	Forked from 25.05 of the official Slurm
Docker	25.0.1
PyTorch	2.7 - For a list of supported features, see PyTorch Support Matrix.
lightning-habana	1.6.0
Ray	2.32.0
DeepSpeed	Forked from 0.14.4 of the official DeepSpeed. For a list of supported features, see DeepSpeed.
Megatron-LM	Forked from the official Megatron-LM, core_r0.11.0
Intel Neural Compressor (INC)	v3.5
Open MPI	4.1.6
Libfabric	General support: 1.16.1 and above Gaudi Direct with Verbs: 1.20.0
Optimum for Intel Gaudi 4	1.19.0
Text Generation Inference	3.3.2
Transformers	4.49.0 with Optimum for Intel Gaudi 1.19.0
vLLM	Forked from v0.9.0.1 of the official vLLM

4

Refer to Optimum for Intel Gaudi release notes for more details on the release.

Gaudi 2 On-Prem

	Components	Version
Intel Gaudi Software	Build Number	1.22.1-6
SVN	SVN Version	sec-9
HL-225H	SPI Firmware	1.22.0-fw-61.0.1
	FIT	1.22.0-fw-61.0.1
	CPLD	0X10
	eROM	1.12.1-fw-46.0.5 and above
HLBA-225	PCIe Retimer Firmware	2.2
	SerDes Retimer Firmware	0xD00A
	CPLD	A01 (HLS users) A02SA (non-HLS users)
HLS-Gaudi 2	JC BMC	4.0
	HIB BMC	3.04
	PCIe Switch	002104

Backward/Forward Compatibility

The following is validated on Ubuntu 22.04.5.

Gaudi 3

Note

The driver version should be equal or higher than the Docker version.

Docker Image Version	Driver	SPI Firmware
1.22.0	1.22.0	1.22.0
		1.21.3
		1.21.1
1.21.x	1.21.x	1.21.x
		1.20.1
1.20.1	1.20.1	1.21.x
		1.20.x
1.20.0	1.20.0	1.20.0
		1.19.x
1.19.x	1.19.x	1.20.0
		1.19.x

Gaudi 2

Note

• The driver version should be equal or higher than the Docker version.

• Validation is performed only for the latest version and the two preceding versions.

Docker Image Version	Driver	SPI Firmware
1.22.0, 1.21.3	1.22.0, 1.21.3	1.22.0
	1.22.0	1.21.3
	1.22.0	1.20.1
1.21.2, 1.20.1	1.21.2, 1.20.1	1.21.2
	1.21.2	1.20.1
	1.21.2	1.19.0
1.21.0, 1.20.1	1.21.0, 1.20.1	1.20.1
		1.19.0
1.20.0	1.20.0	1.20.0
		1.19.0
		1.18.0
1.19.0	1.21.2, 1.20.1, 1.19.0	1.21.2
	1.21.2	1.20.1
	1.20.0, 1.19.0	1.20.0
	1.21.2, 1.20.1, 1.19.0	1.19.0
	1.20.0, 1.19.0	1.18.0
	1.20.0, 1.19.0	1.17.x 5
1.18.0	1.18.0, 1.19.0	1.19.0
		1.18.0
		1.17.x
		1.16.0
		1.15.2
1.17.1	1.19.0	1.18.0
	1.18.0, 1.19.0	1.17.x
	1.18.0, 1.17.1	1.15.2
1.16.2	1.18.0, 1.17.1, 1.16.2	1.18.0
	1.18.0, 1.17.1, 1.16.2	1.17.x
	1.16.2	1.15.2

5

Not validated with the 1.20.0 driver version.