Support Matrix v1.17.1

The tables below detail the configurations and versions supported for first-gen Intel® Gaudi® AI accelerator, Intel® Gaudi® 2 AI accelerator, and Intel® Gaudi® 3 AI accelerator.

Gaudi 3

Intel Gaudi Software	1.17.1
Operating System	Ubuntu	RHEL9	SUSE
Version	22.04	9.4	15.5
Kernel	5.4.0 and above	5.14 and above
Python	3.10	3.11
OpenShift		4.16
Kubernetes	1.27, 1.28, 1.29
KubeVirt	0.36 and above
Slurm	Forked from 24.08.0-0rc1 of the official Slurm
Docker	25.0.1
PyTorch	2.3.1 - For a list of supported features, see PyTorch Support Matrix.
PyTorch Lightning or Lightning	2.3.3
lightning-habana	1.6.0
Ray	2.32.0
DeepSpeed	Forked from 0.14.0 of the official DeepSpeed. For a list of supported features, see DeepSpeed.
Open MPI	4.1.6
Libfabric	General support: 1.16.1 and above Gaudi Direct with Verbs: 1.20.0
Optimum for Intel Gaudi 1	1.13.2, 1.13.1, 1.13.0, 1.12.1
Text Generation Inference	2.0.5 with Optimum for Intel Gaudi 1.13.2 2.0.4 with Optimum for Intel Gaudi 1.13.1 2.0.1 with Optimum for Intel Gaudi 1.12.1
Transformers	4.43 with Optimum for Intel Gaudi 1.13.0, 1.13.1, 1.13.2 4.40.2 with Optimum for Intel Gaudi 1.12.1

1

Refer to Optimum for Intel Gaudi release notes for more details on the release.

Gaudi 3 On-Prem

	Components	Version
Intel Gaudi Software	Build Number	1.17.1-40
HL-325L	SPI Firmware	1.17.1-fw-51.5.0
	FIT	1.17.1-fw-51.5.0
	CPLD	03
	eROM	1.12.1-fw-46.0.5 and above
HLB-325	PCIe Retimer Firmware	2.8.45
	SerDes Retimer Firmware	D0_05
	CPLD	00_16 (Primary) 00_05 (Secondary)

Gaudi 2

Intel Gaudi Software	1.17.1
Operating Systems	Ubuntu	RHEL8	RHEL9		TencentOS
Version	22.04	8.6	9.2	9.4	3.1
Kernel	5.4.0 and above	4.18.0	5.14 and above	5.14 and above	5.4.0 and above
Python	3.10	3.8	3.10	3.11	3.10
OpenShift			4.14	4.16
Kubernetes	1.27, 1.28, 1.29
KubeVirt	0.36 and above
Slurm	Forked from 24.08.0-0rc1 of the official Slurm
Docker	25.0.1
PyTorch	2.3.1 - For a list of supported features, see PyTorch Support Matrix.
PyTorch Lightning or Lightning	2.3.3
lightning-habana	1.6.0
Ray	2.32.0
DeepSpeed	Forked from 0.14.0 of the official DeepSpeed. For a list of supported features, see DeepSpeed.
Megatron-DeepSpeed	Forked from the official Megatron-DeepSpeed, PR #374
Open MPI	4.1.6
Libfabric	General support: 1.16.1 and above Gaudi Direct with Verbs: 1.20.0
Optimum for Intel Gaudi 2	1.13.2, 1.13.1, 1.13.0, 1.12.1
Text Generation Inference	2.0.5 with Optimum for Intel Gaudi 1.13.2 2.0.4 with Optimum for Intel Gaudi 1.13.1 2.0.1 with Optimum for Intel Gaudi 1.12.1
Transformers	4.43 with Optimum for Intel Gaudi 1.13.0, 1.13.1, 1.13.2 4.40.2 with Optimum for Intel Gaudi 1.12.1
vLLM	Forked from v0.5.3 of the official vLLM

2

Refer to Optimum for Intel Gaudi release notes for more details on the release.

Gaudi 2 On-Prem

	Components	Version
Intel Gaudi Software	Build Number	1.17.1-40
SVN	SVN Version	sec-8
HL-225H/C	SPI Firmware	1.17.0-fw-51.2.0
	FIT	1.17.0-fw-51.2.0
	CPLD	0X10
	eROM	1.12.1-fw-46.0.5 and above (HL-225H only)
HLBA-225	PCIe Retimer Firmware	2.2
	SerDes Retimer Firmware	0xD00A
	CPLD	A01 (HLS users) A02SA (non-HLS users)
HLS-Gaudi 2	JC BMC	4.0
	HIB BMC	3.04
	PCIe Switch	002104

First-gen Gaudi

Intel Gaudi Software	1.17.1
Gaudi Firmware	1.2.3
Gaudi SPI Firmware	1.1.0
Operating Systems	Ubuntu	Amazon Linux 2
Version	22.04
Kernel	5.15 and above	5.4.0 and above
Python	3.10	3.8
Kubernetes	1.27, 1.28, 1.29
KubeVirt	0.36 and above
Slurm	Forked from 24.08.0-0rc1 of the official Slurm
Docker	25.0.1
PyTorch	2.3.1 - For a list of supported features, see PyTorch Support Matrix.
PyTorch Lightning or Lightning	2.3.3
lightning-habana	1.6.0
DeepSpeed	Forked from 0.14.0 of the official DeepSpeed. For a list of supported features, see DeepSpeed
Open MPI	4.1.6
Libfabric	1.16.1 and above
Optimum for Intel Gaudi 3	1.13.2, 1.13.1, 1.13.0, 1.12.1
Transformers	4.43 with Optimum for Intel Gaudi 1.13.0, 1.13.1, 1.13.2 4.40.2 with Optimum for Intel Gaudi 1.12.1

3

Refer to Optimum for Intel Gaudi release notes for more details on the release.