Support Matrix v1.16.1

The tables below detail the configurations and versions supported for first-gen Intel® Gaudi® AI accelerator, Intel® Gaudi® 2 AI accelerator, and Intel® Gaudi® 3 AI accelerator.

Gaudi 3

Intel Gaudi Software	1.16.1
Operating System	Ubuntu
Version	22.04
Kernel	5.4.0 and above
Python	3.10
Kubernetes	1.27, 1.28, 1.29
KubeVirt	0.36 and above
Docker	25.0.1
PyTorch	2.2.2
PyTorch Lightning or Lightning	2.2.4
lightning-habana	1.5.0
Ray	2.20
DeepSpeed	Forked from 0.14.0 of the official DeepSpeed.
Open MPI	4.1.6
Libfabric	General support: 1.16.1 and above Gaudi Direct with Verbs: 1.20.0

Gaudi 3 On-Prem

	Components	1.16.1
Intel Gaudi Software	Build Number	1.16.1-7
HL-325H	SPI Firmware	1.16.0-fw-50.0.0
	FIT	1.16.0-fw-50.0.0
	CPLD	03
	eROM	1.12.1-fw-46.0.5 and above
HLBA-325	PCIe Retimer Firmware	2.8.45
	SerDes Retimer Firmware	D0_05
	CPLD	00_15 (Primary) 00_05 (Secondary)

Gaudi 2

Intel Gaudi Software	1.16.1
Operating Systems	Ubuntu	Debian	RHEL8	RHEL9	TencentOS
Version	22.04	10.10	8.6	9.2	3.1
Kernel	5.4.0 and above	5.4.0 and above	4.18.0	5.14 and above	5.4.0 and above
Python	3.10	3.8	3.8	3.10	3.8
OpenShift				4.14
Kubernetes	1.27, 1.28, 1.29
KubeVirt	0.36 and above
Docker	25.0.1
PyTorch	2.2.2 - For a list of supported features, see PyTorch Support Matrix.
PyTorch Lightning or Lightning	2.2.4
lightning-habana	1.5.0
Ray	2.20
DeepSpeed	Forked from 0.14.0 of the official DeepSpeed. For a list of supported features, see DeepSpeed.
Megatron-DeepSpeed	Forked from the official Megatron-DeepSpeed, PR #372
Open MPI	4.1.6
Libfabric	General support: 1.16.1 and above Gaudi Direct with Verbs: 1.20.0
Optimum Habana 1	1.12.0
Text Generation Inference	2.0.1 with Optimum Habana 1.12.0
Transformers	4.40.2 with Optimum Habana 1.12.0
vLLM	Forked from v0.4.2 of the official vLLM

1

Refer to Optimum Habana release notes for more details on the release.

Gaudi 2 On-Prem

	Components	1.16.1
Intel Gaudi Software	Build Number	1.16.1-7
SVN	SVN Version	sec-8
HL-225H/C	SPI Firmware	1.16.0-fw-50.1.2
	FIT	1.16.0-fw-50.1.2
	CPLD	0X10
	eROM	1.12.1-fw-46.0.5 and above (HL-225H only)
HLBA-225	PCIe Retimer Firmware	2.2
	SerDes Retimer Firmware	0xD00A
	CPLD	A01 (HLS users) A02SA (non-HLS users)
HLS-Gaudi 2	JC BMC	4.0
	HIB BMC	3.04
	PCIe Switch	002104

First-gen Gaudi

Intel Gaudi Software	1.16.1
Gaudi Firmware	1.2.3
Gaudi SPI Firmware	1.1.0
Operating Systems	Ubuntu	Amazon Linux 2
Version	22.04
Kernel	5.15 and above	5.4.0 and above
Python	3.10	3.8
Kubernetes	1.27, 1.28, 1.29
Docker	25.0.1
PyTorch	2.2.0 - for a list of supported features, see PyTorch Support Matrix.
PyTorch Lightning or Lightning	2.2.0
lightning-habana	1.4.0
DeepSpeed	Forked from 0.12.4 of the official DeepSpeed. For a list of supported features, see DeepSpeed.
Open MPI	4.1.6
Libfabric	1.16.1 and above
Optimum Habana 2	1.12.0
Transformers	4.40.2 with Optimum Habana 1.12.0

2

Refer to Optimum Habana release notes for more details on the release.