Support Matrix

Note

For previous versions of the Support Matrix, please refer to Previous Support Matrix.

Supported Configurations and Components

The tables below detail the configurations and versions supported for first-gen Intel® Gaudi® AI accelerator, Intel® Gaudi® 2 AI accelerator, and Intel® Gaudi® 3 AI accelerator.

Intel Gaudi Software

1.18.0

Operating System

Ubuntu

RHEL9

SUSE

Version

22.04

24.04

9.4

15.5

Kernel

5.4.0 and above

6.8.0

5.14 and above

5.14.21-150500.53-default

Python

3.10

3.12

3.11

3.11

OpenShift

4.16

Kubernetes

1.27, 1.28, 1.29

KubeVirt

0.36 and above

Slurm

Forked from 24.11.0-0rc1 of the official Slurm

Docker

25.0.1

PyTorch

2.4.0 - For a list of supported features, see PyTorch Support Matrix.

PyTorch Lightning or Lightning

2.3.3

lightning-habana

1.6.0

Ray

2.32.0

DeepSpeed

Forked from 0.14.4 of the official DeepSpeed. For a list of supported features, see DeepSpeed.

Intel Neural Compressor (INC)

v3.1

Open MPI

4.1.6

Libfabric

  • General support: 1.16.1 and above

  • Gaudi Direct with Verbs: 1.20.0

Optimum for Intel Gaudi 1

1.14.1, 1.14.0, 1.13.1, 1.13.0, 1.12.1

Text Generation Inference

  • 2.0.6 with Optimum for Intel Gaudi 1.14.1

  • 2.0.5 with Optimum for Intel Gaudi 1.14.0

  • 2.0.4 with Optimum for Intel Gaudi 1.13.1

  • 2.0.1 with Optimum for Intel Gaudi 1.12.1

Transformers

  • 4.45 with Optimum for Intel Gaudi 1.14.0, 1.14.1

  • 4.43 with Optimum for Intel Gaudi 1.13.0 and 1.13.1

  • 4.40.2 with Optimum for Intel Gaudi 1.12.1
1

Refer to Optimum for Intel Gaudi release notes for more details on the release.

Components

Version

Intel Gaudi Software

Build Number

1.18.0-524

HL-325L

SPI Firmware

1.18.0-fw-53.1.0

FIT

1.18.0-fw-53.1.0

CPLD

  • 03

  • 04 (secured CPLD)

eROM

1.12.1-fw-46.0.5 and above

HLB-325

PCIe Retimer Firmware

2.8.45

SerDes Retimer Firmware

D0_06

CPLD

  • 0x12 (Primary)

  • 0x02 (Secondary)

Intel Gaudi Software

1.18.0

Operating Systems

Ubuntu

RHEL8

RHEL9

TencentOS

Version

22.04

8.6

9.2

9.4

3.1

Kernel

5.4.0 and above

4.18.0

5.14 and above

5.14 and above

5.4.0 and above

Python

3.10

3.8

3.10

3.11

3.10

OpenShift

4.14

4.16

Kubernetes

1.27, 1.28, 1.29

KubeVirt

0.36 and above

Slurm

Forked from 24.11.0-0rc1 of the official Slurm

Docker

25.0.1

PyTorch

2.4.0 - For a list of supported features, see PyTorch Support Matrix.

PyTorch Lightning or Lightning

2.3.3

lightning-habana

1.6.0

Ray

2.32.0

DeepSpeed

Forked from 0.14.4 of the official DeepSpeed. For a list of supported features, see DeepSpeed.

Megatron-DeepSpeed

Forked from the official Megatron-DeepSpeed, PR #374

Intel Neural Compressor (INC)

v3.1

Open MPI

4.1.6

Libfabric

  • General support: 1.16.1 and above

  • Gaudi Direct with Verbs: 1.20.0

Optimum for Intel Gaudi 2

1.14.1, 1.14.0, 1.13.1, 1.13.0, 1.12.1

Text Generation Inference

  • 2.0.6 with Optimum for Intel Gaudi 1.14.1

  • 2.0.5 with Optimum for Intel Gaudi 1.14.0

  • 2.0.4 with Optimum for Intel Gaudi 1.13.1

  • 2.0.1 with Optimum for Intel Gaudi 1.12.1

Transformers

  • 4.45 with Optimum for Intel Gaudi 1.14.0, 1.14.1

  • 4.43 with Optimum for Intel Gaudi 1.13.0 and 1.13.1

  • 4.40.2 with Optimum for Intel Gaudi 1.12.1

vLLM

Forked from v0.5.3 of the official vLLM
2

Refer to Optimum for Intel Gaudi release notes for more details on the release.

Components

Version

Intel Gaudi Software

Build Number

1.18.0-524

SVN

SVN Version

sec-9

HL-225H/C

SPI Firmware

1.18.0-fw-53.1.1

FIT

1.18.0-fw-53.1.1

CPLD

0X10

eROM

1.12.1-fw-46.0.5 and above (HL-225H only)

HLBA-225

PCIe Retimer Firmware

2.2

SerDes Retimer Firmware

0xD00A

CPLD

  • A01 (HLS users)

  • A02SA (non-HLS users)

HLS-Gaudi 2

JC BMC

4.0

HIB BMC

3.04

PCIe Switch

002104

Intel Gaudi Software

1.18.0

Gaudi Firmware

1.2.3

Gaudi SPI Firmware

1.1.0

Operating Systems

Ubuntu

Amazon Linux 2

Version

22.04

Kernel

5.15 and above

5.4.0 and above

Python

3.10

3.8

Kubernetes

1.27, 1.28, 1.29

KubeVirt

0.36 and above

Slurm

Forked from 24.11.0-0rc1 of the official Slurm

Docker

25.0.1

PyTorch

2.4.0 - For a list of supported features, see PyTorch Support Matrix.
PyTorch Lightning

or

Lightning

2.3.3

lightning-habana

1.6.0

DeepSpeed

Forked from 0.14.4 of the official DeepSpeed. For a list of supported features, see DeepSpeed.

Open MPI

4.1.6

Libfabric

1.16.1 and above

Optimum for Intel Gaudi 3

1.14.1, 1.14.0, 1.13.1, 1.13.0, 1.12.1

Transformers

  • 4.45 with Optimum for Intel Gaudi 1.14.0, 1.14.1

  • 4.43 with Optimum for Intel Gaudi 1.13.0, 1.13.1

  • 4.40.2 with Optimum for Intel Gaudi 1.12.1
3

Refer to Optimum for Intel Gaudi release notes for more details on the release.

Backward/Forward Compatibility

The following is validated on Ubuntu 22.04 and Intel® Gaudi® 2 AI accelerator only.

Docker Image Version

Driver/FIT

SPI Firmware

1.18.0

1.18.0, 1.17.1

1.17.x

1.17.1

1.16.2

1.17.1, 1.16.2

1.15.2

1.17.1

1.18.0

1.18.0

1.18.0, 1.16.2

1.17.x

1.18.0, 1.17.1

1.15.2

1.16.2

1.18.0, 1.17.1, 1.16.2

1.18.0

1.18.0, 1.17.1, 1.16.2

1.17.x

1.16.2

1.15.2