Multiple Tenants on HPUΒΆ

Multiple tenants allows running multiple workloads while using partial Gaudi processors on the same node simultaneously. Unlike distributed training, each workload only uses part of the Gaudi processors on the node. Using this feature requires some additional configuration to make the workload run properly with part of the Gaudi processors and also avoid interference between the workloads which run in parallel.