PyTorch OperatorsĀ¶

OverviewĀ¶

This document provides an overview of PyTorch-supported operators for the IntelĀ® GaudiĀ® AI accelerator. Note that the operators listed below support only selected variants and limited optional parameters for Gaudi.

For details on Fused Ops, see Handling Custom Ops.

PyTorch Operators Support SummaryĀ¶

PyTorch Operator

FP32

BF16

INT32

INT8

BOOL

Operator Type

avg_pool2d

Yes

Yes

No

No

No

torch.nn.functional

batch_norm

Yes

Yes

No

No

No

torch.nn.functional

binary_cross_entropy

Yes

Yes

No

No

No

torch.nn.functional

binary_cross_entropy_with_logits

Yes

Yes

No

No

No

torch.nn.functional

conv_transpose2d

Yes

Yes

No

No

No

torch.nn.functional

conv1d

Yes

Yes

No

No

No

torch.nn.functional

conv2d

Yes

Yes

No

No

No

torch.nn.functional

conv3d

Yes

Yes

No

No

No

torch.nn.functional

dropout

Yes

Yes

No

No

No

torch.nn.functional

embedding

Yes

Yes

No

No

No

torch.nn.functional

embedding_bag

Yes

Yes

No

No

No

torch.nn.functional

elu

Yes

Yes

No

No

No

torch.nn.functional

elu_

Yes

Yes

No

No

No

torch.nn.functional

gelu

Yes

Yes

No

No

No

torch.nn.functional

glu

Yes

No

No

No

No

torch.nn.functional

grid_sample

Yes

No

No

No

No

torch.nn.functional

hardshrink

Yes

Yes

No

No

No

torch.nn.functional

hardsigmoid

Yes

Yes

No

No

No

torch.nn.functional

hardtanh

Yes

No

No

No

No

torch.nn.functional

hardtanh_

Yes

No

No

No

No

torch.nn.functional

huber_loss

Yes

Yes

No

No

No

torch.nn.functional

instance_norm

Yes

Yes

No

No

No

torch.nn.functional

kl_div

Yes

Yes

No

No

No

torch.nn.functional

l1_loss

Yes

Yes

No

No

No

torch.nn.functional

layer_norm

Yes

Yes

No

No

No

torch.nn.functional

leaky_relu

Yes

Yes

No

No

No

torch.nn.functional

linear

Yes

Yes

No

No

No

torch.nn.functional

log_softmax

Yes

Yes

No

No

No

torch.nn.functional

logsigmoid

Yes

No

No

No

No

torch.nn.functional

max_pool2d

Yes

Yes

No

No

No

torch.nn.functional

max_pool3d

Yes

Yes

No

No

No

torch.nn.functional

mish

Yes

Yes

No

No

No

torch.nn.functional

mse_loss

Yes

Yes

No

No

No

torch.nn.functional

nll_loss

Yes

Yes

No

No

No

torch.nn.functional

one_hot

Yes

Yes

Yes

No

No

torch.nn.functional

pad

Yes

Yes

No

No

No

torch.nn.functional

relu

Yes

Yes

No

No

No

torch.nn.functional

relu_

Yes

Yes

No

No

No

torch.nn.functional

rrelu

Yes

Yes

No

No

No

torch.nn.functional

sigmoid

Yes

Yes

No

No

No

torch.nn.functional

silu

Yes

Yes

No

No

No

torch.nn.functional

smooth_l1_loss

Yes

Yes

No

No

No

torch.nn.functional

softmax

Yes

Yes

No

No

No

torch.nn.functional

softplus

Yes

Yes

No

No

No

torch.nn.functional

softshrink

Yes

Yes

No

No

No

torch.nn.functional

tanh

Yes

Yes

No

No

No

torch.nn.functional

threshold

Yes

Yes

No

No

No

torch.nn.functional

upsample

Yes

Yes

No

No

No

torch.nn.functional

upsample_nearest

Yes

Yes

No

No

No

torch.nn.functional

vector_norm

Yes

Yes

No

No

No

torch.linalg

abs

Yes

Yes

No

No

No

torch

absolute

Yes

Yes

No

No

No

torch

acos

Yes

Yes

No

No

No

torch

acosh

Yes

Yes

No

No

No

torch

add

Yes

Yes

Yes

No

No

torch

addbmm

Yes

Yes

No

No

No

torch

addcdiv

Yes

Yes

No

No

No

torch

addcmul

Yes

Yes

No

No

No

torch

addmm

Yes

Yes

No

No

No

torch

addmv

Yes

Yes

No

No

No

torch

addr

Yes

Yes

No

No

No

torch

all

No

No

No

No

Yes

torch

amax

Yes

Yes

Yes

No

No

torch

amin

Yes

Yes

Yes

No

No

torch

aminmax

Yes

Yes

Yes

Yes

No

torch

any

Yes

Yes

Yes

No

Yes

torch

arange

Yes

Yes

Yes

Yes

Yes

torch

arccos

Yes

Yes

No

No

No

torch

arccosh

Yes

Yes

No

No

No

torch

arcsin

Yes

Yes

No

No

No

torch

arcsinh

Yes

Yes

No

No

No

torch

arctan

Yes

Yes

No

No

No

torch

arctanh

Yes

Yes

No

No

No

torch

argmax

Yes

Yes

Yes

No

No

torch

argmin

Yes

Yes

Yes

No

No

torch

asin

Yes

Yes

No

No

No

torch

asinh

Yes

Yes

No

No

No

torch

as_strided

Yes

Yes

Yes

Yes

Yes

torch

atan

Yes

Yes

No

No

No

torch

atan2

Yes

Yes

No

No

No

torch

arctan2

Yes

Yes

No

No

No

torch

atanh

Yes

Yes

No

No

No

torch

baddbmm

Yes

Yes

No

No

No

torch

bernoulli

Yes

Yes

No

No

No

torch

bitwise_and

No

No

Yes

Yes

Yes

torch

bitwise_left_shift

No

No

Yes

Yes

Yes

torch

bitwise_not

No

No

No

No

Yes

torch

bitwise_or

No

No

Yes

Yes

Yes

torch

bitwise_right_shift

No

No

Yes

Yes

Yes

torch

bitwise_xor

No

No

Yes

Yes

Yes

torch

bmm

Yes

Yes

No

No

No

torch

broadcast_tensors

Yes

Yes

No

No

No

torch

cat

Yes

Yes

Yes

Yes

Yes

torch

ceil

Yes

Yes

No

No

No

torch

chunk

Yes

Yes

Yes

No

No

torch

clamp

Yes

Yes

Yes

No

No

torch

clip

Yes

Yes

Yes

No

No

torch

clone

Yes

Yes

Yes

Yes

Yes

torch

conj

Yes

Yes

Yes

No

No

torch

copysign

Yes

Yes

No

No

No

torch

cos

Yes

Yes

No

No

No

torch

cosh

Yes

Yes

No

No

No

torch

count_nonzero

Yes

Yes

Yes

Yes

Yes

torch

cross

Yes

Yes

Yes

No

No

torch

cumsum

Yes

Yes

Yes

No

No

torch

cumprod

Yes

Yes

Yes

No

No

torch

diag

Yes

Yes

No

No

No

torch

div

Yes

Yes

Yes

Yes

No

torch

divide

Yes

Yes

Yes

Yes

No

torch

dot

Yes

Yes

No

No

No

torch

empty

Yes

Yes

Yes

Yes

Yes

torch

empty_like

Yes

Yes

Yes

Yes

Yes

torch

empty_strided

Yes

Yes

Yes

Yes

Yes

torch

eq

Yes

Yes

Yes

Yes

No

torch

equal

Yes

Yes

Yes

Yes

Yes

torch

erf

Yes

Yes

No

No

No

torch

erfc

Yes

Yes

No

No

No

torch

erfinv

Yes

No

No

No

No

torch

exp

Yes

Yes

No

No

No

torch

exp2

Yes

Yes

No

No

No

torch

expm1

Yes

No

No

No

No

torch

flatten

Yes

Yes

Yes

No

No

torch

flip

Yes

Yes

Yes

Yes

Yes

torch

float_power

Yes

Yes

No

No

No

torch

floor

Yes

Yes

No

No

No

torch

floor_divide

Yes

Yes

No

No

No

torch

fmod

Yes

Yes

Yes

No

No

torch

frac

Yes

Yes

No

No

No

torch

frexp

Yes

Yes

No

No

No

torch

full

Yes

Yes

Yes

Yes

No

torch

full_like

Yes

Yes

Yes

Yes

No

torch

gather

Yes

Yes

Yes

Yes

No

torch

ge

Yes

Yes

Yes

No

No

torch

greater

Yes

Yes

Yes

Yes

No

torch

greater_equal

Yes

Yes

Yes

Yes

No

torch

gt

Yes

Yes

No

No

No

torch

heaviside

Yes

Yes

Yes

No

No

torch

hypot

Yes

Yes

No

No

No

torch

index_select

Yes

Yes

Yes

No

No

torch

is_complex

Yes

Yes

Yes

No

No

torch

is_floating_point

Yes

Yes

Yes

No

No

torch

is_nonzero

Yes

Yes

Yes

No

No

torch

isfinite

Yes

Yes

No

No

No

torch

isinf

Yes

Yes

No

No

No

torch

isnan

Yes

Yes

Yes

No

No

torch

isneginf

Yes

Yes

No

No

No

torch

isposinf

Yes

Yes

No

No

No

torch

kthvalue

Yes

Yes

Yes

No

No

torch

le

Yes

Yes

Yes

Yes

No

torch

lerp

Yes

Yes

Yes

No

No

torch

less

Yes

Yes

Yes

Yes

No

torch

less_equal

Yes

Yes

Yes

Yes

No

torch

linspace

Yes

Yes

No

No

No

torch

log

Yes

Yes

No

No

No

torch

log10

Yes

Yes

No

No

No

torch

log1p

Yes

Yes

No

No

No

torch

log2

Yes

Yes

No

No

No

torch

logaddexp

Yes

Yes

No

No

No

torch

logaddexp2

Yes

Yes

No

No

No

torch

logcumsumexp

Yes

Yes

No

No

No

torch

logical_and

Yes

Yes

No

Yes

No

torch

logical_or

Yes

Yes

No

Yes

No

torch

logical_xor

Yes

Yes

No

Yes

No

torch

logit

Yes

Yes

No

No

No

torch

logspace

Yes

Yes

No

No

No

torch

logsumexp

Yes

Yes

No

No

No

torch

lt

Yes

Yes

Yes

Yes

No

torch

masked_select

Yes

Yes

Yes

No

No

torch

matmul

Yes

Yes

No

No

No

torch

max

Yes

Yes

Yes

No

No

torch

maximum

Yes

Yes

Yes

No

No

torch

mean

Yes

Yes

No

No

No

torch

median

Yes

Yes

No

No

No

torch

meshgrid

Yes

Yes

No

No

No

torch

min

Yes

Yes

Yes

No

No

torch

minimum

Yes

Yes

Yes

No

No

torch

mm

Yes

Yes

No

No

No

torch

mul

Yes

Yes

No

No

No

torch

mv

Yes

Yes

No

No

No

torch

nan_to_num

Yes

Yes

Yes

No

No

torch

nansum

Yes

No

No

No

No

torch

narrow

Yes

No

No

No

No

torch

ne

Yes

Yes

Yes

No

No

torch

neg

Yes

Yes

No

No

No

torch

nextafter

Yes

Yes

No

No

No

torch

nonzero

Yes

Yes

Yes

No

Yes

torch

norm

Yes

Yes

No

No

No

torch

normal

Yes

Yes

No

No

No

torch

not_equal

Yes

Yes

Yes

Yes

Yes

torch

ones

Yes

Yes

Yes

Yes

Yes

torch

ones_like

Yes

Yes

Yes

Yes

Yes

torch

poisson

Yes

Yes

No

No

No

torch

pow

Yes

Yes

No

No

No

torch

prod

Yes

Yes

No

No

No

torch

random

Yes

Yes

Yes

No

No

torch

randperm

No

No

Yes

No

No

torch

reciprocal

Yes

Yes

No

No

No

torch

reshape

Yes

Yes

Yes

Yes

Yes

torch

resolve_conj

Yes

Yes

No

No

No

torch

resolve_neg

Yes

Yes

No

No

No

torch

result_type

Yes

Yes

Yes

No

No

torch

round

Yes

Yes

No

No

No

torch

rsqrt

Yes

Yes

No

No

No

torch

rsub

Yes

Yes

No

No

No

torch

scatter

Yes

Yes

Yes

No

Yes

torch

scatter_add

Yes

Yes

No

No

No

torch

searchsorted

Yes

Yes

Yes

No

No

torch

select

Yes

Yes

Yes

No

No

torch

sgn

Yes

Yes

No

No

No

torch

sigmoid

Yes

Yes

No

No

No

torch

sign

Yes

Yes

No

No

No

torch

signbit

Yes

Yes

Yes

Yes

No

torch

sin

Yes

Yes

No

No

No

torch

sinc

Yes

Yes

No

No

No

torch

sinh

Yes

Yes

No

No

No

torch

sort

Yes

Yes

No

No

No

torch

split_with_sizes

Yes

Yes

Yes

No

No

torch

sqrt

Yes

Yes

No

No

No

torch

square

Yes

Yes

Yes

No

No

torch

squeeze

Yes

Yes

Yes

Yes

Yes

torch

stack

Yes

Yes

Yes

No

No

torch

std

Yes

Yes

No

No

No

torch

std_mean

Yes

Yes

No

No

No

torch

sub

Yes

Yes

No

No

No

torch

sum

Yes

Yes

Yes

No

Yes

torch

t

Yes

Yes

Yes

Yes

Yes

torch

take

Yes

Yes

Yes

No

No

torch

tan

Yes

Yes

No

No

No

torch

tanh

Yes

Yes

No

No

No

torch

topk

Yes

Yes

No

No

No

torch

trace

Yes

Yes

Yes

No

No

torch

transpose

Yes

Yes

Yes

Yes

Yes

torch

tril

Yes

Yes

No

No

No

torch

triu

Yes

Yes

No

No

No

torch

trunc

Yes

Yes

No

No

No

torch

unbind

Yes

Yes

Yes

No

No

torch

unique

Yes

Yes

No

No

No

torch

unsqueeze

Yes

Yes

Yes

No

No

torch

var

Yes

Yes

No

No

No

torch

var_mean

Yes

Yes

No

No

No

torch

vdot

Yes

Yes

No

No

No

torch

where

Yes

Yes

Yes

No

No

torch

xlogy

Yes

Yes

No

No

No

torch

zeros

Yes

Yes

Yes

Yes

Yes

torch

zeros_like

Yes

Yes

Yes

Yes

Yes

torch

AdaptiveAvgPool2d

Yes

Yes

No

No

No

torch.nn

AvgPool2d

Yes

Yes

No

No

No

torch.nn

BatchNorm1d

Yes

Yes

No

No

No

torch.nn

BatchNorm2d

Yes

Yes

No

No

No

torch.nn

BCELoss

Yes

Yes

No

No

No

torch.nn

BCEWithLogitsLoss

Yes

Yes

No

No

No

torch.nn

ChannelShuffle

Yes

Yes

Yes

No

No

torch.nn

ConstantPad1d

Yes

Yes

No

No

No

torch.nn

Conv1d

Yes

Yes

No

No

No

torch.nn

Conv2d

Yes

Yes

No

No

No

torch.nn

Conv3d

Yes

Yes

No

No

No

torch.nn

ConvTranspose2d

Yes

Yes

No

No

No

torch.nn

ConvTranspose3d

Yes

Yes

No

No

No

torch.nn

CrossEntropyLoss

Yes

Yes

No

No

No

torch.nn

Dropout

Yes

Yes

No

No

No

torch.nn

ELU

Yes

Yes

No

No

No

torch.nn

Embedding

Yes

Yes

No

No

No

torch.nn

EmbeddingBag

Yes

Yes

No

No

No

torch.nn

GELU

Yes

Yes

No

No

No

torch.nn

GLU

Yes

No

No

No

No

torch.nn

Hardshrink

Yes

Yes

No

No

No

torch.nn

Hardsigmoid

Yes

Yes

No

No

No

torch.nn

Hardtanh

Yes

No

No

No

No

torch.nn

HuberLoss

Yes

Yes

No

No

No

torch.nn

InstanceNorm2d

Yes

Yes

No

No

No

torch.nn

KLDivLoss

Yes

Yes

No

No

No

torch.nn

LayerNorm

Yes

Yes

No

No

No

torch.nn

LeakyReLU

Yes

Yes

No

No

No

torch.nn

Linear

Yes

Yes

No

No

No

torch.nn

LogSigmoid

Yes

No

No

No

No

torch.nn

LogSoftmax

Yes

Yes

No

No

No

torch.nn

MaxPool2d

Yes

Yes

No

No

No

torch.nn

MaxPool3d

Yes

Yes

No

No

No

torch.nn

Mish

Yes

Yes

No

No

No

torch.nn

MSELoss

Yes

Yes

No

No

No

torch.nn

NLLLoss

Yes

Yes

No

No

No

torch.nn

ReLU

Yes

Yes

No

No

No

torch.nn

ReflectionPad1d

Yes

No

No

No

No

torch.nn

ReflectionPad2d

Yes

No

No

No

No

torch.nn

ReflectionPad3d

Yes

No

No

No

No

torch.nn

ReplicationPad1d

Yes

Yes

Yes

No

No

torch.nn

ReplicationPad2d

Yes

Yes

Yes

No

No

torch.nn

ReplicationPad3d

Yes

Yes

Yes

No

No

torch.nn

RReLU

Yes

Yes

No

No

No

torch.nn

SiLU

Yes

Yes

No

No

No

torch.nn

Softmax

Yes

Yes

No

No

No

torch.nn

Softplus

Yes

Yes

No

No

No

torch.nn

Softshrink

Yes

Yes

No

No

No

torch.nn

Threshold

Yes

Yes

No

No

No

torch.nn

SmoothL1Loss

Yes

Yes

No

No

No

torch.nn

Upsample

Yes

Yes

No

No

No

torch.nn

UpsamplingNearest2d

Yes

Yes

No

No

No

torch.nn

weight_norm

Yes

Yes

No

No

No

torch.nn.utils

__and__

No

No

Yes

Yes

Yes

torch.Tensor

__iand__

No

No

Yes

Yes

Yes

torch.Tensor

__ilshift__

No

No

Yes

Yes

Yes

torch.Tensor

__ior__

No

No

Yes

Yes

Yes

torch.Tensor

__irshift__

No

No

Yes

Yes

Yes

torch.Tensor

__ixor__

No

No

Yes

Yes

Yes

torch.Tensor

__lshift__

No

No

Yes

Yes

Yes

torch.Tensor

__or__

No

No

Yes

Yes

Yes

torch.Tensor

__rshift__

No

No

Yes

Yes

Yes

torch.Tensor

__xor__

No

No

Yes

Yes

Yes

torch.Tensor

abs

Yes

Yes

No

No

No

torch.Tensor

acos

Yes

Yes

No

No

No

torch.Tensor

acos_

Yes

Yes

No

No

No

torch.Tensor

acosh

Yes

Yes

No

No

No

torch.Tensor

acosh_

Yes

Yes

No

No

No

torch.Tensor

add

Yes

Yes

Yes

No

No

torch.Tensor

add_

Yes

Yes

Yes

No

No

torch.Tensor

addbmm

Yes

Yes

No

No

No

torch.Tensor

addbmm_

Yes

Yes

No

No

No

torch.Tensor

addcdiv

Yes

Yes

No

No

No

torch.Tensor

addcdiv_

Yes

Yes

No

No

No

torch.Tensor

addcmul

Yes

Yes

No

No

No

torch.Tensor

addcmul_

Yes

Yes

No

No

No

torch.Tensor

addmm

Yes

Yes

No

No

No

torch.Tensor

addmm_

Yes

Yes

No

No

No

torch.Tensor

addmv

Yes

Yes

No

No

No

torch.Tensor

addmv_

Yes

Yes

No

No

No

torch.Tensor

addr

Yes

Yes

No

No

No

torch.Tensor

addr_

Yes

Yes

No

No

No

torch.Tensor

all

No

No

No

No

Yes

torch.Tensor

amax

Yes

Yes

No

No

No

torch.Tensor

amin

Yes

Yes

No

No

No

torch.Tensor

aminmax

Yes

Yes

Yes

Yes

No

torch.Tensor

any

No

No

No

No

Yes

torch.Tensor

arccos

Yes

Yes

No

No

No

torch.Tensor

arccos_

Yes

Yes

No

No

No

torch.Tensor

arccosh

Yes

Yes

No

No

No

torch.Tensor

arccosh_

Yes

Yes

No

No

No

torch.Tensor

arcsin

Yes

Yes

No

No

No

torch.Tensor

arcsin_

Yes

Yes

No

No

No

torch.Tensor

arcsinh

Yes

Yes

No

No

No

torch.Tensor

arcsinh_

Yes

Yes

No

No

No

torch.Tensor

arctan

Yes

Yes

No

No

No

torch.Tensor

arctan_

Yes

Yes

No

No

No

torch.Tensor

arctanh

Yes

Yes

No

No

No

torch.Tensor

arctanh_

Yes

Yes

No

No

No

torch.Tensor

argmax

Yes

Yes

No

No

No

torch.Tensor

asin

Yes

Yes

No

No

No

torch.Tensor

asin_

Yes

Yes

No

No

No

torch.Tensor

asinh

Yes

Yes

No

No

No

torch.Tensor

asinh_

Yes

Yes

No

No

No

torch.Tensor

atan2

Yes

Yes

No

No

No

torch.Tensor

atan2_

Yes

Yes

No

No

No

torch.Tensor

arctan2

Yes

Yes

No

No

No

torch.Tensor

arctan2_

Yes

Yes

No

No

No

torch.Tensor

atanh

Yes

Yes

No

No

No

torch.Tensor

atanh_

Yes

Yes

No

No

No

torch.Tensor

baddbmm

Yes

Yes

No

No

No

torch.Tensor

baddbmm_

Yes

Yes

No

No

No

torch.Tensor

bernoulli

Yes

Yes

No

No

No

torch.Tensor

bitwise_and

No

No

No

No

Yes

torch.Tensor

bitwise_left_shift

No

No

Yes

Yes

No

torch.Tensor

bitwise_not

No

No

Yes

Yes

Yes

torch.Tensor

bitwise_or

No

No

No

No

Yes

torch.Tensor

bitwise_right_shift

No

No

Yes

Yes

No

torch.Tensor

bitwise_xor

No

No

No

No

Yes

torch.Tensor

bmm

Yes

Yes

No

No

No

torch.Tensor

ceil

Yes

Yes

No

No

No

torch.Tensor

clamp

Yes

Yes

Yes

No

No

torch.Tensor

clamp_

Yes

Yes

Yes

No

No

torch.Tensor

clamp_max

Yes

Yes

Yes

No

No

torch.Tensor

clamp_min

Yes

Yes

Yes

No

No

torch.Tensor

clip

Yes

Yes

Yes

No

No

torch.Tensor

clip_

Yes

Yes

Yes

No

No

torch.Tensor

clone

Yes

Yes

Yes

Yes

Yes

torch.Tensor

conj

Yes

Yes

Yes

No

No

torch.Tensor

copy_

Yes

Yes

Yes

Yes

Yes

torch.Tensor

copysign

Yes

Yes

No

No

No

torch.Tensor

copysign_

Yes

Yes

No

No

No

torch.Tensor

cos

Yes

Yes

No

No

No

torch.Tensor

cos_

Yes

Yes

No

No

No

torch.Tensor

cosh_

Yes

Yes

No

No

No

torch.Tensor

count_nonzero

Yes

Yes

Yes

Yes

Yes

torch.Tensor

cross

Yes

Yes

Yes

No

No

torch.Tensor

cumprod

Yes

Yes

Yes

No

No

torch.Tensor

cumsum

Yes

Yes

Yes

No

No

torch.Tensor

diag

Yes

Yes

No

No

No

torch.Tensor

div

Yes

Yes

Yes

Yes

No

torch.Tensor

div_

Yes

Yes

Yes

Yes

No

torch.Tensor

dot

Yes

Yes

No

No

No

torch.Tensor

fill_

Yes

Yes

Yes

No

No

torch.Tensor

eq

Yes

Yes

Yes

Yes

No

torch.Tensor

eq_

Yes

Yes

Yes

Yes

No

torch.Tensor

equal

Yes

Yes

Yes

Yes

No

torch.Tensor

erf

Yes

Yes

No

No

No

torch.Tensor

erf_

Yes

Yes

No

No

No

torch.Tensor

erfinv

Yes

No

No

No

No

torch.Tensor

erfinv_

Yes

No

No

No

No

torch.Tensor

erfc_

Yes

Yes

No

No

No

torch.Tensor

erfc

Yes

Yes

No

No

No

torch.Tensor

exp

Yes

Yes

No

No

No

torch.Tensor

exp_

Yes

Yes

No

No

No

torch.Tensor

expand

Yes

Yes

Yes

No

No

torch.Tensor

expand_as

Yes

Yes

Yes

Yes

Yes

torch.Tensor

expm1

Yes

No

No

No

No

torch.Tensor

expm1_

Yes

No

No

No

No

torch.Tensor

exponential_

Yes

Yes

No

No

No

torch.Tensor

flatten

Yes

Yes

Yes

No

No

torch.Tensor

flip

Yes

Yes

Yes

Yes

Yes

torch.Tensor

floor

Yes

Yes

No

No

No

torch.Tensor

floor_

Yes

Yes

No

No

No

torch.Tensor

floor_divide

Yes

Yes

Yes

No

No

torch.Tensor

fmod

Yes

Yes

Yes

No

No

torch.Tensor

fmod_

Yes

Yes

Yes

No

No

torch.Tensor

frac

Yes

Yes

No

No

No

torch.Tensor

frexp

Yes

Yes

No

No

No

torch.Tensor

gather

Yes

Yes

No

No

No

torch.Tensor

ge

Yes

Yes

Yes

No

No

torch.Tensor

ge_

Yes

Yes

Yes

No

No

torch.Tensor

geometric_

Yes

Yes

No

No

No

torch.Tensor

greater

Yes

Yes

Yes

Yes

No

torch.Tensor

greater_equal

Yes

Yes

Yes

Yes

No

torch.Tensor

gt

Yes

Yes

Yes

Yes

No

torch.Tensor

hardshrink

Yes

Yes

No

No

No

torch.Tensor

heaviside

Yes

Yes

Yes

No

No

torch.Tensor

hypot

Yes

Yes

No

No

No

torch.Tensor

index_add_

Yes

Yes

Yes

No

No

torch.Tensor

index_copy_

Yes

Yes

Yes

Yes

Yes

torch.Tensor

index_put

Yes

Yes

Yes

No

No

torch.Tensor

index_put_

Yes

Yes

Yes

No

No

torch.Tensor

index_select

Yes

Yes

Yes

No

No

torch.Tensor

is_complex

Yes

Yes

Yes

No

No

torch.Tensor

is_floating_point

Yes

Yes

Yes

No

No

torch.Tensor

isfinite

Yes

Yes

No

No

No

torch.Tensor

isinf

Yes

Yes

No

No

No

torch.Tensor

isnan

Yes

Yes

Yes

No

No

torch.Tensor

isneginf

Yes

Yes

No

No

No

torch.Tensor

isposinf

Yes

Yes

No

No

No

torch.Tensor

item

Yes

No

No

No

No

torch.Tensor

kthvalue

Yes

Yes

Yes

No

No

torch.Tensor

le

Yes

Yes

Yes

Yes

No

torch.Tensor

le_

Yes

Yes

Yes

Yes

No

torch.Tensor

lerp

Yes

Yes

Yes

No

No

torch.Tensor

less

Yes

Yes

Yes

Yes

No

torch.Tensor

less_

Yes

Yes

Yes

Yes

No

torch.Tensor

less_equal

Yes

Yes

Yes

Yes

No

torch.Tensor

less_equal_

Yes

Yes

Yes

Yes

No

torch.Tensor

log

Yes

Yes

No

No

No

torch.Tensor

log_

Yes

Yes

No

No

No

torch.Tensor

log_normal_

Yes

Yes

No

No

No

torch.Tensor

log_softmax

Yes

Yes

No

No

No

torch.Tensor

log10

Yes

Yes

No

No

No

torch.Tensor

log1p

Yes

Yes

No

No

No

torch.Tensor

log1p_

Yes

Yes

No

No

No

torch.Tensor

log2

Yes

Yes

No

No

No

torch.Tensor

log2_

Yes

Yes

No

No

No

torch.Tensor

logaddexp

Yes

Yes

No

No

No

torch.Tensor

logaddexp2

Yes

Yes

No

No

No

torch.Tensor

logcumsumexp

Yes

Yes

No

No

No

torch.Tensor

logical_and

Yes

Yes

No

Yes

No

torch.Tensor

logical_or

Yes

Yes

No

Yes

No

torch.Tensor

logical_xor

Yes

Yes

No

Yes

No

torch.Tensor

logit

Yes

Yes

No

No

No

torch.Tensor

logsumexp

Yes

Yes

No

No

No

torch.Tensor

lt

Yes

Yes

Yes

Yes

No

torch.Tensor

masked_fill

Yes

Yes

Yes

No

No

torch.Tensor

masked_fill_

Yes

Yes

Yes

No

No

torch.Tensor

masked_scatter_

Yes

Yes

Yes

No

No

torch.Tensor

masked_select

Yes

Yes

Yes

No

No

torch.Tensor

matmul

Yes

Yes

No

No

No

torch.Tensor

max

Yes

Yes

No

No

No

torch.Tensor

maximum

Yes

Yes

Yes

No

No

torch.Tensor

mean

Yes

Yes

No

No

No

torch.Tensor

median

Yes

Yes

No

No

No

torch.Tensor

min

Yes

Yes

Yes

No

No

torch.Tensor

minimum

Yes

Yes

Yes

No

No

torch.Tensor

mm

Yes

Yes

No

No

No

torch.Tensor

mul

Yes

Yes

No

No

No

torch.Tensor

mul_

Yes

Yes

No

No

No

torch.Tensor

mv

Yes

Yes

No

No

No

torch.Tensor

nan_to_num

Yes

Yes

Yes

No

No

torch.Tensor

nansum

Yes

No

No

No

No

torch.Tensor

narrow

Yes

No

No

No

No

torch.Tensor

ne

Yes

Yes

Yes

No

No

torch.Tensor

ne_

Yes

Yes

Yes

No

No

torch.Tensor

neg

Yes

Yes

No

No

No

torch.Tensor

new_empty

Yes

Yes

Yes

Yes

No

torch.Tensor

new_empty_strided

Yes

Yes

Yes

Yes

No

torch.Tensor

new_full

Yes

Yes

Yes

Yes

No

torch.Tensor

new_ones

Yes

Yes

Yes

Yes

No

torch.Tensor

new_zeros

Yes

Yes

Yes

Yes

No

torch.Tensor

nextafter

Yes

Yes

No

No

No

torch.Tensor

nonzero

Yes

Yes

Yes

No

Yes

torch.Tensor

norm

Yes

Yes

No

No

No

torch.Tensor

normal_

Yes

Yes

No

No

No

torch.Tensor

permute

Yes

Yes

Yes

No

No

torch.Tensor

pin_memory

Yes

Yes

Yes

Yes

Yes

torch.Tensor

pow

Yes

Yes

No

No

No

torch.Tensor

pow_

Yes

Yes

No

No

No

torch.Tensor

prod

Yes

Yes

No

No

No

torch.Tensor

reciprocal

Yes

Yes

No

No

No

torch.Tensor

reciprocal_

Yes

Yes

No

No

No

torch.Tensor

remainder

Yes

No

Yes

Yes

No

torch.Tensor

remainder_

No

No

Yes

Yes

No

torch.Tensor

repeat

Yes

Yes

Yes

Yes

Yes

torch.Tensor

reshape

Yes

Yes

Yes

Yes

Yes

torch.Tensor

round

Yes

Yes

No

No

No

torch.Tensor

round_

Yes

Yes

No

No

No

torch.Tensor

rsqrt

Yes

Yes

No

No

No

torch.Tensor

rsqrt_

Yes

Yes

No

No

No

torch.Tensor

scatter_

Yes

Yes

No

No

No

torch.Tensor

scatter_add

Yes

Yes

No

No

No

torch.Tensor

scatter_add_

Yes

Yes

No

No

No

torch.Tensor

select

Yes

Yes

Yes

No

No

torch.Tensor

sgn

Yes

Yes

No

No

No

torch.Tensor

sgn_

Yes

Yes

No

No

No

torch.Tensor

sigmoid

Yes

Yes

No

No

No

torch.Tensor

sigmoid_

Yes

Yes

No

No

No

torch.Tensor

sign

Yes

Yes

No

No

No

torch.Tensor

sign_

Yes

Yes

No

No

No

torch.Tensor

signbit

Yes

Yes

Yes

Yes

No

torch.Tensor

sin

Yes

Yes

No

No

No

torch.Tensor

sin_

Yes

Yes

No

No

No

torch.Tensor

sinh

Yes

Yes

No

No

No

torch.Tensor

sinh_

Yes

Yes

No

No

No

torch.Tensor

sinc

Yes

Yes

No

No

No

torch.Tensor

sort

Yes

Yes

No

No

No

torch.Tensor

split_with_sizes

Yes

Yes

Yes

No

No

torch.Tensor

sqrt

Yes

Yes

No

No

No

torch.Tensor

square

Yes

Yes

No

No

No

torch.Tensor

square_

Yes

Yes

No

No

No

torch.Tensor

squeeze

Yes

Yes

Yes

Yes

Yes

torch.Tensor

squeeze_

Yes

Yes

Yes

Yes

Yes

torch.Tensor

std

Yes

Yes

No

No

No

torch.Tensor

sub

Yes

Yes

No

No

No

torch.Tensor

sub_

Yes

Yes

No

No

No

torch.Tensor

sum

Yes

Yes

No

No

No

torch.Tensor

T

Yes

Yes

Yes

Yes

Yes

torch.Tensor

t

Yes

Yes

Yes

Yes

Yes

torch.Tensor

tan

Yes

Yes

No

No

No

torch.Tensor

tan_

Yes

Yes

No

No

No

torch.Tensor

tanh

Yes

Yes

No

No

No

torch.Tensor

tanh_

Yes

Yes

No

No

No

torch.Tensor

to

Yes

Yes

Yes

Yes

Yes

torch.Tensor

topk

Yes

Yes

No

No

No

torch.Tensor

trace

Yes

Yes

Yes

No

No

torch.Tensor

take

Yes

Yes

Yes

No

No

torch.Tensor

transpose

Yes

Yes

Yes

Yes

Yes

torch.Tensor

tril

Yes

Yes

No

No

No

torch.Tensor

tril_

Yes

Yes

No

No

No

torch.Tensor

triu

Yes

Yes

No

No

No

torch.Tensor

triu_

Yes

Yes

No

No

No

torch.Tensor

trunc

Yes

Yes

No

No

No

torch.Tensor

trunc_

Yes

Yes

No

No

No

torch.Tensor

unbind

Yes

Yes

Yes

No

No

torch.Tensor

unsqueeze

Yes

Yes

Yes

No

No

torch.Tensor

uniform_

Yes

Yes

No

No

No

torch.Tensor

unique

Yes

Yes

No

No

No

torch.Tensor

var

Yes

Yes

No

No

No

torch.Tensor

vdot

Yes

Yes

No

No

No

torch.Tensor

view

Yes

No

No

No

No

torch.Tensor

where

Yes

Yes

Yes

No

No

torch.Tensor

xlogy

Yes

Yes

No

No

No

torch.Tensor

xlogy_

Yes

Yes

No

No

No

torch.Tensor

entr

Yes

No

No

No

No

torch.special

erf

Yes

Yes

No

No

No

torch.special

erfc

Yes

Yes

No

No

No

torch.special

exp2

Yes

Yes

No

No

No

torch.special

expit

Yes

Yes

No

No

No

torch.special

expm1

Yes

No

No

No

No

torch.special

erfinv

Yes

No

No

No

No

torch.special

log1p

Yes

Yes

No

No

No

torch.special

logit

Yes

Yes

No

No

No

torch.special

logsumexp

Yes

Yes

No

No

No

torch.special

round

Yes

Yes

No

No

No

torch.special

sinc

Yes

Yes

No

No

No

torch.special

softmax

Yes

Yes

No

No

No

torch.special

xlog1py

Yes

Yes

No

No

No

torch.special

xlogy

Yes

Yes

No

No

No

torch.special

batched_nms

Yes

No

No

No

No

torchvision.ops

nms

Yes

No

No

No

No

torchvision.ops

roi_align

Yes

No

No

No

No

torchvision.ops