PyTorch Operators
On this Page
PyTorch OperatorsĀ¶
OverviewĀ¶
This document provides an overview of PyTorch-supported operators for the IntelĀ® GaudiĀ® AI accelerator. Note that the operators listed below support only selected variants and limited optional parameters for Gaudi.
For details on Fused Ops, see Handling Custom Ops.
PyTorch Operators Support SummaryĀ¶
PyTorch Operator |
FP32 |
BF16 |
INT32 |
INT8 |
BOOL |
Operator Type |
---|---|---|---|---|---|---|
avg_pool2d |
Yes |
Yes |
No |
No |
No |
torch.nn.functional |
batch_norm |
Yes |
Yes |
No |
No |
No |
torch.nn.functional |
binary_cross_entropy |
Yes |
Yes |
No |
No |
No |
torch.nn.functional |
binary_cross_entropy_with_logits |
Yes |
Yes |
No |
No |
No |
torch.nn.functional |
conv_transpose2d |
Yes |
Yes |
No |
No |
No |
torch.nn.functional |
conv1d |
Yes |
Yes |
No |
No |
No |
torch.nn.functional |
conv2d |
Yes |
Yes |
No |
No |
No |
torch.nn.functional |
conv3d |
Yes |
Yes |
No |
No |
No |
torch.nn.functional |
dropout |
Yes |
Yes |
No |
No |
No |
torch.nn.functional |
embedding |
Yes |
Yes |
No |
No |
No |
torch.nn.functional |
embedding_bag |
Yes |
Yes |
No |
No |
No |
torch.nn.functional |
elu |
Yes |
Yes |
No |
No |
No |
torch.nn.functional |
elu_ |
Yes |
Yes |
No |
No |
No |
torch.nn.functional |
gelu |
Yes |
Yes |
No |
No |
No |
torch.nn.functional |
glu |
Yes |
No |
No |
No |
No |
torch.nn.functional |
grid_sample |
Yes |
No |
No |
No |
No |
torch.nn.functional |
hardshrink |
Yes |
Yes |
No |
No |
No |
torch.nn.functional |
hardsigmoid |
Yes |
Yes |
No |
No |
No |
torch.nn.functional |
hardtanh |
Yes |
No |
No |
No |
No |
torch.nn.functional |
hardtanh_ |
Yes |
No |
No |
No |
No |
torch.nn.functional |
huber_loss |
Yes |
Yes |
No |
No |
No |
torch.nn.functional |
instance_norm |
Yes |
Yes |
No |
No |
No |
torch.nn.functional |
kl_div |
Yes |
Yes |
No |
No |
No |
torch.nn.functional |
l1_loss |
Yes |
Yes |
No |
No |
No |
torch.nn.functional |
layer_norm |
Yes |
Yes |
No |
No |
No |
torch.nn.functional |
leaky_relu |
Yes |
Yes |
No |
No |
No |
torch.nn.functional |
linear |
Yes |
Yes |
No |
No |
No |
torch.nn.functional |
log_softmax |
Yes |
Yes |
No |
No |
No |
torch.nn.functional |
logsigmoid |
Yes |
No |
No |
No |
No |
torch.nn.functional |
max_pool2d |
Yes |
Yes |
No |
No |
No |
torch.nn.functional |
max_pool3d |
Yes |
Yes |
No |
No |
No |
torch.nn.functional |
mish |
Yes |
Yes |
No |
No |
No |
torch.nn.functional |
mse_loss |
Yes |
Yes |
No |
No |
No |
torch.nn.functional |
nll_loss |
Yes |
Yes |
No |
No |
No |
torch.nn.functional |
one_hot |
Yes |
Yes |
Yes |
No |
No |
torch.nn.functional |
pad |
Yes |
Yes |
No |
No |
No |
torch.nn.functional |
relu |
Yes |
Yes |
No |
No |
No |
torch.nn.functional |
relu_ |
Yes |
Yes |
No |
No |
No |
torch.nn.functional |
rrelu |
Yes |
Yes |
No |
No |
No |
torch.nn.functional |
sigmoid |
Yes |
Yes |
No |
No |
No |
torch.nn.functional |
silu |
Yes |
Yes |
No |
No |
No |
torch.nn.functional |
smooth_l1_loss |
Yes |
Yes |
No |
No |
No |
torch.nn.functional |
softmax |
Yes |
Yes |
No |
No |
No |
torch.nn.functional |
softplus |
Yes |
Yes |
No |
No |
No |
torch.nn.functional |
softshrink |
Yes |
Yes |
No |
No |
No |
torch.nn.functional |
tanh |
Yes |
Yes |
No |
No |
No |
torch.nn.functional |
threshold |
Yes |
Yes |
No |
No |
No |
torch.nn.functional |
upsample |
Yes |
Yes |
No |
No |
No |
torch.nn.functional |
upsample_nearest |
Yes |
Yes |
No |
No |
No |
torch.nn.functional |
vector_norm |
Yes |
Yes |
No |
No |
No |
torch.linalg |
abs |
Yes |
Yes |
No |
No |
No |
torch |
absolute |
Yes |
Yes |
No |
No |
No |
torch |
acos |
Yes |
Yes |
No |
No |
No |
torch |
acosh |
Yes |
Yes |
No |
No |
No |
torch |
add |
Yes |
Yes |
Yes |
No |
No |
torch |
addbmm |
Yes |
Yes |
No |
No |
No |
torch |
addcdiv |
Yes |
Yes |
No |
No |
No |
torch |
addcmul |
Yes |
Yes |
No |
No |
No |
torch |
addmm |
Yes |
Yes |
No |
No |
No |
torch |
addmv |
Yes |
Yes |
No |
No |
No |
torch |
addr |
Yes |
Yes |
No |
No |
No |
torch |
all |
No |
No |
No |
No |
Yes |
torch |
amax |
Yes |
Yes |
Yes |
No |
No |
torch |
amin |
Yes |
Yes |
Yes |
No |
No |
torch |
aminmax |
Yes |
Yes |
Yes |
Yes |
No |
torch |
any |
Yes |
Yes |
Yes |
No |
Yes |
torch |
arange |
Yes |
Yes |
Yes |
Yes |
Yes |
torch |
arccos |
Yes |
Yes |
No |
No |
No |
torch |
arccosh |
Yes |
Yes |
No |
No |
No |
torch |
arcsin |
Yes |
Yes |
No |
No |
No |
torch |
arcsinh |
Yes |
Yes |
No |
No |
No |
torch |
arctan |
Yes |
Yes |
No |
No |
No |
torch |
arctanh |
Yes |
Yes |
No |
No |
No |
torch |
argmax |
Yes |
Yes |
Yes |
No |
No |
torch |
argmin |
Yes |
Yes |
Yes |
No |
No |
torch |
asin |
Yes |
Yes |
No |
No |
No |
torch |
asinh |
Yes |
Yes |
No |
No |
No |
torch |
as_strided |
Yes |
Yes |
Yes |
Yes |
Yes |
torch |
atan |
Yes |
Yes |
No |
No |
No |
torch |
atan2 |
Yes |
Yes |
No |
No |
No |
torch |
arctan2 |
Yes |
Yes |
No |
No |
No |
torch |
atanh |
Yes |
Yes |
No |
No |
No |
torch |
baddbmm |
Yes |
Yes |
No |
No |
No |
torch |
bernoulli |
Yes |
Yes |
No |
No |
No |
torch |
bitwise_and |
No |
No |
Yes |
Yes |
Yes |
torch |
bitwise_left_shift |
No |
No |
Yes |
Yes |
Yes |
torch |
bitwise_not |
No |
No |
No |
No |
Yes |
torch |
bitwise_or |
No |
No |
Yes |
Yes |
Yes |
torch |
bitwise_right_shift |
No |
No |
Yes |
Yes |
Yes |
torch |
bitwise_xor |
No |
No |
Yes |
Yes |
Yes |
torch |
bmm |
Yes |
Yes |
No |
No |
No |
torch |
broadcast_tensors |
Yes |
Yes |
No |
No |
No |
torch |
cat |
Yes |
Yes |
Yes |
Yes |
Yes |
torch |
ceil |
Yes |
Yes |
No |
No |
No |
torch |
chunk |
Yes |
Yes |
Yes |
No |
No |
torch |
clamp |
Yes |
Yes |
Yes |
No |
No |
torch |
clip |
Yes |
Yes |
Yes |
No |
No |
torch |
clone |
Yes |
Yes |
Yes |
Yes |
Yes |
torch |
conj |
Yes |
Yes |
Yes |
No |
No |
torch |
copysign |
Yes |
Yes |
No |
No |
No |
torch |
cos |
Yes |
Yes |
No |
No |
No |
torch |
cosh |
Yes |
Yes |
No |
No |
No |
torch |
count_nonzero |
Yes |
Yes |
Yes |
Yes |
Yes |
torch |
cross |
Yes |
Yes |
Yes |
No |
No |
torch |
cumsum |
Yes |
Yes |
Yes |
No |
No |
torch |
cumprod |
Yes |
Yes |
Yes |
No |
No |
torch |
diag |
Yes |
Yes |
No |
No |
No |
torch |
div |
Yes |
Yes |
Yes |
Yes |
No |
torch |
divide |
Yes |
Yes |
Yes |
Yes |
No |
torch |
dot |
Yes |
Yes |
No |
No |
No |
torch |
empty |
Yes |
Yes |
Yes |
Yes |
Yes |
torch |
empty_like |
Yes |
Yes |
Yes |
Yes |
Yes |
torch |
empty_strided |
Yes |
Yes |
Yes |
Yes |
Yes |
torch |
eq |
Yes |
Yes |
Yes |
Yes |
No |
torch |
equal |
Yes |
Yes |
Yes |
Yes |
Yes |
torch |
erf |
Yes |
Yes |
No |
No |
No |
torch |
erfc |
Yes |
Yes |
No |
No |
No |
torch |
erfinv |
Yes |
No |
No |
No |
No |
torch |
exp |
Yes |
Yes |
No |
No |
No |
torch |
exp2 |
Yes |
Yes |
No |
No |
No |
torch |
expm1 |
Yes |
No |
No |
No |
No |
torch |
flatten |
Yes |
Yes |
Yes |
No |
No |
torch |
flip |
Yes |
Yes |
Yes |
Yes |
Yes |
torch |
float_power |
Yes |
Yes |
No |
No |
No |
torch |
floor |
Yes |
Yes |
No |
No |
No |
torch |
floor_divide |
Yes |
Yes |
No |
No |
No |
torch |
fmod |
Yes |
Yes |
Yes |
No |
No |
torch |
frac |
Yes |
Yes |
No |
No |
No |
torch |
frexp |
Yes |
Yes |
No |
No |
No |
torch |
full |
Yes |
Yes |
Yes |
Yes |
No |
torch |
full_like |
Yes |
Yes |
Yes |
Yes |
No |
torch |
gather |
Yes |
Yes |
Yes |
Yes |
No |
torch |
ge |
Yes |
Yes |
Yes |
No |
No |
torch |
greater |
Yes |
Yes |
Yes |
Yes |
No |
torch |
greater_equal |
Yes |
Yes |
Yes |
Yes |
No |
torch |
gt |
Yes |
Yes |
No |
No |
No |
torch |
heaviside |
Yes |
Yes |
Yes |
No |
No |
torch |
hypot |
Yes |
Yes |
No |
No |
No |
torch |
index_select |
Yes |
Yes |
Yes |
No |
No |
torch |
is_complex |
Yes |
Yes |
Yes |
No |
No |
torch |
is_floating_point |
Yes |
Yes |
Yes |
No |
No |
torch |
is_nonzero |
Yes |
Yes |
Yes |
No |
No |
torch |
isfinite |
Yes |
Yes |
No |
No |
No |
torch |
isinf |
Yes |
Yes |
No |
No |
No |
torch |
isnan |
Yes |
Yes |
Yes |
No |
No |
torch |
isneginf |
Yes |
Yes |
No |
No |
No |
torch |
isposinf |
Yes |
Yes |
No |
No |
No |
torch |
kthvalue |
Yes |
Yes |
Yes |
No |
No |
torch |
le |
Yes |
Yes |
Yes |
Yes |
No |
torch |
lerp |
Yes |
Yes |
Yes |
No |
No |
torch |
less |
Yes |
Yes |
Yes |
Yes |
No |
torch |
less_equal |
Yes |
Yes |
Yes |
Yes |
No |
torch |
linspace |
Yes |
Yes |
No |
No |
No |
torch |
log |
Yes |
Yes |
No |
No |
No |
torch |
log10 |
Yes |
Yes |
No |
No |
No |
torch |
log1p |
Yes |
Yes |
No |
No |
No |
torch |
log2 |
Yes |
Yes |
No |
No |
No |
torch |
logaddexp |
Yes |
Yes |
No |
No |
No |
torch |
logaddexp2 |
Yes |
Yes |
No |
No |
No |
torch |
logcumsumexp |
Yes |
Yes |
No |
No |
No |
torch |
logical_and |
Yes |
Yes |
No |
Yes |
No |
torch |
logical_or |
Yes |
Yes |
No |
Yes |
No |
torch |
logical_xor |
Yes |
Yes |
No |
Yes |
No |
torch |
logit |
Yes |
Yes |
No |
No |
No |
torch |
logspace |
Yes |
Yes |
No |
No |
No |
torch |
logsumexp |
Yes |
Yes |
No |
No |
No |
torch |
lt |
Yes |
Yes |
Yes |
Yes |
No |
torch |
masked_select |
Yes |
Yes |
Yes |
No |
No |
torch |
matmul |
Yes |
Yes |
No |
No |
No |
torch |
max |
Yes |
Yes |
Yes |
No |
No |
torch |
maximum |
Yes |
Yes |
Yes |
No |
No |
torch |
mean |
Yes |
Yes |
No |
No |
No |
torch |
median |
Yes |
Yes |
No |
No |
No |
torch |
meshgrid |
Yes |
Yes |
No |
No |
No |
torch |
min |
Yes |
Yes |
Yes |
No |
No |
torch |
minimum |
Yes |
Yes |
Yes |
No |
No |
torch |
mm |
Yes |
Yes |
No |
No |
No |
torch |
mul |
Yes |
Yes |
No |
No |
No |
torch |
mv |
Yes |
Yes |
No |
No |
No |
torch |
nan_to_num |
Yes |
Yes |
Yes |
No |
No |
torch |
nansum |
Yes |
No |
No |
No |
No |
torch |
narrow |
Yes |
No |
No |
No |
No |
torch |
ne |
Yes |
Yes |
Yes |
No |
No |
torch |
neg |
Yes |
Yes |
No |
No |
No |
torch |
nextafter |
Yes |
Yes |
No |
No |
No |
torch |
nonzero |
Yes |
Yes |
Yes |
No |
Yes |
torch |
norm |
Yes |
Yes |
No |
No |
No |
torch |
normal |
Yes |
Yes |
No |
No |
No |
torch |
not_equal |
Yes |
Yes |
Yes |
Yes |
Yes |
torch |
ones |
Yes |
Yes |
Yes |
Yes |
Yes |
torch |
ones_like |
Yes |
Yes |
Yes |
Yes |
Yes |
torch |
poisson |
Yes |
Yes |
No |
No |
No |
torch |
pow |
Yes |
Yes |
No |
No |
No |
torch |
prod |
Yes |
Yes |
No |
No |
No |
torch |
random |
Yes |
Yes |
Yes |
No |
No |
torch |
randperm |
No |
No |
Yes |
No |
No |
torch |
reciprocal |
Yes |
Yes |
No |
No |
No |
torch |
reshape |
Yes |
Yes |
Yes |
Yes |
Yes |
torch |
resolve_conj |
Yes |
Yes |
No |
No |
No |
torch |
resolve_neg |
Yes |
Yes |
No |
No |
No |
torch |
result_type |
Yes |
Yes |
Yes |
No |
No |
torch |
round |
Yes |
Yes |
No |
No |
No |
torch |
rsqrt |
Yes |
Yes |
No |
No |
No |
torch |
rsub |
Yes |
Yes |
No |
No |
No |
torch |
scatter |
Yes |
Yes |
Yes |
No |
Yes |
torch |
scatter_add |
Yes |
Yes |
No |
No |
No |
torch |
searchsorted |
Yes |
Yes |
Yes |
No |
No |
torch |
select |
Yes |
Yes |
Yes |
No |
No |
torch |
sgn |
Yes |
Yes |
No |
No |
No |
torch |
sigmoid |
Yes |
Yes |
No |
No |
No |
torch |
sign |
Yes |
Yes |
No |
No |
No |
torch |
signbit |
Yes |
Yes |
Yes |
Yes |
No |
torch |
sin |
Yes |
Yes |
No |
No |
No |
torch |
sinc |
Yes |
Yes |
No |
No |
No |
torch |
sinh |
Yes |
Yes |
No |
No |
No |
torch |
sort |
Yes |
Yes |
No |
No |
No |
torch |
split_with_sizes |
Yes |
Yes |
Yes |
No |
No |
torch |
sqrt |
Yes |
Yes |
No |
No |
No |
torch |
square |
Yes |
Yes |
Yes |
No |
No |
torch |
squeeze |
Yes |
Yes |
Yes |
Yes |
Yes |
torch |
stack |
Yes |
Yes |
Yes |
No |
No |
torch |
std |
Yes |
Yes |
No |
No |
No |
torch |
std_mean |
Yes |
Yes |
No |
No |
No |
torch |
sub |
Yes |
Yes |
No |
No |
No |
torch |
sum |
Yes |
Yes |
Yes |
No |
Yes |
torch |
t |
Yes |
Yes |
Yes |
Yes |
Yes |
torch |
take |
Yes |
Yes |
Yes |
No |
No |
torch |
tan |
Yes |
Yes |
No |
No |
No |
torch |
tanh |
Yes |
Yes |
No |
No |
No |
torch |
topk |
Yes |
Yes |
No |
No |
No |
torch |
trace |
Yes |
Yes |
Yes |
No |
No |
torch |
transpose |
Yes |
Yes |
Yes |
Yes |
Yes |
torch |
tril |
Yes |
Yes |
No |
No |
No |
torch |
triu |
Yes |
Yes |
No |
No |
No |
torch |
trunc |
Yes |
Yes |
No |
No |
No |
torch |
unbind |
Yes |
Yes |
Yes |
No |
No |
torch |
unique |
Yes |
Yes |
No |
No |
No |
torch |
unsqueeze |
Yes |
Yes |
Yes |
No |
No |
torch |
var |
Yes |
Yes |
No |
No |
No |
torch |
var_mean |
Yes |
Yes |
No |
No |
No |
torch |
vdot |
Yes |
Yes |
No |
No |
No |
torch |
where |
Yes |
Yes |
Yes |
No |
No |
torch |
xlogy |
Yes |
Yes |
No |
No |
No |
torch |
zeros |
Yes |
Yes |
Yes |
Yes |
Yes |
torch |
zeros_like |
Yes |
Yes |
Yes |
Yes |
Yes |
torch |
AdaptiveAvgPool2d |
Yes |
Yes |
No |
No |
No |
torch.nn |
AvgPool2d |
Yes |
Yes |
No |
No |
No |
torch.nn |
BatchNorm1d |
Yes |
Yes |
No |
No |
No |
torch.nn |
BatchNorm2d |
Yes |
Yes |
No |
No |
No |
torch.nn |
BCELoss |
Yes |
Yes |
No |
No |
No |
torch.nn |
BCEWithLogitsLoss |
Yes |
Yes |
No |
No |
No |
torch.nn |
ChannelShuffle |
Yes |
Yes |
Yes |
No |
No |
torch.nn |
ConstantPad1d |
Yes |
Yes |
No |
No |
No |
torch.nn |
Conv1d |
Yes |
Yes |
No |
No |
No |
torch.nn |
Conv2d |
Yes |
Yes |
No |
No |
No |
torch.nn |
Conv3d |
Yes |
Yes |
No |
No |
No |
torch.nn |
ConvTranspose2d |
Yes |
Yes |
No |
No |
No |
torch.nn |
ConvTranspose3d |
Yes |
Yes |
No |
No |
No |
torch.nn |
CrossEntropyLoss |
Yes |
Yes |
No |
No |
No |
torch.nn |
Dropout |
Yes |
Yes |
No |
No |
No |
torch.nn |
ELU |
Yes |
Yes |
No |
No |
No |
torch.nn |
Embedding |
Yes |
Yes |
No |
No |
No |
torch.nn |
EmbeddingBag |
Yes |
Yes |
No |
No |
No |
torch.nn |
GELU |
Yes |
Yes |
No |
No |
No |
torch.nn |
GLU |
Yes |
No |
No |
No |
No |
torch.nn |
Hardshrink |
Yes |
Yes |
No |
No |
No |
torch.nn |
Hardsigmoid |
Yes |
Yes |
No |
No |
No |
torch.nn |
Hardtanh |
Yes |
No |
No |
No |
No |
torch.nn |
HuberLoss |
Yes |
Yes |
No |
No |
No |
torch.nn |
InstanceNorm2d |
Yes |
Yes |
No |
No |
No |
torch.nn |
KLDivLoss |
Yes |
Yes |
No |
No |
No |
torch.nn |
LayerNorm |
Yes |
Yes |
No |
No |
No |
torch.nn |
LeakyReLU |
Yes |
Yes |
No |
No |
No |
torch.nn |
Linear |
Yes |
Yes |
No |
No |
No |
torch.nn |
LogSigmoid |
Yes |
No |
No |
No |
No |
torch.nn |
LogSoftmax |
Yes |
Yes |
No |
No |
No |
torch.nn |
MaxPool2d |
Yes |
Yes |
No |
No |
No |
torch.nn |
MaxPool3d |
Yes |
Yes |
No |
No |
No |
torch.nn |
Mish |
Yes |
Yes |
No |
No |
No |
torch.nn |
MSELoss |
Yes |
Yes |
No |
No |
No |
torch.nn |
NLLLoss |
Yes |
Yes |
No |
No |
No |
torch.nn |
ReLU |
Yes |
Yes |
No |
No |
No |
torch.nn |
ReflectionPad1d |
Yes |
No |
No |
No |
No |
torch.nn |
ReflectionPad2d |
Yes |
No |
No |
No |
No |
torch.nn |
ReflectionPad3d |
Yes |
No |
No |
No |
No |
torch.nn |
ReplicationPad1d |
Yes |
Yes |
Yes |
No |
No |
torch.nn |
ReplicationPad2d |
Yes |
Yes |
Yes |
No |
No |
torch.nn |
ReplicationPad3d |
Yes |
Yes |
Yes |
No |
No |
torch.nn |
RReLU |
Yes |
Yes |
No |
No |
No |
torch.nn |
SiLU |
Yes |
Yes |
No |
No |
No |
torch.nn |
Softmax |
Yes |
Yes |
No |
No |
No |
torch.nn |
Softplus |
Yes |
Yes |
No |
No |
No |
torch.nn |
Softshrink |
Yes |
Yes |
No |
No |
No |
torch.nn |
Threshold |
Yes |
Yes |
No |
No |
No |
torch.nn |
SmoothL1Loss |
Yes |
Yes |
No |
No |
No |
torch.nn |
Upsample |
Yes |
Yes |
No |
No |
No |
torch.nn |
UpsamplingNearest2d |
Yes |
Yes |
No |
No |
No |
torch.nn |
weight_norm |
Yes |
Yes |
No |
No |
No |
torch.nn.utils |
__and__ |
No |
No |
Yes |
Yes |
Yes |
torch.Tensor |
__iand__ |
No |
No |
Yes |
Yes |
Yes |
torch.Tensor |
__ilshift__ |
No |
No |
Yes |
Yes |
Yes |
torch.Tensor |
__ior__ |
No |
No |
Yes |
Yes |
Yes |
torch.Tensor |
__irshift__ |
No |
No |
Yes |
Yes |
Yes |
torch.Tensor |
__ixor__ |
No |
No |
Yes |
Yes |
Yes |
torch.Tensor |
__lshift__ |
No |
No |
Yes |
Yes |
Yes |
torch.Tensor |
__or__ |
No |
No |
Yes |
Yes |
Yes |
torch.Tensor |
__rshift__ |
No |
No |
Yes |
Yes |
Yes |
torch.Tensor |
__xor__ |
No |
No |
Yes |
Yes |
Yes |
torch.Tensor |
abs |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
acos |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
acos_ |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
acosh |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
acosh_ |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
add |
Yes |
Yes |
Yes |
No |
No |
torch.Tensor |
add_ |
Yes |
Yes |
Yes |
No |
No |
torch.Tensor |
addbmm |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
addbmm_ |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
addcdiv |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
addcdiv_ |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
addcmul |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
addcmul_ |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
addmm |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
addmm_ |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
addmv |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
addmv_ |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
addr |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
addr_ |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
all |
No |
No |
No |
No |
Yes |
torch.Tensor |
amax |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
amin |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
aminmax |
Yes |
Yes |
Yes |
Yes |
No |
torch.Tensor |
any |
No |
No |
No |
No |
Yes |
torch.Tensor |
arccos |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
arccos_ |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
arccosh |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
arccosh_ |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
arcsin |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
arcsin_ |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
arcsinh |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
arcsinh_ |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
arctan |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
arctan_ |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
arctanh |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
arctanh_ |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
argmax |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
asin |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
asin_ |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
asinh |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
asinh_ |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
atan2 |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
atan2_ |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
arctan2 |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
arctan2_ |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
atanh |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
atanh_ |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
baddbmm |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
baddbmm_ |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
bernoulli |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
bitwise_and |
No |
No |
No |
No |
Yes |
torch.Tensor |
bitwise_left_shift |
No |
No |
Yes |
Yes |
No |
torch.Tensor |
bitwise_not |
No |
No |
Yes |
Yes |
Yes |
torch.Tensor |
bitwise_or |
No |
No |
No |
No |
Yes |
torch.Tensor |
bitwise_right_shift |
No |
No |
Yes |
Yes |
No |
torch.Tensor |
bitwise_xor |
No |
No |
No |
No |
Yes |
torch.Tensor |
bmm |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
ceil |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
clamp |
Yes |
Yes |
Yes |
No |
No |
torch.Tensor |
clamp_ |
Yes |
Yes |
Yes |
No |
No |
torch.Tensor |
clamp_max |
Yes |
Yes |
Yes |
No |
No |
torch.Tensor |
clamp_min |
Yes |
Yes |
Yes |
No |
No |
torch.Tensor |
clip |
Yes |
Yes |
Yes |
No |
No |
torch.Tensor |
clip_ |
Yes |
Yes |
Yes |
No |
No |
torch.Tensor |
clone |
Yes |
Yes |
Yes |
Yes |
Yes |
torch.Tensor |
conj |
Yes |
Yes |
Yes |
No |
No |
torch.Tensor |
copy_ |
Yes |
Yes |
Yes |
Yes |
Yes |
torch.Tensor |
copysign |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
copysign_ |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
cos |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
cos_ |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
cosh_ |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
count_nonzero |
Yes |
Yes |
Yes |
Yes |
Yes |
torch.Tensor |
cross |
Yes |
Yes |
Yes |
No |
No |
torch.Tensor |
cumprod |
Yes |
Yes |
Yes |
No |
No |
torch.Tensor |
cumsum |
Yes |
Yes |
Yes |
No |
No |
torch.Tensor |
diag |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
div |
Yes |
Yes |
Yes |
Yes |
No |
torch.Tensor |
div_ |
Yes |
Yes |
Yes |
Yes |
No |
torch.Tensor |
dot |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
fill_ |
Yes |
Yes |
Yes |
No |
No |
torch.Tensor |
eq |
Yes |
Yes |
Yes |
Yes |
No |
torch.Tensor |
eq_ |
Yes |
Yes |
Yes |
Yes |
No |
torch.Tensor |
equal |
Yes |
Yes |
Yes |
Yes |
No |
torch.Tensor |
erf |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
erf_ |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
erfinv |
Yes |
No |
No |
No |
No |
torch.Tensor |
erfinv_ |
Yes |
No |
No |
No |
No |
torch.Tensor |
erfc_ |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
erfc |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
exp |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
exp_ |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
expand |
Yes |
Yes |
Yes |
No |
No |
torch.Tensor |
expand_as |
Yes |
Yes |
Yes |
Yes |
Yes |
torch.Tensor |
expm1 |
Yes |
No |
No |
No |
No |
torch.Tensor |
expm1_ |
Yes |
No |
No |
No |
No |
torch.Tensor |
exponential_ |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
flatten |
Yes |
Yes |
Yes |
No |
No |
torch.Tensor |
flip |
Yes |
Yes |
Yes |
Yes |
Yes |
torch.Tensor |
floor |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
floor_ |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
floor_divide |
Yes |
Yes |
Yes |
No |
No |
torch.Tensor |
fmod |
Yes |
Yes |
Yes |
No |
No |
torch.Tensor |
fmod_ |
Yes |
Yes |
Yes |
No |
No |
torch.Tensor |
frac |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
frexp |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
gather |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
ge |
Yes |
Yes |
Yes |
No |
No |
torch.Tensor |
ge_ |
Yes |
Yes |
Yes |
No |
No |
torch.Tensor |
geometric_ |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
greater |
Yes |
Yes |
Yes |
Yes |
No |
torch.Tensor |
greater_equal |
Yes |
Yes |
Yes |
Yes |
No |
torch.Tensor |
gt |
Yes |
Yes |
Yes |
Yes |
No |
torch.Tensor |
hardshrink |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
heaviside |
Yes |
Yes |
Yes |
No |
No |
torch.Tensor |
hypot |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
index_add_ |
Yes |
Yes |
Yes |
No |
No |
torch.Tensor |
index_copy_ |
Yes |
Yes |
Yes |
Yes |
Yes |
torch.Tensor |
index_put |
Yes |
Yes |
Yes |
No |
No |
torch.Tensor |
index_put_ |
Yes |
Yes |
Yes |
No |
No |
torch.Tensor |
index_select |
Yes |
Yes |
Yes |
No |
No |
torch.Tensor |
is_complex |
Yes |
Yes |
Yes |
No |
No |
torch.Tensor |
is_floating_point |
Yes |
Yes |
Yes |
No |
No |
torch.Tensor |
isfinite |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
isinf |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
isnan |
Yes |
Yes |
Yes |
No |
No |
torch.Tensor |
isneginf |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
isposinf |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
item |
Yes |
No |
No |
No |
No |
torch.Tensor |
kthvalue |
Yes |
Yes |
Yes |
No |
No |
torch.Tensor |
le |
Yes |
Yes |
Yes |
Yes |
No |
torch.Tensor |
le_ |
Yes |
Yes |
Yes |
Yes |
No |
torch.Tensor |
lerp |
Yes |
Yes |
Yes |
No |
No |
torch.Tensor |
less |
Yes |
Yes |
Yes |
Yes |
No |
torch.Tensor |
less_ |
Yes |
Yes |
Yes |
Yes |
No |
torch.Tensor |
less_equal |
Yes |
Yes |
Yes |
Yes |
No |
torch.Tensor |
less_equal_ |
Yes |
Yes |
Yes |
Yes |
No |
torch.Tensor |
log |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
log_ |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
log_normal_ |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
log_softmax |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
log10 |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
log1p |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
log1p_ |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
log2 |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
log2_ |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
logaddexp |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
logaddexp2 |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
logcumsumexp |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
logical_and |
Yes |
Yes |
No |
Yes |
No |
torch.Tensor |
logical_or |
Yes |
Yes |
No |
Yes |
No |
torch.Tensor |
logical_xor |
Yes |
Yes |
No |
Yes |
No |
torch.Tensor |
logit |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
logsumexp |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
lt |
Yes |
Yes |
Yes |
Yes |
No |
torch.Tensor |
masked_fill |
Yes |
Yes |
Yes |
No |
No |
torch.Tensor |
masked_fill_ |
Yes |
Yes |
Yes |
No |
No |
torch.Tensor |
masked_scatter_ |
Yes |
Yes |
Yes |
No |
No |
torch.Tensor |
masked_select |
Yes |
Yes |
Yes |
No |
No |
torch.Tensor |
matmul |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
max |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
maximum |
Yes |
Yes |
Yes |
No |
No |
torch.Tensor |
mean |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
median |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
min |
Yes |
Yes |
Yes |
No |
No |
torch.Tensor |
minimum |
Yes |
Yes |
Yes |
No |
No |
torch.Tensor |
mm |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
mul |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
mul_ |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
mv |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
nan_to_num |
Yes |
Yes |
Yes |
No |
No |
torch.Tensor |
nansum |
Yes |
No |
No |
No |
No |
torch.Tensor |
narrow |
Yes |
No |
No |
No |
No |
torch.Tensor |
ne |
Yes |
Yes |
Yes |
No |
No |
torch.Tensor |
ne_ |
Yes |
Yes |
Yes |
No |
No |
torch.Tensor |
neg |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
new_empty |
Yes |
Yes |
Yes |
Yes |
No |
torch.Tensor |
new_empty_strided |
Yes |
Yes |
Yes |
Yes |
No |
torch.Tensor |
new_full |
Yes |
Yes |
Yes |
Yes |
No |
torch.Tensor |
new_ones |
Yes |
Yes |
Yes |
Yes |
No |
torch.Tensor |
new_zeros |
Yes |
Yes |
Yes |
Yes |
No |
torch.Tensor |
nextafter |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
nonzero |
Yes |
Yes |
Yes |
No |
Yes |
torch.Tensor |
norm |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
normal_ |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
permute |
Yes |
Yes |
Yes |
No |
No |
torch.Tensor |
pin_memory |
Yes |
Yes |
Yes |
Yes |
Yes |
torch.Tensor |
pow |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
pow_ |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
prod |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
reciprocal |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
reciprocal_ |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
remainder |
Yes |
No |
Yes |
Yes |
No |
torch.Tensor |
remainder_ |
No |
No |
Yes |
Yes |
No |
torch.Tensor |
repeat |
Yes |
Yes |
Yes |
Yes |
Yes |
torch.Tensor |
reshape |
Yes |
Yes |
Yes |
Yes |
Yes |
torch.Tensor |
round |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
round_ |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
rsqrt |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
rsqrt_ |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
scatter_ |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
scatter_add |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
scatter_add_ |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
select |
Yes |
Yes |
Yes |
No |
No |
torch.Tensor |
sgn |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
sgn_ |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
sigmoid |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
sigmoid_ |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
sign |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
sign_ |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
signbit |
Yes |
Yes |
Yes |
Yes |
No |
torch.Tensor |
sin |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
sin_ |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
sinh |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
sinh_ |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
sinc |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
sort |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
split_with_sizes |
Yes |
Yes |
Yes |
No |
No |
torch.Tensor |
sqrt |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
square |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
square_ |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
squeeze |
Yes |
Yes |
Yes |
Yes |
Yes |
torch.Tensor |
squeeze_ |
Yes |
Yes |
Yes |
Yes |
Yes |
torch.Tensor |
std |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
sub |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
sub_ |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
sum |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
T |
Yes |
Yes |
Yes |
Yes |
Yes |
torch.Tensor |
t |
Yes |
Yes |
Yes |
Yes |
Yes |
torch.Tensor |
tan |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
tan_ |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
tanh |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
tanh_ |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
to |
Yes |
Yes |
Yes |
Yes |
Yes |
torch.Tensor |
topk |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
trace |
Yes |
Yes |
Yes |
No |
No |
torch.Tensor |
take |
Yes |
Yes |
Yes |
No |
No |
torch.Tensor |
transpose |
Yes |
Yes |
Yes |
Yes |
Yes |
torch.Tensor |
tril |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
tril_ |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
triu |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
triu_ |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
trunc |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
trunc_ |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
unbind |
Yes |
Yes |
Yes |
No |
No |
torch.Tensor |
unsqueeze |
Yes |
Yes |
Yes |
No |
No |
torch.Tensor |
uniform_ |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
unique |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
var |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
vdot |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
view |
Yes |
No |
No |
No |
No |
torch.Tensor |
where |
Yes |
Yes |
Yes |
No |
No |
torch.Tensor |
xlogy |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
xlogy_ |
Yes |
Yes |
No |
No |
No |
torch.Tensor |
entr |
Yes |
No |
No |
No |
No |
torch.special |
erf |
Yes |
Yes |
No |
No |
No |
torch.special |
erfc |
Yes |
Yes |
No |
No |
No |
torch.special |
exp2 |
Yes |
Yes |
No |
No |
No |
torch.special |
expit |
Yes |
Yes |
No |
No |
No |
torch.special |
expm1 |
Yes |
No |
No |
No |
No |
torch.special |
erfinv |
Yes |
No |
No |
No |
No |
torch.special |
log1p |
Yes |
Yes |
No |
No |
No |
torch.special |
logit |
Yes |
Yes |
No |
No |
No |
torch.special |
logsumexp |
Yes |
Yes |
No |
No |
No |
torch.special |
round |
Yes |
Yes |
No |
No |
No |
torch.special |
sinc |
Yes |
Yes |
No |
No |
No |
torch.special |
softmax |
Yes |
Yes |
No |
No |
No |
torch.special |
xlog1py |
Yes |
Yes |
No |
No |
No |
torch.special |
xlogy |
Yes |
Yes |
No |
No |
No |
torch.special |
batched_nms |
Yes |
No |
No |
No |
No |
torchvision.ops |
nms |
Yes |
No |
No |
No |
No |
torchvision.ops |
roi_align |
Yes |
No |
No |
No |
No |
torchvision.ops |