PyTorch



Automatic Mixed Precision

torch.cuda.amp.GradScaler.is_enabled()


Backends



CUDA



DDP Communication Hooks

torch.distributed.GradBucket.parameters()


Discrete Fourier Transforms



Distributed Checkpoint



Distributed Communication



Distributed Elastic

torch.distributed.elastic.agent.server.SimpleElasticAgent


Distributed Optimizers

torch.distributed.optim.PostLocalSGDOptimizer.load_state_dict()


Fully Sharded Data Parallel

torch.distributed.fsdp.FullyShardedDataParallel.set_state_dict_type()


FX



Linear Algebra



Miscellaneous

torch.utils.cpp_extension.BuildExtension()


Neuro Network

torch.nn.utils.rnn.unpack_sequence()


NN Functions

torch.nn.functional.torch.nn.functional.embedding_bag
torch.nn.functional.torch.nn.functional.gelu
torch.nn.functional.torch.nn.functional.softshrink
torch.nn.functional.torch.nn.functional.threshold


ONNX



Optimization



Probability Distributions



Profiler



Quantization

torch.ao.quantization.backend_config.BackendPatternConfig.from_dict()
torch.ao.quantization.fx.custom_config.ConvertCustomConfig.to_dict()


Storage



Tensor

torch.Tensor.torch.Tensor.copy_
torch.Tensor.torch.Tensor.expm1_
torch.Tensor.torch.Tensor.floor_
torch.Tensor.torch.Tensor.less_
torch.Tensor.torch.Tensor.quantile
torch.Tensor.torch.Tensor.unique


Torch

torch.quasirandom.SobolEngine.draw()


Torch Script



Traced Graph Export