PyTorch



Automatic Differentiation



Automatic Mixed Precision



Backends

torch.backends.cuda.flash_sdp_enabled()
torch.backends.cuda.matmul.allow_fp16_reduced_precision_reduction


Benchmark Utils



CUDA



Datasets and Data Loaders



DDP Communication Hooks

torch.distributed.algorithms.ddp_comm_hooks.powerSGD_hook.PowerSGDState
torch.distributed.algorithms.ddp_comm_hooks.powerSGD_hook.PowerSGDState.__setstate__()
torch.distributed.algorithms.ddp_comm_hooks.powerSGD_hook.powerSGD_hook()


Discrete Fourier Transforms



Distributed Checkpoint



Distributed Communication

torch.distributed.is_nccl_available()


Distributed Elastic

torch.distributed.elastic.rendezvous.RendezvousParameters.get()
torch.distributed.elastic.rendezvous.RendezvousTimeoutError
torch.distributed.elastic.rendezvous.dynamic_rendezvous.RendezvousTimeout.close
torch.distributed.elastic.rendezvous.etcd_rendezvous_backend.EtcdRendezvousBackend.get_state()
torch.distributed.elastic.rendezvous.etcd_server.EtcdServer


Distributed Optimizers



Distributed RPC



Fully Sharded Data Parallel

torch.distributed.fsdp.FullyShardedDataParallel.apply()
torch.distributed.fsdp.FullyShardedDataParallel.optim_state_dict()


FX



JAX-like Function Transforms



Linear Algebra



Miscellaneous

torch.compiler.TorchDynamo APIs for fine-grained tracing


Monitor



MPS



Neuro Network



NN Functions



ONNX

torch.onnx.TorchDynamo-based ONNX Exporter.FXE0012:unsupported-fx-node-analysis
torch.onnx.TorchDynamo-based ONNX Exporter.FXE0016:find-operator-overloads-in-onnx-registry


Optimization



Package



Parameter Initializations



Probability Distributions

torch.distributions.bernoulli.Bernoulli.log_prob()
torch.distributions.categorical.Categorical.has_enumerate_support
torch.distributions.lowrank_multivariate_normal.LowRankMultivariateNormal.log_prob()
torch.distributions.multivariate_normal.MultivariateNormal.covariance_matrix
torch.distributions.multivariate_normal.MultivariateNormal.precision_matrix
torch.distributions.negative_binomial.NegativeBinomial.expand()
torch.distributions.relaxed_categorical.RelaxedOneHotCategorical.temperature
torch.distributions.transformed_distribution.TransformedDistribution.arg_constraints


Profiler



Quantization

torch.ao.quantization.fx.custom_config.ConvertCustomConfig.set_preserved_attributes()


SciPy-like Signal



SciPy-like Special



Sparse Tensors



Storage



Tensor



Tensor Parallelism



Tensorboard



Torch



Torch Script



Traced Graph Export