PyTorch



Automatic Mixed Precision



Backends



CUDA



DDP Communication Hooks



Discrete Fourier Transforms



Distributed Checkpoint

torch.distributed.checkpoint.LoadPlanner.finish_plan()


Distributed Communication



Distributed Elastic



Distributed Optimizers



Fully Sharded Data Parallel

torch.distributed.fsdp.FullyShardedDataParallel.scatter_full_optim_state_dict()


FX



Linear Algebra



Miscellaneous



MPS



Neuro Network



NN Functions

torch.nn.functional.torch.nn.functional.conv_transpose3d
torch.nn.functional.torch.nn.functional.ctc_loss
torch.nn.functional.torch.nn.functional.embedding_bag
torch.nn.functional.torch.nn.functional.fractional_max_pool3d
torch.nn.functional.torch.nn.functional.gelu
torch.nn.functional.torch.nn.functional.max_pool3d
torch.nn.functional.torch.nn.functional.softshrink
torch.nn.functional.torch.nn.functional.threshold


ONNX



Optimization

torch.optim.lr_scheduler.ChainedScheduler.state_dict()
torch.optim.lr_scheduler.CosineAnnealingWarmRestarts.print_lr()
torch.optim.lr_scheduler.CosineAnnealingWarmRestarts.step()


Probability Distributions

torch.distributions.half_cauchy.HalfCauchy.entropy()
torch.distributions.half_normal.HalfNormal.expand()
torch.distributions.lowrank_multivariate_normal.LowRankMultivariateNormal.variance
torch.distributions.relaxed_categorical.RelaxedOneHotCategorical.support
torch.distributions.relaxed_categorical.RelaxedOneHotCategorical.temperature
torch.distributions.transformed_distribution.TransformedDistribution.support


Profiler



Quantization

torch.ao.ns._numeric_suite.get_matching_activations()
torch.ao.quantization.fake_quantize.enable_observer
torch.ao.quantization.fx.custom_config.PrepareCustomConfig.set_float_to_observed_mapping()
torch.ao.quantization.fx.custom_config.PrepareCustomConfig.set_non_traceable_module_names()


SciPy-like Special



Sparse Tensors



Storage

torch.TypedStorage.bfloat16()


Tensor

torch.Tensor.torch.Tensor.as_strided
torch.Tensor.torch.Tensor.copy_
torch.Tensor.torch.Tensor.cos
torch.Tensor.torch.Tensor.cross
torch.Tensor.torch.Tensor.expm1_
torch.Tensor.torch.Tensor.index_add_
torch.Tensor.torch.Tensor.less_
torch.Tensor.torch.Tensor.masked_select
torch.Tensor.torch.Tensor.matmul
torch.Tensor.torch.Tensor.nanmean
torch.Tensor.torch.Tensor.new_ones
torch.Tensor.torch.Tensor.nextafter
torch.Tensor.torch.Tensor.nextafter_
torch.Tensor.torch.Tensor.pin_memory
torch.Tensor.torch.Tensor.quantile
torch.Tensor.torch.Tensor.to_dense


Tensor Parallelism



Tensorboard

torch.utils.tensorboard.writer.SummaryWriter.add_figure()


Torch



Torch Script



Traced Graph Export