PAI-TorchAcc
TorchAcc
Introduction
Installation
Quick Start
Functionality
Data Parallel
FSDP (Fully Sharded Data Parallel)
Data Bucketing
Tutorials
Flash Models
HuggingFace Transformers
Best Practices
Best Practices
API Reference
torchacc
torchacc package
Submodules
torchacc.accelerate module
torchacc.config module
Module contents
Subpackages
torchacc.core package
torchacc.dist package
torchacc.llm package
torchacc.ops package
torchacc.utils package
PAI-TorchAcc
torchacc
torchacc package
torchacc.dist package
View page source
torchacc.dist package
Subpackages
torchacc.dist.pp package
Submodules
torchacc.dist.pp.executor module
torchacc.dist.pp.microbatch module
torchacc.dist.pp.p2p module
torchacc.dist.pp.pipeline module
torchacc.dist.pp.schedule module
torchacc.dist.pp.utils module
Module contents
Submodules
torchacc.dist.backend module
torchacc.dist.distributed_parallel module
torchacc.dist.dp module
torchacc.dist.fsdp module
torchacc.dist.mesh module
torchacc.dist.parallel_module module
torchacc.dist.spmd_fsdp module
torchacc.dist.tp module
Module contents