A GPipe implementation in PyTorch
-
Updated
Jul 25, 2024 - Python
A GPipe implementation in PyTorch
Model parallelism for NN architectures with skip connections (eg. ResNets, UNets)
Development of Project HPGO | Hybrid Parallelism Global Orchestration
A fully distributed hyperparameter optimization tool for PyTorch DNNs
Add a description, image, and links to the gpipe topic page so that developers can more easily learn about it.
To associate your repository with the gpipe topic, visit your repo's landing page and select "manage topics."