8000 [Async TP] Support saving reduce-scatter for backward to fix no AC, per op SAC, and per layer SAC policies in torchtitan by danielvegamyhre · Pull Request #149946 · pytorch/pytorch · GitHub
[go: up one dir, main page]
Skip to content

[Async TP] Support saving reduce-scatter for backward to fix no AC, per op SAC, and per layer SAC policies in torchtitan#149946

Closed
danielvegamyhre wants to merge 8 commits intomainfrom
rs-ac
Closed

[Async TP] Support saving reduce-scatter for backward to fix no AC, per op SAC, and per layer SAC policies in torchtitan#149946
danielvegamyhre wants to merge 8 commits intomainfrom
rs-ac

Commits

Commits on Mar 28, 2025

Commits on Mar 29, 2025
0