Skip to content

Fix gradient scaling to account for world_size normalization#2172

Merged
ebsmothers merged 3 commits intopytorch:mainfrom mirceamironenco:fix-world-size-normalizationJan 9, 2025
+18-9

Commits

Commits on Jan 7, 2025