Add Automicrobatching for Non-Powers-of-2 + Fixes to FSDP deadlocks using Adaptive Sync Hooks#3503
Draft
JackZ-db wants to merge 23 commits intomosaicml:mainfrom JackZ-db:jz/auto_non_powers_of_2
+569-66
Commits
Commits on Jul 30, 2024
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
Commits on Jul 31, 2024
- committed
- committed
- committed
- committed
- committed
- committed