You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
It looks a little confusing and maybe could be written more clearly, but I think that's actually correct. If it was just model, it would be trying to FSDP-wrap the DDP model. By using model(), it's FSDP wrapping a new model instance.
📚 Documentation
In the blog introducing FSDP API
it should be
model
instead ofmodel()
insideFullyShardedDataParallel
so it should be
The text was updated successfully, but these errors were encountered: