You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Thank you for sharing this amazing repository. I am running table2text examples and impressed with the ghost differentiation trick. I noticed that origin_params is set to None when a deepspeed_config file is provided. Does this mean the trick is unavailable in distributed settings? Is there a specific reason why this is not supported? Additionally, I saw that a recent commit removed files for distributed setting. Could you share the reason behind this?
Thanks!
The text was updated successfully, but these errors were encountered:
We are rewinding due to a non-technical issue. Please stay tuned as we should put them back soon, especially after our DP ZeRO paper is officially published.
Hi,
Thank you for sharing this amazing repository. I am running table2text examples and impressed with the ghost differentiation trick. I noticed that origin_params is set to None when a deepspeed_config file is provided. Does this mean the trick is unavailable in distributed settings? Is there a specific reason why this is not supported? Additionally, I saw that a recent commit removed files for distributed setting. Could you share the reason behind this?
Thanks!
The text was updated successfully, but these errors were encountered: