Zero copy initialization of models onto training workers for LLMs #10438
Job | Run time |
---|---|
1h 8m 49s | |
47m 9s | |
58m 37s | |
35m 59s | |
16m 18s | |
27m 12s | |
1h 3m 14s | |
30m 13s | |
44m 45s | |
29s | |
27s | |
27m 40s | |
2s | |
6m 25s | |
7h 7m 19s |
Job | Run time |
---|---|
1h 8m 49s | |
47m 9s | |
58m 37s | |
35m 59s | |
16m 18s | |
27m 12s | |
1h 3m 14s | |
30m 13s | |
44m 45s | |
29s | |
27s | |
27m 40s | |
2s | |
6m 25s | |
7h 7m 19s |