Zero copy initialization of models onto training workers for LLMs #10473
Job | Run time |
---|---|
1h 2m 8s | |
50m 7s | |
44m 23s | |
28m 44s | |
53m 40s | |
26m 5s | |
56m 56s | |
22m 21s | |
3m 32s | |
21m 23s | |
2s | |
34m 24s | |
19m 23s | |
5m 0s | |
7h 8m 8s |
Job | Run time |
---|---|
1h 2m 8s | |
50m 7s | |
44m 23s | |
28m 44s | |
53m 40s | |
26m 5s | |
56m 56s | |
22m 21s | |
3m 32s | |
21m 23s | |
2s | |
34m 24s | |
19m 23s | |
5m 0s | |
7h 8m 8s |