add code documentation for the tokenizer #1182
Job | Run time |
---|---|
1h 8m 35s | |
2m 49s | |
51s | |
33m 2s | |
23m 25s | |
15m 43s | |
8m 44s | |
50m 0s | |
1h 23m 9s | |
27m 1s | |
29m 46s | |
0s | |
5h 43m 5s |
Job | Run time |
---|---|
1h 8m 35s | |
2m 49s | |
51s | |
33m 2s | |
23m 25s | |
15m 43s | |
8m 44s | |
50m 0s | |
1h 23m 9s | |
27m 1s | |
29m 46s | |
0s | |
5h 43m 5s |