Add support for data parallel QLoRA training via DeepSpeed Zero stages 0, 1 and 2. #11361
Triggered via pull request
October 17, 2023 20:37
Status
Cancelled
Total duration
15m 3s
Artifacts
–
pytest.yml
on: pull_request
LLM Tests
0s
Combinatorial Tests
0s
Test Minimal Install
0s
Event File
0s
Matrix: integration-tests
Matrix: pytest
Annotations
15 errors
integration_tests_c
Canceling since a higher priority waiting request for 'pytest-ds-stage2' exists
|
integration_tests_a
Canceling since a higher priority waiting request for 'pytest-ds-stage2' exists
|
integration_tests_d
Canceling since a higher priority waiting request for 'pytest-ds-stage2' exists
|
integration_tests_b
Canceling since a higher priority waiting request for 'pytest-ds-stage2' exists
|
integration_tests_e
Canceling since a higher priority waiting request for 'pytest-ds-stage2' exists
|
LLM Tests
Canceling since a higher priority waiting request for 'pytest-ds-stage2' exists
|
Combinatorial Tests
Canceling since a higher priority waiting request for 'pytest-ds-stage2' exists
|
py3.9, torch-2.0.0, not distributed, ubuntu-latest, ray 2.3.0
Canceling since a higher priority waiting request for 'pytest-ds-stage2' exists
|
py3.8, torch-1.13.0, distributed, ubuntu-latest, ray 2.2.0
Canceling since a higher priority waiting request for 'pytest-ds-stage2' exists
|
py3.10, torch-nightly, not distributed, ubuntu-latest, ray 2.3.1
Canceling since a higher priority waiting request for 'pytest-ds-stage2' exists
|
py3.8, torch-1.13.0, not distributed, ubuntu-latest, ray 2.2.0
Canceling since a higher priority waiting request for 'pytest-ds-stage2' exists
|
py3.10, torch-nightly, distributed, ubuntu-latest, ray 2.3.1
Canceling since a higher priority waiting request for 'pytest-ds-stage2' exists
|
Event File
Canceling since a higher priority waiting request for 'pytest-ds-stage2' exists
|
py3.9, torch-2.0.0, distributed, ubuntu-latest, ray 2.3.0
Canceling since a higher priority waiting request for 'pytest-ds-stage2' exists
|
Test Minimal Install
Canceling since a higher priority waiting request for 'pytest-ds-stage2' exists
|