Skip to content

Add support for data parallel QLoRA training via DeepSpeed Zero stages 0, 1 and 2. #11335

Add support for data parallel QLoRA training via DeepSpeed Zero stages 0, 1 and 2.

Add support for data parallel QLoRA training via DeepSpeed Zero stages 0, 1 and 2. #11335

Triggered via pull request October 16, 2023 13:10
@arnavgarg1arnavgarg1
synchronize #3728
ds-stage2
Status Cancelled
Total duration 13m 30s
Artifacts 4

pytest.yml

on: pull_request
Matrix: integration-tests
Matrix: pytest
Fit to window
Zoom out
Zoom in

Annotations

11 errors, 18 warnings, and 2 notices
integration_tests_d
The operation was canceled.
integration_tests_e
The operation was canceled.
integration_tests_a
The operation was canceled.
LLM Tests
The operation was canceled.
py3.10, torch-nightly, not distributed, ubuntu-latest, ray 2.3.1
The operation was canceled.
py3.8, torch-1.13.0, not distributed, ubuntu-latest, ray 2.2.0
The operation was canceled.
integration_tests_b
The operation was canceled.
integration_tests_c
The operation was canceled.
py3.9, torch-2.0.0, distributed, ubuntu-latest, ray 2.3.0
The operation was canceled.
py3.9, torch-2.0.0, not distributed, ubuntu-latest, ray 2.3.0
The operation was canceled.
Combinatorial Tests
The operation was canceled.
Event File
The following actions uses node12 which is deprecated and will be forced to run on node16: actions/upload-artifact@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
Test Minimal Install
The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2, actions/setup-python@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
py3.8, torch-1.13.0, distributed, ubuntu-latest, ray 2.2.0
The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2, actions/setup-python@v2, actions/cache@v2, actions/upload-artifact@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
py3.10, torch-nightly, distributed, ubuntu-latest, ray 2.3.1
The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2, actions/setup-python@v2, actions/cache@v2, actions/upload-artifact@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
integration_tests_d
The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2, actions/setup-python@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
integration_tests_e
The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2, actions/setup-python@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
integration_tests_a
The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2, actions/setup-python@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
LLM Tests
The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2, actions/setup-python@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
py3.10, torch-nightly, not distributed, ubuntu-latest, ray 2.3.1
The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2, actions/setup-python@v2, actions/cache@v2, actions/upload-artifact@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
py3.10, torch-nightly, not distributed, ubuntu-latest, ray 2.3.1
No files were found with the provided path: pytest.xml. No artifacts will be uploaded.
py3.8, torch-1.13.0, not distributed, ubuntu-latest, ray 2.2.0
The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2, actions/setup-python@v2, actions/cache@v2, actions/upload-artifact@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
py3.8, torch-1.13.0, not distributed, ubuntu-latest, ray 2.2.0
No files were found with the provided path: pytest.xml. No artifacts will be uploaded.
integration_tests_b
The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2, actions/setup-python@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
integration_tests_c
The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2, actions/setup-python@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
py3.9, torch-2.0.0, distributed, ubuntu-latest, ray 2.3.0
The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2, actions/setup-python@v2, actions/cache@v2, actions/upload-artifact@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
py3.9, torch-2.0.0, not distributed, ubuntu-latest, ray 2.3.0
The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2, actions/setup-python@v2, actions/cache@v2, actions/upload-artifact@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
py3.9, torch-2.0.0, not distributed, ubuntu-latest, ray 2.3.0
No files were found with the provided path: pytest.xml. No artifacts will be uploaded.
Combinatorial Tests
The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2, actions/setup-python@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
7 skipped tests found
There are 7 skipped tests, see "Raw output" for the full list of skipped tests.
56 tests found
There are 56 tests, see "Raw output" for the full list of tests.

Artifacts

Produced during runtime
Name Size
Event File Expired
29 KB
Unit Test Results (Python 3.10 distributed) Expired
2.01 KB
Unit Test Results (Python 3.8 distributed) Expired
2.01 KB
Unit Test Results (Python 3.9 distributed) Expired
6.46 KB