Skip to content

Add support for data parallel QLoRA training via DeepSpeed Zero stages 0, 1 and 2. #11340

Add support for data parallel QLoRA training via DeepSpeed Zero stages 0, 1 and 2.

Add support for data parallel QLoRA training via DeepSpeed Zero stages 0, 1 and 2. #11340

Triggered via pull request October 16, 2023 15:36
@arnavgarg1arnavgarg1
synchronize #3728
ds-stage2
Status Cancelled
Total duration 18m 33s
Artifacts 4

pytest.yml

on: pull_request
Matrix: integration-tests
Matrix: pytest
Fit to window
Zoom out
Zoom in

Annotations

9 errors, 18 warnings, and 2 notices
integration_tests_e
The operation was canceled.
py3.10, torch-nightly, not distributed, ubuntu-latest, ray 2.3.1
The operation was canceled.
integration_tests_c
The operation was canceled.
integration_tests_a
The operation was canceled.
py3.8, torch-1.13.0, not distributed, ubuntu-latest, ray 2.2.0
The operation was canceled.
Combinatorial Tests
The operation was canceled.
py3.9, torch-2.0.0, not distributed, ubuntu-latest, ray 2.3.0
The operation was canceled.
integration_tests_d
The operation was canceled.
LLM Tests
The operation was canceled.
Event File
The following actions uses node12 which is deprecated and will be forced to run on node16: actions/upload-artifact@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
Test Minimal Install
The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2, actions/setup-python@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
py3.8, torch-1.13.0, distributed, ubuntu-latest, ray 2.2.0
The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2, actions/setup-python@v2, actions/cache@v2, actions/upload-artifact@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
py3.10, torch-nightly, distributed, ubuntu-latest, ray 2.3.1
The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2, actions/setup-python@v2, actions/cache@v2, actions/upload-artifact@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
py3.9, torch-2.0.0, distributed, ubuntu-latest, ray 2.3.0
The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2, actions/setup-python@v2, actions/cache@v2, actions/upload-artifact@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
integration_tests_b
The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2, actions/setup-python@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
integration_tests_e
The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2, actions/setup-python@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
py3.10, torch-nightly, not distributed, ubuntu-latest, ray 2.3.1
The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2, actions/setup-python@v2, actions/cache@v2, actions/upload-artifact@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
py3.10, torch-nightly, not distributed, ubuntu-latest, ray 2.3.1
No files were found with the provided path: pytest.xml. No artifacts will be uploaded.
integration_tests_c
The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2, actions/setup-python@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
integration_tests_a
The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2, actions/setup-python@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
py3.8, torch-1.13.0, not distributed, ubuntu-latest, ray 2.2.0
The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2, actions/setup-python@v2, actions/cache@v2, actions/upload-artifact@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
py3.8, torch-1.13.0, not distributed, ubuntu-latest, ray 2.2.0
No files were found with the provided path: pytest.xml. No artifacts will be uploaded.
Combinatorial Tests
The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2, actions/setup-python@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
py3.9, torch-2.0.0, not distributed, ubuntu-latest, ray 2.3.0
The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2, actions/setup-python@v2, actions/cache@v2, actions/upload-artifact@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
py3.9, torch-2.0.0, not distributed, ubuntu-latest, ray 2.3.0
No files were found with the provided path: pytest.xml. No artifacts will be uploaded.
integration_tests_d
The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2, actions/setup-python@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
LLM Tests
The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2, actions/setup-python@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
3 skipped tests found
There are 3 skipped tests, see "Raw output" for the full list of skipped tests.
8 tests found
There are 8 tests, see "Raw output" for the full list of tests.

Artifacts

Produced during runtime
Name Size
Event File Expired
33 KB
Unit Test Results (Python 3.10 distributed) Expired
2.01 KB
Unit Test Results (Python 3.8 distributed) Expired
2.01 KB
Unit Test Results (Python 3.9 distributed) Expired
2.01 KB