Enable evaluation with LLMs <7B #10516
geoffreyanguspytest.yml
on: pull_request
Integration Tests (A)
52m 3s
Integration Tests (B)
1h 8m
Integration Tests (C)
47m 3s
Integration Tests (D)
38m 50s
LLM Tests
17m 12s
Combinatorial Tests
20m 51s
Test Minimal Install
5m 24s
Event File
2s
Matrix: pytest
Annotations
2 errors, 21 warnings, and 6 notices
|
py3.10, torch-nightly, distributed, ubuntu-latest, ray 2.3.1
Process completed with exit code 1.
|
|
py3.10, torch-nightly, not distributed, ubuntu-latest, ray 2.3.1
Process completed with exit code 1.
|
|
Combinatorial Tests
The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2, actions/setup-python@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
|
|
Event File
The following actions uses node12 which is deprecated and will be forced to run on node16: actions/upload-artifact@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
|
|
Integration Tests (D)
The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2, actions/setup-python@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
|
|
Integration Tests (C)
The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2, actions/setup-python@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
|
|
LLM Tests
The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2, actions/setup-python@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
|
|
Integration Tests (A)
The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2, actions/setup-python@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
|
|
py3.8, torch-1.13.0, not distributed, ubuntu-latest, ray 2.2.0
The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2, actions/setup-python@v2, actions/cache@v2, actions/upload-artifact@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
|
|
py3.8, torch-1.13.0, distributed, ubuntu-latest, ray 2.2.0
The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2, actions/setup-python@v2, actions/cache@v2, actions/upload-artifact@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
|
|
py3.9, torch-2.0.0, not distributed, ubuntu-latest, ray 2.3.0
The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2, actions/setup-python@v2, actions/cache@v2, actions/upload-artifact@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
|
|
py3.9, torch-2.0.0, distributed, ubuntu-latest, ray 2.3.0
The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2, actions/setup-python@v2, actions/cache@v2, actions/upload-artifact@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
|
|
py3.10, torch-nightly, distributed, ubuntu-latest, ray 2.3.1
The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2, actions/setup-python@v2, actions/cache@v2, actions/upload-artifact@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
|
|
py3.10, torch-nightly, not distributed, ubuntu-latest, ray 2.3.1
The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2, actions/setup-python@v2, actions/cache@v2, actions/upload-artifact@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
|
|
py3.10, torch-nightly, distributed, ubuntu-latest, ray 2.3.1
No files were found with the provided path: pytest.xml. No artifacts will be uploaded.
|
|
Test Minimal Install
The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2, actions/setup-python@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
|
|
Integration Tests (B)
The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2, actions/setup-python@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
|
|
test_add_feature_data[raw] (tests.ludwig.features.test_audio_feature) failed:
tests.ludwig.features.test_audio_feature#L0
artifacts/Unit Test Results (Python 3.10 not distributed)/pytest.xml
|
|
test_add_feature_data[stft] (tests.ludwig.features.test_audio_feature) failed:
tests.ludwig.features.test_audio_feature#L0
artifacts/Unit Test Results (Python 3.10 not distributed)/pytest.xml
|
|
test_add_feature_data[stft_phase] (tests.ludwig.features.test_audio_feature) failed:
tests.ludwig.features.test_audio_feature#L0
artifacts/Unit Test Results (Python 3.10 not distributed)/pytest.xml
|
|
test_add_feature_data[group_delay] (tests.ludwig.features.test_audio_feature) failed:
tests.ludwig.features.test_audio_feature#L0
artifacts/Unit Test Results (Python 3.10 not distributed)/pytest.xml
|
|
test_add_feature_data[fbank] (tests.ludwig.features.test_audio_feature) failed:
tests.ludwig.features.test_audio_feature#L0
artifacts/Unit Test Results (Python 3.10 not distributed)/pytest.xml
|
|
test_training_determinism_local_backend (tests.ludwig.models.test_training_determinism) failed:
tests.ludwig.models.test_training_determinism#L0
artifacts/Unit Test Results (Python 3.10 not distributed)/pytest.xml
|
|
12 skipped tests found
There are 12 skipped tests, see "Raw output" for the full list of skipped tests.
|
|
2774 tests found (test 1 to 526)
There are 2774 tests, see "Raw output" for the list of tests 1 to 526.
|
|
2774 tests found (test 527 to 1228)
There are 2774 tests, see "Raw output" for the list of tests 527 to 1228.
|
|
2774 tests found (test 1229 to 1945)
There are 2774 tests, see "Raw output" for the list of tests 1229 to 1945.
|
|
2774 tests found (test 1946 to 2699)
There are 2774 tests, see "Raw output" for the list of tests 1946 to 2699.
|
|
2774 tests found (test 2700 to 2774)
There are 2774 tests, see "Raw output" for the list of tests 2700 to 2774.
|
Artifacts
Produced during runtime
| Name | Size | |
|---|---|---|
|
Event File
Expired
|
30.5 KB |
|
|
Unit Test Results (Python 3.10 not distributed)
Expired
|
404 KB |
|
|
Unit Test Results (Python 3.8 distributed)
Expired
|
3.14 KB |
|
|
Unit Test Results (Python 3.8 not distributed)
Expired
|
2.53 KB |
|
|
Unit Test Results (Python 3.9 distributed)
Expired
|
3.14 KB |
|
|
Unit Test Results (Python 3.9 not distributed)
Expired
|
2.53 KB |
|