[EIM-104] [Test] Automated test refactor #87
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Hahihula
approved these changes
Jan 21, 2025
.github/workflows/test.yml
Outdated
| reporter: mocha-json | ||
| fail-on-empty: "true" | ||
|
|
||
| # publish-test-results: |
tests/script/installCustom.test.js
Outdated
| logger.info("Installation completed"); | ||
| testRunner.output = ""; | ||
| testRunner.sendInput("n"); | ||
| // expect( |
There was a problem hiding this comment.
Changed my mind about adding a test there. Removed.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Description
Test automation infrastructure refactor. The actual tests steps are miantained but with this PR starting this tests are concentrated into a ingle test runner script.
The script is launched using different entry codes which will use JSON files as test suite instructions.
The test parameters are defined in the files located at ./src/tests/runs/suites
The tests are launched directly from npm scripts, so the bash/powershell scripts have been removed.
To create new tests runs, with different set of parameters it is only necessary to add a new entry in the json file. Future test suite expansion will use this structure by creating new test types, or appending test cases to the current scripts.
CI
The workflow setup is currently running the "basic" test and "extended" test on all runners. The intent is to split this into different workflows and have the basic tests running for all PRs, and the extended test only focusing on release testing. The exact distinction will be defined later.
Test Reports
For each test runs, reports are published back into the workflow page for easier readability, note the example below.
Known issues
The failing tests are already documented.
Related
Testing
Checklist
Before submitting a Pull Request, please ensure the following: