[EIM-104] [Test] Automated test refactor #423
13 passed, 3 failed and 3 skipped
| Report | Passed | Failed | Skipped | Time |
|---|---|---|---|---|
| results-basic_test.json | 11✅ | 2❌ | 2⚪ | 1910s |
| results-pre-install-test.json | 1✅ | 1❌ | 82s | |
| results-pre-requisites-test.json | 1✅ | 1⚪ | 9s |
❌ results-basic_test.json
15 tests were completed in 1910s with 11 passed, 2 failed and 2 skipped.
| Test suite | Passed | Failed | Skipped | Time |
|---|---|---|---|---|
| tests/runs/testRun.test.js | 11✅ | 2❌ | 2⚪ | 1877s |
❌ tests/runs/testRun.test.js
1 - EIM command line arguments -> Basic Arguments Tests ->
✅ should handle invalid arguments
✅ should show correct version number
✅ should show help with --help argument
2 - Installation manager default installation -> 1 - Run Install Wizard steps ->
✅ Should install IDF using wizard and default values
2 - Installation manager default installation -> 2 - Post installation test (create and build project) ->
✅ 1 - Should create a new project based on a template
✅ 2 - Should set the target
✅ 3 - Should build project for the selected target
3 - Installation using custom settings -> non-interactive-basic -> 1 - Run custom installation using given parameters ->
✅ Should install IDF using specified parameters
3 - Installation using custom settings -> non-interactive-basic -> 2 - Post installation test (create and build project) ->
✅ 1 - Should create a new project based on a template
✅ 2 - Should set the target
✅ 3 - Should build project for the selected target
4 - Installation using custom settings -> non-interactive-full-parameters -> 1 - Run custom installation using given parameters ->
❌ Should install IDF using specified parameters
Failed to complete installation, missing 'Successfully Installed IDF': expected false to be true
4 - Installation using custom settings -> non-interactive-full-parameters -> 2 - Post installation test (create and build project) ->
❌ 1 - Should create a new project based on a template
sdkconfig.ci file not shown after a ls command, file copy failed: expected false to be true
⚪ 2 - Should set the target
⚪ 3 - Should build project for the selected target
❌ results-pre-install-test.json
2 tests were completed in 82s with 1 passed, 1 failed and 0 skipped.
| Test suite | Passed | Failed | Skipped | Time |
|---|---|---|---|---|
| D:/a/idf-im-cli/idf-im-cli/tests/script/prerequisitesInstallRunner.test.js | 1✅ | 1❌ | 68s |
❌ D:/a/idf-im-cli/idf-im-cli/tests/script/prerequisitesInstallRunner.test.js
Check Pre-requisites installation on Windows ->
✅ 1 - should install prerequisites and offer to install python and exit upon negative answer
❌ 2 - should detect all prerequisites are installed
EIM did not ask to select target, error installing prerequisites: expected false to be true
✅ results-pre-requisites-test.json
2 tests were completed in 9s with 1 passed, 0 failed and 1 skipped.
| Test suite | Passed | Failed | Skipped | Time |
|---|---|---|---|---|
| D:/a/idf-im-cli/idf-im-cli/tests/script/prerequisites.test.js | 1✅ | 1⚪ | 5s |
✅ D:/a/idf-im-cli/idf-im-cli/tests/script/prerequisites.test.js
Check if prerequisites are installed -> Pre-Requisites test on non windows platform
⚪ Should detect missing requirements
Check if prerequisites are installed -> Pre-requisites test on Windows
✅ should offer to install prerequisites and exit upon negative answer
Annotations
Check failure on line 0 in results-basic_test.json
github-actions / Auto Tests windows-x64-GitHub.zip
tests/runs/testRun.test.js ► 4 - Installation using custom settings -> non-interactive-full-parameters -> 1 - Run custom installation using given parameters -> ► Should install IDF using specified parameters
Failed test found in:
results-basic_test.json
Error:
Failed to complete installation, missing 'Successfully Installed IDF': expected false to be true
Raw output
AssertionError: Failed to complete installation, missing 'Successfully Installed IDF': expected false to be true
at Context.<anonymous> (file:///home/fabricio/idf-im-cli/tests/script/installCustom.test.js:83:20)
Check failure on line 0 in results-basic_test.json
github-actions / Auto Tests windows-x64-GitHub.zip
tests/runs/testRun.test.js ► 4 - Installation using custom settings -> non-interactive-full-parameters -> 2 - Post installation test (create and build project) -> ► 1 - Should create a new project based on a template
Failed test found in:
results-basic_test.json
Error:
sdkconfig.ci file not shown after a ls command, file copy failed: expected false to be true
Raw output
AssertionError: sdkconfig.ci file not shown after a ls command, file copy failed: expected false to be true
at Context.<anonymous> (file:///home/fabricio/idf-im-cli/tests/script/postInstall.test.js:99:20)
Check failure on line 0 in results-pre-install-test.json
github-actions / Auto Tests windows-x64-GitHub.zip
D:/a/idf-im-cli/idf-im-cli/tests/script/prerequisitesInstallRunner.test.js ► Check Pre-requisites installation on Windows -> ► 2 - should detect all prerequisites are installed
Failed test found in:
results-pre-install-test.json
Error:
EIM did not ask to select target, error installing prerequisites: expected false to be true
Raw output
AssertionError: EIM did not ask to select target, error installing prerequisites: expected false to be true
at Context.<anonymous> (file:///D:/a/idf-im-cli/idf-im-cli/tests/script/prerequisitesInstallRunner.test.js:94:16)