Skip to content

[QAA-284][Detox] Improving tests stability #1304

[QAA-284][Detox] Improving tests stability

[QAA-284][Detox] Improving tests stability #1304

Triggered via pull request October 10, 2024 19:46
Status Cancelled
Total duration 19m 31s
Billable time 16m
Artifacts 18

build-and-test-pr.yml

on: pull_request
Turbo Affected  /  Determine Affected
1m 15s
Turbo Affected / Determine Affected
Test Mobile E2E  /  Ledger Live Mobile - Android Detox Tests
15m 14s
Test Mobile E2E / Ledger Live Mobile - Android Detox Tests
Test Mobile E2E  /  LLM - iOS Detox Tests
0s
Test Mobile E2E / LLM - iOS Detox Tests
Test Desktop  /  Desktop Tests E2E (Ubuntu)
9m 56s
Test Desktop / Desktop Tests E2E (Ubuntu)
Matrix: Build Desktop / build-desktop-app
Build Mobile  /  Build LLM | Android
12m 59s
Build Mobile / Build LLM | Android
Build Mobile  /  Build LLM | iOS
0s
Build Mobile / Build LLM | iOS
Test Mobile  /  LLM CodeCheck
6m 29s
Test Mobile / LLM CodeCheck
Test Design System  /  Design System Tests
2m 35s
Test Design System / Design System Tests
Test Desktop  /  LLD Code Checks
8m 50s
Test Desktop / LLD Code Checks
Test Desktop  /  Desktop Unit Tests
5m 20s
Test Desktop / Desktop Unit Tests
Test Libraries  /  Test Libraries
2m 4s
Test Libraries / Test Libraries
Test Libraries  /  Codecheck Libraries
6m 49s
Test Libraries / Codecheck Libraries
Test Libraries  /  Test Docs
3m 13s
Test Libraries / Test Docs
Test Web Tools  /  Test web-tools
2m 27s
Test Web Tools / Test web-tools
Test Mobile E2E  /  Allure Reports Export on Server
0s
Test Mobile E2E / Allure Reports Export on Server
Matrix: Test Mobile E2E / Upload to Xray
Test Mobile E2E  /  report
0s
Test Mobile E2E / report
Test Mobile E2E  /  report-on-slack
0s
Test Mobile E2E / report-on-slack
Test Mobile E2E  /  Allure Reports Export on Server
0s
Test Mobile E2E / Allure Reports Export on Server
Test Desktop  /  Allure Reports Export on Server
0s
Test Desktop / Allure Reports Export on Server
Build Desktop  /  report
29s
Build Desktop / report
Build Mobile  /  report
0s
Build Mobile / report
Test CLI  /  report
0s
Test CLI / report
Test Desktop  /  report
17s
Test Desktop / report
Test Libraries  /  report
0s
Test Libraries / report
Test Web Tools  /  report
0s
Test Web Tools / report
Fit to window
Zoom out
Zoom in

Annotations

6 errors, 3 warnings, and 1 notice
[mocked_tests] › specs/market/market.spec.ts:34:5 › Market: apps/ledger-live-desktop/tests/specs/market/market.spec.ts#L177
1) [mocked_tests] › specs/market/market.spec.ts:34:5 › Market › go to bitcoin page ─────────────── Error: Screenshot comparison failed: 182182 pixels (ratio 0.24 of all image pixels) are different. Expected: /home/runner/_work/ledger-live/ledger-live/apps/ledger-live-desktop/tests/specs/market/market.spec.ts-snapshots/market-btc-page-linux.png Received: /home/runner/_work/ledger-live/ledger-live/apps/ledger-live-desktop/tests/artifacts/test-results/market-market-Market-mocked-tests/market-btc-page-actual.png Diff: /home/runner/_work/ledger-live/ledger-live/apps/ledger-live-desktop/tests/artifacts/test-results/market-market-Market-mocked-tests/market-btc-page-diff.png Call log: - expect.soft.toHaveScreenshot(market-btc-page.png) with timeout 41000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 174794 pixels (ratio 0.23 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 182182 pixels (ratio 0.24 of all image pixels) are different. 175 | await test.step("go to bitcoin page", async () => { 176 | await marketPage.openCoinPage("btc"); > 177 | await expect.soft(page).toHaveScreenshot("market-btc-page.png", { | ^ 178 | mask: [ 179 | page.getByTestId("chart-container"), 180 | page.getByTestId("market-price-delta"), at /home/runner/_work/ledger-live/ledger-live/apps/ledger-live-desktop/tests/specs/market/market.spec.ts:177:29 at /home/runner/_work/ledger-live/ledger-live/apps/ledger-live-desktop/tests/specs/market/market.spec.ts:175:3
Test Desktop / Desktop Tests E2E (Ubuntu)
Process completed with exit code 1.
Build Mobile / Build LLM | iOS
Canceling since a higher priority waiting request for '[PR] Build and Test-refs/pull/8041/merge' exists
Test Mobile E2E / LLM - iOS Detox Tests
Canceling since a higher priority waiting request for '[PR] Build and Test-refs/pull/8041/merge' exists
Test Mobile E2E / Ledger Live Mobile - Android Detox Tests
Canceling since a higher priority waiting request for '[PR] Build and Test-refs/pull/8041/merge' exists
Test Mobile E2E / Ledger Live Mobile - Android Detox Tests
The operation was canceled.
Test Mobile / LLM CodeCheck
No files were found with the provided path: /home/runner/work/ledger-live/ledger-live/apps/ledger-live-mobile/lint-mobile.json. No artifacts will be uploaded.
Test Libraries / Codecheck Libraries
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/github-script@v6. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
Test Desktop / Desktop Tests E2E (Ubuntu)
This job failure may be caused by using an out of date self-hosted runner. You are currently using runner version 2.319.1. Please update to the latest version 2.320.0
🎭 Playwright Run Summary
1 failed [mocked_tests] › specs/market/market.spec.ts:34:5 › Market ───────────────────────────────────── 3 skipped 64 passed (7.5m)

Artifacts

Produced during runtime
Name Size
2.88.0-sha.9c8823603b8942a2753fa9dfe2c67aa6a0665ff7-linux-x86_64.AppImage
177 MB
2.88.0-sha.9c8823603b8942a2753fa9dfe2c67aa6a0665ff7-mac.dmg
242 MB
2.88.0-sha.9c8823603b8942a2753fa9dfe2c67aa6a0665ff7-win-x64.exe
138 MB
3.51.0-sha.3225148-release
274 MB
allure-results-linux
920 KB
android-allure-report
1.28 MB
android-test-artifacts
9.85 MB
images
315 Bytes
lint-desktop
36.3 KB
linux-js-bundle-metafiles
653 KB
mac-js-bundle-metafiles
653 KB
outputs-codecheck
298 Bytes
outputs-test-libraries
157 Bytes
outputs-test-ui
179 Bytes
playwright-results-linux
3.22 MB
summary-build-desktop.json
360 Bytes
summary-test-desktop.json
1.14 KB
win-js-bundle-metafiles
653 KB