Skip to content

matrix-react-sdk End to End Tests #2943

matrix-react-sdk End to End Tests

matrix-react-sdk End to End Tests #2943

Triggered via merge group February 26, 2025 16:06
Status Success
Total duration 11m 31s
Artifacts 8
Playwright  /  Build Element-Web
1m 49s
Playwright / Build Element-Web
Matrix: Playwright / playwright
Playwright  /  end-to-end-tests
40s
Playwright / end-to-end-tests
Fit to window
Zoom out
Zoom in

Annotations

7 errors, 29 warnings, and 6 notices
[Chrome] › playwright/e2e/read-receipts/new-messages-main-timeline.spec.ts:53:17 › Read receipts › new messages › in the main timeline › Reading an older message leaves the room unread @mergequeue: playwright/e2e/read-receipts/index.ts#L488
1) [Chrome] › playwright/e2e/read-receipts/new-messages-main-timeline.spec.ts:53:17 › Read receipts › new messages › in the main timeline › Reading an older message leaves the room unread @mergequeue Error: expect(received).toBeLessThan(expected) Expected: < 30 Received: 30 Call Log: - Timeout 5000ms exceeded while waiting on the predicate at read-receipts/index.ts:488 486 | // https://playwright.dev/docs/test-assertions#expectpoll 487 | // .toBeLessThan doesn't have a retry mechanism, so we use .poll > 488 | await expect | ^ 489 | .poll(async () => { 490 | return parseInt(await tile.locator(".mx_NotificationBadge_count").textContent(), 10); 491 | }) at Helpers.assertUnreadLessThan (/home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/read-receipts/index.ts:488:9) at /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/read-receipts/new-messages-main-timeline.spec.ts:68:17
[Chrome] › playwright/e2e/audio-player/audio-player.spec.ts:250:9 › Audio player › should support creating a reply chain with multiple audio files @no-firefox @no-webkit @screenshot: playwright/e2e/audio-player/audio-player.spec.ts#L21
1) [Chrome] › playwright/e2e/audio-player/audio-player.spec.ts:250:9 › Audio player › should support creating a reply chain with multiple audio files @no-firefox @no-webkit @screenshot Error: Test timeout of 30000ms exceeded 19 | await tile.hover(); 20 | await tile.getByRole("button", { name: "Reply", exact: true }).click(); > 21 | }).toPass(); | ^ 22 | }; 23 | 24 | test.describe("Audio player", { tag: ["@no-firefox", "@no-webkit"] }, () => { at clickButtonReply (/home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/audio-player/audio-player.spec.ts:21:8) at /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/audio-player/audio-player.spec.ts:274:19
[Chrome] › playwright/e2e/crypto/device-verification.spec.ts:121:9 › Device verification › Verify device with QR code during login @no-webkit: playwright/e2e/crypto/device-verification.spec.ts#L96
2) [Chrome] › playwright/e2e/crypto/device-verification.spec.ts:121:9 › Device verification › Verify device with QR code during login @no-webkit Error: "route.fetch: Test ended." while running route callback. Consider awaiting `await page.unrouteAll({ behavior: 'ignoreErrors' })` before the end of the test to ignore remaining routes in flight. 94 | await route.fulfill({ json: {} }); 95 | await new Promise((f) => setTimeout(f, 1000)); > 96 | await route.fetch(); | ^ 97 | }); 98 | 99 | await logIntoElement(page, credentials); at /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/crypto/device-verification.spec.ts:96:25
[Chrome] › playwright/e2e/crypto/device-verification.spec.ts:121:9 › Device verification › Verify device with QR code during login @no-webkit: playwright/plugins/utils/api.ts#L27
2) [Chrome] › playwright/e2e/crypto/device-verification.spec.ts:121:9 › Device verification › Verify device with QR code during login @no-webkit Error: apiRequestContext.fetch: Target page, context or browser has been closed Call log: - → POST http://localhost:41887/_synapse/admin/v1/register - user-agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/133.0.6943.16 Safari/537.36 - accept: */* - accept-encoding: gzip,deflate,br - content-type: application/json - content-length: 311 at ../plugins/utils/api.ts:27 25 | public async request<R extends {}>(verb: Verb, path: string, token?: string, data?: object): Promise<R> { 26 | const url = `${this.baseUrl}${path}`; > 27 | const res = await this._request.fetch(url, { | ^ 28 | data, 29 | method: verb, 30 | headers: token at Api.request (/home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/plugins/utils/api.ts:27:41) at StartedSynapseContainer.registerUserInternal (/home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/testcontainers/synapse.ts:306:42) at Object.credentials (/home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/element-web-test.ts:162:29)
[Chrome] › playwright/e2e/timeline/timeline.spec.ts:140:13 › Timeline › configure room › should create and configure a room on IRC layout @screenshot: playwright/e2e/timeline/timeline.spec.ts#L156
1) [Chrome] › playwright/e2e/timeline/timeline.spec.ts:140:13 › Timeline › configure room › should create and configure a room on IRC layout @screenshot Error: expect(locator).toHaveScreenshot(expected) 40 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/snapshots/timeline/timeline.spec.ts/configured-room-irc-layout-linux.png Received: /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/test-results/timeline-timeline-Timeline-43bff-figure-a-room-on-IRC-layout-Chrome/configured-room-irc-layout-actual.png Diff: /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/test-results/timeline-timeline-Timeline-43bff-figure-a-room-on-IRC-layout-Chrome/configured-room-irc-layout-diff.png Call log: - expect.toHaveScreenshot(configured-room-irc-layout.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_MainSplit') - locator resolved to <div class="mx_MainSplit">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 40 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_MainSplit') - locator resolved to <div class="mx_MainSplit">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 40 pixels (ratio 0.01 of all image pixels) are different. 154 | await expect(page.locator(".mx_TimelineSeparator")).toHaveText("today"); 155 | > 156 | await expect(page.locator(".mx_MainSplit")).toMatchScreenshot("configured-room-irc-layout.png"); | ^ 157 | }, 158 | ); 159 | at /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/timeline/timeline.spec.ts:156:61
[Chrome] › playwright/e2e/timeline/timeline.spec.ts:226:13 › Timeline › configure room › should click 'collapse' on the first hovered info event line inside GELS on bubble layout @screenshot: playwright/e2e/timeline/timeline.spec.ts#L254
2) [Chrome] › playwright/e2e/timeline/timeline.spec.ts:226:13 › Timeline › configure room › should click 'collapse' on the first hovered info event line inside GELS on bubble layout @screenshot Error: expect(locator).toHaveScreenshot(expected) 210 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/snapshots/timeline/timeline.spec.ts/expanded-gels-bubble-layout-linux.png Received: /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/test-results/timeline-timeline-Timeline-d0f12-nside-GELS-on-bubble-layout-Chrome/expanded-gels-bubble-layout-actual.png Diff: /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/test-results/timeline-timeline-Timeline-d0f12-nside-GELS-on-bubble-layout-Chrome/expanded-gels-bubble-layout-diff.png Call log: - expect.toHaveScreenshot(expanded-gels-bubble-layout.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_MainSplit') - locator resolved to <div class="mx_MainSplit">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 210 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_MainSplit') - locator resolved to <div class="mx_MainSplit">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 210 pixels (ratio 0.01 of all image pixels) are different. 252 | 253 | // Save snapshot of expanded generic event list summary on bubble layout > 254 | await expect(page.locator(".mx_MainSplit")).toMatchScreenshot("expanded-gels-bubble-layout.png", { | ^ 255 | // Exclude timestamp from snapshot 256 | mask: [page.locator(".mx_MessageTimestamp")], 257 | }); at /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/timeline/timeline.spec.ts:254:61
[Chrome] › playwright/e2e/timeline/timeline.spec.ts:1217:13 › Timeline › message sending › should render images in the timeline @no-firefox @no-webkit @screenshot: playwright/e2e/timeline/timeline.spec.ts#L1211
3) [Chrome] › playwright/e2e/timeline/timeline.spec.ts:1217:13 › Timeline › message sending › should render images in the timeline @no-firefox @no-webkit @screenshot Error: expect(locator).toHaveScreenshot(expected) 90725 pixels (ratio 0.19 of all image pixels) are different. Expected: /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/snapshots/timeline/timeline.spec.ts/image-in-timeline-default-layout-linux.png Received: /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/test-results/timeline-timeline-Timeline-4bcb0-nder-images-in-the-timeline-Chrome/image-in-timeline-default-layout-actual.png Diff: /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/test-results/timeline-timeline-Timeline-4bcb0-nder-images-in-the-timeline-Chrome/image-in-timeline-default-layout-diff.png Call log: - expect.toHaveScreenshot(image-in-timeline-default-layout.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_ScrollPanel') - locator resolved to <div tabindex="-1" class="mx_AutoHideScrollbar mx_ScrollPanel mx_RoomView_messagePanel">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 90725 pixels (ratio 0.19 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_ScrollPanel') - locator resolved to <div tabindex="-1" class="mx_AutoHideScrollbar mx_ScrollPanel mx_RoomView_messagePanel">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 90725 pixels (ratio 0.19 of all image pixels) are different. 1209 | }; 1210 | > 1211 | await expect(page.locator(".mx_ScrollPanel")).toMatchScreenshot( | ^ 1212 | "image-in-timeline-default-layout.png", 1213 | screenshotOptions, 1214 | ); at testImageRendering (/home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/timeline/timeline.spec.ts:1211:59) at /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/timeline/timeline.spec.ts:1218:13
Slow Test: [Chrome] › playwright/e2e/messages/messages.spec.ts#L1
[Chrome] › playwright/e2e/messages/messages.spec.ts took 57.5s
Slow Test: [Chrome] › playwright/e2e/pinned-messages/pinned-messages.spec.ts#L1
[Chrome] › playwright/e2e/pinned-messages/pinned-messages.spec.ts took 56.2s
Slow Test: [Chrome] › playwright/e2e/read-receipts/editing-messages-in-threads.spec.ts#L1
[Chrome] › playwright/e2e/read-receipts/editing-messages-in-threads.spec.ts took 38.4s
Slow Test: [Chrome] › playwright/e2e/read-receipts/editing-messages-main-timeline.spec.ts#L1
[Chrome] › playwright/e2e/read-receipts/editing-messages-main-timeline.spec.ts took 38.1s
Slow Test: [Chrome] › playwright/e2e/invite/invite-dialog.spec.ts#L1
[Chrome] › playwright/e2e/invite/invite-dialog.spec.ts took 22.9s
Slow Test: [Chrome] › playwright/e2e/read-receipts/high-level.spec.ts#L1
[Chrome] › playwright/e2e/read-receipts/high-level.spec.ts took 2.7m
Slow Test: [Chrome] › playwright/e2e/read-receipts/new-messages-in-threads.spec.ts#L1
[Chrome] › playwright/e2e/read-receipts/new-messages-in-threads.spec.ts took 59.9s
Slow Test: [Chrome] › playwright/e2e/read-receipts/editing-messages-thread-roots.spec.ts#L1
[Chrome] › playwright/e2e/read-receipts/editing-messages-thread-roots.spec.ts took 45.5s
Slow Test: [Chrome] › playwright/e2e/read-receipts/new-messages-thread-roots.spec.ts#L1
[Chrome] › playwright/e2e/read-receipts/new-messages-thread-roots.spec.ts took 29.1s
Slow Test: [Chrome] › playwright/e2e/read-receipts/redactions-in-threads.spec.ts#L1
[Chrome] › playwright/e2e/read-receipts/redactions-in-threads.spec.ts took 1.5m
Slow Test: [Chrome] › playwright/e2e/read-receipts/redactions-main-timeline.spec.ts#L1
[Chrome] › playwright/e2e/read-receipts/redactions-main-timeline.spec.ts took 1.1m
Slow Test: [Chrome] › playwright/e2e/read-receipts/reactions-in-threads.spec.ts#L1
[Chrome] › playwright/e2e/read-receipts/reactions-in-threads.spec.ts took 49.0s
Slow Test: [Chrome] › playwright/e2e/read-receipts/read-receipts.spec.ts#L1
[Chrome] › playwright/e2e/read-receipts/read-receipts.spec.ts took 46.5s
Slow Test: [Chrome] › playwright/e2e/read-receipts/redactions-thread-roots.spec.ts#L1
[Chrome] › playwright/e2e/read-receipts/redactions-thread-roots.spec.ts took 31.3s
Slow Test: [Chrome] › playwright/e2e/crypto/event-shields.spec.ts#L1
[Chrome] › playwright/e2e/crypto/event-shields.spec.ts took 52.6s
Slow Test: [Chrome] › playwright/e2e/composer/RTE.spec.ts#L1
[Chrome] › playwright/e2e/composer/RTE.spec.ts took 34.6s
Slow Test: [Chrome] › playwright/e2e/crypto/crypto.spec.ts#L1
[Chrome] › playwright/e2e/crypto/crypto.spec.ts took 33.6s
Slow Test: [Chrome] › playwright/e2e/crypto/decryption-failure-messages.spec.ts#L1
[Chrome] › playwright/e2e/crypto/decryption-failure-messages.spec.ts took 28.1s
Slow Test: [Chrome] › playwright/e2e/integration-manager/kick.spec.ts#L1
[Chrome] › playwright/e2e/integration-manager/kick.spec.ts took 23.4s
Slow Test: [Chrome] › playwright/e2e/spotlight/spotlight.spec.ts#L1
[Chrome] › playwright/e2e/spotlight/spotlight.spec.ts took 2.4m
Slow Test: [Chrome] › playwright/e2e/sliding-sync/sliding-sync.spec.ts#L1
[Chrome] › playwright/e2e/sliding-sync/sliding-sync.spec.ts took 54.9s
Slow Test: [Chrome] › playwright/e2e/spaces/threads-activity-centre/threadsActivityCentre.spec.ts#L1
[Chrome] › playwright/e2e/spaces/threads-activity-centre/threadsActivityCentre.spec.ts took 50.0s
Slow Test: [Chrome] › playwright/e2e/spaces/spaces.spec.ts#L1
[Chrome] › playwright/e2e/spaces/spaces.spec.ts took 31.3s
Slow Test: [Chrome] › playwright/e2e/room/room.spec.ts#L1
[Chrome] › playwright/e2e/room/room.spec.ts took 26.2s
Slow Test: [Chrome] › playwright/e2e/login/login-consent.spec.ts#L1
[Chrome] › playwright/e2e/login/login-consent.spec.ts took 1.4m
Slow Test: [Chrome] › playwright/e2e/threads/threads.spec.ts#L1
[Chrome] › playwright/e2e/threads/threads.spec.ts took 33.4s
Slow Test: [Chrome] › playwright/e2e/crypto/backups-mas.spec.ts#L1
[Chrome] › playwright/e2e/crypto/backups-mas.spec.ts took 31.0s
Slow Test: [Chrome] › playwright/e2e/crypto/dehydration.spec.ts#L1
[Chrome] › playwright/e2e/crypto/dehydration.spec.ts took 22.7s
Slow Test: [Chrome] › playwright/e2e/app-loading/guest-registration.spec.ts#L1
[Chrome] › playwright/e2e/app-loading/guest-registration.spec.ts took 16.5s
🎭 Playwright Run Summary
2 skipped 80 passed (5.7m)
🎭 Playwright Run Summary
1 flaky [Chrome] › playwright/e2e/read-receipts/new-messages-main-timeline.spec.ts:53:17 › Read receipts › new messages › in the main timeline › Reading an older message leaves the room unread @mergequeue 43 skipped 38 passed (6.2m)
🎭 Playwright Run Summary
2 skipped 80 passed (6.9m)
🎭 Playwright Run Summary
2 flaky [Chrome] › playwright/e2e/audio-player/audio-player.spec.ts:250:9 › Audio player › should support creating a reply chain with multiple audio files @no-firefox @no-webkit @screenshot [Chrome] › playwright/e2e/crypto/device-verification.spec.ts:121:9 › Device verification › Verify device with QR code during login @no-webkit 83 passed (7.6m)
🎭 Playwright Run Summary
2 skipped 86 passed (7.6m)
🎭 Playwright Run Summary
3 flaky [Chrome] › playwright/e2e/timeline/timeline.spec.ts:140:13 › Timeline › configure room › should create and configure a room on IRC layout @screenshot [Chrome] › playwright/e2e/timeline/timeline.spec.ts:226:13 › Timeline › configure room › should click 'collapse' on the first hovered info event line inside GELS on bubble layout @screenshot [Chrome] › playwright/e2e/timeline/timeline.spec.ts:1217:13 › Timeline › message sending › should render images in the timeline @no-firefox @no-webkit @screenshot 68 passed (7.8m)

Artifacts

Produced during runtime
Name Size
all-blob-reports-Chrome-1
11.5 MB
all-blob-reports-Chrome-2
289 KB
all-blob-reports-Chrome-3
5.76 MB
all-blob-reports-Chrome-4
351 KB
all-blob-reports-Chrome-5
531 KB
all-blob-reports-Chrome-6
10.3 MB
html-report
26.3 MB
webapp
27.3 MB