matrix-react-sdk End to End Tests #2943
downstream-end-to-end-tests.yml
on: merge_group
Playwright
/
Build Element-Web
1m 49s
Matrix: Playwright / playwright
Playwright
/
end-to-end-tests
40s
Annotations
7 errors, 29 warnings, and 6 notices
[Chrome] › playwright/e2e/read-receipts/new-messages-main-timeline.spec.ts:53:17 › Read receipts › new messages › in the main timeline › Reading an older message leaves the room unread @mergequeue:
playwright/e2e/read-receipts/index.ts#L488
1) [Chrome] › playwright/e2e/read-receipts/new-messages-main-timeline.spec.ts:53:17 › Read receipts › new messages › in the main timeline › Reading an older message leaves the room unread @mergequeue
Error: expect(received).toBeLessThan(expected)
Expected: < 30
Received: 30
Call Log:
- Timeout 5000ms exceeded while waiting on the predicate
at read-receipts/index.ts:488
486 | // https://playwright.dev/docs/test-assertions#expectpoll
487 | // .toBeLessThan doesn't have a retry mechanism, so we use .poll
> 488 | await expect
| ^
489 | .poll(async () => {
490 | return parseInt(await tile.locator(".mx_NotificationBadge_count").textContent(), 10);
491 | })
at Helpers.assertUnreadLessThan (/home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/read-receipts/index.ts:488:9)
at /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/read-receipts/new-messages-main-timeline.spec.ts:68:17
|
[Chrome] › playwright/e2e/audio-player/audio-player.spec.ts:250:9 › Audio player › should support creating a reply chain with multiple audio files @no-firefox @no-webkit @screenshot:
playwright/e2e/audio-player/audio-player.spec.ts#L21
1) [Chrome] › playwright/e2e/audio-player/audio-player.spec.ts:250:9 › Audio player › should support creating a reply chain with multiple audio files @no-firefox @no-webkit @screenshot
Error: Test timeout of 30000ms exceeded
19 | await tile.hover();
20 | await tile.getByRole("button", { name: "Reply", exact: true }).click();
> 21 | }).toPass();
| ^
22 | };
23 |
24 | test.describe("Audio player", { tag: ["@no-firefox", "@no-webkit"] }, () => {
at clickButtonReply (/home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/audio-player/audio-player.spec.ts:21:8)
at /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/audio-player/audio-player.spec.ts:274:19
|
[Chrome] › playwright/e2e/crypto/device-verification.spec.ts:121:9 › Device verification › Verify device with QR code during login @no-webkit:
playwright/e2e/crypto/device-verification.spec.ts#L96
2) [Chrome] › playwright/e2e/crypto/device-verification.spec.ts:121:9 › Device verification › Verify device with QR code during login @no-webkit
Error: "route.fetch: Test ended." while running route callback.
Consider awaiting `await page.unrouteAll({ behavior: 'ignoreErrors' })`
before the end of the test to ignore remaining routes in flight.
94 | await route.fulfill({ json: {} });
95 | await new Promise((f) => setTimeout(f, 1000));
> 96 | await route.fetch();
| ^
97 | });
98 |
99 | await logIntoElement(page, credentials);
at /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/crypto/device-verification.spec.ts:96:25
|
[Chrome] › playwright/e2e/crypto/device-verification.spec.ts:121:9 › Device verification › Verify device with QR code during login @no-webkit:
playwright/plugins/utils/api.ts#L27
2) [Chrome] › playwright/e2e/crypto/device-verification.spec.ts:121:9 › Device verification › Verify device with QR code during login @no-webkit
Error: apiRequestContext.fetch: Target page, context or browser has been closed
Call log:
- → POST http://localhost:41887/_synapse/admin/v1/register
- user-agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/133.0.6943.16 Safari/537.36
- accept: */*
- accept-encoding: gzip,deflate,br
- content-type: application/json
- content-length: 311
at ../plugins/utils/api.ts:27
25 | public async request<R extends {}>(verb: Verb, path: string, token?: string, data?: object): Promise<R> {
26 | const url = `${this.baseUrl}${path}`;
> 27 | const res = await this._request.fetch(url, {
| ^
28 | data,
29 | method: verb,
30 | headers: token
at Api.request (/home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/plugins/utils/api.ts:27:41)
at StartedSynapseContainer.registerUserInternal (/home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/testcontainers/synapse.ts:306:42)
at Object.credentials (/home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/element-web-test.ts:162:29)
|
[Chrome] › playwright/e2e/timeline/timeline.spec.ts:140:13 › Timeline › configure room › should create and configure a room on IRC layout @screenshot:
playwright/e2e/timeline/timeline.spec.ts#L156
1) [Chrome] › playwright/e2e/timeline/timeline.spec.ts:140:13 › Timeline › configure room › should create and configure a room on IRC layout @screenshot
Error: expect(locator).toHaveScreenshot(expected)
40 pixels (ratio 0.01 of all image pixels) are different.
Expected: /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/snapshots/timeline/timeline.spec.ts/configured-room-irc-layout-linux.png
Received: /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/test-results/timeline-timeline-Timeline-43bff-figure-a-room-on-IRC-layout-Chrome/configured-room-irc-layout-actual.png
Diff: /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/test-results/timeline-timeline-Timeline-43bff-figure-a-room-on-IRC-layout-Chrome/configured-room-irc-layout-diff.png
Call log:
- expect.toHaveScreenshot(configured-room-irc-layout.png) with timeout 5000ms
- verifying given screenshot expectation
- waiting for locator('.mx_MainSplit')
- locator resolved to <div class="mx_MainSplit">…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- 40 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- waiting for locator('.mx_MainSplit')
- locator resolved to <div class="mx_MainSplit">…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- captured a stable screenshot
- 40 pixels (ratio 0.01 of all image pixels) are different.
154 | await expect(page.locator(".mx_TimelineSeparator")).toHaveText("today");
155 |
> 156 | await expect(page.locator(".mx_MainSplit")).toMatchScreenshot("configured-room-irc-layout.png");
| ^
157 | },
158 | );
159 |
at /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/timeline/timeline.spec.ts:156:61
|
[Chrome] › playwright/e2e/timeline/timeline.spec.ts:226:13 › Timeline › configure room › should click 'collapse' on the first hovered info event line inside GELS on bubble layout @screenshot:
playwright/e2e/timeline/timeline.spec.ts#L254
2) [Chrome] › playwright/e2e/timeline/timeline.spec.ts:226:13 › Timeline › configure room › should click 'collapse' on the first hovered info event line inside GELS on bubble layout @screenshot
Error: expect(locator).toHaveScreenshot(expected)
210 pixels (ratio 0.01 of all image pixels) are different.
Expected: /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/snapshots/timeline/timeline.spec.ts/expanded-gels-bubble-layout-linux.png
Received: /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/test-results/timeline-timeline-Timeline-d0f12-nside-GELS-on-bubble-layout-Chrome/expanded-gels-bubble-layout-actual.png
Diff: /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/test-results/timeline-timeline-Timeline-d0f12-nside-GELS-on-bubble-layout-Chrome/expanded-gels-bubble-layout-diff.png
Call log:
- expect.toHaveScreenshot(expanded-gels-bubble-layout.png) with timeout 5000ms
- verifying given screenshot expectation
- waiting for locator('.mx_MainSplit')
- locator resolved to <div class="mx_MainSplit">…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- 210 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- waiting for locator('.mx_MainSplit')
- locator resolved to <div class="mx_MainSplit">…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- captured a stable screenshot
- 210 pixels (ratio 0.01 of all image pixels) are different.
252 |
253 | // Save snapshot of expanded generic event list summary on bubble layout
> 254 | await expect(page.locator(".mx_MainSplit")).toMatchScreenshot("expanded-gels-bubble-layout.png", {
| ^
255 | // Exclude timestamp from snapshot
256 | mask: [page.locator(".mx_MessageTimestamp")],
257 | });
at /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/timeline/timeline.spec.ts:254:61
|
[Chrome] › playwright/e2e/timeline/timeline.spec.ts:1217:13 › Timeline › message sending › should render images in the timeline @no-firefox @no-webkit @screenshot:
playwright/e2e/timeline/timeline.spec.ts#L1211
3) [Chrome] › playwright/e2e/timeline/timeline.spec.ts:1217:13 › Timeline › message sending › should render images in the timeline @no-firefox @no-webkit @screenshot
Error: expect(locator).toHaveScreenshot(expected)
90725 pixels (ratio 0.19 of all image pixels) are different.
Expected: /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/snapshots/timeline/timeline.spec.ts/image-in-timeline-default-layout-linux.png
Received: /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/test-results/timeline-timeline-Timeline-4bcb0-nder-images-in-the-timeline-Chrome/image-in-timeline-default-layout-actual.png
Diff: /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/test-results/timeline-timeline-Timeline-4bcb0-nder-images-in-the-timeline-Chrome/image-in-timeline-default-layout-diff.png
Call log:
- expect.toHaveScreenshot(image-in-timeline-default-layout.png) with timeout 5000ms
- verifying given screenshot expectation
- waiting for locator('.mx_ScrollPanel')
- locator resolved to <div tabindex="-1" class="mx_AutoHideScrollbar mx_ScrollPanel mx_RoomView_messagePanel">…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- 90725 pixels (ratio 0.19 of all image pixels) are different.
- waiting 100ms before taking screenshot
- waiting for locator('.mx_ScrollPanel')
- locator resolved to <div tabindex="-1" class="mx_AutoHideScrollbar mx_ScrollPanel mx_RoomView_messagePanel">…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- captured a stable screenshot
- 90725 pixels (ratio 0.19 of all image pixels) are different.
1209 | };
1210 |
> 1211 | await expect(page.locator(".mx_ScrollPanel")).toMatchScreenshot(
| ^
1212 | "image-in-timeline-default-layout.png",
1213 | screenshotOptions,
1214 | );
at testImageRendering (/home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/timeline/timeline.spec.ts:1211:59)
at /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/timeline/timeline.spec.ts:1218:13
|
Slow Test:
[Chrome] › playwright/e2e/messages/messages.spec.ts#L1
[Chrome] › playwright/e2e/messages/messages.spec.ts took 57.5s
|
Slow Test:
[Chrome] › playwright/e2e/pinned-messages/pinned-messages.spec.ts#L1
[Chrome] › playwright/e2e/pinned-messages/pinned-messages.spec.ts took 56.2s
|
Slow Test:
[Chrome] › playwright/e2e/read-receipts/editing-messages-in-threads.spec.ts#L1
[Chrome] › playwright/e2e/read-receipts/editing-messages-in-threads.spec.ts took 38.4s
|
Slow Test:
[Chrome] › playwright/e2e/read-receipts/editing-messages-main-timeline.spec.ts#L1
[Chrome] › playwright/e2e/read-receipts/editing-messages-main-timeline.spec.ts took 38.1s
|
Slow Test:
[Chrome] › playwright/e2e/invite/invite-dialog.spec.ts#L1
[Chrome] › playwright/e2e/invite/invite-dialog.spec.ts took 22.9s
|
Slow Test:
[Chrome] › playwright/e2e/read-receipts/high-level.spec.ts#L1
[Chrome] › playwright/e2e/read-receipts/high-level.spec.ts took 2.7m
|
Slow Test:
[Chrome] › playwright/e2e/read-receipts/new-messages-in-threads.spec.ts#L1
[Chrome] › playwright/e2e/read-receipts/new-messages-in-threads.spec.ts took 59.9s
|
Slow Test:
[Chrome] › playwright/e2e/read-receipts/editing-messages-thread-roots.spec.ts#L1
[Chrome] › playwright/e2e/read-receipts/editing-messages-thread-roots.spec.ts took 45.5s
|
Slow Test:
[Chrome] › playwright/e2e/read-receipts/new-messages-thread-roots.spec.ts#L1
[Chrome] › playwright/e2e/read-receipts/new-messages-thread-roots.spec.ts took 29.1s
|
Slow Test:
[Chrome] › playwright/e2e/read-receipts/redactions-in-threads.spec.ts#L1
[Chrome] › playwright/e2e/read-receipts/redactions-in-threads.spec.ts took 1.5m
|
Slow Test:
[Chrome] › playwright/e2e/read-receipts/redactions-main-timeline.spec.ts#L1
[Chrome] › playwright/e2e/read-receipts/redactions-main-timeline.spec.ts took 1.1m
|
Slow Test:
[Chrome] › playwright/e2e/read-receipts/reactions-in-threads.spec.ts#L1
[Chrome] › playwright/e2e/read-receipts/reactions-in-threads.spec.ts took 49.0s
|
Slow Test:
[Chrome] › playwright/e2e/read-receipts/read-receipts.spec.ts#L1
[Chrome] › playwright/e2e/read-receipts/read-receipts.spec.ts took 46.5s
|
Slow Test:
[Chrome] › playwright/e2e/read-receipts/redactions-thread-roots.spec.ts#L1
[Chrome] › playwright/e2e/read-receipts/redactions-thread-roots.spec.ts took 31.3s
|
Slow Test:
[Chrome] › playwright/e2e/crypto/event-shields.spec.ts#L1
[Chrome] › playwright/e2e/crypto/event-shields.spec.ts took 52.6s
|
Slow Test:
[Chrome] › playwright/e2e/composer/RTE.spec.ts#L1
[Chrome] › playwright/e2e/composer/RTE.spec.ts took 34.6s
|
Slow Test:
[Chrome] › playwright/e2e/crypto/crypto.spec.ts#L1
[Chrome] › playwright/e2e/crypto/crypto.spec.ts took 33.6s
|
Slow Test:
[Chrome] › playwright/e2e/crypto/decryption-failure-messages.spec.ts#L1
[Chrome] › playwright/e2e/crypto/decryption-failure-messages.spec.ts took 28.1s
|
Slow Test:
[Chrome] › playwright/e2e/integration-manager/kick.spec.ts#L1
[Chrome] › playwright/e2e/integration-manager/kick.spec.ts took 23.4s
|
Slow Test:
[Chrome] › playwright/e2e/spotlight/spotlight.spec.ts#L1
[Chrome] › playwright/e2e/spotlight/spotlight.spec.ts took 2.4m
|
Slow Test:
[Chrome] › playwright/e2e/sliding-sync/sliding-sync.spec.ts#L1
[Chrome] › playwright/e2e/sliding-sync/sliding-sync.spec.ts took 54.9s
|
Slow Test:
[Chrome] › playwright/e2e/spaces/threads-activity-centre/threadsActivityCentre.spec.ts#L1
[Chrome] › playwright/e2e/spaces/threads-activity-centre/threadsActivityCentre.spec.ts took 50.0s
|
Slow Test:
[Chrome] › playwright/e2e/spaces/spaces.spec.ts#L1
[Chrome] › playwright/e2e/spaces/spaces.spec.ts took 31.3s
|
Slow Test:
[Chrome] › playwright/e2e/room/room.spec.ts#L1
[Chrome] › playwright/e2e/room/room.spec.ts took 26.2s
|
Slow Test:
[Chrome] › playwright/e2e/login/login-consent.spec.ts#L1
[Chrome] › playwright/e2e/login/login-consent.spec.ts took 1.4m
|
Slow Test:
[Chrome] › playwright/e2e/threads/threads.spec.ts#L1
[Chrome] › playwright/e2e/threads/threads.spec.ts took 33.4s
|
Slow Test:
[Chrome] › playwright/e2e/crypto/backups-mas.spec.ts#L1
[Chrome] › playwright/e2e/crypto/backups-mas.spec.ts took 31.0s
|
Slow Test:
[Chrome] › playwright/e2e/crypto/dehydration.spec.ts#L1
[Chrome] › playwright/e2e/crypto/dehydration.spec.ts took 22.7s
|
Slow Test:
[Chrome] › playwright/e2e/app-loading/guest-registration.spec.ts#L1
[Chrome] › playwright/e2e/app-loading/guest-registration.spec.ts took 16.5s
|
🎭 Playwright Run Summary
2 skipped
80 passed (5.7m)
|
🎭 Playwright Run Summary
1 flaky
[Chrome] › playwright/e2e/read-receipts/new-messages-main-timeline.spec.ts:53:17 › Read receipts › new messages › in the main timeline › Reading an older message leaves the room unread @mergequeue
43 skipped
38 passed (6.2m)
|
🎭 Playwright Run Summary
2 skipped
80 passed (6.9m)
|
🎭 Playwright Run Summary
2 flaky
[Chrome] › playwright/e2e/audio-player/audio-player.spec.ts:250:9 › Audio player › should support creating a reply chain with multiple audio files @no-firefox @no-webkit @screenshot
[Chrome] › playwright/e2e/crypto/device-verification.spec.ts:121:9 › Device verification › Verify device with QR code during login @no-webkit
83 passed (7.6m)
|
🎭 Playwright Run Summary
2 skipped
86 passed (7.6m)
|
🎭 Playwright Run Summary
3 flaky
[Chrome] › playwright/e2e/timeline/timeline.spec.ts:140:13 › Timeline › configure room › should create and configure a room on IRC layout @screenshot
[Chrome] › playwright/e2e/timeline/timeline.spec.ts:226:13 › Timeline › configure room › should click 'collapse' on the first hovered info event line inside GELS on bubble layout @screenshot
[Chrome] › playwright/e2e/timeline/timeline.spec.ts:1217:13 › Timeline › message sending › should render images in the timeline @no-firefox @no-webkit @screenshot
68 passed (7.8m)
|
Artifacts
Produced during runtime
Name | Size | |
---|---|---|
all-blob-reports-Chrome-1
|
11.5 MB |
|
all-blob-reports-Chrome-2
|
289 KB |
|
all-blob-reports-Chrome-3
|
5.76 MB |
|
all-blob-reports-Chrome-4
|
351 KB |
|
all-blob-reports-Chrome-5
|
531 KB |
|
all-blob-reports-Chrome-6
|
10.3 MB |
|
html-report
|
26.3 MB |
|
webapp
|
27.3 MB |
|