matrix-react-sdk End to End Tests #2943
Annotations
3 errors, 5 warnings, and 1 notice
Run Playwright tests:
playwright/e2e/timeline/timeline.spec.ts#L156
1) [Chrome] › playwright/e2e/timeline/timeline.spec.ts:140:13 › Timeline › configure room › should create and configure a room on IRC layout @screenshot
Error: expect(locator).toHaveScreenshot(expected)
40 pixels (ratio 0.01 of all image pixels) are different.
Expected: /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/snapshots/timeline/timeline.spec.ts/configured-room-irc-layout-linux.png
Received: /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/test-results/timeline-timeline-Timeline-43bff-figure-a-room-on-IRC-layout-Chrome/configured-room-irc-layout-actual.png
Diff: /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/test-results/timeline-timeline-Timeline-43bff-figure-a-room-on-IRC-layout-Chrome/configured-room-irc-layout-diff.png
Call log:
- expect.toHaveScreenshot(configured-room-irc-layout.png) with timeout 5000ms
- verifying given screenshot expectation
- waiting for locator('.mx_MainSplit')
- locator resolved to <div class="mx_MainSplit">…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- 40 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- waiting for locator('.mx_MainSplit')
- locator resolved to <div class="mx_MainSplit">…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- captured a stable screenshot
- 40 pixels (ratio 0.01 of all image pixels) are different.
154 | await expect(page.locator(".mx_TimelineSeparator")).toHaveText("today");
155 |
> 156 | await expect(page.locator(".mx_MainSplit")).toMatchScreenshot("configured-room-irc-layout.png");
| ^
157 | },
158 | );
159 |
at /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/timeline/timeline.spec.ts:156:61
|
Run Playwright tests:
playwright/e2e/timeline/timeline.spec.ts#L254
2) [Chrome] › playwright/e2e/timeline/timeline.spec.ts:226:13 › Timeline › configure room › should click 'collapse' on the first hovered info event line inside GELS on bubble layout @screenshot
Error: expect(locator).toHaveScreenshot(expected)
210 pixels (ratio 0.01 of all image pixels) are different.
Expected: /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/snapshots/timeline/timeline.spec.ts/expanded-gels-bubble-layout-linux.png
Received: /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/test-results/timeline-timeline-Timeline-d0f12-nside-GELS-on-bubble-layout-Chrome/expanded-gels-bubble-layout-actual.png
Diff: /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/test-results/timeline-timeline-Timeline-d0f12-nside-GELS-on-bubble-layout-Chrome/expanded-gels-bubble-layout-diff.png
Call log:
- expect.toHaveScreenshot(expanded-gels-bubble-layout.png) with timeout 5000ms
- verifying given screenshot expectation
- waiting for locator('.mx_MainSplit')
- locator resolved to <div class="mx_MainSplit">…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- 210 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- waiting for locator('.mx_MainSplit')
- locator resolved to <div class="mx_MainSplit">…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- captured a stable screenshot
- 210 pixels (ratio 0.01 of all image pixels) are different.
252 |
253 | // Save snapshot of expanded generic event list summary on bubble layout
> 254 | await expect(page.locator(".mx_MainSplit")).toMatchScreenshot("expanded-gels-bubble-layout.png", {
| ^
255 | // Exclude timestamp from snapshot
256 | mask: [page.locator(".mx_MessageTimestamp")],
257 | });
at /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/timeline/timeline.spec.ts:254:61
|
Run Playwright tests:
playwright/e2e/timeline/timeline.spec.ts#L1211
3) [Chrome] › playwright/e2e/timeline/timeline.spec.ts:1217:13 › Timeline › message sending › should render images in the timeline @no-firefox @no-webkit @screenshot
Error: expect(locator).toHaveScreenshot(expected)
90725 pixels (ratio 0.19 of all image pixels) are different.
Expected: /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/snapshots/timeline/timeline.spec.ts/image-in-timeline-default-layout-linux.png
Received: /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/test-results/timeline-timeline-Timeline-4bcb0-nder-images-in-the-timeline-Chrome/image-in-timeline-default-layout-actual.png
Diff: /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/test-results/timeline-timeline-Timeline-4bcb0-nder-images-in-the-timeline-Chrome/image-in-timeline-default-layout-diff.png
Call log:
- expect.toHaveScreenshot(image-in-timeline-default-layout.png) with timeout 5000ms
- verifying given screenshot expectation
- waiting for locator('.mx_ScrollPanel')
- locator resolved to <div tabindex="-1" class="mx_AutoHideScrollbar mx_ScrollPanel mx_RoomView_messagePanel">…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- 90725 pixels (ratio 0.19 of all image pixels) are different.
- waiting 100ms before taking screenshot
- waiting for locator('.mx_ScrollPanel')
- locator resolved to <div tabindex="-1" class="mx_AutoHideScrollbar mx_ScrollPanel mx_RoomView_messagePanel">…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- captured a stable screenshot
- 90725 pixels (ratio 0.19 of all image pixels) are different.
1209 | };
1210 |
> 1211 | await expect(page.locator(".mx_ScrollPanel")).toMatchScreenshot(
| ^
1212 | "image-in-timeline-default-layout.png",
1213 | screenshotOptions,
1214 | );
at testImageRendering (/home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/timeline/timeline.spec.ts:1211:59)
at /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/timeline/timeline.spec.ts:1218:13
|
Run Playwright tests:
[Chrome] › playwright/e2e/login/login-consent.spec.ts#L1
[Chrome] › playwright/e2e/login/login-consent.spec.ts took 1.4m
|
Run Playwright tests:
[Chrome] › playwright/e2e/threads/threads.spec.ts#L1
[Chrome] › playwright/e2e/threads/threads.spec.ts took 33.4s
|
Run Playwright tests:
[Chrome] › playwright/e2e/crypto/backups-mas.spec.ts#L1
[Chrome] › playwright/e2e/crypto/backups-mas.spec.ts took 31.0s
|
Run Playwright tests:
[Chrome] › playwright/e2e/crypto/dehydration.spec.ts#L1
[Chrome] › playwright/e2e/crypto/dehydration.spec.ts took 22.7s
|
Run Playwright tests:
[Chrome] › playwright/e2e/app-loading/guest-registration.spec.ts#L1
[Chrome] › playwright/e2e/app-loading/guest-registration.spec.ts took 16.5s
|
Run Playwright tests
3 flaky
[Chrome] › playwright/e2e/timeline/timeline.spec.ts:140:13 › Timeline › configure room › should create and configure a room on IRC layout @screenshot
[Chrome] › playwright/e2e/timeline/timeline.spec.ts:226:13 › Timeline › configure room › should click 'collapse' on the first hovered info event line inside GELS on bubble layout @screenshot
[Chrome] › playwright/e2e/timeline/timeline.spec.ts:1217:13 › Timeline › message sending › should render images in the timeline @no-firefox @no-webkit @screenshot
68 passed (7.8m)
|
Loading