1) register/register.spec.ts:18:9 › Registration › registers an account and lands on the home screen Error: Screenshot comparison failed: 182 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/snapshots/register/register.spec.ts/use-case-selection-linux.png Received: /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/test-results/register-register-Registra-495ef-nd-lands-on-the-home-screen/use-case-selection-actual.png Diff: /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/test-results/register-register-Registra-495ef-nd-lands-on-the-home-screen/use-case-selection-diff.png Call log: - expect.toHaveScreenshot(use-case-selection.png) with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 182 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 182 pixels (ratio 0.01 of all image pixels) are different. 56 | 57 | await expect(page.locator(".mx_UseCaseSelection_skip")).toBeVisible(); > 58 | await expect(page).toMatchScreenshot("use-case-selection.png", screenshotOptions); | ^ 59 | await checkA11y(); 60 | await page.getByRole("button", { name: "Skip", exact: true }).click(); 61 | at /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/register/register.spec.ts:58:28

1) register/register.spec.ts:18:9 › Registration › registers an account and lands on the home screen Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 182 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/snapshots/register/register.spec.ts/use-case-selection-linux.png Received: /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/test-results/register-register-Registra-495ef-nd-lands-on-the-home-screen-retry1/use-case-selection-actual.png Diff: /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/test-results/register-register-Registra-495ef-nd-lands-on-the-home-screen-retry1/use-case-selection-diff.png Call log: - expect.toHaveScreenshot(use-case-selection.png) with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 182 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 182 pixels (ratio 0.01 of all image pixels) are different. 56 | 57 | await expect(page.locator(".mx_UseCaseSelection_skip")).toBeVisible(); > 58 | await expect(page).toMatchScreenshot("use-case-selection.png", screenshotOptions); | ^ 59 | await checkA11y(); 60 | await page.getByRole("button", { name: "Skip", exact: true }).click(); 61 | at /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/register/register.spec.ts:58:28

1) register/register.spec.ts:18:9 › Registration › registers an account and lands on the home screen Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 182 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/snapshots/register/register.spec.ts/use-case-selection-linux.png Received: /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/test-results/register-register-Registra-495ef-nd-lands-on-the-home-screen-retry2/use-case-selection-actual.png Diff: /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/test-results/register-register-Registra-495ef-nd-lands-on-the-home-screen-retry2/use-case-selection-diff.png Call log: - expect.toHaveScreenshot(use-case-selection.png) with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 182 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 182 pixels (ratio 0.01 of all image pixels) are different. 56 | 57 | await expect(page.locator(".mx_UseCaseSelection_skip")).toBeVisible(); > 58 | await expect(page).toMatchScreenshot("use-case-selection.png", screenshotOptions); | ^ 59 | await checkA11y(); 60 | await page.getByRole("button", { name: "Skip", exact: true }).click(); 61 | at /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/register/register.spec.ts:58:28

2) release-announcement/releaseAnnouncement.spec.ts:21:9 › Release announcement › should display the release announcement process Error: Screenshot comparison failed: 7 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/snapshots/release-announcement/releaseAnnouncement.spec.ts/release-announcement-Threads-Activity-Centre-linux.png Received: /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/test-results/release-announcement-relea-4147f-elease-announcement-process/release-announcement-Threads-Activity-Centre-actual.png Diff: /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/test-results/release-announcement-relea-4147f-elease-announcement-process/release-announcement-Threads-Activity-Centre-diff.png Call log: - expect.toHaveScreenshot(release-announcement-Threads-Activity-Centre.png) with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 7 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 7 pixels (ratio 0.01 of all image pixels) are different. at release-announcement/index.ts:45 43 | async assertReleaseAnnouncementIsVisible(name: string) { 44 | await expect(this.getReleaseAnnouncement(name)).toBeVisible(); > 45 | await expect(this.page).toMatchScreenshot(`release-announcement-${name}.png`, { showTooltips: true }); | ^ 46 | } 47 | 48 | /** at Helpers.assertReleaseAnnouncementIsVisible (/home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/release-announcement/index.ts:45:33) at /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/release-announcement/releaseAnnouncement.spec.ts:23:9

2) release-announcement/releaseAnnouncement.spec.ts:21:9 › Release announcement › should display the release announcement process Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 7 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/snapshots/release-announcement/releaseAnnouncement.spec.ts/release-announcement-Threads-Activity-Centre-linux.png Received: /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/test-results/release-announcement-relea-4147f-elease-announcement-process-retry1/release-announcement-Threads-Activity-Centre-actual.png Diff: /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/test-results/release-announcement-relea-4147f-elease-announcement-process-retry1/release-announcement-Threads-Activity-Centre-diff.png Call log: - expect.toHaveScreenshot(release-announcement-Threads-Activity-Centre.png) with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 7 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 7 pixels (ratio 0.01 of all image pixels) are different. at release-announcement/index.ts:45 43 | async assertReleaseAnnouncementIsVisible(name: string) { 44 | await expect(this.getReleaseAnnouncement(name)).toBeVisible(); > 45 | await expect(this.page).toMatchScreenshot(`release-announcement-${name}.png`, { showTooltips: true }); | ^ 46 | } 47 | 48 | /** at Helpers.assertReleaseAnnouncementIsVisible (/home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/release-announcement/index.ts:45:33) at /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/release-announcement/releaseAnnouncement.spec.ts:23:9

2) release-announcement/releaseAnnouncement.spec.ts:21:9 › Release announcement › should display the release announcement process Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 7 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/snapshots/release-announcement/releaseAnnouncement.spec.ts/release-announcement-Threads-Activity-Centre-linux.png Received: /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/test-results/release-announcement-relea-4147f-elease-announcement-process-retry2/release-announcement-Threads-Activity-Centre-actual.png Diff: /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/test-results/release-announcement-relea-4147f-elease-announcement-process-retry2/release-announcement-Threads-Activity-Centre-diff.png Call log: - expect.toHaveScreenshot(release-announcement-Threads-Activity-Centre.png) with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 7 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 7 pixels (ratio 0.01 of all image pixels) are different. at release-announcement/index.ts:45 43 | async assertReleaseAnnouncementIsVisible(name: string) { 44 | await expect(this.getReleaseAnnouncement(name)).toBeVisible(); > 45 | await expect(this.page).toMatchScreenshot(`release-announcement-${name}.png`, { showTooltips: true }); | ^ 46 | } 47 | 48 | /** at Helpers.assertReleaseAnnouncementIsVisible (/home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/release-announcement/index.ts:45:33) at /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/release-announcement/releaseAnnouncement.spec.ts:23:9

3) settings/appearance-user-settings-tab/appearance-user-settings-tab.spec.ts:28:9 › Appearance user settings tab › should support changing font size by using the font size dropdown Error: Screenshot comparison failed: 6 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/snapshots/settings/appearance-user-settings-tab/appearance-user-settings-tab.spec.ts/window-12px-linux.png Received: /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/test-results/settings-appearance-user-s-76af4-sing-the-font-size-dropdown/window-12px-actual.png Diff: /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/test-results/settings-appearance-user-s-76af4-sing-the-font-size-dropdown/window-12px-diff.png Call log: - expect.toHaveScreenshot(window-12px.png) with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 6 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 6 pixels (ratio 0.01 of all image pixels) are different. 37 | await fontDropdown.getByLabel("Font size").selectOption({ value: "-4" }); 38 | > 39 | await expect(page).toMatchScreenshot("window-12px.png", { includeDialogBackground: true }); | ^ 40 | }); 41 | 42 | test("should support enabling system font", async ({ page, app, user }) => { at /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/settings/appearance-user-settings-tab/appearance-user-settings-tab.spec.ts:39:28

3) settings/appearance-user-settings-tab/appearance-user-settings-tab.spec.ts:28:9 › Appearance user settings tab › should support changing font size by using the font size dropdown Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 6 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/snapshots/settings/appearance-user-settings-tab/appearance-user-settings-tab.spec.ts/window-12px-linux.png Received: /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/test-results/settings-appearance-user-s-76af4-sing-the-font-size-dropdown-retry1/window-12px-actual.png Diff: /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/test-results/settings-appearance-user-s-76af4-sing-the-font-size-dropdown-retry1/window-12px-diff.png Call log: - expect.toHaveScreenshot(window-12px.png) with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 6 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 6 pixels (ratio 0.01 of all image pixels) are different. 37 | await fontDropdown.getByLabel("Font size").selectOption({ value: "-4" }); 38 | > 39 | await expect(page).toMatchScreenshot("window-12px.png", { includeDialogBackground: true }); | ^ 40 | }); 41 | 42 | test("should support enabling system font", async ({ page, app, user }) => { at /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/settings/appearance-user-settings-tab/appearance-user-settings-tab.spec.ts:39:28

3) settings/appearance-user-settings-tab/appearance-user-settings-tab.spec.ts:28:9 › Appearance user settings tab › should support changing font size by using the font size dropdown Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 6 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/snapshots/settings/appearance-user-settings-tab/appearance-user-settings-tab.spec.ts/window-12px-linux.png Received: /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/test-results/settings-appearance-user-s-76af4-sing-the-font-size-dropdown-retry2/window-12px-actual.png Diff: /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/test-results/settings-appearance-user-s-76af4-sing-the-font-size-dropdown-retry2/window-12px-diff.png Call log: - expect.toHaveScreenshot(window-12px.png) with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 6 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 6 pixels (ratio 0.01 of all image pixels) are different. 37 | await fontDropdown.getByLabel("Font size").selectOption({ value: "-4" }); 38 | > 39 | await expect(page).toMatchScreenshot("window-12px.png", { includeDialogBackground: true }); | ^ 40 | }); 41 | 42 | test("should support enabling system font", async ({ page, app, user }) => { at /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/settings/appearance-user-settings-tab/appearance-user-settings-tab.spec.ts:39:28

4) settings/general-room-settings-tab.spec.ts:23:9 › General room settings tab › should be rendered properly Error: Screenshot comparison failed: 10 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/snapshots/settings/general-room-settings-tab.spec.ts/General-room-settings-tab-should-be-rendered-properly-1-linux.png Received: /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/test-results/settings-general-room-sett-fdda5-should-be-rendered-properly/General-room-settings-tab-should-be-rendered-properly-1-actual.png Diff: /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/test-results/settings-general-room-sett-fdda5-should-be-rendered-properly/General-room-settings-tab-should-be-rendered-properly-1-diff.png Call log: - expect.toHaveScreenshot(General-room-settings-tab-should-be-rendered-properly-1.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_Dialog').filter({ has: locator('.mx_RoomSettingsDialog') }) - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 10 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_Dialog').filter({ has: locator('.mx_RoomSettingsDialog') }) - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 10 pixels (ratio 0.01 of all image pixels) are different. 27 | await expect(settings.getByText("Show less")).toBeVisible(); 28 | > 29 | await expect(settings).toMatchScreenshot("General-room-settings-tab-should-be-rendered-properly-1.png"); | ^ 30 | 31 | // Click the "Show less" details element 32 | await settings.getByText("Show less").click(); at /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/settings/general-room-settings-tab.spec.ts:29:32

1) spaces/threads-activity-centre/threadsActivityCentre.spec.ts:19:9 › Threads Activity Centre › should have the button correctly aligned and displayed in the space panel when expanded Error: Screenshot comparison failed: 6 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/snapshots/spaces/threads-activity-centre/threadsActivityCentre.spec.ts/tac-button-expanded-linux.png Received: /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/test-results/spaces-threads-activity-ce-34d5f-e-space-panel-when-expanded/tac-button-expanded-actual.png Diff: /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/test-results/spaces-threads-activity-ce-34d5f-e-space-panel-when-expanded/tac-button-expanded-diff.png Call log: - expect.toHaveScreenshot(tac-button-expanded.png) with timeout 5000ms - verifying given screenshot expectation - waiting for getByRole('navigation', { name: 'Spaces' }) - locator resolved to <nav aria-label="Spaces" class="mx_SpacePanel">…</nav> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 6 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for getByRole('navigation', { name: 'Spaces' }) - locator resolved to <nav aria-label="Spaces" class="mx_SpacePanel">…</nav> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 6 pixels (ratio 0.01 of all image pixels) are different. 23 | await util.expandSpacePanel(); 24 | // The buttons in the space panel should be aligned when expanded > 25 | await expect(util.getSpacePanel()).toMatchScreenshot("tac-button-expanded.png"); | ^ 26 | }); 27 | 28 | test("should not show indicator when there is no thread", async ({ room1, util }) => { at /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/spaces/threads-activity-centre/threadsActivityCentre.spec.ts:25:44

1) spaces/threads-activity-centre/threadsActivityCentre.spec.ts:19:9 › Threads Activity Centre › should have the button correctly aligned and displayed in the space panel when expanded Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 6 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/snapshots/spaces/threads-activity-centre/threadsActivityCentre.spec.ts/tac-button-expanded-linux.png Received: /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/test-results/spaces-threads-activity-ce-34d5f-e-space-panel-when-expanded-retry1/tac-button-expanded-actual.png Diff: /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/test-results/spaces-threads-activity-ce-34d5f-e-space-panel-when-expanded-retry1/tac-button-expanded-diff.png Call log: - expect.toHaveScreenshot(tac-button-expanded.png) with timeout 5000ms - verifying given screenshot expectation - waiting for getByRole('navigation', { name: 'Spaces' }) - locator resolved to <nav aria-label="Spaces" class="mx_SpacePanel">…</nav> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 6 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for getByRole('navigation', { name: 'Spaces' }) - locator resolved to <nav aria-label="Spaces" class="mx_SpacePanel">…</nav> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 6 pixels (ratio 0.01 of all image pixels) are different. 23 | await util.expandSpacePanel(); 24 | // The buttons in the space panel should be aligned when expanded > 25 | await expect(util.getSpacePanel()).toMatchScreenshot("tac-button-expanded.png"); | ^ 26 | }); 27 | 28 | test("should not show indicator when there is no thread", async ({ room1, util }) => { at /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/spaces/threads-activity-centre/threadsActivityCentre.spec.ts:25:44

1) spaces/threads-activity-centre/threadsActivityCentre.spec.ts:19:9 › Threads Activity Centre › should have the button correctly aligned and displayed in the space panel when expanded Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 6 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/snapshots/spaces/threads-activity-centre/threadsActivityCentre.spec.ts/tac-button-expanded-linux.png Received: /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/test-results/spaces-threads-activity-ce-34d5f-e-space-panel-when-expanded-retry2/tac-button-expanded-actual.png Diff: /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/test-results/spaces-threads-activity-ce-34d5f-e-space-panel-when-expanded-retry2/tac-button-expanded-diff.png Call log: - expect.toHaveScreenshot(tac-button-expanded.png) with timeout 5000ms - verifying given screenshot expectation - waiting for getByRole('navigation', { name: 'Spaces' }) - locator resolved to <nav aria-label="Spaces" class="mx_SpacePanel">…</nav> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 6 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for getByRole('navigation', { name: 'Spaces' }) - locator resolved to <nav aria-label="Spaces" class="mx_SpacePanel">…</nav> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 6 pixels (ratio 0.01 of all image pixels) are different. 23 | await util.expandSpacePanel(); 24 | // The buttons in the space panel should be aligned when expanded > 25 | await expect(util.getSpacePanel()).toMatchScreenshot("tac-button-expanded.png"); | ^ 26 | }); 27 | 28 | test("should not show indicator when there is no thread", async ({ room1, util }) => { at /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/spaces/threads-activity-centre/threadsActivityCentre.spec.ts:25:44

2) spaces/threads-activity-centre/threadsActivityCentre.spec.ts:131:9 › Threads Activity Centre › should have the correct hover state Error: Screenshot comparison failed: 6 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/snapshots/spaces/threads-activity-centre/threadsActivityCentre.spec.ts/tac-hovered-linux.png Received: /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/test-results/spaces-threads-activity-ce-f979e-ave-the-correct-hover-state/tac-hovered-actual.png Diff: /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/test-results/spaces-threads-activity-ce-f979e-ave-the-correct-hover-state/tac-hovered-diff.png Call log: - expect.toHaveScreenshot(tac-hovered.png) with timeout 5000ms - verifying given screenshot expectation - waiting for getByRole('navigation', { name: 'Spaces' }) - locator resolved to <nav aria-label="Spaces" class="mx_SpacePanel collapsed">…</nav> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 6 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for getByRole('navigation', { name: 'Spaces' }) - locator resolved to <nav aria-label="Spaces" class="mx_SpacePanel collapsed">…</nav> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 6 pixels (ratio 0.01 of all image pixels) are different. 131 | test("should have the correct hover state", async ({ util, page }) => { 132 | await util.hoverTacButton(); > 133 | await expect(util.getSpacePanel()).toMatchScreenshot("tac-hovered.png"); | ^ 134 | 135 | // Expand the space panel, hover the button and take a screenshot 136 | await util.expandSpacePanel(); at /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/spaces/threads-activity-centre/threadsActivityCentre.spec.ts:133:44

2) spaces/threads-activity-centre/threadsActivityCentre.spec.ts:131:9 › Threads Activity Centre › should have the correct hover state Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 6 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/snapshots/spaces/threads-activity-centre/threadsActivityCentre.spec.ts/tac-hovered-linux.png Received: /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/test-results/spaces-threads-activity-ce-f979e-ave-the-correct-hover-state-retry1/tac-hovered-actual.png Diff: /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/test-results/spaces-threads-activity-ce-f979e-ave-the-correct-hover-state-retry1/tac-hovered-diff.png Call log: - expect.toHaveScreenshot(tac-hovered.png) with timeout 5000ms - verifying given screenshot expectation - waiting for getByRole('navigation', { name: 'Spaces' }) - locator resolved to <nav aria-label="Spaces" class="mx_SpacePanel collapsed">…</nav> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 6 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for getByRole('navigation', { name: 'Spaces' }) - locator resolved to <nav aria-label="Spaces" class="mx_SpacePanel collapsed">…</nav> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 6 pixels (ratio 0.01 of all image pixels) are different. 131 | test("should have the correct hover state", async ({ util, page }) => { 132 | await util.hoverTacButton(); > 133 | await expect(util.getSpacePanel()).toMatchScreenshot("tac-hovered.png"); | ^ 134 | 135 | // Expand the space panel, hover the button and take a screenshot 136 | await util.expandSpacePanel(); at /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/spaces/threads-activity-centre/threadsActivityCentre.spec.ts:133:44

2) spaces/threads-activity-centre/threadsActivityCentre.spec.ts:131:9 › Threads Activity Centre › should have the correct hover state Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 6 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/snapshots/spaces/threads-activity-centre/threadsActivityCentre.spec.ts/tac-hovered-linux.png Received: /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/test-results/spaces-threads-activity-ce-f979e-ave-the-correct-hover-state-retry2/tac-hovered-actual.png Diff: /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/test-results/spaces-threads-activity-ce-f979e-ave-the-correct-hover-state-retry2/tac-hovered-diff.png Call log: - expect.toHaveScreenshot(tac-hovered.png) with timeout 5000ms - verifying given screenshot expectation - waiting for getByRole('navigation', { name: 'Spaces' }) - locator resolved to <nav aria-label="Spaces" class="mx_SpacePanel collapsed">…</nav> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 6 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for getByRole('navigation', { name: 'Spaces' }) - locator resolved to <nav aria-label="Spaces" class="mx_SpacePanel collapsed">…</nav> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 6 pixels (ratio 0.01 of all image pixels) are different. 131 | test("should have the correct hover state", async ({ util, page }) => { 132 | await util.hoverTacButton(); > 133 | await expect(util.getSpacePanel()).toMatchScreenshot("tac-hovered.png"); | ^ 134 | 135 | // Expand the space panel, hover the button and take a screenshot 136 | await util.expandSpacePanel(); at /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/spaces/threads-activity-centre/threadsActivityCentre.spec.ts:133:44

3) timeline/timeline.spec.ts:140:13 › Timeline › configure room › should create and configure a room on IRC layout Error: Screenshot comparison failed: 1 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/snapshots/timeline/timeline.spec.ts/configured-room-irc-layout-linux.png Received: /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/test-results/timeline-timeline-Timeline-43bff-figure-a-room-on-IRC-layout/configured-room-irc-layout-actual.png Diff: /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/test-results/timeline-timeline-Timeline-43bff-figure-a-room-on-IRC-layout/configured-room-irc-layout-diff.png Call log: - expect.toHaveScreenshot(configured-room-irc-layout.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_MainSplit') - locator resolved to <div class="mx_MainSplit">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 1 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_MainSplit') - locator resolved to <div class="mx_MainSplit">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 1 pixels (ratio 0.01 of all image pixels) are different. 151 | await expect(page.locator(".mx_TimelineSeparator")).toHaveText("today"); 152 | > 153 | await expect(page.locator(".mx_MainSplit")).toMatchScreenshot("configured-room-irc-layout.png"); | ^ 154 | }); 155 | 156 | test("should have an expanded generic event list summary (GELS) on IRC layout", async ({ page, app, room }) => { at /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/timeline/timeline.spec.ts:153:57

3) timeline/timeline.spec.ts:140:13 › Timeline › configure room › should create and configure a room on IRC layout Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 1 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/snapshots/timeline/timeline.spec.ts/configured-room-irc-layout-linux.png Received: /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/test-results/timeline-timeline-Timeline-43bff-figure-a-room-on-IRC-layout-retry1/configured-room-irc-layout-actual.png Diff: /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/test-results/timeline-timeline-Timeline-43bff-figure-a-room-on-IRC-layout-retry1/configured-room-irc-layout-diff.png Call log: - expect.toHaveScreenshot(configured-room-irc-layout.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_MainSplit') - locator resolved to <div class="mx_MainSplit">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 1 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_MainSplit') - locator resolved to <div class="mx_MainSplit">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 1 pixels (ratio 0.01 of all image pixels) are different. 151 | await expect(page.locator(".mx_TimelineSeparator")).toHaveText("today"); 152 | > 153 | await expect(page.locator(".mx_MainSplit")).toMatchScreenshot("configured-room-irc-layout.png"); | ^ 154 | }); 155 | 156 | test("should have an expanded generic event list summary (GELS) on IRC layout", async ({ page, app, room }) => { at /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/timeline/timeline.spec.ts:153:57

3) timeline/timeline.spec.ts:140:13 › Timeline › configure room › should create and configure a room on IRC layout Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 1 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/snapshots/timeline/timeline.spec.ts/configured-room-irc-layout-linux.png Received: /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/test-results/timeline-timeline-Timeline-43bff-figure-a-room-on-IRC-layout-retry2/configured-room-irc-layout-actual.png Diff: /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/test-results/timeline-timeline-Timeline-43bff-figure-a-room-on-IRC-layout-retry2/configured-room-irc-layout-diff.png Call log: - expect.toHaveScreenshot(configured-room-irc-layout.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_MainSplit') - locator resolved to <div class="mx_MainSplit">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 1 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_MainSplit') - locator resolved to <div class="mx_MainSplit">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 1 pixels (ratio 0.01 of all image pixels) are different. 151 | await expect(page.locator(".mx_TimelineSeparator")).toHaveText("today"); 152 | > 153 | await expect(page.locator(".mx_MainSplit")).toMatchScreenshot("configured-room-irc-layout.png"); | ^ 154 | }); 155 | 156 | test("should have an expanded generic event list summary (GELS) on IRC layout", async ({ page, app, room }) => { at /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/timeline/timeline.spec.ts:153:57

4) timeline/timeline.spec.ts:156:13 › Timeline › configure room › should have an expanded generic event list summary (GELS) on IRC layout Error: Screenshot comparison failed: 1 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/snapshots/timeline/timeline.spec.ts/expanded-gels-irc-layout-linux.png Received: /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/test-results/timeline-timeline-Timeline-88c2d--summary-GELS-on-IRC-layout/expanded-gels-irc-layout-actual.png Diff: /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/test-results/timeline-timeline-Timeline-88c2d--summary-GELS-on-IRC-layout/expanded-gels-irc-layout-diff.png Call log: - expect.toHaveScreenshot(expanded-gels-irc-layout.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_MainSplit') - locator resolved to <div class="mx_MainSplit">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 1 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_MainSplit') - locator resolved to <div class="mx_MainSplit">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 1 pixels (ratio 0.01 of all image pixels) are different. 172 | await expect(gels.getByRole("button", { name: "Collapse" })).toBeVisible(); 173 | > 174 | await expect(page.locator(".mx_MainSplit")).toMatchScreenshot("expanded-gels-irc-layout.png", { | ^ 175 | mask: [page.locator(".mx_MessageTimestamp")], 176 | css: ` 177 | .mx_TopUnreadMessagesBar, .mx_MessagePanel_myReadMarker { at /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/timeline/timeline.spec.ts:174:57

Stale screenshot file

Stale screenshot file

Stale screenshot file

Stale screenshot file

Stale screenshot file

Stale screenshot file

Stale screenshot file

Stale screenshot file

Stale screenshot file

Stale screenshot file

read-receipts/high-level.spec.ts took 3.5m

read-receipts/new-messages-in-threads.spec.ts took 1.8m

read-receipts/editing-messages-in-threads.spec.ts took 1.4m

read-receipts/editing-messages-main-timeline.spec.ts took 1.2m

read-receipts/editing-messages-thread-roots.spec.ts took 57.5s

right-panel/right-panel.spec.ts took 1.0m

settings/account-user-settings-tab.spec.ts took 48.5s

right-panel/file-panel.spec.ts took 42.3s

settings/appearance-user-settings-tab/theme-choice-panel.spec.ts took 34.9s

read-receipts/room-list-order.spec.ts took 32.5s

read-receipts/redactions-in-threads.spec.ts took 2.8m

read-receipts/redactions-main-timeline.spec.ts took 2.1m

read-receipts/new-messages-main-timeline.spec.ts took 1.5m

read-receipts/read-receipts.spec.ts took 1.2m

read-receipts/reactions-in-threads.spec.ts took 1.1m

messages/messages.spec.ts took 2.5m

pinned-messages/pinned-messages.spec.ts took 1.8m

login/login.spec.ts took 1.1m

knock/knock-into-room.spec.ts took 40.8s

integration-manager/read_events.spec.ts took 40.2s

composer/RTE.spec.ts took 1.4m

audio-player/audio-player.spec.ts took 1.3m

crypto/crypto.spec.ts took 1.1m

crypto/event-shields.spec.ts took 1.1m

crypto/device-verification.spec.ts took 49.4s

spotlight/spotlight.spec.ts took 2.4m

threads/threads.spec.ts took 38.3s

user-onboarding/user-onboarding-new.spec.ts took 33.5s

widgets/widget-pip-close.spec.ts took 23.8s

widgets/stickers.spec.ts took 22.6s

32 skipped 42 passed (9.0m)

6 failed register/register.spec.ts:18:9 › Registration › registers an account and lands on the home screen release-announcement/releaseAnnouncement.spec.ts:21:9 › Release announcement › should display the release announcement process settings/appearance-user-settings-tab/appearance-user-settings-tab.spec.ts:28:9 › Appearance user settings tab › should support changing font size by using the font size dropdown settings/general-room-settings-tab.spec.ts:23:9 › General room settings tab › should be rendered properly spaces/spaces.spec.ts:58:9 › Spaces › should allow user to create public space ───────────────── spaces/spaces.spec.ts:219:9 › Spaces › should render subspaces in the space panel only when expanded 9 skipped 59 passed (11.6m)

15 skipped 68 passed (11.7m)

1 skipped 78 passed (11.5m)

78 passed (12.2m)