Skip to content

feat(elements): add file picker #12564

feat(elements): add file picker

feat(elements): add file picker #12564

Triggered via pull request November 16, 2024 15:31
Status Failure
Total duration 10m 59s
Artifacts 1

ci.yml

on: pull_request
incremental_mutation_testing
8m 52s
incremental_mutation_testing
Matrix: build_and_test
Fit to window
Zoom out
Zoom in

Annotations

25 errors, 10 warnings, and 4 notices
build_and_test (20.x, ubuntu-latest)
Process completed with exit code 1.
build_and_test (18.x, ubuntu-latest)
Process completed with exit code 1.
build_and_test (18.x, ubuntu-latest)
Failed to CreateArtifact: Received non-retryable error: Failed request: (409) Conflict: an artifact with this name already exists on the workflow run
build_and_test (20.x, windows-latest)
Failed to CreateArtifact: Received non-retryable error: Failed request: (409) Conflict: an artifact with this name already exists on the workflow run
[chromium] › lib\helpers.ts:6:3 › Theming › dark theme › when opening the file picker › should match the dark theme: packages\elements\test\integration\lib\helpers.ts#L14
1) [chromium] › lib\helpers.ts:6:3 › Theming › dark theme › when opening the file picker › should match the dark theme Error: Screenshot comparison failed: 92765 pixels (ratio 0.07 of all image pixels) are different. Expected: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\theming.it.spec.ts-snapshots\Theming-dark-theme-when-opening-the-file-picker-should-match-the-dark-theme-1-chromium-win32.png Received: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\theming.it-Theming-dark-th-ae1c3-should-match-the-dark-theme-chromium\Theming-dark-theme-when-op-89f1e-ould-match-the-dark-theme-1-actual.png Diff: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\theming.it-Theming-dark-th-ae1c3-should-match-the-dark-theme-chromium\Theming-dark-theme-when-op-89f1e-ould-match-the-dark-theme-1-diff.png Call log: - expect.toHaveScreenshot with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 92765 pixels (ratio 0.07 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 92765 pixels (ratio 0.07 of all image pixels) are different. 12 | if (isHeadless()) { 13 | await page.locator('mutation-test-report-app >> :is(mte-test-view, mte-mutant-view)').waitFor(); > 14 | await expect(page).toHaveScreenshot(); | ^ 15 | } else { 16 | console.log('[SKIP] skipping screenshot comparison, because not running in headless mode'); 17 | context.skip(); at actScreenshotMatch (D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\lib\helpers.ts:14:24) at D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\lib\helpers.ts:7:5
[chromium] › lib\helpers.ts:6:3 › Theming › dark theme › when opening the file picker › should match the dark theme: packages\elements\test\integration\lib\helpers.ts#L14
1) [chromium] › lib\helpers.ts:6:3 › Theming › dark theme › when opening the file picker › should match the dark theme Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 92765 pixels (ratio 0.07 of all image pixels) are different. Expected: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\theming.it.spec.ts-snapshots\Theming-dark-theme-when-opening-the-file-picker-should-match-the-dark-theme-1-chromium-win32.png Received: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\theming.it-Theming-dark-th-ae1c3-should-match-the-dark-theme-chromium-retry1\Theming-dark-theme-when-op-89f1e-ould-match-the-dark-theme-1-actual.png Diff: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\theming.it-Theming-dark-th-ae1c3-should-match-the-dark-theme-chromium-retry1\Theming-dark-theme-when-op-89f1e-ould-match-the-dark-theme-1-diff.png Call log: - expect.toHaveScreenshot with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 92765 pixels (ratio 0.07 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 92765 pixels (ratio 0.07 of all image pixels) are different. 12 | if (isHeadless()) { 13 | await page.locator('mutation-test-report-app >> :is(mte-test-view, mte-mutant-view)').waitFor(); > 14 | await expect(page).toHaveScreenshot(); | ^ 15 | } else { 16 | console.log('[SKIP] skipping screenshot comparison, because not running in headless mode'); 17 | context.skip(); at actScreenshotMatch (D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\lib\helpers.ts:14:24) at D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\lib\helpers.ts:7:5
[chromium] › lib\helpers.ts:6:3 › Theming › dark theme › when opening the file picker › should match the dark theme: packages\elements\test\integration\lib\helpers.ts#L14
1) [chromium] › lib\helpers.ts:6:3 › Theming › dark theme › when opening the file picker › should match the dark theme Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 92764 pixels (ratio 0.07 of all image pixels) are different. Expected: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\theming.it.spec.ts-snapshots\Theming-dark-theme-when-opening-the-file-picker-should-match-the-dark-theme-1-chromium-win32.png Received: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\theming.it-Theming-dark-th-ae1c3-should-match-the-dark-theme-chromium-retry2\Theming-dark-theme-when-op-89f1e-ould-match-the-dark-theme-1-actual.png Diff: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\theming.it-Theming-dark-th-ae1c3-should-match-the-dark-theme-chromium-retry2\Theming-dark-theme-when-op-89f1e-ould-match-the-dark-theme-1-diff.png Call log: - expect.toHaveScreenshot with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 92764 pixels (ratio 0.07 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 92764 pixels (ratio 0.07 of all image pixels) are different. 12 | if (isHeadless()) { 13 | await page.locator('mutation-test-report-app >> :is(mte-test-view, mte-mutant-view)').waitFor(); > 14 | await expect(page).toHaveScreenshot(); | ^ 15 | } else { 16 | console.log('[SKIP] skipping screenshot comparison, because not running in headless mode'); 17 | context.skip(); at actScreenshotMatch (D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\lib\helpers.ts:14:24) at D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\lib\helpers.ts:7:5
[chromium] › lib\helpers.ts:6:3 › Theming › light theme › when opening the file picker › should match the light theme: packages\elements\test\integration\lib\helpers.ts#L14
2) [chromium] › lib\helpers.ts:6:3 › Theming › light theme › when opening the file picker › should match the light theme Error: Screenshot comparison failed: 1106951 pixels (ratio 0.80 of all image pixels) are different. Expected: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\theming.it.spec.ts-snapshots\Theming-light-theme-when-opening-the-file-picker-should-match-the-light-theme-1-chromium-win32.png Received: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\theming.it-Theming-light-t-c06b8-hould-match-the-light-theme-chromium\Theming-light-theme-when-o-62fa1-uld-match-the-light-theme-1-actual.png Diff: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\theming.it-Theming-light-t-c06b8-hould-match-the-light-theme-chromium\Theming-light-theme-when-o-62fa1-uld-match-the-light-theme-1-diff.png Call log: - expect.toHaveScreenshot with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 1106951 pixels (ratio 0.80 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 1106951 pixels (ratio 0.80 of all image pixels) are different. 12 | if (isHeadless()) { 13 | await page.locator('mutation-test-report-app >> :is(mte-test-view, mte-mutant-view)').waitFor(); > 14 | await expect(page).toHaveScreenshot(); | ^ 15 | } else { 16 | console.log('[SKIP] skipping screenshot comparison, because not running in headless mode'); 17 | context.skip(); at actScreenshotMatch (D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\lib\helpers.ts:14:24) at D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\lib\helpers.ts:7:5
[chromium] › lib\helpers.ts:6:3 › Theming › light theme › when opening the file picker › should match the light theme: packages\elements\test\integration\lib\helpers.ts#L14
2) [chromium] › lib\helpers.ts:6:3 › Theming › light theme › when opening the file picker › should match the light theme Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 1106951 pixels (ratio 0.80 of all image pixels) are different. Expected: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\theming.it.spec.ts-snapshots\Theming-light-theme-when-opening-the-file-picker-should-match-the-light-theme-1-chromium-win32.png Received: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\theming.it-Theming-light-t-c06b8-hould-match-the-light-theme-chromium-retry1\Theming-light-theme-when-o-62fa1-uld-match-the-light-theme-1-actual.png Diff: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\theming.it-Theming-light-t-c06b8-hould-match-the-light-theme-chromium-retry1\Theming-light-theme-when-o-62fa1-uld-match-the-light-theme-1-diff.png Call log: - expect.toHaveScreenshot with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 1106951 pixels (ratio 0.80 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 1106951 pixels (ratio 0.80 of all image pixels) are different. 12 | if (isHeadless()) { 13 | await page.locator('mutation-test-report-app >> :is(mte-test-view, mte-mutant-view)').waitFor(); > 14 | await expect(page).toHaveScreenshot(); | ^ 15 | } else { 16 | console.log('[SKIP] skipping screenshot comparison, because not running in headless mode'); 17 | context.skip(); at actScreenshotMatch (D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\lib\helpers.ts:14:24) at D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\lib\helpers.ts:7:5
[chromium] › lib\helpers.ts:6:3 › Theming › light theme › when opening the file picker › should match the light theme: packages\elements\test\integration\lib\helpers.ts#L14
2) [chromium] › lib\helpers.ts:6:3 › Theming › light theme › when opening the file picker › should match the light theme Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 1106951 pixels (ratio 0.80 of all image pixels) are different. Expected: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\theming.it.spec.ts-snapshots\Theming-light-theme-when-opening-the-file-picker-should-match-the-light-theme-1-chromium-win32.png Received: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\theming.it-Theming-light-t-c06b8-hould-match-the-light-theme-chromium-retry2\Theming-light-theme-when-o-62fa1-uld-match-the-light-theme-1-actual.png Diff: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\theming.it-Theming-light-t-c06b8-hould-match-the-light-theme-chromium-retry2\Theming-light-theme-when-o-62fa1-uld-match-the-light-theme-1-diff.png Call log: - expect.toHaveScreenshot with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 1106951 pixels (ratio 0.80 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 1106951 pixels (ratio 0.80 of all image pixels) are different. 12 | if (isHeadless()) { 13 | await page.locator('mutation-test-report-app >> :is(mte-test-view, mte-mutant-view)').waitFor(); > 14 | await expect(page).toHaveScreenshot(); | ^ 15 | } else { 16 | console.log('[SKIP] skipping screenshot comparison, because not running in headless mode'); 17 | context.skip(); at actScreenshotMatch (D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\lib\helpers.ts:14:24) at D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\lib\helpers.ts:7:5
[firefox] › lib\helpers.ts:6:3 › Theming › dark theme › when opening the file picker › should match the dark theme: packages\elements\test\integration\lib\helpers.ts#L14
3) [firefox] › lib\helpers.ts:6:3 › Theming › dark theme › when opening the file picker › should match the dark theme Error: Screenshot comparison failed: 83508 pixels (ratio 0.10 of all image pixels) are different. Expected: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\theming.it.spec.ts-snapshots\Theming-dark-theme-when-opening-the-file-picker-should-match-the-dark-theme-1-firefox-win32.png Received: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\theming.it-Theming-dark-th-ae1c3-should-match-the-dark-theme-firefox\Theming-dark-theme-when-op-89f1e-ould-match-the-dark-theme-1-actual.png Diff: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\theming.it-Theming-dark-th-ae1c3-should-match-the-dark-theme-firefox\Theming-dark-theme-when-op-89f1e-ould-match-the-dark-theme-1-diff.png Call log: - expect.toHaveScreenshot with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 83508 pixels (ratio 0.10 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 83508 pixels (ratio 0.10 of all image pixels) are different. 12 | if (isHeadless()) { 13 | await page.locator('mutation-test-report-app >> :is(mte-test-view, mte-mutant-view)').waitFor(); > 14 | await expect(page).toHaveScreenshot(); | ^ 15 | } else { 16 | console.log('[SKIP] skipping screenshot comparison, because not running in headless mode'); 17 | context.skip(); at actScreenshotMatch (D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\lib\helpers.ts:14:24) at D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\lib\helpers.ts:7:5
[firefox] › lib\helpers.ts:6:3 › Theming › dark theme › when opening the file picker › should match the dark theme: packages\elements\test\integration\lib\helpers.ts#L14
3) [firefox] › lib\helpers.ts:6:3 › Theming › dark theme › when opening the file picker › should match the dark theme Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 83508 pixels (ratio 0.10 of all image pixels) are different. Expected: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\theming.it.spec.ts-snapshots\Theming-dark-theme-when-opening-the-file-picker-should-match-the-dark-theme-1-firefox-win32.png Received: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\theming.it-Theming-dark-th-ae1c3-should-match-the-dark-theme-firefox-retry1\Theming-dark-theme-when-op-89f1e-ould-match-the-dark-theme-1-actual.png Diff: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\theming.it-Theming-dark-th-ae1c3-should-match-the-dark-theme-firefox-retry1\Theming-dark-theme-when-op-89f1e-ould-match-the-dark-theme-1-diff.png Call log: - expect.toHaveScreenshot with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 83508 pixels (ratio 0.10 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 83508 pixels (ratio 0.10 of all image pixels) are different. 12 | if (isHeadless()) { 13 | await page.locator('mutation-test-report-app >> :is(mte-test-view, mte-mutant-view)').waitFor(); > 14 | await expect(page).toHaveScreenshot(); | ^ 15 | } else { 16 | console.log('[SKIP] skipping screenshot comparison, because not running in headless mode'); 17 | context.skip(); at actScreenshotMatch (D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\lib\helpers.ts:14:24) at D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\lib\helpers.ts:7:5
[firefox] › lib\helpers.ts:6:3 › Theming › dark theme › when opening the file picker › should match the dark theme: packages\elements\test\integration\lib\helpers.ts#L14
3) [firefox] › lib\helpers.ts:6:3 › Theming › dark theme › when opening the file picker › should match the dark theme Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 83508 pixels (ratio 0.10 of all image pixels) are different. Expected: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\theming.it.spec.ts-snapshots\Theming-dark-theme-when-opening-the-file-picker-should-match-the-dark-theme-1-firefox-win32.png Received: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\theming.it-Theming-dark-th-ae1c3-should-match-the-dark-theme-firefox-retry2\Theming-dark-theme-when-op-89f1e-ould-match-the-dark-theme-1-actual.png Diff: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\theming.it-Theming-dark-th-ae1c3-should-match-the-dark-theme-firefox-retry2\Theming-dark-theme-when-op-89f1e-ould-match-the-dark-theme-1-diff.png Call log: - expect.toHaveScreenshot with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 83508 pixels (ratio 0.10 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 83508 pixels (ratio 0.10 of all image pixels) are different. 12 | if (isHeadless()) { 13 | await page.locator('mutation-test-report-app >> :is(mte-test-view, mte-mutant-view)').waitFor(); > 14 | await expect(page).toHaveScreenshot(); | ^ 15 | } else { 16 | console.log('[SKIP] skipping screenshot comparison, because not running in headless mode'); 17 | context.skip(); at actScreenshotMatch (D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\lib\helpers.ts:14:24) at D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\lib\helpers.ts:7:5
[firefox] › lib\helpers.ts:6:3 › Theming › light theme › when opening the file picker › should match the light theme: packages\elements\test\integration\lib\helpers.ts#L14
4) [firefox] › lib\helpers.ts:6:3 › Theming › light theme › when opening the file picker › should match the light theme Error: Screenshot comparison failed: 688343 pixels (ratio 0.75 of all image pixels) are different. Expected: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\theming.it.spec.ts-snapshots\Theming-light-theme-when-opening-the-file-picker-should-match-the-light-theme-1-firefox-win32.png Received: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\theming.it-Theming-light-t-c06b8-hould-match-the-light-theme-firefox\Theming-light-theme-when-o-62fa1-uld-match-the-light-theme-1-actual.png Diff: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\theming.it-Theming-light-t-c06b8-hould-match-the-light-theme-firefox\Theming-light-theme-when-o-62fa1-uld-match-the-light-theme-1-diff.png Call log: - expect.toHaveScreenshot with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 688343 pixels (ratio 0.75 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 688343 pixels (ratio 0.75 of all image pixels) are different. 12 | if (isHeadless()) { 13 | await page.locator('mutation-test-report-app >> :is(mte-test-view, mte-mutant-view)').waitFor(); > 14 | await expect(page).toHaveScreenshot(); | ^ 15 | } else { 16 | console.log('[SKIP] skipping screenshot comparison, because not running in headless mode'); 17 | context.skip(); at actScreenshotMatch (D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\lib\helpers.ts:14:24) at D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\lib\helpers.ts:7:5
[chromium] › lib\helpers.ts:6:3 › Theming › dark theme › when opening the file picker › should match the dark theme: packages\elements\test\integration\lib\helpers.ts#L14
1) [chromium] › lib\helpers.ts:6:3 › Theming › dark theme › when opening the file picker › should match the dark theme Error: Screenshot comparison failed: 92764 pixels (ratio 0.07 of all image pixels) are different. Expected: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\theming.it.spec.ts-snapshots\Theming-dark-theme-when-opening-the-file-picker-should-match-the-dark-theme-1-chromium-win32.png Received: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\theming.it-Theming-dark-th-ae1c3-should-match-the-dark-theme-chromium\Theming-dark-theme-when-op-89f1e-ould-match-the-dark-theme-1-actual.png Diff: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\theming.it-Theming-dark-th-ae1c3-should-match-the-dark-theme-chromium\Theming-dark-theme-when-op-89f1e-ould-match-the-dark-theme-1-diff.png Call log: - expect.toHaveScreenshot with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 92764 pixels (ratio 0.07 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 92764 pixels (ratio 0.07 of all image pixels) are different. 12 | if (isHeadless()) { 13 | await page.locator('mutation-test-report-app >> :is(mte-test-view, mte-mutant-view)').waitFor(); > 14 | await expect(page).toHaveScreenshot(); | ^ 15 | } else { 16 | console.log('[SKIP] skipping screenshot comparison, because not running in headless mode'); 17 | context.skip(); at actScreenshotMatch (D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\lib\helpers.ts:14:24) at D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\lib\helpers.ts:7:5
[chromium] › lib\helpers.ts:6:3 › Theming › dark theme › when opening the file picker › should match the dark theme: packages\elements\test\integration\lib\helpers.ts#L14
1) [chromium] › lib\helpers.ts:6:3 › Theming › dark theme › when opening the file picker › should match the dark theme Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 92765 pixels (ratio 0.07 of all image pixels) are different. Expected: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\theming.it.spec.ts-snapshots\Theming-dark-theme-when-opening-the-file-picker-should-match-the-dark-theme-1-chromium-win32.png Received: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\theming.it-Theming-dark-th-ae1c3-should-match-the-dark-theme-chromium-retry1\Theming-dark-theme-when-op-89f1e-ould-match-the-dark-theme-1-actual.png Diff: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\theming.it-Theming-dark-th-ae1c3-should-match-the-dark-theme-chromium-retry1\Theming-dark-theme-when-op-89f1e-ould-match-the-dark-theme-1-diff.png Call log: - expect.toHaveScreenshot with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 92765 pixels (ratio 0.07 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 92765 pixels (ratio 0.07 of all image pixels) are different. 12 | if (isHeadless()) { 13 | await page.locator('mutation-test-report-app >> :is(mte-test-view, mte-mutant-view)').waitFor(); > 14 | await expect(page).toHaveScreenshot(); | ^ 15 | } else { 16 | console.log('[SKIP] skipping screenshot comparison, because not running in headless mode'); 17 | context.skip(); at actScreenshotMatch (D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\lib\helpers.ts:14:24) at D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\lib\helpers.ts:7:5
[chromium] › lib\helpers.ts:6:3 › Theming › dark theme › when opening the file picker › should match the dark theme: packages\elements\test\integration\lib\helpers.ts#L14
1) [chromium] › lib\helpers.ts:6:3 › Theming › dark theme › when opening the file picker › should match the dark theme Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 92764 pixels (ratio 0.07 of all image pixels) are different. Expected: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\theming.it.spec.ts-snapshots\Theming-dark-theme-when-opening-the-file-picker-should-match-the-dark-theme-1-chromium-win32.png Received: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\theming.it-Theming-dark-th-ae1c3-should-match-the-dark-theme-chromium-retry2\Theming-dark-theme-when-op-89f1e-ould-match-the-dark-theme-1-actual.png Diff: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\theming.it-Theming-dark-th-ae1c3-should-match-the-dark-theme-chromium-retry2\Theming-dark-theme-when-op-89f1e-ould-match-the-dark-theme-1-diff.png Call log: - expect.toHaveScreenshot with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 92764 pixels (ratio 0.07 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 92764 pixels (ratio 0.07 of all image pixels) are different. 12 | if (isHeadless()) { 13 | await page.locator('mutation-test-report-app >> :is(mte-test-view, mte-mutant-view)').waitFor(); > 14 | await expect(page).toHaveScreenshot(); | ^ 15 | } else { 16 | console.log('[SKIP] skipping screenshot comparison, because not running in headless mode'); 17 | context.skip(); at actScreenshotMatch (D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\lib\helpers.ts:14:24) at D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\lib\helpers.ts:7:5
[chromium] › lib\helpers.ts:6:3 › Theming › light theme › when opening the file picker › should match the light theme: packages\elements\test\integration\lib\helpers.ts#L14
2) [chromium] › lib\helpers.ts:6:3 › Theming › light theme › when opening the file picker › should match the light theme Error: Screenshot comparison failed: 1106951 pixels (ratio 0.80 of all image pixels) are different. Expected: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\theming.it.spec.ts-snapshots\Theming-light-theme-when-opening-the-file-picker-should-match-the-light-theme-1-chromium-win32.png Received: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\theming.it-Theming-light-t-c06b8-hould-match-the-light-theme-chromium\Theming-light-theme-when-o-62fa1-uld-match-the-light-theme-1-actual.png Diff: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\theming.it-Theming-light-t-c06b8-hould-match-the-light-theme-chromium\Theming-light-theme-when-o-62fa1-uld-match-the-light-theme-1-diff.png Call log: - expect.toHaveScreenshot with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 1106951 pixels (ratio 0.80 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 1106951 pixels (ratio 0.80 of all image pixels) are different. 12 | if (isHeadless()) { 13 | await page.locator('mutation-test-report-app >> :is(mte-test-view, mte-mutant-view)').waitFor(); > 14 | await expect(page).toHaveScreenshot(); | ^ 15 | } else { 16 | console.log('[SKIP] skipping screenshot comparison, because not running in headless mode'); 17 | context.skip(); at actScreenshotMatch (D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\lib\helpers.ts:14:24) at D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\lib\helpers.ts:7:5
[chromium] › lib\helpers.ts:6:3 › Theming › light theme › when opening the file picker › should match the light theme: packages\elements\test\integration\lib\helpers.ts#L14
2) [chromium] › lib\helpers.ts:6:3 › Theming › light theme › when opening the file picker › should match the light theme Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 1106951 pixels (ratio 0.80 of all image pixels) are different. Expected: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\theming.it.spec.ts-snapshots\Theming-light-theme-when-opening-the-file-picker-should-match-the-light-theme-1-chromium-win32.png Received: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\theming.it-Theming-light-t-c06b8-hould-match-the-light-theme-chromium-retry1\Theming-light-theme-when-o-62fa1-uld-match-the-light-theme-1-actual.png Diff: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\theming.it-Theming-light-t-c06b8-hould-match-the-light-theme-chromium-retry1\Theming-light-theme-when-o-62fa1-uld-match-the-light-theme-1-diff.png Call log: - expect.toHaveScreenshot with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 1106951 pixels (ratio 0.80 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 1106951 pixels (ratio 0.80 of all image pixels) are different. 12 | if (isHeadless()) { 13 | await page.locator('mutation-test-report-app >> :is(mte-test-view, mte-mutant-view)').waitFor(); > 14 | await expect(page).toHaveScreenshot(); | ^ 15 | } else { 16 | console.log('[SKIP] skipping screenshot comparison, because not running in headless mode'); 17 | context.skip(); at actScreenshotMatch (D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\lib\helpers.ts:14:24) at D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\lib\helpers.ts:7:5
[chromium] › lib\helpers.ts:6:3 › Theming › light theme › when opening the file picker › should match the light theme: packages\elements\test\integration\lib\helpers.ts#L14
2) [chromium] › lib\helpers.ts:6:3 › Theming › light theme › when opening the file picker › should match the light theme Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 1106951 pixels (ratio 0.80 of all image pixels) are different. Expected: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\theming.it.spec.ts-snapshots\Theming-light-theme-when-opening-the-file-picker-should-match-the-light-theme-1-chromium-win32.png Received: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\theming.it-Theming-light-t-c06b8-hould-match-the-light-theme-chromium-retry2\Theming-light-theme-when-o-62fa1-uld-match-the-light-theme-1-actual.png Diff: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\theming.it-Theming-light-t-c06b8-hould-match-the-light-theme-chromium-retry2\Theming-light-theme-when-o-62fa1-uld-match-the-light-theme-1-diff.png Call log: - expect.toHaveScreenshot with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 1106951 pixels (ratio 0.80 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 1106951 pixels (ratio 0.80 of all image pixels) are different. 12 | if (isHeadless()) { 13 | await page.locator('mutation-test-report-app >> :is(mte-test-view, mte-mutant-view)').waitFor(); > 14 | await expect(page).toHaveScreenshot(); | ^ 15 | } else { 16 | console.log('[SKIP] skipping screenshot comparison, because not running in headless mode'); 17 | context.skip(); at actScreenshotMatch (D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\lib\helpers.ts:14:24) at D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\lib\helpers.ts:7:5
[firefox] › lib\helpers.ts:6:3 › Theming › dark theme › when opening the file picker › should match the dark theme: packages\elements\test\integration\lib\helpers.ts#L14
3) [firefox] › lib\helpers.ts:6:3 › Theming › dark theme › when opening the file picker › should match the dark theme Error: Screenshot comparison failed: 83508 pixels (ratio 0.10 of all image pixels) are different. Expected: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\theming.it.spec.ts-snapshots\Theming-dark-theme-when-opening-the-file-picker-should-match-the-dark-theme-1-firefox-win32.png Received: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\theming.it-Theming-dark-th-ae1c3-should-match-the-dark-theme-firefox\Theming-dark-theme-when-op-89f1e-ould-match-the-dark-theme-1-actual.png Diff: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\theming.it-Theming-dark-th-ae1c3-should-match-the-dark-theme-firefox\Theming-dark-theme-when-op-89f1e-ould-match-the-dark-theme-1-diff.png Call log: - expect.toHaveScreenshot with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 83508 pixels (ratio 0.10 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 83508 pixels (ratio 0.10 of all image pixels) are different. 12 | if (isHeadless()) { 13 | await page.locator('mutation-test-report-app >> :is(mte-test-view, mte-mutant-view)').waitFor(); > 14 | await expect(page).toHaveScreenshot(); | ^ 15 | } else { 16 | console.log('[SKIP] skipping screenshot comparison, because not running in headless mode'); 17 | context.skip(); at actScreenshotMatch (D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\lib\helpers.ts:14:24) at D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\lib\helpers.ts:7:5
[firefox] › lib\helpers.ts:6:3 › Theming › dark theme › when opening the file picker › should match the dark theme: packages\elements\test\integration\lib\helpers.ts#L14
3) [firefox] › lib\helpers.ts:6:3 › Theming › dark theme › when opening the file picker › should match the dark theme Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 83508 pixels (ratio 0.10 of all image pixels) are different. Expected: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\theming.it.spec.ts-snapshots\Theming-dark-theme-when-opening-the-file-picker-should-match-the-dark-theme-1-firefox-win32.png Received: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\theming.it-Theming-dark-th-ae1c3-should-match-the-dark-theme-firefox-retry1\Theming-dark-theme-when-op-89f1e-ould-match-the-dark-theme-1-actual.png Diff: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\theming.it-Theming-dark-th-ae1c3-should-match-the-dark-theme-firefox-retry1\Theming-dark-theme-when-op-89f1e-ould-match-the-dark-theme-1-diff.png Call log: - expect.toHaveScreenshot with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 83508 pixels (ratio 0.10 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 83508 pixels (ratio 0.10 of all image pixels) are different. 12 | if (isHeadless()) { 13 | await page.locator('mutation-test-report-app >> :is(mte-test-view, mte-mutant-view)').waitFor(); > 14 | await expect(page).toHaveScreenshot(); | ^ 15 | } else { 16 | console.log('[SKIP] skipping screenshot comparison, because not running in headless mode'); 17 | context.skip(); at actScreenshotMatch (D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\lib\helpers.ts:14:24) at D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\lib\helpers.ts:7:5
[firefox] › lib\helpers.ts:6:3 › Theming › dark theme › when opening the file picker › should match the dark theme: packages\elements\test\integration\lib\helpers.ts#L14
3) [firefox] › lib\helpers.ts:6:3 › Theming › dark theme › when opening the file picker › should match the dark theme Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 83508 pixels (ratio 0.10 of all image pixels) are different. Expected: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\theming.it.spec.ts-snapshots\Theming-dark-theme-when-opening-the-file-picker-should-match-the-dark-theme-1-firefox-win32.png Received: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\theming.it-Theming-dark-th-ae1c3-should-match-the-dark-theme-firefox-retry2\Theming-dark-theme-when-op-89f1e-ould-match-the-dark-theme-1-actual.png Diff: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\theming.it-Theming-dark-th-ae1c3-should-match-the-dark-theme-firefox-retry2\Theming-dark-theme-when-op-89f1e-ould-match-the-dark-theme-1-diff.png Call log: - expect.toHaveScreenshot with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 83508 pixels (ratio 0.10 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 83508 pixels (ratio 0.10 of all image pixels) are different. 12 | if (isHeadless()) { 13 | await page.locator('mutation-test-report-app >> :is(mte-test-view, mte-mutant-view)').waitFor(); > 14 | await expect(page).toHaveScreenshot(); | ^ 15 | } else { 16 | console.log('[SKIP] skipping screenshot comparison, because not running in headless mode'); 17 | context.skip(); at actScreenshotMatch (D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\lib\helpers.ts:14:24) at D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\lib\helpers.ts:7:5
[firefox] › lib\helpers.ts:6:3 › Theming › light theme › when opening the file picker › should match the light theme: packages\elements\test\integration\lib\helpers.ts#L14
4) [firefox] › lib\helpers.ts:6:3 › Theming › light theme › when opening the file picker › should match the light theme Error: Screenshot comparison failed: 688343 pixels (ratio 0.75 of all image pixels) are different. Expected: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\theming.it.spec.ts-snapshots\Theming-light-theme-when-opening-the-file-picker-should-match-the-light-theme-1-firefox-win32.png Received: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\theming.it-Theming-light-t-c06b8-hould-match-the-light-theme-firefox\Theming-light-theme-when-o-62fa1-uld-match-the-light-theme-1-actual.png Diff: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\theming.it-Theming-light-t-c06b8-hould-match-the-light-theme-firefox\Theming-light-theme-when-o-62fa1-uld-match-the-light-theme-1-diff.png Call log: - expect.toHaveScreenshot with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 688343 pixels (ratio 0.75 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 688343 pixels (ratio 0.75 of all image pixels) are different. 12 | if (isHeadless()) { 13 | await page.locator('mutation-test-report-app >> :is(mte-test-view, mte-mutant-view)').waitFor(); > 14 | await expect(page).toHaveScreenshot(); | ^ 15 | } else { 16 | console.log('[SKIP] skipping screenshot comparison, because not running in headless mode'); 17 | context.skip(); at actScreenshotMatch (D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\lib\helpers.ts:14:24) at D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\lib\helpers.ts:7:5
build_and_test (18.x, windows-latest)
Failed to CreateArtifact: Received non-retryable error: Failed request: (409) Conflict: an artifact with this name already exists on the workflow run
Slow Test: packages\elements\[firefox] › fileReport.it.spec.ts#L1
packages\elements\[firefox] › fileReport.it.spec.ts took 41.2s
Slow Test: packages\elements\[firefox] › navigation.it.spec.ts#L1
packages\elements\[firefox] › navigation.it.spec.ts took 35.0s
Slow Test: packages\elements\[firefox] › drawer-mutant.it.spec.ts#L1
packages\elements\[firefox] › drawer-mutant.it.spec.ts took 34.9s
Slow Test: packages\elements\[firefox] › test-view.it.spec.ts#L1
packages\elements\[firefox] › test-view.it.spec.ts took 31.8s
Slow Test: packages\elements\[firefox] › drawer-test.it.spec.ts#L1
packages\elements\[firefox] › drawer-test.it.spec.ts took 25.8s
Slow Test: packages\elements\[firefox] › fileReport.it.spec.ts#L1
packages\elements\[firefox] › fileReport.it.spec.ts took 41.7s
Slow Test: packages\elements\[firefox] › drawer-mutant.it.spec.ts#L1
packages\elements\[firefox] › drawer-mutant.it.spec.ts took 37.0s
Slow Test: packages\elements\[firefox] › navigation.it.spec.ts#L1
packages\elements\[firefox] › navigation.it.spec.ts took 35.1s
Slow Test: packages\elements\[firefox] › test-view.it.spec.ts#L1
packages\elements\[firefox] › test-view.it.spec.ts took 32.1s
Slow Test: packages\elements\[firefox] › drawer-test.it.spec.ts#L1
packages\elements\[firefox] › drawer-test.it.spec.ts took 25.8s
🎭 Playwright Run Summary
172 passed (2.1m)
🎭 Playwright Run Summary
172 passed (2.1m)
🎭 Playwright Run Summary
4 failed [chromium] › lib\helpers.ts:6:3 › Theming › dark theme › when opening the file picker › should match the dark theme [chromium] › lib\helpers.ts:6:3 › Theming › light theme › when opening the file picker › should match the light theme [firefox] › lib\helpers.ts:6:3 › Theming › dark theme › when opening the file picker › should match the dark theme [firefox] › lib\helpers.ts:6:3 › Theming › light theme › when opening the file picker › should match the light theme 168 passed (6.1m)
🎭 Playwright Run Summary
4 failed [chromium] › lib\helpers.ts:6:3 › Theming › dark theme › when opening the file picker › should match the dark theme [chromium] › lib\helpers.ts:6:3 › Theming › light theme › when opening the file picker › should match the light theme [firefox] › lib\helpers.ts:6:3 › Theming › dark theme › when opening the file picker › should match the dark theme [firefox] › lib\helpers.ts:6:3 › Theming › light theme › when opening the file picker › should match the light theme 168 passed (6.4m)

Artifacts

Produced during runtime
Name Size
image-diffs
241 KB