Skip to content

Nightly Tests

Nightly Tests #6

Manually triggered January 22, 2025 13:26
Status Failure
Total duration 46m 59s
Artifacts 1

nightly-tests.yml

on: workflow_dispatch
Matrix: check-test-build-deploy
Fit to window
Zoom out
Zoom in

Annotations

20 errors, 33 warnings, and 2 notices
[Mobile Safari] › e2e/general.spec.ts:68:3 › test links › links in footer work: packages/tool-finder/tests/playwright/e2e/general.spec.ts#L1
1) [Mobile Safari] › e2e/general.spec.ts:68:3 › test links › links in footer work ──────────────── Test timeout of 30000ms exceeded.
[Mobile Safari] › e2e/general.spec.ts:68:3 › test links › links in footer work: packages/tool-finder/tests/playwright/e2e/general.spec.ts#L74
1) [Mobile Safari] › e2e/general.spec.ts:68:3 › test links › links in footer work ──────────────── Error: locator.click: Test timeout of 30000ms exceeded. Call log: - waiting for getByRole('link', { name: 'Impressum' }) - locator resolved to <a href="/impressum" class="text-link increase-tap-area whitespace-nowrap">Impressum </a> - attempting click action 2 × waiting for element to be visible, enabled and stable - element is visible, enabled and stable - scrolling into view if needed - done scrolling - element is outside of the viewport - retrying click action - waiting 20ms 2 × waiting for element to be visible, enabled and stable - element is visible, enabled and stable - scrolling into view if needed - done scrolling - element is outside of the viewport - retrying click action - waiting 100ms 47 × waiting for element to be visible, enabled and stable - element is visible, enabled and stable - scrolling into view if needed - done scrolling - element is outside of the viewport - retrying click action - waiting 500ms 72 | await page.getByRole("link", { name: "Barrierefreiheit" }).click(); 73 | await expect(page).toHaveURL(allRoutes.PATH_A11Y); > 74 | await page.getByRole("link", { name: "Impressum" }).click(); | ^ 75 | await expect(page).toHaveURL(allRoutes.PATH_IMPRINT); 76 | }); 77 | at /home/runner/work/digitalcheck-apps/digitalcheck-apps/packages/tool-finder/tests/playwright/e2e/general.spec.ts:74:57
[Mobile Safari] › e2e/general.spec.ts:68:3 › test links › links in footer work: packages/tool-finder/tests/playwright/e2e/general.spec.ts#L1
1) [Mobile Safari] › e2e/general.spec.ts:68:3 › test links › links in footer work ──────────────── Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Test timeout of 30000ms exceeded.
[Mobile Safari] › e2e/general.spec.ts:68:3 › test links › links in footer work: packages/tool-finder/tests/playwright/e2e/general.spec.ts#L74
1) [Mobile Safari] › e2e/general.spec.ts:68:3 › test links › links in footer work ──────────────── Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: locator.click: Test timeout of 30000ms exceeded. Call log: - waiting for getByRole('link', { name: 'Impressum' }) - locator resolved to <a href="/impressum" class="text-link increase-tap-area whitespace-nowrap">Impressum </a> - attempting click action 2 × waiting for element to be visible, enabled and stable - element is visible, enabled and stable - scrolling into view if needed - done scrolling - element is outside of the viewport - retrying click action - waiting 20ms 2 × waiting for element to be visible, enabled and stable - element is visible, enabled and stable - scrolling into view if needed - done scrolling - element is outside of the viewport - retrying click action - waiting 100ms 49 × waiting for element to be visible, enabled and stable - element is visible, enabled and stable - scrolling into view if needed - done scrolling - element is outside of the viewport - retrying click action - waiting 500ms 72 | await page.getByRole("link", { name: "Barrierefreiheit" }).click(); 73 | await expect(page).toHaveURL(allRoutes.PATH_A11Y); > 74 | await page.getByRole("link", { name: "Impressum" }).click(); | ^ 75 | await expect(page).toHaveURL(allRoutes.PATH_IMPRINT); 76 | }); 77 | at /home/runner/work/digitalcheck-apps/digitalcheck-apps/packages/tool-finder/tests/playwright/e2e/general.spec.ts:74:57
[Mobile Safari] › e2e/quizAndResult.spec.ts:58:3 › test result page › visualisation object leads to correct cluster: packages/tool-finder/tests/playwright/e2e/quizAndResult.spec.ts#L1
2) [Mobile Safari] › e2e/quizAndResult.spec.ts:58:3 › test result page › visualisation object leads to correct cluster Test timeout of 30000ms exceeded.
[Mobile Safari] › e2e/quizAndResult.spec.ts:58:3 › test result page › visualisation object leads to correct cluster: packages/tool-finder/tests/playwright/e2e/quizAndResult.spec.ts#L1
2) [Mobile Safari] › e2e/quizAndResult.spec.ts:58:3 › test result page › visualisation object leads to correct cluster Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Test timeout of 30000ms exceeded.
[Tablet Safari] › e2e/general.spec.ts:68:3 › test links › links in footer work: packages/tool-finder/tests/playwright/e2e/general.spec.ts#L1
3) [Tablet Safari] › e2e/general.spec.ts:68:3 › test links › links in footer work ──────────────── Test timeout of 30000ms exceeded.
[Tablet Safari] › e2e/general.spec.ts:68:3 › test links › links in footer work: packages/tool-finder/tests/playwright/e2e/general.spec.ts#L74
3) [Tablet Safari] › e2e/general.spec.ts:68:3 › test links › links in footer work ──────────────── Error: locator.click: Test timeout of 30000ms exceeded. Call log: - waiting for getByRole('link', { name: 'Impressum' }) - locator resolved to <a href="/impressum" class="text-link increase-tap-area whitespace-nowrap">Impressum </a> - attempting click action 2 × waiting for element to be visible, enabled and stable - element is visible, enabled and stable - scrolling into view if needed - done scrolling - element is outside of the viewport - retrying click action - waiting 20ms 2 × waiting for element to be visible, enabled and stable - element is visible, enabled and stable - scrolling into view if needed - done scrolling - element is outside of the viewport - retrying click action - waiting 100ms 55 × waiting for element to be visible, enabled and stable - element is visible, enabled and stable - scrolling into view if needed - done scrolling - element is outside of the viewport - retrying click action - waiting 500ms 72 | await page.getByRole("link", { name: "Barrierefreiheit" }).click(); 73 | await expect(page).toHaveURL(allRoutes.PATH_A11Y); > 74 | await page.getByRole("link", { name: "Impressum" }).click(); | ^ 75 | await expect(page).toHaveURL(allRoutes.PATH_IMPRINT); 76 | }); 77 | at /home/runner/work/digitalcheck-apps/digitalcheck-apps/packages/tool-finder/tests/playwright/e2e/general.spec.ts:74:57
[Tablet Safari] › e2e/general.spec.ts:68:3 › test links › links in footer work: packages/tool-finder/tests/playwright/e2e/general.spec.ts#L1
3) [Tablet Safari] › e2e/general.spec.ts:68:3 › test links › links in footer work ──────────────── Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Test timeout of 30000ms exceeded.
[Tablet Safari] › e2e/general.spec.ts:68:3 › test links › links in footer work: packages/tool-finder/tests/playwright/e2e/general.spec.ts#L74
3) [Tablet Safari] › e2e/general.spec.ts:68:3 › test links › links in footer work ──────────────── Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: locator.click: Test timeout of 30000ms exceeded. Call log: - waiting for getByRole('link', { name: 'Impressum' }) - locator resolved to <a href="/impressum" class="text-link increase-tap-area whitespace-nowrap">Impressum </a> - attempting click action 2 × waiting for element to be visible, enabled and stable - element is visible, enabled and stable - scrolling into view if needed - done scrolling - element is outside of the viewport - retrying click action - waiting 20ms 2 × waiting for element to be visible, enabled and stable - element is visible, enabled and stable - scrolling into view if needed - done scrolling - element is outside of the viewport - retrying click action - waiting 100ms 54 × waiting for element to be visible, enabled and stable - element is visible, enabled and stable - scrolling into view if needed - done scrolling - element is outside of the viewport - retrying click action - waiting 500ms 72 | await page.getByRole("link", { name: "Barrierefreiheit" }).click(); 73 | await expect(page).toHaveURL(allRoutes.PATH_A11Y); > 74 | await page.getByRole("link", { name: "Impressum" }).click(); | ^ 75 | await expect(page).toHaveURL(allRoutes.PATH_IMPRINT); 76 | }); 77 | at /home/runner/work/digitalcheck-apps/digitalcheck-apps/packages/tool-finder/tests/playwright/e2e/general.spec.ts:74:57
[Mobile Safari] › e2e/examplePages.spec.ts:18:5 › Digitaltauglichkeit main functionality › displays detailed information for principle: digitale-kommunikation-sicherstellen: packages/dito/tests/e2e/examplePages.spec.ts#L1
1) [Mobile Safari] › e2e/examplePages.spec.ts:18:5 › Digitaltauglichkeit main functionality › displays detailed information for principle: digitale-kommunikation-sicherstellen Test timeout of 30000ms exceeded.
[Mobile Safari] › e2e/examplePages.spec.ts:18:5 › Digitaltauglichkeit main functionality › displays detailed information for principle: digitale-kommunikation-sicherstellen: packages/dito/tests/e2e/examplePages.spec.ts#L1
1) [Mobile Safari] › e2e/examplePages.spec.ts:18:5 › Digitaltauglichkeit main functionality › displays detailed information for principle: digitale-kommunikation-sicherstellen Test timeout of 30000ms exceeded.
[Mobile Safari] › e2e/examplePages.spec.ts:18:5 › Digitaltauglichkeit main functionality › displays detailed information for principle: digitale-kommunikation-sicherstellen: packages/dito/tests/e2e/examplePages.spec.ts#L22
1) [Mobile Safari] › e2e/examplePages.spec.ts:18:5 › Digitaltauglichkeit main functionality › displays detailed information for principle: digitale-kommunikation-sicherstellen Error: page.goto: Test ended. Call log: - navigating to "http://localhost:5172/beispiele/prinzipien/digitale-kommunikation-sicherstellen", waiting until "load" 20 | }) => { 21 | const url = `${ROUTE_PRINCIPLES.url}/${principle}`; > 22 | await page.goto(url); | ^ 23 | 24 | const mainContent = page.locator("main"); 25 | await mainContent.waitFor(); at /home/runner/work/digitalcheck-apps/digitalcheck-apps/packages/dito/tests/e2e/examplePages.spec.ts:22:18
[Mobile Safari] › e2e/examplePages.spec.ts:18:5 › Digitaltauglichkeit main functionality › displays detailed information for principle: digitale-kommunikation-sicherstellen: packages/dito/tests/e2e/examplePages.spec.ts#L1
1) [Mobile Safari] › e2e/examplePages.spec.ts:18:5 › Digitaltauglichkeit main functionality › displays detailed information for principle: digitale-kommunikation-sicherstellen Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Test timeout of 30000ms exceeded.
[Mobile Safari] › e2e/examplePages.spec.ts:18:5 › Digitaltauglichkeit main functionality › displays detailed information for principle: digitale-kommunikation-sicherstellen: packages/dito/tests/e2e/examplePages.spec.ts#L1
1) [Mobile Safari] › e2e/examplePages.spec.ts:18:5 › Digitaltauglichkeit main functionality › displays detailed information for principle: digitale-kommunikation-sicherstellen Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Test timeout of 30000ms exceeded.
[Mobile Safari] › e2e/examplePages.spec.ts:18:5 › Digitaltauglichkeit main functionality › displays detailed information for principle: digitale-kommunikation-sicherstellen: packages/dito/tests/e2e/examplePages.spec.ts#L22
1) [Mobile Safari] › e2e/examplePages.spec.ts:18:5 › Digitaltauglichkeit main functionality › displays detailed information for principle: digitale-kommunikation-sicherstellen Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: page.goto: Test ended. Call log: - navigating to "http://localhost:5172/beispiele/prinzipien/digitale-kommunikation-sicherstellen", waiting until "load" 20 | }) => { 21 | const url = `${ROUTE_PRINCIPLES.url}/${principle}`; > 22 | await page.goto(url); | ^ 23 | 24 | const mainContent = page.locator("main"); 25 | await mainContent.waitFor(); at /home/runner/work/digitalcheck-apps/digitalcheck-apps/packages/dito/tests/e2e/examplePages.spec.ts:22:18
[Mobile Safari] › e2e/examplePages.spec.ts:31:5 › Digitaltauglichkeit main functionality › renders navigation links for principle: digitale-kommunikation-sicherstellen: packages/dito/tests/e2e/examplePages.spec.ts#L1
2) [Mobile Safari] › e2e/examplePages.spec.ts:31:5 › Digitaltauglichkeit main functionality › renders navigation links for principle: digitale-kommunikation-sicherstellen Test timeout of 30000ms exceeded.
[Mobile Safari] › e2e/examplePages.spec.ts:31:5 › Digitaltauglichkeit main functionality › renders navigation links for principle: digitale-kommunikation-sicherstellen: packages/dito/tests/e2e/examplePages.spec.ts#L1
2) [Mobile Safari] › e2e/examplePages.spec.ts:31:5 › Digitaltauglichkeit main functionality › renders navigation links for principle: digitale-kommunikation-sicherstellen Test timeout of 30000ms exceeded.
[Mobile Safari] › e2e/examplePages.spec.ts:31:5 › Digitaltauglichkeit main functionality › renders navigation links for principle: digitale-kommunikation-sicherstellen: packages/dito/tests/e2e/examplePages.spec.ts#L35
2) [Mobile Safari] › e2e/examplePages.spec.ts:31:5 › Digitaltauglichkeit main functionality › renders navigation links for principle: digitale-kommunikation-sicherstellen Error: page.goto: Test ended. Call log: - navigating to "http://localhost:5172/beispiele/prinzipien/digitale-kommunikation-sicherstellen", waiting until "load" 33 | }) => { 34 | const url = `${ROUTE_PRINCIPLES.url}/${principle}`; > 35 | await page.goto(url); | ^ 36 | 37 | const nextPrincipleIndex = principles.indexOf(principle) + 1; 38 | if (nextPrincipleIndex < principles.length) { at /home/runner/work/digitalcheck-apps/digitalcheck-apps/packages/dito/tests/e2e/examplePages.spec.ts:35:18
[Mobile Safari] › e2e/examplePages.spec.ts:31:5 › Digitaltauglichkeit main functionality › renders navigation links for principle: digitale-kommunikation-sicherstellen: packages/dito/tests/e2e/examplePages.spec.ts#L1
2) [Mobile Safari] › e2e/examplePages.spec.ts:31:5 › Digitaltauglichkeit main functionality › renders navigation links for principle: digitale-kommunikation-sicherstellen Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Test timeout of 30000ms exceeded.
check-test-build-deploy (tool-finder) / check-and-test
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
check-test-build-deploy (tool-finder) / check-and-test: packages/tool-finder/src/MaintenanceModeApp.tsx#L20
Classname 'increase-tap-area' is not a Tailwind CSS class!
Slow Test: packages/tool-finder/[Desktop Safari] › e2e/general.spec.ts#L1
packages/tool-finder/[Desktop Safari] › e2e/general.spec.ts took 24.3s
Slow Test: packages/tool-finder/[Desktop Safari] › e2e/quizAndResult.spec.ts#L1
packages/tool-finder/[Desktop Safari] › e2e/quizAndResult.spec.ts took 23.8s
Slow Test: packages/tool-finder/[Desktop Firefox] › e2e/general.spec.ts#L1
packages/tool-finder/[Desktop Firefox] › e2e/general.spec.ts took 15.0s
check-test-build-deploy (tool-finder) / check-and-test: packages/tool-finder/src/MaintenanceModeApp.tsx#L20
Classname 'increase-tap-area' is not a Tailwind CSS class!
check-test-build-deploy (dito) / check-and-test
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
check-test-build-deploy (dito) / check-and-test: packages/dito/app/components/ParagraphList.tsx#L38
Unsafe member access .children on an `any` value
check-test-build-deploy (dito) / check-and-test: packages/dito/app/routes/_index.tsx#L111
Classname 'list-unstyled' is not a Tailwind CSS class!
check-test-build-deploy (dito) / check-and-test: packages/dito/app/routes/_index.tsx#L123
Classname 'text-link' is not a Tailwind CSS class!
check-test-build-deploy (dito) / check-and-test: packages/dito/app/routes/methoden_.fuenf-prinzipien.tsx#L78
Classname 'list-unstyled' is not a Tailwind CSS class!
check-test-build-deploy (dito) / check-and-test: packages/dito/app/routes/sitemap.tsx#L50
Classname 'list-unstyled' is not a Tailwind CSS class!
check-test-build-deploy (dito) / check-and-test: packages/dito/app/routes/sitemap.tsx#L53
Classname 'text-link' is not a Tailwind CSS class!
check-test-build-deploy (dito) / check-and-test: packages/dito/app/components/ParagraphList.tsx#L38
Unsafe member access .children on an `any` value
check-test-build-deploy (dito) / check-and-test: packages/dito/app/routes/_index.tsx#L111
Classname 'list-unstyled' is not a Tailwind CSS class!
check-test-build-deploy (dito) / check-and-test: packages/dito/app/routes/_index.tsx#L123
Classname 'text-link' is not a Tailwind CSS class!
check-test-build-deploy (dito) / check-and-test: packages/dito/app/routes/methoden_.fuenf-prinzipien.tsx#L78
Classname 'list-unstyled' is not a Tailwind CSS class!
check-test-build-deploy (dito) / check-and-test: packages/dito/app/routes/sitemap.tsx#L50
Classname 'list-unstyled' is not a Tailwind CSS class!
check-test-build-deploy (dito) / check-and-test: packages/dito/app/routes/sitemap.tsx#L53
Classname 'text-link' is not a Tailwind CSS class!
Slow Test: packages/dito/[Desktop Firefox] › e2e/resultForm.spec.ts#L1
packages/dito/[Desktop Firefox] › e2e/resultForm.spec.ts took 2.8m
Slow Test: packages/dito/[Desktop Chrome] › e2e/resultForm.spec.ts#L1
packages/dito/[Desktop Chrome] › e2e/resultForm.spec.ts took 1.6m
Slow Test: packages/dito/[Mobile Chrome] › e2e/resultForm.spec.ts#L1
packages/dito/[Mobile Chrome] › e2e/resultForm.spec.ts took 1.6m
Slow Test: packages/dito/[Tablet Chrome] › e2e/resultForm.spec.ts#L1
packages/dito/[Tablet Chrome] › e2e/resultForm.spec.ts took 1.5m
Slow Test: packages/dito/[Desktop Safari] › e2e/general.spec.ts#L1
packages/dito/[Desktop Safari] › e2e/general.spec.ts took 1.5m
check-test-build-deploy (dito) / check-and-test
No files were found with the provided path: packages/dito/tests/playwright/playwright-report. No artifacts will be uploaded.
🎭 Playwright Run Summary
3 failed [Mobile Safari] › e2e/general.spec.ts:68:3 › test links › links in footer work ───────────────── [Mobile Safari] › e2e/quizAndResult.spec.ts:58:3 › test result page › visualisation object leads to correct cluster [Tablet Safari] › e2e/general.spec.ts:68:3 › test links › links in footer work ───────────────── 1 flaky [Mobile Safari] › e2e/general.spec.ts:10:3 › test general functionality › all routes are reachable and have a breadcrumb menu + title 136 passed (4.8m)
🎭 Playwright Run Summary
17 failed [Mobile Safari] › e2e/examplePages.spec.ts:18:5 › Digitaltauglichkeit main functionality › displays detailed information for principle: digitale-kommunikation-sicherstellen [Mobile Safari] › e2e/examplePages.spec.ts:31:5 › Digitaltauglichkeit main functionality › renders navigation links for principle: digitale-kommunikation-sicherstellen [Mobile Safari] › e2e/examplePages.spec.ts:18:5 › Digitaltauglichkeit main functionality › displays detailed information for principle: datenschutz-und-informationssicherheit-gewaehrleisten [Mobile Safari] › e2e/examplePages.spec.ts:31:5 › Digitaltauglichkeit main functionality › renders navigation links for principle: datenschutz-und-informationssicherheit-gewaehrleisten [Mobile Safari] › e2e/examplePages.spec.ts:54:5 › Digitaltauglichkeit Prinzipien Detail › displays paragraphs with relevant principles for: digitale-kommunikation-sicherstellen [Mobile Safari] › e2e/examplePages.spec.ts:67:5 › Digitaltauglichkeit Prinzipien Detail › navigates to laws associated with principle: digitale-kommunikation-sicherstellen [Mobile Safari] › e2e/examplePages.spec.ts:54:5 › Digitaltauglichkeit Prinzipien Detail › displays paragraphs with relevant principles for: datenschutz-und-informationssicherheit-gewaehrleisten [Mobile Safari] › e2e/examplePages.spec.ts:67:5 › Digitaltauglichkeit Prinzipien Detail › navigates to laws associated with principle: datenschutz-und-informationssicherheit-gewaehrleisten [Mobile Safari] › e2e/examplePages.spec.ts:92:3 › Visualizations Overview Page › displays main heading and subtitle [Mobile Safari] › e2e/examplePages.spec.ts:104:3 › Visualizations Overview Page › displays visualization details correctly [Mobile Safari] › e2e/examplePages.spec.ts:118:3 › Visualizations Overview Page › opens images in new tab [Mobile Safari] › e2e/examplePages.spec.ts:134:3 › Visualizations Overview Page › navigation to regulation detail works [Mobile Safari] › e2e/general.spec.ts:17:5 › test general availability › /beispiele/visualisierungen is reachable and has a breadcrumb menu + title [Mobile Safari] › e2e/general.spec.ts:17:5 › test general availability › /beispiele/prinzipien/digitale-kommunikation-sicherstellen is reachable and has a breadcrumb menu + title [Mobile Safari] › e2e/general.spec.ts:17:5 › test general availability › /beispiele/prinzipien/datenschutz-und-informationssicherheit-gewaehrleisten is reachable and has a breadcrumb menu + title [Mobile Safari] › e2e/preCheckQuestions.spec.ts:58:3 › test questions form › back button works ─ [Tablet Safari] › e2e/methodPages.spec.ts:136:3 › five principles page › five principles page links to examples 11 flaky [Desktop Safari] › e2e/resultForm.spec.ts:283:3 › test positive result for digital and unsure for interoperability › email body contains result title [Desktop Safari] › e2e/resultForm.spec.ts:473:3 › test negative result for digital and unsure for interoperability › negative reasoning input is not visible [Desktop Safari] › e2e/resultPage.spec.ts:99:3 › test result page reasoning › one positive answer and only negativ interoperability question leads to positive result without interoperability [Mobile Safari] › e2e/methodPages.spec.ts:109:3 › five principles page › five principles conditional next step is accurate [Mobile Safari] › e2e/resultForm.spec.ts:155:3 › test positive result for digital and interoperability › email cc includes email from email input [Mobile Safari] › e2e/resultForm.spec.ts:393:3 › test negative result for digital and interoperability › email body contains negative reasoning [Mobile Safari] › e2e/resultForm.spec.ts:506:3 › test positive result with mixed answers › answers in email body are prefixed by a special character indicating the type of answer [Mobile Safari] › e2e/resultPage.spec.ts:32:3 › test result page general content › result page links to methods [Mobile Safari] › e2e/resultPage.spec.ts:192:3 › test result page reasoning › checking mix of unsu

Artifacts

Produced during runtime
Name Size
playwright-e2e-test-results
49.9 MB