Skip to content
Prompt Eval Tests

error grouping prompt #38

Sign in to view logs

error grouping prompt

error grouping prompt #38

Triggered via pull request February 26, 2025 11:17
@aluedekealuedeke
synchronize #53
errorgroups
Status Failure
Total duration 3m 3s
Artifacts –

test-evals.yml

on: pull_request
build
2m 55s
build
Fit to window
Zoom out
Zoom in

Annotations

11 errors and 1 warning
Checkly Prompt Tests ► Checkly Prompt Tests should find similar errors for check { checkId: '3c4264bc-4355-4f7f-ba6c-5d79a647e0bc', expected: [Object] } ► Checkly Prompt Tests should find similar errors for check { checkId: '3c4264bc-4355-4f7f-ba6c-5d7...: reports/junit.xml#L0
Failed test found in: reports/junit.xml Error: Error: ENOENT: no such file or directory, open 'results/groups/394650/checks/3c4264bc-4355-4f7f-ba6c-5d79a647e0bc/result-summary.json'
Checkly Prompt Tests ► Checkly Prompt Tests should find similar errors for check { checkId: '5ee8e373-f204-45e4-b193-d652dba7e928', expected: [Object] } ► Checkly Prompt Tests should find similar errors for check { checkId: '5ee8e373-f204-45e4-b193-d65...: reports/junit.xml#L0
Failed test found in: reports/junit.xml Error: Error: ENOENT: no such file or directory, open 'results/groups/394650/checks/5ee8e373-f204-45e4-b193-d652dba7e928/result-summary.json'
Checkly Prompt Tests ► Checkly Prompt Tests should find similar errors for check { checkId: '005fd7bd-81f9-43e0-bcc5-4ac57002b8cd', expected: [Object] } ► Checkly Prompt Tests should find similar errors for check { checkId: '005fd7bd-81f9-43e0-bcc5-4ac...: reports/junit.xml#L0
Failed test found in: reports/junit.xml Error: Error: ENOENT: no such file or directory, open 'results/groups/394650/checks/005fd7bd-81f9-43e0-bcc5-4ac57002b8cd/result-summary.json'
Checkly Prompt Tests ► Checkly Prompt Tests should find similar errors for check { checkId: '28f31eaf-3169-4a13-8f7d-f547c100805f', expected: [Object] } ► Checkly Prompt Tests should find similar errors for check { checkId: '28f31eaf-3169-4a13-8f7d-f54...: reports/junit.xml#L0
Failed test found in: reports/junit.xml Error: Error: ENOENT: no such file or directory, open 'results/groups/394650/checks/28f31eaf-3169-4a13-8f7d-f547c100805f/result-summary.json'
Checkly Prompt Tests ► Checkly Prompt Tests should find similar errors for check { checkId: '84d25fb6-a6a7-4127-9c99-64cd3d754817', expected: [Object] } ► Checkly Prompt Tests should find similar errors for check { checkId: '84d25fb6-a6a7-4127-9c99-64c...: reports/junit.xml#L0
Failed test found in: reports/junit.xml Error: Error: ENOENT: no such file or directory, open 'results/groups/394650/checks/84d25fb6-a6a7-4127-9c99-64cd3d754817/result-summary.json'
Checkly Prompt Tests ► Checkly Prompt Tests should find similar errors for check { checkId: '683f229f-48d2-4b97-9161-db029f9d9a32', expected: [Object] } ► Checkly Prompt Tests should find similar errors for check { checkId: '683f229f-48d2-4b97-9161-db0...: reports/junit.xml#L0
Failed test found in: reports/junit.xml Error: Error: ENOENT: no such file or directory, open 'results/groups/394650/checks/683f229f-48d2-4b97-9161-db029f9d9a32/result-summary.json'
Checkly Prompt Tests ► Checkly Prompt Tests should find similar errors for check { checkId: 'dd89cce7-3eec-4786-8e0e-0e5f3b3647b4', expected: [Object] } ► Checkly Prompt Tests should find similar errors for check { checkId: 'dd89cce7-3eec-4786-8e0e-0e5...: reports/junit.xml#L0
Failed test found in: reports/junit.xml Error: Error: ENOENT: no such file or directory, open 'results/groups/394650/checks/dd89cce7-3eec-4786-8e0e-0e5f3b3647b4/result-summary.json'
Checkly Prompt Tests ► Checkly Prompt Tests should find similar errors for check { checkId: 'e9ac8920-ee84-40aa-bd67-f3d04babc3db', expected: [Object] } ► Checkly Prompt Tests should find similar errors for check { checkId: 'e9ac8920-ee84-40aa-bd67-f3d...: reports/junit.xml#L0
Failed test found in: reports/junit.xml Error: Error: ENOENT: no such file or directory, open 'results/groups/394650/checks/e9ac8920-ee84-40aa-bd67-f3d04babc3db/result-summary.json'
Github Prompt Tests ► Github Prompt Tests should summarize releases by prompt ► Github Prompt Tests should summarize releases by prompt: src/prompts/github.eval.spec.ts#L19
Failed test found in: reports/junit.xml Error: Error: thrown: "Exceeded timeout of 120000 ms for a test.
build
Failed test were found and 'fail-on-error' option is set to true
build
Process completed with exit code 1.
build
Cache not found for keys: node-cache-Linux-x64-npm-f8306e32bc2e5ce3f752c337af248a003545d4477b2f493f29d8244b7a74957b