Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Critical: Fix banded scoring within individual bands #1385

Merged
merged 1 commit into from
Jul 25, 2024
Merged

Conversation

arlimus
Copy link
Member

@arlimus arlimus commented Jul 25, 2024

Variations within bands were inverted and led to incorrect results on the edges of those variations i.e. if all scores within a band were failing or only one was failing. The tests reflect have been added to test out this behavior of variation within bands and will be further expanded in the future.

Copy link
Contributor

github-actions bot commented Jul 25, 2024

Test Results

  1 files  ±0   24 suites  ±0   19s ⏱️ ±0s
400 tests +5  399 ✅ +5  1 💤 ±0  0 ❌ ±0 
401 runs  +5  400 ✅ +5  1 💤 ±0  0 ❌ ±0 

Results for commit 22c3968. ± Comparison against base commit 7903322.

♻️ This comment has been updated with latest results.

Variations within bands were inverted and led to incorrect results on
the edges of those variations i.e. if all scores within a band were
failing or only one was failing. The tests reflect have been added to
test out this behavior of variation within bands and will be further
expanded in the future.

Signed-off-by: Dominik Richter <[email protected]>
}

// This is a toolchain that can be used to see what the scoring mechanism would produce under different scenarios
func TestScoreMechanisms(t *testing.T) {
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This has been added to have a playground for experimenting with scoring mechanisms. Uncomment the last line to force the failure to be printed

@arlimus arlimus merged commit dd081f8 into main Jul 25, 2024
14 checks passed
@arlimus arlimus deleted the dom/scoring-tests branch July 25, 2024 18:11
@github-actions github-actions bot locked and limited conversation to collaborators Jul 25, 2024
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants