Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix: consume duplicates in rolling_by window #11261

Merged
merged 4 commits into from
Sep 23, 2023
Merged

fix: consume duplicates in rolling_by window #11261

merged 4 commits into from
Sep 23, 2023

Conversation

ritchie46
Copy link
Member

@github-actions github-actions bot added fix Bug fix python Related to Python Polars rust Related to Rust Polars labels Sep 23, 2023
@MarcoGorelli
Copy link
Collaborator

nice! so, salvaging the fastpath rather than conditionally taking a slowpath

Just as a suggestion, is it possible to keep the parametric tests from #11237? They're very fast to run, and would add quite some confidence in the method's correctness (it's from them that I discovered the duplicates bug)

@ritchie46
Copy link
Member Author

Sure, can you open them as a separate PR?

@MarcoGorelli
Copy link
Collaborator

#11262

good news is - those tests currently fail, but when rebased onto this branch, they pass! very confident in group_by_rolling's correctness then 🎉

@ritchie46
Copy link
Member Author

so, salvaging the fastpath

Yes, I didn't like a full data pass to check if we have duplicates. This shouldn't have any noticable performance implications on the happy path, most of our time is in the binary search and the Duration::add_us.

image

I think we should take a look at both later.

@ritchie46 ritchie46 merged commit 4efb7fe into main Sep 23, 2023
24 checks passed
@ritchie46 ritchie46 deleted the duplicate branch September 23, 2023 10:37
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
fix Bug fix python Related to Python Polars rust Related to Rust Polars
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants