Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Default middle-out compression to on #1323

Merged
merged 1 commit into from
Mar 3, 2025

Conversation

mrubens
Copy link
Collaborator

@mrubens mrubens commented Mar 2, 2025

Context

Related to the other PRs around trying to do a better job of context window management - one thing I realized is that middle-out compression is off by default for OpenRouter. Since it's a last line of defense after we fail to fit the conversation within the context window, I don't see any reason not to default it to on.

Implementation

I turned it on by default for new users.

How to Test

Clear your state and go through the setup as a new user.


Important

Default middle-out compression to on for OpenRouter, affecting new users.

  • Behavior:
    • Default middle-out compression to on for OpenRouter in openrouter.ts, ClineProvider.ts, and ApiOptions.tsx.
    • Affects new users; existing users retain their settings.
  • Implementation:
    • In openrouter.ts, set openRouterUseMiddleOutTransform to true by default.
    • In ClineProvider.ts, update openRouterUseMiddleOutTransform default to true in state management.
    • In ApiOptions.tsx, update checkbox default to true for middle-out compression.

This description was created by Ellipsis for 9b91ab2. It will automatically update as commits are pushed.

@mrubens mrubens requested a review from cte as a code owner March 2, 2025 23:07
Copy link

changeset-bot bot commented Mar 2, 2025

🦋 Changeset detected

Latest commit: 9b91ab2

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 1 package
Name Type
roo-cline Patch

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

@dosubot dosubot bot added the size:XS This PR changes 0-9 lines, ignoring generated files. label Mar 2, 2025
@mrubens mrubens marked this pull request as draft March 2, 2025 23:08
@dosubot dosubot bot added the enhancement New feature or request label Mar 2, 2025
@mrubens mrubens force-pushed the default_on_middle_out_compression branch from 333a2df to 9b91ab2 Compare March 3, 2025 01:58
@mrubens mrubens marked this pull request as ready for review March 3, 2025 01:58
@dosubot dosubot bot added size:S This PR changes 10-29 lines, ignoring generated files. and removed size:XS This PR changes 0-9 lines, ignoring generated files. labels Mar 3, 2025
@dosubot dosubot bot added the lgtm This PR has been approved by a maintainer label Mar 3, 2025
@mrubens mrubens merged commit 82b6fe6 into main Mar 3, 2025
19 of 20 checks passed
@mrubens mrubens deleted the default_on_middle_out_compression branch March 3, 2025 02:10
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request lgtm This PR has been approved by a maintainer size:S This PR changes 10-29 lines, ignoring generated files.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants