Support 128k max tokens for openrouter and vertex thinking #1338
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
#1327 for OpenRouter and Vertex too @cte @monotykamary
This sure seems to imply that the max is 128k on Vertex (no mention of a beta).
Important
Increase
maxTokens
to 128,000 foranthropic/claude-3.7-sonnet:thinking
in OpenRouter API and update tests accordingly.maxTokens
to 128,000 foranthropic/claude-3.7-sonnet:thinking
inopenrouter.ts
andopenrouter.test.ts
.OpenRouterHandler
test inopenrouter.test.ts
to reflect newmaxTokens
limit.getOpenRouterModels()
inopenrouter.ts
to setmaxTokens
to 128,000 foranthropic/claude-3.7-sonnet:thinking
.This description was created by
for 63cecf8. It will automatically update as commits are pushed.