Increase max context to 4k+ or a selectable amount? #237
Doublespaced1
started this conversation in
Ideas
Replies: 1 comment
-
Yes it can be done, You need to do 2 things:
|
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
I'm messing around with models that have 4k+ context windows such as Wes Brown's Cassandra models, and I noticed kobold still only seems to support 2048. Any way to bump that to 4096 or give us a selectable user amount?
Beta Was this translation helpful? Give feedback.
All reactions