Skip to content

Passing samplers to API - which sampler has which order number and what are the defaults? #1315

Answered by LostRuins
progmars asked this question in Q&A
Discussion options

You must be logged in to vote

0=top_k, 1=top_a, 2=top_p, 3=tfs, 4=typ, 5=temp, 6=rep_pen

For details on each sampler, please refer to https://github.com/LostRuins/koboldcpp/wiki#what-are-samplers-how-do-i-change-or-disable-them-what-are-the-best-samplers

Generally you don't need to (and should not) change them unless you have to. If you don't send it, the optimal default settings will be used.

Replies: 2 comments 2 replies

Comment options

You must be logged in to vote
0 replies
Answer selected by progmars
Comment options

You must be logged in to vote
2 replies
@LostRuins
Comment options

@progmars
Comment options

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Category
Q&A
Labels
None yet
2 participants