Skip to content

Commit

Permalink
increase max_tokens
Browse files Browse the repository at this point in the history
  • Loading branch information
franktip committed Jun 30, 2024
1 parent 9b7deb8 commit f0bf1ac
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion src/chatmodel.ts
Original file line number Diff line number Diff line change
Expand Up @@ -3,7 +3,7 @@ import { performance } from "perf_hooks";
import { ICompletionModel } from "./completionModel";

const defaultPostOptions = {
max_tokens: 500, // maximum number of tokens to return
max_tokens: 1000, // maximum number of tokens to return
temperature: 0, // sampling temperature; higher values increase diversity
top_p: 1, // no need to change this
};
Expand Down

0 comments on commit f0bf1ac

Please sign in to comment.