Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix: add missing interface options #77

Merged
merged 3 commits into from
May 9, 2024
Merged

fix: add missing interface options #77

Changes from 1 commit
Commits
Show all changes
3 commits
Select commit Hold shift + click to select a range
420c483
fix: add missing interface options
saul-jb Apr 25, 2024
26dd8e8
Update src/interfaces.ts
BruceMacD May 9, 2024
4dfe818
Update src/interfaces.ts
BruceMacD May 9, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 4 additions & 0 deletions src/interfaces.ts
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -12,6 +12,8 @@ export interface Options {
numa: boolean
num_ctx: number
num_batch: number
num_gpu: number
num_gqa: number
BruceMacD marked this conversation as resolved.
Show resolved Hide resolved
main_gpu: number
low_vram: boolean
f16_kv: boolean
Expand Down Expand Up @@ -40,6 +42,8 @@ export interface Options {
mirostat_eta: number
penalize_newline: boolean
stop: string[]
rope_frequency_base: number
rope_frequency_scale: number
BruceMacD marked this conversation as resolved.
Show resolved Hide resolved
}

export interface GenerateRequest {
Expand Down
Loading