Skip to content

Commit

Permalink
feat(openai): Add chatglm3 and chatglm3-16k models to SCHEMA_GROUP
Browse files Browse the repository at this point in the history
Add the chatglm3 and chatglm3-16k models to the SCHEMA_GROUP in the Openai endpoint initialization file. This allows for the usage of these models with specified token limits and schema types.
  • Loading branch information
sudoskys committed Nov 11, 2023
1 parent 90320e0 commit 9dbf980
Showing 1 changed file with 23 additions and 0 deletions.
23 changes: 23 additions & 0 deletions llmkira/sdk/endpoint/openai/__init__.py
Original file line number Diff line number Diff line change
Expand Up @@ -279,6 +279,29 @@ async def create(self,
return return_result


SCHEMA_GROUP.add_model(
models=[
SingleModel(
model_name="chatglm3",
token_limit=4096,
request=Openai,
response=OpenaiResult,
schema_type="openai",
func_executor="function_call",
exception=None
),
SingleModel(
model_name="chatglm3-16k",
token_limit=16384,
request=Openai,
response=OpenaiResult,
schema_type="openai",
func_executor="function_call",
exception=None
),
]
)

SCHEMA_GROUP.add_model(
models=[
SingleModel(
Expand Down

0 comments on commit 9dbf980

Please sign in to comment.