Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

1.0.5 #22

Merged
merged 34 commits into from
Jul 25, 2024
Merged

1.0.5 #22

merged 34 commits into from
Jul 25, 2024

Conversation

Gyarbij
Copy link
Owner

@Gyarbij Gyarbij commented Jul 25, 2024

  • 2024-07-25 Implemented support for Azure AI Studio deployments with support for Meta LLama 3.1, Mistral-2407 (mistral large 2), and other open models including from Cohere AI.
  • 2024-07-18 Added support for gpt-4o-mini.

Gyarbij added 30 commits July 20, 2024 19:35
- Added base for serverless studio deployments.

- Added dotenv.

- Add sup and override mode.
…rless deployments.

Modified the init() function to parse the AZURE_AI_STUDIO_DEPLOYMENTS environment variable and populate both AzureAIStudioDeployments and ServerlessDeploymentInfo.
Updated HandleToken() to use the serverless deployment key when appropriate.
Modified makeDirector() to construct the correct URL for serverless deployments.
…handled in azure.init()

.
Updated handleGetModels function to include serverless deployments:
It now iterates over azure.ServerlessDeploymentInfo to add serverless deployments to the list of models.

Serverless deployments have base: (Completion, ChatCompletion, and Inference).
…request is for a serverless deployment.

For serverless deployments:

set "isServerless" to true.
We keep the original path, including the '/v1' prefix.

does not modify the query parameters.

For regular Azure OpenAI deployments:

Add the api-version query parameter if "isServerless" is false.
… and improve token handling logic by removing strings.tolower from pre forked code.
f
u
c
k
e
r
y
@Gyarbij Gyarbij merged commit 9dec7bc into main Jul 25, 2024
6 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant