Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Updating .env and Changing Model Configurations #1306

Open
3 tasks
DSOTM-RSA opened this issue Sep 13, 2024 · 4 comments
Open
3 tasks

Updating .env and Changing Model Configurations #1306

DSOTM-RSA opened this issue Sep 13, 2024 · 4 comments
Labels
bug Something isn't working

Comments

@DSOTM-RSA
Copy link

Describe the bug

Having succesfully deployed the solution via Local Development/Deployment I would like to change my .env to reflect am alternate configruation, i.e. GPT3.5 to GPT4o for example. Adjusting the .env as needed, I receive the following error.

image

It seems like I can't update the open-ai service to use an alternative (chat) model.

Expected behavior

The ability to change .env to deploy new models, or use existing models (in the same azure-openai instance) for previously deployed azd environments. [I've done this many times for the alternative ChatGPT + Enterprise data with Azure OpenAI and AI Search demo successfully]

How can I change, configure my deplyoments to meet/match the case as presented in the contract existence example, or in any custom configuration of my choice, gpt4-o and embedding-small etc.

Am I missing something fundamentally different about how these two solutions use azd, change existing/create new enviornments or use existing resources??

Debugging information

Windows 10 >> WSL >> Dev Container
RG = swedencentral

Steps to reproduce

Steps to reproduce the behavior:

  1. Go to '...'
  2. Click on '....'
  3. Scroll down to '....'
  4. See error

Screenshots

If applicable, add screenshots to help explain your problem.

Logs

If applicable, add logs to help the engineer debug the problem.


Tasks

To be filled in by the engineer picking up the issue

  • Task 1
  • Task 2
  • ...
@DSOTM-RSA DSOTM-RSA added the bug Something isn't working label Sep 13, 2024
@Roopan-Microsoft
Copy link
Contributor

Roopan-Microsoft commented Sep 15, 2024

Hey @DSOTM-RSA , Thanks for your feedback. If you want to update the GPT Model. You have 2 options.

  • During One Click Deployment, you can update the GPT model as part of the deployment process.
  • For local deployment, you can update the model by following a few steps.

I’ll provide you with the details soon.

Thank you for your patience; it’s greatly appreciated.

@Roopan-Microsoft
Copy link
Contributor

Hey @DSOTM-RSA - We figured out the issue that few of the env variables are not getting populated in .env file.

We are currently working on that. Will keep you posted. Thanks

@Pavan-Microsoft
Copy link
Contributor

Hi @DSOTM-RSA - Thank you for your patience. We have identified the issue regarding the environment variables not being populated in the .env file. Due to a limitation in the Bicep output variable, which can only accommodate 64 variables, we were unable to include the missing variables individually.

To address this, we have consolidated the OpenAI model variables and the Azure OpenAI embedding model into a single object. This change allows us to update the .env file to deploy new models or utilize existing models within the same Azure OpenAI instance for previously deployed Azure Development environments.

Previously, the variable AZURE_OPENAI_MODEL was missing; however, we have now consolidated the OpenAI model information into the AZURE_OPENAI_MODEL_INFO object, which includes AZURE_OPENAI_MODEL, AZURE_OPENAI_MODEL_NAME, and AZURE_OPENAI_MODEL_VERSION.
github2709

We appreciate your understanding. Thank you!

CC: @Roopan-Microsoft

@Roopan-Microsoft
Copy link
Contributor

Hey @DSOTM-RSA - We have fixed as part of #1347. Please let us know if we are good to close this issue.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

3 participants