When working with AI large language models, the prompts need to be updated and tested frequently. If an application makes an api call to a large language model with the prompt it is beneficial to be able to retreive the prompt dynamically to ensure one is retreiving the lastest version. Within watsonx.ai, the mechanism to do this is to create a deployment space that can be retrieved by knowing the Space ID.
Follow the steps below to promote the prompt template to deployment space
-
Save your prompts as a Prompt Template named
promptSQLandpromptClassify. See examples in the prompts subdirectory. -
Open the prompt template in Watsonx AI project. Go to Assets.
-
To be able to promote this as a template, we need to create a prompt variable within the prompt. This can be anything like
userid. Click on{#}button on top right and create theuseridprompt variable. To refer to the prompt variable in the prompt use{userid}. -
Go back to the project and click on three dots (ellipsis) in front of prompt template. Click on Promote to space.
-
If you don’t have a target deployment space, create a new deployment space. Enter all the details as shown below.
-
Now select the target deployment space and click on promote.
-
Click on hamburger menu on top of IBM watsonx. Select Deployments.
-
Click on the deployment space you created above
-
Click on ellipsis and Deploy.
-
Create a deployment
Note:
-
For this application please make sure the name of prompt templates are
promptSQLandpromptClassify. -
You have to create at least one prompt variable (step 2) to get an option to promote the prompt template to deployment space.
Adding Space ID to env file
After you create a deployment space (Step 7 above). Go to the deployment space (screenshot of step 8) and click on Manage tab.
Copy the Space GUID from above and add it to the WX_SPACE_ID in your .env file of the project.