components llm_rag_validate_deployments

LLM - Validate Deployments

llm_rag_validate_deployments

Overview

Validates that completion model, embedding model, and Azure Cognitive Search resource deployments is successful and connections works. For default AOAI, it attempts to create the deployments if not valid or present. This validation is done only if customer is using Azure Open AI models or creating an ACS index.

Version: 0.0.74

Tags

Preview

View in Studio: https://ml.azure.com/registries/azureml/components/llm_rag_validate_deployments/version/0.0.74

Inputs

Name	Description	Type	Default	Optional	Enum
embeddings_model	The model to use to embed data. E.g. 'hugging_face://model/sentence-transformers/all-mpnet-base-v2' or 'azure_open_ai://deployment/{deployment_name}/model/{model_name}'	string		False
embeddings_connection	The connection id of the Embeddings Model provider to use.	string		True
llm_config	JSON Configuration for what model to use for question generation. Must contain following keys: 'type' (value must be 'azure_open_ai' or 'azure'), 'model_name' (name of model to use for summary), 'deployment_name' (name of deployment for model), 'temperature' (randomness in response, float from 0 to 1), 'max_tokens' (number of tokens for response).	string	{"type": "azure_open_ai", "model_name": "gpt-35-turbo", "deployment_name": "gpt-35-turbo", "temperature": 0, "max_tokens": 2000}	True
llm_connection		string		True
acs_config	JSON string containing the ACS configuration. e.g. {"index_name": "my-index"}	string		True
index_connection	The connection id of the ACS provider to use.	string		True

Outputs

Name	Description	Type
output_data		uri_file

Environment

azureml:llm-rag-embeddings@latest