Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature] Add Support for ML-Based APIs for Semantic Search #725

Open
bhoskins7 opened this issue Aug 22, 2024 · 1 comment
Open

[Feature] Add Support for ML-Based APIs for Semantic Search #725

bhoskins7 opened this issue Aug 22, 2024 · 1 comment
Labels
enhancement New feature or request

Comments

@bhoskins7
Copy link

Is your feature request related to a problem? Please describe.
When deploying Semantic search based use cases we require to download the proper model, deploy and possibly test it is available before data can be ingested into the elasticsearch cluster and possibly setup connector to the LLMs / External Models for use at ingest and query time.

Describe the resource you would like to have implemented..

  1. Eland for ability to upload models from hugging face.
  2. Load Model PUT _ml/trained_models/<model_id>
  3. Start Model POST _ml/trained_models/<model_id>/deployment/_start
  4. Get Trained Model GET _ml/trained_models/<model_id>
  5. Create / Update Trained Model Alias PUT _ml/trained_models/<model_id>/model_aliases/<model_alias>
  6. Create Connectors for LLMs or External Embedding Models AWS Bedrock, Azure OpenAI Google Vertex, Cohere, etc.

Describe the solution you'd like
Terraform stack functions that can call these apis in preparation of delivering a semantic search use case.

Describe alternatives you've considered
Direct / Manual REST API Calls or custom scipts.

@bhoskins7 bhoskins7 added the enhancement New feature or request label Aug 22, 2024
@jvia
Copy link

jvia commented Aug 26, 2024

This would be great! We are starting to experiment with vector search at the moment and having to run eland to managed our models is a bit of a pain. The rest of our cluster is managed with Terraform so having this one outside piece leads to manual cluster work.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants