The request to the /v1/embeddings endpoint returned a 404 status code.

[monkdharma]

Model description

When I loaded the embedding model and tested the request, it returned a 404 status code. Is this because Infinity does not support requests in the form of /v1/embeddings?

curl http://127.0.0.1:8000/v1/embeddings \
    -X POST \
    -H 'Content-Type: application/json' \
   -d '{
  "model": "bge-large-zh-v1.5",
  "embedding_format": "float",
  "input": "What is Deep Learning"
  }'

Open source status

• The model implementation is available on transformers
• The model weights are available on huggingface-hub
• I verified that the model is currently not running in the lastest version pip install infinity_emb[all] --upgrade

Provide useful links for the implementation

No response

[greptile-apps]

The 404 status code indicates that the endpoint /v1/embeddings does not exist. The correct endpoint is /embeddings as defined in the FastAPI server implementation. Update your request URL to http://127.0.0.1:8000/embeddings.

References

/libs/infinity_emb/infinity_emb/engine.py
/libs/infinity_emb/infinity_emb/fastapi_schemas/convert.py
/libs/infinity_emb/infinity_emb/infinity_server.py
/libs/infinity_emb/tests/end_to_end/test_api_with_dummymodel.py
/libs/infinity_emb/tests/end_to_end/test_optimum_embedding.py
/docs
/docs/assets/openapi.json
/docs/docs/index.md

About Greptile

This response provides a starting point for your research, not a precise solution.

Help us improve! Please leave a 👍 if this is helpful and 👎 if it is irrelevant.

Ask Greptile · Edit Issue Bot Settings

[michaelfeil]

@monkdharma Please use the url-prefix feature for `v2 --url-prefix "v1"