Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

AI 缓存 Wasm 插件对接更多文本向量化服务 #1442

Open
7 tasks
CH3CHO opened this issue Oct 29, 2024 · 0 comments
Open
7 tasks

AI 缓存 Wasm 插件对接更多文本向量化服务 #1442

CH3CHO opened this issue Oct 29, 2024 · 0 comments
Assignees
Labels
area/ai help wanted Extra attention is needed kind/HEP sig/wasm type/enhancement New feature or request

Comments

@CH3CHO
Copy link
Collaborator

CH3CHO commented Oct 29, 2024

背景

#1040 中,Higress 实现了基于向量相似度进行 LLM 响应找回的 ai-cache 插件(https://github.com/alibaba/higress/tree/main/plugins/wasm-go/extensions/ai-cache)。这其中需要对用户的请求文本进行向量化,然后在缓存和向量数据库中寻找与之相似的历史请求。

目前,该插件仅对接了一个文本向量化服务,即阿里云提供的向量检索服务 DashVector。为了进一步扩展该插件的功能,我们需要对接更多的文本向量化服务。欢迎大家积极参与本项任务。感兴趣的同学可以在对应的子 issue 下留言认领。

如果有其他希望对接但还没有列在下面的文本向量化服务,欢迎大家留言提出需求。

待对接服务提供商

@CH3CHO CH3CHO added type/enhancement New feature or request help wanted Extra attention is needed kind/HEP sig/wasm area/ai labels Oct 29, 2024
@CH3CHO CH3CHO self-assigned this Oct 29, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/ai help wanted Extra attention is needed kind/HEP sig/wasm type/enhancement New feature or request
Projects
Status: Todo
Development

No branches or pull requests

1 participant