-
Notifications
You must be signed in to change notification settings - Fork 572
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
feat: Enhance ai-cache Plugin with Vector Similarity-Based LLM Cache Recall and Multi-DB Support #1248
Merged
Merged
feat: Enhance ai-cache Plugin with Vector Similarity-Based LLM Cache Recall and Multi-DB Support #1248
Changes from 3 commits
Commits
Show all changes
92 commits
Select commit
Hold shift + click to select a range
4f7bfbd
fix bugs
johnlanni 0f9e816
fix bugs
Suchun-sv ff1bce6
fix bugs
Suchun-sv 1e9d42e
init
EnableAsync f2a9ff6
fix conflict
Suchun-sv 5cbae03
Merge branch 'alibaba:main' into main
Suchun-sv 27b2f71
alter some errors
Suchun-sv 130f2ee
fix: embedding error
EnableAsync 56314d7
fix bugs && update interface design
Suchun-sv 3d7e85c
feat: add elasticsearch
EnableAsync 85549d0
fix bugs && refine the variable names
Suchun-sv 8444f5e
update design for cache to support extension
Suchun-sv a655bc4
Merge branch 'alibaba:main' into main
Suchun-sv 57bc863
Merge branch 'alibaba:main' into feat/chroma
Suchun-sv d68fa88
Refined the code; README.md content needs to be updated.
Suchun-sv d6c643f
add: makefile for weaviate
EnableAsync 3f3a1bc
feat: add weaviate
EnableAsync 71cc25b
feat: add pinecone
EnableAsync 5179392
fix bugs, README.md to be updated
Suchun-sv ece7e2f
fix bugs, refine variable name, update README.md
Suchun-sv e868a1a
Merge branch 'alibaba:main' into main
Suchun-sv 138a526
delete folder
Suchun-sv 65aafbd
Merge branch 'feat/chroma' of https://github.com/Suchun-sv/higress in…
EnableAsync bfaed4c
fix: format
EnableAsync e8ad550
fix typos
Suchun-sv 95b06b7
Merge branch 'alibaba:main' into feat/chroma
Suchun-sv a40f5e9
update
EnableAsync c83f5c4
fix typos
Suchun-sv f3d3292
change append to appendMsg
Suchun-sv b0cf29d
fix bugs and refine code
Suchun-sv 4a18f96
Merge branch 'main' into main
Suchun-sv 21c9a79
fix bugs and update the SetEx function
Suchun-sv 1767896
Merge branch 'main' into main
Suchun-sv 71b9530
Optimize query flow logic (not fully tested)
Suchun-sv 51b9ccc
Fix bugs and verify removal of cache setting
Suchun-sv 3583bc9
fix bugs and update logic as requested
Suchun-sv 10cc7ef
Merge branch 'main' into main
Suchun-sv 36ca3f1
Merge branch 'alibaba:main' into main
Suchun-sv c261583
add cacheKeyStrategy and enableSemanticCache
Suchun-sv fa22d63
add cacheKeyStrategy and enableSemanticCache
Suchun-sv 9145132
Vector or cache database must be configured
Suchun-sv ef443bf
new version envoy
EnableAsync 14a2a3d
fix: GetContext type
EnableAsync b862ef9
feat: chroma
EnableAsync 7bc5f65
merge
EnableAsync 303f6ed
feat: weaviate
EnableAsync fb2c26c
fix: clean useless code
EnableAsync 8486555
fix: clean useless code
EnableAsync e9a14d8
feat: es
EnableAsync 32eccd7
feat: pinecone
EnableAsync e6f700c
feat: chroma dasvector es pinecone weaviate
EnableAsync 02bc9a2
Merge remote-tracking branch 'origin/main' into feat/chroma
EnableAsync 440cd8d
fix: bugs
EnableAsync 628b74b
fix: bugs
EnableAsync 342bd94
fix: remove uesless files
EnableAsync cbeb71b
fix: remove uesless files
EnableAsync 43cfdaf
feat: qdrant
EnableAsync 2a4363a
feat: milvus
EnableAsync 9603479
feat: custom threshold
EnableAsync 3d615cc
feat: custom threshold
EnableAsync 558e75e
fix: code format
EnableAsync 2cfcda6
add ai cache test
Suchun-sv 4caf9be
update test
Suchun-sv d04d78a
fix bugs
Suchun-sv 81bde6d
update
EnableAsync ea34f4a
fix: bugs
EnableAsync 784740f
Merge branch 'main' into main
Suchun-sv f5b50fd
add support for skip-cache
Suchun-sv a1fe701
update README.md and change to FQDNCluster
Suchun-sv 730d951
change to FQDNCluster
Suchun-sv 335c04c
provide support for the legacy configuration
Suchun-sv 59bddf6
simplify resp func, add func name when debug
Suchun-sv e4901d9
Merge branch 'alibaba:main' into main
Suchun-sv 36f0d77
change *.typ to *
Suchun-sv 009a1b1
add support for legacy config
Suchun-sv 4515f43
update content_type in stream resp
Suchun-sv c048280
fix bugs
Suchun-sv 0ec24f3
add support for legacy configuration
Suchun-sv a658bfe
fix bugs
Suchun-sv a199144
handle the data: [DONE] and return in escaped string
Suchun-sv 77f05d6
dont read resp when ERROR_PARTIAL_MESSAGE_KEY not nil
Suchun-sv 28c629c
Update redis_wrapper.go
CH3CHO bd84cd0
merge
EnableAsync d9ce358
merge
EnableAsync 4a95557
update: README.md
EnableAsync 04f288c
merge
EnableAsync 902d810
fix: READMME.md
EnableAsync a1a7eef
Update README.md
EnableAsync d1b99b3
Merge remote-tracking branch 'my/feat/chroma' into feat/chroma
EnableAsync 6a782a4
update
EnableAsync 014d3ea
update
EnableAsync 134aecc
Merge branch 'main' into feat/chroma
CH3CHO File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file was deleted.
Oops, something went wrong.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
这个 Weaviate 里好像是叫 class,不叫 collection。
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
其他几个 provider 的对应描述也调整一下吧。需要告知用户实际创建的是什么,需要把什么填入 collectionId 配置里。