Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

vector store + integration #864

Open
2 of 5 tasks
skyzh opened this issue Jan 8, 2025 · 1 comment
Open
2 of 5 tasks

vector store + integration #864

skyzh opened this issue Jan 8, 2025 · 1 comment

Comments

@skyzh
Copy link
Member

skyzh commented Jan 8, 2025 •
edited
Loading

  • vector type
  • vector functions
  • vector storage format
  • vector indexes
  • integration with langchain (WIP)
@skyzh
Copy link
Member Author

skyzh commented Jan 8, 2025

misc:

  • create table if not exists
  • more efficient insert into statements via python interface (passing string is slow)

@skyzh skyzh mentioned this issue Jan 8, 2025
Merged
github-merge-queue bot pushed a commit that referenced this issue Jan 11, 2025
@skyzh
feat(binder): support create index statements (#865)
423d0e9 
part of #864

Add `create index` support. No indexes are created for now. It only
modifies the catalog. All storage engines now use a shared submodule
called `index` to manage in-memory indexes.

---------

Signed-off-by: Alex Chi Z <[email protected]>
Signed-off-by: Alex Chi <[email protected]>
This was referenced Jan 19, 2025
Merged
Merged
Merged
Merged
github-merge-queue bot pushed a commit that referenced this issue Jan 26, 2025
@skyzh
feat(array): use fixed chunk array for vectors (#869)
210c770 
requires: #866

This patch adds a new array type for vector arrays.

The array stores primitive type chunks of the same length. Trying to
inserting chunks of different sizes will panic.

#864

---------

Signed-off-by: Alex Chi Z <[email protected]>
github-merge-queue bot pushed a commit that referenced this issue Jan 26, 2025
@skyzh @wangrunji0408
feat(storage): support vector block (#871)
1d646b8 
We added a new block type that stores fixed-size chunk data. The
in-memory array type is added in
#869.

#864

---------

Signed-off-by: Alex Chi Z <[email protected]>
Signed-off-by: Runji Wang <[email protected]>
Signed-off-by: Alex Chi <[email protected]>
Co-authored-by: Runji Wang <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@skyzh