You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Currently if you upload the same document twice, it will create duplicated chunks of the same documents.
Before add a document to the database, we should remove all chunks related to the document using its filename as ID to avoid duplication and allow updates.
Tasks
Remove all chunks with the same filename of uploaded document in POST /documents
for Azure ComosDB for MongoDB vCore path
for FAISS path when running locally
The text was updated successfully, but these errors were encountered:
Currently if you upload the same document twice, it will create duplicated chunks of the same documents.
Before add a document to the database, we should remove all chunks related to the document using its filename as ID to avoid duplication and allow updates.
Tasks
The text was updated successfully, but these errors were encountered: