You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
what's the current recommended way to create a custom chunker ? If I understand correctly, one would have do the following:
In documentLoader.py -> add a new custom _FORMAT_PROCESSORS
create a customLoader that follows the ouput format of structuredLoader, like this:
docsList.append({str(uuid.uuid4()): {"content": doc.page_content, "metadata":doc.metadata}})
Currently, RAGE provides different chunking methods. An additional semantic chunking method should be added which should be configurable.
The text was updated successfully, but these errors were encountered: