Skip to content

text-splitters[minor]: Ability to Passing a Tokenizer directly to TokenTextSplitter and updating from_tiktoken_encoder, from_huggingface_tokenizer #30972

text-splitters[minor]: Ability to Passing a Tokenizer directly to TokenTextSplitter and updating from_tiktoken_encoder, from_huggingface_tokenizer

text-splitters[minor]: Ability to Passing a Tokenizer directly to TokenTextSplitter and updating from_tiktoken_encoder, from_huggingface_tokenizer #30972

cd libs/partners/mongodb  /  make test # pydantic: ~=2.6.0, python: 3.11,

succeeded Oct 2, 2024 in 2m 25s