Skip to content
Back to pull request #27036

text-splitters[minor]: Ability to Passing a Tokenizer directly to TokenTextSplitter and updating from_tiktoken_encoder, from_huggingface_tokenizer #30972

Sign in to view logs

text-splitters[minor]: Ability to Passing a Tokenizer directly to TokenTextSplitter and updating from_tiktoken_encoder, from_huggingface_tokenizer

text-splitters[minor]: Ability to Passing a Tokenizer directly to TokenTextSplitter and updating from_tiktoken_encoder, from_huggingface_tokenizer #30972

cd libs/langchain  /  poetry run pytest -m compile tests/integration_tests #3.9

cd libs/langchain / poetry run pytest -m compile tests/integration_tests #3.9
succeeded Oct 2, 2024 in 18s