chore(deps): update tokenizers optional requirement from 0.14.1 to 0.…

…15.0 (#38)

Updates the requirements on [tokenizers](https://github.com/huggingface/tokenizers) to permit the latest version.
- [Release notes](https://github.com/huggingface/tokenizers/releases)
- [Changelog](https://github.com/huggingface/tokenizers/blob/main/RELEASE.md)
- [Commits](huggingface/tokenizers@v0.14.1...v0.15.0)

---
updated-dependencies:
- dependency-name: tokenizers
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

Cargo.toml

@@ -26,7 +26,7 @@ rand = { version = "0.8.5", optional = true }
 [dev-dependencies]
 rand = "0.8.5"
 criterion = "0.5.1"
-tokenizers = "0.14.1"
+tokenizers = "0.15.0"
 
 [[bench]]
 name = "tokenize"