Skip to content

Actions: huggingface/tokenizers

Build documentation

Actions

Loading...
Loading

Show workflow options

Create status badge

Loading
110 workflow runs
110 workflow runs

Filter by Event

Filter by Status

Filter by Branch

Filter by Actor

Clippy.
Build documentation #179: Commit 99a48dc pushed by Narsil
August 6, 2024 08:48 1m 48s main
August 6, 2024 08:48 1m 48s
Fixing release CI strict (taken from safetensors).
Build documentation #178: Commit 7b80359 pushed by Narsil
August 6, 2024 07:11 2m 11s main
August 6, 2024 07:11 2m 11s
Revert "Using serde (serde_pyo3) to get __str__ and __repr__ easily."
Build documentation #177: Commit a010f6b pushed by Narsil
August 2, 2024 16:43 1m 57s main
August 2, 2024 16:43 1m 57s
Using serde (serde_pyo3) to get __str__ and __repr__ easily.
Build documentation #176: Commit 8613833 pushed by Narsil
August 2, 2024 16:42 2m 3s main
August 2, 2024 16:42 2m 3s
Enabling the option to use fancy_regex instead of onig.
Build documentation #175: Commit 7415e28 pushed by Narsil
August 1, 2024 13:53 1m 55s main
August 1, 2024 13:53 1m 55s
Small performance fixup (negligible but obviously better).
Build documentation #174: Commit 9e0c791 pushed by Narsil
August 1, 2024 13:52 1m 59s main
August 1, 2024 13:52 1m 59s
Fixing the benchmark. (#1583)
Build documentation #173: Commit c6f2c0b pushed by Narsil
August 1, 2024 08:36 1m 59s main
August 1, 2024 08:36 1m 59s
Add benchmark vs tiktoken (#1582)
Build documentation #172: Commit 35f338a pushed by Narsil
July 31, 2024 15:09 1m 58s main
July 31, 2024 15:09 1m 58s
dump spm_precompiled to 0.1.3 (#1571)
Build documentation #171: Commit aface7a pushed by Narsil
July 31, 2024 13:38 2m 11s main
July 31, 2024 13:38 2m 11s
Fix clippy + feature test management. (#1580)
Build documentation #170: Commit a3ad85b pushed by Narsil
July 26, 2024 10:16 1m 49s main
July 26, 2024 10:16 1m 49s
Add bytelevel normalizer to fix decode when adding tokens to BPE (#1555)
Build documentation #169: Commit 4ea2f23 pushed by ArthurZucker
July 15, 2024 10:12 1m 59s main
July 15, 2024 10:12 1m 59s
Revert "[BREAKING CHANGE] Ignore added_tokens (both special and not) …
Build documentation #168: Commit f2a44dc pushed by ArthurZucker
July 12, 2024 05:29 1m 41s main
July 12, 2024 05:29 1m 41s
Enable dropout = 0.0 as an equivalent to none in BPE (#1550)
Build documentation #167: Commit fdd26ba pushed by ArthurZucker
June 24, 2024 10:36 1m 56s main
June 24, 2024 10:36 1m 56s
make sure we don't warn on empty tokens (#1554)
Build documentation #166: Commit 9441f7e pushed by ArthurZucker
June 20, 2024 12:33 2m 2s main
June 20, 2024 12:33 2m 2s
Fix clippy
Build documentation #165: Commit 3e736bb pushed by ArthurZucker
June 20, 2024 07:39 2m 30s main
June 20, 2024 07:39 2m 30s
Fix 'dictionnary' typo (#1511)
Build documentation #164: Commit 1ff56c0 pushed by ArthurZucker
June 11, 2024 13:43 1m 52s main
June 11, 2024 13:43 1m 52s
Switch from cached_download to hf_hub_download in tests (#1547)
Build documentation #163: Commit 88f51fe pushed by Wauplin
June 11, 2024 13:27 1m 43s main
June 11, 2024 13:27 1m 43s
feat(ci): add trufflehog secrets detection (#1551)
Build documentation #162: Commit 418c35c pushed by McPatate
June 10, 2024 14:10 2m 44s main
June 10, 2024 14:10 2m 44s
Fixing for clippy 1.78 (#1548)
Build documentation #161: Commit 8d28dbe pushed by Narsil
June 6, 2024 11:19 1m 59s main
June 6, 2024 11:19 1m 59s
Make USED_PARALLELISM atomic (#1532)
Build documentation #160: Commit bfefcf6 pushed by Narsil
June 6, 2024 11:02 1m 44s main
June 6, 2024 11:02 1m 44s
[BREAKING CHANGE] Ignore added_tokens (both special and not) in the d…
Build documentation #159: Commit 25aee8b pushed by Narsil
May 6, 2024 09:49 1m 54s main
May 6, 2024 09:49 1m 54s
remove enforcement of non special when adding tokens (#1521)
Build documentation #158: Commit f2ec3b2 pushed by ArthurZucker
April 30, 2024 13:53 1m 53s main
April 30, 2024 13:53 1m 53s
update dev version so 0.19.1
Build documentation #157: Commit 71c2a8d pushed by ArthurZucker
April 17, 2024 21:17 4m 35s main
April 17, 2024 21:17 4m 35s
add serialization for ignore_merges (#1504)
Build documentation #156: Commit 7733bc2 pushed by Narsil
April 17, 2024 19:56 4m 13s main
April 17, 2024 19:56 4m 13s
Fixing doc. (#1499)
Build documentation #155: Commit 91393ef pushed by Narsil
April 17, 2024 07:32 4m 27s main
April 17, 2024 07:32 4m 27s