v1.4.1

valeriansaliou · Aug 12, 2023 · d822f56 · d822f56
1 parent 12ea7e1
commit d822f56
Show file tree

Hide file tree

Showing 4 changed files with 199 additions and 164 deletions.
diff --git a/CHANGELOG.md b/CHANGELOG.md
@@ -1,6 +1,12 @@
 Sonic Changelog
 ===============
 
+## 1.4.1 (2023-08-12)
+
+### New Features
+
+* Added support for Japanese word segmentation in tokenizer (note that as this adds quite some size overhead to the final binary size, the feature `tokenizer-japanese` can be disabled when building Sonic) [[@nmkj-io](https://github.com/nmkj-io), [#311](https://github.com/valeriansaliou/sonic/pull/311)].
+
 ## 1.4.0 (2022-10-20)
 
 ### Bug Fixes