v0.5.0

Highlights

• No major change in using default parsers.
• If you're using a custom model, you need to update it. Read on the "Updating Models" section.
• The defineClassAs method in javascript/src/html_processor.ts is removed.

Updating Models

As described in #112, the model file structure has been updated for performance improvement and file size reduction. The change is simple; it just adds one layer depth by grouping features as the following example shows.

Before:

{"UW1:a": 123, "UW3:b": 271}

After:

{"UW1": {"a": 123}, "UW3": {"b": 271}}

You can update your custom model to the latest by running scripts/translate_model.py.

$ python translate_model.py --format=json old-model.json > new-model.json

What's Changed

• Nit fix on some test descriptions by @tushuhei in #109
• Delete unused tsconfig by @tushuhei in #110
• Add unit test for Web Components by @tushuhei in #111
• Update the model structure for faster processing by @tushuhei in #112
• Refactor feature_extractor by @tushuhei in #113
• Use tempfile for unit test by @tushuhei in #114
• Add model translator for ICU by @tushuhei in #115
• Add a model format updater by @tushuhei in #117
• Remove defineClassAs function by @tushuhei in #119
• Remove unnecessary assertion by @tushuhei in #118
• Remove skip nodes data from JS by @tushuhei in #120
• Update the Prepare KNBC script to break chunks by specified sequences by @tushuhei in #121
• Update JA model by @tushuhei in #122
• Version Bump to 0.5.0 by @tushuhei in #123

Full Changelog: v0.4.1...v0.5.0