Releases: jpreprocess/jpreprocess
Releases · jpreprocess/jpreprocess
v0.12.0
Breaking Changes
Continuous Integration
Commits
v0.11.0
Main Breaking Changes
jpreprocess
Crate:
- The type variable trait for
JPreprocess
has been changed fromDictionaryFetcher
toTokenizer
. If you are usingJPreprocess<DefaultFetcher>
, replace it withJPreprocess<DefaultTokenizer>
. - The method
JPreprocess::with_dictionary_fetcher
has been removed. For advanced use cases that previously requiredwith_dictionary_fetcher
, usefrom_tokenizer
instead, though some modifications are required. UserDictionary
type is nowserde_json::Value
.
jpreprocess-dictionary
Crate:
- The
DictionaryFetcher
andDictionaryStore
traits have been removed. TheTokenizer
andToken
traits will now serve a similar purpose, allowing precise control over dictionary loading behavior, but they require additional implementation for the tokenization step. - The
DefaultFetcher
has been removed. TheDefaultTokenizer
provides almost the same functionality but does not detect older dictionaries.
jpreprocess-njd
Crate:
- The function signature of
NJD::from_tokens
has been changed to accept any type implementing theToken
trait, and it no longer requiresDictionaryFetcher
as an argument. - The
NJDNode::load
method now acceptsWordEntry
by immutable borrow.
jpreprocess-dictionary-builder
Crate:
This crate was removed and moved to jpreprocess-dictionary
.
Bug Fixes
- Fix unvoiced vowel of "Shi" mora (#399) #399 (phenylshima)
Code Refactoring
- Jpreprocess serializer (#413) #413 (phenylshima)
Chores
Commits
- 0b18359: Update Rust crate clap to v4.5.16 (#372) (renovate[bot]) #372
- 9481fe9: Update Rust crate serde to v1.0.209 (#373) (renovate[bot]) #373
- b59a67e: Update dtolnay/rust-toolchain digest to 7b1c307 (#375) (renovate[bot]) #375
- 143d8b7: Update Rust crate flate2 to v1.0.33 (#374) (renovate[bot]) #374
- 13adfa5: Update actions/setup-python action to v5.2.0 (#376) (renovate[bot]) #376
- 178bf2c: Update actions/upload-artifact action to v4.4.0 (#377) (renovate[bot]) #377
- ba07482: fix clippy (#390) (phenylshima) #390
- a8a4a5d: Update uraimo/run-on-arch-action action to v2.8.1 (#393) (renovate[bot]) #393
- 65d580b: refactor!: Merge dictionary builder into dictionary (#396) (phenylshima) #396
- 92cd3f3: move DictionarySerializer to serializer (#398) (phenylshima) #398
- 73561a8: refactor!: Remove DictionaryFetcher and DictionaryStore, and move to Tokenizer (#397) (phenylshima) #397
- 56da74a: Update actions/setup-node action to v4.2.0 (#389) (renovate[bot]) #389
- 3323a56: refactor!: Update lindera (#401) (phenylshima) #401
- a22e9cf: Parse as many moras as possible from string in njd_set_pronunciation (#412) (phenylshima) #412
- 00d8b33: Fix binaries (#414) (phenylshima) #414
- dce6d29: Add unit tests for njd (#415) (phenylshima) #415
- 8cc1e25: remove unused deps (#417) (phenylshima) #417
- 0ba8907: update pyo3 to 0.23 (#416) (phenylshima) #416
- ef0a7f6: V0.11.0 (#418) (phenylshima) #418
v0.10.0
Features
Commits
- 0ad44ef: Update Rust crate flate2 to v1.0.30 (#326) (renovate[bot]) #326
- 9abb6e5: Update uraimo/run-on-arch-action action to v2.7.2 (#325) (renovate[bot]) #325
- 3d67ab6: Update actions/checkout action to v4.1.4 (#322) (renovate[bot]) #322
- 0ddd9c6: Update actions/upload-artifact action to v4.3.3 (#324) (renovate[bot]) #324
- 47a27b4: Update actions/download-artifact action to v4.1.7 (#323) (renovate[bot]) #323
- 55ed1f5: Update PyO3/maturin-action action to v1.42.2 (#317) (renovate[bot]) #317
- e113080: Update Rust crate serde to v1.0.201 (#321) (renovate[bot]) #321
- e3b3fa4: supress empty-doc-comment by adding doc comment (#339) (phenylshima) #339
- fbc1f81: migrate renovate config (#327) (Mogyuchi) #327
- dd09c89: remove implicit features (#330) (phenylshima) #330
- fecac2e: update lindera to 0.31 (#338) (phenylshima) #338
- a2c749f: Update dtolnay/rust-toolchain digest to d8352f6 (#316) (renovate[bot]) #316
- aeebcd4: fix
legacy numeric constants
clippy warning (#343) (phenylshima) #343 - b5b55e7: Update Rust crate log to v0.4.22 (#344) (renovate[bot]) #344
- 15131f6: Update Rust crate regex to v1.10.5 (#342) (renovate[bot]) #342
- d14996f: Update Rust crate tar to v0.4.41 (#341) (renovate[bot]) #341
- edb6831: Update Rust crate clap to v4.5.8 (#340) (renovate[bot]) #340
- e96a0d3: Update actions/checkout action to v4.1.7 (#332) (renovate[bot]) #332
- ae71fb0: Update Rust crate serde to v1.0.203 (#331) (renovate[bot]) #331
- 96a29bf: Update Rust crate thiserror to v1.0.61 (#329) (renovate[bot]) #329
- 17502fa: Update Rust crate anyhow to v1.0.86 (#328) (renovate[bot]) #328
- 5f7c2a5: update lindera to 0.32 (#348) (phenylshima) #348
- 669971a: Update PyO3/maturin-action action to v1.44.0 (#333) (renovate[bot]) #333
- a48dcd7: Update Rust crate thiserror to v1.0.63 (#358) (renovate[bot]) #358
- 5070eb3: Update Rust crate clap to v4.5.9 (#357) (renovate[bot]) #357
- 44724ca: Update Rust crate serde to v1.0.204 (#356) (renovate[bot]) #356
- b03a731: Update Rust crate ureq to v2.10.0 (#355) (renovate[bot]) #355
- 7f2f9ca: Update pnpm/action-setup action to v4 (#354) (renovate[bot]) #354
- 0cda859: Update actions/upload-artifact action to v4.3.4 (#353) (renovate[bot]) #353
- e8e1d5f: Update actions/download-artifact action to v4.1.8 (#352) (renovate[bot]) #352
- b754771: Update dtolnay/rust-toolchain digest to 21dc36f (#351) (renovate[bot]) #351
- 6e08d1c: Move test to a dedicated crate (#359) (phenylshima) #359
- 8fe140d: Currency filter (#311) (phenylshima) #311
- ffb52cc: fix naist-jdic test (#366) (phenylshima) #366
- 9ba81af: Refactor digit (#309) (phenylshima) #309
- d78c797: Update Rust crate flate2 to v1.0.31 (#365) (renovate[bot]) #365
- 880ce40: Update actions/upload-artifact action to v4.3.5 (#364) (renovate[bot]) #364
- 9c175cd: Update actions/setup-python action to v5.1.1 (#363) (renovate[bot]) #363
- eb25ec2: Update actions/setup-node action to v4.0.3 (#362) (renovate[bot]) #362
- d12f412: Update Rust crate regex to v1.10.6 (#361) (renovate[bot]) #361
- 50e4d59: Update Rust crate clap to v4.5.13 (#360) (renovate[bot]) #360
- 896ba6a: Update dependencies (non-major) to 0.22.0 (#345) (renovate[bot]) #345
- 0e41856: Update Rust crate clap to v4.5.15 (#367) (renovate[bot]) #367
- 698012e: Update Rust crate serde to v1.0.207 (#368) (renovate[bot]) #368
- 8a8774c: Update Rust crate ureq to v2.10.1 (#369) (renovate[bot]) #369
- 3956033: v0.10.0/py-0.1.4 (#370) (phenylshima) #370
v0.9.1
Commits
- e21b757: Binstall support (#301) (phenylshima) #301
- 7eeb6b2: update naist-jdic (#302) (phenylshima) #302
- da39d87: fix Display impl for
名詞,*,*,*
(#310) (phenylshima) #310 - 708bb6d: Fix accent_type rustdoc (#303) (phenylshima) #303
- 46b5f7c: refactor core Display implementations (#312) (phenylshima) #312
- 3689b7c: Update Rust crate pyo3 to 0.21.2 (#304) (renovate[bot]) #304
- cee0ad8: Update Rust crate serde to 1.0.199 (#305) (renovate[bot]) #305
- 4acd8d4: Update Rust crate thiserror to 1.0.59 (#306) (renovate[bot]) #306
- 22b9258: Update Rust crate flate2 to 1.0.29 (#307) (renovate[bot]) #307
- b631947: Update Rust crate ureq to 2.9.7 (#308) (renovate[bot]) #308
- efbb12c: v0.9.1 (#313) (phenylshima) #313
- 52f0e9f: update naist-jdic (#315) (phenylshima) #315
- 2bf92cb: update python package version (#314) (phenylshima) #314
v0.9.1-alpha.0
Commits
- f1ede6e: support binstall (femshima) #301
- b8dff7e: execute workflow (femshima) #301
- c187fbe: fix (femshima) #301
- 4b09ae9: fix (femshima) #301
- d9c6fc0: windows vs linux (femshima) #301
- 47064fa: fix again (femshima) #301
- 62ac73c: fix artifact name (femshima) #301
- ad6e9ec: tgz (femshima) #301
- 47646d2: fix naist-jdic (femshima) #301
- cd8676c: remove hyphen (femshima) #301
- 8d2e74f: fix archive name (femshima) #301
- 2e0ffcd: remove debug (femshima) #301
v0.9.0
Commits
- 1f3350d: Update Rust crate rayon to 1.10 (#282) (renovate[bot]) #282
- 352c1a6: Update Rust crate clap to 4.5.4 (#284) (renovate[bot]) #284
- 92e6c3e: Update Rust crate jlabel to 0.1.4 (#285) (renovate[bot]) #285
- 8b265cd: Update dtolnay/rust-toolchain digest to dc63535 (#287) (renovate[bot]) #287
- a63666a: Update dependencies (non-major) to 0.21.1 (#286) (renovate[bot]) #286
- 5d57339: Update actions/setup-python action to v5.1.0 (#288) (renovate[bot]) #288
- 5912088: update lindera to 0.30 (#294) (phenylshima) #294
- 4d20a27: Refactor njd (#295) (phenylshima) #295
- 8aac671: Update Rust crate anyhow to 1.0.82 (#289) (renovate[bot]) #289
- 7d7e058: add aarch64-unknown-linux-gnu build (#296) (cm-ayf) #296
- 30d596a: rename python binding (in Cargo.toml), while maintaining python module name (#298) (phenylshima) #298
- 044af6c: v0.9.0 (#297) (phenylshima) #297
- 8cd45f2: fix dict_tools (#299) (phenylshima) #299
v0.8.1
Commits
- 1dffe18: Update python binding (#262) (phenylshima) #262
- 48ebede: remove --manifest-path (#263) (phenylshima) #263
- 9693670: Update Rust crate jlabel to 0.1.3 (#269) (renovate[bot]) #269
- 1bd3256: Update Rust crate yada to 0.5.1 (#264) (renovate[bot]) #264
- 2723a96: Update Rust crate thiserror to 1.0.58 (#272) (renovate[bot]) #272
- 2a375c6: Update Rust crate anyhow to 1.0.81 (#271) (renovate[bot]) #271
- 1be98bb: Update actions/download-artifact action to v4.1.4 (#267) (renovate[bot]) #267
- 3ac0de8: Update Rust crate rayon to 1.9 (#268) (renovate[bot]) #268
- 42a29fc: Update Rust crate clap to 4.5.3 (#270) (renovate[bot]) #270
- d075f88: Update Rust crate log to 0.4.21 (#266) (renovate[bot]) #266
- 38c414e: better version specification in python ci (#273) (phenylshima) #273
- b2544a1: Update Rust crate regex to 1.10.4 (#276) (renovate[bot]) #276
- 31e04e0: update lindera to 0.29 (#279) (phenylshima) #279
- 0805d80: Update PyO3/maturin-action action to v1.42.0 (#281) (renovate[bot]) #281
- 9015672: v0.8.1 (#280) (phenylshima) #280
v0.8.0
Commits
- 86f732d: Update Rust crate ureq to 2.9.5 (#232) (renovate[bot]) #232
- f7562fd: Refactor[Part 1] jpreprocess-njd (#235) (phenylshima) #235
- 928ad57: Update dependencies (non-major) (#233) (renovate[bot]) #233
- 28e6082: Refactor[Part 2] error handling (#236) (phenylshima) #236
- 1647178: Update Rust crate ureq to 2.9.6 (#238) (renovate[bot]) #238
- 08698b5: Refactor[Part 3] Move
acc
andmora_size
to pronunciation (#239) (phenylshima) #239 - 8051c3f: better error handling of acc_morasize (#240) (phenylshima) #240
- f915579: Update dependencies (non-major) (#237) (renovate[bot]) #237
- 16936b4: move versions to workspace Cargo.toml (#241) (phenylshima) #241
- fb0d4d9: Add python binding (#234) (phenylshima) #234
- dc20906: Pin dependencies (#244) (renovate[bot]) #244
- e165dde: Update Rust crate serde to 1.0.197 (#242) (renovate[bot]) #242
- 23bd41a: Lindera 0.28 (#249) (phenylshima) #249
- 8359d3f: Update uraimo/run-on-arch-action action to v2.7.1 (#253) (renovate[bot]) #253
- 3a358e3: Update actions/download-artifact action to v4.1.2 (#250) (renovate[bot]) #250
- 643ea72: Update actions/setup-node action to v4.0.2 (#251) (renovate[bot]) #251
- 722290a: Update actions/upload-artifact action to v4.3.1 (#252) (renovate[bot]) #252
- bce268c: Update pnpm/action-setup action to v3 (#256) (renovate[bot]) #256
- f8b0723: Update actions/checkout action to v4 (#254) (renovate[bot]) #254
- c3ccbd2: Update GitHub Artifact Actions to v4 (major) (#257) (renovate[bot]) #257
- 446f404: Update actions/setup-python action to v5 (#255) (renovate[bot]) #255
- e898c0e: Update Rust crate pyo3 to 0.20.3 (#248) (renovate[bot]) #248
- b3a1008: fix readme example (#231) (phenylshima) #231
- dd8fadd: drop backward compatibility (#259) (phenylshima) #259
- e239ccf: v0.8.0 (#260) (phenylshima) #260
- 31babd5: fix cross build
python not found
error (#261) (phenylshima) #261
v0.7.0
There were breaking changes between v0.6.3 and v0.7.0.
For details, please see migration guide.
Commits
- cd0511c: Update Rust crate lindera-core to 0.27.2 (renovate[bot]) #213
- 49befc6: Update dtolnay/rust-toolchain digest to be73d79 (renovate[bot]) #214
- 8b5eccc: Update actions/setup-node action to v4.0.1 (renovate[bot]) #215
- 82189f2: Update actions/download-artifact action to v4 (renovate[bot]) #216
- e0de847: Update actions/upload-artifact action to v4 (renovate[bot]) #217
- 9aa99a5: Update dependencies (non-major) (renovate[bot]) #212
- 8d94011: clippy fix (femshima) #220
- c022206: Update dependencies (non-major) (renovate[bot]) #218
- 71d94df: remove env_logger (femshima) #218
- c15cb9c: Update Rust crate ureq to 2.9.4 (#223) (renovate[bot]) #223
- 8791a3f: Update actions/upload-artifact action to v4.3.0 (#228) (renovate[bot]) #228
- adab7db: Update actions/download-artifact action to v4.1.1 (#227) (renovate[bot]) #227
- 1b1fdf1: Update Swatinem/rust-cache action to v2.7.3 (#224) (renovate[bot]) #224
- 23f670d: unlock 形容詞・イイ (#229) (phenylshima) #229
- 93063ce: Remove
dyn
from structs (#222) (phenylshima) #222 - 5fe24f7: use jlabel on jpreprocess-jpcommon (#219) (cm-ayf) #219
- bbe827e: Add LRU example (#225) (phenylshima) #225
- 6dd0f4b: Update README (#226) (phenylshima) #226
- 1bebeae: v0.7.0 (#230) (phenylshima) #230