Thanks to visit codestin.com
Credit goes to github.com

Skip to content

Commit 3323a56

Browse files
phenylshimacm-ayf
andauthored
refactor!: Update lindera (#401)
* ignore min-dict/orig * update lindera * updates forced by lindera in jpreprocess-dictionary * add new to_dict copied and modified from lindera * migrate to new builder and fix tokenizer bugs * remove serializer * update on lindera for normal crates * update naist-jdic * update python and test * fix dict_tools and move it to jpreprocess-dictionary * update min-dict * fix naist-jdic * fix dictionary used in ci * update lindera to 0.39 * patch lindera * fix example-wasm * mark extention with backticks Co-authored-by: cm-ayf <[email protected]> * quit log crate in get_dict_preamble * add separator * implement new for JPreprocessDictionaryBuilder * DictionaryWordEncoder->DictionaryWordEncoding * fix clippy * remove log crate from DictionaryIdent --------- Co-authored-by: femshima <[email protected]> Co-authored-by: cm-ayf <[email protected]>
1 parent 56da74a commit 3323a56

File tree

48 files changed

+2194
-1590
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

48 files changed

+2194
-1590
lines changed

.cargo/config.toml

Lines changed: 7 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,7 @@
1+
[patch.crates-io.lindera]
2+
git = "https://github.com/jpreprocess/lindera.git"
3+
rev = "4203d3b21cc26ffa43018bc85aa0b6f3bcdf7a0e" # The latest commit in optional-default-assets branch
4+
5+
[patch.crates-io.lindera-dictionary]
6+
git = "https://github.com/jpreprocess/lindera.git"
7+
rev = "4203d3b21cc26ffa43018bc85aa0b6f3bcdf7a0e" # The latest commit in optional-default-assets branch

.github/workflows/publish.yml

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -21,7 +21,8 @@ jobs:
2121
chmod +x openjtalk_bin
2222
2323
gh release download --repo jpreprocess/jpreprocess v0.0.1-rc0
24-
tar xJvf dictionaries.tar.xz
24+
tar xJvf lindera.tar.xz
25+
tar xJvf mecab-naist-jdic.tar.xz
2526
2627
rm *.tar.gz *.tar.xz
2728
- name: Build

.github/workflows/rust.yml

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -30,7 +30,8 @@ jobs:
3030
chmod +x openjtalk_bin
3131
3232
gh release download --repo jpreprocess/jpreprocess v0.0.1-rc0
33-
tar xJvf dictionaries.tar.xz
33+
tar xJvf lindera.tar.xz
34+
tar xJvf mecab-naist-jdic.tar.xz
3435
3536
rm *.tar.gz *.tar.xz
3637

0 commit comments

Comments
 (0)