Thanks to visit codestin.com
Credit goes to github.com

Skip to content

[SVS] Add Joint-training#4977

Merged
ftshijt merged 11 commits intoespnet:masterfrom
A-Quarter-Mile:tmp_muskit
Mar 2, 2023
Merged

[SVS] Add Joint-training#4977
ftshijt merged 11 commits intoespnet:masterfrom
A-Quarter-Mile:tmp_muskit

Conversation

@A-Quarter-Mile
Copy link
Contributor

Hi @ftshijt, here are updates on Muskits.

  • Add joint-train for SVS. Prepare joint train config for Xiaoice and Naive_RNN_DP.
  • fix bugs in previous gan_svs.
  • fix a bug in data_prep for opencpop.

@mergify mergify bot added the ESPnet2 label Mar 2, 2023
@A-Quarter-Mile A-Quarter-Mile changed the title [SVS] Add joint train [SVS] Add Joint-training Mar 2, 2023
Copy link
Collaborator

@ftshijt ftshijt left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM! some minor comments for the part.

) -> Tuple[str, ...]:
if not inference:
retval = ("spembs", "durations", "pitch", "energy", "sids", "lids")
retval = ("spembs", "durations", "pitch", "energy", "sids", "lids", "feats")
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Probably, we do not need to add additional feats here but reuse the singing variable. We can have more discussion after the deadline for interspeech.

@codecov
Copy link

codecov bot commented Mar 2, 2023

Codecov Report

Merging #4977 (e19df1e) into master (2313feb) will decrease coverage by 0.15%.
The diff coverage is 12.34%.

@@            Coverage Diff             @@
##           master    #4977      +/-   ##
==========================================
- Coverage   77.10%   76.96%   -0.15%     
==========================================
  Files         604      606       +2     
  Lines       53613    53751     +138     
==========================================
+ Hits        41338    41368      +30     
- Misses      12275    12383     +108     
Flag Coverage Δ
test_integration_espnet1 66.33% <ø> (ø)
test_integration_espnet2 47.50% <ø> (ø)
test_python 66.84% <12.34%> (-0.12%) ⬇️
test_utils 23.35% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files Coverage Δ
espnet2/gan_svs/espnet_model.py 0.00% <0.00%> (ø)
espnet2/svs/espnet_model.py 8.64% <0.00%> (-0.70%) ⬇️
espnet2/svs/naive_rnn/naive_rnn_dp.py 10.92% <0.00%> (-0.70%) ⬇️
espnet2/svs/xiaoice/XiaoiceSing.py 11.94% <0.00%> (-0.76%) ⬇️
espnet2/tasks/gan_svs.py 0.00% <0.00%> (ø)
espnet2/gan_svs/joint/joint_score2wav.py 19.44% <19.44%> (ø)
espnet2/tasks/svs.py 46.95% <50.00%> (+0.32%) ⬆️
espnet2/gan_svs/joint/__init__.py 100.00% <100.00%> (ø)

📣 We’re building smart automated test selection to slash your CI/CD build times. Learn more

@ftshijt
Copy link
Collaborator

ftshijt commented Mar 2, 2023

LGTM! Let's work on the CI after the interspeech.

@ftshijt ftshijt merged commit 1bed2f9 into espnet:master Mar 2, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants