Thanks to visit codestin.com
Credit goes to github.com

Skip to content

Add a new SE recipe combining five public corpora#5484

Merged
sw005320 merged 3 commits intoespnet:masterfrom
Emrys365:tse
Oct 23, 2023
Merged

Add a new SE recipe combining five public corpora#5484
sw005320 merged 3 commits intoespnet:masterfrom
Emrys365:tse

Conversation

@Emrys365
Copy link
Collaborator

@Emrys365 Emrys365 commented Oct 18, 2023 •
edited
Loading

What?

This PR adds a new speech enhancement recipe egs2/universal_se/enh1 that combines five public corpora for training and evaluation:

Dataset Category #samples Duration Note
VoiceBank+DEMAND 1ch, 48kHz 10802 8.8h w/o reverb
DNS Interspeech 2020 1ch, 16kHz 10800 90h w/o reverb
WHAMR! (max) 2ch, 16kHz 20000 × 2 58h × 2 anechoic+reverb
CHiME-4 5ch, 16kHz 7137 (SIMU) 15.1h slight reverb
REVERB 8ch, 16kHz 7861 (SIMU) 15.5h reverb

Why?

This PR aims to reproduce the experiments mentioned in a recent paper "Toward Universal Speech Enhancement for Diverse Input Conditions" (Table 4).

See also

https://arxiv.org/abs/2309.17384

#5482

@Emrys365 Emrys365 added Recipe ESPnet2 SE Speech enhancement labels Oct 18, 2023
@mergify mergify bot added the README label Oct 18, 2023
@codecov
Copy link

codecov bot commented Oct 18, 2023 •
edited
Loading

Codecov Report

Merging #5484 (b73ccb7) into master (4a4c8d5) will increase coverage by 0.29%.
Report is 23 commits behind head on master.
The diff coverage is n/a.

@@            Coverage Diff             @@
##           master    #5484      +/-   ##
==========================================
+ Coverage   75.07%   75.37%   +0.29%     
==========================================
  Files         709      709              
  Lines       65290    65291       +1     
==========================================
+ Hits        49017    49212     +195     
+ Misses      16273    16079     -194
Flag Coverage Δ
test_configuration_espnet2 ∅ <ø> (∅)
test_integration_espnet1 65.67% <ø> (+0.14%) ⬆️
test_integration_espnet2 48.71% <ø> (ø)
test_python_espnet1 19.16% <ø> (-0.01%) ⬇️
test_python_espnet2 51.40% <ø> (+0.11%) ⬆️
test_utils 23.10% <ø> (?)

Flags with carried forward coverage won't be shown. Click here to find out more.

see 16 files with indirect coverage changes

📣 We’re building smart automated test selection to slash your CI/CD build times. Learn more

@sw005320 sw005320 added this to the v.202312 milestone Oct 20, 2023
@sw005320
Copy link
Contributor

sw005320 commented Oct 20, 2023

LGTM.
My only comment is the recipe name.
The design of the corpora can be changed in the future
How about calling it universal_se_v1?
Please also add the description (which corpora are combined) to https://github.com/espnet/espnet/blob/master/egs2/README.md

@Emrys365
Copy link
Collaborator Author

Emrys365 commented Oct 22, 2023

Thanks! I have renamed the recipe and added it to egs2/README.md.

@sw005320 sw005320 merged commit 6d05a75 into espnet:master Oct 23, 2023
@sw005320
Copy link
Contributor

sw005320 commented Oct 23, 2023

Thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

ESPnet2 README Recipe SE Speech enhancement

Projects

None yet

Milestone

v.202310

Development

Successfully merging this pull request may close these issues.

2 participants

@Emrys365 @sw005320