Thanks to visit codestin.com
Credit goes to github.com

Skip to content

Split ci into several jobs#5343

Merged
sw005320 merged 3 commits intoespnet:masterfrom
kan-bayashi:feat/split-ci-into-several-jobs
Jul 22, 2023
Merged

Split ci into several jobs#5343
sw005320 merged 3 commits intoespnet:masterfrom
kan-bayashi:feat/split-ci-into-several-jobs

Conversation

@kan-bayashi
Copy link
Member

@kan-bayashi kan-bayashi commented Jul 22, 2023

What?

  • Split CI into several jobs
    • test_python.sh -> test_python_espnet1.sh / test_python_espnet2.sh
    • test_shell.sh -> test_shell_espnet1.sh / test_shell_espnet2.sh
    • I found that the validation of configuraiton files in test_integration_espnet2.sh consume too much time so split it into test_integration_espnet2.sh and test_configuration_espnet2.sh.
  • Changed OS / version matrix
    • MacOS / Windows: check only installation
    • Cent / Debian: check except integration test
    • Ubuntu
      • ESPnet1 related job: pytest / bats / integration of espnet1
        • Run on only oldest and newest combiniation (3.7 + 1.10.2 & 3.10 + 1.13.1)
      • ESPnet2 related job: pytest / bats / integration of espnet2
        • Run on all supported pytorch with python 3.7
        • Run on all python version with newest pytorch 1.13.1
      • ESPnet2 configuration validation job: configuration check of espnet2
        • Run on only oldest and newest combiniation (3.7 + 1.10.2 & 3.19 + 1.13.1)

Why?

  • To reduce CI required time

See also

@kan-bayashi kan-bayashi changed the title split ci into several jobs Split ci into several jobs Jul 22, 2023
@mergify mergify bot added the CI Travis, Circle CI, etc label Jul 22, 2023
@mergify
Copy link
Contributor

mergify bot commented Jul 22, 2023

This pull request is now in conflict :(

@mergify mergify bot added the conflicts label Jul 22, 2023
@kan-bayashi kan-bayashi force-pushed the feat/split-ci-into-several-jobs branch from acd780c to 172b9e1 Compare July 22, 2023 10:52
@mergify mergify bot removed the conflicts label Jul 22, 2023
@kan-bayashi kan-bayashi marked this pull request as ready for review July 22, 2023 10:53
@kan-bayashi kan-bayashi marked this pull request as draft July 22, 2023 10:53
@kan-bayashi kan-bayashi marked this pull request as ready for review July 22, 2023 14:21
@kan-bayashi kan-bayashi reopened this Jul 22, 2023
@kan-bayashi kan-bayashi added auto-merge Enable auto-merge and removed auto-merge Enable auto-merge labels Jul 22, 2023
@mergify
Copy link
Contributor

mergify bot commented Jul 22, 2023

This pull request is now in conflict :(

@mergify mergify bot added the conflicts label Jul 22, 2023
@codecov
Copy link

codecov bot commented Jul 22, 2023

Codecov Report

Merging #5343 (a08f52c) into master (8ed5d5c) will increase coverage by 0.00%.
The diff coverage is n/a.

@@           Coverage Diff           @@
##           master    #5343   +/-   ##
=======================================
  Coverage   76.11%   76.11%           
=======================================
  Files         672      672           
  Lines       59859    59859           
=======================================
+ Hits        45561    45563    +2     
+ Misses      14298    14296    -2     
Flag Coverage Δ
test_configuration_espnet2 ∅ <ø> (?)
test_integration_espnet1 65.93% <ø> (ø)
test_integration_espnet2 47.92% <ø> (ø)
test_python ?
test_python_espnet1 20.51% <ø> (?)
test_python_espnet2 51.35% <ø> (?)
test_utils 23.17% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

see 1 file with indirect coverage changes

📣 We’re building smart automated test selection to slash your CI/CD build times. Learn more

@kan-bayashi kan-bayashi force-pushed the feat/split-ci-into-several-jobs branch from 172b9e1 to ab96124 Compare July 22, 2023 14:44
@mergify mergify bot removed the conflicts label Jul 22, 2023
@kan-bayashi kan-bayashi added the auto-merge Enable auto-merge label Jul 22, 2023
@sw005320 sw005320 merged commit 50ac0fc into espnet:master Jul 22, 2023
@kan-bayashi kan-bayashi deleted the feat/split-ci-into-several-jobs branch July 22, 2023 22:03
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

auto-merge Enable auto-merge CI Travis, Circle CI, etc Need review RFC

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants