Thanks to visit codestin.com
Credit goes to github.com

Skip to content

Linux framework_tests_libraries is 2.15% flaky #167640

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
fluttergithubbot opened this issue Apr 23, 2025 · 2 comments
Open

Linux framework_tests_libraries is 2.15% flaky #167640

fluttergithubbot opened this issue Apr 23, 2025 · 2 comments
Assignees
@Piinks
Labels
c: flake Tests that sometimes, but not always, incorrectly pass P1 High-priority issues at the top of the work list team-framework Owned by Framework team triaged-framework Triaged by Framework team

Comments

@fluttergithubbot
Copy link
Contributor

The post-submit test builder Linux framework_tests_libraries had a flaky ratio 2.15% for the past (up to) 100 commits, which is above our 2.00% threshold.

One recent flaky example for a same commit: https://ci.chromium.org/ui/p/flutter/builders/prod/Linux%20framework_tests_libraries/22107
Commit: ffa1891

Flaky builds:
https://ci.chromium.org/ui/p/flutter/builders/prod/Linux%20framework_tests_libraries/22107
https://ci.chromium.org/ui/p/flutter/builders/prod/Linux%20framework_tests_libraries/22075

Recent test runs:
https://flutter-dashboard.appspot.com/#/build?taskFilter=Linux%20framework_tests_libraries

Please follow https://github.com/flutter/flutter/blob/master/docs/infra/Reducing-Test-Flakiness.md#fixing-flaky-tests to fix the flakiness and enable the test back after validating the fix (internal dashboard to validate: go/flutter_test_flakiness).
@fluttergithubbot fluttergithubbot added c: flake Tests that sometimes, but not always, incorrectly pass P0 Critical issues such as a build break or regression team-framework Owned by Framework team labels Apr 23, 2025
@justinmc justinmc added the triaged-framework Triaged by Framework team label Apr 29, 2025
@Piinks
Copy link
Contributor

Piinks commented Apr 29, 2025

Both of these were separate golden file test failures in post submit. I don't see these images being triaged around that time, so it could be these image tests are potentially flaky.
Will continue to monitor to see if this recurs.

@Piinks Piinks added P1 High-priority issues at the top of the work list triaged-framework Triaged by Framework team and removed P0 Critical issues such as a build break or regression triaged-framework Triaged by Framework team labels Apr 29, 2025
@fluttergithubbot
Copy link
Contributor Author

[prod pool] flaky ratio for the past (up to) 100 commits between 2025-04-30 and 2025-05-06 is 1.01%. Flaky number: 1; total number: 99.
One recent flaky example for a same commit: https://ci.chromium.org/ui/p/flutter/builders/prod/Linux%20framework_tests_libraries/22327,%2022326,%2022325
Commit: 87753f3
Flaky builds:
https://ci.chromium.org/ui/p/flutter/builders/prod/Linux%20framework_tests_libraries/22327
https://ci.chromium.org/ui/p/flutter/builders/prod/Linux%20framework_tests_libraries/22326
https://ci.chromium.org/ui/p/flutter/builders/prod/Linux%20framework_tests_libraries/22325

Recent test runs:
https://flutter-dashboard.appspot.com/#/build?taskFilter=Linux%20framework_tests_libraries

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@Piinks Piinks

Labels
c: flake Tests that sometimes, but not always, incorrectly pass P1 High-priority issues at the top of the work list team-framework Owned by Framework team triaged-framework Triaged by Framework team
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@justinmc @Piinks @fluttergithubbot