-
Notifications
You must be signed in to change notification settings - Fork 6.6k
chore(run/jobs): add retries for flaky Cloud Builds #8491
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM
Would |
run/jobs/e2e_test.py
Outdated
built = True | ||
except Exception as e: | ||
print(e) | ||
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Are there any cleanups that needs to be done, possibly in a finally
clause?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
See other thread. 🙂
run/jobs/e2e_test.py
Outdated
] | ||
) | ||
destroyed = False | ||
for x in range(3): |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Same 3 concerns as above! (backoff, exception, and cleanup using finally)
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This step looks like the clean-up step for the previous one.
In any case - is a finally
clause required if we're working with backoff
?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
It's a bit tricky in this case actually - I'm not sure what would be the best approach if teardown
were to throw errors. In other cases I'd suggest finally
to clean up but fine to leave it as is here.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thank you!
Fixes #8465