Thanks to visit codestin.com
Credit goes to github.com

Skip to content

Perf release gate #9068

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 11 commits into from
Jul 22, 2025
Merged

Perf release gate #9068

Changes from 1 commit
Commits
Show all changes
11 commits
Select commit Hold shift + click to select a range
fdd30e5
chore(ci): Basic slo breach prototype
bric3 Jun 30, 2025
6407c42
chore(ci): PR review
bric3 Jul 2, 2025
736aefd
chore: Collect reports from benchmarks
bric3 Jul 9, 2025
361aaf6
tweak: Include benchmarkType in file name
ddyurchenko Jul 11, 2025
92f9783
tweak: Store artifacts that were used for checking regression, so we …
ddyurchenko Jul 11, 2025
67435a9
chore(ci): Tweak thresholds
bric3 Jul 11, 2025
616ae97
chore(ci): Tweak to recommended thresholds
bric3 Jul 17, 2025
0708dfb
Merge remote-tracking branch 'origin/master' into bdu/r-gate
bric3 Jul 17, 2025
98f9a31
chore(ci): Another tweak to recommended thresholds
bric3 Jul 17, 2025
098e012
chore(ci): Revert hack to run the release gate (it needed the all mac…
bric3 Jul 17, 2025
df915f0
Merge branch 'master' into bdu/r-gate
ddyurchenko Jul 17, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
chore(ci): PR review
  • Loading branch information
@bric3
bric3 committed Jul 11, 2025
commit 6407c4230096a3eddc072c9ac39e736b2292c27f
9 changes: 1 addition & 8 deletions .gitlab/benchmarks/bp-runner.fail-on-breach.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,7 +1,4 @@
# Example of measurements can be seen here:
# https://benchmarking.us1.prod.dog/benchmarks?benchmarkGroupPipelineId=66629462&benchmarkGroupSha=16054515e292a66c5eaf79b9ea62df6f348cd67e&page=1&ciJobDateStart=1746309551994&ciJobDateEnd=1748901551994&benchmarkId=14167634

# Thresholds set based on guidance in https://datadoghq.atlassian.net/wiki/spaces/APMINT/pages/5070193198/How+to+set+up+pre-release+performance+quality+gates#How-to-choose-thresholds-for-pre-release-gates%3F
# Thresholds set based on guidance in https://datadoghq.atlassian.net/wiki/x/LgI1LgE#How-to-choose-thresholds-for-pre-release-gates%3F

experiments:
- name: Run SLO breach check
Expand All @@ -20,14 +17,10 @@ experiments:
- name: normal_operation/only-tracing
thresholds:
- agg_http_req_duration_p50 < 2.28 ms
- name: normal_operation/only-tracing
thresholds:
- agg_http_req_duration_p99 < 7.45 ms
- name: normal_operation/otel-latest
thresholds:
- agg_http_req_duration_p50 < 2.28 ms
- name: normal_operation/otel-latest
thresholds:
- agg_http_req_duration_p99 < 9.00 ms

- name: high_load/only-tracing
Expand Down