Fix nightly pipeline #9368

sarahchen6 · 2025-08-15T13:53:56Z

What Does This Do

Allow publishing-gate job to run when POPULATE_CACHE is true because we promote OCI artifacts to staging during nightly builds: https://gitlab.ddbuild.io/DataDog/apm-reliability/dd-trace-java/-/pipeline_schedules?scope=ALL

Motivation

Fix the nightly pipeline failure: https://gitlab.ddbuild.io/DataDog/apm-reliability/dd-trace-java/-/pipelines/73766389

Additional Notes

I re-ran the nightly pipeline after this PR was merged, and it was successful: https://gitlab.ddbuild.io/DataDog/apm-reliability/dd-trace-java/-/pipelines/73812480

Contributor Checklist

Format the title according the contribution guidelines
Assign the type: and (comp: or inst:) labels in addition to any usefull labels
Don't use close, fix or any linking keywords when referencing an issue.
Use solves instead, and assign the PR milestone to the issue
Update the CODEOWNERS file on source file addition, move, or deletion
Update the public documentation in case of new configuration flag or behavior

Jira ticket: [PROJ-IDENT]

datadog-datadog-prod-us1 · 2025-08-15T14:14:07Z

Code coverage: total 57.30%, base diff 0.05%, patch 100.00% (view details)

_{This comment will be updated automatically if new data arrives.

🔗 Commit SHA: 065cd7e | Docs | Was this helpful? Give us feedback!}

pr-commenter · 2025-08-15T14:25:26Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	sarahchen6/fix-nightly
git_commit_date	1755212609	1755265920
git_commit_sha	`65b2349`	`065cd7e`
release_version	1.53.0-SNAPSHOT~65b2349214	1.53.0-SNAPSHOT~065cd7ee92

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1755267671	1755267671
ci_job_id	1082206328	1082206328
ci_pipeline_id	73794871	73794871
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-088f8xzc 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-088f8xzc 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 45 metrics, 14 unstable metrics.

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.53.0-SNAPSHOT~065cd7ee92, baseline=1.53.0-SNAPSHOT~65b2349214

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.051 s) : 0, 1051249
Total [baseline] (10.619 s) : 0, 10619410
Agent [candidate] (1.043 s) : 0, 1043343
Total [candidate] (10.689 s) : 0, 10688729
section appsec
Agent [baseline] (1.222 s) : 0, 1221946
Total [baseline] (10.724 s) : 0, 10724007
Agent [candidate] (1.221 s) : 0, 1220692
Total [candidate] (10.803 s) : 0, 10803300
section iast
Agent [baseline] (1.192 s) : 0, 1192332
Total [baseline] (10.937 s) : 0, 10936941
Agent [candidate] (1.185 s) : 0, 1185152
Total [candidate] (10.908 s) : 0, 10908090
section profiling
Agent [baseline] (1.192 s) : 0, 1191826
Total [baseline] (10.812 s) : 0, 10812015
Agent [candidate] (1.191 s) : 0, 1191487
Total [candidate] (10.941 s) : 0, 10941009

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.051 s	-
Agent	appsec	1.222 s	170.697 ms (16.2%)
Agent	iast	1.192 s	141.082 ms (13.4%)
Agent	profiling	1.192 s	140.576 ms (13.4%)
Total	tracing	10.619 s	-
Total	appsec	10.724 s	104.596 ms (1.0%)
Total	iast	10.937 s	317.53 ms (3.0%)
Total	profiling	10.812 s	192.604 ms (1.8%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.043 s	-
Agent	appsec	1.221 s	177.349 ms (17.0%)
Agent	iast	1.185 s	141.808 ms (13.6%)
Agent	profiling	1.191 s	148.144 ms (14.2%)
Total	tracing	10.689 s	-
Total	appsec	10.803 s	114.571 ms (1.1%)
Total	iast	10.908 s	219.361 ms (2.1%)
Total	profiling	10.941 s	252.28 ms (2.4%)

gantt
    title petclinic - break down per module: candidate=1.53.0-SNAPSHOT~065cd7ee92, baseline=1.53.0-SNAPSHOT~65b2349214

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.447 ms) : 0, 1447
crashtracking [candidate] (1.432 ms) : 0, 1432
BytebuddyAgent [baseline] (736.14 ms) : 0, 736140
BytebuddyAgent [candidate] (730.193 ms) : 0, 730193
GlobalTracer [baseline] (242.822 ms) : 0, 242822
GlobalTracer [candidate] (241.263 ms) : 0, 241263
AppSec [baseline] (30.375 ms) : 0, 30375
AppSec [candidate] (30.034 ms) : 0, 30034
Debugger [baseline] (6.035 ms) : 0, 6035
Debugger [candidate] (6.025 ms) : 0, 6025
Remote Config [baseline] (656.833 µs) : 0, 657
Remote Config [candidate] (639.294 µs) : 0, 639
Telemetry [baseline] (12.699 ms) : 0, 12699
Telemetry [candidate] (12.752 ms) : 0, 12752
section appsec
crashtracking [baseline] (1.438 ms) : 0, 1438
crashtracking [candidate] (1.436 ms) : 0, 1436
BytebuddyAgent [baseline] (754.616 ms) : 0, 754616
BytebuddyAgent [candidate] (752.207 ms) : 0, 752207
GlobalTracer [baseline] (235.642 ms) : 0, 235642
GlobalTracer [candidate] (235.48 ms) : 0, 235480
IAST [baseline] (23.597 ms) : 0, 23597
IAST [candidate] (23.843 ms) : 0, 23843
AppSec [baseline] (169.267 ms) : 0, 169267
AppSec [candidate] (170.251 ms) : 0, 170251
Debugger [baseline] (7.274 ms) : 0, 7274
Debugger [candidate] (6.561 ms) : 0, 6561
Remote Config [baseline] (620.88 µs) : 0, 621
Remote Config [candidate] (622.104 µs) : 0, 622
Telemetry [baseline] (8.41 ms) : 0, 8410
Telemetry [candidate] (9.262 ms) : 0, 9262
section iast
crashtracking [baseline] (1.436 ms) : 0, 1436
crashtracking [candidate] (1.448 ms) : 0, 1448
BytebuddyAgent [baseline] (862.069 ms) : 0, 862069
BytebuddyAgent [candidate] (856.672 ms) : 0, 856672
GlobalTracer [baseline] (234.574 ms) : 0, 234574
GlobalTracer [candidate] (233.719 ms) : 0, 233719
IAST [baseline] (28.733 ms) : 0, 28733
IAST [candidate] (27.562 ms) : 0, 27562
AppSec [baseline] (27.987 ms) : 0, 27987
AppSec [candidate] (27.515 ms) : 0, 27515
Debugger [baseline] (7.419 ms) : 0, 7419
Debugger [candidate] (8.211 ms) : 0, 8211
Remote Config [baseline] (592.805 µs) : 0, 593
Remote Config [candidate] (582.095 µs) : 0, 582
Telemetry [baseline] (8.42 ms) : 0, 8420
Telemetry [candidate] (8.314 ms) : 0, 8314
section profiling
crashtracking [baseline] (1.392 ms) : 0, 1392
crashtracking [candidate] (1.399 ms) : 0, 1399
BytebuddyAgent [baseline] (759.8 ms) : 0, 759800
BytebuddyAgent [candidate] (758.952 ms) : 0, 758952
GlobalTracer [baseline] (221.529 ms) : 0, 221529
GlobalTracer [candidate] (221.13 ms) : 0, 221130
AppSec [baseline] (29.837 ms) : 0, 29837
AppSec [candidate] (29.871 ms) : 0, 29871
Debugger [baseline] (6.256 ms) : 0, 6256
Debugger [candidate] (6.268 ms) : 0, 6268
Remote Config [baseline] (661.62 µs) : 0, 662
Remote Config [candidate] (662.656 µs) : 0, 663
Telemetry [baseline] (15.173 ms) : 0, 15173
Telemetry [candidate] (15.932 ms) : 0, 15932
ProfilingAgent [baseline] (107.881 ms) : 0, 107881
ProfilingAgent [candidate] (107.799 ms) : 0, 107799
Profiling [baseline] (108.509 ms) : 0, 108509
Profiling [candidate] (108.436 ms) : 0, 108436

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.53.0-SNAPSHOT~065cd7ee92, baseline=1.53.0-SNAPSHOT~65b2349214

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.045 s) : 0, 1045424
Total [baseline] (8.583 s) : 0, 8582599
Agent [candidate] (1.045 s) : 0, 1044945
Total [candidate] (8.596 s) : 0, 8596439
section iast
Agent [baseline] (1.172 s) : 0, 1172137
Total [baseline] (9.284 s) : 0, 9284255
Agent [candidate] (1.191 s) : 0, 1190826
Total [candidate] (9.329 s) : 0, 9328926

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.045 s	-
Agent	iast	1.172 s	126.713 ms (12.1%)
Total	tracing	8.583 s	-
Total	iast	9.284 s	701.655 ms (8.2%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.045 s	-
Agent	iast	1.191 s	145.881 ms (14.0%)
Total	tracing	8.596 s	-
Total	iast	9.329 s	732.487 ms (8.5%)

gantt
    title insecure-bank - break down per module: candidate=1.53.0-SNAPSHOT~065cd7ee92, baseline=1.53.0-SNAPSHOT~65b2349214

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.445 ms) : 0, 1445
crashtracking [candidate] (1.421 ms) : 0, 1421
BytebuddyAgent [baseline] (733.463 ms) : 0, 733463
BytebuddyAgent [candidate] (731.494 ms) : 0, 731494
GlobalTracer [baseline] (241.994 ms) : 0, 241994
GlobalTracer [candidate] (241.68 ms) : 0, 241680
AppSec [baseline] (30.124 ms) : 0, 30124
AppSec [candidate] (29.997 ms) : 0, 29997
Debugger [baseline] (6.039 ms) : 0, 6039
Debugger [candidate] (5.999 ms) : 0, 5999
Remote Config [baseline] (652.185 µs) : 0, 652
Remote Config [candidate] (648.829 µs) : 0, 649
Telemetry [baseline] (10.751 ms) : 0, 10751
Telemetry [candidate] (12.795 ms) : 0, 12795
section iast
crashtracking [baseline] (1.426 ms) : 0, 1426
crashtracking [candidate] (1.438 ms) : 0, 1438
BytebuddyAgent [baseline] (846.21 ms) : 0, 846210
BytebuddyAgent [candidate] (861.299 ms) : 0, 861299
GlobalTracer [baseline] (231.926 ms) : 0, 231926
GlobalTracer [candidate] (233.71 ms) : 0, 233710
AppSec [baseline] (27.108 ms) : 0, 27108
AppSec [candidate] (27.889 ms) : 0, 27889
Debugger [baseline] (5.704 ms) : 0, 5704
Debugger [candidate] (7.51 ms) : 0, 7510
Remote Config [baseline] (673.466 µs) : 0, 673
Remote Config [candidate] (594.197 µs) : 0, 594
Telemetry [baseline] (8.412 ms) : 0, 8412
Telemetry [candidate] (8.513 ms) : 0, 8513
IAST [baseline] (29.818 ms) : 0, 29818
IAST [candidate] (28.708 ms) : 0, 28708

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	sarahchen6/fix-nightly
git_commit_date	1755212609	1755265920
git_commit_sha	`65b2349`	`065cd7e`
release_version	1.53.0-SNAPSHOT~65b2349214	1.53.0-SNAPSHOT~065cd7ee92

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1755267344	1755267344
ci_job_id	1082206329	1082206329
ci_pipeline_id	73794871	73794871
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-1-pjnwrqot 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-1-pjnwrqot 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 2 performance regressions! Performance is the same for 9 metrics, 12 unstable metrics.

scenario	Δ mean http_req_duration	Δ mean throughput	candidate mean http_req_duration	candidate mean throughput	baseline mean http_req_duration	baseline mean throughput
scenario:load:insecure-bank:iast_GLOBAL:high_load	worse [+373.385µs; +762.239µs] or [+3.755%; +7.666%]	unstable [-81.099op/s; +30.849op/s] or [-17.357%; +6.602%]	10.511ms	442.125op/s	9.943ms	467.250op/s
scenario:load:petclinic:tracing:high_load	worse [+0.899ms; +1.718ms] or [+2.053%; +3.924%]	unstable [-10.399op/s; +4.299op/s] or [-9.740%; +4.027%]	45.102ms	103.725op/s	43.793ms	106.775op/s
scenario:load:petclinic:appsec:high_load	better [-3.365ms; -2.454ms] or [-6.838%; -4.988%]	unstable [-0.454op/s; +12.529op/s] or [-0.478%; +13.175%]	46.297ms	101.138op/s	49.207ms	95.100op/s

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.53.0-SNAPSHOT~065cd7ee92, baseline=1.53.0-SNAPSHOT~65b2349214
    dateFormat X
    axisFormat %s
section baseline
no_agent (4.577 ms) : 4517, 4637
.   : milestone, 4577,
iast (9.578 ms) : 9412, 9744
.   : milestone, 9578,
iast_FULL (14.134 ms) : 13852, 14417
.   : milestone, 14134,
iast_GLOBAL (9.943 ms) : 9767, 10118
.   : milestone, 9943,
profiling (8.911 ms) : 8745, 9077
.   : milestone, 8911,
tracing (7.483 ms) : 7371, 7594
.   : milestone, 7483,
section candidate
no_agent (4.442 ms) : 4387, 4498
.   : milestone, 4442,
iast (9.358 ms) : 9208, 9509
.   : milestone, 9358,
iast_FULL (14.414 ms) : 14130, 14698
.   : milestone, 14414,
iast_GLOBAL (10.511 ms) : 10325, 10696
.   : milestone, 10511,
profiling (8.715 ms) : 8569, 8861
.   : milestone, 8715,
tracing (7.737 ms) : 7628, 7846
.   : milestone, 7737,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	4.577 ms [4.517 ms, 4.637 ms]	-
iast	9.578 ms [9.412 ms, 9.744 ms]	5.0 ms (109.2%)
iast_FULL	14.134 ms [13.852 ms, 14.417 ms]	9.557 ms (208.8%)
iast_GLOBAL	9.943 ms [9.767 ms, 10.118 ms]	5.366 ms (117.2%)
profiling	8.911 ms [8.745 ms, 9.077 ms]	4.334 ms (94.7%)
tracing	7.483 ms [7.371 ms, 7.594 ms]	2.906 ms (63.5%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	4.442 ms [4.387 ms, 4.498 ms]	-
iast	9.358 ms [9.208 ms, 9.509 ms]	4.916 ms (110.7%)
iast_FULL	14.414 ms [14.13 ms, 14.698 ms]	9.972 ms (224.5%)
iast_GLOBAL	10.511 ms [10.325 ms, 10.696 ms]	6.068 ms (136.6%)
profiling	8.715 ms [8.569 ms, 8.861 ms]	4.273 ms (96.2%)
tracing	7.737 ms [7.628 ms, 7.846 ms]	3.294 ms (74.2%)

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.53.0-SNAPSHOT~065cd7ee92, baseline=1.53.0-SNAPSHOT~65b2349214
    dateFormat X
    axisFormat %s
section baseline
no_agent (37.94 ms) : 37641, 38238
.   : milestone, 37940,
appsec (49.207 ms) : 48771, 49642
.   : milestone, 49207,
code_origins (45.337 ms) : 44953, 45721
.   : milestone, 45337,
iast (45.014 ms) : 44617, 45411
.   : milestone, 45014,
profiling (50.625 ms) : 50138, 51112
.   : milestone, 50625,
tracing (43.793 ms) : 43424, 44162
.   : milestone, 43793,
section candidate
no_agent (37.539 ms) : 37226, 37851
.   : milestone, 37539,
appsec (46.297 ms) : 45887, 46707
.   : milestone, 46297,
code_origins (44.771 ms) : 44385, 45158
.   : milestone, 44771,
iast (45.42 ms) : 45030, 45809
.   : milestone, 45420,
profiling (49.991 ms) : 49524, 50459
.   : milestone, 49991,
tracing (45.102 ms) : 44710, 45493
.   : milestone, 45102,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	37.94 ms [37.641 ms, 38.238 ms]	-
appsec	49.207 ms [48.771 ms, 49.642 ms]	11.267 ms (29.7%)
code_origins	45.337 ms [44.953 ms, 45.721 ms]	7.397 ms (19.5%)
iast	45.014 ms [44.617 ms, 45.411 ms]	7.075 ms (18.6%)
profiling	50.625 ms [50.138 ms, 51.112 ms]	12.686 ms (33.4%)
tracing	43.793 ms [43.424 ms, 44.162 ms]	5.853 ms (15.4%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	37.539 ms [37.226 ms, 37.851 ms]	-
appsec	46.297 ms [45.887 ms, 46.707 ms]	8.759 ms (23.3%)
code_origins	44.771 ms [44.385 ms, 45.158 ms]	7.233 ms (19.3%)
iast	45.42 ms [45.03 ms, 45.809 ms]	7.881 ms (21.0%)
profiling	49.991 ms [49.524 ms, 50.459 ms]	12.453 ms (33.2%)
tracing	45.102 ms [44.71 ms, 45.493 ms]	7.563 ms (20.1%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	sarahchen6/fix-nightly
git_commit_date	1755212609	1755265920
git_commit_sha	`65b2349`	`065cd7e`
release_version	1.53.0-SNAPSHOT~65b2349214	1.53.0-SNAPSHOT~065cd7ee92

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1755267774	1755267774
ci_job_id	1082206330	1082206330
ci_pipeline_id	73794871	73794871
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-q2j5ui36 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-q2j5ui36 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.53.0-SNAPSHOT~065cd7ee92, baseline=1.53.0-SNAPSHOT~65b2349214
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.482 ms) : 1471, 1494
.   : milestone, 1482,
appsec (3.697 ms) : 3478, 3917
.   : milestone, 3697,
iast (2.212 ms) : 2148, 2275
.   : milestone, 2212,
iast_GLOBAL (2.248 ms) : 2184, 2311
.   : milestone, 2248,
profiling (2.067 ms) : 2015, 2119
.   : milestone, 2067,
tracing (2.025 ms) : 1975, 2074
.   : milestone, 2025,
section candidate
no_agent (1.485 ms) : 1473, 1496
.   : milestone, 1485,
appsec (3.667 ms) : 3450, 3884
.   : milestone, 3667,
iast (2.211 ms) : 2148, 2274
.   : milestone, 2211,
iast_GLOBAL (2.254 ms) : 2191, 2318
.   : milestone, 2254,
profiling (2.072 ms) : 2020, 2124
.   : milestone, 2072,
tracing (2.022 ms) : 1973, 2070
.   : milestone, 2022,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.482 ms [1.471 ms, 1.494 ms]	-
appsec	3.697 ms [3.478 ms, 3.917 ms]	2.215 ms (149.4%)
iast	2.212 ms [2.148 ms, 2.275 ms]	729.543 µs (49.2%)
iast_GLOBAL	2.248 ms [2.184 ms, 2.311 ms]	765.449 µs (51.6%)
profiling	2.067 ms [2.015 ms, 2.119 ms]	584.859 µs (39.5%)
tracing	2.025 ms [1.975 ms, 2.074 ms]	542.416 µs (36.6%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.485 ms [1.473 ms, 1.496 ms]	-
appsec	3.667 ms [3.45 ms, 3.884 ms]	2.183 ms (147.0%)
iast	2.211 ms [2.148 ms, 2.274 ms]	726.47 µs (48.9%)
iast_GLOBAL	2.254 ms [2.191 ms, 2.318 ms]	769.845 µs (51.9%)
profiling	2.072 ms [2.02 ms, 2.124 ms]	587.775 µs (39.6%)
tracing	2.022 ms [1.973 ms, 2.07 ms]	537.046 µs (36.2%)

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.53.0-SNAPSHOT~065cd7ee92, baseline=1.53.0-SNAPSHOT~65b2349214
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.967 s) : 14967000, 14967000
.   : milestone, 14967000,
appsec (14.895 s) : 14895000, 14895000
.   : milestone, 14895000,
iast (18.566 s) : 18566000, 18566000
.   : milestone, 18566000,
iast_GLOBAL (18.346 s) : 18346000, 18346000
.   : milestone, 18346000,
profiling (15.456 s) : 15456000, 15456000
.   : milestone, 15456000,
tracing (15.074 s) : 15074000, 15074000
.   : milestone, 15074000,
section candidate
no_agent (15.533 s) : 15533000, 15533000
.   : milestone, 15533000,
appsec (15.017 s) : 15017000, 15017000
.   : milestone, 15017000,
iast (18.459 s) : 18459000, 18459000
.   : milestone, 18459000,
iast_GLOBAL (18.388 s) : 18388000, 18388000
.   : milestone, 18388000,
profiling (15.211 s) : 15211000, 15211000
.   : milestone, 15211000,
tracing (14.965 s) : 14965000, 14965000
.   : milestone, 14965000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	14.967 s [14.967 s, 14.967 s]	-
appsec	14.895 s [14.895 s, 14.895 s]	-72.0 ms (-0.5%)
iast	18.566 s [18.566 s, 18.566 s]	3.599 s (24.0%)
iast_GLOBAL	18.346 s [18.346 s, 18.346 s]	3.379 s (22.6%)
profiling	15.456 s [15.456 s, 15.456 s]	489.0 ms (3.3%)
tracing	15.074 s [15.074 s, 15.074 s]	107.0 ms (0.7%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.533 s [15.533 s, 15.533 s]	-
appsec	15.017 s [15.017 s, 15.017 s]	-516.0 ms (-3.3%)
iast	18.459 s [18.459 s, 18.459 s]	2.926 s (18.8%)
iast_GLOBAL	18.388 s [18.388 s, 18.388 s]	2.855 s (18.4%)
profiling	15.211 s [15.211 s, 15.211 s]	-322.0 ms (-2.1%)
tracing	14.965 s [14.965 s, 14.965 s]	-568.0 ms (-3.7%)

sarahchen6 added 2 commits August 15, 2025 09:34

Add stage for publishing-gate

66991b9

Allow publishing-gate to run when populating cache

065cd7e

sarahchen6 added type: bug Bug report and fix tag: no release notes Changes to exclude from release notes labels Aug 15, 2025

sarahchen6 marked this pull request as ready for review August 15, 2025 13:54

sarahchen6 requested a review from a team as a code owner August 15, 2025 13:54

sarahchen6 requested review from randomanderson and AlexeyKuznetsov-DD and removed request for a team August 15, 2025 13:54

AlexeyKuznetsov-DD approved these changes Aug 15, 2025

View reviewed changes

randomanderson approved these changes Aug 15, 2025

View reviewed changes

sarahchen6 enabled auto-merge (squash) August 15, 2025 15:33

sarahchen6 merged commit f15598a into master Aug 15, 2025
502 checks passed

sarahchen6 deleted the sarahchen6/fix-nightly branch August 15, 2025 15:40

github-actions bot added this to the 1.53.0 milestone Aug 15, 2025

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Fix nightly pipeline #9368

Fix nightly pipeline #9368

Uh oh!

sarahchen6 commented Aug 15, 2025 •

edited

Loading

Uh oh!

datadog-datadog-prod-us1 bot commented Aug 15, 2025 •

edited

Loading

Uh oh!

pr-commenter bot commented Aug 15, 2025

Uh oh!

Uh oh!

Uh oh!

Fix nightly pipeline #9368

Fix nightly pipeline #9368

Uh oh!

Conversation

sarahchen6 commented Aug 15, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Uh oh!

datadog-datadog-prod-us1 bot commented Aug 15, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

pr-commenter bot commented Aug 15, 2025

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

Uh oh!

Uh oh!

Uh oh!

sarahchen6 commented Aug 15, 2025 •

edited

Loading

datadog-datadog-prod-us1 bot commented Aug 15, 2025 •

edited

Loading