🍒 9201 - Match Hands Off Config selectors on process_arguments value #9238

sarahchen6 · 2025-07-24T13:56:57Z

Backport #9201 to release/v1.50.x

* feat: match stable config java properties on other operator than 'contains' * fix: lowercase match value * fix: extra parameter * fix: remove duplicate values * fix: lint * fi: wrong variable * fix lint * fix: tests * fix: null matches with exist should work * feat: add tests for equal operator on arguments * fix: use equal method instead of operator * Update internal-api/src/main/java/datadog/trace/bootstrap/config/provider/StableConfigParser.java Co-authored-by: Bruce Bujon <[email protected]> * apply PR suggestions * fix typo * Add missing locale * add matches == null check back in to avoid NPE --------- Co-authored-by: Mikayla Toffler <[email protected]> Co-authored-by: Bruce Bujon <[email protected]> Co-authored-by: Mikayla Toffler <[email protected]>

github-actions · 2025-07-24T13:57:07Z

Hi! 👋 Thanks for your pull request! 🎉

To help us review it, please make sure to:

Add at least one type, and one component or instrumentation label to the pull request

If you need help, please check our contributing guidelines.

pr-commenter · 2025-07-24T15:00:29Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	sarah.chen/backport-pr-9201
git_commit_date	1753362658	1753365261
git_commit_sha	`4fde84f`	`a516959`
release_version	1.51.1-SNAPSHOT~4fde84fc67	1.51.0-SNAPSHOT~a5169598dc

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1753368982	1753368982
ci_job_id	1045733409	1045733409
ci_pipeline_id	71585107	71585107
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-kiqjh4g8 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-kiqjh4g8 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None

Summary

Found 9 performance improvements and 4 performance regressions! Performance is the same for 26 metrics, 14 unstable metrics.

scenario	Δ mean execution_time	candidate mean execution_time	baseline mean execution_time
scenario:startup:insecure-bank:iast:BytebuddyAgent	better [-44.375ms; -38.220ms] or [-5.226%; -4.501%]	807.803ms	849.101ms
scenario:startup:insecure-bank:tracing:BytebuddyAgent	better [-49.730ms; -42.083ms] or [-6.794%; -5.749%]	686.087ms	731.993ms
scenario:startup:petclinic:appsec:Agent.start	better [-67.463ms; -37.404ms] or [-5.504%; -3.051%]	1.173s	1.226s
scenario:startup:petclinic:appsec:BytebuddyAgent	better [-60.972ms; -39.362ms] or [-8.049%; -5.196%]	707.333ms	757.500ms
scenario:startup:petclinic:appsec:IAST	better [-2.199ms; -1.349ms] or [-9.310%; -5.712%]	21.846ms	23.620ms
scenario:startup:petclinic:appsec:Telemetry	better [-1.148ms; -0.897ms] or [-13.970%; -10.913%]	7.195ms	8.217ms
scenario:startup:petclinic:iast:BytebuddyAgent	better [-45.863ms; -39.467ms] or [-5.403%; -4.649%]	806.249ms	848.914ms
scenario:startup:petclinic:profiling:Agent.start	worse [+73.683ms; +85.564ms] or [+6.197%; +7.196%]	1.269s	1.189s
scenario:startup:petclinic:profiling:BytebuddyAgent	better [-83.772ms; -78.027ms] or [-11.049%; -10.292%]	677.259ms	758.158ms
scenario:startup:petclinic:profiling:GlobalTracer	worse [+138.406ms; +141.575ms] or [+62.782%; +64.219%]	360.445ms	220.455ms
scenario:startup:petclinic:profiling:AppSec	worse [+31.115ms; +31.977ms] or [+103.360%; +106.223%]	61.650ms	30.104ms
scenario:startup:petclinic:tracing:BytebuddyAgent	better [-45.524ms; -38.182ms] or [-6.246%; -5.239%]	686.993ms	728.846ms
scenario:startup:petclinic:tracing:Debugger	worse [+173.196µs; +354.334µs] or [+2.900%; +5.932%]	6.237ms	5.973ms

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.51.0-SNAPSHOT~a5169598dc, baseline=1.51.1-SNAPSHOT~4fde84fc67

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.044 s) : 0, 1043528
Total [baseline] (10.701 s) : 0, 10701476
Agent [candidate] (1.028 s) : 0, 1027585
Total [candidate] (10.614 s) : 0, 10613711
section appsec
Agent [baseline] (1.226 s) : 0, 1225756
Total [baseline] (10.726 s) : 0, 10726142
Agent [candidate] (1.173 s) : 0, 1173322
Total [candidate] (10.686 s) : 0, 10686299
section iast
Agent [baseline] (1.176 s) : 0, 1175682
Total [baseline] (10.967 s) : 0, 10967218
Agent [candidate] (1.152 s) : 0, 1151968
Total [candidate] (10.895 s) : 0, 10894922
section profiling
Agent [baseline] (1.189 s) : 0, 1189044
Total [baseline] (10.79 s) : 0, 10790035
Agent [candidate] (1.269 s) : 0, 1268668
Total [candidate] (10.96 s) : 0, 10960283

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.044 s	-
Agent	appsec	1.226 s	182.227 ms (17.5%)
Agent	iast	1.176 s	132.154 ms (12.7%)
Agent	profiling	1.189 s	145.516 ms (13.9%)
Total	tracing	10.701 s	-
Total	appsec	10.726 s	24.666 ms (0.2%)
Total	iast	10.967 s	265.742 ms (2.5%)
Total	profiling	10.79 s	88.559 ms (0.8%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.028 s	-
Agent	appsec	1.173 s	145.737 ms (14.2%)
Agent	iast	1.152 s	124.382 ms (12.1%)
Agent	profiling	1.269 s	241.083 ms (23.5%)
Total	tracing	10.614 s	-
Total	appsec	10.686 s	72.588 ms (0.7%)
Total	iast	10.895 s	281.211 ms (2.6%)
Total	profiling	10.96 s	346.572 ms (3.3%)

gantt
    title petclinic - break down per module: candidate=1.51.0-SNAPSHOT~a5169598dc, baseline=1.51.1-SNAPSHOT~4fde84fc67

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (728.846 ms) : 0, 728846
BytebuddyAgent [candidate] (686.993 ms) : 0, 686993
GlobalTracer [baseline] (241.313 ms) : 0, 241313
GlobalTracer [candidate] (242.603 ms) : 0, 242603
AppSec [baseline] (30.24 ms) : 0, 30240
AppSec [candidate] (58.994 ms) : 0, 58994
Debugger [baseline] (5.973 ms) : 0, 5973
Debugger [candidate] (6.237 ms) : 0, 6237
Remote Config [baseline] (645.238 µs) : 0, 645
Remote Config [candidate] (653.898 µs) : 0, 654
Telemetry [baseline] (14.13 ms) : 0, 14130
Telemetry [candidate] (11.124 ms) : 0, 11124
crashtracking [baseline] (1.431 ms) : 0, 1431
section appsec
BytebuddyAgent [baseline] (757.5 ms) : 0, 757500
BytebuddyAgent [candidate] (707.333 ms) : 0, 707333
GlobalTracer [baseline] (235.858 ms) : 0, 235858
GlobalTracer [candidate] (234.865 ms) : 0, 234865
AppSec [baseline] (169.182 ms) : 0, 169182
AppSec [candidate] (174.888 ms) : 0, 174888
Debugger [baseline] (7.96 ms) : 0, 7960
Debugger [candidate] (5.893 ms) : 0, 5893
Remote Config [baseline] (623.966 µs) : 0, 624
Remote Config [candidate] (610.509 µs) : 0, 611
Telemetry [baseline] (8.217 ms) : 0, 8217
Telemetry [candidate] (7.195 ms) : 0, 7195
crashtracking [baseline] (1.435 ms) : 0, 1435
IAST [baseline] (23.62 ms) : 0, 23620
IAST [candidate] (21.846 ms) : 0, 21846
section iast
BytebuddyAgent [baseline] (848.914 ms) : 0, 848914
BytebuddyAgent [candidate] (806.249 ms) : 0, 806249
GlobalTracer [baseline] (231.579 ms) : 0, 231579
GlobalTracer [candidate] (231.661 ms) : 0, 231661
AppSec [baseline] (29.074 ms) : 0, 29074
AppSec [candidate] (53.588 ms) : 0, 53588
Debugger [baseline] (5.744 ms) : 0, 5744
Debugger [candidate] (5.918 ms) : 0, 5918
Remote Config [baseline] (585.599 µs) : 0, 586
Remote Config [candidate] (613.704 µs) : 0, 614
Telemetry [baseline] (8.147 ms) : 0, 8147
Telemetry [candidate] (7.971 ms) : 0, 7971
crashtracking [baseline] (1.423 ms) : 0, 1423
IAST [baseline] (29.16 ms) : 0, 29160
IAST [candidate] (25.12 ms) : 0, 25120
section profiling
BytebuddyAgent [baseline] (758.158 ms) : 0, 758158
BytebuddyAgent [candidate] (677.259 ms) : 0, 677259
GlobalTracer [baseline] (220.455 ms) : 0, 220455
GlobalTracer [candidate] (360.445 ms) : 0, 360445
AppSec [baseline] (30.104 ms) : 0, 30104
AppSec [candidate] (61.65 ms) : 0, 61650
Debugger [baseline] (6.195 ms) : 0, 6195
Debugger [candidate] (6.087 ms) : 0, 6087
Remote Config [baseline] (717.145 µs) : 0, 717
Remote Config [candidate] (694.493 µs) : 0, 694
Telemetry [baseline] (15.08 ms) : 0, 15080
Telemetry [candidate] (8.099 ms) : 0, 8099
crashtracking [baseline] (1.396 ms) : 0, 1396
ProfilingAgent [baseline] (108.537 ms) : 0, 108537
ProfilingAgent [candidate] (105.848 ms) : 0, 105848
Profiling [baseline] (108.561 ms) : 0, 108561
Profiling [candidate] (105.875 ms) : 0, 105875

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.51.0-SNAPSHOT~a5169598dc, baseline=1.51.1-SNAPSHOT~4fde84fc67

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.047 s) : 0, 1047463
Total [baseline] (8.612 s) : 0, 8611656
Agent [candidate] (1.025 s) : 0, 1024882
Total [candidate] (8.557 s) : 0, 8557191
section iast
Agent [baseline] (1.177 s) : 0, 1177229
Total [baseline] (9.304 s) : 0, 9304408
Agent [candidate] (1.154 s) : 0, 1154135
Total [candidate] (9.205 s) : 0, 9205102

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.047 s	-
Agent	iast	1.177 s	129.766 ms (12.4%)
Total	tracing	8.612 s	-
Total	iast	9.304 s	692.753 ms (8.0%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.025 s	-
Agent	iast	1.154 s	129.252 ms (12.6%)
Total	tracing	8.557 s	-
Total	iast	9.205 s	647.911 ms (7.6%)

gantt
    title insecure-bank - break down per module: candidate=1.51.0-SNAPSHOT~a5169598dc, baseline=1.51.1-SNAPSHOT~4fde84fc67

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (731.993 ms) : 0, 731993
BytebuddyAgent [candidate] (686.087 ms) : 0, 686087
GlobalTracer [baseline] (243.033 ms) : 0, 243033
GlobalTracer [candidate] (242.263 ms) : 0, 242263
AppSec [baseline] (30.692 ms) : 0, 30692
AppSec [candidate] (56.723 ms) : 0, 56723
Debugger [baseline] (6.037 ms) : 0, 6037
Debugger [candidate] (7.892 ms) : 0, 7892
Remote Config [baseline] (655.536 µs) : 0, 656
Remote Config [candidate] (684.691 µs) : 0, 685
Telemetry [baseline] (12.64 ms) : 0, 12640
Telemetry [candidate] (10.382 ms) : 0, 10382
crashtracking [baseline] (1.428 ms) : 0, 1428
section iast
BytebuddyAgent [baseline] (849.101 ms) : 0, 849101
BytebuddyAgent [candidate] (807.803 ms) : 0, 807803
GlobalTracer [baseline] (232.936 ms) : 0, 232936
GlobalTracer [candidate] (232.147 ms) : 0, 232147
AppSec [baseline] (30.642 ms) : 0, 30642
AppSec [candidate] (51.298 ms) : 0, 51298
Debugger [baseline] (6.633 ms) : 0, 6633
Debugger [candidate] (5.883 ms) : 0, 5883
Remote Config [baseline] (592.959 µs) : 0, 593
Remote Config [candidate] (601.677 µs) : 0, 602
Telemetry [baseline] (8.156 ms) : 0, 8156
Telemetry [candidate] (7.994 ms) : 0, 7994
crashtracking [baseline] (1.426 ms) : 0, 1426
IAST [baseline] (26.705 ms) : 0, 26705
IAST [candidate] (27.585 ms) : 0, 27585

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	sarah.chen/backport-pr-9201
git_commit_date	1753362658	1753365261
git_commit_sha	`4fde84f`	`a516959`
release_version	1.51.1-SNAPSHOT~4fde84fc67	1.51.0-SNAPSHOT~a5169598dc

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1753368662	1753368662
ci_job_id	1045733411	1045733411
ci_pipeline_id	71585107	71585107
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-1-ganvp6vb 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-1-ganvp6vb 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 2 performance improvements and 3 performance regressions! Performance is the same for 7 metrics, 12 unstable metrics.

scenario	Δ mean http_req_duration	Δ mean throughput	candidate mean http_req_duration	candidate mean throughput	baseline mean http_req_duration	baseline mean throughput
scenario:load:insecure-bank:iast:high_load	worse [+450.062µs; +787.243µs] or [+4.903%; +8.577%]	unstable [-94.728op/s; +31.728op/s] or [-18.740%; +6.277%]	9.798ms	474.000op/s	9.179ms	505.500op/s
scenario:load:insecure-bank:profiling:high_load	better [-749.675µs; -432.221µs] or [-7.923%; -4.568%]	unstable [-38.274op/s; +102.961op/s] or [-7.803%; +20.991%]	8.872ms	522.844op/s	9.463ms	490.500op/s
scenario:load:petclinic:no_agent:high_load	better [-1.853ms; -1.201ms] or [-4.833%; -3.132%]	unstable [-3.541op/s; +13.691op/s] or [-2.904%; +11.228%]	36.815ms	127.013op/s	38.342ms	121.938op/s
scenario:load:petclinic:iast:high_load	worse [+2.534ms; +3.364ms] or [+5.872%; +7.797%]	unstable [-14.026op/s; +0.351op/s] or [-12.938%; +0.324%]	46.098ms	101.575op/s	43.149ms	108.412op/s
scenario:load:petclinic:profiling:high_load	worse [+1.727ms; +2.654ms] or [+3.648%; +5.605%]	unstable [-10.976op/s; +2.276op/s] or [-11.107%; +2.303%]	49.540ms	94.475op/s	47.349ms	98.825op/s

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.51.0-SNAPSHOT~a5169598dc, baseline=1.51.1-SNAPSHOT~4fde84fc67
    dateFormat X
    axisFormat %s
section baseline
no_agent (38.342 ms) : 38037, 38646
.   : milestone, 38342,
appsec (47.701 ms) : 47277, 48125
.   : milestone, 47701,
code_origins (45.314 ms) : 44937, 45692
.   : milestone, 45314,
iast (43.149 ms) : 42779, 43518
.   : milestone, 43149,
profiling (47.349 ms) : 46928, 47771
.   : milestone, 47349,
tracing (46.316 ms) : 45935, 46698
.   : milestone, 46316,
section candidate
no_agent (36.815 ms) : 36513, 37117
.   : milestone, 36815,
appsec (47.53 ms) : 47096, 47965
.   : milestone, 47530,
code_origins (44.122 ms) : 43743, 44502
.   : milestone, 44122,
iast (46.098 ms) : 45696, 46499
.   : milestone, 46098,
profiling (49.54 ms) : 49100, 49980
.   : milestone, 49540,
tracing (45.506 ms) : 45109, 45903
.   : milestone, 45506,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	38.342 ms [38.037 ms, 38.646 ms]	-
appsec	47.701 ms [47.277 ms, 48.125 ms]	9.359 ms (24.4%)
code_origins	45.314 ms [44.937 ms, 45.692 ms]	6.973 ms (18.2%)
iast	43.149 ms [42.779 ms, 43.518 ms]	4.807 ms (12.5%)
profiling	47.349 ms [46.928 ms, 47.771 ms]	9.008 ms (23.5%)
tracing	46.316 ms [45.935 ms, 46.698 ms]	7.975 ms (20.8%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	36.815 ms [36.513 ms, 37.117 ms]	-
appsec	47.53 ms [47.096 ms, 47.965 ms]	10.715 ms (29.1%)
code_origins	44.122 ms [43.743 ms, 44.502 ms]	7.307 ms (19.8%)
iast	46.098 ms [45.696 ms, 46.499 ms]	9.283 ms (25.2%)
profiling	49.54 ms [49.1 ms, 49.98 ms]	12.725 ms (34.6%)
tracing	45.506 ms [45.109 ms, 45.903 ms]	8.691 ms (23.6%)

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.51.0-SNAPSHOT~a5169598dc, baseline=1.51.1-SNAPSHOT~4fde84fc67
    dateFormat X
    axisFormat %s
section baseline
no_agent (4.377 ms) : 4327, 4426
.   : milestone, 4377,
iast (9.179 ms) : 9030, 9328
.   : milestone, 9179,
iast_FULL (13.837 ms) : 13561, 14112
.   : milestone, 13837,
iast_GLOBAL (10.352 ms) : 10170, 10534
.   : milestone, 10352,
profiling (9.463 ms) : 9310, 9615
.   : milestone, 9463,
tracing (7.828 ms) : 7717, 7940
.   : milestone, 7828,
section candidate
no_agent (4.338 ms) : 4288, 4388
.   : milestone, 4338,
iast (9.798 ms) : 9634, 9961
.   : milestone, 9798,
iast_FULL (14.335 ms) : 14051, 14620
.   : milestone, 14335,
iast_GLOBAL (9.962 ms) : 9791, 10132
.   : milestone, 9962,
profiling (8.872 ms) : 8729, 9014
.   : milestone, 8872,
tracing (7.753 ms) : 7639, 7868
.   : milestone, 7753,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	4.377 ms [4.327 ms, 4.426 ms]	-
iast	9.179 ms [9.03 ms, 9.328 ms]	4.802 ms (109.7%)
iast_FULL	13.837 ms [13.561 ms, 14.112 ms]	9.46 ms (216.1%)
iast_GLOBAL	10.352 ms [10.17 ms, 10.534 ms]	5.976 ms (136.5%)
profiling	9.463 ms [9.31 ms, 9.615 ms]	5.086 ms (116.2%)
tracing	7.828 ms [7.717 ms, 7.94 ms]	3.452 ms (78.9%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	4.338 ms [4.288 ms, 4.388 ms]	-
iast	9.798 ms [9.634 ms, 9.961 ms]	5.46 ms (125.9%)
iast_FULL	14.335 ms [14.051 ms, 14.62 ms]	9.997 ms (230.5%)
iast_GLOBAL	9.962 ms [9.791 ms, 10.132 ms]	5.624 ms (129.6%)
profiling	8.872 ms [8.729 ms, 9.014 ms]	4.534 ms (104.5%)
tracing	7.753 ms [7.639 ms, 7.868 ms]	3.415 ms (78.7%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	sarah.chen/backport-pr-9201
git_commit_date	1753362658	1753365261
git_commit_sha	`4fde84f`	`a516959`
release_version	1.51.1-SNAPSHOT~4fde84fc67	1.51.0-SNAPSHOT~a5169598dc

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1753369193	1753369193
ci_job_id	1045733412	1045733412
ci_pipeline_id	71585107	71585107
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-2-0uuij8en 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-2-0uuij8en 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 0 unstable metrics.

scenario	Δ mean execution_time	candidate mean execution_time	baseline mean execution_time
scenario:dacapo:tomcat:appsec	better [-1.364ms; -1.033ms] or [-37.749%; -28.581%]	2.416ms	3.615ms

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.51.0-SNAPSHOT~a5169598dc, baseline=1.51.1-SNAPSHOT~4fde84fc67
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.474 ms) : 1462, 1485
.   : milestone, 1474,
appsec (3.615 ms) : 3402, 3827
.   : milestone, 3615,
iast (2.214 ms) : 2151, 2277
.   : milestone, 2214,
iast_GLOBAL (2.252 ms) : 2188, 2315
.   : milestone, 2252,
profiling (2.073 ms) : 2021, 2125
.   : milestone, 2073,
tracing (2.032 ms) : 1983, 2081
.   : milestone, 2032,
section candidate
no_agent (1.486 ms) : 1475, 1498
.   : milestone, 1486,
appsec (2.416 ms) : 2367, 2465
.   : milestone, 2416,
iast (2.209 ms) : 2146, 2271
.   : milestone, 2209,
iast_GLOBAL (2.246 ms) : 2184, 2309
.   : milestone, 2246,
profiling (2.054 ms) : 2003, 2105
.   : milestone, 2054,
tracing (2.028 ms) : 1980, 2076
.   : milestone, 2028,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.474 ms [1.462 ms, 1.485 ms]	-
appsec	3.615 ms [3.402 ms, 3.827 ms]	2.141 ms (145.3%)
iast	2.214 ms [2.151 ms, 2.277 ms]	740.59 µs (50.2%)
iast_GLOBAL	2.252 ms [2.188 ms, 2.315 ms]	777.636 µs (52.8%)
profiling	2.073 ms [2.021 ms, 2.125 ms]	599.001 µs (40.6%)
tracing	2.032 ms [1.983 ms, 2.081 ms]	557.989 µs (37.9%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.486 ms [1.475 ms, 1.498 ms]	-
appsec	2.416 ms [2.367 ms, 2.465 ms]	929.458 µs (62.5%)
iast	2.209 ms [2.146 ms, 2.271 ms]	722.205 µs (48.6%)
iast_GLOBAL	2.246 ms [2.184 ms, 2.309 ms]	759.854 µs (51.1%)
profiling	2.054 ms [2.003 ms, 2.105 ms]	567.468 µs (38.2%)
tracing	2.028 ms [1.98 ms, 2.076 ms]	541.495 µs (36.4%)

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.51.0-SNAPSHOT~a5169598dc, baseline=1.51.1-SNAPSHOT~4fde84fc67
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.058 s) : 15058000, 15058000
.   : milestone, 15058000,
appsec (14.691 s) : 14691000, 14691000
.   : milestone, 14691000,
iast (19.022 s) : 19022000, 19022000
.   : milestone, 19022000,
iast_GLOBAL (17.887 s) : 17887000, 17887000
.   : milestone, 17887000,
profiling (15.333 s) : 15333000, 15333000
.   : milestone, 15333000,
tracing (14.936 s) : 14936000, 14936000
.   : milestone, 14936000,
section candidate
no_agent (15.464 s) : 15464000, 15464000
.   : milestone, 15464000,
appsec (14.872 s) : 14872000, 14872000
.   : milestone, 14872000,
iast (18.899 s) : 18899000, 18899000
.   : milestone, 18899000,
iast_GLOBAL (17.84 s) : 17840000, 17840000
.   : milestone, 17840000,
profiling (15.174 s) : 15174000, 15174000
.   : milestone, 15174000,
tracing (14.987 s) : 14987000, 14987000
.   : milestone, 14987000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.058 s [15.058 s, 15.058 s]	-
appsec	14.691 s [14.691 s, 14.691 s]	-367.0 ms (-2.4%)
iast	19.022 s [19.022 s, 19.022 s]	3.964 s (26.3%)
iast_GLOBAL	17.887 s [17.887 s, 17.887 s]	2.829 s (18.8%)
profiling	15.333 s [15.333 s, 15.333 s]	275.0 ms (1.8%)
tracing	14.936 s [14.936 s, 14.936 s]	-122.0 ms (-0.8%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.464 s [15.464 s, 15.464 s]	-
appsec	14.872 s [14.872 s, 14.872 s]	-592.0 ms (-3.8%)
iast	18.899 s [18.899 s, 18.899 s]	3.435 s (22.2%)
iast_GLOBAL	17.84 s [17.84 s, 17.84 s]	2.376 s (15.4%)
profiling	15.174 s [15.174 s, 15.174 s]	-290.0 ms (-1.9%)
tracing	14.987 s [14.987 s, 14.987 s]	-477.0 ms (-3.1%)

sarahchen6 · 2025-07-24T20:15:29Z

We no longer need to proceed with the 1.50.2 release.

sarahchen6 requested a review from a team as a code owner July 24, 2025 13:56

sarahchen6 requested a review from smola July 24, 2025 13:56

sarahchen6 added type: bug Bug report and fix comp: core Tracer core labels Jul 24, 2025

sarahchen6 added this to the 1.50.2 milestone Jul 24, 2025

mcculls approved these changes Jul 24, 2025

View reviewed changes

manuel-alvarez-alvarez approved these changes Jul 24, 2025

View reviewed changes

sarahchen6 closed this Jul 24, 2025

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

🍒 9201 - Match Hands Off Config selectors on process_arguments value #9238

🍒 9201 - Match Hands Off Config selectors on process_arguments value #9238

Uh oh!

sarahchen6 commented Jul 24, 2025

Uh oh!

github-actions bot commented Jul 24, 2025

Uh oh!

pr-commenter bot commented Jul 24, 2025

Uh oh!

sarahchen6 commented Jul 24, 2025

Uh oh!

Uh oh!

🍒 9201 - Match Hands Off Config selectors on process_arguments value #9238

🍒 9201 - Match Hands Off Config selectors on process_arguments value #9238

Uh oh!

Conversation

sarahchen6 commented Jul 24, 2025

Uh oh!

github-actions bot commented Jul 24, 2025

Uh oh!

pr-commenter bot commented Jul 24, 2025

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

Uh oh!

sarahchen6 commented Jul 24, 2025

Uh oh!

Uh oh!