Align the JMH version in project. #9281

AlexeyKuznetsov-DD · 2025-07-30T17:21:15Z

What Does This Do

Align the JMH version in project.

Motivation

Align the JMH (Java Microbenchmark Harness) version across the project to ensure consistency in benchmarking behavior and results. Simplify future updates.

pr-commenter · 2025-07-30T17:56:10Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	alexeyk/jmh-align-version
git_commit_date	1753877213	1753895879
git_commit_sha	`2c5960b`	`36fac41`
release_version	1.51.1-SNAPSHOT~2c5960be47	1.51.1-SNAPSHOT~36fac41ac8

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1753897885	1753897885
ci_job_id	1056018476	1056018476
ci_pipeline_id	72205621	72205621
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-9xxehqo1 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-9xxehqo1 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 48 metrics, 11 unstable metrics.

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.51.1-SNAPSHOT~36fac41ac8, baseline=1.51.1-SNAPSHOT~2c5960be47

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.041 s) : 0, 1040818
Total [baseline] (8.548 s) : 0, 8548150
Agent [candidate] (1.052 s) : 0, 1051689
Total [candidate] (8.587 s) : 0, 8587195
section iast
Agent [baseline] (1.183 s) : 0, 1183334
Total [baseline] (9.32 s) : 0, 9319827
Agent [candidate] (1.175 s) : 0, 1175044
Total [candidate] (9.287 s) : 0, 9286744

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.041 s	-
Agent	iast	1.183 s	142.517 ms (13.7%)
Total	tracing	8.548 s	-
Total	iast	9.32 s	771.677 ms (9.0%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.052 s	-
Agent	iast	1.175 s	123.356 ms (11.7%)
Total	tracing	8.587 s	-
Total	iast	9.287 s	699.549 ms (8.1%)

gantt
    title insecure-bank - break down per module: candidate=1.51.1-SNAPSHOT~36fac41ac8, baseline=1.51.1-SNAPSHOT~2c5960be47

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.431 ms) : 0, 1431
crashtracking [candidate] (1.441 ms) : 0, 1441
BytebuddyAgent [baseline] (728.606 ms) : 0, 728606
BytebuddyAgent [candidate] (735.293 ms) : 0, 735293
GlobalTracer [baseline] (241.088 ms) : 0, 241088
GlobalTracer [candidate] (243.034 ms) : 0, 243034
AppSec [baseline] (30.247 ms) : 0, 30247
AppSec [candidate] (30.683 ms) : 0, 30683
Debugger [baseline] (5.982 ms) : 0, 5982
Debugger [candidate] (6.085 ms) : 0, 6085
Remote Config [baseline] (647.489 µs) : 0, 647
Remote Config [candidate] (656.292 µs) : 0, 656
Telemetry [baseline] (11.946 ms) : 0, 11946
Telemetry [candidate] (13.445 ms) : 0, 13445
section iast
crashtracking [baseline] (1.444 ms) : 0, 1444
crashtracking [candidate] (1.434 ms) : 0, 1434
BytebuddyAgent [baseline] (855.291 ms) : 0, 855291
BytebuddyAgent [candidate] (848.221 ms) : 0, 848221
GlobalTracer [baseline] (232.285 ms) : 0, 232285
GlobalTracer [candidate] (231.273 ms) : 0, 231273
IAST [baseline] (30.098 ms) : 0, 30098
IAST [candidate] (30.149 ms) : 0, 30149
AppSec [baseline] (26.831 ms) : 0, 26831
AppSec [candidate] (27.506 ms) : 0, 27506
Debugger [baseline] (7.477 ms) : 0, 7477
Debugger [candidate] (6.768 ms) : 0, 6768
Remote Config [baseline] (601.14 µs) : 0, 601
Remote Config [candidate] (582.641 µs) : 0, 583
Telemetry [baseline] (8.224 ms) : 0, 8224
Telemetry [candidate] (8.147 ms) : 0, 8147

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.51.1-SNAPSHOT~36fac41ac8, baseline=1.51.1-SNAPSHOT~2c5960be47

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.04 s) : 0, 1040212
Total [baseline] (10.732 s) : 0, 10731569
Agent [candidate] (1.051 s) : 0, 1050922
Total [candidate] (10.737 s) : 0, 10736604
section appsec
Agent [baseline] (1.215 s) : 0, 1215270
Total [baseline] (10.737 s) : 0, 10736566
Agent [candidate] (1.225 s) : 0, 1224995
Total [candidate] (10.731 s) : 0, 10731239
section iast
Agent [baseline] (1.18 s) : 0, 1180301
Total [baseline] (10.842 s) : 0, 10842310
Agent [candidate] (1.172 s) : 0, 1172028
Total [candidate] (10.897 s) : 0, 10897157
section profiling
Agent [baseline] (1.191 s) : 0, 1190630
Total [baseline] (10.857 s) : 0, 10857043
Agent [candidate] (1.193 s) : 0, 1193448
Total [candidate] (10.817 s) : 0, 10816938

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.04 s	-
Agent	appsec	1.215 s	175.058 ms (16.8%)
Agent	iast	1.18 s	140.089 ms (13.5%)
Agent	profiling	1.191 s	150.417 ms (14.5%)
Total	tracing	10.732 s	-
Total	appsec	10.737 s	4.997 ms (0.0%)
Total	iast	10.842 s	110.741 ms (1.0%)
Total	profiling	10.857 s	125.474 ms (1.2%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.051 s	-
Agent	appsec	1.225 s	174.073 ms (16.6%)
Agent	iast	1.172 s	121.106 ms (11.5%)
Agent	profiling	1.193 s	142.526 ms (13.6%)
Total	tracing	10.737 s	-
Total	appsec	10.731 s	-5.365 ms (-0.0%)
Total	iast	10.897 s	160.553 ms (1.5%)
Total	profiling	10.817 s	80.334 ms (0.7%)

gantt
    title petclinic - break down per module: candidate=1.51.1-SNAPSHOT~36fac41ac8, baseline=1.51.1-SNAPSHOT~2c5960be47

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.421 ms) : 0, 1421
crashtracking [candidate] (1.438 ms) : 0, 1438
BytebuddyAgent [baseline] (728.359 ms) : 0, 728359
BytebuddyAgent [candidate] (734.711 ms) : 0, 734711
GlobalTracer [baseline] (240.724 ms) : 0, 240724
GlobalTracer [candidate] (244.088 ms) : 0, 244088
AppSec [baseline] (30.268 ms) : 0, 30268
AppSec [candidate] (30.859 ms) : 0, 30859
Debugger [baseline] (5.989 ms) : 0, 5989
Debugger [candidate] (6.064 ms) : 0, 6064
Remote Config [baseline] (642.094 µs) : 0, 642
Remote Config [candidate] (650.606 µs) : 0, 651
Telemetry [baseline] (11.914 ms) : 0, 11914
Telemetry [candidate] (12.049 ms) : 0, 12049
section appsec
crashtracking [baseline] (1.424 ms) : 0, 1424
crashtracking [candidate] (1.436 ms) : 0, 1436
BytebuddyAgent [baseline] (750.773 ms) : 0, 750773
BytebuddyAgent [candidate] (757.375 ms) : 0, 757375
GlobalTracer [baseline] (233.723 ms) : 0, 233723
GlobalTracer [candidate] (235.819 ms) : 0, 235819
IAST [baseline] (23.436 ms) : 0, 23436
IAST [candidate] (23.554 ms) : 0, 23554
AppSec [baseline] (166.726 ms) : 0, 166726
AppSec [candidate] (168.91 ms) : 0, 168910
Debugger [baseline] (9.344 ms) : 0, 9344
Debugger [candidate] (7.908 ms) : 0, 7908
Remote Config [baseline] (610.965 µs) : 0, 611
Remote Config [candidate] (619.09 µs) : 0, 619
Telemetry [baseline] (8.251 ms) : 0, 8251
Telemetry [candidate] (8.246 ms) : 0, 8246
section iast
crashtracking [baseline] (1.427 ms) : 0, 1427
crashtracking [candidate] (1.424 ms) : 0, 1424
BytebuddyAgent [baseline] (852.763 ms) : 0, 852763
BytebuddyAgent [candidate] (846.037 ms) : 0, 846037
GlobalTracer [baseline] (232.777 ms) : 0, 232777
GlobalTracer [candidate] (231.043 ms) : 0, 231043
IAST [baseline] (29.303 ms) : 0, 29303
IAST [candidate] (30.628 ms) : 0, 30628
AppSec [baseline] (26.653 ms) : 0, 26653
AppSec [candidate] (26.554 ms) : 0, 26554
Debugger [baseline] (7.475 ms) : 0, 7475
Debugger [candidate] (6.75 ms) : 0, 6750
Remote Config [baseline] (600.198 µs) : 0, 600
Remote Config [candidate] (587.226 µs) : 0, 587
Telemetry [baseline] (8.209 ms) : 0, 8209
Telemetry [candidate] (8.142 ms) : 0, 8142
section profiling
crashtracking [baseline] (1.388 ms) : 0, 1388
crashtracking [candidate] (1.392 ms) : 0, 1392
BytebuddyAgent [baseline] (757.983 ms) : 0, 757983
BytebuddyAgent [candidate] (758.23 ms) : 0, 758230
GlobalTracer [baseline] (221.338 ms) : 0, 221338
GlobalTracer [candidate] (222.582 ms) : 0, 222582
AppSec [baseline] (30.231 ms) : 0, 30231
AppSec [candidate] (30.487 ms) : 0, 30487
Debugger [baseline] (6.246 ms) : 0, 6246
Debugger [candidate] (6.316 ms) : 0, 6316
Remote Config [baseline] (700.278 µs) : 0, 700
Remote Config [candidate] (675.167 µs) : 0, 675
Telemetry [baseline] (16.193 ms) : 0, 16193
Telemetry [candidate] (15.252 ms) : 0, 15252
ProfilingAgent [baseline] (107.318 ms) : 0, 107318
ProfilingAgent [candidate] (109.273 ms) : 0, 109273
Profiling [baseline] (107.942 ms) : 0, 107942
Profiling [candidate] (109.921 ms) : 0, 109921

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	alexeyk/jmh-align-version
git_commit_date	1753877213	1753895879
git_commit_sha	`2c5960b`	`36fac41`
release_version	1.51.1-SNAPSHOT~2c5960be47	1.51.1-SNAPSHOT~36fac41ac8

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1753897576	1753897576
ci_job_id	1056018478	1056018478
ci_pipeline_id	72205621	72205621
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-1-hea5sxz7 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-1-hea5sxz7 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 2 performance regressions! Performance is the same for 9 metrics, 12 unstable metrics.

scenario	Δ mean http_req_duration	Δ mean throughput	candidate mean http_req_duration	candidate mean throughput	baseline mean http_req_duration	baseline mean throughput
scenario:load:insecure-bank:profiling:high_load	worse [+487.384µs; +822.787µs] or [+5.578%; +9.417%]	unstable [-102.791op/s; +29.103op/s] or [-19.358%; +5.481%]	9.393ms	494.156op/s	8.738ms	531.000op/s
scenario:load:insecure-bank:iast_GLOBAL:high_load	worse [+206.757µs; +579.608µs] or [+2.098%; +5.881%]	unstable [-71.374op/s; +35.936op/s] or [-15.148%; +7.627%]	10.248ms	453.469op/s	9.855ms	471.188op/s
scenario:load:petclinic:iast:high_load	better [-1.920ms; -1.099ms] or [-4.240%; -2.425%]	unstable [-3.947op/s; +11.097op/s] or [-3.822%; +10.746%]	43.790ms	106.838op/s	45.300ms	103.263op/s

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.51.1-SNAPSHOT~36fac41ac8, baseline=1.51.1-SNAPSHOT~2c5960be47
    dateFormat X
    axisFormat %s
section baseline
no_agent (4.334 ms) : 4285, 4384
.   : milestone, 4334,
iast (9.387 ms) : 9230, 9544
.   : milestone, 9387,
iast_FULL (14.045 ms) : 13763, 14327
.   : milestone, 14045,
iast_GLOBAL (9.855 ms) : 9685, 10025
.   : milestone, 9855,
profiling (8.738 ms) : 8584, 8891
.   : milestone, 8738,
tracing (7.541 ms) : 7418, 7664
.   : milestone, 7541,
section candidate
no_agent (4.463 ms) : 4414, 4512
.   : milestone, 4463,
iast (9.456 ms) : 9303, 9610
.   : milestone, 9456,
iast_FULL (13.766 ms) : 13496, 14035
.   : milestone, 13766,
iast_GLOBAL (10.248 ms) : 10072, 10425
.   : milestone, 10248,
profiling (9.393 ms) : 9235, 9551
.   : milestone, 9393,
tracing (7.735 ms) : 7607, 7863
.   : milestone, 7735,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	4.334 ms [4.285 ms, 4.384 ms]	-
iast	9.387 ms [9.23 ms, 9.544 ms]	5.052 ms (116.6%)
iast_FULL	14.045 ms [13.763 ms, 14.327 ms]	9.711 ms (224.0%)
iast_GLOBAL	9.855 ms [9.685 ms, 10.025 ms]	5.521 ms (127.4%)
profiling	8.738 ms [8.584 ms, 8.891 ms]	4.403 ms (101.6%)
tracing	7.541 ms [7.418 ms, 7.664 ms]	3.206 ms (74.0%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	4.463 ms [4.414 ms, 4.512 ms]	-
iast	9.456 ms [9.303 ms, 9.61 ms]	4.994 ms (111.9%)
iast_FULL	13.766 ms [13.496 ms, 14.035 ms]	9.303 ms (208.5%)
iast_GLOBAL	10.248 ms [10.072 ms, 10.425 ms]	5.785 ms (129.6%)
profiling	9.393 ms [9.235 ms, 9.551 ms]	4.93 ms (110.5%)
tracing	7.735 ms [7.607 ms, 7.863 ms]	3.272 ms (73.3%)

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.51.1-SNAPSHOT~36fac41ac8, baseline=1.51.1-SNAPSHOT~2c5960be47
    dateFormat X
    axisFormat %s
section baseline
no_agent (36.646 ms) : 36346, 36945
.   : milestone, 36646,
appsec (48.155 ms) : 47715, 48595
.   : milestone, 48155,
code_origins (44.428 ms) : 44038, 44818
.   : milestone, 44428,
iast (45.3 ms) : 44910, 45690
.   : milestone, 45300,
profiling (48.379 ms) : 47927, 48831
.   : milestone, 48379,
tracing (43.378 ms) : 43007, 43749
.   : milestone, 43378,
section candidate
no_agent (36.469 ms) : 36178, 36760
.   : milestone, 36469,
appsec (47.362 ms) : 46930, 47794
.   : milestone, 47362,
code_origins (45.577 ms) : 45185, 45968
.   : milestone, 45577,
iast (43.79 ms) : 43416, 44164
.   : milestone, 43790,
profiling (47.361 ms) : 46946, 47777
.   : milestone, 47361,
tracing (44.144 ms) : 43761, 44527
.   : milestone, 44144,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	36.646 ms [36.346 ms, 36.945 ms]	-
appsec	48.155 ms [47.715 ms, 48.595 ms]	11.509 ms (31.4%)
code_origins	44.428 ms [44.038 ms, 44.818 ms]	7.782 ms (21.2%)
iast	45.3 ms [44.91 ms, 45.69 ms]	8.654 ms (23.6%)
profiling	48.379 ms [47.927 ms, 48.831 ms]	11.734 ms (32.0%)
tracing	43.378 ms [43.007 ms, 43.749 ms]	6.733 ms (18.4%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	36.469 ms [36.178 ms, 36.76 ms]	-
appsec	47.362 ms [46.93 ms, 47.794 ms]	10.894 ms (29.9%)
code_origins	45.577 ms [45.185 ms, 45.968 ms]	9.108 ms (25.0%)
iast	43.79 ms [43.416 ms, 44.164 ms]	7.322 ms (20.1%)
profiling	47.361 ms [46.946 ms, 47.777 ms]	10.893 ms (29.9%)
tracing	44.144 ms [43.761 ms, 44.527 ms]	7.675 ms (21.0%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	alexeyk/jmh-align-version
git_commit_date	1753877213	1753895879
git_commit_sha	`2c5960b`	`36fac41`
release_version	1.51.1-SNAPSHOT~2c5960be47	1.51.1-SNAPSHOT~36fac41ac8

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1753898083	1753898083
ci_job_id	1056018482	1056018482
ci_pipeline_id	72205621	72205621
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-2-ezxrynrl 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-2-ezxrynrl 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.51.1-SNAPSHOT~36fac41ac8, baseline=1.51.1-SNAPSHOT~2c5960be47
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.145 s) : 15145000, 15145000
.   : milestone, 15145000,
appsec (14.842 s) : 14842000, 14842000
.   : milestone, 14842000,
iast (18.654 s) : 18654000, 18654000
.   : milestone, 18654000,
iast_GLOBAL (18.168 s) : 18168000, 18168000
.   : milestone, 18168000,
profiling (15.842 s) : 15842000, 15842000
.   : milestone, 15842000,
tracing (15.013 s) : 15013000, 15013000
.   : milestone, 15013000,
section candidate
no_agent (15.299 s) : 15299000, 15299000
.   : milestone, 15299000,
appsec (14.783 s) : 14783000, 14783000
.   : milestone, 14783000,
iast (18.959 s) : 18959000, 18959000
.   : milestone, 18959000,
iast_GLOBAL (18.289 s) : 18289000, 18289000
.   : milestone, 18289000,
profiling (15.683 s) : 15683000, 15683000
.   : milestone, 15683000,
tracing (15.146 s) : 15146000, 15146000
.   : milestone, 15146000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.145 s [15.145 s, 15.145 s]	-
appsec	14.842 s [14.842 s, 14.842 s]	-303.0 ms (-2.0%)
iast	18.654 s [18.654 s, 18.654 s]	3.509 s (23.2%)
iast_GLOBAL	18.168 s [18.168 s, 18.168 s]	3.023 s (20.0%)
profiling	15.842 s [15.842 s, 15.842 s]	697.0 ms (4.6%)
tracing	15.013 s [15.013 s, 15.013 s]	-132.0 ms (-0.9%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.299 s [15.299 s, 15.299 s]	-
appsec	14.783 s [14.783 s, 14.783 s]	-516.0 ms (-3.4%)
iast	18.959 s [18.959 s, 18.959 s]	3.66 s (23.9%)
iast_GLOBAL	18.289 s [18.289 s, 18.289 s]	2.99 s (19.5%)
profiling	15.683 s [15.683 s, 15.683 s]	384.0 ms (2.5%)
tracing	15.146 s [15.146 s, 15.146 s]	-153.0 ms (-1.0%)

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.51.1-SNAPSHOT~36fac41ac8, baseline=1.51.1-SNAPSHOT~2c5960be47
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.477 ms) : 1466, 1489
.   : milestone, 1477,
appsec (3.517 ms) : 3309, 3724
.   : milestone, 3517,
iast (2.199 ms) : 2137, 2262
.   : milestone, 2199,
iast_GLOBAL (2.243 ms) : 2180, 2306
.   : milestone, 2243,
profiling (2.031 ms) : 1981, 2081
.   : milestone, 2031,
tracing (2.012 ms) : 1963, 2061
.   : milestone, 2012,
section candidate
no_agent (1.473 ms) : 1461, 1484
.   : milestone, 1473,
appsec (3.634 ms) : 3417, 3852
.   : milestone, 3634,
iast (2.202 ms) : 2139, 2265
.   : milestone, 2202,
iast_GLOBAL (2.241 ms) : 2178, 2304
.   : milestone, 2241,
profiling (2.063 ms) : 2011, 2115
.   : milestone, 2063,
tracing (2.023 ms) : 1974, 2073
.   : milestone, 2023,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.477 ms [1.466 ms, 1.489 ms]	-
appsec	3.517 ms [3.309 ms, 3.724 ms]	2.04 ms (138.1%)
iast	2.199 ms [2.137 ms, 2.262 ms]	722.377 µs (48.9%)
iast_GLOBAL	2.243 ms [2.18 ms, 2.306 ms]	765.618 µs (51.8%)
profiling	2.031 ms [1.981 ms, 2.081 ms]	553.907 µs (37.5%)
tracing	2.012 ms [1.963 ms, 2.061 ms]	534.855 µs (36.2%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.473 ms [1.461 ms, 1.484 ms]	-
appsec	3.634 ms [3.417 ms, 3.852 ms]	2.162 ms (146.8%)
iast	2.202 ms [2.139 ms, 2.265 ms]	729.328 µs (49.5%)
iast_GLOBAL	2.241 ms [2.178 ms, 2.304 ms]	768.331 µs (52.2%)
profiling	2.063 ms [2.011 ms, 2.115 ms]	590.715 µs (40.1%)
tracing	2.023 ms [1.974 ms, 2.073 ms]	550.959 µs (37.4%)

Signed-off-by: Nayeem Kamal <[email protected]>

Align the JMH version in project.

36fac41

AlexeyKuznetsov-DD self-assigned this Jul 30, 2025

AlexeyKuznetsov-DD added tag: no release notes Changes to exclude from release notes comp: tooling Build & Tooling labels Jul 30, 2025

AlexeyKuznetsov-DD marked this pull request as ready for review July 30, 2025 17:21

AlexeyKuznetsov-DD requested review from a team as code owners July 30, 2025 17:21

AlexeyKuznetsov-DD requested review from robertpi, sezen-datadog, dougqh, bric3 and PerfectSlayer and removed request for a team July 30, 2025 17:21

mhlidd approved these changes Jul 30, 2025

View reviewed changes

bric3 approved these changes Jul 30, 2025

View reviewed changes

AlexeyKuznetsov-DD merged commit 3a35f77 into master Jul 31, 2025
508 checks passed

AlexeyKuznetsov-DD deleted the alexeyk/jmh-align-version branch July 31, 2025 13:30

github-actions bot added this to the 1.52.0 milestone Jul 31, 2025

nayeem-kamal pushed a commit that referenced this pull request Aug 4, 2025

Align the JMH version in project. (#9281)

f0fc78e

Signed-off-by: Nayeem Kamal <[email protected]>

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Align the JMH version in project. #9281

Align the JMH version in project. #9281

Uh oh!

AlexeyKuznetsov-DD commented Jul 30, 2025

Uh oh!

pr-commenter bot commented Jul 30, 2025

Uh oh!

Uh oh!

Uh oh!

Align the JMH version in project. #9281

Align the JMH version in project. #9281

Uh oh!

Conversation

AlexeyKuznetsov-DD commented Jul 30, 2025

What Does This Do

Motivation

Uh oh!

pr-commenter bot commented Jul 30, 2025

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

Uh oh!

Uh oh!

Uh oh!