Migrate Maven instrumentation and Ut8Cache tests to JUnit 5 #9568

daniel-mohedano · 2025-09-19T10:13:54Z

What Does This Do

Migrate tests still using JUnit 4's org.junit.test to JUnit 5.

Motivation

Without these changes, the tests were not being discovered by Gradle and not run.

Additional Notes

Contributor Checklist

Format the title according the contribution guidelines
Assign the type: and (comp: or inst:) labels in addition to any usefull labels
Don't use close, fix or any linking keywords when referencing an issue.
Use solves instead, and assign the PR milestone to the issue
Update the CODEOWNERS file on source file addition, move, or deletion
Update the public documentation in case of new configuration flag or behavior

Jira ticket: [PROJ-IDENT]

pr-commenter · 2025-09-19T11:08:36Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	daniel.mohedano/maven-instrumentation-junit5
git_commit_date	1758286417	1758291697
git_commit_sha	`abb87ab`	`67f1cf7`
release_version	1.54.0-SNAPSHOT~abb87aba78	1.54.0-SNAPSHOT~67f1cf75fc

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1758293488	1758293488
ci_job_id	1138413726	1138413726
ci_pipeline_id	76992472	76992472
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-4b4z2fcf 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-4b4z2fcf 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None

Summary

Found 2 performance improvements and 13 performance regressions! Performance is the same for 32 metrics, 12 unstable metrics.

scenario	Δ mean execution_time	candidate mean execution_time	baseline mean execution_time
scenario:startup:insecure-bank:iast:Agent.start	worse [+31.885ms; +43.689ms] or [+2.764%; +3.787%]	1.191s	1.154s
scenario:startup:insecure-bank:iast:BytebuddyAgent	worse [+40.124ms; +48.559ms] or [+4.962%; +6.005%]	853.031ms	808.690ms
scenario:startup:insecure-bank:tracing:Agent.start	worse [+34.994ms; +67.105ms] or [+3.439%; +6.594%]	1.069s	1.018s
scenario:startup:insecure-bank:tracing:BytebuddyAgent	worse [+36.526ms; +61.401ms] or [+5.305%; +8.918%]	737.463ms	688.499ms
scenario:startup:petclinic:appsec:BytebuddyAgent	worse [+29.678ms; +50.376ms] or [+4.139%; +7.025%]	757.122ms	717.095ms
scenario:startup:petclinic:appsec:IAST	better [-1.551ms; -0.703ms] or [-6.226%; -2.822%]	23.779ms	24.906ms
scenario:startup:petclinic:iast:Agent.start	worse [+32.341ms; +42.244ms] or [+2.803%; +3.662%]	1.191s	1.154s
scenario:startup:petclinic:iast:BytebuddyAgent	worse [+41.041ms; +47.827ms] or [+5.078%; +5.918%]	852.587ms	808.153ms
scenario:startup:petclinic:profiling:Agent.start	worse [+36.845ms; +64.139ms] or [+3.162%; +5.504%]	1.216s	1.165s
scenario:startup:petclinic:profiling:ProfilingAgent	worse [+5.906ms; +7.766ms] or [+5.814%; +7.645%]	108.417ms	101.581ms
scenario:startup:petclinic:profiling:BytebuddyAgent	worse [+36.409ms; +55.691ms] or [+5.059%; +7.738%]	765.767ms	719.717ms
scenario:startup:petclinic:profiling:Profiling	worse [+6.000ms; +7.829ms] or [+5.872%; +7.662%]	109.097ms	102.182ms
scenario:startup:petclinic:tracing:Agent.start	worse [+21.296ms; +49.391ms] or [+2.080%; +4.824%]	1.059s	1.024s
scenario:startup:petclinic:tracing:BytebuddyAgent	worse [+29.571ms; +48.997ms] or [+4.274%; +7.081%]	731.232ms	691.948ms
scenario:startup:petclinic:tracing:AppSec	better [-1.987ms; -0.907ms] or [-6.216%; -2.838%]	30.527ms	31.974ms

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.54.0-SNAPSHOT~67f1cf75fc, baseline=1.54.0-SNAPSHOT~abb87aba78

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.018 s) : 0, 1017669
Total [baseline] (8.625 s) : 0, 8624982
Agent [candidate] (1.069 s) : 0, 1068718
Total [candidate] (8.632 s) : 0, 8632171
section iast
Agent [baseline] (1.154 s) : 0, 1153561
Total [baseline] (9.388 s) : 0, 9387885
Agent [candidate] (1.191 s) : 0, 1191348
Total [candidate] (9.284 s) : 0, 9284129

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.018 s	-
Agent	iast	1.154 s	135.892 ms (13.4%)
Total	tracing	8.625 s	-
Total	iast	9.388 s	762.902 ms (8.8%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.069 s	-
Agent	iast	1.191 s	122.63 ms (11.5%)
Total	tracing	8.632 s	-
Total	iast	9.284 s	651.958 ms (7.6%)

gantt
    title insecure-bank - break down per module: candidate=1.54.0-SNAPSHOT~67f1cf75fc, baseline=1.54.0-SNAPSHOT~abb87aba78

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.465 ms) : 0, 1465
crashtracking [candidate] (1.464 ms) : 0, 1464
BytebuddyAgent [baseline] (688.499 ms) : 0, 688499
BytebuddyAgent [candidate] (737.463 ms) : 0, 737463
GlobalTracer [baseline] (257.789 ms) : 0, 257789
GlobalTracer [candidate] (254.346 ms) : 0, 254346
AppSec [baseline] (31.581 ms) : 0, 31581
AppSec [candidate] (30.762 ms) : 0, 30762
Debugger [baseline] (6.344 ms) : 0, 6344
Debugger [candidate] (6.413 ms) : 0, 6413
Remote Config [baseline] (684.271 µs) : 0, 684
Remote Config [candidate] (700.633 µs) : 0, 701
Telemetry [baseline] (10.334 ms) : 0, 10334
Telemetry [candidate] (16.488 ms) : 0, 16488
section iast
crashtracking [baseline] (1.455 ms) : 0, 1455
crashtracking [candidate] (1.463 ms) : 0, 1463
BytebuddyAgent [baseline] (808.69 ms) : 0, 808690
BytebuddyAgent [candidate] (853.031 ms) : 0, 853031
GlobalTracer [baseline] (248.933 ms) : 0, 248933
GlobalTracer [candidate] (249.192 ms) : 0, 249192
IAST [baseline] (30.661 ms) : 0, 30661
IAST [candidate] (25.39 ms) : 0, 25390
AppSec [baseline] (28.07 ms) : 0, 28070
AppSec [candidate] (26.364 ms) : 0, 26364
Debugger [baseline] (6.128 ms) : 0, 6128
Debugger [candidate] (6.036 ms) : 0, 6036
Remote Config [baseline] (600.346 µs) : 0, 600
Remote Config [candidate] (596.771 µs) : 0, 597
Telemetry [baseline] (8.134 ms) : 0, 8134
Telemetry [candidate] (8.242 ms) : 0, 8242

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.54.0-SNAPSHOT~67f1cf75fc, baseline=1.54.0-SNAPSHOT~abb87aba78

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.024 s) : 0, 1023880
Total [baseline] (10.743 s) : 0, 10743407
Agent [candidate] (1.059 s) : 0, 1059224
Total [candidate] (10.695 s) : 0, 10694932
section appsec
Agent [baseline] (1.205 s) : 0, 1204806
Total [baseline] (11.031 s) : 0, 11030502
Agent [candidate] (1.237 s) : 0, 1237174
Total [candidate] (11.108 s) : 0, 11108035
section iast
Agent [baseline] (1.154 s) : 0, 1153683
Total [baseline] (11.068 s) : 0, 11067536
Agent [candidate] (1.191 s) : 0, 1190976
Total [candidate] (11.065 s) : 0, 11064913
section profiling
Agent [baseline] (1.165 s) : 0, 1165265
Total [baseline] (11.06 s) : 0, 11059962
Agent [candidate] (1.216 s) : 0, 1215757
Total [candidate] (10.95 s) : 0, 10949757

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.024 s	-
Agent	appsec	1.205 s	180.926 ms (17.7%)
Agent	iast	1.154 s	129.803 ms (12.7%)
Agent	profiling	1.165 s	141.384 ms (13.8%)
Total	tracing	10.743 s	-
Total	appsec	11.031 s	287.095 ms (2.7%)
Total	iast	11.068 s	324.129 ms (3.0%)
Total	profiling	11.06 s	316.555 ms (2.9%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.059 s	-
Agent	appsec	1.237 s	177.95 ms (16.8%)
Agent	iast	1.191 s	131.752 ms (12.4%)
Agent	profiling	1.216 s	156.533 ms (14.8%)
Total	tracing	10.695 s	-
Total	appsec	11.108 s	413.103 ms (3.9%)
Total	iast	11.065 s	369.981 ms (3.5%)
Total	profiling	10.95 s	254.825 ms (2.4%)

gantt
    title petclinic - break down per module: candidate=1.54.0-SNAPSHOT~67f1cf75fc, baseline=1.54.0-SNAPSHOT~abb87aba78

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.476 ms) : 0, 1476
crashtracking [candidate] (1.448 ms) : 0, 1448
BytebuddyAgent [baseline] (691.948 ms) : 0, 691948
BytebuddyAgent [candidate] (731.232 ms) : 0, 731232
GlobalTracer [baseline] (260.493 ms) : 0, 260493
GlobalTracer [candidate] (252.641 ms) : 0, 252641
AppSec [baseline] (31.974 ms) : 0, 31974
AppSec [candidate] (30.527 ms) : 0, 30527
Debugger [baseline] (6.374 ms) : 0, 6374
Debugger [candidate] (6.378 ms) : 0, 6378
Remote Config [baseline] (692.295 µs) : 0, 692
Remote Config [candidate] (684.863 µs) : 0, 685
Telemetry [baseline] (9.74 ms) : 0, 9740
Telemetry [candidate] (15.343 ms) : 0, 15343
section appsec
crashtracking [baseline] (1.462 ms) : 0, 1462
crashtracking [candidate] (1.44 ms) : 0, 1440
BytebuddyAgent [baseline] (717.095 ms) : 0, 717095
BytebuddyAgent [candidate] (757.122 ms) : 0, 757122
GlobalTracer [baseline] (252.462 ms) : 0, 252462
GlobalTracer [candidate] (246.821 ms) : 0, 246821
IAST [baseline] (24.906 ms) : 0, 24906
IAST [candidate] (23.779 ms) : 0, 23779
AppSec [baseline] (170.214 ms) : 0, 170214
AppSec [candidate] (171.594 ms) : 0, 171594
Debugger [baseline] (6.124 ms) : 0, 6124
Debugger [candidate] (6.023 ms) : 0, 6023
Remote Config [baseline] (624.164 µs) : 0, 624
Remote Config [candidate] (636.852 µs) : 0, 637
Telemetry [baseline] (10.727 ms) : 0, 10727
Telemetry [candidate] (8.58 ms) : 0, 8580
section iast
crashtracking [baseline] (1.463 ms) : 0, 1463
crashtracking [candidate] (1.457 ms) : 0, 1457
BytebuddyAgent [baseline] (808.153 ms) : 0, 808153
BytebuddyAgent [candidate] (852.587 ms) : 0, 852587
GlobalTracer [baseline] (249.469 ms) : 0, 249469
GlobalTracer [candidate] (246.674 ms) : 0, 246674
IAST [baseline] (31.468 ms) : 0, 31468
IAST [candidate] (27.289 ms) : 0, 27289
AppSec [baseline] (26.428 ms) : 0, 26428
AppSec [candidate] (26.95 ms) : 0, 26950
Debugger [baseline] (6.161 ms) : 0, 6161
Debugger [candidate] (6.032 ms) : 0, 6032
Remote Config [baseline] (597.003 µs) : 0, 597
Remote Config [candidate] (602.136 µs) : 0, 602
Telemetry [baseline] (8.958 ms) : 0, 8958
Telemetry [candidate] (8.359 ms) : 0, 8359
section profiling
crashtracking [baseline] (1.443 ms) : 0, 1443
crashtracking [candidate] (1.442 ms) : 0, 1442
BytebuddyAgent [baseline] (719.717 ms) : 0, 719717
BytebuddyAgent [candidate] (765.767 ms) : 0, 765767
GlobalTracer [baseline] (236.688 ms) : 0, 236688
GlobalTracer [candidate] (234.452 ms) : 0, 234452
AppSec [baseline] (31.117 ms) : 0, 31117
AppSec [candidate] (30.31 ms) : 0, 30310
Debugger [baseline] (6.514 ms) : 0, 6514
Debugger [candidate] (12.956 ms) : 0, 12956
Remote Config [baseline] (719.747 µs) : 0, 720
Remote Config [candidate] (1.577 ms) : 0, 1577
Telemetry [baseline] (16.504 ms) : 0, 16504
Telemetry [candidate] (9.476 ms) : 0, 9476
ProfilingAgent [baseline] (101.581 ms) : 0, 101581
ProfilingAgent [candidate] (108.417 ms) : 0, 108417
Profiling [baseline] (102.182 ms) : 0, 102182
Profiling [candidate] (109.097 ms) : 0, 109097

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	daniel.mohedano/maven-instrumentation-junit5
git_commit_date	1758286417	1758291697
git_commit_sha	`abb87ab`	`67f1cf7`
release_version	1.54.0-SNAPSHOT~abb87aba78	1.54.0-SNAPSHOT~67f1cf75fc

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1758293162	1758293162
ci_job_id	1138413728	1138413728
ci_pipeline_id	76992472	76992472
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-1-zcwixfw2 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-1-zcwixfw2 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 3 performance improvements and 2 performance regressions! Performance is the same for 7 metrics, 12 unstable metrics.

scenario	Δ mean http_req_duration	Δ mean throughput	candidate mean http_req_duration	candidate mean throughput	baseline mean http_req_duration	baseline mean throughput
scenario:load:insecure-bank:tracing:high_load	worse [+208.919µs; +450.543µs] or [+2.745%; +5.920%]	unstable [-98.178op/s; +48.303op/s] or [-16.136%; +7.939%]	7.940ms	583.500op/s	7.610ms	608.438op/s
scenario:load:insecure-bank:profiling:high_load	better [-508.807µs; -192.518µs] or [-5.491%; -2.078%]	unstable [-44.520op/s; +83.145op/s] or [-8.888%; +16.599%]	8.915ms	520.219op/s	9.266ms	500.906op/s
scenario:load:insecure-bank:no_agent:high_load	worse [+218.913µs; +327.713µs] or [+5.290%; +7.919%]	unstable [-184.633op/s; +49.820op/s] or [-16.667%; +4.497%]	4.412ms	1040.344op/s	4.138ms	1107.750op/s
scenario:load:insecure-bank:iast:high_load	better [-1083.802µs; -706.392µs] or [-10.261%; -6.688%]	unstable [-14.025op/s; +94.650op/s] or [-3.187%; +21.508%]	9.667ms	480.375op/s	10.562ms	440.062op/s
scenario:load:insecure-bank:iast_FULL:high_load	better [-981.161µs; -352.886µs] or [-6.603%; -2.375%]	unstable [-22.283op/s; +51.533op/s] or [-7.104%; +16.428%]	14.193ms	328.312op/s	14.860ms	313.688op/s

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.54.0-SNAPSHOT~67f1cf75fc, baseline=1.54.0-SNAPSHOT~abb87aba78
    dateFormat X
    axisFormat %s
section baseline
no_agent (4.138 ms) : 4089, 4187
.   : milestone, 4138,
iast (10.562 ms) : 10373, 10751
.   : milestone, 10562,
iast_FULL (14.86 ms) : 14565, 15155
.   : milestone, 14860,
iast_GLOBAL (10.941 ms) : 10747, 11134
.   : milestone, 10941,
profiling (9.266 ms) : 9118, 9414
.   : milestone, 9266,
tracing (7.61 ms) : 7501, 7719
.   : milestone, 7610,
section candidate
no_agent (4.412 ms) : 4360, 4463
.   : milestone, 4412,
iast (9.667 ms) : 9506, 9828
.   : milestone, 9667,
iast_FULL (14.193 ms) : 13905, 14482
.   : milestone, 14193,
iast_GLOBAL (10.626 ms) : 10426, 10826
.   : milestone, 10626,
profiling (8.915 ms) : 8769, 9061
.   : milestone, 8915,
tracing (7.94 ms) : 7824, 8056
.   : milestone, 7940,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	4.138 ms [4.089 ms, 4.187 ms]	-
iast	10.562 ms [10.373 ms, 10.751 ms]	6.424 ms (155.2%)
iast_FULL	14.86 ms [14.565 ms, 15.155 ms]	10.722 ms (259.1%)
iast_GLOBAL	10.941 ms [10.747 ms, 11.134 ms]	6.803 ms (164.4%)
profiling	9.266 ms [9.118 ms, 9.414 ms]	5.128 ms (123.9%)
tracing	7.61 ms [7.501 ms, 7.719 ms]	3.472 ms (83.9%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	4.412 ms [4.36 ms, 4.463 ms]	-
iast	9.667 ms [9.506 ms, 9.828 ms]	5.255 ms (119.1%)
iast_FULL	14.193 ms [13.905 ms, 14.482 ms]	9.782 ms (221.7%)
iast_GLOBAL	10.626 ms [10.426 ms, 10.826 ms]	6.215 ms (140.9%)
profiling	8.915 ms [8.769 ms, 9.061 ms]	4.504 ms (102.1%)
tracing	7.94 ms [7.824 ms, 8.056 ms]	3.528 ms (80.0%)

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.54.0-SNAPSHOT~67f1cf75fc, baseline=1.54.0-SNAPSHOT~abb87aba78
    dateFormat X
    axisFormat %s
section baseline
no_agent (36.77 ms) : 36469, 37071
.   : milestone, 36770,
appsec (48.788 ms) : 48355, 49221
.   : milestone, 48788,
code_origins (45.642 ms) : 45244, 46040
.   : milestone, 45642,
iast (44.922 ms) : 44513, 45331
.   : milestone, 44922,
profiling (50.024 ms) : 49496, 50552
.   : milestone, 50024,
tracing (44.548 ms) : 44170, 44925
.   : milestone, 44548,
section candidate
no_agent (36.627 ms) : 36335, 36918
.   : milestone, 36627,
appsec (48.44 ms) : 48014, 48866
.   : milestone, 48440,
code_origins (45.869 ms) : 45469, 46269
.   : milestone, 45869,
iast (44.384 ms) : 43995, 44773
.   : milestone, 44384,
profiling (48.498 ms) : 48029, 48966
.   : milestone, 48498,
tracing (43.85 ms) : 43468, 44232
.   : milestone, 43850,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	36.77 ms [36.469 ms, 37.071 ms]	-
appsec	48.788 ms [48.355 ms, 49.221 ms]	12.018 ms (32.7%)
code_origins	45.642 ms [45.244 ms, 46.04 ms]	8.872 ms (24.1%)
iast	44.922 ms [44.513 ms, 45.331 ms]	8.152 ms (22.2%)
profiling	50.024 ms [49.496 ms, 50.552 ms]	13.254 ms (36.0%)
tracing	44.548 ms [44.17 ms, 44.925 ms]	7.778 ms (21.2%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	36.627 ms [36.335 ms, 36.918 ms]	-
appsec	48.44 ms [48.014 ms, 48.866 ms]	11.814 ms (32.3%)
code_origins	45.869 ms [45.469 ms, 46.269 ms]	9.242 ms (25.2%)
iast	44.384 ms [43.995 ms, 44.773 ms]	7.757 ms (21.2%)
profiling	48.498 ms [48.029 ms, 48.966 ms]	11.871 ms (32.4%)
tracing	43.85 ms [43.468 ms, 44.232 ms]	7.223 ms (19.7%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	daniel.mohedano/maven-instrumentation-junit5
git_commit_date	1758286417	1758291697
git_commit_sha	`abb87ab`	`67f1cf7`
release_version	1.54.0-SNAPSHOT~abb87aba78	1.54.0-SNAPSHOT~67f1cf75fc

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1758293624	1758293624
ci_job_id	1138413729	1138413729
ci_pipeline_id	76992472	76992472
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-ljzhxyku 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-ljzhxyku 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 10 metrics, 2 unstable metrics.

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.54.0-SNAPSHOT~67f1cf75fc, baseline=1.54.0-SNAPSHOT~abb87aba78
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.479 ms) : 1468, 1491
.   : milestone, 1479,
appsec (2.445 ms) : 2395, 2494
.   : milestone, 2445,
iast (2.201 ms) : 2139, 2264
.   : milestone, 2201,
iast_GLOBAL (2.249 ms) : 2186, 2311
.   : milestone, 2249,
profiling (2.068 ms) : 2016, 2120
.   : milestone, 2068,
tracing (2.038 ms) : 1989, 2087
.   : milestone, 2038,
section candidate
no_agent (1.474 ms) : 1463, 1486
.   : milestone, 1474,
appsec (3.75 ms) : 3532, 3968
.   : milestone, 3750,
iast (2.214 ms) : 2151, 2277
.   : milestone, 2214,
iast_GLOBAL (2.244 ms) : 2181, 2307
.   : milestone, 2244,
profiling (2.369 ms) : 2225, 2514
.   : milestone, 2369,
tracing (2.038 ms) : 1989, 2088
.   : milestone, 2038,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.479 ms [1.468 ms, 1.491 ms]	-
appsec	2.445 ms [2.395 ms, 2.494 ms]	965.218 µs (65.2%)
iast	2.201 ms [2.139 ms, 2.264 ms]	721.977 µs (48.8%)
iast_GLOBAL	2.249 ms [2.186 ms, 2.311 ms]	769.2 µs (52.0%)
profiling	2.068 ms [2.016 ms, 2.12 ms]	588.548 µs (39.8%)
tracing	2.038 ms [1.989 ms, 2.087 ms]	558.619 µs (37.8%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.474 ms [1.463 ms, 1.486 ms]	-
appsec	3.75 ms [3.532 ms, 3.968 ms]	2.276 ms (154.4%)
iast	2.214 ms [2.151 ms, 2.277 ms]	739.905 µs (50.2%)
iast_GLOBAL	2.244 ms [2.181 ms, 2.307 ms]	769.726 µs (52.2%)
profiling	2.369 ms [2.225 ms, 2.514 ms]	895.229 µs (60.7%)
tracing	2.038 ms [1.989 ms, 2.088 ms]	564.042 µs (38.3%)

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.54.0-SNAPSHOT~67f1cf75fc, baseline=1.54.0-SNAPSHOT~abb87aba78
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.395 s) : 15395000, 15395000
.   : milestone, 15395000,
appsec (15.16 s) : 15160000, 15160000
.   : milestone, 15160000,
iast (18.356 s) : 18356000, 18356000
.   : milestone, 18356000,
iast_GLOBAL (18.406 s) : 18406000, 18406000
.   : milestone, 18406000,
profiling (16.01 s) : 16010000, 16010000
.   : milestone, 16010000,
tracing (15.182 s) : 15182000, 15182000
.   : milestone, 15182000,
section candidate
no_agent (14.969 s) : 14969000, 14969000
.   : milestone, 14969000,
appsec (14.946 s) : 14946000, 14946000
.   : milestone, 14946000,
iast (18.92 s) : 18920000, 18920000
.   : milestone, 18920000,
iast_GLOBAL (18.113 s) : 18113000, 18113000
.   : milestone, 18113000,
profiling (15.582 s) : 15582000, 15582000
.   : milestone, 15582000,
tracing (15.065 s) : 15065000, 15065000
.   : milestone, 15065000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.395 s [15.395 s, 15.395 s]	-
appsec	15.16 s [15.16 s, 15.16 s]	-235.0 ms (-1.5%)
iast	18.356 s [18.356 s, 18.356 s]	2.961 s (19.2%)
iast_GLOBAL	18.406 s [18.406 s, 18.406 s]	3.011 s (19.6%)
profiling	16.01 s [16.01 s, 16.01 s]	615.0 ms (4.0%)
tracing	15.182 s [15.182 s, 15.182 s]	-213.0 ms (-1.4%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	14.969 s [14.969 s, 14.969 s]	-
appsec	14.946 s [14.946 s, 14.946 s]	-23.0 ms (-0.2%)
iast	18.92 s [18.92 s, 18.92 s]	3.951 s (26.4%)
iast_GLOBAL	18.113 s [18.113 s, 18.113 s]	3.144 s (21.0%)
profiling	15.582 s [15.582 s, 15.582 s]	613.0 ms (4.1%)
tracing	15.065 s [15.065 s, 15.065 s]	96.0 ms (0.6%)

- updating tests to not use magic number and use MAX_ENTRY_LEN of their respective cache - had to make MAX_ENTRY_LEN package visible in both caches

datadog-official · 2025-09-19T13:29:07Z

🎯 Code Coverage
• Patch Coverage: 100.00%
• Total Coverage: 63.14% (+3.36%)

View detailed report

_{This comment will be updated automatically if new data arrives.

🔗 Commit SHA: 67f1cf7 | Docs | Was this helpful? Give us feedback!}

daniel-mohedano added 2 commits September 19, 2025 12:09

fix: migrate to JUnit 5

8e3c698

fix: add maven tests back

7d582cc

daniel-mohedano added comp: testing Testing tag: no release notes Changes to exclude from release notes labels Sep 19, 2025

fix: add new line to stat

3ccd7f5

nikita-tkachenko-datadog approved these changes Sep 19, 2025

View reviewed changes

AlexeyKuznetsov-DD approved these changes Sep 19, 2025

View reviewed changes

daniel-mohedano marked this pull request as ready for review September 19, 2025 12:41

daniel-mohedano requested review from a team as code owners September 19, 2025 12:41

daniel-mohedano requested review from Mariovido and amarziali September 19, 2025 12:41

Making bigStrings no cache tests more reliable

1d17958

- updating tests to not use magic number and use MAX_ENTRY_LEN of their respective cache - had to make MAX_ENTRY_LEN package visible in both caches

fix: tempdir usage without getRoot

67f1cf7

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Migrate Maven instrumentation and Ut8Cache tests to JUnit 5 #9568

Migrate Maven instrumentation and Ut8Cache tests to JUnit 5 #9568

Uh oh!

daniel-mohedano commented Sep 19, 2025

Uh oh!

pr-commenter bot commented Sep 19, 2025 •

edited

Loading

Uh oh!

datadog-official bot commented Sep 19, 2025 •

edited by datadog-datadog-prod-us1 bot

Loading

Uh oh!

Uh oh!

Migrate Maven instrumentation and Ut8Cache tests to JUnit 5 #9568

Are you sure you want to change the base?

Migrate Maven instrumentation and Ut8Cache tests to JUnit 5 #9568

Uh oh!

Conversation

daniel-mohedano commented Sep 19, 2025

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Uh oh!

pr-commenter bot commented Sep 19, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

Uh oh!

datadog-official bot commented Sep 19, 2025 • edited by datadog-datadog-prod-us1 bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Uh oh!

pr-commenter bot commented Sep 19, 2025 •

edited

Loading

datadog-official bot commented Sep 19, 2025 •

edited by datadog-datadog-prod-us1 bot

Loading