Thanks to visit codestin.com
Credit goes to github.com

Skip to content

Add graalvm25 image to testing #9562

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Draft
wants to merge 6 commits into
base: master
Choose a base branch
from
Draft

Add graalvm25 image to testing #9562

wants to merge 6 commits into from
+4 −2

Conversation

sarahchen6
Copy link
Contributor

@sarahchen6 sarahchen6 commented Sep 18, 2025 •
edited
Loading

What Does This Do

Test Graalvm 25 image in CI

Motivation

Additional Notes

Contributor Checklist

Jira ticket: https://datadoghq.atlassian.net/browse/LANGPLAT-83

@datadog-official Datadog Official
Copy link

datadog-official bot commented Sep 18, 2025 •
edited
Loading

🎯 Code Coverage
• Patch Coverage: 100.00%
• Total Coverage: 59.34% (-0.48%)

View detailed report

This comment will be updated automatically if new data arrives.
🔗 Commit SHA: 7f3e77e | Docs | Was this helpful? Give us feedback!

@pr-commenter
Copy link

pr-commenter bot commented Sep 18, 2025 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master sarahchen6/test-graalvm25
git_commit_date 1758306588 1758311422
git_commit_sha 3a389f5 7f3e77e
release_version 1.54.0-SNAPSHOT~3a389f573c 1.54.0-SNAPSHOT~7f3e77eddb
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1758313143 1758313143
ci_job_id 1139251610 1139251610
ci_pipeline_id 77037228 77037228
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-4-bkt17q32 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-4-bkt17q32 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 1 performance improvements and 13 performance regressions! Performance is the same for 33 metrics, 12 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:startup:insecure-bank:iast:Agent.start worse
[+29.854ms; +43.565ms] or [+2.590%; +3.779%]		 1.190s 1.153s
scenario:startup:insecure-bank:iast:BytebuddyAgent worse
[+39.077ms; +48.492ms] or [+4.838%; +6.003%]		 851.551ms 807.766ms
scenario:startup:insecure-bank:tracing:Agent.start worse
[+31.991ms; +49.664ms] or [+3.118%; +4.840%]		 1.067s 1.026s
scenario:startup:insecure-bank:tracing:BytebuddyAgent worse
[+42.168ms; +49.379ms] or [+6.117%; +7.164%]		 735.075ms 689.301ms
scenario:startup:petclinic:appsec:BytebuddyAgent worse
[+32.400ms; +65.469ms] or [+4.525%; +9.144%]		 764.906ms 715.971ms
scenario:startup:petclinic:appsec:IAST better
[-1.902ms; -0.577ms] or [-7.560%; -2.293%]		 23.915ms 25.154ms
scenario:startup:petclinic:iast:Agent.start worse
[+34.724ms; +43.548ms] or [+3.014%; +3.780%]		 1.191s 1.152s
scenario:startup:petclinic:iast:BytebuddyAgent worse
[+42.251ms; +48.334ms] or [+5.237%; +5.991%]		 852.135ms 806.842ms
scenario:startup:petclinic:profiling:Agent.start worse
[+39.581ms; +49.227ms] or [+3.392%; +4.219%]		 1.211s 1.167s
scenario:startup:petclinic:profiling:ProfilingAgent worse
[+6.138ms; +9.330ms] or [+6.021%; +9.153%]		 109.671ms 101.937ms
scenario:startup:petclinic:profiling:BytebuddyAgent worse
[+38.040ms; +43.884ms] or [+5.281%; +6.093%]		 761.223ms 720.261ms
scenario:startup:petclinic:profiling:Profiling worse
[+6.180ms; +9.382ms] or [+6.027%; +9.150%]		 110.317ms 102.536ms
scenario:startup:petclinic:tracing:Agent.start worse
[+31.724ms; +60.979ms] or [+3.109%; +5.975%]		 1.067s 1.020s
scenario:startup:petclinic:tracing:BytebuddyAgent worse
[+38.511ms; +58.709ms] or [+5.603%; +8.542%]		 735.945ms 687.335ms
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.54.0-SNAPSHOT~7f3e77eddb, baseline=1.54.0-SNAPSHOT~3a389f573c

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.026 s) : 0, 1026095
Total [baseline] (8.704 s) : 0, 8704131
Agent [candidate] (1.067 s) : 0, 1066923
Total [candidate] (8.678 s) : 0, 8678423
section iast
Agent [baseline] (1.153 s) : 0, 1152858
Total [baseline] (9.381 s) : 0, 9381260
Agent [candidate] (1.19 s) : 0, 1189567
Total [candidate] (9.318 s) : 0, 9318441
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.026 s -
Agent iast 1.153 s 126.762 ms (12.4%)
Total tracing 8.704 s -
Total iast 9.381 s 677.129 ms (7.8%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.067 s -
Agent iast 1.19 s 122.644 ms (11.5%)
Total tracing 8.678 s -
Total iast 9.318 s 640.018 ms (7.4%) 
gantt
    title insecure-bank - break down per module: candidate=1.54.0-SNAPSHOT~7f3e77eddb, baseline=1.54.0-SNAPSHOT~3a389f573c

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.456 ms) : 0, 1456
crashtracking [candidate] (1.453 ms) : 0, 1453
BytebuddyAgent [baseline] (689.301 ms) : 0, 689301
BytebuddyAgent [candidate] (735.075 ms) : 0, 735075
GlobalTracer [baseline] (260.224 ms) : 0, 260224
GlobalTracer [candidate] (255.025 ms) : 0, 255025
AppSec [baseline] (31.904 ms) : 0, 31904
AppSec [candidate] (31.073 ms) : 0, 31073
Debugger [baseline] (6.392 ms) : 0, 6392
Debugger [candidate] (6.428 ms) : 0, 6428
Remote Config [baseline] (691.836 µs) : 0, 692
Remote Config [candidate] (690.094 µs) : 0, 690
Telemetry [baseline] (15.068 ms) : 0, 15068
Telemetry [candidate] (16.215 ms) : 0, 16215
section iast
crashtracking [baseline] (1.453 ms) : 0, 1453
crashtracking [candidate] (1.454 ms) : 0, 1454
BytebuddyAgent [baseline] (807.766 ms) : 0, 807766
BytebuddyAgent [candidate] (851.551 ms) : 0, 851551
GlobalTracer [baseline] (249.411 ms) : 0, 249411
GlobalTracer [candidate] (244.426 ms) : 0, 244426
IAST [baseline] (29.99 ms) : 0, 29990
IAST [candidate] (31.13 ms) : 0, 31130
AppSec [baseline] (28.596 ms) : 0, 28596
AppSec [candidate] (25.44 ms) : 0, 25440
Debugger [baseline] (6.025 ms) : 0, 6025
Debugger [candidate] (6.035 ms) : 0, 6035
Remote Config [baseline] (603.28 µs) : 0, 603
Remote Config [candidate] (584.09 µs) : 0, 584
Telemetry [baseline] (8.117 ms) : 0, 8117
Telemetry [candidate] (8.086 ms) : 0, 8086
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.54.0-SNAPSHOT~7f3e77eddb, baseline=1.54.0-SNAPSHOT~3a389f573c

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.02 s) : 0, 1020494
Total [baseline] (10.707 s) : 0, 10707270
Agent [candidate] (1.067 s) : 0, 1066846
Total [candidate] (10.791 s) : 0, 10790947
section appsec
Agent [baseline] (1.205 s) : 0, 1204900
Total [baseline] (11.086 s) : 0, 11086030
Agent [candidate] (1.246 s) : 0, 1246404
Total [candidate] (11.046 s) : 0, 11046348
section iast
Agent [baseline] (1.152 s) : 0, 1151946
Total [baseline] (11.053 s) : 0, 11053338
Agent [candidate] (1.191 s) : 0, 1191082
Total [candidate] (11.051 s) : 0, 11050980
section profiling
Agent [baseline] (1.167 s) : 0, 1166711
Total [baseline] (11.036 s) : 0, 11035710
Agent [candidate] (1.211 s) : 0, 1211115
Total [candidate] (11.023 s) : 0, 11023226
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.02 s -
Agent appsec 1.205 s 184.406 ms (18.1%)
Agent iast 1.152 s 131.452 ms (12.9%)
Agent profiling 1.167 s 146.217 ms (14.3%)
Total tracing 10.707 s -
Total appsec 11.086 s 378.76 ms (3.5%)
Total iast 11.053 s 346.068 ms (3.2%)
Total profiling 11.036 s 328.44 ms (3.1%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.067 s -
Agent appsec 1.246 s 179.558 ms (16.8%)
Agent iast 1.191 s 124.237 ms (11.6%)
Agent profiling 1.211 s 144.27 ms (13.5%)
Total tracing 10.791 s -
Total appsec 11.046 s 255.401 ms (2.4%)
Total iast 11.051 s 260.033 ms (2.4%)
Total profiling 11.023 s 232.278 ms (2.2%) 
gantt
    title petclinic - break down per module: candidate=1.54.0-SNAPSHOT~7f3e77eddb, baseline=1.54.0-SNAPSHOT~3a389f573c

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.463 ms) : 0, 1463
crashtracking [candidate] (1.458 ms) : 0, 1458
BytebuddyAgent [baseline] (687.335 ms) : 0, 687335
BytebuddyAgent [candidate] (735.945 ms) : 0, 735945
GlobalTracer [baseline] (259.144 ms) : 0, 259144
GlobalTracer [candidate] (253.844 ms) : 0, 253844
AppSec [baseline] (31.749 ms) : 0, 31749
AppSec [candidate] (30.735 ms) : 0, 30735
Debugger [baseline] (6.36 ms) : 0, 6360
Debugger [candidate] (6.498 ms) : 0, 6498
Remote Config [baseline] (689.772 µs) : 0, 690
Remote Config [candidate] (696.03 µs) : 0, 696
Telemetry [baseline] (12.667 ms) : 0, 12667
Telemetry [candidate] (16.474 ms) : 0, 16474
section appsec
crashtracking [baseline] (1.468 ms) : 0, 1468
crashtracking [candidate] (1.492 ms) : 0, 1492
BytebuddyAgent [baseline] (715.971 ms) : 0, 715971
BytebuddyAgent [candidate] (764.906 ms) : 0, 764906
GlobalTracer [baseline] (253.22 ms) : 0, 253220
GlobalTracer [candidate] (247.609 ms) : 0, 247609
IAST [baseline] (25.154 ms) : 0, 25154
IAST [candidate] (23.915 ms) : 0, 23915
AppSec [baseline] (171.43 ms) : 0, 171430
AppSec [candidate] (170.96 ms) : 0, 170960
Debugger [baseline] (6.079 ms) : 0, 6079
Debugger [candidate] (6.922 ms) : 0, 6922
Remote Config [baseline] (625.672 µs) : 0, 626
Remote Config [candidate] (640.291 µs) : 0, 640
Telemetry [baseline] (9.809 ms) : 0, 9809
Telemetry [candidate] (8.53 ms) : 0, 8530
section iast
crashtracking [baseline] (1.459 ms) : 0, 1459
crashtracking [candidate] (1.442 ms) : 0, 1442
BytebuddyAgent [baseline] (806.842 ms) : 0, 806842
BytebuddyAgent [candidate] (852.135 ms) : 0, 852135
GlobalTracer [baseline] (248.718 ms) : 0, 248718
GlobalTracer [candidate] (247.247 ms) : 0, 247247
IAST [baseline] (30.826 ms) : 0, 30826
IAST [candidate] (28.829 ms) : 0, 28829
AppSec [baseline] (28.205 ms) : 0, 28205
AppSec [candidate] (25.546 ms) : 0, 25546
Debugger [baseline] (6.093 ms) : 0, 6093
Debugger [candidate] (6.075 ms) : 0, 6075
Remote Config [baseline] (612.77 µs) : 0, 613
Remote Config [candidate] (599.739 µs) : 0, 600
Telemetry [baseline] (8.163 ms) : 0, 8163
Telemetry [candidate] (8.204 ms) : 0, 8204
section profiling
crashtracking [baseline] (1.443 ms) : 0, 1443
crashtracking [candidate] (1.429 ms) : 0, 1429
BytebuddyAgent [baseline] (720.261 ms) : 0, 720261
BytebuddyAgent [candidate] (761.223 ms) : 0, 761223
GlobalTracer [baseline] (237.13 ms) : 0, 237130
GlobalTracer [candidate] (232.901 ms) : 0, 232901
AppSec [baseline] (31.121 ms) : 0, 31121
AppSec [candidate] (30.564 ms) : 0, 30564
Debugger [baseline] (7.215 ms) : 0, 7215
Debugger [candidate] (13.801 ms) : 0, 13801
Remote Config [baseline] (708.774 µs) : 0, 709
Remote Config [candidate] (748.433 µs) : 0, 748
Telemetry [baseline] (15.741 ms) : 0, 15741
Telemetry [candidate] (9.514 ms) : 0, 9514
ProfilingAgent [baseline] (101.937 ms) : 0, 101937
ProfilingAgent [candidate] (109.671 ms) : 0, 109671
Profiling [baseline] (102.536 ms) : 0, 102536
Profiling [candidate] (110.317 ms) : 0, 110317
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master sarahchen6/test-graalvm25
git_commit_date 1758306588 1758311422
git_commit_sha 3a389f5 7f3e77e
release_version 1.54.0-SNAPSHOT~3a389f573c 1.54.0-SNAPSHOT~7f3e77eddb
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1758312885 1758312885
ci_job_id 1139251611 1139251611
ci_pipeline_id 77037228 77037228
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-5-ngwpjzki 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-5-ngwpjzki 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 3 performance improvements and 2 performance regressions! Performance is the same for 7 metrics, 12 unstable metrics.

scenario Δ mean http_req_duration Δ mean throughput candidate mean http_req_duration candidate mean throughput baseline mean http_req_duration baseline mean throughput
scenario:load:insecure-bank:iast_GLOBAL:high_load better
[-1043.777µs; -620.606µs] or [-9.113%; -5.418%]		 unstable
[-18.728op/s; +81.728op/s] or [-4.613%; +20.129%]		 10.622ms 437.531op/s 11.454ms 406.031op/s
scenario:load:insecure-bank:iast_FULL:high_load better
[-1.353ms; -0.748ms] or [-9.216%; -5.095%]		 unstable
[-12.932op/s; +61.682op/s] or [-4.074%; +19.431%]		 13.629ms 341.812op/s 14.680ms 317.438op/s
scenario:load:petclinic:code_origins:high_load worse
[+1.728ms; +2.595ms] or [+3.854%; +5.785%]		 unstable
[-11.972op/s; +2.347op/s] or [-11.475%; +2.250%]		 47.014ms 99.525op/s 44.852ms 104.338op/s
scenario:load:petclinic:tracing:high_load better
[-2.682ms; -1.905ms] or [-6.034%; -4.285%]		 unstable
[-1.960op/s; +13.385op/s] or [-1.861%; +12.711%]		 42.151ms 111.013op/s 44.444ms 105.300op/s
scenario:load:petclinic:appsec:high_load worse
[+1.135ms; +2.000ms] or [+2.422%; +4.270%]		 unstable
[-10.259op/s; +3.884op/s] or [-10.269%; +3.887%]		 48.404ms 96.713op/s 46.837ms 99.900op/s
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.54.0-SNAPSHOT~7f3e77eddb, baseline=1.54.0-SNAPSHOT~3a389f573c
    dateFormat X
    axisFormat %s
section baseline
no_agent (4.409 ms) : 4359, 4458
.   : milestone, 4409,
iast (9.665 ms) : 9495, 9835
.   : milestone, 9665,
iast_FULL (14.68 ms) : 14388, 14971
.   : milestone, 14680,
iast_GLOBAL (11.454 ms) : 11248, 11660
.   : milestone, 11454,
profiling (8.926 ms) : 8790, 9062
.   : milestone, 8926,
tracing (7.788 ms) : 7675, 7900
.   : milestone, 7788,
section candidate
no_agent (4.545 ms) : 4490, 4600
.   : milestone, 4545,
iast (9.651 ms) : 9488, 9814
.   : milestone, 9651,
iast_FULL (13.629 ms) : 13359, 13900
.   : milestone, 13629,
iast_GLOBAL (10.622 ms) : 10435, 10809
.   : milestone, 10622,
profiling (8.77 ms) : 8635, 8905
.   : milestone, 8770,
tracing (7.631 ms) : 7521, 7741
.   : milestone, 7631,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.409 ms [4.359 ms, 4.458 ms] -
iast 9.665 ms [9.495 ms, 9.835 ms] 5.257 ms (119.2%)
iast_FULL 14.68 ms [14.388 ms, 14.971 ms] 10.271 ms (233.0%)
iast_GLOBAL 11.454 ms [11.248 ms, 11.66 ms] 7.045 ms (159.8%)
profiling 8.926 ms [8.79 ms, 9.062 ms] 4.517 ms (102.5%)
tracing 7.788 ms [7.675 ms, 7.9 ms] 3.379 ms (76.6%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.545 ms [4.49 ms, 4.6 ms] -
iast 9.651 ms [9.488 ms, 9.814 ms] 5.106 ms (112.4%)
iast_FULL 13.629 ms [13.359 ms, 13.9 ms] 9.085 ms (199.9%)
iast_GLOBAL 10.622 ms [10.435 ms, 10.809 ms] 6.077 ms (133.7%)
profiling 8.77 ms [8.635 ms, 8.905 ms] 4.225 ms (93.0%)
tracing 7.631 ms [7.521 ms, 7.741 ms] 3.086 ms (67.9%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.54.0-SNAPSHOT~7f3e77eddb, baseline=1.54.0-SNAPSHOT~3a389f573c
    dateFormat X
    axisFormat %s
section baseline
no_agent (36.81 ms) : 36513, 37107
.   : milestone, 36810,
appsec (46.837 ms) : 46426, 47247
.   : milestone, 46837,
code_origins (44.852 ms) : 44475, 45230
.   : milestone, 44852,
iast (45.04 ms) : 44647, 45434
.   : milestone, 45040,
profiling (50.456 ms) : 49955, 50957
.   : milestone, 50456,
tracing (44.444 ms) : 44067, 44822
.   : milestone, 44444,
section candidate
no_agent (37.81 ms) : 37495, 38126
.   : milestone, 37810,
appsec (48.404 ms) : 48011, 48797
.   : milestone, 48404,
code_origins (47.014 ms) : 46588, 47440
.   : milestone, 47014,
iast (45.82 ms) : 45424, 46216
.   : milestone, 45820,
profiling (50.006 ms) : 49514, 50499
.   : milestone, 50006,
tracing (42.151 ms) : 41807, 42495
.   : milestone, 42151,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 36.81 ms [36.513 ms, 37.107 ms] -
appsec 46.837 ms [46.426 ms, 47.247 ms] 10.027 ms (27.2%)
code_origins 44.852 ms [44.475 ms, 45.23 ms] 8.042 ms (21.8%)
iast 45.04 ms [44.647 ms, 45.434 ms] 8.23 ms (22.4%)
profiling 50.456 ms [49.955 ms, 50.957 ms] 13.646 ms (37.1%)
tracing 44.444 ms [44.067 ms, 44.822 ms] 7.634 ms (20.7%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 37.81 ms [37.495 ms, 38.126 ms] -
appsec 48.404 ms [48.011 ms, 48.797 ms] 10.593 ms (28.0%)
code_origins 47.014 ms [46.588 ms, 47.44 ms] 9.203 ms (24.3%)
iast 45.82 ms [45.424 ms, 46.216 ms] 8.01 ms (21.2%)
profiling 50.006 ms [49.514 ms, 50.499 ms] 12.196 ms (32.3%)
tracing 42.151 ms [41.807 ms, 42.495 ms] 4.341 ms (11.5%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master sarahchen6/test-graalvm25
git_commit_date 1758306588 1758311422
git_commit_sha 3a389f5 7f3e77e
release_version 1.54.0-SNAPSHOT~3a389f573c 1.54.0-SNAPSHOT~7f3e77eddb
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1758313345 1758313345
ci_job_id 1139251612 1139251612
ci_pipeline_id 77037228 77037228
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-2-wvpnzzf4 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-2-wvpnzzf4 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.54.0-SNAPSHOT~7f3e77eddb, baseline=1.54.0-SNAPSHOT~3a389f573c
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.883 s) : 14883000, 14883000
.   : milestone, 14883000,
appsec (14.951 s) : 14951000, 14951000
.   : milestone, 14951000,
iast (18.549 s) : 18549000, 18549000
.   : milestone, 18549000,
iast_GLOBAL (17.884 s) : 17884000, 17884000
.   : milestone, 17884000,
profiling (16.005 s) : 16005000, 16005000
.   : milestone, 16005000,
tracing (15.035 s) : 15035000, 15035000
.   : milestone, 15035000,
section candidate
no_agent (15.536 s) : 15536000, 15536000
.   : milestone, 15536000,
appsec (14.862 s) : 14862000, 14862000
.   : milestone, 14862000,
iast (18.231 s) : 18231000, 18231000
.   : milestone, 18231000,
iast_GLOBAL (18.253 s) : 18253000, 18253000
.   : milestone, 18253000,
profiling (15.323 s) : 15323000, 15323000
.   : milestone, 15323000,
tracing (14.711 s) : 14711000, 14711000
.   : milestone, 14711000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.883 s [14.883 s, 14.883 s] -
appsec 14.951 s [14.951 s, 14.951 s] 68.0 ms (0.5%)
iast 18.549 s [18.549 s, 18.549 s] 3.666 s (24.6%)
iast_GLOBAL 17.884 s [17.884 s, 17.884 s] 3.001 s (20.2%)
profiling 16.005 s [16.005 s, 16.005 s] 1.122 s (7.5%)
tracing 15.035 s [15.035 s, 15.035 s] 152.0 ms (1.0%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.536 s [15.536 s, 15.536 s] -
appsec 14.862 s [14.862 s, 14.862 s] -674.0 ms (-4.3%)
iast 18.231 s [18.231 s, 18.231 s] 2.695 s (17.3%)
iast_GLOBAL 18.253 s [18.253 s, 18.253 s] 2.717 s (17.5%)
profiling 15.323 s [15.323 s, 15.323 s] -213.0 ms (-1.4%)
tracing 14.711 s [14.711 s, 14.711 s] -825.0 ms (-5.3%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.54.0-SNAPSHOT~7f3e77eddb, baseline=1.54.0-SNAPSHOT~3a389f573c
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.484 ms) : 1472, 1495
.   : milestone, 1484,
appsec (3.724 ms) : 3504, 3944
.   : milestone, 3724,
iast (2.201 ms) : 2138, 2264
.   : milestone, 2201,
iast_GLOBAL (2.245 ms) : 2182, 2309
.   : milestone, 2245,
profiling (2.051 ms) : 2001, 2102
.   : milestone, 2051,
tracing (2.032 ms) : 1983, 2081
.   : milestone, 2032,
section candidate
no_agent (1.481 ms) : 1469, 1492
.   : milestone, 1481,
appsec (3.71 ms) : 3491, 3930
.   : milestone, 3710,
iast (2.207 ms) : 2144, 2270
.   : milestone, 2207,
iast_GLOBAL (2.244 ms) : 2181, 2307
.   : milestone, 2244,
profiling (2.069 ms) : 2016, 2121
.   : milestone, 2069,
tracing (2.024 ms) : 1975, 2073
.   : milestone, 2024,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.484 ms [1.472 ms, 1.495 ms] -
appsec 3.724 ms [3.504 ms, 3.944 ms] 2.24 ms (151.0%)
iast 2.201 ms [2.138 ms, 2.264 ms] 717.257 µs (48.3%)
iast_GLOBAL 2.245 ms [2.182 ms, 2.309 ms] 761.77 µs (51.3%)
profiling 2.051 ms [2.001 ms, 2.102 ms] 567.76 µs (38.3%)
tracing 2.032 ms [1.983 ms, 2.081 ms] 548.423 µs (37.0%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.481 ms [1.469 ms, 1.492 ms] -
appsec 3.71 ms [3.491 ms, 3.93 ms] 2.23 ms (150.6%)
iast 2.207 ms [2.144 ms, 2.27 ms] 726.714 µs (49.1%)
iast_GLOBAL 2.244 ms [2.181 ms, 2.307 ms] 763.36 µs (51.6%)
profiling 2.069 ms [2.016 ms, 2.121 ms] 588.243 µs (39.7%)
tracing 2.024 ms [1.975 ms, 2.073 ms] 543.616 µs (36.7%)

@sarahchen6 sarahchen6 mentioned this pull request Sep 18, 2025
Open
@sarahchen6 sarahchen6 added type: enhancement Enhancements and improvements comp: testing Testing tag: no release notes Changes to exclude from release notes labels Sep 18, 2025
@sarahchen6 sarahchen6 force-pushed the sarahchen6/test-graalvm25 branch from 2bf27d8 to 506ec84 Compare September 18, 2025 19:50
@sarahchen6 sarahchen6 force-pushed the sarahchen6/test-graalvm25 branch from 506ec84 to b191c6f Compare September 18, 2025 20:57
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
comp: testing Testing tag: no release notes Changes to exclude from release notes type: enhancement Enhancements and improvements
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@sarahchen6