Thanks to visit codestin.com
Credit goes to github.com

Skip to content

increase load benchmark scenario durations #9567

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Draft
wants to merge 2 commits into
base: master
Choose a base branch
from
Draft

increase load benchmark scenario durations #9567

wants to merge 2 commits into from

Conversation

igoragoli
Copy link
Contributor

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@datadog-official Datadog Official
Copy link

datadog-official bot commented Sep 19, 2025 •
edited by datadog-datadog-prod-us1 bot
Loading

🎯 Code Coverage
• Patch Coverage: 100.00%
• Total Coverage: 60.14% (+0.36%)

View detailed report

This comment will be updated automatically if new data arrives.
🔗 Commit SHA: 2bc6b45 | Docs | Was this helpful? Give us feedback!

@pr-commenter
Copy link

pr-commenter bot commented Sep 19, 2025

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master augusto/benchmark-load-experiments
git_commit_date 1758276503 1758280203
git_commit_sha 418fb39 2bc6b45
release_version 1.54.0-SNAPSHOT~418fb39b19 1.54.0-SNAPSHOT~2bc6b45c3d
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1758281976 1758281976
ci_job_id 1137981748 1137981748
ci_pipeline_id 76971083 76971083
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-0p1n29gq 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-0p1n29gq 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 50 metrics, 9 unstable metrics.

Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.54.0-SNAPSHOT~2bc6b45c3d, baseline=1.54.0-SNAPSHOT~418fb39b19

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.065 s) : 0, 1064880
Total [baseline] (10.585 s) : 0, 10584959
Agent [candidate] (1.069 s) : 0, 1069014
Total [candidate] (10.822 s) : 0, 10822071
section appsec
Agent [baseline] (1.234 s) : 0, 1234482
Total [baseline] (11.042 s) : 0, 11042014
Agent [candidate] (1.246 s) : 0, 1246361
Total [candidate] (10.91 s) : 0, 10910122
section iast
Agent [baseline] (1.193 s) : 0, 1193241
Total [baseline] (11.1 s) : 0, 11099581
Agent [candidate] (1.192 s) : 0, 1192275
Total [candidate] (11.105 s) : 0, 11105349
section profiling
Agent [baseline] (1.212 s) : 0, 1212193
Total [baseline] (10.975 s) : 0, 10975445
Agent [candidate] (1.207 s) : 0, 1207276
Total [candidate] (10.987 s) : 0, 10986772
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.065 s -
Agent appsec 1.234 s 169.602 ms (15.9%)
Agent iast 1.193 s 128.361 ms (12.1%)
Agent profiling 1.212 s 147.313 ms (13.8%)
Total tracing 10.585 s -
Total appsec 11.042 s 457.055 ms (4.3%)
Total iast 11.1 s 514.622 ms (4.9%)
Total profiling 10.975 s 390.485 ms (3.7%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.069 s -
Agent appsec 1.246 s 177.348 ms (16.6%)
Agent iast 1.192 s 123.261 ms (11.5%)
Agent profiling 1.207 s 138.262 ms (12.9%)
Total tracing 10.822 s -
Total appsec 10.91 s 88.051 ms (0.8%)
Total iast 11.105 s 283.278 ms (2.6%)
Total profiling 10.987 s 164.701 ms (1.5%) 
gantt
    title petclinic - break down per module: candidate=1.54.0-SNAPSHOT~2bc6b45c3d, baseline=1.54.0-SNAPSHOT~418fb39b19

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.487 ms) : 0, 1487
crashtracking [candidate] (1.47 ms) : 0, 1470
BytebuddyAgent [baseline] (734.834 ms) : 0, 734834
BytebuddyAgent [candidate] (737.906 ms) : 0, 737906
GlobalTracer [baseline] (253.345 ms) : 0, 253345
GlobalTracer [candidate] (254.065 ms) : 0, 254065
AppSec [baseline] (30.655 ms) : 0, 30655
AppSec [candidate] (30.89 ms) : 0, 30890
Debugger [baseline] (6.415 ms) : 0, 6415
Debugger [candidate] (6.443 ms) : 0, 6443
Remote Config [baseline] (696.181 µs) : 0, 696
Remote Config [candidate] (710.31 µs) : 0, 710
Telemetry [baseline] (16.11 ms) : 0, 16110
Telemetry [candidate] (16.286 ms) : 0, 16286
section appsec
crashtracking [baseline] (1.443 ms) : 0, 1443
crashtracking [candidate] (1.461 ms) : 0, 1461
BytebuddyAgent [baseline] (755.172 ms) : 0, 755172
BytebuddyAgent [candidate] (763.128 ms) : 0, 763128
GlobalTracer [baseline] (246.362 ms) : 0, 246362
GlobalTracer [candidate] (248.365 ms) : 0, 248365
AppSec [baseline] (170.742 ms) : 0, 170742
AppSec [candidate] (171.798 ms) : 0, 171798
Debugger [baseline] (5.944 ms) : 0, 5944
Debugger [candidate] (6.08 ms) : 0, 6080
Remote Config [baseline] (620.692 µs) : 0, 621
Remote Config [candidate] (615.828 µs) : 0, 616
Telemetry [baseline] (9.149 ms) : 0, 9149
Telemetry [candidate] (9.332 ms) : 0, 9332
IAST [baseline] (23.844 ms) : 0, 23844
IAST [candidate] (24.135 ms) : 0, 24135
section iast
crashtracking [baseline] (1.453 ms) : 0, 1453
crashtracking [candidate] (1.442 ms) : 0, 1442
BytebuddyAgent [baseline] (854.362 ms) : 0, 854362
BytebuddyAgent [candidate] (853.179 ms) : 0, 853179
GlobalTracer [baseline] (245.863 ms) : 0, 245863
GlobalTracer [candidate] (244.628 ms) : 0, 244628
AppSec [baseline] (26.303 ms) : 0, 26303
AppSec [candidate] (28.769 ms) : 0, 28769
Debugger [baseline] (6.074 ms) : 0, 6074
Debugger [candidate] (6.051 ms) : 0, 6051
Remote Config [baseline] (583.806 µs) : 0, 584
Remote Config [candidate] (591.481 µs) : 0, 591
Telemetry [baseline] (8.208 ms) : 0, 8208
Telemetry [candidate] (8.281 ms) : 0, 8281
IAST [baseline] (29.411 ms) : 0, 29411
IAST [candidate] (28.269 ms) : 0, 28269
section profiling
crashtracking [baseline] (1.454 ms) : 0, 1454
crashtracking [candidate] (1.43 ms) : 0, 1430
BytebuddyAgent [baseline] (762.741 ms) : 0, 762741
BytebuddyAgent [candidate] (760.304 ms) : 0, 760304
GlobalTracer [baseline] (233.799 ms) : 0, 233799
GlobalTracer [candidate] (232.695 ms) : 0, 232695
AppSec [baseline] (31.028 ms) : 0, 31028
AppSec [candidate] (31.096 ms) : 0, 31096
Debugger [baseline] (11.202 ms) : 0, 11202
Debugger [candidate] (8.202 ms) : 0, 8202
Remote Config [baseline] (697.271 µs) : 0, 697
Remote Config [candidate] (701.929 µs) : 0, 702
Telemetry [baseline] (11.037 ms) : 0, 11037
Telemetry [candidate] (14.05 ms) : 0, 14050
ProfilingAgent [baseline] (108.928 ms) : 0, 108928
ProfilingAgent [candidate] (107.735 ms) : 0, 107735
Profiling [baseline] (109.557 ms) : 0, 109557
Profiling [candidate] (108.4 ms) : 0, 108400
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.54.0-SNAPSHOT~2bc6b45c3d, baseline=1.54.0-SNAPSHOT~418fb39b19

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.06 s) : 0, 1059669
Total [baseline] (8.645 s) : 0, 8644606
Agent [candidate] (1.061 s) : 0, 1060505
Total [candidate] (8.64 s) : 0, 8639526
section iast
Agent [baseline] (1.191 s) : 0, 1190870
Total [baseline] (9.334 s) : 0, 9334038
Agent [candidate] (1.192 s) : 0, 1191637
Total [candidate] (9.309 s) : 0, 9309032
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.06 s -
Agent iast 1.191 s 131.201 ms (12.4%)
Total tracing 8.645 s -
Total iast 9.334 s 689.433 ms (8.0%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.061 s -
Agent iast 1.192 s 131.132 ms (12.4%)
Total tracing 8.64 s -
Total iast 9.309 s 669.507 ms (7.7%) 
gantt
    title insecure-bank - break down per module: candidate=1.54.0-SNAPSHOT~2bc6b45c3d, baseline=1.54.0-SNAPSHOT~418fb39b19

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.457 ms) : 0, 1457
crashtracking [candidate] (1.459 ms) : 0, 1459
BytebuddyAgent [baseline] (731.464 ms) : 0, 731464
BytebuddyAgent [candidate] (732.138 ms) : 0, 732138
GlobalTracer [baseline] (252.165 ms) : 0, 252165
GlobalTracer [candidate] (251.929 ms) : 0, 251929
AppSec [baseline] (30.32 ms) : 0, 30320
AppSec [candidate] (30.462 ms) : 0, 30462
Debugger [baseline] (6.338 ms) : 0, 6338
Debugger [candidate] (6.392 ms) : 0, 6392
Remote Config [baseline] (700.176 µs) : 0, 700
Remote Config [candidate] (687.87 µs) : 0, 688
Telemetry [baseline] (16.238 ms) : 0, 16238
Telemetry [candidate] (16.334 ms) : 0, 16334
section iast
crashtracking [baseline] (1.451 ms) : 0, 1451
crashtracking [candidate] (1.453 ms) : 0, 1453
BytebuddyAgent [baseline] (852.142 ms) : 0, 852142
BytebuddyAgent [candidate] (852.435 ms) : 0, 852435
GlobalTracer [baseline] (249.559 ms) : 0, 249559
GlobalTracer [candidate] (245.807 ms) : 0, 245807
AppSec [baseline] (24.623 ms) : 0, 24623
AppSec [candidate] (28.331 ms) : 0, 28331
Debugger [baseline] (6.069 ms) : 0, 6069
Debugger [candidate] (6.126 ms) : 0, 6126
Remote Config [baseline] (603.573 µs) : 0, 604
Remote Config [candidate] (605.178 µs) : 0, 605
Telemetry [baseline] (8.26 ms) : 0, 8260
Telemetry [candidate] (8.324 ms) : 0, 8324
IAST [baseline] (27.149 ms) : 0, 27149
IAST [candidate] (27.44 ms) : 0, 27440
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master augusto/benchmark-load-experiments
git_commit_date 1758276503 1758280203
git_commit_sha 418fb39 2bc6b45
release_version 1.54.0-SNAPSHOT~418fb39b19 1.54.0-SNAPSHOT~2bc6b45c3d
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1758284126 1758284126
ci_job_id 1137981749 1137981749
ci_pipeline_id 76971083 76971083
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-mi63lnc7 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-mi63lnc7 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 3 performance improvements and 8 performance regressions! Performance is the same for 13 metrics, 0 unstable metrics.

scenario Δ mean http_req_duration Δ mean throughput candidate mean http_req_duration candidate mean throughput baseline mean http_req_duration baseline mean throughput
scenario:load:petclinic:profiling:high_load worse
[+920.315µs; +1041.760µs] or [+4.628%; +5.239%]		 worse
[-15.450op/s; -7.728op/s] or [-6.241%; -3.121%]		 20.867ms 235.982op/s 19.886ms 247.571op/s
scenario:load:petclinic:tracing:high_load better
[-531.177µs; -420.540µs] or [-2.748%; -2.176%]		 unsure
[+2.608op/s; +10.183op/s] or [+1.024%; +3.998%]		 18.851ms 261.086op/s 19.327ms 254.690op/s
scenario:load:petclinic:code_origins:high_load better
[-1005.007µs; -887.314µs] or [-4.937%; -4.358%]		 better
[+7.997op/s; +15.471op/s] or [+3.307%; +6.397%]		 19.412ms 253.578op/s 20.359ms 241.844op/s
scenario:load:petclinic:appsec:high_load worse
[+1.619ms; +1.739ms] or [+8.341%; +8.962%]		 worse
[-23.708op/s; -16.520op/s] or [-9.347%; -6.513%]		 21.086ms 233.530op/s 19.407ms 253.644op/s
scenario:load:petclinic:iast:high_load worse
[+890.827µs; +1006.015µs] or [+4.600%; +5.195%]		 worse
[-15.294op/s; -8.333op/s] or [-6.017%; -3.278%]		 20.314ms 242.371op/s 19.366ms 254.185op/s
scenario:load:petclinic:no_agent:high_load worse
[+690.292µs; +792.778µs] or [+3.796%; +4.359%]		 worse
[-14.005op/s; -7.081op/s] or [-5.176%; -2.617%]		 18.928ms 260.046op/s 18.186ms 270.589op/s
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.54.0-SNAPSHOT~2bc6b45c3d, baseline=1.54.0-SNAPSHOT~418fb39b19
    dateFormat X
    axisFormat %s
section baseline
no_agent (18.186 ms) : 18139, 18233
.   : milestone, 18186,
appsec (19.407 ms) : 19354, 19461
.   : milestone, 19407,
code_origins (20.359 ms) : 20303, 20415
.   : milestone, 20359,
iast (19.366 ms) : 19314, 19418
.   : milestone, 19366,
profiling (19.886 ms) : 19830, 19941
.   : milestone, 19886,
tracing (19.327 ms) : 19275, 19379
.   : milestone, 19327,
section candidate
no_agent (18.928 ms) : 18879, 18976
.   : milestone, 18928,
appsec (21.086 ms) : 21028, 21144
.   : milestone, 21086,
code_origins (19.412 ms) : 19359, 19466
.   : milestone, 19412,
iast (20.314 ms) : 20259, 20369
.   : milestone, 20314,
profiling (20.867 ms) : 20809, 20924
.   : milestone, 20867,
tracing (18.851 ms) : 18801, 18902
.   : milestone, 18851,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.186 ms [18.139 ms, 18.233 ms] -
appsec 19.407 ms [19.354 ms, 19.461 ms] 1.221 ms (6.7%)
code_origins 20.359 ms [20.303 ms, 20.415 ms] 2.172 ms (11.9%)
iast 19.366 ms [19.314 ms, 19.418 ms] 1.179 ms (6.5%)
profiling 19.886 ms [19.83 ms, 19.941 ms] 1.7 ms (9.3%)
tracing 19.327 ms [19.275 ms, 19.379 ms] 1.141 ms (6.3%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.928 ms [18.879 ms, 18.976 ms] -
appsec 21.086 ms [21.028 ms, 21.144 ms] 2.158 ms (11.4%)
code_origins 19.412 ms [19.359 ms, 19.466 ms] 484.759 µs (2.6%)
iast 20.314 ms [20.259 ms, 20.369 ms] 1.386 ms (7.3%)
profiling 20.867 ms [20.809 ms, 20.924 ms] 1.939 ms (10.2%)
tracing 18.851 ms [18.801 ms, 18.902 ms] -76.203 µs (-0.4%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.54.0-SNAPSHOT~2bc6b45c3d, baseline=1.54.0-SNAPSHOT~418fb39b19
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.203 ms) : 1198, 1208
.   : milestone, 1203,
iast (3.413 ms) : 3396, 3430
.   : milestone, 3413,
iast_FULL (6.117 ms) : 6091, 6143
.   : milestone, 6117,
iast_GLOBAL (3.779 ms) : 3756, 3802
.   : milestone, 3779,
profiling (2.279 ms) : 2269, 2289
.   : milestone, 2279,
tracing (1.984 ms) : 1976, 1992
.   : milestone, 1984,
section candidate
no_agent (1.192 ms) : 1187, 1197
.   : milestone, 1192,
iast (3.463 ms) : 3446, 3480
.   : milestone, 3463,
iast_FULL (6.128 ms) : 6102, 6154
.   : milestone, 6128,
iast_GLOBAL (3.723 ms) : 3701, 3745
.   : milestone, 3723,
profiling (2.302 ms) : 2292, 2312
.   : milestone, 2302,
tracing (2.006 ms) : 1999, 2014
.   : milestone, 2006,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.203 ms [1.198 ms, 1.208 ms] -
iast 3.413 ms [3.396 ms, 3.43 ms] 2.21 ms (183.7%)
iast_FULL 6.117 ms [6.091 ms, 6.143 ms] 4.914 ms (408.5%)
iast_GLOBAL 3.779 ms [3.756 ms, 3.802 ms] 2.577 ms (214.2%)
profiling 2.279 ms [2.269 ms, 2.289 ms] 1.076 ms (89.4%)
tracing 1.984 ms [1.976 ms, 1.992 ms] 781.263 µs (65.0%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.192 ms [1.187 ms, 1.197 ms] -
iast 3.463 ms [3.446 ms, 3.48 ms] 2.271 ms (190.5%)
iast_FULL 6.128 ms [6.102 ms, 6.154 ms] 4.936 ms (414.1%)
iast_GLOBAL 3.723 ms [3.701 ms, 3.745 ms] 2.531 ms (212.3%)
profiling 2.302 ms [2.292 ms, 2.312 ms] 1.11 ms (93.1%)
tracing 2.006 ms [1.999 ms, 2.014 ms] 814.101 µs (68.3%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master augusto/benchmark-load-experiments
git_commit_date 1758276503 1758280203
git_commit_sha 418fb39 2bc6b45
release_version 1.54.0-SNAPSHOT~418fb39b19 1.54.0-SNAPSHOT~2bc6b45c3d
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1758282132 1758282132
ci_job_id 1137981750 1137981750
ci_pipeline_id 76971083 76971083
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-2-q85247gl 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-2-q85247gl 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 10 metrics, 2 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.54.0-SNAPSHOT~2bc6b45c3d, baseline=1.54.0-SNAPSHOT~418fb39b19
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.605 s) : 15605000, 15605000
.   : milestone, 15605000,
appsec (14.918 s) : 14918000, 14918000
.   : milestone, 14918000,
iast (18.345 s) : 18345000, 18345000
.   : milestone, 18345000,
iast_GLOBAL (18.226 s) : 18226000, 18226000
.   : milestone, 18226000,
profiling (15.469 s) : 15469000, 15469000
.   : milestone, 15469000,
tracing (15.044 s) : 15044000, 15044000
.   : milestone, 15044000,
section candidate
no_agent (15.014 s) : 15014000, 15014000
.   : milestone, 15014000,
appsec (14.911 s) : 14911000, 14911000
.   : milestone, 14911000,
iast (18.223 s) : 18223000, 18223000
.   : milestone, 18223000,
iast_GLOBAL (17.963 s) : 17963000, 17963000
.   : milestone, 17963000,
profiling (15.372 s) : 15372000, 15372000
.   : milestone, 15372000,
tracing (15.153 s) : 15153000, 15153000
.   : milestone, 15153000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.605 s [15.605 s, 15.605 s] -
appsec 14.918 s [14.918 s, 14.918 s] -687.0 ms (-4.4%)
iast 18.345 s [18.345 s, 18.345 s] 2.74 s (17.6%)
iast_GLOBAL 18.226 s [18.226 s, 18.226 s] 2.621 s (16.8%)
profiling 15.469 s [15.469 s, 15.469 s] -136.0 ms (-0.9%)
tracing 15.044 s [15.044 s, 15.044 s] -561.0 ms (-3.6%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.014 s [15.014 s, 15.014 s] -
appsec 14.911 s [14.911 s, 14.911 s] -103.0 ms (-0.7%)
iast 18.223 s [18.223 s, 18.223 s] 3.209 s (21.4%)
iast_GLOBAL 17.963 s [17.963 s, 17.963 s] 2.949 s (19.6%)
profiling 15.372 s [15.372 s, 15.372 s] 358.0 ms (2.4%)
tracing 15.153 s [15.153 s, 15.153 s] 139.0 ms (0.9%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.54.0-SNAPSHOT~2bc6b45c3d, baseline=1.54.0-SNAPSHOT~418fb39b19
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.472 ms) : 1460, 1483
.   : milestone, 1472,
appsec (3.697 ms) : 3481, 3913
.   : milestone, 3697,
iast (2.196 ms) : 2133, 2259
.   : milestone, 2196,
iast_GLOBAL (2.235 ms) : 2172, 2298
.   : milestone, 2235,
profiling (2.463 ms) : 2238, 2687
.   : milestone, 2463,
tracing (2.018 ms) : 1968, 2067
.   : milestone, 2018,
section candidate
no_agent (1.471 ms) : 1460, 1483
.   : milestone, 1471,
appsec (3.699 ms) : 3482, 3916
.   : milestone, 3699,
iast (2.196 ms) : 2133, 2259
.   : milestone, 2196,
iast_GLOBAL (2.244 ms) : 2180, 2307
.   : milestone, 2244,
profiling (2.055 ms) : 2003, 2106
.   : milestone, 2055,
tracing (2.005 ms) : 1956, 2054
.   : milestone, 2005,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.472 ms [1.46 ms, 1.483 ms] -
appsec 3.697 ms [3.481 ms, 3.913 ms] 2.225 ms (151.2%)
iast 2.196 ms [2.133 ms, 2.259 ms] 724.009 µs (49.2%)
iast_GLOBAL 2.235 ms [2.172 ms, 2.298 ms] 763.06 µs (51.8%)
profiling 2.463 ms [2.238 ms, 2.687 ms] 991.049 µs (67.3%)
tracing 2.018 ms [1.968 ms, 2.067 ms] 545.79 µs (37.1%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.471 ms [1.46 ms, 1.483 ms] -
appsec 3.699 ms [3.482 ms, 3.916 ms] 2.227 ms (151.4%)
iast 2.196 ms [2.133 ms, 2.259 ms] 725.023 µs (49.3%)
iast_GLOBAL 2.244 ms [2.18 ms, 2.307 ms] 772.628 µs (52.5%)
profiling 2.055 ms [2.003 ms, 2.106 ms] 583.628 µs (39.7%)
tracing 2.005 ms [1.956 ms, 2.054 ms] 533.843 µs (36.3%)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@igoragoli