increase heap memory for build step on system-tests #8758

cbeauchesne · 2025-05-02T13:20:36Z

What Does This Do

Increase heap memory size for build step of system-tests, as we're experiencing sometimes GC memory issue : https://github.com/DataDog/dd-trace-java/actions/runs/14780117568/job/41497030067?pr=8755

Motivation

Stable CI

Additional Notes

Contributor Checklist

Format the title according the contribution guidelines
Assign the type: and (comp: or inst:) labels in addition to any usefull labels
Don't use close, fix or any linking keywords when referencing an issue.
Use solves instead, and assign the PR milestone to the issue
Update the public documentation in case of new configuration flag or behavior

Jira ticket: [PROJ-IDENT]

github-actions · 2025-05-02T13:35:33Z

Hi! 👋 Thanks for your pull request! 🎉

To help us review it, please make sure to:

Add at least one type, and one component or instrumentation label to the pull request

If you need help, please check our contributing guidelines.

pr-commenter · 2025-05-02T15:03:41Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	cbeauchesne/heapsize-build
git_commit_date	1746187873	1746195146
git_commit_sha	`9f65194`	`58196c0`
release_version	1.49.0-SNAPSHOT~9f6519428f	1.49.0-SNAPSHOT~58196c0481

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1746198172	1746198172
ci_job_id	921708520	921708520
ci_pipeline_id	63970936	63970936
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-h1u4oesf-project-304-concurrent-0-cs8ucfjc 6.8.0-1027-aws #29~22.04.1-Ubuntu SMP Sun Mar 30 07:45:38 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-h1u4oesf-project-304-concurrent-0-cs8ucfjc 6.8.0-1027-aws #29~22.04.1-Ubuntu SMP Sun Mar 30 07:45:38 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None
variant	iast	iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 63 metrics, 8 unstable metrics.

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.49.0-SNAPSHOT~58196c0481, baseline=1.49.0-SNAPSHOT~9f6519428f

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.006 s) : 0, 1005717
Total [baseline] (8.653 s) : 0, 8653361
Agent [candidate] (1.003 s) : 0, 1002782
Total [candidate] (8.63 s) : 0, 8630400
section iast
Agent [baseline] (1.135 s) : 0, 1134967
Total [baseline] (9.248 s) : 0, 9248038
Agent [candidate] (1.139 s) : 0, 1139439
Total [candidate] (9.248 s) : 0, 9247851
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.137 s) : 0, 1137242
Total [baseline] (9.172 s) : 0, 9172258
Agent [candidate] (1.146 s) : 0, 1145769
Total [candidate] (9.276 s) : 0, 9276390
section iast_TELEMETRY_OFF
Agent [baseline] (1.131 s) : 0, 1131414
Total [baseline] (9.201 s) : 0, 9201079
Agent [candidate] (1.132 s) : 0, 1131853
Total [candidate] (9.269 s) : 0, 9268802

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.006 s	-
Agent	iast	1.135 s	129.251 ms (12.9%)
Agent	iast_HARDCODED_SECRET_DISABLED	1.137 s	131.526 ms (13.1%)
Agent	iast_TELEMETRY_OFF	1.131 s	125.697 ms (12.5%)
Total	tracing	8.653 s	-
Total	iast	9.248 s	594.677 ms (6.9%)
Total	iast_HARDCODED_SECRET_DISABLED	9.172 s	518.896 ms (6.0%)
Total	iast_TELEMETRY_OFF	9.201 s	547.717 ms (6.3%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.003 s	-
Agent	iast	1.139 s	136.657 ms (13.6%)
Agent	iast_HARDCODED_SECRET_DISABLED	1.146 s	142.986 ms (14.3%)
Agent	iast_TELEMETRY_OFF	1.132 s	129.071 ms (12.9%)
Total	tracing	8.63 s	-
Total	iast	9.248 s	617.451 ms (7.2%)
Total	iast_HARDCODED_SECRET_DISABLED	9.276 s	645.991 ms (7.5%)
Total	iast_TELEMETRY_OFF	9.269 s	638.403 ms (7.4%)

gantt
    title insecure-bank - break down per module: candidate=1.49.0-SNAPSHOT~58196c0481, baseline=1.49.0-SNAPSHOT~9f6519428f

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (670.269 ms) : 0, 670269
BytebuddyAgent [candidate] (669.666 ms) : 0, 669666
GlobalTracer [baseline] (240.437 ms) : 0, 240437
GlobalTracer [candidate] (239.852 ms) : 0, 239852
AppSec [baseline] (54.879 ms) : 0, 54879
AppSec [candidate] (54.626 ms) : 0, 54626
Debugger [baseline] (6.834 ms) : 0, 6834
Debugger [candidate] (6.154 ms) : 0, 6154
Remote Config [baseline] (706.185 µs) : 0, 706
Remote Config [candidate] (699.006 µs) : 0, 699
Telemetry [baseline] (9.251 ms) : 0, 9251
Telemetry [candidate] (8.506 ms) : 0, 8506
section iast
BytebuddyAgent [baseline] (788.753 ms) : 0, 788753
BytebuddyAgent [candidate] (790.734 ms) : 0, 790734
GlobalTracer [baseline] (229.374 ms) : 0, 229374
GlobalTracer [candidate] (231.013 ms) : 0, 231013
IAST [baseline] (22.663 ms) : 0, 22663
IAST [candidate] (23.044 ms) : 0, 23044
AppSec [baseline] (56.446 ms) : 0, 56446
AppSec [candidate] (56.734 ms) : 0, 56734
Debugger [baseline] (5.893 ms) : 0, 5893
Debugger [candidate] (5.931 ms) : 0, 5931
Remote Config [baseline] (593.172 µs) : 0, 593
Remote Config [candidate] (592.561 µs) : 0, 593
Telemetry [baseline] (7.902 ms) : 0, 7902
Telemetry [candidate] (7.92 ms) : 0, 7920
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (790.339 ms) : 0, 790339
BytebuddyAgent [candidate] (796.121 ms) : 0, 796121
GlobalTracer [baseline] (229.973 ms) : 0, 229973
GlobalTracer [candidate] (231.013 ms) : 0, 231013
IAST [baseline] (22.883 ms) : 0, 22883
IAST [candidate] (23.86 ms) : 0, 23860
AppSec [baseline] (56.284 ms) : 0, 56284
AppSec [candidate] (56.488 ms) : 0, 56488
Debugger [baseline] (5.885 ms) : 0, 5885
Debugger [candidate] (6.025 ms) : 0, 6025
Remote Config [baseline] (581.76 µs) : 0, 582
Remote Config [candidate] (594.604 µs) : 0, 595
Telemetry [baseline] (7.867 ms) : 0, 7867
Telemetry [candidate] (8.05 ms) : 0, 8050
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (785.613 ms) : 0, 785613
BytebuddyAgent [candidate] (785.502 ms) : 0, 785502
GlobalTracer [baseline] (229.45 ms) : 0, 229450
GlobalTracer [candidate] (229.6 ms) : 0, 229600
IAST [baseline] (22.21 ms) : 0, 22210
IAST [candidate] (22.16 ms) : 0, 22160
AppSec [baseline] (56.559 ms) : 0, 56559
AppSec [candidate] (56.738 ms) : 0, 56738
Debugger [baseline] (5.904 ms) : 0, 5904
Debugger [candidate] (6.031 ms) : 0, 6031
Remote Config [baseline] (593.455 µs) : 0, 593
Remote Config [candidate] (608.45 µs) : 0, 608
Telemetry [baseline] (7.689 ms) : 0, 7689
Telemetry [candidate] (7.86 ms) : 0, 7860

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.49.0-SNAPSHOT~58196c0481, baseline=1.49.0-SNAPSHOT~9f6519428f

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.008 s) : 0, 1007821
Total [baseline] (10.485 s) : 0, 10485416
Agent [candidate] (1.015 s) : 0, 1014931
Total [candidate] (10.593 s) : 0, 10592883
section appsec
Agent [baseline] (1.152 s) : 0, 1152184
Total [baseline] (10.705 s) : 0, 10704877
Agent [candidate] (1.153 s) : 0, 1153214
Total [candidate] (10.694 s) : 0, 10693835
section iast
Agent [baseline] (1.143 s) : 0, 1142543
Total [baseline] (10.951 s) : 0, 10951426
Agent [candidate] (1.146 s) : 0, 1146399
Total [candidate] (10.861 s) : 0, 10860531
section profiling
Agent [baseline] (1.267 s) : 0, 1267439
Total [baseline] (10.877 s) : 0, 10877050
Agent [candidate] (1.265 s) : 0, 1264713
Total [candidate] (10.829 s) : 0, 10829010

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.008 s	-
Agent	appsec	1.152 s	144.362 ms (14.3%)
Agent	iast	1.143 s	134.722 ms (13.4%)
Agent	profiling	1.267 s	259.617 ms (25.8%)
Total	tracing	10.485 s	-
Total	appsec	10.705 s	219.462 ms (2.1%)
Total	iast	10.951 s	466.01 ms (4.4%)
Total	profiling	10.877 s	391.634 ms (3.7%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.015 s	-
Agent	appsec	1.153 s	138.283 ms (13.6%)
Agent	iast	1.146 s	131.468 ms (13.0%)
Agent	profiling	1.265 s	249.783 ms (24.6%)
Total	tracing	10.593 s	-
Total	appsec	10.694 s	100.952 ms (1.0%)
Total	iast	10.861 s	267.648 ms (2.5%)
Total	profiling	10.829 s	236.127 ms (2.2%)

gantt
    title petclinic - break down per module: candidate=1.49.0-SNAPSHOT~58196c0481, baseline=1.49.0-SNAPSHOT~9f6519428f

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (672.248 ms) : 0, 672248
BytebuddyAgent [candidate] (675.224 ms) : 0, 675224
GlobalTracer [baseline] (241.097 ms) : 0, 241097
GlobalTracer [candidate] (241.569 ms) : 0, 241569
AppSec [baseline] (54.786 ms) : 0, 54786
AppSec [candidate] (54.848 ms) : 0, 54848
Debugger [baseline] (6.172 ms) : 0, 6172
Debugger [candidate] (7.029 ms) : 0, 7029
Remote Config [baseline] (703.714 µs) : 0, 704
Remote Config [candidate] (704.785 µs) : 0, 705
Telemetry [baseline] (9.251 ms) : 0, 9251
Telemetry [candidate] (12.009 ms) : 0, 12009
section appsec
BytebuddyAgent [baseline] (690.866 ms) : 0, 690866
BytebuddyAgent [candidate] (691.234 ms) : 0, 691234
GlobalTracer [baseline] (237.001 ms) : 0, 237001
GlobalTracer [candidate] (237.417 ms) : 0, 237417
IAST [baseline] (21.719 ms) : 0, 21719
IAST [candidate] (21.983 ms) : 0, 21983
AppSec [baseline] (174.982 ms) : 0, 174982
AppSec [candidate] (174.892 ms) : 0, 174892
Debugger [baseline] (5.84 ms) : 0, 5840
Debugger [candidate] (5.957 ms) : 0, 5957
Remote Config [baseline] (632.332 µs) : 0, 632
Remote Config [candidate] (657.525 µs) : 0, 658
Telemetry [baseline] (8.437 ms) : 0, 8437
Telemetry [candidate] (8.551 ms) : 0, 8551
section iast
BytebuddyAgent [baseline] (794.863 ms) : 0, 794863
BytebuddyAgent [candidate] (796.851 ms) : 0, 796851
GlobalTracer [baseline] (230.423 ms) : 0, 230423
GlobalTracer [candidate] (231.901 ms) : 0, 231901
IAST [baseline] (22.757 ms) : 0, 22757
IAST [candidate] (22.89 ms) : 0, 22890
AppSec [baseline] (56.633 ms) : 0, 56633
AppSec [candidate] (56.57 ms) : 0, 56570
Debugger [baseline] (5.875 ms) : 0, 5875
Debugger [candidate] (5.964 ms) : 0, 5964
Remote Config [baseline] (593.77 µs) : 0, 594
Remote Config [candidate] (597.66 µs) : 0, 598
Telemetry [baseline] (7.928 ms) : 0, 7928
Telemetry [candidate] (8.004 ms) : 0, 8004
section profiling
BytebuddyAgent [baseline] (667.835 ms) : 0, 667835
BytebuddyAgent [candidate] (666.518 ms) : 0, 666518
GlobalTracer [baseline] (381.073 ms) : 0, 381073
GlobalTracer [candidate] (380.931 ms) : 0, 380931
AppSec [baseline] (55.045 ms) : 0, 55045
AppSec [candidate] (54.323 ms) : 0, 54323
Debugger [baseline] (6.212 ms) : 0, 6212
Debugger [candidate] (6.143 ms) : 0, 6143
Remote Config [baseline] (660.067 µs) : 0, 660
Remote Config [candidate] (647.253 µs) : 0, 647
Telemetry [baseline] (8.261 ms) : 0, 8261
Telemetry [candidate] (8.418 ms) : 0, 8418
ProfilingAgent [baseline] (97.884 ms) : 0, 97884
ProfilingAgent [candidate] (97.214 ms) : 0, 97214
Profiling [baseline] (97.907 ms) : 0, 97907
Profiling [candidate] (97.238 ms) : 0, 97238

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
end_time	2025-05-02T14:33:12	2025-05-02T14:40:55
git_branch	master	cbeauchesne/heapsize-build
git_commit_date	1746187873	1746195146
git_commit_sha	`9f65194`	`58196c0`
release_version	1.49.0-SNAPSHOT~9f6519428f	1.49.0-SNAPSHOT~58196c0481
start_time	2025-05-02T14:32:58	2025-05-02T14:40:41

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1746197252	1746197252
ci_job_id	921708521	921708521
ci_pipeline_id	63970936	63970936
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-rwlv-vyc-project-304-concurrent-0-s0lewyq5 6.8.0-1027-aws #29~22.04.1-Ubuntu SMP Sun Mar 30 07:45:38 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-rwlv-vyc-project-304-concurrent-0-s0lewyq5 6.8.0-1027-aws #29~22.04.1-Ubuntu SMP Sun Mar 30 07:45:38 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant	iast	iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 19 unstable metrics.

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.49.0-SNAPSHOT~58196c0481, baseline=1.49.0-SNAPSHOT~9f6519428f
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.349 ms) : 1329, 1368
.   : milestone, 1349,
appsec (1.718 ms) : 1695, 1741
.   : milestone, 1718,
appsec_no_iast (1.725 ms) : 1701, 1748
.   : milestone, 1725,
code_origins (1.664 ms) : 1637, 1690
.   : milestone, 1664,
iast (1.524 ms) : 1500, 1549
.   : milestone, 1524,
profiling (1.575 ms) : 1542, 1608
.   : milestone, 1575,
tracing (1.483 ms) : 1458, 1507
.   : milestone, 1483,
section candidate
no_agent (1.361 ms) : 1341, 1380
.   : milestone, 1361,
appsec (1.734 ms) : 1710, 1758
.   : milestone, 1734,
appsec_no_iast (1.734 ms) : 1710, 1758
.   : milestone, 1734,
code_origins (1.668 ms) : 1641, 1695
.   : milestone, 1668,
iast (1.51 ms) : 1486, 1534
.   : milestone, 1510,
profiling (1.521 ms) : 1495, 1546
.   : milestone, 1521,
tracing (1.501 ms) : 1477, 1526
.   : milestone, 1501,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.349 ms [1.329 ms, 1.368 ms]	-
appsec	1.718 ms [1.695 ms, 1.741 ms]	369.411 µs (27.4%)
appsec_no_iast	1.725 ms [1.701 ms, 1.748 ms]	376.182 µs (27.9%)
code_origins	1.664 ms [1.637 ms, 1.69 ms]	315.163 µs (23.4%)
iast	1.524 ms [1.5 ms, 1.549 ms]	175.813 µs (13.0%)
profiling	1.575 ms [1.542 ms, 1.608 ms]	226.473 µs (16.8%)
tracing	1.483 ms [1.458 ms, 1.507 ms]	134.466 µs (10.0%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.361 ms [1.341 ms, 1.38 ms]	-
appsec	1.734 ms [1.71 ms, 1.758 ms]	373.64 µs (27.5%)
appsec_no_iast	1.734 ms [1.71 ms, 1.758 ms]	373.281 µs (27.4%)
code_origins	1.668 ms [1.641 ms, 1.695 ms]	307.427 µs (22.6%)
iast	1.51 ms [1.486 ms, 1.534 ms]	149.378 µs (11.0%)
profiling	1.521 ms [1.495 ms, 1.546 ms]	159.899 µs (11.8%)
tracing	1.501 ms [1.477 ms, 1.526 ms]	140.377 µs (10.3%)

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.49.0-SNAPSHOT~58196c0481, baseline=1.49.0-SNAPSHOT~9f6519428f
    dateFormat X
    axisFormat %s
section baseline
no_agent (379.685 µs) : 360, 399
.   : milestone, 380,
iast (529.742 µs) : 506, 554
.   : milestone, 530,
iast_FULL (733.388 µs) : 710, 757
.   : milestone, 733,
iast_GLOBAL (564.11 µs) : 540, 588
.   : milestone, 564,
iast_HARDCODED_SECRET_DISABLED (520.662 µs) : 498, 543
.   : milestone, 521,
iast_INACTIVE (471.444 µs) : 449, 494
.   : milestone, 471,
iast_TELEMETRY_OFF (500.183 µs) : 478, 523
.   : milestone, 500,
tracing (457.953 µs) : 436, 480
.   : milestone, 458,
section candidate
no_agent (380.093 µs) : 360, 400
.   : milestone, 380,
iast (519.847 µs) : 497, 543
.   : milestone, 520,
iast_FULL (736.036 µs) : 713, 759
.   : milestone, 736,
iast_GLOBAL (568.953 µs) : 546, 592
.   : milestone, 569,
iast_HARDCODED_SECRET_DISABLED (527.602 µs) : 505, 550
.   : milestone, 528,
iast_INACTIVE (464.546 µs) : 443, 486
.   : milestone, 465,
iast_TELEMETRY_OFF (503.985 µs) : 480, 528
.   : milestone, 504,
tracing (459.172 µs) : 437, 482
.   : milestone, 459,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	379.685 µs [360.253 µs, 399.118 µs]	-
iast	529.742 µs [505.866 µs, 553.617 µs]	150.056 µs (39.5%)
iast_FULL	733.388 µs [709.733 µs, 757.043 µs]	353.703 µs (93.2%)
iast_GLOBAL	564.11 µs [540.023 µs, 588.198 µs]	184.425 µs (48.6%)
iast_HARDCODED_SECRET_DISABLED	520.662 µs [498.171 µs, 543.153 µs]	140.976 µs (37.1%)
iast_INACTIVE	471.444 µs [448.635 µs, 494.253 µs]	91.759 µs (24.2%)
iast_TELEMETRY_OFF	500.183 µs [477.546 µs, 522.82 µs]	120.497 µs (31.7%)
tracing	457.953 µs [435.877 µs, 480.029 µs]	78.268 µs (20.6%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	380.093 µs [360.114 µs, 400.072 µs]	-
iast	519.847 µs [496.825 µs, 542.87 µs]	139.754 µs (36.8%)
iast_FULL	736.036 µs [712.657 µs, 759.415 µs]	355.943 µs (93.6%)
iast_GLOBAL	568.953 µs [545.729 µs, 592.177 µs]	188.86 µs (49.7%)
iast_HARDCODED_SECRET_DISABLED	527.602 µs [505.131 µs, 550.073 µs]	147.509 µs (38.8%)
iast_INACTIVE	464.546 µs [443.426 µs, 485.665 µs]	84.452 µs (22.2%)
iast_TELEMETRY_OFF	503.985 µs [479.913 µs, 528.058 µs]	123.892 µs (32.6%)
tracing	459.172 µs [436.679 µs, 481.664 µs]	79.079 µs (20.8%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	cbeauchesne/heapsize-build
git_commit_date	1746187873	1746195146
git_commit_sha	`9f65194`	`58196c0`
release_version	1.49.0-SNAPSHOT~9f6519428f	1.49.0-SNAPSHOT~58196c0481

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1746197747	1746197747
ci_job_id	921708522	921708522
ci_pipeline_id	63970936	63970936
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-tsd2jdn2-project-304-concurrent-1-3s84l97p 6.8.0-1027-aws #29~22.04.1-Ubuntu SMP Sun Mar 30 07:45:38 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-tsd2jdn2-project-304-concurrent-1-3s84l97p 6.8.0-1027-aws #29~22.04.1-Ubuntu SMP Sun Mar 30 07:45:38 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant	appsec	appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.49.0-SNAPSHOT~58196c0481, baseline=1.49.0-SNAPSHOT~9f6519428f
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.479 ms) : 1467, 1490
.   : milestone, 1479,
appsec (2.402 ms) : 2353, 2451
.   : milestone, 2402,
iast (2.187 ms) : 2126, 2249
.   : milestone, 2187,
iast_GLOBAL (2.231 ms) : 2168, 2293
.   : milestone, 2231,
profiling (2.042 ms) : 1992, 2093
.   : milestone, 2042,
tracing (2.007 ms) : 1959, 2055
.   : milestone, 2007,
section candidate
no_agent (1.48 ms) : 1469, 1492
.   : milestone, 1480,
appsec (2.406 ms) : 2357, 2455
.   : milestone, 2406,
iast (2.184 ms) : 2122, 2245
.   : milestone, 2184,
iast_GLOBAL (2.235 ms) : 2173, 2297
.   : milestone, 2235,
profiling (2.534 ms) : 2350, 2717
.   : milestone, 2534,
tracing (2.016 ms) : 1969, 2064
.   : milestone, 2016,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.479 ms [1.467 ms, 1.49 ms]	-
appsec	2.402 ms [2.353 ms, 2.451 ms]	922.927 µs (62.4%)
iast	2.187 ms [2.126 ms, 2.249 ms]	708.492 µs (47.9%)
iast_GLOBAL	2.231 ms [2.168 ms, 2.293 ms]	751.896 µs (50.8%)
profiling	2.042 ms [1.992 ms, 2.093 ms]	563.454 µs (38.1%)
tracing	2.007 ms [1.959 ms, 2.055 ms]	528.022 µs (35.7%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.48 ms [1.469 ms, 1.492 ms]	-
appsec	2.406 ms [2.357 ms, 2.455 ms]	925.521 µs (62.5%)
iast	2.184 ms [2.122 ms, 2.245 ms]	703.098 µs (47.5%)
iast_GLOBAL	2.235 ms [2.173 ms, 2.297 ms]	754.621 µs (51.0%)
profiling	2.534 ms [2.35 ms, 2.717 ms]	1.053 ms (71.1%)
tracing	2.016 ms [1.969 ms, 2.064 ms]	535.896 µs (36.2%)

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.49.0-SNAPSHOT~58196c0481, baseline=1.49.0-SNAPSHOT~9f6519428f
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.983 s) : 14983000, 14983000
.   : milestone, 14983000,
appsec (14.952 s) : 14952000, 14952000
.   : milestone, 14952000,
iast (19.184 s) : 19184000, 19184000
.   : milestone, 19184000,
iast_GLOBAL (17.942 s) : 17942000, 17942000
.   : milestone, 17942000,
profiling (15.696 s) : 15696000, 15696000
.   : milestone, 15696000,
tracing (15.089 s) : 15089000, 15089000
.   : milestone, 15089000,
section candidate
no_agent (14.669 s) : 14669000, 14669000
.   : milestone, 14669000,
appsec (15.058 s) : 15058000, 15058000
.   : milestone, 15058000,
iast (18.578 s) : 18578000, 18578000
.   : milestone, 18578000,
iast_GLOBAL (18.159 s) : 18159000, 18159000
.   : milestone, 18159000,
profiling (14.715 s) : 14715000, 14715000
.   : milestone, 14715000,
tracing (15.039 s) : 15039000, 15039000
.   : milestone, 15039000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	14.983 s [14.983 s, 14.983 s]	-
appsec	14.952 s [14.952 s, 14.952 s]	-31.0 ms (-0.2%)
iast	19.184 s [19.184 s, 19.184 s]	4.201 s (28.0%)
iast_GLOBAL	17.942 s [17.942 s, 17.942 s]	2.959 s (19.7%)
profiling	15.696 s [15.696 s, 15.696 s]	713.0 ms (4.8%)
tracing	15.089 s [15.089 s, 15.089 s]	106.0 ms (0.7%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	14.669 s [14.669 s, 14.669 s]	-
appsec	15.058 s [15.058 s, 15.058 s]	389.0 ms (2.7%)
iast	18.578 s [18.578 s, 18.578 s]	3.909 s (26.6%)
iast_GLOBAL	18.159 s [18.159 s, 18.159 s]	3.49 s (23.8%)
profiling	14.715 s [14.715 s, 14.715 s]	46.0 ms (0.3%)
tracing	15.039 s [15.039 s, 15.039 s]	370.0 ms (2.5%)

increase heap memory for build step on system-tests

d435432

cbeauchesne force-pushed the cbeauchesne/heapsize-build branch from 4235856 to d435432 Compare May 2, 2025 13:27

cbeauchesne marked this pull request as ready for review May 2, 2025 13:35

cbeauchesne requested a review from a team as a code owner May 2, 2025 13:35

cbeauchesne requested a review from PerfectSlayer May 2, 2025 13:35

cbeauchesne enabled auto-merge (squash) May 2, 2025 13:46

cbeauchesne added type: enhancement comp: testing Testing comp: tooling Build & Tooling labels May 2, 2025

use old way to send env, and exclude two scenario

58196c0

mcculls approved these changes May 2, 2025

View reviewed changes

Also skip APM_TRACING_E2E_SINGLE_SPAN

fd98df5

cbeauchesne merged commit 5a04e8c into master May 2, 2025
428 of 450 checks passed

cbeauchesne deleted the cbeauchesne/heapsize-build branch May 2, 2025 18:06

github-actions bot added this to the 1.49.0 milestone May 2, 2025

smola added the tag: no release notes Changes to exclude from release notes label May 6, 2025

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

increase heap memory for build step on system-tests #8758

increase heap memory for build step on system-tests #8758

cbeauchesne commented May 2, 2025

github-actions bot commented May 2, 2025

pr-commenter bot commented May 2, 2025

increase heap memory for build step on system-tests #8758

increase heap memory for build step on system-tests #8758

Conversation

cbeauchesne commented May 2, 2025

What Does This Do

Motivation

Additional Notes

Contributor Checklist

github-actions bot commented May 2, 2025

pr-commenter bot commented May 2, 2025

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary