Allow to manually set PR info #8566

nikita-tkachenko-datadog · 2025-03-14T15:01:05Z

What Does This Do

Adds support for DDCI_PULL_REQUEST_SOURCE_SHA and DDCI_PULL_REQUEST_TARGET_SHA environment variables that can be used to manually provide PR info to the tracer (for CI providers or non-standard set ups where the PR info cannot be determined automatically).

Additional Notes

The PR also contains a small refactoring, moving some of the CI Vis constants to the internal module - the goal is to reduce what we expose in the API.

Contributor Checklist

Format the title according the contribution guidelines
Assign the type: and (comp: or inst:) labels in addition to any usefull labels
Don't use close, fix or any linking keywords when referencing an issue.
Use solves instead, and assign the PR milestone to the issue
Update the public documentation in case of new configuration flag or behavior

pr-commenter · 2025-03-14T16:09:54Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	nikita-tkachenko/manual-pr-info
git_commit_date	1741967085	1742203526
git_commit_sha	`c06a408`	`c8c0479`
release_version	1.48.0-SNAPSHOT~c06a40868a	1.48.0-SNAPSHOT~c8c04796ed

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1742206032	1742206032
ci_job_id	850197925	850197925
ci_pipeline_id	58997839	58997839
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-hvxyazeg-project-304-concurrent-3-ct2bcmno 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-hvxyazeg-project-304-concurrent-3-ct2bcmno 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None
variant	iast	iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 59 metrics, 4 unstable metrics.

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.48.0-SNAPSHOT~c8c04796ed, baseline=1.48.0-SNAPSHOT~c06a40868a

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.039 s) : 0, 1039163
Total [baseline] (10.396 s) : 0, 10396416
Agent [candidate] (1.041 s) : 0, 1041416
Total [candidate] (10.425 s) : 0, 10424946
section appsec
Agent [baseline] (1.181 s) : 0, 1181226
Total [baseline] (10.765 s) : 0, 10765060
Agent [candidate] (1.189 s) : 0, 1189430
Total [candidate] (10.774 s) : 0, 10773934
section iast
Agent [baseline] (1.171 s) : 0, 1171322
Total [baseline] (10.954 s) : 0, 10953776
Agent [candidate] (1.17 s) : 0, 1169982
Total [candidate] (10.965 s) : 0, 10964907
section profiling
Agent [baseline] (1.259 s) : 0, 1258671
Total [baseline] (10.861 s) : 0, 10860548
Agent [candidate] (1.258 s) : 0, 1258328
Total [candidate] (10.827 s) : 0, 10826821

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.039 s	-
Agent	appsec	1.181 s	142.063 ms (13.7%)
Agent	iast	1.171 s	132.158 ms (12.7%)
Agent	profiling	1.259 s	219.508 ms (21.1%)
Total	tracing	10.396 s	-
Total	appsec	10.765 s	368.645 ms (3.5%)
Total	iast	10.954 s	557.361 ms (5.4%)
Total	profiling	10.861 s	464.133 ms (4.5%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.041 s	-
Agent	appsec	1.189 s	148.014 ms (14.2%)
Agent	iast	1.17 s	128.566 ms (12.3%)
Agent	profiling	1.258 s	216.912 ms (20.8%)
Total	tracing	10.425 s	-
Total	appsec	10.774 s	348.988 ms (3.3%)
Total	iast	10.965 s	539.961 ms (5.2%)
Total	profiling	10.827 s	401.875 ms (3.9%)

gantt
    title petclinic - break down per module: candidate=1.48.0-SNAPSHOT~c8c04796ed, baseline=1.48.0-SNAPSHOT~c06a40868a

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (716.909 ms) : 0, 716909
BytebuddyAgent [candidate] (719.04 ms) : 0, 719040
GlobalTracer [baseline] (238.817 ms) : 0, 238817
GlobalTracer [candidate] (239.81 ms) : 0, 239810
AppSec [baseline] (54.445 ms) : 0, 54445
AppSec [candidate] (54.64 ms) : 0, 54640
Remote Config [baseline] (695.501 µs) : 0, 696
Remote Config [candidate] (681.73 µs) : 0, 682
Telemetry [baseline] (13.038 ms) : 0, 13038
Telemetry [candidate] (12.031 ms) : 0, 12031
section appsec
BytebuddyAgent [baseline] (735.039 ms) : 0, 735039
BytebuddyAgent [candidate] (740.016 ms) : 0, 740016
GlobalTracer [baseline] (235.808 ms) : 0, 235808
GlobalTracer [candidate] (237.775 ms) : 0, 237775
AppSec [baseline] (175.544 ms) : 0, 175544
AppSec [candidate] (176.302 ms) : 0, 176302
Remote Config [baseline] (668.044 µs) : 0, 668
Remote Config [candidate] (667.61 µs) : 0, 668
Telemetry [baseline] (8.273 ms) : 0, 8273
Telemetry [candidate] (8.657 ms) : 0, 8657
IAST [baseline] (21.34 ms) : 0, 21340
IAST [candidate] (21.471 ms) : 0, 21471
section iast
BytebuddyAgent [baseline] (837.795 ms) : 0, 837795
BytebuddyAgent [candidate] (836.315 ms) : 0, 836315
GlobalTracer [baseline] (230.489 ms) : 0, 230489
GlobalTracer [candidate] (230.326 ms) : 0, 230326
AppSec [baseline] (55.997 ms) : 0, 55997
AppSec [candidate] (55.98 ms) : 0, 55980
Remote Config [baseline] (598.512 µs) : 0, 599
Remote Config [candidate] (597.772 µs) : 0, 598
Telemetry [baseline] (8.622 ms) : 0, 8622
Telemetry [candidate] (8.655 ms) : 0, 8655
IAST [baseline] (22.571 ms) : 0, 22571
IAST [candidate] (22.818 ms) : 0, 22818
section profiling
BytebuddyAgent [baseline] (708.116 ms) : 0, 708116
BytebuddyAgent [candidate] (708.287 ms) : 0, 708287
GlobalTracer [baseline] (349.173 ms) : 0, 349173
GlobalTracer [candidate] (349.984 ms) : 0, 349984
AppSec [baseline] (54.337 ms) : 0, 54337
AppSec [candidate] (53.487 ms) : 0, 53487
Remote Config [baseline] (664.234 µs) : 0, 664
Remote Config [candidate] (661.823 µs) : 0, 662
Telemetry [baseline] (8.936 ms) : 0, 8936
Telemetry [candidate] (8.922 ms) : 0, 8922
ProfilingAgent [baseline] (96.345 ms) : 0, 96345
ProfilingAgent [candidate] (96.337 ms) : 0, 96337
Profiling [baseline] (96.37 ms) : 0, 96370
Profiling [candidate] (96.36 ms) : 0, 96360

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.48.0-SNAPSHOT~c8c04796ed, baseline=1.48.0-SNAPSHOT~c06a40868a

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.039 s) : 0, 1039173
Total [baseline] (8.679 s) : 0, 8678597
Agent [candidate] (1.04 s) : 0, 1039612
Total [candidate] (8.662 s) : 0, 8661658
section iast
Agent [baseline] (1.17 s) : 0, 1169567
Total [baseline] (9.236 s) : 0, 9236210
Agent [candidate] (1.17 s) : 0, 1169953
Total [candidate] (9.254 s) : 0, 9253769
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.168 s) : 0, 1167662
Total [baseline] (9.195 s) : 0, 9195020
Agent [candidate] (1.181 s) : 0, 1180722
Total [candidate] (9.246 s) : 0, 9246154
section iast_TELEMETRY_OFF
Agent [baseline] (1.168 s) : 0, 1167754
Total [baseline] (9.287 s) : 0, 9286522
Agent [candidate] (1.168 s) : 0, 1167552
Total [candidate] (9.267 s) : 0, 9267279

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.039 s	-
Agent	iast	1.17 s	130.394 ms (12.5%)
Agent	iast_HARDCODED_SECRET_DISABLED	1.168 s	128.489 ms (12.4%)
Agent	iast_TELEMETRY_OFF	1.168 s	128.581 ms (12.4%)
Total	tracing	8.679 s	-
Total	iast	9.236 s	557.612 ms (6.4%)
Total	iast_HARDCODED_SECRET_DISABLED	9.195 s	516.422 ms (6.0%)
Total	iast_TELEMETRY_OFF	9.287 s	607.925 ms (7.0%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.04 s	-
Agent	iast	1.17 s	130.341 ms (12.5%)
Agent	iast_HARDCODED_SECRET_DISABLED	1.181 s	141.11 ms (13.6%)
Agent	iast_TELEMETRY_OFF	1.168 s	127.94 ms (12.3%)
Total	tracing	8.662 s	-
Total	iast	9.254 s	592.111 ms (6.8%)
Total	iast_HARDCODED_SECRET_DISABLED	9.246 s	584.497 ms (6.7%)
Total	iast_TELEMETRY_OFF	9.267 s	605.622 ms (7.0%)

gantt
    title insecure-bank - break down per module: candidate=1.48.0-SNAPSHOT~c8c04796ed, baseline=1.48.0-SNAPSHOT~c06a40868a

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (717.605 ms) : 0, 717605
BytebuddyAgent [candidate] (716.204 ms) : 0, 716204
GlobalTracer [baseline] (239.375 ms) : 0, 239375
GlobalTracer [candidate] (239.268 ms) : 0, 239268
AppSec [baseline] (54.352 ms) : 0, 54352
AppSec [candidate] (54.493 ms) : 0, 54493
Remote Config [baseline] (674.52 µs) : 0, 675
Remote Config [candidate] (681.281 µs) : 0, 681
Telemetry [baseline] (11.974 ms) : 0, 11974
Telemetry [candidate] (13.718 ms) : 0, 13718
section iast
BytebuddyAgent [baseline] (836.084 ms) : 0, 836084
BytebuddyAgent [candidate] (836.316 ms) : 0, 836316
GlobalTracer [baseline] (229.921 ms) : 0, 229921
GlobalTracer [candidate] (230.253 ms) : 0, 230253
AppSec [baseline] (56.167 ms) : 0, 56167
AppSec [candidate] (56.081 ms) : 0, 56081
Remote Config [baseline] (611.342 µs) : 0, 611
Remote Config [candidate] (601.824 µs) : 0, 602
Telemetry [baseline] (8.706 ms) : 0, 8706
Telemetry [candidate] (8.626 ms) : 0, 8626
IAST [baseline] (22.854 ms) : 0, 22854
IAST [candidate] (22.76 ms) : 0, 22760
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (833.975 ms) : 0, 833975
BytebuddyAgent [candidate] (843.876 ms) : 0, 843876
GlobalTracer [baseline] (230.192 ms) : 0, 230192
GlobalTracer [candidate] (232.274 ms) : 0, 232274
AppSec [baseline] (56.329 ms) : 0, 56329
AppSec [candidate] (56.615 ms) : 0, 56615
Remote Config [baseline] (611.7 µs) : 0, 612
Remote Config [candidate] (620.973 µs) : 0, 621
Telemetry [baseline] (8.644 ms) : 0, 8644
Telemetry [candidate] (8.727 ms) : 0, 8727
IAST [baseline] (22.596 ms) : 0, 22596
IAST [candidate] (23.132 ms) : 0, 23132
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (834.397 ms) : 0, 834397
BytebuddyAgent [candidate] (834.5 ms) : 0, 834500
GlobalTracer [baseline] (230.332 ms) : 0, 230332
GlobalTracer [candidate] (230.635 ms) : 0, 230635
AppSec [baseline] (56.036 ms) : 0, 56036
AppSec [candidate] (55.788 ms) : 0, 55788
Remote Config [baseline] (620.093 µs) : 0, 620
Remote Config [candidate] (609.497 µs) : 0, 609
Telemetry [baseline] (8.684 ms) : 0, 8684
Telemetry [candidate] (8.519 ms) : 0, 8519
IAST [baseline] (22.374 ms) : 0, 22374
IAST [candidate] (22.236 ms) : 0, 22236

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
end_time	2025-03-17T09:37:29	2025-03-17T09:45:10
git_branch	master	nikita-tkachenko/manual-pr-info
git_commit_date	1741967085	1742203526
git_commit_sha	`c06a408`	`c8c0479`
release_version	1.48.0-SNAPSHOT~c06a40868a	1.48.0-SNAPSHOT~c8c04796ed
start_time	2025-03-17T09:37:15	2025-03-17T09:44:56

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1742205106	1742205106
ci_job_id	850197926	850197926
ci_pipeline_id	58997839	58997839
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-hvxyazeg-project-304-concurrent-4-7fg0b0d0 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-hvxyazeg-project-304-concurrent-4-7fg0b0d0 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant	iast	iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 13 metrics, 17 unstable metrics.

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.48.0-SNAPSHOT~c8c04796ed, baseline=1.48.0-SNAPSHOT~c06a40868a
    dateFormat X
    axisFormat %s
section baseline
no_agent (378.3 µs) : 358, 398
.   : milestone, 378,
iast (506.714 µs) : 485, 528
.   : milestone, 507,
iast_FULL (721.629 µs) : 700, 744
.   : milestone, 722,
iast_GLOBAL (549.303 µs) : 528, 571
.   : milestone, 549,
iast_HARDCODED_SECRET_DISABLED (510.288 µs) : 488, 532
.   : milestone, 510,
iast_INACTIVE (462.225 µs) : 440, 485
.   : milestone, 462,
iast_TELEMETRY_OFF (500.098 µs) : 477, 523
.   : milestone, 500,
tracing (453.265 µs) : 432, 474
.   : milestone, 453,
section candidate
no_agent (378.376 µs) : 358, 398
.   : milestone, 378,
iast (507.816 µs) : 486, 529
.   : milestone, 508,
iast_FULL (727.667 µs) : 706, 750
.   : milestone, 728,
iast_GLOBAL (549.244 µs) : 528, 571
.   : milestone, 549,
iast_HARDCODED_SECRET_DISABLED (513.621 µs) : 492, 535
.   : milestone, 514,
iast_INACTIVE (453.819 µs) : 433, 475
.   : milestone, 454,
iast_TELEMETRY_OFF (497.345 µs) : 475, 519
.   : milestone, 497,
tracing (448.813 µs) : 428, 470
.   : milestone, 449,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	378.3 µs [358.397 µs, 398.203 µs]	-
iast	506.714 µs [485.047 µs, 528.381 µs]	128.414 µs (33.9%)
iast_FULL	721.629 µs [699.736 µs, 743.521 µs]	343.329 µs (90.8%)
iast_GLOBAL	549.303 µs [527.515 µs, 571.091 µs]	171.003 µs (45.2%)
iast_HARDCODED_SECRET_DISABLED	510.288 µs [488.113 µs, 532.463 µs]	131.988 µs (34.9%)
iast_INACTIVE	462.225 µs [439.747 µs, 484.703 µs]	83.925 µs (22.2%)
iast_TELEMETRY_OFF	500.098 µs [477.014 µs, 523.182 µs]	121.798 µs (32.2%)
tracing	453.265 µs [432.412 µs, 474.119 µs]	74.965 µs (19.8%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	378.376 µs [358.296 µs, 398.457 µs]	-
iast	507.816 µs [486.219 µs, 529.412 µs]	129.439 µs (34.2%)
iast_FULL	727.667 µs [705.719 µs, 749.615 µs]	349.291 µs (92.3%)
iast_GLOBAL	549.244 µs [527.669 µs, 570.82 µs]	170.868 µs (45.2%)
iast_HARDCODED_SECRET_DISABLED	513.621 µs [491.871 µs, 535.371 µs]	135.245 µs (35.7%)
iast_INACTIVE	453.819 µs [432.644 µs, 474.993 µs]	75.442 µs (19.9%)
iast_TELEMETRY_OFF	497.345 µs [475.404 µs, 519.286 µs]	118.969 µs (31.4%)
tracing	448.813 µs [427.969 µs, 469.657 µs]	70.437 µs (18.6%)

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.48.0-SNAPSHOT~c8c04796ed, baseline=1.48.0-SNAPSHOT~c06a40868a
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.373 ms) : 1353, 1393
.   : milestone, 1373,
appsec (1.726 ms) : 1702, 1749
.   : milestone, 1726,
appsec_no_iast (1.726 ms) : 1702, 1750
.   : milestone, 1726,
code_origins (1.675 ms) : 1648, 1702
.   : milestone, 1675,
iast (1.502 ms) : 1477, 1527
.   : milestone, 1502,
profiling (1.503 ms) : 1480, 1527
.   : milestone, 1503,
tracing (1.494 ms) : 1470, 1518
.   : milestone, 1494,
section candidate
no_agent (1.358 ms) : 1339, 1377
.   : milestone, 1358,
appsec (1.746 ms) : 1723, 1770
.   : milestone, 1746,
appsec_no_iast (1.729 ms) : 1704, 1753
.   : milestone, 1729,
code_origins (1.684 ms) : 1658, 1710
.   : milestone, 1684,
iast (1.501 ms) : 1477, 1524
.   : milestone, 1501,
profiling (1.508 ms) : 1484, 1531
.   : milestone, 1508,
tracing (1.497 ms) : 1473, 1521
.   : milestone, 1497,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.373 ms [1.353 ms, 1.393 ms]	-
appsec	1.726 ms [1.702 ms, 1.749 ms]	352.941 µs (25.7%)
appsec_no_iast	1.726 ms [1.702 ms, 1.75 ms]	353.244 µs (25.7%)
code_origins	1.675 ms [1.648 ms, 1.702 ms]	302.35 µs (22.0%)
iast	1.502 ms [1.477 ms, 1.527 ms]	129.412 µs (9.4%)
profiling	1.503 ms [1.48 ms, 1.527 ms]	130.56 µs (9.5%)
tracing	1.494 ms [1.47 ms, 1.518 ms]	121.426 µs (8.8%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.358 ms [1.339 ms, 1.377 ms]	-
appsec	1.746 ms [1.723 ms, 1.77 ms]	388.138 µs (28.6%)
appsec_no_iast	1.729 ms [1.704 ms, 1.753 ms]	370.283 µs (27.3%)
code_origins	1.684 ms [1.658 ms, 1.71 ms]	325.854 µs (24.0%)
iast	1.501 ms [1.477 ms, 1.524 ms]	142.409 µs (10.5%)
profiling	1.508 ms [1.484 ms, 1.531 ms]	149.225 µs (11.0%)
tracing	1.497 ms [1.473 ms, 1.521 ms]	138.627 µs (10.2%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	nikita-tkachenko/manual-pr-info
git_commit_date	1741967085	1742203526
git_commit_sha	`c06a408`	`c8c0479`
release_version	1.48.0-SNAPSHOT~c06a40868a	1.48.0-SNAPSHOT~c8c04796ed

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1742205628	1742205628
ci_job_id	850197927	850197927
ci_pipeline_id	58997839	58997839
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-hvxyazeg-project-304-concurrent-5-raewvhah 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-hvxyazeg-project-304-concurrent-5-raewvhah 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant	appsec	appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.48.0-SNAPSHOT~c8c04796ed, baseline=1.48.0-SNAPSHOT~c06a40868a
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.479 ms) : 1467, 1490
.   : milestone, 1479,
appsec (2.372 ms) : 2328, 2416
.   : milestone, 2372,
iast (2.129 ms) : 2073, 2185
.   : milestone, 2129,
iast_GLOBAL (2.179 ms) : 2123, 2235
.   : milestone, 2179,
profiling (1.992 ms) : 1947, 2037
.   : milestone, 1992,
tracing (1.956 ms) : 1913, 1999
.   : milestone, 1956,
section candidate
no_agent (1.479 ms) : 1468, 1491
.   : milestone, 1479,
appsec (2.378 ms) : 2333, 2422
.   : milestone, 2378,
iast (2.135 ms) : 2079, 2191
.   : milestone, 2135,
iast_GLOBAL (2.174 ms) : 2118, 2231
.   : milestone, 2174,
profiling (1.987 ms) : 1943, 2031
.   : milestone, 1987,
tracing (1.969 ms) : 1926, 2011
.   : milestone, 1969,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.479 ms [1.467 ms, 1.49 ms]	-
appsec	2.372 ms [2.328 ms, 2.416 ms]	893.47 µs (60.4%)
iast	2.129 ms [2.073 ms, 2.185 ms]	650.217 µs (44.0%)
iast_GLOBAL	2.179 ms [2.123 ms, 2.235 ms]	700.459 µs (47.4%)
profiling	1.992 ms [1.947 ms, 2.037 ms]	513.155 µs (34.7%)
tracing	1.956 ms [1.913 ms, 1.999 ms]	477.38 µs (32.3%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.479 ms [1.468 ms, 1.491 ms]	-
appsec	2.378 ms [2.333 ms, 2.422 ms]	898.381 µs (60.7%)
iast	2.135 ms [2.079 ms, 2.191 ms]	655.62 µs (44.3%)
iast_GLOBAL	2.174 ms [2.118 ms, 2.231 ms]	695.061 µs (47.0%)
profiling	1.987 ms [1.943 ms, 2.031 ms]	508.046 µs (34.3%)
tracing	1.969 ms [1.926 ms, 2.011 ms]	489.325 µs (33.1%)

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.48.0-SNAPSHOT~c8c04796ed, baseline=1.48.0-SNAPSHOT~c06a40868a
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.952 s) : 14952000, 14952000
.   : milestone, 14952000,
appsec (14.716 s) : 14716000, 14716000
.   : milestone, 14716000,
iast (18.538 s) : 18538000, 18538000
.   : milestone, 18538000,
iast_GLOBAL (17.786 s) : 17786000, 17786000
.   : milestone, 17786000,
profiling (15.042 s) : 15042000, 15042000
.   : milestone, 15042000,
tracing (15.01 s) : 15010000, 15010000
.   : milestone, 15010000,
section candidate
no_agent (14.922 s) : 14922000, 14922000
.   : milestone, 14922000,
appsec (14.802 s) : 14802000, 14802000
.   : milestone, 14802000,
iast (18.885 s) : 18885000, 18885000
.   : milestone, 18885000,
iast_GLOBAL (18.122 s) : 18122000, 18122000
.   : milestone, 18122000,
profiling (15.177 s) : 15177000, 15177000
.   : milestone, 15177000,
tracing (14.841 s) : 14841000, 14841000
.   : milestone, 14841000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	14.952 s [14.952 s, 14.952 s]	-
appsec	14.716 s [14.716 s, 14.716 s]	-236.0 ms (-1.6%)
iast	18.538 s [18.538 s, 18.538 s]	3.586 s (24.0%)
iast_GLOBAL	17.786 s [17.786 s, 17.786 s]	2.834 s (19.0%)
profiling	15.042 s [15.042 s, 15.042 s]	90.0 ms (0.6%)
tracing	15.01 s [15.01 s, 15.01 s]	58.0 ms (0.4%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	14.922 s [14.922 s, 14.922 s]	-
appsec	14.802 s [14.802 s, 14.802 s]	-120.0 ms (-0.8%)
iast	18.885 s [18.885 s, 18.885 s]	3.963 s (26.6%)
iast_GLOBAL	18.122 s [18.122 s, 18.122 s]	3.2 s (21.4%)
profiling	15.177 s [15.177 s, 15.177 s]	255.0 ms (1.7%)
tracing	14.841 s [14.841 s, 14.841 s]	-81.0 ms (-0.5%)

| Package | Type | Package file | Manager | Update | Change | |---|---|---|---|---|---| | org.flywaydb.flyway | plugin | misk/gradle/libs.versions.toml | gradle | minor | `11.6.0` -> `11.7.0` | | [com.squareup.okio:okio-fakefilesystem](https://github.com/square/okio) | dependencies | misk/gradle/libs.versions.toml | gradle | minor | `3.10.2` -> `3.11.0` | | [com.squareup.okio:okio](https://github.com/square/okio) | dependencies | misk/gradle/libs.versions.toml | gradle | minor | `3.10.2` -> `3.11.0` | | [com.autonomousapps.dependency-analysis](https://github.com/autonomousapps/dependency-analysis-android-gradle-plugin) | plugin | misk/gradle/libs.versions.toml | gradle | minor | `2.15.0` -> `2.16.0` | | [com.datadoghq:dd-trace-api](https://github.com/datadog/dd-trace-java) | dependencies | misk/gradle/libs.versions.toml | gradle | minor | `1.47.3` -> `1.48.1` | | [com.datadoghq:dd-trace-ot](https://github.com/datadog/dd-trace-java) | dependencies | misk/gradle/libs.versions.toml | gradle | minor | `1.47.3` -> `1.48.1` | | [software.amazon.awssdk:sdk-core](https://aws.amazon.com/sdkforjava) | dependencies | misk/gradle/libs.versions.toml | gradle | patch | `2.31.18` -> `2.31.20` | | [software.amazon.awssdk:sqs](https://aws.amazon.com/sdkforjava) | dependencies | misk/gradle/libs.versions.toml | gradle | patch | `2.31.18` -> `2.31.20` | | [software.amazon.awssdk:dynamodb-enhanced](https://aws.amazon.com/sdkforjava) | dependencies | misk/gradle/libs.versions.toml | gradle | patch | `2.31.18` -> `2.31.20` | | [software.amazon.awssdk:dynamodb](https://aws.amazon.com/sdkforjava) | dependencies | misk/gradle/libs.versions.toml | gradle | patch | `2.31.18` -> `2.31.20` | | [software.amazon.awssdk:aws-core](https://aws.amazon.com/sdkforjava) | dependencies | misk/gradle/libs.versions.toml | gradle | patch | `2.31.18` -> `2.31.20` | | [software.amazon.awssdk:bom](https://aws.amazon.com/sdkforjava) | dependencies | misk/gradle/libs.versions.toml | gradle | patch | `2.31.18` -> `2.31.20` | | [software.amazon.awssdk:auth](https://aws.amazon.com/sdkforjava) | dependencies | misk/gradle/libs.versions.toml | gradle | patch | `2.31.18` -> `2.31.20` | --- ### Release Notes <details> <summary>square/okio (com.squareup.okio:okio-fakefilesystem)</summary> ### [`v3.11.0`](https://github.com/square/okio/blob/HEAD/CHANGELOG.md#Version-3110) *2025-04-09* - Fix: Clear the deflater's byte array reference - New: Faster implementation of `String.decodeHex()` on Kotlin/JS. - New: Declare `EXACTLY_ONCE` execution for blocks like `Closeable.use {}` and `FileSystem.read {}`. - Upgrade: \[Kotlin 2.1.20]\[kotlin\_2\_1\_20]. </details> <details> <summary>autonomousapps/dependency-analysis-android-gradle-plugin (com.autonomousapps.dependency-analysis)</summary> ### [`v2.16.0`](https://github.com/autonomousapps/dependency-analysis-android-gradle-plugin/blob/HEAD/CHANGELOG.md#Version-2160) - \[Feat]: support `com.android.test` projects. - \[Feat]: support typesafe project accessors with opt-in. ```kotlin dependencyAnalysis { useTypesafeProjectAccessors(true) // false by default } ``` </details> <details> <summary>datadog/dd-trace-java (com.datadoghq:dd-trace-api)</summary> ### [`v1.48.1`](https://github.com/DataDog/dd-trace-java/releases/tag/v1.48.1): 1.48.1 ### Components #### Tracer internal logging - 🐛 Remove print line causing unnecessary logs ([#8687](DataDog/dd-trace-java#8687) - [@sarahchen6](https://github.com/sarahchen6)) ### [`v1.48.0`](https://github.com/DataDog/dd-trace-java/releases/tag/v1.48.0): 1.48.0 ### Known Bugs > \[!NOTE] > If you are experiencing issues with spamming timeout logs, please update to the [latest version](https://github.com/DataDog/dd-trace-java/releases/latest) or set [JDK_SOCKET_ENABLED](https://github.com/DataDog/dd-trace-java/blob/33fc3c9a9b7cda3beda88b8b3e5224ae2b10764a/dd-trace-api/src/main/java/datadog/trace/api/config/GeneralConfig.java#L98) to false. ### Components #### Application Security Management (IAST) - ✨ Fix vulnerability location org.jose4j.lang.HashUtil ([#8610](DataDog/dd-trace-java#8610) - [@jandro996](https://github.com/jandro996)) - ✨ Fix weak randomness in oracle.ucp.util.OpaqueString ([#8609](DataDog/dd-trace-java#8609) - [@jandro996](https://github.com/jandro996)) - ✨ Fix weak hash false positive in oracle.security.o5logon.O5Logon ([#8608](DataDog/dd-trace-java#8608) - [@jandro996](https://github.com/jandro996)) - 🐛 Prevent before callsites targeting constructors in super calls ([#8549](DataDog/dd-trace-java#8549) - [@manuel-alvarez-alvarez](https://github.com/manuel-alvarez-alvarez)) #### Application Security Management (WAF) - ✨ Update login events public SDK to V2 ([#8620](DataDog/dd-trace-java#8620) - [@manuel-alvarez-alvarez](https://github.com/manuel-alvarez-alvarez)) - 🐛 Send RASP LFI capability only when AppSec is statically enabled ([#8573](DataDog/dd-trace-java#8573) - [@jandro996](https://github.com/jandro996)) - ✨ Improve detection of missing request end events ([#8510](DataDog/dd-trace-java#8510) - [@smola](https://github.com/smola)) - 🧹 Remove remote configuration for API Security sampling rate ([#8486](DataDog/dd-trace-java#8486) - [@smola](https://github.com/smola)) - ✨ Add setUser to user monitoring SDK ([#8482](DataDog/dd-trace-java#8482) - [@manuel-alvarez-alvarez](https://github.com/manuel-alvarez-alvarez)) - ✨ Add missing address for signup event ([#8469](DataDog/dd-trace-java#8469) - [@manuel-alvarez-alvarez](https://github.com/manuel-alvarez-alvarez)) - ✨ Allow login events SDK to be used with appsec disabled ([#8464](DataDog/dd-trace-java#8464) - [@manuel-alvarez-alvarez](https://github.com/manuel-alvarez-alvarez)) - ✨ Add support for endpoint discovery in spring mvc ([#8352](DataDog/dd-trace-java#8352) - [@manuel-alvarez-alvarez](https://github.com/manuel-alvarez-alvarez)) - ✨ New API Security sampling algorithm ([#8178](DataDog/dd-trace-java#8178) - [@ValentinZakharov](https://github.com/ValentinZakharov)) #### Build & Tooling - ✨ Add buffer size customizability to JDK UDS support ([#8629](DataDog/dd-trace-java#8629) - [@sarahchen6](https://github.com/sarahchen6)) - ✨ Add JDK built-in support for UDS on Java 16+ ([#8314](DataDog/dd-trace-java#8314) - [@sarahchen6](https://github.com/sarahchen6)) #### Configuration at Runtime - 🐛 Send RASP LFI capability only when AppSec is statically enabled ([#8573](DataDog/dd-trace-java#8573) - [@jandro996](https://github.com/jandro996)) #### Continuous Integration Visibility - 🐛 Prevent double reporting of Scalatest events when using SBT with test forking ([#8682](DataDog/dd-trace-java#8682) - [@nikita-tkachenko-datadog](https://github.com/nikita-tkachenko-datadog)) - 🐛 Shutdown CI Visibility test event handlers before tracer ([#8677](DataDog/dd-trace-java#8677) - [@nikita-tkachenko-datadog](https://github.com/nikita-tkachenko-datadog)) - 🐛 Do not apply JUnit 4 instrumentation to MUnit runners ([#8675](DataDog/dd-trace-java#8675), [#8683](DataDog/dd-trace-java#8683) - [@nikita-tkachenko-datadog](https://github.com/nikita-tkachenko-datadog)) - ✨ Remove error log when source path resolution fails on isModified check ([#8663](DataDog/dd-trace-java#8663) - [@daniel-mohedano](https://github.com/daniel-mohedano)) - ✨ Implement tests reordering for JUnit 4 ([#8650](DataDog/dd-trace-java#8650) - [@daniel-mohedano](https://github.com/daniel-mohedano)) - 🐛 Set default Attempt to Fix retries if none provided from the backend ([#8615](DataDog/dd-trace-java#8615) - [@daniel-mohedano](https://github.com/daniel-mohedano)) - ✨ Allow to manually set PR info ([#8566](DataDog/dd-trace-java#8566) - [@nikita-tkachenko-datadog](https://github.com/nikita-tkachenko-datadog)) - 🐛 Fix Test Optimization init when repo root cannot be determined ([#8533](DataDog/dd-trace-java#8533) - [@nikita-tkachenko-datadog](https://github.com/nikita-tkachenko-datadog)) - ✨ Add capabilities tagging ([#8499](DataDog/dd-trace-java#8499), [#8540](DataDog/dd-trace-java#8540) - [@daniel-mohedano](https://github.com/daniel-mohedano)) #### Crash tracking - 🐛 Remove dependency on bash from crash/oome uploder scripts ([#8652](DataDog/dd-trace-java#8652) - [@jbachorik](https://github.com/jbachorik)) #### Data Streams Monitoring - ✨ e2e pipeline configuration when data jobs is enabled ([#8553](DataDog/dd-trace-java#8553) - [@kr-igor](https://github.com/kr-igor)) #### Dynamic Instrumentation - 🐛 Fix In-Product when config is empty ([#8679](DataDog/dd-trace-java#8679) - [@jpbempel](https://github.com/jpbempel)) - ✨ Add support for filtering shaded third-party libs ([#8612](DataDog/dd-trace-java#8612) - [@jpbempel](https://github.com/jpbempel)) - ✨ Add In-Product Enablement ([#8587](DataDog/dd-trace-java#8587) - [@jpbempel](https://github.com/jpbempel)) - ✨⚡ Reduce footprint of SourceFile tracking ([#8524](DataDog/dd-trace-java#8524) - [@jpbempel](https://github.com/jpbempel)) - ✨⚡ Optimize the SourceFile tracking ([#8520](DataDog/dd-trace-java#8520) - [@jpbempel](https://github.com/jpbempel)) #### OpenTracing - 🧹 Remove activeScope() use in OpenTracing shim ([#8478](DataDog/dd-trace-java#8478) - [@mcculls](https://github.com/mcculls)) #### Profiling - ✨ Add profiler env check command to AgentCLI ([#8671](DataDog/dd-trace-java#8671) - [@jbachorik](https://github.com/jbachorik)) - ✨ Bump ddprof to 1.23.0 ([#8668](DataDog/dd-trace-java#8668) - [@jbachorik](https://github.com/jbachorik)) - Fix a crash related to ElfParser::loadSymbolTable ([#191](DataDog/dd-trace-java#191)) by [@yanglong1010](https://github.com/yanglong1010) in DataDog/java-profiler#192 - Unwind String.indexOf intrinsic on AArch64 by [@MattAlp](https://github.com/MattAlp) in DataDog/java-profiler#193 - Fix Java 24 support by [@jbachorik](https://github.com/jbachorik) in DataDog/java-profiler#194 - A set of fixes related to clang, aarch64 and musl pecularities of vmstructs stack unwinder by [@jbachorik](https://github.com/jbachorik) in DataDog/java-profiler#199 - 🐛 Remove process information from JFR recording ([#8661](DataDog/dd-trace-java#8661) - [@r1viollet](https://github.com/r1viollet)) - 🐛 Make TempLocationManager USER aware ([#8605](DataDog/dd-trace-java#8605) - [@jbachorik](https://github.com/jbachorik)) - ✨ Extract git tags from embedded git.properties and datadog_git.properties ([#8561](DataDog/dd-trace-java#8561) - [@wmouchere](https://github.com/wmouchere)) #### Telemetry - 🐛 Fix appsec.rasp.error and appsec.waf.error telemetry metrics ([#8624](DataDog/dd-trace-java#8624) - [@jandro996](https://github.com/jandro996)) - ✨ Create metric: appsec.rasp.rule.skipped ([#8618](DataDog/dd-trace-java#8618) - [@jandro996](https://github.com/jandro996)) - ✨ Extract git tags from embedded git.properties and datadog_git.properties ([#8561](DataDog/dd-trace-java#8561) - [@wmouchere](https://github.com/wmouchere)) #### Testing - 🧹 Simplify ssi tests one-pipeline ([#8558](DataDog/dd-trace-java#8558) - [@robertomonteromiguel](https://github.com/robertomonteromiguel)) - ✨ Add smoke tests for java's concurrent API ([#8438](DataDog/dd-trace-java#8438) - [@sarahchen6](https://github.com/sarahchen6)) #### Trace context propagation - ✨ Adding Support for `TRACE_PROPAGATION_BEHAVIOR_EXTRACT` ([#8535](DataDog/dd-trace-java#8535) - [@mhlidd](https://github.com/mhlidd)) #### Tracer core - 🐛 Ensure shaded helpers have unique names ([#8559](DataDog/dd-trace-java#8559) - [@amarziali](https://github.com/amarziali)) - ✨ Support common config sources for user-provided git info ([#8547](DataDog/dd-trace-java#8547) - [@nikita-tkachenko-datadog](https://github.com/nikita-tkachenko-datadog)) - ✨ Make the default config sources more robust when a security manager is installed ([#8544](DataDog/dd-trace-java#8544) - [@mcculls](https://github.com/mcculls)) - ✨ Support targeting services with configurations in stable configuration file ([#8526](DataDog/dd-trace-java#8526) - [@mtoffl01](https://github.com/mtoffl01)) - ✨ Add new parser for `DD_TAGS` and prioritizing `DD_SERVICE` ([#8296](DataDog/dd-trace-java#8296) - [@mhlidd](https://github.com/mhlidd)) #### Tracer internal logging - 🐛 Add missing debug log for the cloudPayloadTaggingServices config ([#8600](DataDog/dd-trace-java#8600) - [@ygree](https://github.com/ygree)) - ✨ Add the possibility to output the logs of the Java tracer in JSON ([#8083](DataDog/dd-trace-java#8083) - [@cecile75](https://github.com/cecile75)) #### Tracer public API - ✨ Introducing `DD_TRACE_EXPERIMENTAL_FEATURES_ENABLED` Config ([#8536](DataDog/dd-trace-java#8536) - [@mhlidd](https://github.com/mhlidd)) - ✨ Config Consistency Round 2 ([#8489](DataDog/dd-trace-java#8489) - [@mhlidd](https://github.com/mhlidd)) ### Instrumentations #### - 🐛 Fix NPE in getMdcCopy of LoggingEventInstrumentation ([#8599](DataDog/dd-trace-java#8599) - [@ygree](https://github.com/ygree)) #### Apache Spark instrumentation - ✨ Instrument Runtime.exit() to finish spark application spans ([#8572](DataDog/dd-trace-java#8572) - [@paul-laffon-dd](https://github.com/paul-laffon-dd)) - ✨ Configure OpenLineage if present in Spark instrumentation ([#8541](DataDog/dd-trace-java#8541) - [@mobuchowski](https://github.com/mobuchowski)) #### Armeria Instrumentation - ✨ Support armeria grpc 1.32.3 ([#8606](DataDog/dd-trace-java#8606) - [@github-actions](https://github.com/github-actions)\[bot]) #### AWS DynamoDB Instrumentation - ✨ Create DynamoDB instrumentation + add span pointers for `updateItem` and `deleteItem` ([#8490](DataDog/dd-trace-java#8490) - [@nhulston](https://github.com/nhulston)) #### AWS SDK instrumentation - ✨ Add DynamoDB in DEFAULT_TRACE_CLOUD_PAYLOAD_TAGGING_SERVICES ([#8595](DataDog/dd-trace-java#8595) - [@joeyzhao2018](https://github.com/joeyzhao2018)) #### Azure Functions instrumentation - ✨ Enable tracer computed trace metrics by default for Azure Functions ([#8518](DataDog/dd-trace-java#8518) - [@duncanpharvey](https://github.com/duncanpharvey)) - 💡 Add azure-functions instrumentation ([#8432](DataDog/dd-trace-java#8432) - [@duncanpharvey](https://github.com/duncanpharvey)) #### Core Java language instrumentation - 🐛 Fix ForkJoinPool.execute() instrumentation on Java 21+ ([#8560](DataDog/dd-trace-java#8560) - [@PerfectSlayer](https://github.com/PerfectSlayer)) #### Eclipse Vert.x instrumentation - ✨ Add vertx postgresql client instrumentation ([#8471](DataDog/dd-trace-java#8471) - [@vandonr](https://github.com/vandonr) - thanks for the contribution!) #### Kafka instrumentation - ✨ Support and test kafka-clients 4 ([#8581](DataDog/dd-trace-java#8581) - [@amarziali](https://github.com/amarziali)) #### Kotlin instrumentation - ✨ Avoid disconnected traces when using Kotlin flowOn ([#8651](DataDog/dd-trace-java#8651) - [@mcculls](https://github.com/mcculls)) #### OpenTelemetry instrumentation - 🧹 Migrate OtelContext wrapper to new internal Context API ([#8645](DataDog/dd-trace-java#8645) - [@mcculls](https://github.com/mcculls)) #### Spring instrumentation - 🐛 Support CompletableFuture on spring webmvc controllers ([#8659](DataDog/dd-trace-java#8659) - [@amarziali](https://github.com/amarziali)) - ✨ Add support for endpoint discovery in spring mvc ([#8352](DataDog/dd-trace-java#8352) - [@manuel-alvarez-alvarez](https://github.com/manuel-alvarez-alvarez)) #### WebSocket Instrumentation - ✨ Instrument Jetty websocket pojo ([#8562](DataDog/dd-trace-java#8562) - [@amarziali](https://github.com/amarziali)) - 💡 Instrument Java Websocket API (JSR356) ([#8440](DataDog/dd-trace-java#8440) - [@amarziali](https://github.com/amarziali)) #### All other instrumentations - ✨ Introduce cache for peer.hostname lookup ([#8601](DataDog/dd-trace-java#8601) - [@mcculls](https://github.com/mcculls)) - ✨ Support pekko http 1.1 ([#8532](DataDog/dd-trace-java#8532) - [@amarziali](https://github.com/amarziali)) </details> --- ### Configuration 📅 **Schedule**: Branch creation - "after 6pm every weekday,before 2am every weekday" in timezone Australia/Melbourne, Automerge - At any time (no schedule defined). 🚦 **Automerge**: Disabled by config. Please merge this manually once you are satisfied. ♻ **Rebasing**: Never, or you tick the rebase/retry checkbox. 👻 **Immortal**: This PR will be recreated if closed unmerged. Get [config help](https://github.com/renovatebot/renovate/discussions) if that's undesired. --- - [ ] If you want to rebase/retry this PR, check this box --- This PR has been generated by [Renovate Bot](https://github.com/renovatebot/renovate). GitOrigin-RevId: 331314f71acaced3adc75ea5d7e855c248d593fc

Allow to manually set PR info

9e3b94f

nikita-tkachenko-datadog added type: enhancement comp: ci visibility Continuous Integration Visibility labels Mar 14, 2025

Replace Jetbrains annotation with a standard javax one

ab6df6e

nikita-tkachenko-datadog marked this pull request as ready for review March 14, 2025 15:49

nikita-tkachenko-datadog requested a review from a team as a code owner March 14, 2025 15:49

nikita-tkachenko-datadog requested review from juan-fernandez and daniel-mohedano March 14, 2025 15:49

Update env var names

c8c0479

daniel-mohedano approved these changes Mar 17, 2025

View reviewed changes

nikita-tkachenko-datadog merged commit 5fb00dc into master Mar 17, 2025
254 checks passed

nikita-tkachenko-datadog deleted the nikita-tkachenko/manual-pr-info branch March 17, 2025 14:30

github-actions bot added this to the 1.48.0 milestone Mar 17, 2025

mtoffl01 pushed a commit that referenced this pull request Mar 24, 2025

Allow to manually set PR info (#8566)

8327a8f

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Allow to manually set PR info #8566

Allow to manually set PR info #8566

nikita-tkachenko-datadog commented Mar 14, 2025 •

edited

Loading

pr-commenter bot commented Mar 14, 2025 •

edited

Loading

Allow to manually set PR info #8566

Allow to manually set PR info #8566

Conversation

nikita-tkachenko-datadog commented Mar 14, 2025 • edited Loading

What Does This Do

Additional Notes

Contributor Checklist

pr-commenter bot commented Mar 14, 2025 • edited Loading

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

nikita-tkachenko-datadog commented Mar 14, 2025 •

edited

Loading

pr-commenter bot commented Mar 14, 2025 •

edited

Loading