Skip to content

Conversation

dd-octo-sts[bot]
Copy link
Contributor

@dd-octo-sts dd-octo-sts bot commented Aug 31, 2025

This PR updates the Gradle dependencies. ⚠️ Don't forget to squash commits before merging. ⚠️

  • Update PR title if a code change is needed to support one of those new dependencies

@dd-octo-sts dd-octo-sts bot requested review from a team as code owners August 31, 2025 04:16
@dd-octo-sts dd-octo-sts bot requested review from evanchooly, nikita-tkachenko-datadog, robertpi, sezen-datadog and PerfectSlayer and removed request for a team August 31, 2025 04:16
@pr-commenter
Copy link

pr-commenter bot commented Aug 31, 2025

Debugger benchmarks

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
ci_job_date 1756659658 1756660004
end_time 2025-08-31T17:02:19 2025-08-31T17:08:05
git_branch master ci/update-gradle-dependencies-20250831
git_commit_sha d434107 b183fad
start_time 2025-08-31T17:00:59 2025-08-31T17:06:45
See matching parameters
Baseline Candidate
ci_job_id 1106701356 1106701356
ci_pipeline_id 75175103 75175103
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
git_commit_date 1756658926 1756658926

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 9 metrics, 6 unstable metrics.

See unchanged results
scenario Δ mean agg_http_req_duration_min Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p75 Δ mean agg_http_req_duration_p99 Δ mean throughput
scenario:noprobe unstable
[-31.507µs; +15.854µs] or [-11.053%; +5.562%]
unstable
[-43.990µs; +24.380µs] or [-13.488%; +7.475%]
unstable
[-58.025µs; +32.225µs] or [-16.948%; +9.412%]
unstable
[-21.526µs; +210.509µs] or [-2.204%; +21.552%]
same
scenario:basic same same same unstable
[+41.273µs; +247.577µs] or [+5.528%; +33.160%]
unstable
[-208.316op/s; +208.316op/s] or [-7.916%; +7.916%]
scenario:loop same same same same same
Request duration reports for reports
gantt
    title reports - request duration [CI 0.99] : candidate=None, baseline=None
    dateFormat X
    axisFormat %s
section baseline
noprobe (326.151 µs) : 287, 366
.   : milestone, 326,
basic (277.256 µs) : 271, 283
.   : milestone, 277,
loop (8.972 ms) : 8968, 8977
.   : milestone, 8972,
section candidate
noprobe (316.346 µs) : 293, 340
.   : milestone, 316,
basic (278.049 µs) : 273, 283
.   : milestone, 278,
loop (8.969 ms) : 8964, 8973
.   : milestone, 8969,
Loading
  • baseline results
Scenario Request median duration [CI 0.99]
noprobe 326.151 µs [286.636 µs, 365.667 µs]
basic 277.256 µs [271.451 µs, 283.06 µs]
loop 8.972 ms [8.968 ms, 8.977 ms]
  • candidate results
Scenario Request median duration [CI 0.99]
noprobe 316.346 µs [292.754 µs, 339.939 µs]
basic 278.049 µs [272.797 µs, 283.302 µs]
loop 8.969 ms [8.964 ms, 8.973 ms]

@pr-commenter
Copy link

pr-commenter bot commented Aug 31, 2025

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ci/update-gradle-dependencies-20250831
git_commit_date 1756482235 1756658926
git_commit_sha d434107 b183fad
release_version 1.53.0-SNAPSHOT~d43410737f 1.53.0-SNAPSHOT~b183fad3db
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1756660742 1756660742
ci_job_id 1106701349 1106701349
ci_pipeline_id 75175103 75175103
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-qcuzc6my 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-qcuzc6my 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 50 metrics, 9 unstable metrics.

Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.53.0-SNAPSHOT~b183fad3db, baseline=1.53.0-SNAPSHOT~d43410737f

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.046 s) : 0, 1045542
Total [baseline] (8.613 s) : 0, 8612752
Agent [candidate] (1.047 s) : 0, 1046661
Total [candidate] (8.594 s) : 0, 8594310
section iast
Agent [baseline] (1.184 s) : 0, 1184008
Total [baseline] (9.33 s) : 0, 9330355
Agent [candidate] (1.179 s) : 0, 1178748
Total [candidate] (9.323 s) : 0, 9323419
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.046 s -
Agent iast 1.184 s 138.466 ms (13.2%)
Total tracing 8.613 s -
Total iast 9.33 s 717.603 ms (8.3%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.047 s -
Agent iast 1.179 s 132.086 ms (12.6%)
Total tracing 8.594 s -
Total iast 9.323 s 729.109 ms (8.5%)
gantt
    title insecure-bank - break down per module: candidate=1.53.0-SNAPSHOT~b183fad3db, baseline=1.53.0-SNAPSHOT~d43410737f

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.444 ms) : 0, 1444
crashtracking [candidate] (1.443 ms) : 0, 1443
BytebuddyAgent [baseline] (732.69 ms) : 0, 732690
BytebuddyAgent [candidate] (731.029 ms) : 0, 731029
GlobalTracer [baseline] (242.131 ms) : 0, 242131
GlobalTracer [candidate] (242.168 ms) : 0, 242168
AppSec [baseline] (30.034 ms) : 0, 30034
AppSec [candidate] (30.024 ms) : 0, 30024
Debugger [baseline] (6.064 ms) : 0, 6064
Debugger [candidate] (6.047 ms) : 0, 6047
Remote Config [baseline] (669.349 µs) : 0, 669
Remote Config [candidate] (665.6 µs) : 0, 666
Telemetry [baseline] (11.601 ms) : 0, 11601
Telemetry [candidate] (14.341 ms) : 0, 14341
section iast
crashtracking [baseline] (1.459 ms) : 0, 1459
crashtracking [candidate] (1.454 ms) : 0, 1454
BytebuddyAgent [baseline] (855.49 ms) : 0, 855490
BytebuddyAgent [candidate] (850.96 ms) : 0, 850960
GlobalTracer [baseline] (233.258 ms) : 0, 233258
GlobalTracer [candidate] (232.782 ms) : 0, 232782
IAST [baseline] (31.239 ms) : 0, 31239
IAST [candidate] (30.361 ms) : 0, 30361
AppSec [baseline] (26.902 ms) : 0, 26902
AppSec [candidate] (27.44 ms) : 0, 27440
Debugger [baseline] (5.778 ms) : 0, 5778
Debugger [candidate] (5.78 ms) : 0, 5780
Remote Config [baseline] (592.27 µs) : 0, 592
Remote Config [candidate] (595.893 µs) : 0, 596
Telemetry [baseline] (8.337 ms) : 0, 8337
Telemetry [candidate] (8.434 ms) : 0, 8434
Loading
Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.53.0-SNAPSHOT~b183fad3db, baseline=1.53.0-SNAPSHOT~d43410737f

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.044 s) : 0, 1044038
Total [baseline] (10.648 s) : 0, 10647699
Agent [candidate] (1.046 s) : 0, 1045819
Total [candidate] (10.743 s) : 0, 10742611
section appsec
Agent [baseline] (1.223 s) : 0, 1222901
Total [baseline] (10.775 s) : 0, 10774928
Agent [candidate] (1.221 s) : 0, 1221379
Total [candidate] (10.78 s) : 0, 10779751
section iast
Agent [baseline] (1.185 s) : 0, 1184910
Total [baseline] (10.938 s) : 0, 10937814
Agent [candidate] (1.177 s) : 0, 1177195
Total [candidate] (10.883 s) : 0, 10883294
section profiling
Agent [baseline] (1.2 s) : 0, 1199549
Total [baseline] (10.868 s) : 0, 10867962
Agent [candidate] (1.199 s) : 0, 1198950
Total [candidate] (10.865 s) : 0, 10865417
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.044 s -
Agent appsec 1.223 s 178.863 ms (17.1%)
Agent iast 1.185 s 140.872 ms (13.5%)
Agent profiling 1.2 s 155.512 ms (14.9%)
Total tracing 10.648 s -
Total appsec 10.775 s 127.23 ms (1.2%)
Total iast 10.938 s 290.115 ms (2.7%)
Total profiling 10.868 s 220.263 ms (2.1%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.046 s -
Agent appsec 1.221 s 175.56 ms (16.8%)
Agent iast 1.177 s 131.376 ms (12.6%)
Agent profiling 1.199 s 153.131 ms (14.6%)
Total tracing 10.743 s -
Total appsec 10.78 s 37.139 ms (0.3%)
Total iast 10.883 s 140.682 ms (1.3%)
Total profiling 10.865 s 122.806 ms (1.1%)
gantt
    title petclinic - break down per module: candidate=1.53.0-SNAPSHOT~b183fad3db, baseline=1.53.0-SNAPSHOT~d43410737f

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.434 ms) : 0, 1434
crashtracking [candidate] (1.444 ms) : 0, 1444
BytebuddyAgent [baseline] (731.126 ms) : 0, 731126
BytebuddyAgent [candidate] (733.599 ms) : 0, 733599
GlobalTracer [baseline] (241.572 ms) : 0, 241572
GlobalTracer [candidate] (242.689 ms) : 0, 242689
AppSec [baseline] (30.129 ms) : 0, 30129
AppSec [candidate] (30.182 ms) : 0, 30182
Debugger [baseline] (6.036 ms) : 0, 6036
Debugger [candidate] (6.056 ms) : 0, 6056
Remote Config [baseline] (669.161 µs) : 0, 669
Remote Config [candidate] (666.154 µs) : 0, 666
Telemetry [baseline] (12.079 ms) : 0, 12079
Telemetry [candidate] (10.074 ms) : 0, 10074
section appsec
crashtracking [baseline] (1.448 ms) : 0, 1448
crashtracking [candidate] (1.464 ms) : 0, 1464
BytebuddyAgent [baseline] (755.431 ms) : 0, 755431
BytebuddyAgent [candidate] (755.11 ms) : 0, 755110
GlobalTracer [baseline] (235.183 ms) : 0, 235183
GlobalTracer [candidate] (234.921 ms) : 0, 234921
IAST [baseline] (23.608 ms) : 0, 23608
IAST [candidate] (23.434 ms) : 0, 23434
AppSec [baseline] (167.304 ms) : 0, 167304
AppSec [candidate] (169.055 ms) : 0, 169055
Debugger [baseline] (6.545 ms) : 0, 6545
Debugger [candidate] (5.734 ms) : 0, 5734
Remote Config [baseline] (646.108 µs) : 0, 646
Remote Config [candidate] (617.514 µs) : 0, 618
Telemetry [baseline] (11.525 ms) : 0, 11525
Telemetry [candidate] (9.956 ms) : 0, 9956
section iast
crashtracking [baseline] (1.457 ms) : 0, 1457
crashtracking [candidate] (1.442 ms) : 0, 1442
BytebuddyAgent [baseline] (855.578 ms) : 0, 855578
BytebuddyAgent [candidate] (849.33 ms) : 0, 849330
GlobalTracer [baseline] (233.681 ms) : 0, 233681
GlobalTracer [candidate] (232.922 ms) : 0, 232922
IAST [baseline] (30.56 ms) : 0, 30560
IAST [candidate] (30.297 ms) : 0, 30297
AppSec [baseline] (27.796 ms) : 0, 27796
AppSec [candidate] (27.437 ms) : 0, 27437
Debugger [baseline] (5.765 ms) : 0, 5765
Debugger [candidate] (5.772 ms) : 0, 5772
Remote Config [baseline] (610.471 µs) : 0, 610
Remote Config [candidate] (584.414 µs) : 0, 584
Telemetry [baseline] (8.305 ms) : 0, 8305
Telemetry [candidate] (8.384 ms) : 0, 8384
section profiling
crashtracking [baseline] (1.44 ms) : 0, 1440
crashtracking [candidate] (1.441 ms) : 0, 1441
BytebuddyAgent [baseline] (762.871 ms) : 0, 762871
BytebuddyAgent [candidate] (763.228 ms) : 0, 763228
GlobalTracer [baseline] (222.851 ms) : 0, 222851
GlobalTracer [candidate] (223.133 ms) : 0, 223133
AppSec [baseline] (30.195 ms) : 0, 30195
AppSec [candidate] (30.186 ms) : 0, 30186
Debugger [baseline] (6.289 ms) : 0, 6289
Debugger [candidate] (6.3 ms) : 0, 6300
Remote Config [baseline] (723.395 µs) : 0, 723
Remote Config [candidate] (691.732 µs) : 0, 692
Telemetry [baseline] (16.361 ms) : 0, 16361
Telemetry [candidate] (16.025 ms) : 0, 16025
ProfilingAgent [baseline] (108.295 ms) : 0, 108295
ProfilingAgent [candidate] (107.628 ms) : 0, 107628
Profiling [baseline] (108.965 ms) : 0, 108965
Profiling [candidate] (108.304 ms) : 0, 108304
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ci/update-gradle-dependencies-20250831
git_commit_date 1756482235 1756658926
git_commit_sha d434107 b183fad
release_version 1.53.0-SNAPSHOT~d43410737f 1.53.0-SNAPSHOT~b183fad3db
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1756660426 1756660426
ci_job_id 1106701350 1106701350
ci_pipeline_id 75175103 75175103
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-brcfn6n5 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-brcfn6n5 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 2 performance improvements and 0 performance regressions! Performance is the same for 10 metrics, 12 unstable metrics.

scenario Δ mean http_req_duration Δ mean throughput candidate mean http_req_duration candidate mean throughput baseline mean http_req_duration baseline mean throughput
scenario:load:insecure-bank:no_agent:high_load better
[-224.826µs; -106.350µs] or [-5.003%; -2.367%]
unstable
[-64.980op/s; +146.730op/s] or [-6.360%; +14.362%]
4.328ms 1062.562op/s 4.494ms 1021.688op/s
scenario:load:petclinic:tracing:high_load better
[-2.867ms; -2.061ms] or [-6.254%; -4.495%]
unstable
[-2.573op/s; +11.489op/s] or [-2.489%; +11.115%]
43.384ms 107.825op/s 45.849ms 103.367op/s
Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.53.0-SNAPSHOT~b183fad3db, baseline=1.53.0-SNAPSHOT~d43410737f
    dateFormat X
    axisFormat %s
section baseline
no_agent (4.494 ms) : 4434, 4553
.   : milestone, 4494,
iast (9.437 ms) : 9276, 9598
.   : milestone, 9437,
iast_FULL (13.968 ms) : 13688, 14248
.   : milestone, 13968,
iast_GLOBAL (10.422 ms) : 10238, 10607
.   : milestone, 10422,
profiling (8.535 ms) : 8405, 8665
.   : milestone, 8535,
tracing (7.566 ms) : 7460, 7673
.   : milestone, 7566,
section candidate
no_agent (4.328 ms) : 4278, 4378
.   : milestone, 4328,
iast (9.348 ms) : 9190, 9505
.   : milestone, 9348,
iast_FULL (14.138 ms) : 13861, 14416
.   : milestone, 14138,
iast_GLOBAL (10.6 ms) : 10413, 10786
.   : milestone, 10600,
profiling (8.776 ms) : 8638, 8914
.   : milestone, 8776,
tracing (7.506 ms) : 7401, 7610
.   : milestone, 7506,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.494 ms [4.434 ms, 4.553 ms] -
iast 9.437 ms [9.276 ms, 9.598 ms] 4.943 ms (110.0%)
iast_FULL 13.968 ms [13.688 ms, 14.248 ms] 9.474 ms (210.8%)
iast_GLOBAL 10.422 ms [10.238 ms, 10.607 ms] 5.928 ms (131.9%)
profiling 8.535 ms [8.405 ms, 8.665 ms] 4.042 ms (89.9%)
tracing 7.566 ms [7.46 ms, 7.673 ms] 3.073 ms (68.4%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.328 ms [4.278 ms, 4.378 ms] -
iast 9.348 ms [9.19 ms, 9.505 ms] 5.02 ms (116.0%)
iast_FULL 14.138 ms [13.861 ms, 14.416 ms] 9.81 ms (226.7%)
iast_GLOBAL 10.6 ms [10.413 ms, 10.786 ms] 6.272 ms (144.9%)
profiling 8.776 ms [8.638 ms, 8.914 ms] 4.448 ms (102.8%)
tracing 7.506 ms [7.401 ms, 7.61 ms] 3.178 ms (73.4%)
Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.53.0-SNAPSHOT~b183fad3db, baseline=1.53.0-SNAPSHOT~d43410737f
    dateFormat X
    axisFormat %s
section baseline
no_agent (37.354 ms) : 37059, 37649
.   : milestone, 37354,
appsec (49.247 ms) : 48816, 49679
.   : milestone, 49247,
code_origins (44.815 ms) : 44426, 45204
.   : milestone, 44815,
iast (46.444 ms) : 46034, 46854
.   : milestone, 46444,
profiling (50.918 ms) : 50427, 51409
.   : milestone, 50918,
tracing (45.849 ms) : 45456, 46241
.   : milestone, 45849,
section candidate
no_agent (37.485 ms) : 37173, 37797
.   : milestone, 37485,
appsec (48.64 ms) : 48225, 49055
.   : milestone, 48640,
code_origins (45.94 ms) : 45545, 46335
.   : milestone, 45940,
iast (45.829 ms) : 45437, 46222
.   : milestone, 45829,
profiling (49.843 ms) : 49362, 50324
.   : milestone, 49843,
tracing (43.384 ms) : 43028, 43741
.   : milestone, 43384,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 37.354 ms [37.059 ms, 37.649 ms] -
appsec 49.247 ms [48.816 ms, 49.679 ms] 11.894 ms (31.8%)
code_origins 44.815 ms [44.426 ms, 45.204 ms] 7.461 ms (20.0%)
iast 46.444 ms [46.034 ms, 46.854 ms] 9.09 ms (24.3%)
profiling 50.918 ms [50.427 ms, 51.409 ms] 13.564 ms (36.3%)
tracing 45.849 ms [45.456 ms, 46.241 ms] 8.495 ms (22.7%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 37.485 ms [37.173 ms, 37.797 ms] -
appsec 48.64 ms [48.225 ms, 49.055 ms] 11.155 ms (29.8%)
code_origins 45.94 ms [45.545 ms, 46.335 ms] 8.455 ms (22.6%)
iast 45.829 ms [45.437 ms, 46.222 ms] 8.344 ms (22.3%)
profiling 49.843 ms [49.362 ms, 50.324 ms] 12.358 ms (33.0%)
tracing 43.384 ms [43.028 ms, 43.741 ms] 5.899 ms (15.7%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ci/update-gradle-dependencies-20250831
git_commit_date 1756482235 1756658926
git_commit_sha d434107 b183fad
release_version 1.53.0-SNAPSHOT~d43410737f 1.53.0-SNAPSHOT~b183fad3db
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1756660898 1756660898
ci_job_id 1106701351 1106701351
ci_pipeline_id 75175103 75175103
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-2-70a77az5 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-2-70a77az5 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 10 metrics, 2 unstable metrics.

Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.53.0-SNAPSHOT~b183fad3db, baseline=1.53.0-SNAPSHOT~d43410737f
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.868 s) : 14868000, 14868000
.   : milestone, 14868000,
appsec (14.877 s) : 14877000, 14877000
.   : milestone, 14877000,
iast (18.429 s) : 18429000, 18429000
.   : milestone, 18429000,
iast_GLOBAL (17.998 s) : 17998000, 17998000
.   : milestone, 17998000,
profiling (15.933 s) : 15933000, 15933000
.   : milestone, 15933000,
tracing (14.924 s) : 14924000, 14924000
.   : milestone, 14924000,
section candidate
no_agent (15.472 s) : 15472000, 15472000
.   : milestone, 15472000,
appsec (14.992 s) : 14992000, 14992000
.   : milestone, 14992000,
iast (18.442 s) : 18442000, 18442000
.   : milestone, 18442000,
iast_GLOBAL (18.048 s) : 18048000, 18048000
.   : milestone, 18048000,
profiling (15.283 s) : 15283000, 15283000
.   : milestone, 15283000,
tracing (14.999 s) : 14999000, 14999000
.   : milestone, 14999000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.868 s [14.868 s, 14.868 s] -
appsec 14.877 s [14.877 s, 14.877 s] 9.0 ms (0.1%)
iast 18.429 s [18.429 s, 18.429 s] 3.561 s (24.0%)
iast_GLOBAL 17.998 s [17.998 s, 17.998 s] 3.13 s (21.1%)
profiling 15.933 s [15.933 s, 15.933 s] 1.065 s (7.2%)
tracing 14.924 s [14.924 s, 14.924 s] 56.0 ms (0.4%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.472 s [15.472 s, 15.472 s] -
appsec 14.992 s [14.992 s, 14.992 s] -480.0 ms (-3.1%)
iast 18.442 s [18.442 s, 18.442 s] 2.97 s (19.2%)
iast_GLOBAL 18.048 s [18.048 s, 18.048 s] 2.576 s (16.6%)
profiling 15.283 s [15.283 s, 15.283 s] -189.0 ms (-1.2%)
tracing 14.999 s [14.999 s, 14.999 s] -473.0 ms (-3.1%)
Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.53.0-SNAPSHOT~b183fad3db, baseline=1.53.0-SNAPSHOT~d43410737f
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.474 ms) : 1462, 1485
.   : milestone, 1474,
appsec (2.464 ms) : 2411, 2517
.   : milestone, 2464,
iast (2.205 ms) : 2142, 2267
.   : milestone, 2205,
iast_GLOBAL (2.243 ms) : 2181, 2306
.   : milestone, 2243,
profiling (2.491 ms) : 2321, 2662
.   : milestone, 2491,
tracing (2.024 ms) : 1975, 2073
.   : milestone, 2024,
section candidate
no_agent (1.476 ms) : 1465, 1488
.   : milestone, 1476,
appsec (3.65 ms) : 3428, 3872
.   : milestone, 3650,
iast (2.191 ms) : 2129, 2253
.   : milestone, 2191,
iast_GLOBAL (2.24 ms) : 2178, 2303
.   : milestone, 2240,
profiling (2.035 ms) : 1985, 2085
.   : milestone, 2035,
tracing (2.013 ms) : 1965, 2062
.   : milestone, 2013,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.474 ms [1.462 ms, 1.485 ms] -
appsec 2.464 ms [2.411 ms, 2.517 ms] 990.929 µs (67.2%)
iast 2.205 ms [2.142 ms, 2.267 ms] 731.418 µs (49.6%)
iast_GLOBAL 2.243 ms [2.181 ms, 2.306 ms] 769.732 µs (52.2%)
profiling 2.491 ms [2.321 ms, 2.662 ms] 1.018 ms (69.1%)
tracing 2.024 ms [1.975 ms, 2.073 ms] 550.843 µs (37.4%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.476 ms [1.465 ms, 1.488 ms] -
appsec 3.65 ms [3.428 ms, 3.872 ms] 2.174 ms (147.3%)
iast 2.191 ms [2.129 ms, 2.253 ms] 715.298 µs (48.5%)
iast_GLOBAL 2.24 ms [2.178 ms, 2.303 ms] 764.046 µs (51.8%)
profiling 2.035 ms [1.985 ms, 2.085 ms] 558.993 µs (37.9%)
tracing 2.013 ms [1.965 ms, 2.062 ms] 537.055 µs (36.4%)

@pr-commenter
Copy link

pr-commenter bot commented Aug 31, 2025

Kafka / consumer-benchmark

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ci/update-gradle-dependencies-20250831
git_commit_date 1756482235 1756658926
git_commit_sha d434107 b183fad
See matching parameters
Baseline Candidate
ci_job_date 1756660016 1756660016
ci_job_id 1106701355 1106701355
ci_pipeline_id 75175103 75175103
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
jdkVersion 11.0.25 11.0.25
jmhVersion 1.36 1.36
jvm /usr/lib/jvm/java-11-openjdk-amd64/bin/java /usr/lib/jvm/java-11-openjdk-amd64/bin/java
jvmArgs -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/consumer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/consumer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant
vmName OpenJDK 64-Bit Server VM OpenJDK 64-Bit Server VM
vmVersion 11.0.25+9-post-Ubuntu-1ubuntu122.04 11.0.25+9-post-Ubuntu-1ubuntu122.04

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 3 metrics, 0 unstable metrics.

See unchanged results
scenario Δ mean throughput
scenario:not-instrumented/KafkaConsumerBenchmark.benchConsume same
scenario:only-tracing-dsm-disabled-benchmarks/KafkaConsumerBenchmark.benchConsume same
scenario:only-tracing-dsm-enabled-benchmarks/KafkaConsumerBenchmark.benchConsume same

@datadog-datadog-prod-us1
Copy link
Contributor

datadog-datadog-prod-us1 bot commented Aug 31, 2025

🎯 Code Coverage
Patch Coverage: 100.00%
Total Coverage: 57.63% (-0.01%)

View detailed report

This comment will be updated automatically if new data arrives.
🔗 Commit SHA: b183fad | Docs | Was this helpful? Give us feedback!

@pr-commenter
Copy link

pr-commenter bot commented Aug 31, 2025

Kafka / producer-benchmark

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ci/update-gradle-dependencies-20250831
git_commit_date 1756482235 1756658926
git_commit_sha d434107 b183fad
See matching parameters
Baseline Candidate
ci_job_date 1756660152 1756660152
ci_job_id 1106701354 1106701354
ci_pipeline_id 75175103 75175103
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
jdkVersion 11.0.25 11.0.25
jmhVersion 1.36 1.36
jvm /usr/lib/jvm/java-11-openjdk-amd64/bin/java /usr/lib/jvm/java-11-openjdk-amd64/bin/java
jvmArgs -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/producer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/producer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant
vmName OpenJDK 64-Bit Server VM OpenJDK 64-Bit Server VM
vmVersion 11.0.25+9-post-Ubuntu-1ubuntu122.04 11.0.25+9-post-Ubuntu-1ubuntu122.04

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 3 metrics, 0 unstable metrics.

See unchanged results
scenario Δ mean throughput
scenario:not-instrumented/KafkaProduceBenchmark.benchProduce same
scenario:only-tracing-dsm-disabled-benchmarks/KafkaProduceBenchmark.benchProduce same
scenario:only-tracing-dsm-enabled-benchmarks/KafkaProduceBenchmark.benchProduce same

@AlexeyKuznetsov-DD AlexeyKuznetsov-DD merged commit 890497c into master Sep 2, 2025
512 checks passed
@AlexeyKuznetsov-DD AlexeyKuznetsov-DD deleted the ci/update-gradle-dependencies-20250831 branch September 2, 2025 13:49
@github-actions github-actions bot added this to the 1.53.0 milestone Sep 2, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
tag: dependencies Dependencies related changes tag: no release notes Changes to exclude from release notes
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants