Skip to content

add flaky annotation #9990

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
zarirhamza merged 1 commit into from
Nov 17, 2025
Merged

add flaky annotation #9990

zarirhamza merged 1 commit into from
Nov 17, 2025

Conversation

@zarirhamza
Copy link
Contributor

@zarirhamza zarirhamza commented Nov 17, 2025

What Does This Do

Annotates flaky test introduced in #9422

The issue is that the current test when AppSec is enabled, the conext is lost in a race condition causing flakiness

Motivation

Mark for future fixing

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@zarirhamza zarirhamza requested a review from a team as a code owner November 17, 2025 20:59
@zarirhamza zarirhamza requested a review from amarziali November 17, 2025 20:59
@github-actions
Copy link
Contributor

github-actions bot commented Nov 17, 2025 •
edited
Loading

Hi! 👋 Thanks for your pull request! 🎉

To help us review it, please make sure to:

  • Add at least one type, and one component or instrumentation label to the pull request

If you need help, please check our contributing guidelines.

@zarirhamza zarirhamza enabled auto-merge (squash) November 17, 2025 20:59
@zarirhamza zarirhamza added tag: flaky test Flaky tests comp: context propagation Trace context propagation labels Nov 17, 2025
@pr-commenter
Copy link

pr-commenter bot commented Nov 17, 2025

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master zarir/flaky-test-ig-session
git_commit_date 1763407991 1763412987
git_commit_sha b6d4e4f 7834eee
release_version 1.56.0-SNAPSHOT~b6d4e4fc4a 1.56.0-SNAPSHOT~7834eeeaee
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1763414796 1763414796
ci_job_id 1240408466 1240408466
ci_pipeline_id 82810657 82810657
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-wv94hr1a 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-wv94hr1a 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 60 metrics, 5 unstable metrics.

Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.56.0-SNAPSHOT~7834eeeaee, baseline=1.56.0-SNAPSHOT~b6d4e4fc4a

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.095 s) : 0, 1094637
Total [baseline] (10.695 s) : 0, 10695097
Agent [candidate] (1.095 s) : 0, 1095447
Total [candidate] (10.826 s) : 0, 10825695
section appsec
Agent [baseline] (1.285 s) : 0, 1284502
Total [baseline] (10.992 s) : 0, 10991773
Agent [candidate] (1.274 s) : 0, 1273958
Total [candidate] (10.995 s) : 0, 10995388
section iast
Agent [baseline] (1.251 s) : 0, 1250807
Total [baseline] (11.197 s) : 0, 11197168
Agent [candidate] (1.231 s) : 0, 1230749
Total [candidate] (11.191 s) : 0, 11191417
section profiling
Agent [baseline] (1.227 s) : 0, 1226662
Total [baseline] (11.023 s) : 0, 11022509
Agent [candidate] (1.232 s) : 0, 1232232
Total [candidate] (11.053 s) : 0, 11052560
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.095 s -
Agent appsec 1.285 s 189.865 ms (17.3%)
Agent iast 1.251 s 156.169 ms (14.3%)
Agent profiling 1.227 s 132.025 ms (12.1%)
Total tracing 10.695 s -
Total appsec 10.992 s 296.676 ms (2.8%)
Total iast 11.197 s 502.071 ms (4.7%)
Total profiling 11.023 s 327.412 ms (3.1%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.095 s -
Agent appsec 1.274 s 178.512 ms (16.3%)
Agent iast 1.231 s 135.302 ms (12.4%)
Agent profiling 1.232 s 136.785 ms (12.5%)
Total tracing 10.826 s -
Total appsec 10.995 s 169.693 ms (1.6%)
Total iast 11.191 s 365.722 ms (3.4%)
Total profiling 11.053 s 226.865 ms (2.1%) 
gantt
    title petclinic - break down per module: candidate=1.56.0-SNAPSHOT~7834eeeaee, baseline=1.56.0-SNAPSHOT~b6d4e4fc4a

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.439 ms) : 0, 1439
crashtracking [candidate] (1.435 ms) : 0, 1435
BytebuddyAgent [baseline] (703.032 ms) : 0, 703032
BytebuddyAgent [candidate] (703.768 ms) : 0, 703768
GlobalTracer [baseline] (247.256 ms) : 0, 247256
GlobalTracer [candidate] (247.321 ms) : 0, 247321
AppSec [baseline] (31.989 ms) : 0, 31989
AppSec [candidate] (32.028 ms) : 0, 32028
Debugger [baseline] (63.941 ms) : 0, 63941
Debugger [candidate] (63.823 ms) : 0, 63823
Remote Config [baseline] (618.86 µs) : 0, 619
Remote Config [candidate] (620.299 µs) : 0, 620
Telemetry [baseline] (8.033 ms) : 0, 8033
Telemetry [candidate] (8.047 ms) : 0, 8047
Flare Poller [baseline] (3.577 ms) : 0, 3577
Flare Poller [candidate] (3.652 ms) : 0, 3652
section appsec
crashtracking [baseline] (1.46 ms) : 0, 1460
crashtracking [candidate] (1.448 ms) : 0, 1448
BytebuddyAgent [baseline] (733.372 ms) : 0, 733372
BytebuddyAgent [candidate] (727.467 ms) : 0, 727467
GlobalTracer [baseline] (240.567 ms) : 0, 240567
GlobalTracer [candidate] (238.954 ms) : 0, 238954
IAST [baseline] (25.09 ms) : 0, 25090
IAST [candidate] (24.638 ms) : 0, 24638
AppSec [baseline] (174.631 ms) : 0, 174631
AppSec [candidate] (173.419 ms) : 0, 173419
Debugger [baseline] (61.466 ms) : 0, 61466
Debugger [candidate] (60.32 ms) : 0, 60320
Remote Config [baseline] (687.522 µs) : 0, 688
Remote Config [candidate] (711.081 µs) : 0, 711
Telemetry [baseline] (8.277 ms) : 0, 8277
Telemetry [candidate] (8.278 ms) : 0, 8278
Flare Poller [baseline] (3.823 ms) : 0, 3823
Flare Poller [candidate] (3.885 ms) : 0, 3885
section iast
crashtracking [baseline] (1.469 ms) : 0, 1469
crashtracking [candidate] (1.446 ms) : 0, 1446
BytebuddyAgent [baseline] (839.403 ms) : 0, 839403
BytebuddyAgent [candidate] (824.762 ms) : 0, 824762
GlobalTracer [baseline] (238.916 ms) : 0, 238916
GlobalTracer [candidate] (236.506 ms) : 0, 236506
IAST [baseline] (28.848 ms) : 0, 28848
IAST [candidate] (28.114 ms) : 0, 28114
AppSec [baseline] (33.31 ms) : 0, 33310
AppSec [candidate] (32.706 ms) : 0, 32706
Debugger [baseline] (61.804 ms) : 0, 61804
Debugger [candidate] (60.796 ms) : 0, 60796
Remote Config [baseline] (556.055 µs) : 0, 556
Remote Config [candidate] (541.932 µs) : 0, 542
Telemetry [baseline] (7.796 ms) : 0, 7796
Telemetry [candidate] (7.627 ms) : 0, 7627
Flare Poller [baseline] (3.566 ms) : 0, 3566
Flare Poller [candidate] (3.496 ms) : 0, 3496
section profiling
crashtracking [baseline] (1.427 ms) : 0, 1427
crashtracking [candidate] (1.458 ms) : 0, 1458
BytebuddyAgent [baseline] (729.82 ms) : 0, 729820
BytebuddyAgent [candidate] (734.551 ms) : 0, 734551
GlobalTracer [baseline] (221.658 ms) : 0, 221658
GlobalTracer [candidate] (221.819 ms) : 0, 221819
AppSec [baseline] (32.075 ms) : 0, 32075
AppSec [candidate] (32.074 ms) : 0, 32074
Debugger [baseline] (62.888 ms) : 0, 62888
Debugger [candidate] (62.777 ms) : 0, 62777
Remote Config [baseline] (651.61 µs) : 0, 652
Remote Config [candidate] (657.908 µs) : 0, 658
Telemetry [baseline] (7.981 ms) : 0, 7981
Telemetry [candidate] (7.873 ms) : 0, 7873
Flare Poller [baseline] (3.779 ms) : 0, 3779
Flare Poller [candidate] (3.734 ms) : 0, 3734
ProfilingAgent [baseline] (96.778 ms) : 0, 96778
ProfilingAgent [candidate] (96.855 ms) : 0, 96855
Profiling [baseline] (97.365 ms) : 0, 97365
Profiling [candidate] (97.436 ms) : 0, 97436
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.56.0-SNAPSHOT~7834eeeaee, baseline=1.56.0-SNAPSHOT~b6d4e4fc4a

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.099 s) : 0, 1098880
Total [baseline] (8.836 s) : 0, 8835691
Agent [candidate] (1.103 s) : 0, 1103328
Total [candidate] (8.862 s) : 0, 8861610
section iast
Agent [baseline] (1.234 s) : 0, 1233828
Total [baseline] (9.516 s) : 0, 9516049
Agent [candidate] (1.234 s) : 0, 1234313
Total [candidate] (9.503 s) : 0, 9503370
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.099 s -
Agent iast 1.234 s 134.948 ms (12.3%)
Total tracing 8.836 s -
Total iast 9.516 s 680.358 ms (7.7%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.103 s -
Agent iast 1.234 s 130.985 ms (11.9%)
Total tracing 8.862 s -
Total iast 9.503 s 641.76 ms (7.2%) 
gantt
    title insecure-bank - break down per module: candidate=1.56.0-SNAPSHOT~7834eeeaee, baseline=1.56.0-SNAPSHOT~b6d4e4fc4a

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.446 ms) : 0, 1446
crashtracking [candidate] (1.463 ms) : 0, 1463
BytebuddyAgent [baseline] (706.127 ms) : 0, 706127
BytebuddyAgent [candidate] (708.84 ms) : 0, 708840
GlobalTracer [baseline] (248.228 ms) : 0, 248228
GlobalTracer [candidate] (249.542 ms) : 0, 249542
AppSec [baseline] (32.308 ms) : 0, 32308
AppSec [candidate] (32.533 ms) : 0, 32533
Debugger [baseline] (63.535 ms) : 0, 63535
Debugger [candidate] (63.587 ms) : 0, 63587
Remote Config [baseline] (632.072 µs) : 0, 632
Remote Config [candidate] (626.399 µs) : 0, 626
Telemetry [baseline] (8.165 ms) : 0, 8165
Telemetry [candidate] (8.253 ms) : 0, 8253
Flare Poller [baseline] (3.66 ms) : 0, 3660
Flare Poller [candidate] (3.677 ms) : 0, 3677
section iast
crashtracking [baseline] (1.451 ms) : 0, 1451
crashtracking [candidate] (1.459 ms) : 0, 1459
BytebuddyAgent [baseline] (827.533 ms) : 0, 827533
BytebuddyAgent [candidate] (827.276 ms) : 0, 827276
GlobalTracer [baseline] (237.036 ms) : 0, 237036
GlobalTracer [candidate] (237.235 ms) : 0, 237235
IAST [baseline] (26.617 ms) : 0, 26617
IAST [candidate] (26.54 ms) : 0, 26540
AppSec [baseline] (34.558 ms) : 0, 34558
AppSec [candidate] (34.719 ms) : 0, 34719
Debugger [baseline] (60.153 ms) : 0, 60153
Debugger [candidate] (60.483 ms) : 0, 60483
Remote Config [baseline] (540.012 µs) : 0, 540
Remote Config [candidate] (538.925 µs) : 0, 539
Telemetry [baseline] (7.713 ms) : 0, 7713
Telemetry [candidate] (7.645 ms) : 0, 7645
Flare Poller [baseline] (3.421 ms) : 0, 3421
Flare Poller [candidate] (3.495 ms) : 0, 3495
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master zarir/flaky-test-ig-session
git_commit_date 1763407991 1763412987
git_commit_sha b6d4e4f 7834eee
release_version 1.56.0-SNAPSHOT~b6d4e4fc4a 1.56.0-SNAPSHOT~7834eeeaee
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1763415285 1763415285
ci_job_id 1240408468 1240408468
ci_pipeline_id 82810657 82810657
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-2-9cye2m3h 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-2-9cye2m3h 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 2 performance improvements and 2 performance regressions! Performance is the same for 14 metrics, 18 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:iast:high_load worse
[+93.937µs; +193.894µs] or [+3.771%; +7.784%]		 worse
[+200.205µs; +559.091µs] or [+2.770%; +7.735%]		 unstable
[-225.479op/s; +68.354op/s] or [-15.758%; +4.777%]		 2.635ms 7.607ms 1352.344op/s 2.491ms 7.228ms 1430.906op/s
scenario:load:petclinic:profiling:high_load better
[-2.022ms; -0.998ms] or [-10.415%; -5.139%]		 better
[-3.116ms; -1.172ms] or [-9.949%; -3.741%]		 unstable
[-6.104op/s; +40.104op/s] or [-2.567%; +16.868%]		 17.907ms 29.180ms 254.750op/s 19.417ms 31.324ms 237.750op/s
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.56.0-SNAPSHOT~7834eeeaee, baseline=1.56.0-SNAPSHOT~b6d4e4fc4a
    dateFormat X
    axisFormat %s
section baseline
no_agent (19.086 ms) : 18890, 19282
.   : milestone, 19086,
appsec (18.778 ms) : 18591, 18964
.   : milestone, 18778,
code_origins (17.928 ms) : 17750, 18105
.   : milestone, 17928,
iast (17.951 ms) : 17771, 18131
.   : milestone, 17951,
profiling (19.634 ms) : 19430, 19838
.   : milestone, 19634,
tracing (17.597 ms) : 17421, 17773
.   : milestone, 17597,
section candidate
no_agent (18.431 ms) : 18237, 18625
.   : milestone, 18431,
appsec (18.974 ms) : 18781, 19167
.   : milestone, 18974,
code_origins (17.769 ms) : 17594, 17944
.   : milestone, 17769,
iast (18.015 ms) : 17836, 18195
.   : milestone, 18015,
profiling (18.323 ms) : 18140, 18505
.   : milestone, 18323,
tracing (17.577 ms) : 17403, 17750
.   : milestone, 17577,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 19.086 ms [18.89 ms, 19.282 ms] -
appsec 18.778 ms [18.591 ms, 18.964 ms] -307.853 µs (-1.6%)
code_origins 17.928 ms [17.75 ms, 18.105 ms] -1.158 ms (-6.1%)
iast 17.951 ms [17.771 ms, 18.131 ms] -1.135 ms (-5.9%)
profiling 19.634 ms [19.43 ms, 19.838 ms] 548.704 µs (2.9%)
tracing 17.597 ms [17.421 ms, 17.773 ms] -1.489 ms (-7.8%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.431 ms [18.237 ms, 18.625 ms] -
appsec 18.974 ms [18.781 ms, 19.167 ms] 542.91 µs (2.9%)
code_origins 17.769 ms [17.594 ms, 17.944 ms] -662.097 µs (-3.6%)
iast 18.015 ms [17.836 ms, 18.195 ms] -415.502 µs (-2.3%)
profiling 18.323 ms [18.14 ms, 18.505 ms] -108.295 µs (-0.6%)
tracing 17.577 ms [17.403 ms, 17.75 ms] -854.309 µs (-4.6%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.56.0-SNAPSHOT~7834eeeaee, baseline=1.56.0-SNAPSHOT~b6d4e4fc4a
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.176 ms) : 1164, 1187
.   : milestone, 1176,
iast (3.197 ms) : 3150, 3244
.   : milestone, 3197,
iast_FULL (5.678 ms) : 5620, 5736
.   : milestone, 5678,
iast_GLOBAL (3.693 ms) : 3630, 3756
.   : milestone, 3693,
profiling (2.183 ms) : 2161, 2206
.   : milestone, 2183,
tracing (1.802 ms) : 1787, 1817
.   : milestone, 1802,
section candidate
no_agent (1.191 ms) : 1180, 1203
.   : milestone, 1191,
iast (3.388 ms) : 3332, 3444
.   : milestone, 3388,
iast_FULL (5.902 ms) : 5843, 5962
.   : milestone, 5902,
iast_GLOBAL (3.739 ms) : 3675, 3803
.   : milestone, 3739,
profiling (1.985 ms) : 1967, 2003
.   : milestone, 1985,
tracing (1.819 ms) : 1804, 1835
.   : milestone, 1819,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.176 ms [1.164 ms, 1.187 ms] -
iast 3.197 ms [3.15 ms, 3.244 ms] 2.021 ms (171.9%)
iast_FULL 5.678 ms [5.62 ms, 5.736 ms] 4.503 ms (383.0%)
iast_GLOBAL 3.693 ms [3.63 ms, 3.756 ms] 2.517 ms (214.1%)
profiling 2.183 ms [2.161 ms, 2.206 ms] 1.008 ms (85.7%)
tracing 1.802 ms [1.787 ms, 1.817 ms] 626.544 µs (53.3%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.191 ms [1.18 ms, 1.203 ms] -
iast 3.388 ms [3.332 ms, 3.444 ms] 2.197 ms (184.5%)
iast_FULL 5.902 ms [5.843 ms, 5.962 ms] 4.711 ms (395.5%)
iast_GLOBAL 3.739 ms [3.675 ms, 3.803 ms] 2.548 ms (213.9%)
profiling 1.985 ms [1.967 ms, 2.003 ms] 793.747 µs (66.6%)
tracing 1.819 ms [1.804 ms, 1.835 ms] 628.247 µs (52.7%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master zarir/flaky-test-ig-session
git_commit_date 1763407991 1763412987
git_commit_sha b6d4e4f 7834eee
release_version 1.56.0-SNAPSHOT~b6d4e4fc4a 1.56.0-SNAPSHOT~7834eeeaee
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1763415019 1763415019
ci_job_id 1240408469 1240408469
ci_pipeline_id 82810657 82810657
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-3-3yw907a6 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-3-3yw907a6 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.56.0-SNAPSHOT~7834eeeaee, baseline=1.56.0-SNAPSHOT~b6d4e4fc4a
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.477 ms) : 1465, 1488
.   : milestone, 1477,
appsec (3.719 ms) : 3495, 3943
.   : milestone, 3719,
iast (2.207 ms) : 2144, 2271
.   : milestone, 2207,
iast_GLOBAL (2.253 ms) : 2189, 2318
.   : milestone, 2253,
profiling (2.076 ms) : 2023, 2129
.   : milestone, 2076,
tracing (2.021 ms) : 1971, 2071
.   : milestone, 2021,
section candidate
no_agent (1.48 ms) : 1469, 1492
.   : milestone, 1480,
appsec (3.702 ms) : 3483, 3922
.   : milestone, 3702,
iast (2.194 ms) : 2131, 2258
.   : milestone, 2194,
iast_GLOBAL (2.254 ms) : 2190, 2318
.   : milestone, 2254,
profiling (2.065 ms) : 2013, 2117
.   : milestone, 2065,
tracing (2.028 ms) : 1978, 2077
.   : milestone, 2028,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.477 ms [1.465 ms, 1.488 ms] -
appsec 3.719 ms [3.495 ms, 3.943 ms] 2.242 ms (151.8%)
iast 2.207 ms [2.144 ms, 2.271 ms] 730.497 µs (49.5%)
iast_GLOBAL 2.253 ms [2.189 ms, 2.318 ms] 776.527 µs (52.6%)
profiling 2.076 ms [2.023 ms, 2.129 ms] 598.751 µs (40.5%)
tracing 2.021 ms [1.971 ms, 2.071 ms] 544.123 µs (36.8%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.48 ms [1.469 ms, 1.492 ms] -
appsec 3.702 ms [3.483 ms, 3.922 ms] 2.222 ms (150.1%)
iast 2.194 ms [2.131 ms, 2.258 ms] 713.96 µs (48.2%)
iast_GLOBAL 2.254 ms [2.19 ms, 2.318 ms] 773.76 µs (52.3%)
profiling 2.065 ms [2.013 ms, 2.117 ms] 584.774 µs (39.5%)
tracing 2.028 ms [1.978 ms, 2.077 ms] 547.36 µs (37.0%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.56.0-SNAPSHOT~7834eeeaee, baseline=1.56.0-SNAPSHOT~b6d4e4fc4a
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.937 s) : 14937000, 14937000
.   : milestone, 14937000,
appsec (14.632 s) : 14632000, 14632000
.   : milestone, 14632000,
iast (18.441 s) : 18441000, 18441000
.   : milestone, 18441000,
iast_GLOBAL (17.964 s) : 17964000, 17964000
.   : milestone, 17964000,
profiling (15.064 s) : 15064000, 15064000
.   : milestone, 15064000,
tracing (14.612 s) : 14612000, 14612000
.   : milestone, 14612000,
section candidate
no_agent (15.538 s) : 15538000, 15538000
.   : milestone, 15538000,
appsec (14.905 s) : 14905000, 14905000
.   : milestone, 14905000,
iast (18.312 s) : 18312000, 18312000
.   : milestone, 18312000,
iast_GLOBAL (18.024 s) : 18024000, 18024000
.   : milestone, 18024000,
profiling (14.896 s) : 14896000, 14896000
.   : milestone, 14896000,
tracing (14.686 s) : 14686000, 14686000
.   : milestone, 14686000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.937 s [14.937 s, 14.937 s] -
appsec 14.632 s [14.632 s, 14.632 s] -305.0 ms (-2.0%)
iast 18.441 s [18.441 s, 18.441 s] 3.504 s (23.5%)
iast_GLOBAL 17.964 s [17.964 s, 17.964 s] 3.027 s (20.3%)
profiling 15.064 s [15.064 s, 15.064 s] 127.0 ms (0.9%)
tracing 14.612 s [14.612 s, 14.612 s] -325.0 ms (-2.2%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.538 s [15.538 s, 15.538 s] -
appsec 14.905 s [14.905 s, 14.905 s] -633.0 ms (-4.1%)
iast 18.312 s [18.312 s, 18.312 s] 2.774 s (17.9%)
iast_GLOBAL 18.024 s [18.024 s, 18.024 s] 2.486 s (16.0%)
profiling 14.896 s [14.896 s, 14.896 s] -642.0 ms (-4.1%)
tracing 14.686 s [14.686 s, 14.686 s] -852.0 ms (-5.5%)

@zarirhamza zarirhamza merged commit 0ba9af0 into master Nov 17, 2025
706 of 712 checks passed
@zarirhamza zarirhamza deleted the zarir/flaky-test-ig-session branch November 17, 2025 21:54
@github-actions github-actions bot added this to the 1.56.0 milestone Nov 17, 2025
@PerfectSlayer PerfectSlayer added tag: no release notes Changes to exclude from release notes tag: flaky test/disabled Disabled flaky tests and removed type: refactoring labels Nov 20, 2025
@AlexeyKuznetsov-DD AlexeyKuznetsov-DD mentioned this pull request Nov 21, 2025
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@AlexeyKuznetsov-DD AlexeyKuznetsov-DD AlexeyKuznetsov-DD approved these changes

@amarziali amarziali Awaiting requested review from amarziali amarziali is a code owner automatically assigned from DataDog/apm-java

Assignees

No one assigned

Labels

comp: context propagation Trace context propagation tag: flaky test/disabled Disabled flaky tests tag: flaky test Flaky tests tag: no release notes Changes to exclude from release notes

Projects

None yet

Milestone

1.56.0

Development

Successfully merging this pull request may close these issues.

4 participants

@zarirhamza @AlexeyKuznetsov-DD @PerfectSlayer