Don't be strict on opensearch tests #9129

amarziali · 2025-07-09T07:01:40Z

What Does This Do

Logs shows that the trace is discarded since spans are not received in the correct order. Removing strict trace writing as a workaround

Motivation

Additional Notes

Contributor Checklist

Format the title according the contribution guidelines
Assign the type: and (comp: or inst:) labels in addition to any usefull labels
Don't use close, fix or any linking keywords when referencing an issue.
Use solves instead, and assign the PR milestone to the issue
Update the CODEOWNERS file on source file addition, move, or deletion
Update the public documentation in case of new configuration flag or behavior

Jira ticket: [PROJ-IDENT]

github-actions · 2025-07-09T07:01:52Z

Hi! 👋 Thanks for your pull request! 🎉

To help us review it, please make sure to:

Add at least one type, and one component or instrumentation label to the pull request

If you need help, please check our contributing guidelines.

pr-commenter · 2025-07-09T07:35:31Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	andrea.marziali/opensearch
git_commit_date	1751991953	1752044444
git_commit_sha	`860a603`	`39ff883`
release_version	1.51.0-SNAPSHOT~860a603678	1.51.0-SNAPSHOT~39ff88364d

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1752046342	1752046342
ci_job_id	1019936103	1019936103
ci_pipeline_id	70007095	70007095
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-k8hl32xk 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-k8hl32xk 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 43 metrics, 10 unstable metrics.

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.51.0-SNAPSHOT~39ff88364d, baseline=1.51.0-SNAPSHOT~860a603678

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.004 s) : 0, 1004216
Total [baseline] (8.601 s) : 0, 8600871
Agent [candidate] (1.003 s) : 0, 1003304
Total [candidate] (8.59 s) : 0, 8590193
section iast
Agent [baseline] (1.135 s) : 0, 1135027
Total [baseline] (9.284 s) : 0, 9283772
Agent [candidate] (1.143 s) : 0, 1143161
Total [candidate] (9.313 s) : 0, 9312894

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.004 s	-
Agent	iast	1.135 s	130.811 ms (13.0%)
Total	tracing	8.601 s	-
Total	iast	9.284 s	682.901 ms (7.9%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.003 s	-
Agent	iast	1.143 s	139.857 ms (13.9%)
Total	tracing	8.59 s	-
Total	iast	9.313 s	722.701 ms (8.4%)

gantt
    title insecure-bank - break down per module: candidate=1.51.0-SNAPSHOT~39ff88364d, baseline=1.51.0-SNAPSHOT~860a603678

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (693.361 ms) : 0, 693361
BytebuddyAgent [candidate] (692.616 ms) : 0, 692616
GlobalTracer [baseline] (244.062 ms) : 0, 244062
GlobalTracer [candidate] (244.049 ms) : 0, 244049
AppSec [baseline] (30.746 ms) : 0, 30746
AppSec [candidate] (30.606 ms) : 0, 30606
Debugger [baseline] (6.149 ms) : 0, 6149
Debugger [candidate] (6.13 ms) : 0, 6130
Remote Config [baseline] (682.472 µs) : 0, 682
Remote Config [candidate] (694.705 µs) : 0, 695
Telemetry [baseline] (8.303 ms) : 0, 8303
Telemetry [candidate] (8.337 ms) : 0, 8337
section iast
BytebuddyAgent [baseline] (808.996 ms) : 0, 808996
BytebuddyAgent [candidate] (815.173 ms) : 0, 815173
GlobalTracer [baseline] (232.851 ms) : 0, 232851
GlobalTracer [candidate] (234.063 ms) : 0, 234063
AppSec [baseline] (27.198 ms) : 0, 27198
AppSec [candidate] (31.028 ms) : 0, 31028
Debugger [baseline] (6.771 ms) : 0, 6771
Debugger [candidate] (5.882 ms) : 0, 5882
Remote Config [baseline] (642.277 µs) : 0, 642
Remote Config [candidate] (587.478 µs) : 0, 587
Telemetry [baseline] (7.987 ms) : 0, 7987
Telemetry [candidate] (8.078 ms) : 0, 8078
IAST [baseline] (29.781 ms) : 0, 29781
IAST [candidate] (27.394 ms) : 0, 27394

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.51.0-SNAPSHOT~39ff88364d, baseline=1.51.0-SNAPSHOT~860a603678

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.005 s) : 0, 1005053
Total [baseline] (10.663 s) : 0, 10663017
Agent [candidate] (997.446 ms) : 0, 997446
Total [candidate] (10.698 s) : 0, 10697753
section appsec
Agent [baseline] (1.193 s) : 0, 1193186
Total [baseline] (10.936 s) : 0, 10935719
Agent [candidate] (1.176 s) : 0, 1175992
Total [candidate] (10.723 s) : 0, 10722573
section iast
Agent [baseline] (1.142 s) : 0, 1141973
Total [baseline] (10.845 s) : 0, 10844930
Agent [candidate] (1.141 s) : 0, 1141024
Total [candidate] (10.884 s) : 0, 10884398
section profiling
Agent [baseline] (1.251 s) : 0, 1251469
Total [baseline] (11.035 s) : 0, 11035134
Agent [candidate] (1.245 s) : 0, 1245048
Total [candidate] (11.072 s) : 0, 11072458

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.005 s	-
Agent	appsec	1.193 s	188.132 ms (18.7%)
Agent	iast	1.142 s	136.92 ms (13.6%)
Agent	profiling	1.251 s	246.415 ms (24.5%)
Total	tracing	10.663 s	-
Total	appsec	10.936 s	272.702 ms (2.6%)
Total	iast	10.845 s	181.913 ms (1.7%)
Total	profiling	11.035 s	372.117 ms (3.5%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	997.446 ms	-
Agent	appsec	1.176 s	178.546 ms (17.9%)
Agent	iast	1.141 s	143.578 ms (14.4%)
Agent	profiling	1.245 s	247.603 ms (24.8%)
Total	tracing	10.698 s	-
Total	appsec	10.723 s	24.82 ms (0.2%)
Total	iast	10.884 s	186.645 ms (1.7%)
Total	profiling	11.072 s	374.705 ms (3.5%)

gantt
    title petclinic - break down per module: candidate=1.51.0-SNAPSHOT~39ff88364d, baseline=1.51.0-SNAPSHOT~860a603678

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (693.749 ms) : 0, 693749
BytebuddyAgent [candidate] (688.788 ms) : 0, 688788
GlobalTracer [baseline] (244.449 ms) : 0, 244449
GlobalTracer [candidate] (242.533 ms) : 0, 242533
AppSec [baseline] (30.756 ms) : 0, 30756
AppSec [candidate] (30.249 ms) : 0, 30249
Debugger [baseline] (6.105 ms) : 0, 6105
Debugger [candidate] (6.093 ms) : 0, 6093
Remote Config [baseline] (682.671 µs) : 0, 683
Remote Config [candidate] (675.963 µs) : 0, 676
Telemetry [baseline] (8.328 ms) : 0, 8328
Telemetry [candidate] (8.243 ms) : 0, 8243
section appsec
BytebuddyAgent [baseline] (722.391 ms) : 0, 722391
BytebuddyAgent [candidate] (710.268 ms) : 0, 710268
GlobalTracer [baseline] (238.636 ms) : 0, 238636
GlobalTracer [candidate] (235.678 ms) : 0, 235678
AppSec [baseline] (172.325 ms) : 0, 172325
AppSec [candidate] (171.57 ms) : 0, 171570
Debugger [baseline] (5.899 ms) : 0, 5899
Debugger [candidate] (5.786 ms) : 0, 5786
Remote Config [baseline] (621.467 µs) : 0, 621
Remote Config [candidate] (604.439 µs) : 0, 604
Telemetry [baseline] (8.281 ms) : 0, 8281
Telemetry [candidate] (8.028 ms) : 0, 8028
IAST [baseline] (23.839 ms) : 0, 23839
IAST [candidate] (23.229 ms) : 0, 23229
section iast
BytebuddyAgent [baseline] (814.383 ms) : 0, 814383
BytebuddyAgent [candidate] (813.012 ms) : 0, 813012
GlobalTracer [baseline] (233.98 ms) : 0, 233980
GlobalTracer [candidate] (233.962 ms) : 0, 233962
AppSec [baseline] (27.624 ms) : 0, 27624
AppSec [candidate] (32.712 ms) : 0, 32712
Debugger [baseline] (7.575 ms) : 0, 7575
Debugger [candidate] (6.782 ms) : 0, 6782
Remote Config [baseline] (582.017 µs) : 0, 582
Remote Config [candidate] (593.673 µs) : 0, 594
Telemetry [baseline] (8.001 ms) : 0, 8001
Telemetry [candidate] (8.079 ms) : 0, 8079
IAST [baseline] (28.9 ms) : 0, 28900
IAST [candidate] (24.861 ms) : 0, 24861
section profiling
BytebuddyAgent [baseline] (680.376 ms) : 0, 680376
BytebuddyAgent [candidate] (677.851 ms) : 0, 677851
GlobalTracer [baseline] (363.8 ms) : 0, 363800
GlobalTracer [candidate] (361.966 ms) : 0, 361966
AppSec [baseline] (32.521 ms) : 0, 32521
AppSec [candidate] (31.656 ms) : 0, 31656
Debugger [baseline] (12.344 ms) : 0, 12344
Debugger [candidate] (12.057 ms) : 0, 12057
Remote Config [baseline] (667.228 µs) : 0, 667
Remote Config [candidate] (1.407 ms) : 0, 1407
Telemetry [baseline] (8.014 ms) : 0, 8014
Telemetry [candidate] (8.035 ms) : 0, 8035
ProfilingAgent [baseline] (104.832 ms) : 0, 104832
ProfilingAgent [candidate] (103.483 ms) : 0, 103483
Profiling [baseline] (104.858 ms) : 0, 104858
Profiling [candidate] (103.508 ms) : 0, 103508

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	andrea.marziali/opensearch
git_commit_date	1751991953	1752044444
git_commit_sha	`860a603`	`39ff883`
release_version	1.51.0-SNAPSHOT~860a603678	1.51.0-SNAPSHOT~39ff88364d

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1752046017	1752046017
ci_job_id	1019936104	1019936104
ci_pipeline_id	70007095	70007095
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-1-cn7n93r6 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-1-cn7n93r6 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 2 performance improvements and 3 performance regressions! Performance is the same for 7 metrics, 12 unstable metrics.

scenario	Δ mean http_req_duration	Δ mean throughput	candidate mean http_req_duration	candidate mean throughput	baseline mean http_req_duration	baseline mean throughput
scenario:load:insecure-bank:iast:high_load	worse [+218.493µs; +547.348µs] or [+2.377%; +5.955%]	unstable [-77.411op/s; +37.474op/s] or [-15.328%; +7.420%]	9.575ms	485.062op/s	9.192ms	505.031op/s
scenario:load:insecure-bank:no_agent:high_load	worse [+150.830µs; +260.038µs] or [+3.499%; +6.032%]	unstable [-160.686op/s; +66.186op/s] or [-15.101%; +6.220%]	4.517ms	1016.812op/s	4.311ms	1064.062op/s
scenario:load:petclinic:appsec:high_load	better [-1.907ms; -0.998ms] or [-3.922%; -2.053%]	unstable [-4.306op/s; +10.231op/s] or [-4.476%; +10.634%]	47.180ms	99.175op/s	48.633ms	96.213op/s
scenario:load:petclinic:code_origins:high_load	better [-2.754ms; -1.917ms] or [-5.817%; -4.047%]	unstable [-1.984op/s; +12.184op/s] or [-2.008%; +12.329%]	45.017ms	103.925op/s	47.353ms	98.825op/s
scenario:load:petclinic:profiling:high_load	worse [+2.969ms; +3.976ms] or [+6.176%; +8.269%]	unstable [-11.833op/s; +1.158op/s] or [-12.155%; +1.189%]	51.555ms	92.013op/s	48.082ms	97.350op/s

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.51.0-SNAPSHOT~39ff88364d, baseline=1.51.0-SNAPSHOT~860a603678
    dateFormat X
    axisFormat %s
section baseline
no_agent (36.89 ms) : 36588, 37191
.   : milestone, 36890,
appsec (48.633 ms) : 48205, 49061
.   : milestone, 48633,
code_origins (47.353 ms) : 46951, 47754
.   : milestone, 47353,
iast (43.883 ms) : 43496, 44271
.   : milestone, 43883,
profiling (48.082 ms) : 47627, 48538
.   : milestone, 48082,
tracing (43.104 ms) : 42744, 43465
.   : milestone, 43104,
section candidate
no_agent (35.982 ms) : 35692, 36271
.   : milestone, 35982,
appsec (47.18 ms) : 46763, 47597
.   : milestone, 47180,
code_origins (45.017 ms) : 44640, 45394
.   : milestone, 45017,
iast (44.325 ms) : 43931, 44718
.   : milestone, 44325,
profiling (51.555 ms) : 51075, 52035
.   : milestone, 51555,
tracing (43.773 ms) : 43399, 44147
.   : milestone, 43773,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	36.89 ms [36.588 ms, 37.191 ms]	-
appsec	48.633 ms [48.205 ms, 49.061 ms]	11.743 ms (31.8%)
code_origins	47.353 ms [46.951 ms, 47.754 ms]	10.463 ms (28.4%)
iast	43.883 ms [43.496 ms, 44.271 ms]	6.994 ms (19.0%)
profiling	48.082 ms [47.627 ms, 48.538 ms]	11.193 ms (30.3%)
tracing	43.104 ms [42.744 ms, 43.465 ms]	6.214 ms (16.8%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	35.982 ms [35.692 ms, 36.271 ms]	-
appsec	47.18 ms [46.763 ms, 47.597 ms]	11.199 ms (31.1%)
code_origins	45.017 ms [44.64 ms, 45.394 ms]	9.036 ms (25.1%)
iast	44.325 ms [43.931 ms, 44.718 ms]	8.343 ms (23.2%)
profiling	51.555 ms [51.075 ms, 52.035 ms]	15.573 ms (43.3%)
tracing	43.773 ms [43.399 ms, 44.147 ms]	7.791 ms (21.7%)

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.51.0-SNAPSHOT~39ff88364d, baseline=1.51.0-SNAPSHOT~860a603678
    dateFormat X
    axisFormat %s
section baseline
no_agent (4.311 ms) : 4262, 4360
.   : milestone, 4311,
iast (9.192 ms) : 9045, 9339
.   : milestone, 9192,
iast_FULL (14.192 ms) : 13910, 14475
.   : milestone, 14192,
iast_GLOBAL (10.355 ms) : 10173, 10537
.   : milestone, 10355,
profiling (8.582 ms) : 8438, 8726
.   : milestone, 8582,
tracing (7.526 ms) : 7412, 7640
.   : milestone, 7526,
section candidate
no_agent (4.517 ms) : 4464, 4569
.   : milestone, 4517,
iast (9.575 ms) : 9416, 9734
.   : milestone, 9575,
iast_FULL (13.799 ms) : 13531, 14067
.   : milestone, 13799,
iast_GLOBAL (10.646 ms) : 10454, 10837
.   : milestone, 10646,
profiling (8.814 ms) : 8672, 8957
.   : milestone, 8814,
tracing (7.703 ms) : 7588, 7819
.   : milestone, 7703,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	4.311 ms [4.262 ms, 4.36 ms]	-
iast	9.192 ms [9.045 ms, 9.339 ms]	4.881 ms (113.2%)
iast_FULL	14.192 ms [13.91 ms, 14.475 ms]	9.881 ms (229.2%)
iast_GLOBAL	10.355 ms [10.173 ms, 10.537 ms]	6.044 ms (140.2%)
profiling	8.582 ms [8.438 ms, 8.726 ms]	4.271 ms (99.1%)
tracing	7.526 ms [7.412 ms, 7.64 ms]	3.215 ms (74.6%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	4.517 ms [4.464 ms, 4.569 ms]	-
iast	9.575 ms [9.416 ms, 9.734 ms]	5.058 ms (112.0%)
iast_FULL	13.799 ms [13.531 ms, 14.067 ms]	9.283 ms (205.5%)
iast_GLOBAL	10.646 ms [10.454 ms, 10.837 ms]	6.129 ms (135.7%)
profiling	8.814 ms [8.672 ms, 8.957 ms]	4.298 ms (95.2%)
tracing	7.703 ms [7.588 ms, 7.819 ms]	3.187 ms (70.6%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	andrea.marziali/opensearch
git_commit_date	1751991953	1752044444
git_commit_sha	`860a603`	`39ff883`
release_version	1.51.0-SNAPSHOT~860a603678	1.51.0-SNAPSHOT~39ff88364d

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1752046436	1752046436
ci_job_id	1019936105	1019936105
ci_pipeline_id	70007095	70007095
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-eto3gqkl 6.8.0-1030-aws #32~22.04.1-Ubuntu SMP Thu Jun 5 08:38:24 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-eto3gqkl 6.8.0-1030-aws #32~22.04.1-Ubuntu SMP Thu Jun 5 08:38:24 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.51.0-SNAPSHOT~39ff88364d, baseline=1.51.0-SNAPSHOT~860a603678
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.481 ms) : 1469, 1493
.   : milestone, 1481,
appsec (2.409 ms) : 2359, 2459
.   : milestone, 2409,
iast (2.192 ms) : 2130, 2254
.   : milestone, 2192,
iast_GLOBAL (2.238 ms) : 2175, 2301
.   : milestone, 2238,
profiling (2.038 ms) : 1988, 2087
.   : milestone, 2038,
tracing (2.009 ms) : 1960, 2057
.   : milestone, 2009,
section candidate
no_agent (1.476 ms) : 1464, 1487
.   : milestone, 1476,
appsec (2.418 ms) : 2368, 2468
.   : milestone, 2418,
iast (2.192 ms) : 2129, 2254
.   : milestone, 2192,
iast_GLOBAL (2.237 ms) : 2174, 2300
.   : milestone, 2237,
profiling (2.061 ms) : 2009, 2113
.   : milestone, 2061,
tracing (2.016 ms) : 1967, 2064
.   : milestone, 2016,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.481 ms [1.469 ms, 1.493 ms]	-
appsec	2.409 ms [2.359 ms, 2.459 ms]	928.099 µs (62.7%)
iast	2.192 ms [2.13 ms, 2.254 ms]	711.128 µs (48.0%)
iast_GLOBAL	2.238 ms [2.175 ms, 2.301 ms]	756.742 µs (51.1%)
profiling	2.038 ms [1.988 ms, 2.087 ms]	556.553 µs (37.6%)
tracing	2.009 ms [1.96 ms, 2.057 ms]	527.637 µs (35.6%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.476 ms [1.464 ms, 1.487 ms]	-
appsec	2.418 ms [2.368 ms, 2.468 ms]	942.352 µs (63.9%)
iast	2.192 ms [2.129 ms, 2.254 ms]	715.951 µs (48.5%)
iast_GLOBAL	2.237 ms [2.174 ms, 2.3 ms]	761.19 µs (51.6%)
profiling	2.061 ms [2.009 ms, 2.113 ms]	585.078 µs (39.6%)
tracing	2.016 ms [1.967 ms, 2.064 ms]	539.801 µs (36.6%)

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.51.0-SNAPSHOT~39ff88364d, baseline=1.51.0-SNAPSHOT~860a603678
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.544 s) : 15544000, 15544000
.   : milestone, 15544000,
appsec (14.669 s) : 14669000, 14669000
.   : milestone, 14669000,
iast (18.309 s) : 18309000, 18309000
.   : milestone, 18309000,
iast_GLOBAL (18.053 s) : 18053000, 18053000
.   : milestone, 18053000,
profiling (14.928 s) : 14928000, 14928000
.   : milestone, 14928000,
tracing (14.911 s) : 14911000, 14911000
.   : milestone, 14911000,
section candidate
no_agent (14.99 s) : 14990000, 14990000
.   : milestone, 14990000,
appsec (14.737 s) : 14737000, 14737000
.   : milestone, 14737000,
iast (18.605 s) : 18605000, 18605000
.   : milestone, 18605000,
iast_GLOBAL (17.717 s) : 17717000, 17717000
.   : milestone, 17717000,
profiling (15.065 s) : 15065000, 15065000
.   : milestone, 15065000,
tracing (14.656 s) : 14656000, 14656000
.   : milestone, 14656000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.544 s [15.544 s, 15.544 s]	-
appsec	14.669 s [14.669 s, 14.669 s]	-875.0 ms (-5.6%)
iast	18.309 s [18.309 s, 18.309 s]	2.765 s (17.8%)
iast_GLOBAL	18.053 s [18.053 s, 18.053 s]	2.509 s (16.1%)
profiling	14.928 s [14.928 s, 14.928 s]	-616.0 ms (-4.0%)
tracing	14.911 s [14.911 s, 14.911 s]	-633.0 ms (-4.1%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	14.99 s [14.99 s, 14.99 s]	-
appsec	14.737 s [14.737 s, 14.737 s]	-253.0 ms (-1.7%)
iast	18.605 s [18.605 s, 18.605 s]	3.615 s (24.1%)
iast_GLOBAL	17.717 s [17.717 s, 17.717 s]	2.727 s (18.2%)
profiling	15.065 s [15.065 s, 15.065 s]	75.0 ms (0.5%)
tracing	14.656 s [14.656 s, 14.656 s]	-334.0 ms (-2.2%)

PerfectSlayer

Unblocking the CI. Need fix from @DataDog/apm-idm-java

Don't be strict on opensearch tests

39ff883

amarziali requested a review from a team as a code owner July 9, 2025 07:01

amarziali added comp: testing Testing tag: no release notes Changes to exclude from release notes tag: flaky test Flaky tests labels Jul 9, 2025

amarziali enabled auto-merge (squash) July 9, 2025 07:02

PerfectSlayer approved these changes Jul 9, 2025

View reviewed changes

amarziali merged commit 16eee52 into master Jul 9, 2025
510 of 512 checks passed

amarziali deleted the andrea.marziali/opensearch branch July 9, 2025 08:00

github-actions bot added this to the 1.51.0 milestone Jul 9, 2025

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Don't be strict on opensearch tests #9129

Don't be strict on opensearch tests #9129

Uh oh!

amarziali commented Jul 9, 2025

Uh oh!

github-actions bot commented Jul 9, 2025

Uh oh!

pr-commenter bot commented Jul 9, 2025

Uh oh!

PerfectSlayer left a comment

Uh oh!

Uh oh!

Uh oh!

Don't be strict on opensearch tests #9129

Don't be strict on opensearch tests #9129

Uh oh!

Conversation

amarziali commented Jul 9, 2025

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Uh oh!

github-actions bot commented Jul 9, 2025

Uh oh!

pr-commenter bot commented Jul 9, 2025

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

Uh oh!

PerfectSlayer left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!