Update system-tests to 63dc98fd3bbf07dfe9aa35f14aeee38024312eb4 #8660

mobuchowski · 2025-04-02T08:13:08Z

What Does This Do

Points to updated system tests to make #8541 pass.

Motivation

Additional Notes

Contributor Checklist

Format the title according the contribution guidelines
Assign the type: and (comp: or inst:) labels in addition to any usefull labels
Don't use close, fix or any linking keywords when referencing an issue.
Use solves instead, and assign the PR milestone to the issue
Update the public documentation in case of new configuration flag or behavior

Jira ticket: [PROJ-IDENT]

github-actions · 2025-04-02T08:13:22Z

Hi! 👋 Thanks for your pull request! 🎉

To help us review it, please make sure to:

Add at least one type, and one component or instrumentation label to the pull request

If you need help, please check our contributing guidelines.

pr-commenter · 2025-04-02T09:02:31Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	mobuchowski/update-system-tests
git_commit_date	1743592817	1743597109
git_commit_sha	`32046a3`	`35a9c7a`
release_version	1.48.0-SNAPSHOT~32046a39ed	1.48.0-SNAPSHOT~35a9c7a0f0

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1743600316	1743600316
ci_job_id	876906122	876906122
ci_pipeline_id	60791274	60791274
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-m1cw8fbu-project-304-concurrent-2-snjn49pl 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-m1cw8fbu-project-304-concurrent-2-snjn49pl 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None
variant	iast	iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 69 metrics, 2 unstable metrics.

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.48.0-SNAPSHOT~35a9c7a0f0, baseline=1.48.0-SNAPSHOT~32046a39ed

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.053 s) : 0, 1053213
Total [baseline] (10.507 s) : 0, 10507357
Agent [candidate] (1.051 s) : 0, 1050650
Total [candidate] (10.494 s) : 0, 10493634
section appsec
Agent [baseline] (1.192 s) : 0, 1192121
Total [baseline] (10.796 s) : 0, 10795829
Agent [candidate] (1.201 s) : 0, 1200862
Total [candidate] (10.816 s) : 0, 10815512
section iast
Agent [baseline] (1.181 s) : 0, 1181227
Total [baseline] (11.062 s) : 0, 11062147
Agent [candidate] (1.187 s) : 0, 1187119
Total [candidate] (11.077 s) : 0, 11077028
section profiling
Agent [baseline] (1.278 s) : 0, 1277551
Total [baseline] (10.925 s) : 0, 10924871
Agent [candidate] (1.276 s) : 0, 1275858
Total [candidate] (10.86 s) : 0, 10860150

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.053 s	-
Agent	appsec	1.192 s	138.908 ms (13.2%)
Agent	iast	1.181 s	128.013 ms (12.2%)
Agent	profiling	1.278 s	224.338 ms (21.3%)
Total	tracing	10.507 s	-
Total	appsec	10.796 s	288.472 ms (2.7%)
Total	iast	11.062 s	554.791 ms (5.3%)
Total	profiling	10.925 s	417.515 ms (4.0%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.051 s	-
Agent	appsec	1.201 s	150.212 ms (14.3%)
Agent	iast	1.187 s	136.469 ms (13.0%)
Agent	profiling	1.276 s	225.208 ms (21.4%)
Total	tracing	10.494 s	-
Total	appsec	10.816 s	321.878 ms (3.1%)
Total	iast	11.077 s	583.394 ms (5.6%)
Total	profiling	10.86 s	366.516 ms (3.5%)

gantt
    title petclinic - break down per module: candidate=1.48.0-SNAPSHOT~35a9c7a0f0, baseline=1.48.0-SNAPSHOT~32046a39ed

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (717.745 ms) : 0, 717745
BytebuddyAgent [candidate] (717.99 ms) : 0, 717990
GlobalTracer [baseline] (239.116 ms) : 0, 239116
GlobalTracer [candidate] (239.303 ms) : 0, 239303
AppSec [baseline] (54.356 ms) : 0, 54356
AppSec [candidate] (54.182 ms) : 0, 54182
Debugger [baseline] (4.401 ms) : 0, 4401
Debugger [candidate] (4.422 ms) : 0, 4422
Remote Config [baseline] (689.48 µs) : 0, 689
Remote Config [candidate] (683.023 µs) : 0, 683
Telemetry [baseline] (16.497 ms) : 0, 16497
Telemetry [candidate] (13.436 ms) : 0, 13436
section appsec
BytebuddyAgent [baseline] (736.596 ms) : 0, 736596
BytebuddyAgent [candidate] (742.346 ms) : 0, 742346
GlobalTracer [baseline] (235.449 ms) : 0, 235449
GlobalTracer [candidate] (237.156 ms) : 0, 237156
IAST [baseline] (21.547 ms) : 0, 21547
IAST [candidate] (21.834 ms) : 0, 21834
AppSec [baseline] (175.736 ms) : 0, 175736
AppSec [candidate] (176.646 ms) : 0, 176646
Debugger [baseline] (4.275 ms) : 0, 4275
Debugger [candidate] (4.311 ms) : 0, 4311
Remote Config [baseline] (645.966 µs) : 0, 646
Remote Config [candidate] (657.348 µs) : 0, 657
Telemetry [baseline] (8.218 ms) : 0, 8218
Telemetry [candidate] (8.245 ms) : 0, 8245
section iast
BytebuddyAgent [baseline] (838.736 ms) : 0, 838736
BytebuddyAgent [candidate] (843.606 ms) : 0, 843606
GlobalTracer [baseline] (230.009 ms) : 0, 230009
GlobalTracer [candidate] (230.665 ms) : 0, 230665
IAST [baseline] (22.645 ms) : 0, 22645
IAST [candidate] (22.765 ms) : 0, 22765
AppSec [baseline] (55.891 ms) : 0, 55891
AppSec [candidate] (55.955 ms) : 0, 55955
Debugger [baseline] (4.145 ms) : 0, 4145
Debugger [candidate] (4.164 ms) : 0, 4164
Remote Config [baseline] (615.382 µs) : 0, 615
Remote Config [candidate] (618.616 µs) : 0, 619
Telemetry [baseline] (8.776 ms) : 0, 8776
Telemetry [candidate] (8.837 ms) : 0, 8837
section profiling
BytebuddyAgent [baseline] (710.468 ms) : 0, 710468
BytebuddyAgent [candidate] (710.395 ms) : 0, 710395
GlobalTracer [baseline] (350.286 ms) : 0, 350286
GlobalTracer [candidate] (349.472 ms) : 0, 349472
AppSec [baseline] (54.216 ms) : 0, 54216
AppSec [candidate] (53.447 ms) : 0, 53447
Debugger [baseline] (4.265 ms) : 0, 4265
Debugger [candidate] (4.251 ms) : 0, 4251
Remote Config [baseline] (703.738 µs) : 0, 704
Remote Config [candidate] (708.04 µs) : 0, 708
Telemetry [baseline] (9.058 ms) : 0, 9058
Telemetry [candidate] (8.955 ms) : 0, 8955
ProfilingAgent [baseline] (102.876 ms) : 0, 102876
ProfilingAgent [candidate] (102.837 ms) : 0, 102837
Profiling [baseline] (102.902 ms) : 0, 102902
Profiling [candidate] (102.861 ms) : 0, 102861

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.48.0-SNAPSHOT~35a9c7a0f0, baseline=1.48.0-SNAPSHOT~32046a39ed

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.058 s) : 0, 1057565
Total [baseline] (8.694 s) : 0, 8694429
Agent [candidate] (1.058 s) : 0, 1057915
Total [candidate] (8.67 s) : 0, 8669719
section iast
Agent [baseline] (1.18 s) : 0, 1180170
Total [baseline] (9.286 s) : 0, 9286136
Agent [candidate] (1.18 s) : 0, 1180482
Total [candidate] (9.263 s) : 0, 9262781
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.183 s) : 0, 1183471
Total [baseline] (9.291 s) : 0, 9291327
Agent [candidate] (1.19 s) : 0, 1189807
Total [candidate] (9.26 s) : 0, 9259999
section iast_TELEMETRY_OFF
Agent [baseline] (1.185 s) : 0, 1184634
Total [baseline] (9.283 s) : 0, 9282861
Agent [candidate] (1.183 s) : 0, 1183241
Total [candidate] (9.297 s) : 0, 9296599

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.058 s	-
Agent	iast	1.18 s	122.605 ms (11.6%)
Agent	iast_HARDCODED_SECRET_DISABLED	1.183 s	125.906 ms (11.9%)
Agent	iast_TELEMETRY_OFF	1.185 s	127.068 ms (12.0%)
Total	tracing	8.694 s	-
Total	iast	9.286 s	591.706 ms (6.8%)
Total	iast_HARDCODED_SECRET_DISABLED	9.291 s	596.898 ms (6.9%)
Total	iast_TELEMETRY_OFF	9.283 s	588.431 ms (6.8%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.058 s	-
Agent	iast	1.18 s	122.567 ms (11.6%)
Agent	iast_HARDCODED_SECRET_DISABLED	1.19 s	131.892 ms (12.5%)
Agent	iast_TELEMETRY_OFF	1.183 s	125.326 ms (11.8%)
Total	tracing	8.67 s	-
Total	iast	9.263 s	593.063 ms (6.8%)
Total	iast_HARDCODED_SECRET_DISABLED	9.26 s	590.28 ms (6.8%)
Total	iast_TELEMETRY_OFF	9.297 s	626.88 ms (7.2%)

gantt
    title insecure-bank - break down per module: candidate=1.48.0-SNAPSHOT~35a9c7a0f0, baseline=1.48.0-SNAPSHOT~32046a39ed

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (723.748 ms) : 0, 723748
BytebuddyAgent [candidate] (723.392 ms) : 0, 723392
GlobalTracer [baseline] (239.541 ms) : 0, 239541
GlobalTracer [candidate] (240.893 ms) : 0, 240893
AppSec [baseline] (55.586 ms) : 0, 55586
AppSec [candidate] (56.217 ms) : 0, 56217
Debugger [baseline] (4.451 ms) : 0, 4451
Debugger [candidate] (4.487 ms) : 0, 4487
Remote Config [baseline] (691.983 µs) : 0, 692
Remote Config [candidate] (701.816 µs) : 0, 702
Telemetry [baseline] (12.952 ms) : 0, 12952
Telemetry [candidate] (11.582 ms) : 0, 11582
section iast
BytebuddyAgent [baseline] (837.434 ms) : 0, 837434
BytebuddyAgent [candidate] (838.601 ms) : 0, 838601
GlobalTracer [baseline] (229.604 ms) : 0, 229604
GlobalTracer [candidate] (229.544 ms) : 0, 229544
IAST [baseline] (22.758 ms) : 0, 22758
IAST [candidate] (22.73 ms) : 0, 22730
AppSec [baseline] (56.337 ms) : 0, 56337
AppSec [candidate] (55.685 ms) : 0, 55685
Debugger [baseline] (4.18 ms) : 0, 4180
Debugger [candidate] (4.128 ms) : 0, 4128
Remote Config [baseline] (627.744 µs) : 0, 628
Remote Config [candidate] (615.968 µs) : 0, 616
Telemetry [baseline] (8.827 ms) : 0, 8827
Telemetry [candidate] (8.704 ms) : 0, 8704
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (840.079 ms) : 0, 840079
BytebuddyAgent [candidate] (844.857 ms) : 0, 844857
GlobalTracer [baseline] (230.443 ms) : 0, 230443
GlobalTracer [candidate] (230.908 ms) : 0, 230908
IAST [baseline] (22.976 ms) : 0, 22976
IAST [candidate] (23.054 ms) : 0, 23054
AppSec [baseline] (55.847 ms) : 0, 55847
AppSec [candidate] (56.558 ms) : 0, 56558
Debugger [baseline] (4.172 ms) : 0, 4172
Debugger [candidate] (4.221 ms) : 0, 4221
Remote Config [baseline] (617.586 µs) : 0, 618
Remote Config [candidate] (631.37 µs) : 0, 631
Telemetry [baseline] (8.806 ms) : 0, 8806
Telemetry [candidate] (8.921 ms) : 0, 8921
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (841.224 ms) : 0, 841224
BytebuddyAgent [candidate] (840.039 ms) : 0, 840039
GlobalTracer [baseline] (230.535 ms) : 0, 230535
GlobalTracer [candidate] (230.453 ms) : 0, 230453
IAST [baseline] (22.378 ms) : 0, 22378
IAST [candidate] (22.497 ms) : 0, 22497
AppSec [baseline] (56.289 ms) : 0, 56289
AppSec [candidate] (56.246 ms) : 0, 56246
Debugger [baseline] (4.228 ms) : 0, 4228
Debugger [candidate] (4.174 ms) : 0, 4174
Remote Config [baseline] (631.423 µs) : 0, 631
Remote Config [candidate] (616.427 µs) : 0, 616
Telemetry [baseline] (8.82 ms) : 0, 8820
Telemetry [candidate] (8.667 ms) : 0, 8667

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
end_time	2025-04-02T12:53:04	2025-04-02T13:00:50
git_branch	master	mobuchowski/update-system-tests
git_commit_date	1743592817	1743597109
git_commit_sha	`32046a3`	`35a9c7a`
release_version	1.48.0-SNAPSHOT~32046a39ed	1.48.0-SNAPSHOT~35a9c7a0f0
start_time	2025-04-02T12:52:50	2025-04-02T13:00:36

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1743599251	1743599251
ci_job_id	876906124	876906124
ci_pipeline_id	60791274	60791274
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-f8yuutny-project-304-concurrent-1-i6zxx8b0 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-f8yuutny-project-304-concurrent-1-i6zxx8b0 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant	iast	iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 14 metrics, 16 unstable metrics.

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.48.0-SNAPSHOT~35a9c7a0f0, baseline=1.48.0-SNAPSHOT~32046a39ed
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.379 ms) : 1359, 1398
.   : milestone, 1379,
appsec (1.733 ms) : 1709, 1757
.   : milestone, 1733,
appsec_no_iast (1.734 ms) : 1709, 1760
.   : milestone, 1734,
code_origins (1.703 ms) : 1676, 1731
.   : milestone, 1703,
iast (1.524 ms) : 1500, 1549
.   : milestone, 1524,
profiling (1.542 ms) : 1519, 1564
.   : milestone, 1542,
tracing (1.508 ms) : 1484, 1533
.   : milestone, 1508,
section candidate
no_agent (1.375 ms) : 1355, 1395
.   : milestone, 1375,
appsec (1.755 ms) : 1731, 1779
.   : milestone, 1755,
appsec_no_iast (1.76 ms) : 1737, 1783
.   : milestone, 1760,
code_origins (1.693 ms) : 1667, 1720
.   : milestone, 1693,
iast (1.553 ms) : 1529, 1577
.   : milestone, 1553,
profiling (1.564 ms) : 1540, 1588
.   : milestone, 1564,
tracing (1.497 ms) : 1473, 1521
.   : milestone, 1497,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.379 ms [1.359 ms, 1.398 ms]	-
appsec	1.733 ms [1.709 ms, 1.757 ms]	354.758 µs (25.7%)
appsec_no_iast	1.734 ms [1.709 ms, 1.76 ms]	355.834 µs (25.8%)
code_origins	1.703 ms [1.676 ms, 1.731 ms]	324.803 µs (23.6%)
iast	1.524 ms [1.5 ms, 1.549 ms]	145.735 µs (10.6%)
profiling	1.542 ms [1.519 ms, 1.564 ms]	162.966 µs (11.8%)
tracing	1.508 ms [1.484 ms, 1.533 ms]	129.865 µs (9.4%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.375 ms [1.355 ms, 1.395 ms]	-
appsec	1.755 ms [1.731 ms, 1.779 ms]	379.835 µs (27.6%)
appsec_no_iast	1.76 ms [1.737 ms, 1.783 ms]	384.566 µs (28.0%)
code_origins	1.693 ms [1.667 ms, 1.72 ms]	318.205 µs (23.1%)
iast	1.553 ms [1.529 ms, 1.577 ms]	177.793 µs (12.9%)
profiling	1.564 ms [1.54 ms, 1.588 ms]	188.886 µs (13.7%)
tracing	1.497 ms [1.473 ms, 1.521 ms]	121.375 µs (8.8%)

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.48.0-SNAPSHOT~35a9c7a0f0, baseline=1.48.0-SNAPSHOT~32046a39ed
    dateFormat X
    axisFormat %s
section baseline
no_agent (382.704 µs) : 362, 403
.   : milestone, 383,
iast (516.105 µs) : 494, 538
.   : milestone, 516,
iast_FULL (740.449 µs) : 718, 763
.   : milestone, 740,
iast_GLOBAL (565.735 µs) : 543, 588
.   : milestone, 566,
iast_HARDCODED_SECRET_DISABLED (520.79 µs) : 499, 543
.   : milestone, 521,
iast_INACTIVE (468.867 µs) : 448, 490
.   : milestone, 469,
iast_TELEMETRY_OFF (508.714 µs) : 487, 531
.   : milestone, 509,
tracing (469.892 µs) : 448, 491
.   : milestone, 470,
section candidate
no_agent (386.583 µs) : 367, 407
.   : milestone, 387,
iast (519.159 µs) : 497, 541
.   : milestone, 519,
iast_FULL (738.314 µs) : 716, 760
.   : milestone, 738,
iast_GLOBAL (564.337 µs) : 543, 586
.   : milestone, 564,
iast_HARDCODED_SECRET_DISABLED (520.108 µs) : 498, 542
.   : milestone, 520,
iast_INACTIVE (474.892 µs) : 453, 497
.   : milestone, 475,
iast_TELEMETRY_OFF (511.034 µs) : 489, 534
.   : milestone, 511,
tracing (462.351 µs) : 441, 484
.   : milestone, 462,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	382.704 µs [362.249 µs, 403.158 µs]	-
iast	516.105 µs [494.24 µs, 537.97 µs]	133.401 µs (34.9%)
iast_FULL	740.449 µs [718.02 µs, 762.879 µs]	357.745 µs (93.5%)
iast_GLOBAL	565.735 µs [543.376 µs, 588.094 µs]	183.031 µs (47.8%)
iast_HARDCODED_SECRET_DISABLED	520.79 µs [498.829 µs, 542.752 µs]	138.087 µs (36.1%)
iast_INACTIVE	468.867 µs [447.623 µs, 490.111 µs]	86.163 µs (22.5%)
iast_TELEMETRY_OFF	508.714 µs [486.768 µs, 530.66 µs]	126.01 µs (32.9%)
tracing	469.892 µs [448.364 µs, 491.42 µs]	87.188 µs (22.8%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	386.583 µs [366.636 µs, 406.53 µs]	-
iast	519.159 µs [496.901 µs, 541.416 µs]	132.576 µs (34.3%)
iast_FULL	738.314 µs [716.3 µs, 760.327 µs]	351.731 µs (91.0%)
iast_GLOBAL	564.337 µs [542.503 µs, 586.171 µs]	177.754 µs (46.0%)
iast_HARDCODED_SECRET_DISABLED	520.108 µs [498.387 µs, 541.829 µs]	133.526 µs (34.5%)
iast_INACTIVE	474.892 µs [452.653 µs, 497.13 µs]	88.309 µs (22.8%)
iast_TELEMETRY_OFF	511.034 µs [488.56 µs, 533.508 µs]	124.451 µs (32.2%)
tracing	462.351 µs [440.549 µs, 484.152 µs]	75.768 µs (19.6%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	mobuchowski/update-system-tests
git_commit_date	1743592817	1743597109
git_commit_sha	`32046a3`	`35a9c7a`
release_version	1.48.0-SNAPSHOT~32046a39ed	1.48.0-SNAPSHOT~35a9c7a0f0

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1743599732	1743599732
ci_job_id	876906127	876906127
ci_pipeline_id	60791274	60791274
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-m1cw8fbu-project-304-concurrent-3-j111oe4i 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-m1cw8fbu-project-304-concurrent-3-j111oe4i 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant	appsec	appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.48.0-SNAPSHOT~35a9c7a0f0, baseline=1.48.0-SNAPSHOT~32046a39ed
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.466 ms) : 1455, 1478
.   : milestone, 1466,
appsec (2.373 ms) : 2326, 2420
.   : milestone, 2373,
iast (2.153 ms) : 2094, 2213
.   : milestone, 2153,
iast_GLOBAL (2.205 ms) : 2145, 2266
.   : milestone, 2205,
profiling (2.006 ms) : 1958, 2053
.   : milestone, 2006,
tracing (1.981 ms) : 1935, 2027
.   : milestone, 1981,
section candidate
no_agent (1.467 ms) : 1456, 1478
.   : milestone, 1467,
appsec (2.376 ms) : 2329, 2424
.   : milestone, 2376,
iast (2.161 ms) : 2101, 2221
.   : milestone, 2161,
iast_GLOBAL (2.2 ms) : 2140, 2260
.   : milestone, 2200,
profiling (1.994 ms) : 1947, 2042
.   : milestone, 1994,
tracing (1.995 ms) : 1948, 2041
.   : milestone, 1995,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.466 ms [1.455 ms, 1.478 ms]	-
appsec	2.373 ms [2.326 ms, 2.42 ms]	906.718 µs (61.8%)
iast	2.153 ms [2.094 ms, 2.213 ms]	687.172 µs (46.9%)
iast_GLOBAL	2.205 ms [2.145 ms, 2.266 ms]	739.051 µs (50.4%)
profiling	2.006 ms [1.958 ms, 2.053 ms]	539.252 µs (36.8%)
tracing	1.981 ms [1.935 ms, 2.027 ms]	514.966 µs (35.1%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.467 ms [1.456 ms, 1.478 ms]	-
appsec	2.376 ms [2.329 ms, 2.424 ms]	909.134 µs (62.0%)
iast	2.161 ms [2.101 ms, 2.221 ms]	694.06 µs (47.3%)
iast_GLOBAL	2.2 ms [2.14 ms, 2.26 ms]	733.07 µs (50.0%)
profiling	1.994 ms [1.947 ms, 2.042 ms]	527.36 µs (35.9%)
tracing	1.995 ms [1.948 ms, 2.041 ms]	527.729 µs (36.0%)

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.48.0-SNAPSHOT~35a9c7a0f0, baseline=1.48.0-SNAPSHOT~32046a39ed
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.326 s) : 15326000, 15326000
.   : milestone, 15326000,
appsec (14.747 s) : 14747000, 14747000
.   : milestone, 14747000,
iast (18.623 s) : 18623000, 18623000
.   : milestone, 18623000,
iast_GLOBAL (18.201 s) : 18201000, 18201000
.   : milestone, 18201000,
profiling (15.301 s) : 15301000, 15301000
.   : milestone, 15301000,
tracing (14.735 s) : 14735000, 14735000
.   : milestone, 14735000,
section candidate
no_agent (15.45 s) : 15450000, 15450000
.   : milestone, 15450000,
appsec (14.997 s) : 14997000, 14997000
.   : milestone, 14997000,
iast (19.101 s) : 19101000, 19101000
.   : milestone, 19101000,
iast_GLOBAL (18.158 s) : 18158000, 18158000
.   : milestone, 18158000,
profiling (14.886 s) : 14886000, 14886000
.   : milestone, 14886000,
tracing (15.053 s) : 15053000, 15053000
.   : milestone, 15053000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.326 s [15.326 s, 15.326 s]	-
appsec	14.747 s [14.747 s, 14.747 s]	-579.0 ms (-3.8%)
iast	18.623 s [18.623 s, 18.623 s]	3.297 s (21.5%)
iast_GLOBAL	18.201 s [18.201 s, 18.201 s]	2.875 s (18.8%)
profiling	15.301 s [15.301 s, 15.301 s]	-25.0 ms (-0.2%)
tracing	14.735 s [14.735 s, 14.735 s]	-591.0 ms (-3.9%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.45 s [15.45 s, 15.45 s]	-
appsec	14.997 s [14.997 s, 14.997 s]	-453.0 ms (-2.9%)
iast	19.101 s [19.101 s, 19.101 s]	3.651 s (23.6%)
iast_GLOBAL	18.158 s [18.158 s, 18.158 s]	2.708 s (17.5%)
profiling	14.886 s [14.886 s, 14.886 s]	-564.0 ms (-3.7%)
tracing	15.053 s [15.053 s, 15.053 s]	-397.0 ms (-2.6%)

Update system-tests to c8c4db362291ae5cb5173dc3765c79be9e18ed35

2cd2298

mobuchowski requested a review from a team as a code owner April 2, 2025 08:13

mobuchowski requested a review from amarziali April 2, 2025 08:13

mobuchowski added comp: testing Testing tag: no release notes Changes to exclude from release notes labels Apr 2, 2025

amarziali approved these changes Apr 2, 2025

View reviewed changes

Merge branch 'master' into mobuchowski/update-system-tests

35a9c7a

mobuchowski changed the title ~~Update system-tests to c8c4db362291ae5cb5173dc3765c79be9e18ed35~~ Update system-tests to 63dc98fd3bbf07dfe9aa35f14aeee38024312eb4 Apr 2, 2025

mobuchowski closed this Apr 3, 2025

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Update system-tests to 63dc98fd3bbf07dfe9aa35f14aeee38024312eb4 #8660

Update system-tests to 63dc98fd3bbf07dfe9aa35f14aeee38024312eb4 #8660

Uh oh!

mobuchowski commented Apr 2, 2025

Uh oh!

github-actions bot commented Apr 2, 2025

Uh oh!

pr-commenter bot commented Apr 2, 2025 •

edited

Loading

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

Update system-tests to 63dc98fd3bbf07dfe9aa35f14aeee38024312eb4 #8660

Update system-tests to 63dc98fd3bbf07dfe9aa35f14aeee38024312eb4 #8660

Uh oh!

Conversation

mobuchowski commented Apr 2, 2025

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Uh oh!

github-actions bot commented Apr 2, 2025

Uh oh!

pr-commenter bot commented Apr 2, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

pr-commenter bot commented Apr 2, 2025 •

edited

Loading