Test dd-octo-sts workflow #9200

sarahchen6 · 2025-07-18T14:48:12Z

What Does This Do

Creates a temporary job that tests that uploading artifacts to github still works with the dd-octo-sts token.

Motivation

Test the dd-octo-sts workflow on a tagged branch without triggering an actual release.

Additional Notes

Depends on #9198. We would test by:

tagging the most recent commit on this branch with vTEST_RELEASE_TAG. DOES NOT WORK: build steps require tags that are prefixed with v to be formatted "correctly"
pushing the tag
manually creating a pre-release with the tag vTEST_RELEASE_TAG e.g.

manually triggering the job that uploads to this test release
checking that github artifacts were successfully uploaded to the test release
deleting the test release and tag

Contributor Checklist

Format the title according the contribution guidelines
Assign the type: and (comp: or inst:) labels in addition to any usefull labels
Don't use close, fix or any linking keywords when referencing an issue.
Use solves instead, and assign the PR milestone to the issue
Update the CODEOWNERS file on source file addition, move, or deletion
Update the public documentation in case of new configuration flag or behavior

Jira ticket: https://datadoghq.atlassian.net/browse/LANGPLAT-696

pr-commenter · 2025-07-21T19:43:45Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	sarahchen6/test-dd-octo-sts-workflow
git_commit_date	1753110119	1753124762
git_commit_sha	`c938629`	`0d5b049`
release_version	1.52.0-SNAPSHOT~c938629f30	1.52.0-SNAPSHOT~0d5b049e9d

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1753126773	1753126773
ci_job_id	1039725320	1039725320
ci_pipeline_id	71229952	71229952
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-1wqkt53h 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-1wqkt53h 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 48 metrics, 11 unstable metrics.

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.52.0-SNAPSHOT~0d5b049e9d, baseline=1.52.0-SNAPSHOT~c938629f30

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.044 s) : 0, 1043600
Total [baseline] (8.606 s) : 0, 8606402
Agent [candidate] (1.051 s) : 0, 1050700
Total [candidate] (8.626 s) : 0, 8626140
section iast
Agent [baseline] (1.17 s) : 0, 1169974
Total [baseline] (9.316 s) : 0, 9315601
Agent [candidate] (1.176 s) : 0, 1176062
Total [candidate] (9.313 s) : 0, 9313046

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.044 s	-
Agent	iast	1.17 s	126.374 ms (12.1%)
Total	tracing	8.606 s	-
Total	iast	9.316 s	709.199 ms (8.2%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.051 s	-
Agent	iast	1.176 s	125.362 ms (11.9%)
Total	tracing	8.626 s	-
Total	iast	9.313 s	686.906 ms (8.0%)

gantt
    title insecure-bank - break down per module: candidate=1.52.0-SNAPSHOT~0d5b049e9d, baseline=1.52.0-SNAPSHOT~c938629f30

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.438 ms) : 0, 1438
crashtracking [candidate] (1.458 ms) : 0, 1458
BytebuddyAgent [baseline] (735.062 ms) : 0, 735062
BytebuddyAgent [candidate] (738.784 ms) : 0, 738784
GlobalTracer [baseline] (240.817 ms) : 0, 240817
GlobalTracer [candidate] (243.693 ms) : 0, 243693
AppSec [baseline] (30.468 ms) : 0, 30468
AppSec [candidate] (30.711 ms) : 0, 30711
Debugger [baseline] (5.996 ms) : 0, 5996
Debugger [candidate] (6.061 ms) : 0, 6061
Remote Config [baseline] (639.763 µs) : 0, 640
Remote Config [candidate] (654.885 µs) : 0, 655
Telemetry [baseline] (8.197 ms) : 0, 8197
Telemetry [candidate] (8.261 ms) : 0, 8261
section iast
crashtracking [baseline] (1.426 ms) : 0, 1426
crashtracking [candidate] (1.427 ms) : 0, 1427
BytebuddyAgent [baseline] (844.981 ms) : 0, 844981
BytebuddyAgent [candidate] (849.009 ms) : 0, 849009
GlobalTracer [baseline] (230.246 ms) : 0, 230246
GlobalTracer [candidate] (232.559 ms) : 0, 232559
IAST [baseline] (28.255 ms) : 0, 28255
IAST [candidate] (28.125 ms) : 0, 28125
AppSec [baseline] (29.281 ms) : 0, 29281
AppSec [candidate] (28.934 ms) : 0, 28934
Debugger [baseline] (6.472 ms) : 0, 6472
Debugger [candidate] (6.595 ms) : 0, 6595
Remote Config [baseline] (582.588 µs) : 0, 583
Remote Config [candidate] (593.414 µs) : 0, 593
Telemetry [baseline] (7.867 ms) : 0, 7867
Telemetry [candidate] (7.973 ms) : 0, 7973

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.52.0-SNAPSHOT~0d5b049e9d, baseline=1.52.0-SNAPSHOT~c938629f30

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.037 s) : 0, 1037106
Total [baseline] (10.744 s) : 0, 10743809
Agent [candidate] (1.04 s) : 0, 1039539
Total [candidate] (10.714 s) : 0, 10714038
section appsec
Agent [baseline] (1.218 s) : 0, 1217895
Total [baseline] (10.783 s) : 0, 10783399
Agent [candidate] (1.228 s) : 0, 1227912
Total [candidate] (10.901 s) : 0, 10900995
section iast
Agent [baseline] (1.172 s) : 0, 1171927
Total [baseline] (10.882 s) : 0, 10881528
Agent [candidate] (1.198 s) : 0, 1198274
Total [candidate] (10.963 s) : 0, 10963423
section profiling
Agent [baseline] (1.181 s) : 0, 1181257
Total [baseline] (10.898 s) : 0, 10898178
Agent [candidate] (1.202 s) : 0, 1202138
Total [candidate] (11.087 s) : 0, 11087023

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.037 s	-
Agent	appsec	1.218 s	180.789 ms (17.4%)
Agent	iast	1.172 s	134.821 ms (13.0%)
Agent	profiling	1.181 s	144.15 ms (13.9%)
Total	tracing	10.744 s	-
Total	appsec	10.783 s	39.59 ms (0.4%)
Total	iast	10.882 s	137.719 ms (1.3%)
Total	profiling	10.898 s	154.369 ms (1.4%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.04 s	-
Agent	appsec	1.228 s	188.373 ms (18.1%)
Agent	iast	1.198 s	158.734 ms (15.3%)
Agent	profiling	1.202 s	162.599 ms (15.6%)
Total	tracing	10.714 s	-
Total	appsec	10.901 s	186.957 ms (1.7%)
Total	iast	10.963 s	249.385 ms (2.3%)
Total	profiling	11.087 s	372.985 ms (3.5%)

gantt
    title petclinic - break down per module: candidate=1.52.0-SNAPSHOT~0d5b049e9d, baseline=1.52.0-SNAPSHOT~c938629f30

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.422 ms) : 0, 1422
crashtracking [candidate] (1.451 ms) : 0, 1451
BytebuddyAgent [baseline] (728.795 ms) : 0, 728795
BytebuddyAgent [candidate] (730.021 ms) : 0, 730021
GlobalTracer [baseline] (240.662 ms) : 0, 240662
GlobalTracer [candidate] (241.132 ms) : 0, 241132
AppSec [baseline] (30.354 ms) : 0, 30354
AppSec [candidate] (30.375 ms) : 0, 30375
Debugger [baseline] (5.998 ms) : 0, 5998
Debugger [candidate] (5.984 ms) : 0, 5984
Remote Config [baseline] (647.89 µs) : 0, 648
Remote Config [candidate] (648.954 µs) : 0, 649
Telemetry [baseline] (8.228 ms) : 0, 8228
Telemetry [candidate] (9.004 ms) : 0, 9004
section appsec
crashtracking [baseline] (1.42 ms) : 0, 1420
crashtracking [candidate] (1.449 ms) : 0, 1449
BytebuddyAgent [baseline] (751.993 ms) : 0, 751993
BytebuddyAgent [candidate] (759.058 ms) : 0, 759058
GlobalTracer [baseline] (234.391 ms) : 0, 234391
GlobalTracer [candidate] (235.486 ms) : 0, 235486
IAST [baseline] (23.504 ms) : 0, 23504
IAST [candidate] (23.755 ms) : 0, 23755
AppSec [baseline] (167.922 ms) : 0, 167922
AppSec [candidate] (168.332 ms) : 0, 168332
Debugger [baseline] (8.64 ms) : 0, 8640
Debugger [candidate] (8.858 ms) : 0, 8858
Remote Config [baseline] (605.838 µs) : 0, 606
Remote Config [candidate] (624.46 µs) : 0, 624
Telemetry [baseline] (8.199 ms) : 0, 8199
Telemetry [candidate] (8.959 ms) : 0, 8959
section iast
crashtracking [baseline] (1.445 ms) : 0, 1445
crashtracking [candidate] (1.488 ms) : 0, 1488
BytebuddyAgent [baseline] (846.296 ms) : 0, 846296
BytebuddyAgent [candidate] (867.292 ms) : 0, 867292
GlobalTracer [baseline] (230.866 ms) : 0, 230866
GlobalTracer [candidate] (234.356 ms) : 0, 234356
IAST [baseline] (28.265 ms) : 0, 28265
IAST [candidate] (29.531 ms) : 0, 29531
AppSec [baseline] (29.073 ms) : 0, 29073
AppSec [candidate] (26.314 ms) : 0, 26314
Debugger [baseline] (6.574 ms) : 0, 6574
Debugger [candidate] (9.324 ms) : 0, 9324
Remote Config [baseline] (579.662 µs) : 0, 580
Remote Config [candidate] (603.043 µs) : 0, 603
Telemetry [baseline] (7.912 ms) : 0, 7912
Telemetry [candidate] (8.097 ms) : 0, 8097
section profiling
crashtracking [baseline] (1.393 ms) : 0, 1393
crashtracking [candidate] (1.414 ms) : 0, 1414
BytebuddyAgent [baseline] (757.589 ms) : 0, 757589
BytebuddyAgent [candidate] (771.371 ms) : 0, 771371
GlobalTracer [baseline] (220.228 ms) : 0, 220228
GlobalTracer [candidate] (223.368 ms) : 0, 223368
AppSec [baseline] (30.385 ms) : 0, 30385
AppSec [candidate] (31.036 ms) : 0, 31036
Debugger [baseline] (7.015 ms) : 0, 7015
Debugger [candidate] (6.392 ms) : 0, 6392
Remote Config [baseline] (653.714 µs) : 0, 654
Remote Config [candidate] (685.965 µs) : 0, 686
Telemetry [baseline] (11.703 ms) : 0, 11703
Telemetry [candidate] (12.716 ms) : 0, 12716
ProfilingAgent [baseline] (104.041 ms) : 0, 104041
ProfilingAgent [candidate] (106.125 ms) : 0, 106125
Profiling [baseline] (104.064 ms) : 0, 104064
Profiling [candidate] (106.147 ms) : 0, 106147

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	sarahchen6/test-dd-octo-sts-workflow
git_commit_date	1753110119	1753124762
git_commit_sha	`c938629`	`0d5b049`
release_version	1.52.0-SNAPSHOT~c938629f30	1.52.0-SNAPSHOT~0d5b049e9d

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1753126396	1753126396
ci_job_id	1039725321	1039725321
ci_pipeline_id	71229952	71229952
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-1-3rfn4lzz 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-1-3rfn4lzz 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 2 performance regressions! Performance is the same for 10 metrics, 12 unstable metrics.

scenario	Δ mean http_req_duration	Δ mean throughput	candidate mean http_req_duration	candidate mean throughput	baseline mean http_req_duration	baseline mean throughput
scenario:load:petclinic:profiling:high_load	worse [+1.680ms; +2.694ms] or [+3.488%; +5.593%]	unstable [-10.968op/s; +2.618op/s] or [-11.287%; +2.694%]	50.350ms	93.000op/s	48.163ms	97.175op/s
scenario:load:petclinic:code_origins:high_load	worse [+1.135ms; +1.938ms] or [+2.629%; +4.489%]	unstable [-10.705op/s; +3.280op/s] or [-9.875%; +3.026%]	44.697ms	104.688op/s	43.161ms	108.400op/s

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.52.0-SNAPSHOT~0d5b049e9d, baseline=1.52.0-SNAPSHOT~c938629f30
    dateFormat X
    axisFormat %s
section baseline
no_agent (37.235 ms) : 36942, 37527
.   : milestone, 37235,
appsec (49.047 ms) : 48611, 49483
.   : milestone, 49047,
code_origins (43.161 ms) : 42796, 43525
.   : milestone, 43161,
iast (44.908 ms) : 44517, 45298
.   : milestone, 44908,
profiling (48.163 ms) : 47673, 48653
.   : milestone, 48163,
tracing (43.779 ms) : 43412, 44145
.   : milestone, 43779,
section candidate
no_agent (36.563 ms) : 36277, 36849
.   : milestone, 36563,
appsec (47.889 ms) : 47456, 48323
.   : milestone, 47889,
code_origins (44.697 ms) : 44315, 45079
.   : milestone, 44697,
iast (44.433 ms) : 44052, 44815
.   : milestone, 44433,
profiling (50.35 ms) : 49898, 50802
.   : milestone, 50350,
tracing (44.453 ms) : 44080, 44825
.   : milestone, 44453,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	37.235 ms [36.942 ms, 37.527 ms]	-
appsec	49.047 ms [48.611 ms, 49.483 ms]	11.812 ms (31.7%)
code_origins	43.161 ms [42.796 ms, 43.525 ms]	5.926 ms (15.9%)
iast	44.908 ms [44.517 ms, 45.298 ms]	7.673 ms (20.6%)
profiling	48.163 ms [47.673 ms, 48.653 ms]	10.928 ms (29.4%)
tracing	43.779 ms [43.412 ms, 44.145 ms]	6.544 ms (17.6%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	36.563 ms [36.277 ms, 36.849 ms]	-
appsec	47.889 ms [47.456 ms, 48.323 ms]	11.326 ms (31.0%)
code_origins	44.697 ms [44.315 ms, 45.079 ms]	8.134 ms (22.2%)
iast	44.433 ms [44.052 ms, 44.815 ms]	7.87 ms (21.5%)
profiling	50.35 ms [49.898 ms, 50.802 ms]	13.787 ms (37.7%)
tracing	44.453 ms [44.08 ms, 44.825 ms]	7.89 ms (21.6%)

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.52.0-SNAPSHOT~0d5b049e9d, baseline=1.52.0-SNAPSHOT~c938629f30
    dateFormat X
    axisFormat %s
section baseline
no_agent (4.355 ms) : 4304, 4405
.   : milestone, 4355,
iast (9.503 ms) : 9346, 9659
.   : milestone, 9503,
iast_FULL (14.013 ms) : 13736, 14289
.   : milestone, 14013,
iast_GLOBAL (10.083 ms) : 9905, 10261
.   : milestone, 10083,
profiling (9.023 ms) : 8867, 9178
.   : milestone, 9023,
tracing (7.635 ms) : 7518, 7751
.   : milestone, 7635,
section candidate
no_agent (4.493 ms) : 4442, 4543
.   : milestone, 4493,
iast (9.548 ms) : 9389, 9706
.   : milestone, 9548,
iast_FULL (14.292 ms) : 14003, 14581
.   : milestone, 14292,
iast_GLOBAL (10.287 ms) : 10106, 10469
.   : milestone, 10287,
profiling (8.98 ms) : 8833, 9127
.   : milestone, 8980,
tracing (7.654 ms) : 7532, 7775
.   : milestone, 7654,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	4.355 ms [4.304 ms, 4.405 ms]	-
iast	9.503 ms [9.346 ms, 9.659 ms]	5.148 ms (118.2%)
iast_FULL	14.013 ms [13.736 ms, 14.289 ms]	9.658 ms (221.8%)
iast_GLOBAL	10.083 ms [9.905 ms, 10.261 ms]	5.728 ms (131.5%)
profiling	9.023 ms [8.867 ms, 9.178 ms]	4.668 ms (107.2%)
tracing	7.635 ms [7.518 ms, 7.751 ms]	3.28 ms (75.3%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	4.493 ms [4.442 ms, 4.543 ms]	-
iast	9.548 ms [9.389 ms, 9.706 ms]	5.055 ms (112.5%)
iast_FULL	14.292 ms [14.003 ms, 14.581 ms]	9.799 ms (218.1%)
iast_GLOBAL	10.287 ms [10.106 ms, 10.469 ms]	5.795 ms (129.0%)
profiling	8.98 ms [8.833 ms, 9.127 ms]	4.487 ms (99.9%)
tracing	7.654 ms [7.532 ms, 7.775 ms]	3.161 ms (70.4%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	sarahchen6/test-dd-octo-sts-workflow
git_commit_date	1753110119	1753124762
git_commit_sha	`c938629`	`0d5b049`
release_version	1.52.0-SNAPSHOT~c938629f30	1.52.0-SNAPSHOT~0d5b049e9d

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1753126988	1753126988
ci_job_id	1039725322	1039725322
ci_pipeline_id	71229952	71229952
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-z0ym9et4 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-z0ym9et4 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.52.0-SNAPSHOT~0d5b049e9d, baseline=1.52.0-SNAPSHOT~c938629f30
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.01 s) : 15010000, 15010000
.   : milestone, 15010000,
appsec (14.898 s) : 14898000, 14898000
.   : milestone, 14898000,
iast (18.327 s) : 18327000, 18327000
.   : milestone, 18327000,
iast_GLOBAL (18.122 s) : 18122000, 18122000
.   : milestone, 18122000,
profiling (16.173 s) : 16173000, 16173000
.   : milestone, 16173000,
tracing (14.682 s) : 14682000, 14682000
.   : milestone, 14682000,
section candidate
no_agent (14.768 s) : 14768000, 14768000
.   : milestone, 14768000,
appsec (14.892 s) : 14892000, 14892000
.   : milestone, 14892000,
iast (18.495 s) : 18495000, 18495000
.   : milestone, 18495000,
iast_GLOBAL (18.008 s) : 18008000, 18008000
.   : milestone, 18008000,
profiling (15.2 s) : 15200000, 15200000
.   : milestone, 15200000,
tracing (14.82 s) : 14820000, 14820000
.   : milestone, 14820000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.01 s [15.01 s, 15.01 s]	-
appsec	14.898 s [14.898 s, 14.898 s]	-112.0 ms (-0.7%)
iast	18.327 s [18.327 s, 18.327 s]	3.317 s (22.1%)
iast_GLOBAL	18.122 s [18.122 s, 18.122 s]	3.112 s (20.7%)
profiling	16.173 s [16.173 s, 16.173 s]	1.163 s (7.7%)
tracing	14.682 s [14.682 s, 14.682 s]	-328.0 ms (-2.2%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	14.768 s [14.768 s, 14.768 s]	-
appsec	14.892 s [14.892 s, 14.892 s]	124.0 ms (0.8%)
iast	18.495 s [18.495 s, 18.495 s]	3.727 s (25.2%)
iast_GLOBAL	18.008 s [18.008 s, 18.008 s]	3.24 s (21.9%)
profiling	15.2 s [15.2 s, 15.2 s]	432.0 ms (2.9%)
tracing	14.82 s [14.82 s, 14.82 s]	52.0 ms (0.4%)

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.52.0-SNAPSHOT~0d5b049e9d, baseline=1.52.0-SNAPSHOT~c938629f30
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.479 ms) : 1467, 1490
.   : milestone, 1479,
appsec (2.423 ms) : 2373, 2473
.   : milestone, 2423,
iast (2.196 ms) : 2133, 2258
.   : milestone, 2196,
iast_GLOBAL (2.245 ms) : 2182, 2309
.   : milestone, 2245,
profiling (2.062 ms) : 2011, 2114
.   : milestone, 2062,
tracing (2.012 ms) : 1964, 2060
.   : milestone, 2012,
section candidate
no_agent (1.482 ms) : 1470, 1493
.   : milestone, 1482,
appsec (3.655 ms) : 3439, 3871
.   : milestone, 3655,
iast (2.196 ms) : 2134, 2259
.   : milestone, 2196,
iast_GLOBAL (2.238 ms) : 2175, 2301
.   : milestone, 2238,
profiling (2.051 ms) : 2000, 2103
.   : milestone, 2051,
tracing (2.016 ms) : 1967, 2065
.   : milestone, 2016,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.479 ms [1.467 ms, 1.49 ms]	-
appsec	2.423 ms [2.373 ms, 2.473 ms]	944.413 µs (63.9%)
iast	2.196 ms [2.133 ms, 2.258 ms]	716.99 µs (48.5%)
iast_GLOBAL	2.245 ms [2.182 ms, 2.309 ms]	766.763 µs (51.9%)
profiling	2.062 ms [2.011 ms, 2.114 ms]	583.793 µs (39.5%)
tracing	2.012 ms [1.964 ms, 2.06 ms]	533.62 µs (36.1%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.482 ms [1.47 ms, 1.493 ms]	-
appsec	3.655 ms [3.439 ms, 3.871 ms]	2.173 ms (146.7%)
iast	2.196 ms [2.134 ms, 2.259 ms]	714.547 µs (48.2%)
iast_GLOBAL	2.238 ms [2.175 ms, 2.301 ms]	756.17 µs (51.0%)
profiling	2.051 ms [2.0 ms, 2.103 ms]	569.588 µs (38.4%)
tracing	2.016 ms [1.967 ms, 2.065 ms]	534.029 µs (36.0%)

sarahchen6 · 2025-07-23T14:12:18Z

This testing method does not work because tags that are prefixed with v expect a correct version format.

Also, we successfully tested the workflow from #9187 in the 1.51.2 patch release!

sarahchen6 added 7 commits July 18, 2025 10:46

Comment out publishing steps

c26723b

Add github auth test

05a447f

Clean gitlab-ci file

5be6f87

Loosen commit tag expectation

798f27b

Instead add separate job that tests artifact upload

7bf8f45

Revert one-pipeline

c332904

Add v to tag

0d5b049

sarahchen6 added 2 commits July 21, 2025 16:18

Merge branch 'master' into sarahchen6/test-dd-octo-sts-workflow

e40606b

Change tag to v0

5a049be

sarahchen6 closed this Jul 23, 2025

sarahchen6 deleted the sarahchen6/test-dd-octo-sts-workflow branch October 16, 2025 18:30

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Test dd-octo-sts workflow #9200

Test dd-octo-sts workflow #9200

Uh oh!

sarahchen6 commented Jul 18, 2025 •

edited

Loading

Uh oh!

pr-commenter bot commented Jul 21, 2025

Uh oh!

sarahchen6 commented Jul 23, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

Test dd-octo-sts workflow #9200

Test dd-octo-sts workflow #9200

Uh oh!

Conversation

sarahchen6 commented Jul 18, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Uh oh!

pr-commenter bot commented Jul 21, 2025

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

Uh oh!

sarahchen6 commented Jul 23, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

sarahchen6 commented Jul 18, 2025 •

edited

Loading