ci: add windows-11-arm runner #2591
Conversation
Failed Interop TestsQUIC Interop Runner, client vs. server, differences relative to 8c65240. neqo-latest as client
neqo-latest as server
All resultsSucceeded Interop TestsQUIC Interop Runner, client vs. server neqo-latest as client
neqo-latest as server
Unsupported Interop TestsQUIC Interop Runner, client vs. server neqo-latest as client
neqo-latest as server
|
|
Maybe we just install it? |
Benchmark resultsPerformance differences relative to 847a598. 1-conn/1-100mb-resp/mtu-1504 (aka. Download)/client: No change in performance detected. time: [693.78 ms 697.61 ms 701.42 ms]
thrpt: [142.57 MiB/s 143.35 MiB/s 144.14 MiB/s]
change:
time: [-1.5580% -0.7959% +0.0525%] (p = 0.05 > 0.05)
thrpt: [-0.0524% +0.8022% +1.5826%]
1-conn/10_000-parallel-1b-resp/mtu-1504 (aka. RPS)/client: No change in performance detected. time: [352.25 ms 353.62 ms 354.98 ms]
thrpt: [28.171 Kelem/s 28.279 Kelem/s 28.389 Kelem/s]
change:
time: [-0.3659% +0.2205% +0.7982%] (p = 0.47 > 0.05)
thrpt: [-0.7918% -0.2200% +0.3673%]
1-conn/1-1b-resp/mtu-1504 (aka. HPS)/client: No change in performance detected. time: [25.488 ms 25.633 ms 25.785 ms]
thrpt: [38.782 elem/s 39.012 elem/s 39.234 elem/s]
change:
time: [-1.3696% -0.5205% +0.2719%] (p = 0.22 > 0.05)
thrpt: [-0.2712% +0.5232% +1.3886%]
1-conn/1-100mb-req/mtu-1504 (aka. Upload)/client: 💚 Performance has improved. time: [1.7915 s 1.8133 s 1.8361 s]
thrpt: [54.463 MiB/s 55.147 MiB/s 55.820 MiB/s]
change:
time: [-8.3956% -6.6210% -4.8312%] (p = 0.00 < 0.05)
thrpt: [+5.0765% +7.0904% +9.1650%]
decode 4096 bytes, mask ff: No change in performance detected. time: [12.070 µs 12.100 µs 12.138 µs]
change: [-0.4081% -0.1094% +0.1954%] (p = 0.49 > 0.05)
decode 1048576 bytes, mask ff: No change in performance detected. time: [3.1272 ms 3.1348 ms 3.1442 ms]
change: [-0.7339% -0.2697% +0.1582%] (p = 0.26 > 0.05)
decode 4096 bytes, mask 7f: No change in performance detected. time: [20.168 µs 20.224 µs 20.286 µs]
change: [-0.3661% +0.0032% +0.4244%] (p = 0.98 > 0.05)
decode 1048576 bytes, mask 7f: No change in performance detected. time: [5.2471 ms 5.2602 ms 5.2751 ms]
change: [-0.3443% -0.0005% +0.3593%] (p = 1.00 > 0.05)
decode 4096 bytes, mask 3f: No change in performance detected. time: [7.0074 µs 7.0185 µs 7.0385 µs]
change: [-0.8880% -0.1196% +0.7775%] (p = 0.80 > 0.05)
decode 1048576 bytes, mask 3f: No change in performance detected. time: [1.7922 ms 1.7980 ms 1.8051 ms]
change: [-0.6316% -0.0830% +0.4601%] (p = 0.75 > 0.05)
1000 streams of 1 bytes/multistream: No change in performance detected. time: [25.576 ms 25.602 ms 25.628 ms]
change: [-0.0568% +0.0869% +0.2311%] (p = 0.23 > 0.05)
1000 streams of 1000 bytes/multistream: Change within noise threshold. time: [143.92 ms 143.96 ms 143.99 ms]
change: [+0.0182% +0.0530% +0.0891%] (p = 0.00 < 0.05)
coalesce_acked_from_zero 1+1 entries: No change in performance detected. time: [94.809 ns 95.147 ns 95.482 ns]
change: [-0.4014% +0.0250% +0.4502%] (p = 0.91 > 0.05)
coalesce_acked_from_zero 3+1 entries: No change in performance detected. time: [112.69 ns 113.02 ns 113.37 ns]
change: [-0.6434% -0.1758% +0.2601%] (p = 0.46 > 0.05)
coalesce_acked_from_zero 10+1 entries: No change in performance detected. time: [111.94 ns 112.29 ns 112.74 ns]
change: [-0.5043% +0.2238% +0.9630%] (p = 0.59 > 0.05)
coalesce_acked_from_zero 1000+1 entries: No change in performance detected. time: [92.961 ns 93.453 ns 93.987 ns]
change: [-0.5859% +0.4267% +1.4132%] (p = 0.41 > 0.05)
RxStreamOrderer::inbound_frame(): Change within noise threshold. time: [117.33 ms 117.38 ms 117.44 ms]
change: [+0.3764% +0.4410% +0.5103%] (p = 0.00 < 0.05)
SentPackets::take_ranges: No change in performance detected. time: [8.2627 µs 8.5307 µs 8.7854 µs]
change: [-3.2255% -0.6526% +2.0184%] (p = 0.63 > 0.05)
transfer/pacing-false/varying-seeds: Change within noise threshold. time: [35.824 ms 35.885 ms 35.945 ms]
change: [+0.7514% +1.0002% +1.2374%] (p = 0.00 < 0.05)
transfer/pacing-true/varying-seeds: Change within noise threshold. time: [36.695 ms 36.799 ms 36.903 ms]
change: [+0.1973% +0.6341% +1.0569%] (p = 0.00 < 0.05)
transfer/pacing-false/same-seed: Change within noise threshold. time: [35.490 ms 35.542 ms 35.597 ms]
change: [+0.5478% +0.7464% +0.9507%] (p = 0.00 < 0.05)
transfer/pacing-true/same-seed: Change within noise threshold. time: [37.377 ms 37.444 ms 37.512 ms]
change: [+0.2418% +0.4769% +0.7140%] (p = 0.00 < 0.05)
Client/server transfer resultsPerformance differences relative to 847a598. Transfer of 33554432 bytes over loopback, 30 runs. All unit-less numbers are in milliseconds.
|
![github-advanced-security[bot]](https://avatars.githubusercontent.com/in/57789?s=60&v=4){kind=small}
|
This is now stuck on actions/partner-runner-images#90 |
Signed-off-by: Lars Eggert <[email protected]>
Codecov Report✅ All modified and coverable lines are covered by tests. Additional details and impacted files@@ Coverage Diff @@
## main #2591 +/- ##
==========================================
+ Coverage 94.88% 94.91% +0.03%
==========================================
Files 115 115
Lines 34291 34323 +32
Branches 34291 34323 +32
==========================================
+ Hits 32536 32577 +41
+ Misses 1748 1737 -11
- Partials 7 9 +2
|
|
There is a new version of the Win11 ARM image, but it's still shipping with the amd64 llvm toolchain. |
Client/server transfer resultsPerformance differences relative to 967947c. Transfer of 33554432 bytes over loopback, min. 100 runs. All unit-less numbers are in milliseconds.
Download data for |
Benchmark resultsPerformance differences relative to 967947c. 1-conn/1-100mb-resp/mtu-1504 (aka. Download)/client: No change in performance detected. time: [199.78 ms 200.13 ms 200.48 ms]
thrpt: [498.79 MiB/s 499.66 MiB/s 500.55 MiB/s]
change:
time: [−0.4357% −0.1466% +0.1287%] (p = 0.33 > 0.05)
thrpt: [−0.1286% +0.1468% +0.4376%]
1-conn/10_000-parallel-1b-resp/mtu-1504 (aka. RPS)/client: No change in performance detected. time: [299.93 ms 301.52 ms 303.11 ms]
thrpt: [32.991 Kelem/s 33.165 Kelem/s 33.341 Kelem/s]
change:
time: [−0.6636% +0.0487% +0.7705%] (p = 0.90 > 0.05)
thrpt: [−0.7646% −0.0487% +0.6680%]
1-conn/1-1b-resp/mtu-1504 (aka. HPS)/client: No change in performance detected. time: [27.904 ms 28.070 ms 28.258 ms]
thrpt: [35.388 B/s 35.625 B/s 35.837 B/s]
change:
time: [−0.1936% +0.6986% +1.5772%] (p = 0.13 > 0.05)
thrpt: [−1.5527% −0.6937% +0.1940%]
1-conn/1-100mb-req/mtu-1504 (aka. Upload)/client: 💔 Performance has regressed. time: [204.41 ms 204.72 ms 205.10 ms]
thrpt: [487.56 MiB/s 488.46 MiB/s 489.21 MiB/s]
change:
time: [+1.2373% +1.4793% +1.7197%] (p = 0.00 < 0.05)
thrpt: [−1.6907% −1.4577% −1.2221%]
decode 4096 bytes, mask ff: No change in performance detected. time: [11.816 µs 11.854 µs 11.900 µs]
change: [−0.5587% −0.0573% +0.5033%] (p = 0.84 > 0.05)
decode 1048576 bytes, mask ff: No change in performance detected. time: [3.0255 ms 3.0388 ms 3.0549 ms]
change: [−0.3495% +0.2837% +0.9105%] (p = 0.38 > 0.05)
decode 4096 bytes, mask 7f: No change in performance detected. time: [20.010 µs 20.069 µs 20.135 µs]
change: [−0.4156% −0.0211% +0.3534%] (p = 0.92 > 0.05)
decode 1048576 bytes, mask 7f: No change in performance detected. time: [5.0441 ms 5.0555 ms 5.0685 ms]
change: [−1.1720% −0.2888% +0.3142%] (p = 0.53 > 0.05)
decode 4096 bytes, mask 3f: No change in performance detected. time: [8.2625 µs 8.2891 µs 8.3226 µs]
change: [−0.8723% −0.1852% +0.4155%] (p = 0.60 > 0.05)
decode 1048576 bytes, mask 3f: No change in performance detected. time: [1.5852 ms 1.5895 ms 1.5951 ms]
change: [−0.6160% −0.0953% +0.4334%] (p = 0.71 > 0.05)
coalesce_acked_from_zero 1+1 entries: No change in performance detected. time: [88.247 ns 88.604 ns 88.970 ns]
change: [−0.6027% +1.3932% +4.1036%] (p = 0.27 > 0.05)
coalesce_acked_from_zero 3+1 entries: No change in performance detected. time: [105.52 ns 105.81 ns 106.11 ns]
change: [−0.5111% −0.1207% +0.2883%] (p = 0.56 > 0.05)
coalesce_acked_from_zero 10+1 entries: No change in performance detected. time: [104.99 ns 105.41 ns 105.92 ns]
change: [−0.8398% +0.0371% +0.7992%] (p = 0.93 > 0.05)
coalesce_acked_from_zero 1000+1 entries: No change in performance detected. time: [88.663 ns 88.761 ns 88.876 ns]
change: [−8.7172% −2.9078% +0.6883%] (p = 0.42 > 0.05)
RxStreamOrderer::inbound_frame(): Change within noise threshold. time: [108.64 ms 108.83 ms 109.12 ms]
change: [−0.8593% −0.6688% −0.3346%] (p = 0.00 < 0.05)
sent::Packets::take_ranges: No change in performance detected. time: [8.0637 µs 8.2690 µs 8.4567 µs]
change: [−0.9199% +5.0453% +15.595%] (p = 0.25 > 0.05)
transfer/pacing-false/varying-seeds: Change within noise threshold. time: [37.393 ms 37.469 ms 37.548 ms]
change: [+1.0035% +1.3060% +1.6036%] (p = 0.00 < 0.05)
transfer/pacing-true/varying-seeds: Change within noise threshold. time: [38.242 ms 38.370 ms 38.498 ms]
change: [+0.0906% +0.5552% +1.0060%] (p = 0.02 < 0.05)
transfer/pacing-false/same-seed: No change in performance detected. time: [36.780 ms 36.843 ms 36.908 ms]
change: [−0.1610% +0.0682% +0.3097%] (p = 0.57 > 0.05)
transfer/pacing-true/same-seed: No change in performance detected. time: [38.638 ms 38.730 ms 38.826 ms]
change: [−0.5422% −0.2261% +0.0730%] (p = 0.16 > 0.05)
Download data for |
larseggert
force-pushed
the
ci-windows-arm
branch
from
e061d67 to
04246c6
Compare
GitHub Actions now provide Windows ARM64 runners:
https://github.blog/changelog/2025-04-14-windows-arm64-hosted-runners-now-available-in-public-preview/
Related: https://bugzilla.mozilla.org/show_bug.cgi?id=1931918