@@ -438,12 +438,12 @@ Apple M1 (Virtual), 1 CPU, 3 logical and 3 physical cores
438438Job=.NET 9.0 Runtime=.NET 9.0
439439
440440```
441- | Method | Mean | Error | StdDev |
442- | ------------- | ---------:| ---------:| ---------:|
443- | Build_TUnit | 988.1 ms | 19.63 ms | 49.60 ms |
444- | Build_NUnit | 823.6 ms | 16.11 ms | 20.95 ms |
445- | Build_xUnit | 784.1 ms | 15.05 ms | 17.33 ms |
446- | Build_MSTest | 842 .5 ms | 10.15 ms | 9.00 ms |
441+ | Method | Mean | Error | StdDev | Median |
442+ | ------------- | ----------- :| ---------:| ----------: | -- ---------:|
443+ | Build_TUnit | 1,154.4 ms | 68.90 ms | 199.88 ms | 1,085.1 ms |
444+ | Build_NUnit | 946.4 ms | 43.01 ms | 126.80 ms | 905.1 ms |
445+ | Build_xUnit | 777.8 ms | 9.19 ms | 7.17 ms | 776.8 ms |
446+ | Build_MSTest | 854 .5 ms | 16.59 ms | 14.71 ms | 851.8 ms |
447447
448448
449449
@@ -462,10 +462,10 @@ Job=.NET 9.0 Runtime=.NET 9.0
462462```
463463| Method | Mean | Error | StdDev |
464464| ------------- | --------:| ---------:| ---------:|
465- | Build_TUnit | 1.989 s | 0.0393 s | 0.0497 s |
466- | Build_NUnit | 1.520 s | 0.0128 s | 0.0119 s |
467- | Build_xUnit | 1.503 s | 0.0109 s | 0.0085 s |
468- | Build_MSTest | 1.535 s | 0.0176 s | 0.0165 s |
465+ | Build_TUnit | 1.966 s | 0.0385 s | 0.0643 s |
466+ | Build_NUnit | 1.519 s | 0.0299 s | 0.0265 s |
467+ | Build_xUnit | 1.491 s | 0.0294 s | 0.0372 s |
468+ | Build_MSTest | 1.516 s | 0.0186 s | 0.0174 s |
469469
470470
471471
@@ -484,10 +484,10 @@ Job=.NET 9.0 Runtime=.NET 9.0
484484```
485485| Method | Mean | Error | StdDev |
486486| ------------- | --------:| ---------:| ---------:|
487- | Build_TUnit | 1.936 s | 0.0383 s | 0.0585 s |
488- | Build_NUnit | 1.525 s | 0.0133 s | 0.0124 s |
489- | Build_xUnit | 1.504 s | 0.0217 s | 0.0192 s |
490- | Build_MSTest | 1.547 s | 0.0307 s | 0.0272 s |
487+ | Build_TUnit | 1.954 s | 0.0364 s | 0.0419 s |
488+ | Build_NUnit | 1.555 s | 0.0307 s | 0.0315 s |
489+ | Build_xUnit | 1.533 s | 0.0264 s | 0.0234 s |
490+ | Build_MSTest | 1.564 s | 0.0288 s | 0.0269 s |
491491
492492
493493### Scenario: A single test that completes instantly (including spawning a new process and initialising the test framework)
@@ -507,11 +507,11 @@ Job=.NET 9.0 Runtime=.NET 9.0
507507```
508508| Method | Mean | Error | StdDev |
509509| ---------- | ----------:| ----------:| ----------:|
510- | TUnit_AOT | 74.75 ms | 0.390 ms | 0.325 ms |
511- | TUnit | 490.04 ms | 8.961 ms | 8.382 ms |
512- | NUnit | 723.16 ms | 12.698 ms | 11.257 ms |
513- | xUnit | 735.73 ms | 8.006 ms | 7.097 ms |
514- | MSTest | 644.11 ms | 6.755 ms | 6.318 ms |
510+ | TUnit_AOT | 69.86 ms | 1.070 ms | 1.232 ms |
511+ | TUnit | 486.18 ms | 8.651 ms | 9.257 ms |
512+ | NUnit | 704.12 ms | 12.613 ms | 11.181 ms |
513+ | xUnit | 722.33 ms | 10.060 ms | 8.918 ms |
514+ | MSTest | 619.32 ms | 8.705 ms | 8.143 ms |
515515
516516
517517
@@ -530,11 +530,11 @@ Job=.NET 9.0 Runtime=.NET 9.0
530530```
531531| Method | Mean | Error | StdDev |
532532| ---------- | ------------:| ----------:| ----------:|
533- | TUnit_AOT | 27.38 ms | 0.667 ms | 1.944 ms |
534- | TUnit | 819.53 ms | 16.184 ms | 20.468 ms |
535- | NUnit | 1,277.88 ms | 15.071 ms | 14.098 ms |
536- | xUnit | 1,325.67 ms | 6.565 ms | 5.482 ms |
537- | MSTest | 1,119.53 ms | 9.595 ms | 8.975 ms |
533+ | TUnit_AOT | 28.64 ms | 0.614 ms | 1.809 ms |
534+ | TUnit | 814.50 ms | 15.909 ms | 18.321 ms |
535+ | NUnit | 1,272.17 ms | 9.961 ms | 8.830 ms |
536+ | xUnit | 1,324.03 ms | 10.031 ms | 9.383 ms |
537+ | MSTest | 1,114.83 ms | 10.230 ms | 8.542 ms |
538538
539539
540540
@@ -551,13 +551,13 @@ AMD EPYC 7763 2.44GHz, 1 CPU, 4 logical and 2 physical cores
551551Job=.NET 9.0 Runtime=.NET 9.0
552552
553553```
554- | Method | Mean | Error | StdDev | Median |
555- | ---------- | ------------:| ----------:| ----------:| ------------: |
556- | TUnit_AOT | 57.44 ms | 2.484 ms | 7.284 ms | 54.77 ms |
557- | TUnit | 890.60 ms | 17.457 ms | 25.589 ms | 895.50 ms |
558- | NUnit | 1,337.23 ms | 10.973 ms | 9.727 ms | 1,340.59 ms |
559- | xUnit | 1,388.13 ms | 11.290 ms | 10.561 ms | 1,386.59 ms |
560- | MSTest | 1,194.59 ms | 10.101 ms | 9.448 ms | 1,193.55 ms |
554+ | Method | Mean | Error | StdDev |
555+ | ---------- | ------------:| ----------:| ----------:|
556+ | TUnit_AOT | 77.66 ms | 1.369 ms | 1.143 ms |
557+ | TUnit | 882.02 ms | 17.345 ms | 28.980 ms |
558+ | NUnit | 1,318.18 ms | 15.739 ms | 13.143 ms |
559+ | xUnit | 1,377.14 ms | 9.337 ms | 8.734 ms |
560+ | MSTest | 1,177.22 ms | 10.907 ms | 10.203 ms |
561561
562562
563563### Scenario: A test that takes 50ms to execute, repeated 100 times (including spawning a new process and initialising the test framework)
@@ -577,11 +577,11 @@ Job=.NET 9.0 Runtime=.NET 9.0
577577```
578578| Method | Mean | Error | StdDev |
579579| ---------- | ------------:| ----------:| ----------:|
580- | TUnit_AOT | 252.3 ms | 16.02 ms | 47.24 ms |
581- | TUnit | 646.1 ms | 23.80 ms | 70.16 ms |
582- | NUnit | 14,066.2 ms | 273.09 ms | 532.64 ms |
583- | xUnit | 14,449.1 ms | 282.10 ms | 413.50 ms |
584- | MSTest | 14,282.8 ms | 282.40 ms | 509.22 ms |
580+ | TUnit_AOT | 238.9 ms | 9.40 ms | 27.72 ms |
581+ | TUnit | 771.3 ms | 28.41 ms | 83.77 ms |
582+ | NUnit | 14,168.3 ms | 283.20 ms | 465.31 ms |
583+ | xUnit | 14,392.9 ms | 284.73 ms | 443.29 ms |
584+ | MSTest | 14,115.5 ms | 276.49 ms | 505.58 ms |
585585
586586
587587
@@ -600,11 +600,11 @@ Job=.NET 9.0 Runtime=.NET 9.0
600600```
601601| Method | Mean | Error | StdDev |
602602| ---------- | ------------:| ----------:| ----------:|
603- | TUnit_AOT | 75.22 ms | 0.744 ms | 0.621 ms |
604- | TUnit | 910.11 ms | 18.138 ms | 22.275 ms |
605- | NUnit | 6,309.50 ms | 12.289 ms | 10.893 ms |
606- | xUnit | 6,467.84 ms | 14.774 ms | 13.820 ms |
607- | MSTest | 6,286.71 ms | 11.789 ms | 10.451 ms |
603+ | TUnit_AOT | 73.98 ms | 0.352 ms | 0.294 ms |
604+ | TUnit | 892.20 ms | 16.946 ms | 21.432 ms |
605+ | NUnit | 6,275.08 ms | 10.495 ms | 9.817 ms |
606+ | xUnit | 6,425.93 ms | 14.618 ms | 13.673 ms |
607+ | MSTest | 6,247.14 ms | 14.274 ms | 13.352 ms |
608608
609609
610610
@@ -621,13 +621,13 @@ AMD EPYC 7763 2.44GHz, 1 CPU, 4 logical and 2 physical cores
621621Job=.NET 9.0 Runtime=.NET 9.0
622622
623623```
624- | Method | Mean | Error | StdDev |
625- | ---------- | -----------:| ---------:| ---------:|
626- | TUnit_AOT | 110.4 ms | 1.73 ms | 1.45 ms |
627- | TUnit | 945.6 ms | 18.49 ms | 25.92 ms |
628- | NUnit | 7,548.4 ms | 28.71 ms | 26.86 ms |
629- | xUnit | 7,598.8 ms | 34.96 ms | 32.71 ms |
630- | MSTest | 7,428.0 ms | 26.22 ms | 24.53 ms |
624+ | Method | Mean | Error | StdDev | Median |
625+ | ---------- | -----------:| ---------:| ---------:| -----------: |
626+ | TUnit_AOT | 111.8 ms | 2.18 ms | 3.65 ms | 109.5 ms |
627+ | TUnit | 965.0 ms | 18.40 ms | 21.18 ms | 965.1 ms |
628+ | NUnit | 7,536.3 ms | 17.95 ms | 16.79 ms | 7,536.0 ms |
629+ | xUnit | 7,581.7 ms | 19.73 ms | 18.45 ms | 7,580.8 ms |
630+ | MSTest | 7,464.9 ms | 14.36 ms | 11.21 ms | 7,461.2 ms |
631631
632632
633633
0 commit comments