Skip to content

Commit 603d5eb

Browse files
github-actions[bot]thomhurst
github-actions[bot]
and
thomhurst
authored
Update README.md (#2644)
Co-authored-by: thomhurst <[email protected]>
1 parent ab17339 commit 603d5eb

File tree

1 file changed

+46
-46
lines changed

1 file changed

+46
-46
lines changed

‎README.md‎

Lines changed: 46 additions & 46 deletions
Original file line numberDiff line numberDiff line change
@@ -440,10 +440,10 @@ Job=.NET 9.0 Runtime=.NET 9.0
440440
```
441441
| Method | Mean | Error | StdDev |
442442
|------------- |---------:|---------:|---------:|
443-
| Build_TUnit | 996.3 ms | 19.88 ms | 48.75 ms |
444-
| Build_NUnit | 823.5 ms | 14.06 ms | 24.26 ms |
445-
| Build_xUnit | 772.0 ms | 8.66 ms | 7.23 ms |
446-
| Build_MSTest | 846.3 ms | 16.79 ms | 23.54 ms |
443+
| Build_TUnit | 988.1 ms | 19.63 ms | 49.60 ms |
444+
| Build_NUnit | 823.6 ms | 16.11 ms | 20.95 ms |
445+
| Build_xUnit | 784.1 ms | 15.05 ms | 17.33 ms |
446+
| Build_MSTest | 842.5 ms | 10.15 ms | 9.00 ms |
447447

448448

449449

@@ -462,10 +462,10 @@ Job=.NET 9.0 Runtime=.NET 9.0
462462
```
463463
| Method | Mean | Error | StdDev |
464464
|------------- |--------:|---------:|---------:|
465-
| Build_TUnit | 1.906 s | 0.0380 s | 0.0545 s |
466-
| Build_NUnit | 1.456 s | 0.0189 s | 0.0177 s |
467-
| Build_xUnit | 1.451 s | 0.0125 s | 0.0111 s |
468-
| Build_MSTest | 1.469 s | 0.0115 s | 0.0107 s |
465+
| Build_TUnit | 1.989 s | 0.0393 s | 0.0497 s |
466+
| Build_NUnit | 1.520 s | 0.0128 s | 0.0119 s |
467+
| Build_xUnit | 1.503 s | 0.0109 s | 0.0085 s |
468+
| Build_MSTest | 1.535 s | 0.0176 s | 0.0165 s |
469469

470470

471471

@@ -484,10 +484,10 @@ Job=.NET 9.0 Runtime=.NET 9.0
484484
```
485485
| Method | Mean | Error | StdDev |
486486
|------------- |--------:|---------:|---------:|
487-
| Build_TUnit | 1.961 s | 0.0386 s | 0.0554 s |
488-
| Build_NUnit | 1.553 s | 0.0271 s | 0.0254 s |
489-
| Build_xUnit | 1.528 s | 0.0164 s | 0.0137 s |
490-
| Build_MSTest | 1.569 s | 0.0165 s | 0.0137 s |
487+
| Build_TUnit | 1.936 s | 0.0383 s | 0.0585 s |
488+
| Build_NUnit | 1.525 s | 0.0133 s | 0.0124 s |
489+
| Build_xUnit | 1.504 s | 0.0217 s | 0.0192 s |
490+
| Build_MSTest | 1.547 s | 0.0307 s | 0.0272 s |
491491

492492

493493
### Scenario: A single test that completes instantly (including spawning a new process and initialising the test framework)
@@ -505,13 +505,13 @@ Apple M1 (Virtual), 1 CPU, 3 logical and 3 physical cores
505505
Job=.NET 9.0 Runtime=.NET 9.0
506506
507507
```
508-
| Method | Mean | Error | StdDev |
509-
|---------- |----------:|---------:|---------:|
510-
| TUnit_AOT | 70.66 ms | 0.855 ms | 0.800 ms |
511-
| TUnit | 478.89 ms | 4.367 ms | 3.647 ms |
512-
| NUnit | 706.56 ms | 9.634 ms | 8.045 ms |
513-
| xUnit | 720.40 ms | 9.537 ms | 8.921 ms |
514-
| MSTest | 626.29 ms | 9.566 ms | 8.480 ms |
508+
| Method | Mean | Error | StdDev |
509+
|---------- |----------:|----------:|----------:|
510+
| TUnit_AOT | 74.75 ms | 0.390 ms | 0.325 ms |
511+
| TUnit | 490.04 ms | 8.961 ms | 8.382 ms |
512+
| NUnit | 723.16 ms | 12.698 ms | 11.257 ms |
513+
| xUnit | 735.73 ms | 8.006 ms | 7.097 ms |
514+
| MSTest | 644.11 ms | 6.755 ms | 6.318 ms |
515515

516516

517517

@@ -530,11 +530,11 @@ Job=.NET 9.0 Runtime=.NET 9.0
530530
```
531531
| Method | Mean | Error | StdDev |
532532
|---------- |------------:|----------:|----------:|
533-
| TUnit_AOT | 26.93 ms | 0.623 ms | 1.807 ms |
534-
| TUnit | 809.76 ms | 15.895 ms | 15.611 ms |
535-
| NUnit | 1,279.12 ms | 8.892 ms | 8.317 ms |
536-
| xUnit | 1,331.71 ms | 11.166 ms | 10.445 ms |
537-
| MSTest | 1,124.72 ms | 9.222 ms | 7.701 ms |
533+
| TUnit_AOT | 27.38 ms | 0.667 ms | 1.944 ms |
534+
| TUnit | 819.53 ms | 16.184 ms | 20.468 ms |
535+
| NUnit | 1,277.88 ms | 15.071 ms | 14.098 ms |
536+
| xUnit | 1,325.67 ms | 6.565 ms | 5.482 ms |
537+
| MSTest | 1,119.53 ms | 9.595 ms | 8.975 ms |
538538

539539

540540

@@ -551,13 +551,13 @@ AMD EPYC 7763 2.44GHz, 1 CPU, 4 logical and 2 physical cores
551551
Job=.NET 9.0 Runtime=.NET 9.0
552552
553553
```
554-
| Method | Mean | Error | StdDev |
555-
|---------- |------------:|----------:|----------:|
556-
| TUnit_AOT | 54.78 ms | 1.365 ms | 3.916 ms |
557-
| TUnit | 882.17 ms | 17.505 ms | 26.201 ms |
558-
| NUnit | 1,358.25 ms | 22.774 ms | 28.802 ms |
559-
| xUnit | 1,401.37 ms | 27.676 ms | 25.888 ms |
560-
| MSTest | 1,183.35 ms | 16.903 ms | 15.811 ms |
554+
| Method | Mean | Error | StdDev | Median |
555+
|---------- |------------:|----------:|----------:|------------:|
556+
| TUnit_AOT | 57.44 ms | 2.484 ms | 7.284 ms | 54.77 ms |
557+
| TUnit | 890.60 ms | 17.457 ms | 25.589 ms | 895.50 ms |
558+
| NUnit | 1,337.23 ms | 10.973 ms | 9.727 ms | 1,340.59 ms |
559+
| xUnit | 1,388.13 ms | 11.290 ms | 10.561 ms | 1,386.59 ms |
560+
| MSTest | 1,194.59 ms | 10.101 ms | 9.448 ms | 1,193.55 ms |
561561

562562

563563
### Scenario: A test that takes 50ms to execute, repeated 100 times (including spawning a new process and initialising the test framework)
@@ -577,11 +577,11 @@ Job=.NET 9.0 Runtime=.NET 9.0
577577
```
578578
| Method | Mean | Error | StdDev |
579579
|---------- |------------:|----------:|----------:|
580-
| TUnit_AOT | 246.8 ms | 10.98 ms | 32.37 ms |
581-
| TUnit | 655.8 ms | 22.11 ms | 65.20 ms |
582-
| NUnit | 14,193.3 ms | 266.33 ms | 531.88 ms |
583-
| xUnit | 14,360.3 ms | 285.99 ms | 537.16 ms |
584-
| MSTest | 14,287.4 ms | 284.77 ms | 575.26 ms |
580+
| TUnit_AOT | 252.3 ms | 16.02 ms | 47.24 ms |
581+
| TUnit | 646.1 ms | 23.80 ms | 70.16 ms |
582+
| NUnit | 14,066.2 ms | 273.09 ms | 532.64 ms |
583+
| xUnit | 14,449.1 ms | 282.10 ms | 413.50 ms |
584+
| MSTest | 14,282.8 ms | 282.40 ms | 509.22 ms |
585585

586586

587587

@@ -600,11 +600,11 @@ Job=.NET 9.0 Runtime=.NET 9.0
600600
```
601601
| Method | Mean | Error | StdDev |
602602
|---------- |------------:|----------:|----------:|
603-
| TUnit_AOT | 73.74 ms | 0.434 ms | 0.362 ms |
604-
| TUnit | 891.83 ms | 17.107 ms | 16.802 ms |
605-
| NUnit | 6,269.02 ms | 8.872 ms | 8.299 ms |
606-
| xUnit | 6,409.66 ms | 10.871 ms | 10.169 ms |
607-
| MSTest | 6,242.22 ms | 11.491 ms | 10.748 ms |
603+
| TUnit_AOT | 75.22 ms | 0.744 ms | 0.621 ms |
604+
| TUnit | 910.11 ms | 18.138 ms | 22.275 ms |
605+
| NUnit | 6,309.50 ms | 12.289 ms | 10.893 ms |
606+
| xUnit | 6,467.84 ms | 14.774 ms | 13.820 ms |
607+
| MSTest | 6,286.71 ms | 11.789 ms | 10.451 ms |
608608

609609

610610

@@ -623,11 +623,11 @@ Job=.NET 9.0 Runtime=.NET 9.0
623623
```
624624
| Method | Mean | Error | StdDev |
625625
|---------- |-----------:|---------:|---------:|
626-
| TUnit_AOT | 112.4 ms | 2.24 ms | 3.42 ms |
627-
| TUnit | 956.8 ms | 18.62 ms | 26.70 ms |
628-
| NUnit | 7,552.8 ms | 49.11 ms | 45.94 ms |
629-
| xUnit | 7,683.9 ms | 61.00 ms | 57.06 ms |
630-
| MSTest | 7,577.2 ms | 43.62 ms | 40.80 ms |
626+
| TUnit_AOT | 110.4 ms | 1.73 ms | 1.45 ms |
627+
| TUnit | 945.6 ms | 18.49 ms | 25.92 ms |
628+
| NUnit | 7,548.4 ms | 28.71 ms | 26.86 ms |
629+
| xUnit | 7,598.8 ms | 34.96 ms | 32.71 ms |
630+
| MSTest | 7,428.0 ms | 26.22 ms | 24.53 ms |
631631

632632

633633

0 commit comments

Comments
 (0)