@@ -289,12 +289,12 @@ Apple M1 (Virtual), 1 CPU, 3 logical and 3 physical cores
289289Job=.NET 9.0 Runtime=.NET 9.0
290290
291291```
292- | Method | Mean | Error | StdDev |
293- | ------------- | --------:| ---------:| ---------:|
294- | Build_TUnit | 1.874 s | 0.0958 s | 0.2795 s |
295- | Build_NUnit | 1.287 s | 0.0412 s | 0.1210 s |
296- | Build_xUnit | 1.308 s | 0.0404 s | 0.1173 s |
297- | Build_MSTest | 1.406 s | 0.0426 s | 0.1250 s |
292+ | Method | Mean | Error | StdDev | Median |
293+ | ------------- | ----------- :| ---------:| ----------: | -- ---------:|
294+ | Build_TUnit | 1,196.3 ms | 87.14 ms | 255.57 ms | 1,108.9 ms |
295+ | Build_NUnit | 976.1 ms | 21.23 ms | 61.60 ms | 969.0 ms |
296+ | Build_xUnit | 1,033.8 ms | 30.35 ms | 87.07 ms | 1,012.0 ms |
297+ | Build_MSTest | 1,064.2 ms | 80.16 ms | 236.34 ms | 1,016.7 ms |
298298
299299
300300
@@ -313,10 +313,10 @@ Job=.NET 9.0 Runtime=.NET 9.0
313313```
314314| Method | Mean | Error | StdDev |
315315| ------------- | --------:| ---------:| ---------:|
316- | Build_TUnit | 1.861 s | 0.0231 s | 0.0204 s |
317- | Build_NUnit | 1.424 s | 0.0117 s | 0.0109 s |
318- | Build_xUnit | 1.438 s | 0.0142 s | 0.0126 s |
319- | Build_MSTest | 1.454 s | 0.0120 s | 0.0112 s |
316+ | Build_TUnit | 1.880 s | 0.0299 s | 0.0249 s |
317+ | Build_NUnit | 1.459 s | 0.0116 s | 0.0103 s |
318+ | Build_xUnit | 1.445 s | 0.0105 s | 0.0093 s |
319+ | Build_MSTest | 1.467 s | 0.0141 s | 0.0132 s |
320320
321321
322322
@@ -335,10 +335,10 @@ Job=.NET 9.0 Runtime=.NET 9.0
335335```
336336| Method | Mean | Error | StdDev |
337337| ------------- | --------:| ---------:| ---------:|
338- | Build_TUnit | 1.883 s | 0.0356 s | 0.0366 s |
339- | Build_NUnit | 1.457 s | 0.0106 s | 0.0088 s |
340- | Build_xUnit | 1.473 s | 0.0270 s | 0.0225 s |
341- | Build_MSTest | 1.500 s | 0.0141 s | 0.0131 s |
338+ | Build_TUnit | 1.928 s | 0.0372 s | 0.0330 s |
339+ | Build_NUnit | 1.504 s | 0.0167 s | 0.0140 s |
340+ | Build_xUnit | 1.498 s | 0.0279 s | 0.0233 s |
341+ | Build_MSTest | 1.527 s | 0.0233 s | 0.0218 s |
342342
343343
344344### Scenario: A single test that completes instantly (including spawning a new process and initialising the test framework)
@@ -356,13 +356,13 @@ Apple M1 (Virtual), 1 CPU, 3 logical and 3 physical cores
356356Job=.NET 9.0 Runtime=.NET 9.0
357357
358358```
359- | Method | Mean | Error | StdDev |
360- | ---------- | ----------:| ----------:| ----------:|
361- | TUnit_AOT | 66.19 ms | 0.391 ms | 0.346 ms |
362- | TUnit | 501.76 ms | 10.005 ms | 15.576 ms |
363- | NUnit | 700.61 ms | 4.639 ms | 4.112 ms |
364- | xUnit | 715.20 ms | 5.205 ms | 4.614 ms |
365- | MSTest | 617.98 ms | 3.197 ms | 2.670 ms |
359+ | Method | Mean | Error | StdDev | Median |
360+ | ---------- | ----------:| ----------:| -----------: | ---------- :|
361+ | TUnit_AOT | 79.11 ms | 1.554 ms | 1.454 ms | 78.67 ms |
362+ | TUnit | 576.59 ms | 36.021 ms | 106.209 ms | 542.81 ms |
363+ | NUnit | 748.01 ms | 14.432 ms | 26.024 ms | 746.05 ms |
364+ | xUnit | 720.94 ms | 6.845 ms | 6.403 ms | 720.02 ms |
365+ | MSTest | 628.81 ms | 8.047 ms | 6.282 ms | 630.57 ms |
366366
367367
368368
@@ -381,11 +381,11 @@ Job=.NET 9.0 Runtime=.NET 9.0
381381```
382382| Method | Mean | Error | StdDev |
383383| ---------- | ------------:| ----------:| ----------:|
384- | TUnit_AOT | 24.78 ms | 0.562 ms | 1.647 ms |
385- | TUnit | 810.22 ms | 15.765 ms | 17.522 ms |
386- | NUnit | 1,280.55 ms | 10.317 ms | 9.650 ms |
387- | xUnit | 1,334.41 ms | 11.679 ms | 10.925 ms |
388- | MSTest | 1,145.71 ms | 16.351 ms | 15.295 ms |
384+ | TUnit_AOT | 26.02 ms | 0.612 ms | 1.805 ms |
385+ | TUnit | 811.68 ms | 15.880 ms | 18.287 ms |
386+ | NUnit | 1,285.99 ms | 12.210 ms | 11.421 ms |
387+ | xUnit | 1,341.96 ms | 11.491 ms | 10.186 ms |
388+ | MSTest | 1,130.38 ms | 7.813 ms | 7.308 ms |
389389
390390
391391
@@ -404,11 +404,11 @@ Job=.NET 9.0 Runtime=.NET 9.0
404404```
405405| Method | Mean | Error | StdDev |
406406| ---------- | ------------:| ----------:| ----------:|
407- | TUnit_AOT | 56.53 ms | 1.723 ms | 5.082 ms |
408- | TUnit | 858.40 ms | 17.018 ms | 27.961 ms |
409- | NUnit | 1,313.50 ms | 22.551 ms | 19.991 ms |
410- | xUnit | 1,357.87 ms | 18.671 ms | 16.551 ms |
411- | MSTest | 1,154.28 ms | 13.186 ms | 12.334 ms |
407+ | TUnit_AOT | 56.95 ms | 1.909 ms | 5.599 ms |
408+ | TUnit | 852.71 ms | 16.888 ms | 25.790 ms |
409+ | NUnit | 1,310.94 ms | 11.451 ms | 10.711 ms |
410+ | xUnit | 1,360.91 ms | 16.567 ms | 15.496 ms |
411+ | MSTest | 1,166.01 ms | 15.708 ms | 14.693 ms |
412412
413413
414414### Scenario: A test that takes 50ms to execute, repeated 100 times (including spawning a new process and initialising the test framework)
@@ -428,11 +428,11 @@ Job=.NET 9.0 Runtime=.NET 9.0
428428```
429429| Method | Mean | Error | StdDev |
430430| ---------- | ------------:| ----------:| ----------:|
431- | TUnit_AOT | 246.6 ms | 14.68 ms | 43.27 ms |
432- | TUnit | 640.9 ms | 21.10 ms | 62.23 ms |
433- | NUnit | 14,260.7 ms | 283.90 ms | 533.23 ms |
434- | xUnit | 14,476.0 ms | 285.56 ms | 409.54 ms |
435- | MSTest | 14,455.3 ms | 258.04 ms | 228.75 ms |
431+ | TUnit_AOT | 242.8 ms | 15.84 ms | 46.69 ms |
432+ | TUnit | 676.1 ms | 26.68 ms | 78.68 ms |
433+ | NUnit | 13,799.6 ms | 275.92 ms | 524.96 ms |
434+ | xUnit | 14,225.4 ms | 284.10 ms | 617.61 ms |
435+ | MSTest | 14,176.5 ms | 280.68 ms | 476.61 ms |
436436
437437
438438
@@ -451,11 +451,11 @@ Job=.NET 9.0 Runtime=.NET 9.0
451451```
452452| Method | Mean | Error | StdDev |
453453| ---------- | ------------:| ----------:| ----------:|
454- | TUnit_AOT | 75.10 ms | 1.493 ms | 2.044 ms |
455- | TUnit | 896.80 ms | 17.246 ms | 16.938 ms |
456- | NUnit | 6,295.21 ms | 20.675 ms | 19.340 ms |
457- | xUnit | 6,435.26 ms | 18.831 ms | 17.614 ms |
458- | MSTest | 6,245.08 ms | 10.851 ms | 9.620 ms |
454+ | TUnit_AOT | 75.40 ms | 1.450 ms | 1.612 ms |
455+ | TUnit | 897.28 ms | 17.681 ms | 21.049 ms |
456+ | NUnit | 6,297.87 ms | 11.476 ms | 10.734 ms |
457+ | xUnit | 6,440.78 ms | 8.735 ms | 7.744 ms |
458+ | MSTest | 6,273.68 ms | 15.032 ms | 14.061 ms |
459459
460460
461461
@@ -472,13 +472,13 @@ AMD EPYC 7763, 1 CPU, 4 logical and 2 physical cores
472472Job=.NET 9.0 Runtime=.NET 9.0
473473
474474```
475- | Method | Mean | Error | StdDev |
476- | ---------- | -----------:| ---------:| ---------:|
477- | TUnit_AOT | 110 .7 ms | 2.15 ms | 2.39 ms |
478- | TUnit | 953.0 ms | 18.10 ms | 22.89 ms |
479- | NUnit | 7,523.8 ms | 24.16 ms | 22.60 ms |
480- | xUnit | 7,579.1 ms | 25.45 ms | 23.81 ms |
481- | MSTest | 7,436.2 ms | 26.15 ms | 24.46 ms |
475+ | Method | Mean | Error | StdDev | Median |
476+ | ---------- | -----------:| ---------:| ---------:| -----------: |
477+ | TUnit_AOT | 112 .7 ms | 2.25 ms | 4.54 ms | 109.5 ms |
478+ | TUnit | 928.8 ms | 17.98 ms | 24.60 ms | 923.5 ms |
479+ | NUnit | 7,489.2 ms | 22.25 ms | 19.73 ms | 7,488.3 ms |
480+ | xUnit | 7,547.4 ms | 21.40 ms | 18.97 ms | 7,545.9 ms |
481+ | MSTest | 7,430.8 ms | 43.95 ms | 41.11 ms | 7,433.7 ms |
482482
483483
484484
0 commit comments