@@ -289,12 +289,12 @@ Apple M1 (Virtual), 1 CPU, 3 logical and 3 physical cores
289289Job=.NET 9.0 Runtime=.NET 9.0
290290
291291```
292- | Method | Mean | Error | StdDev |
293- | ------------- | ----------- :| ---------:| ---------:|
294- | Build_TUnit | 1,033.2 ms | 28.29 ms | 80.71 ms |
295- | Build_NUnit | 806.4 ms | 11.36 ms | 9.49 ms |
296- | Build_xUnit | 780.2 ms | 15.29 ms | 15.01 ms |
297- | Build_MSTest | 860.2 ms | 17.13 ms | 28.61 ms |
292+ | Method | Mean | Error | StdDev |
293+ | ------------- | ---------:| ---------:| ---------:|
294+ | Build_TUnit | 972.8 ms | 19.24 ms | 28.20 ms |
295+ | Build_NUnit | 810.1 ms | 15.35 ms | 13.61 ms |
296+ | Build_xUnit | 788.0 ms | 15.75 ms | 22.58 ms |
297+ | Build_MSTest | 823.4 ms | 13.34 ms | 11.83 ms |
298298
299299
300300
@@ -313,10 +313,10 @@ Job=.NET 9.0 Runtime=.NET 9.0
313313```
314314| Method | Mean | Error | StdDev |
315315| ------------- | --------:| ---------:| ---------:|
316- | Build_TUnit | 1.937 s | 0.0372 s | 0.0443 s |
317- | Build_NUnit | 1.497 s | 0.0155 s | 0.0145 s |
318- | Build_xUnit | 1.492 s | 0.0110 s | 0.0098 s |
319- | Build_MSTest | 1.527 s | 0.0240 s | 0.0224 s |
316+ | Build_TUnit | 1.885 s | 0.0368 s | 0.0409 s |
317+ | Build_NUnit | 1.442 s | 0.0132 s | 0.0117 s |
318+ | Build_xUnit | 1.429 s | 0.0094 s | 0.0088 s |
319+ | Build_MSTest | 1.461 s | 0.0094 s | 0.0083 s |
320320
321321
322322
@@ -335,10 +335,10 @@ Job=.NET 9.0 Runtime=.NET 9.0
335335```
336336| Method | Mean | Error | StdDev |
337337| ------------- | --------:| ---------:| ---------:|
338- | Build_TUnit | 2.036 s | 0.0397 s | 0.0516 s |
339- | Build_NUnit | 1.592 s | 0.0264 s | 0.0247 s |
340- | Build_xUnit | 1.587 s | 0.0289 s | 0.0271 s |
341- | Build_MSTest | 1.606 s | 0.0244 s | 0.0216 s |
338+ | Build_TUnit | 1.973 s | 0.0393 s | 0.0386 s |
339+ | Build_NUnit | 1.577 s | 0.0222 s | 0.0208 s |
340+ | Build_xUnit | 1.536 s | 0.0296 s | 0.0277 s |
341+ | Build_MSTest | 1.589 s | 0.0127 s | 0.0106 s |
342342
343343
344344### Scenario: A single test that completes instantly (including spawning a new process and initialising the test framework)
@@ -356,13 +356,13 @@ Apple M1 (Virtual), 1 CPU, 3 logical and 3 physical cores
356356Job=.NET 9.0 Runtime=.NET 9.0
357357
358358```
359- | Method | Mean | Error | StdDev |
360- | ---------- | ----------:| ----------:| ----------:|
361- | TUnit_AOT | 74.55 ms | 0.637 ms | 0.532 ms |
362- | TUnit | 473.61 ms | 8.172 ms | 6.824 ms |
363- | NUnit | 706.57 ms | 11.663 ms | 10.339 ms |
364- | xUnit | 735.63 ms | 14.611 ms | 21.417 ms |
365- | MSTest | 627.55 ms | 8.620 ms | 8.063 ms |
359+ | Method | Mean | Error | StdDev | Median |
360+ | ---------- | ----------:| ---------: | -------- -:| ----------:|
361+ | TUnit_AOT | 71.36 ms | 1.410 ms | 2.317 ms | 70.17 ms |
362+ | TUnit | 470.45 ms | 6.580 ms | 5.833 ms | 471.47 ms |
363+ | NUnit | 706.43 ms | 7.421 ms | 5.794 ms | 707.51 ms |
364+ | xUnit | 720.04 ms | 9.938 ms | 9.296 ms | 717.06 ms |
365+ | MSTest | 625.18 ms | 8.711 ms | 8.149 ms | 626.26 ms |
366366
367367
368368
@@ -381,11 +381,11 @@ Job=.NET 9.0 Runtime=.NET 9.0
381381```
382382| Method | Mean | Error | StdDev |
383383| ---------- | ------------:| ----------:| ----------:|
384- | TUnit_AOT | 26.19 ms | 0.618 ms | 1.822 ms |
385- | TUnit | 802.91 ms | 15.800 ms | 16.226 ms |
386- | NUnit | 1,276.56 ms | 8.989 ms | 8.408 ms |
387- | xUnit | 1,340.94 ms | 15.552 ms | 12.987 ms |
388- | MSTest | 1,137.70 ms | 17.369 ms | 15.397 ms |
384+ | TUnit_AOT | 25.10 ms | 0.695 ms | 2.049 ms |
385+ | TUnit | 786.82 ms | 15.252 ms | 20.877 ms |
386+ | NUnit | 1,259.92 ms | 21.225 ms | 19.853 ms |
387+ | xUnit | 1,288.83 ms | 20.029 ms | 18.735 ms |
388+ | MSTest | 1,104.15 ms | 21.997 ms | 20.576 ms |
389389
390390
391391
@@ -402,13 +402,13 @@ AMD EPYC 7763, 1 CPU, 4 logical and 2 physical cores
402402Job=.NET 9.0 Runtime=.NET 9.0
403403
404404```
405- | Method | Mean | Error | StdDev | Median |
406- | ---------- | ------------:| ----------:| ----------:| ------------: |
407- | TUnit_AOT | 59.48 ms | 2.295 ms | 6.766 ms | 57.45 ms |
408- | TUnit | 848.39 ms | 16.816 ms | 21.866 ms | 851.96 ms |
409- | NUnit | 1,295.08 ms | 8.461 ms | 7.914 ms | 1,298.54 ms |
410- | xUnit | 1,332.47 ms | 13.329 ms | 11.815 ms | 1,334.11 ms |
411- | MSTest | 1,145.93 ms | 7.210 ms | 6.392 ms | 1,145.01 ms |
405+ | Method | Mean | Error | StdDev |
406+ | ---------- | ------------:| ----------:| ----------:|
407+ | TUnit_AOT | 58.59 ms | 1.750 ms | 5.134 ms |
408+ | TUnit | 856.41 ms | 16.911 ms | 25.312 ms |
409+ | NUnit | 1,295.30 ms | 13.085 ms | 10.927 ms |
410+ | xUnit | 1,339.93 ms | 15.736 ms | 14.719 ms |
411+ | MSTest | 1,145.42 ms | 5.979 ms | 4.993 ms |
412412
413413
414414### Scenario: A test that takes 50ms to execute, repeated 100 times (including spawning a new process and initialising the test framework)
@@ -428,11 +428,11 @@ Job=.NET 9.0 Runtime=.NET 9.0
428428```
429429| Method | Mean | Error | StdDev |
430430| ---------- | ------------:| ----------:| ----------:|
431- | TUnit_AOT | 243.7 ms | 13.22 ms | 38.57 ms |
432- | TUnit | 646.5 ms | 23.49 ms | 68.52 ms |
433- | NUnit | 14,101 .3 ms | 281.41 ms | 581.15 ms |
434- | xUnit | 14,368.1 ms | 282 .80 ms | 517.11 ms |
435- | MSTest | 14,327.9 ms | 281.44 ms | 599.78 ms |
431+ | TUnit_AOT | 247.8 ms | 10.98 ms | 32.37 ms |
432+ | TUnit | 633.7 ms | 21.64 ms | 63.80 ms |
433+ | NUnit | 14,144 .3 ms | 281.26 ms | 568.16 ms |
434+ | xUnit | 14,440.8 ms | 288 .80 ms | 556.41 ms |
435+ | MSTest | 14,164.5 ms | 279.24 ms | 564.09 ms |
436436
437437
438438
@@ -449,13 +449,13 @@ AMD EPYC 7763, 1 CPU, 4 logical and 2 physical cores
449449Job=.NET 9.0 Runtime=.NET 9.0
450450
451451```
452- | Method | Mean | Error | StdDev | Median |
453- | ---------- | ------------:| ----------:| ----------:| ------------: |
454- | TUnit_AOT | 75.34 ms | 1.474 ms | 2.252 ms | 74.12 ms |
455- | TUnit | 874.94 ms | 17.026 ms | 18.925 ms | 875.78 ms |
456- | NUnit | 6,264.58 ms | 6.884 ms | 6.439 ms | 6,265.88 ms |
457- | xUnit | 6,401.00 ms | 10.440 ms | 9.766 ms | 6,400.99 ms |
458- | MSTest | 6,225.42 ms | 10.452 ms | 9.777 ms | 6,223.81 ms |
452+ | Method | Mean | Error | StdDev |
453+ | ---------- | ------------:| ----------:| ----------:|
454+ | TUnit_AOT | 74.42 ms | 0.465 ms | 0.389 ms |
455+ | TUnit | 892.33 ms | 17.793 ms | 20.491 ms |
456+ | NUnit | 6,298.27 ms | 14.285 ms | 13.362 ms |
457+ | xUnit | 6,457.61 ms | 21.735 ms | 20.331 ms |
458+ | MSTest | 6,281.13 ms | 15.469 ms | 14.470 ms |
459459
460460
461461
@@ -472,13 +472,13 @@ AMD EPYC 7763, 1 CPU, 4 logical and 2 physical cores
472472Job=.NET 9.0 Runtime=.NET 9.0
473473
474474```
475- | Method | Mean | Error | StdDev | Median |
476- | ---------- | -----------:| ---------:| ---------:| -----------: |
477- | TUnit_AOT | 109.4 ms | 1.21 ms | 0.95 ms | 109.2 ms |
478- | TUnit | 921.3 ms | 18.06 ms | 22.85 ms | 907.7 ms |
479- | NUnit | 7,487.3 ms | 19.78 ms | 18.50 ms | 7,488.5 ms |
480- | xUnit | 7,547.4 ms | 25.20 ms | 23.57 ms | 7,550.2 ms |
481- | MSTest | 7,425.2 ms | 25.38 ms | 23.74 ms | 7,427.1 ms |
475+ | Method | Mean | Error | StdDev |
476+ | ---------- | -----------:| ---------:| ---------:|
477+ | TUnit_AOT | 109.2 ms | 0.15 ms | 0.12 ms |
478+ | TUnit | 927.8 ms | 18.28 ms | 25.02 ms |
479+ | NUnit | 7,486.5 ms | 13.27 ms | 12.41 ms |
480+ | xUnit | 7,546.9 ms | 15.01 ms | 14.04 ms |
481+ | MSTest | 7,426.3 ms | 17.06 ms | 15.96 ms |
482482
483483
484484
0 commit comments