[Perf] Windows/arm64: 3 Improvements on 9/28/2022 12:34:15 AM

[performanceautofiler]

Run Information

Architecture	arm64
OS	Windows 10.0.25094
Baseline	b2af65a406bc28c25f0a25ed87b4e48c98f52fef
Compare	cdb6e1d5f9075214c8a58ca75d5314b5dc64daed
Diff	Diff

Improvements in System.Tests.Perf_HashCode

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
Combine_4 - Duration of single invocation	128.57 μs	103.62 μs	0.81	0.64	False
Combine_2 - Duration of single invocation	87.67 μs	77.39 μs	0.88	0.63	False
Combine_1 - Duration of single invocation	72.33 μs	55.75 μs	0.77	0.67	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Tests.Perf_HashCode*'

Details

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

System.Tests.Perf_HashCode.Combine_4

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 103.62087320143887 < 116.15733861053718.
IsChangePoint: Marked as a change because one of 9/27/2022 6:39:02 PM, 9/29/2022 12:14:35 AM falls between 9/20/2022 9:08:11 AM and 9/29/2022 12:14:35 AM.
IsImprovementStdDev: Marked as improvement because 4.498080806655565 (T) = (0 -98701.23481315451) / Math.Sqrt((76281417.4049118 / (299)) + (41493245.532319084 / (3))) is greater than 1.9679030112610798 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (3) - 2, .975) and 0.14605934211817267 = (115583.24797179677 - 98701.23481315451) / 115583.24797179677 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_HashCode.Combine_2

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 77.38747826086957 < 83.45807686194819.
IsChangePoint: Marked as a change because one of 9/27/2022 1:53:10 PM, 9/29/2022 12:14:35 AM falls between 9/20/2022 9:08:11 AM and 9/29/2022 12:14:35 AM.
IsImprovementStdDev: Marked as improvement because 7.284310069285875 (T) = (0 -73100.90117179051) / Math.Sqrt((61148365.68752583 / (299)) + (18390469.046697963 / (4))) is greater than 1.9678765312856872 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (4) - 2, .975) and 0.17922772251109503 = (89063.56023066175 - 73100.90117179051) / 89063.56023066175 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_HashCode.Combine_1

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 55.74541215277779 < 68.64937959794209.
IsChangePoint: Marked as a change because one of 9/27/2022 6:39:02 PM, 9/29/2022 12:14:35 AM falls between 9/20/2022 9:08:11 AM and 9/29/2022 12:14:35 AM.
IsImprovementStdDev: Marked as improvement because 5.64312568437468 (T) = (0 -59069.32109210052) / Math.Sqrt((31099368.052836303 / (299)) + (13512983.95182167 / (3))) is greater than 1.9679030112610798 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (3) - 2, .975) and 0.1701817375488805 = (71183.44312840428 - 59069.32109210052) / 71183.44312840428 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

[performanceautofiler]

Run Information

Architecture	arm64
OS	ubuntu 20.04
Baseline	b2af65a406bc28c25f0a25ed87b4e48c98f52fef
Compare	cdb6e1d5f9075214c8a58ca75d5314b5dc64daed
Diff	Diff

Regressions in Benchstone.MDBenchI.MDArray2

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
Test - Duration of single invocation	1.83 secs	1.98 secs	1.08	0.01	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'Benchstone.MDBenchI.MDArray2*'

Details

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

Benchstone.MDBenchI.MDArray2.Test

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.9771834573846154 > 1.9167129977800001.
IsChangePoint: Marked as a change because one of 7/5/2022 7:51:46 PM, 9/27/2022 6:39:02 PM, 9/29/2022 12:14:35 AM falls between 9/20/2022 9:08:11 AM and 9/29/2022 12:14:35 AM.
IsRegressionStdDev: Marked as regression because -135.06266125900802 (T) = (0 -1976244022.3299148) / Math.Sqrt((53938333084848.8 / (47)) + (732884207859.3014 / (3))) is less than -2.010634757623041 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (47) + (3) - 2, .025) and -0.08770246575696423 = (1816897620.94507 - 1976244022.3299148) / 1816897620.94507 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

[performanceautofiler]

Run Information

Architecture	arm64
OS	ubuntu 20.04
Baseline	b2af65a406bc28c25f0a25ed87b4e48c98f52fef
Compare	cdb6e1d5f9075214c8a58ca75d5314b5dc64daed
Diff	Diff

Improvements in System.Tests.Perf_HashCode

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
Combine_5 - Duration of single invocation	104.16 μs	92.56 μs	0.89	0.00	False
Combine_4 - Duration of single invocation	86.29 μs	75.20 μs	0.87	0.00	False
Combine_2 - Duration of single invocation	66.72 μs	56.69 μs	0.85	0.00	False
Combine_1 - Duration of single invocation	53.35 μs	43.35 μs	0.81	0.00	False
Combine_3 - Duration of single invocation	80.04 μs	70.03 μs	0.87	0.00	False
Combine_8 - Duration of single invocation	118.77 μs	107.83 μs	0.91	0.00	False
Combine_6 - Duration of single invocation	120.95 μs	107.95 μs	0.89	0.00	False
Combine_7 - Duration of single invocation	133.44 μs	120.25 μs	0.90	0.00	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Tests.Perf_HashCode*'

Details

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

System.Tests.Perf_HashCode.Combine_5

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 92.56200142998026 < 98.95306877827379.
IsChangePoint: Marked as a change because one of 9/27/2022 6:39:02 PM, 9/29/2022 12:14:35 AM falls between 9/20/2022 9:08:11 AM and 9/29/2022 12:14:35 AM.
IsImprovementStdDev: Marked as improvement because 1246.632105206113 (T) = (0 -92557.77229871543) / Math.Sqrt((249.97503714852766 / (299)) + (257.758737148685 / (3))) is greater than 1.9679030112610798 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (3) - 2, .975) and 0.1114673334298659 = (104169.23967016536 - 92557.77229871543) / 104169.23967016536 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_HashCode.Combine_4

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 75.20390466746795 < 81.97478360273139.
IsChangePoint: Marked as a change because one of 9/27/2022 6:39:02 PM, 9/29/2022 12:14:35 AM falls between 9/20/2022 9:08:11 AM and 9/29/2022 12:14:35 AM.
IsImprovementStdDev: Marked as improvement because 1179.9066912558978 (T) = (0 -75210.90728293474) / Math.Sqrt((7578.985052685131 / (299)) + (188.9227511321674 / (3))) is greater than 1.9679030112610798 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (3) - 2, .975) and 0.12849113308680338 = (86299.6466683406 - 75210.90728293474) / 86299.6466683406 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_HashCode.Combine_2

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 56.69326219806762 < 63.36385388263046.
IsChangePoint: Marked as a change because one of 9/27/2022 6:39:02 PM, 9/29/2022 12:14:35 AM falls between 9/20/2022 9:08:11 AM and 9/29/2022 12:14:35 AM.
IsImprovementStdDev: Marked as improvement because 15412.67884555537 (T) = (0 -56694.025447479245) / Math.Sqrt((72.54142761019858 / (299)) + (0.536870349040916 / (3))) is greater than 1.9679030112610798 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (3) - 2, .975) and 0.15003038238792074 = (66701.23763571281 - 56694.025447479245) / 66701.23763571281 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_HashCode.Combine_1

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 43.34666105724838 < 50.6872702229369.
IsChangePoint: Marked as a change because one of 9/27/2022 6:39:02 PM, 9/29/2022 12:14:35 AM falls between 9/20/2022 9:08:11 AM and 9/29/2022 12:14:35 AM.
IsImprovementStdDev: Marked as improvement because 1606.1100555576545 (T) = (0 -43352.071435716476) / Math.Sqrt((2798.3475370829456 / (299)) + (88.44003604743443 / (3))) is greater than 1.9679030112610798 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (3) - 2, .975) and 0.18757780035166716 = (53361.505205645495 - 43352.071435716476) / 53361.505205645495 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_HashCode.Combine_3

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 70.03228493303573 < 76.0393019786352.
IsChangePoint: Marked as a change because one of 9/27/2022 6:39:02 PM, 9/29/2022 12:14:35 AM falls between 9/20/2022 9:08:11 AM and 9/29/2022 12:14:35 AM.
IsImprovementStdDev: Marked as improvement because 14131.60032675347 (T) = (0 -70032.533203125) / Math.Sqrt((145.54947421494887 / (299)) + (0.046228963972387016 / (3))) is greater than 1.9679030112610798 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (3) - 2, .975) and 0.1251074997243653 = (80047.01512592834 - 70032.533203125) / 80047.01512592834 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_HashCode.Combine_8

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 107.82524393678162 < 112.7922205694219.
IsChangePoint: Marked as a change because one of 9/27/2022 6:39:02 PM, 9/29/2022 12:14:35 AM falls between 9/20/2022 9:08:11 AM and 9/29/2022 12:14:35 AM.
IsImprovementStdDev: Marked as improvement because 747.3577788435249 (T) = (0 -107835.48133141763) / Math.Sqrt((2274.17571381007 / (299)) + (615.1112488611017 / (3))) is greater than 1.9679030112610798 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (3) - 2, .975) and 0.09178680502678542 = (118733.66510007373 - 107835.48133141763) / 118733.66510007373 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_HashCode.Combine_6

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 107.9533962130542 < 114.90420946714742.
IsChangePoint: Marked as a change because one of 9/27/2022 6:39:02 PM, 9/29/2022 12:14:35 AM falls between 9/20/2022 9:08:11 AM and 9/29/2022 12:14:35 AM.
IsImprovementStdDev: Marked as improvement because 437.0664627012697 (T) = (0 -107989.76157293377) / Math.Sqrt((3944.7141769577797 / (299)) + (2601.812890057562 / (3))) is greater than 1.9679030112610798 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (3) - 2, .975) and 0.1072176524629398 = (120958.66576086286 - 107989.76157293377) / 120958.66576086286 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_HashCode.Combine_7

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 120.25075182005494 < 126.77101559973921.
IsChangePoint: Marked as a change because one of 9/27/2022 6:39:02 PM, 9/29/2022 12:14:35 AM falls between 9/20/2022 9:08:11 AM and 9/29/2022 12:14:35 AM.
IsImprovementStdDev: Marked as improvement because 1983.1843919270882 (T) = (0 -120251.38136534939) / Math.Sqrt((10538.563393391829 / (299)) + (27.311702042982727 / (3))) is greater than 1.9679030112610798 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (3) - 2, .975) and 0.09896079784113743 = (133458.54550748816 - 120251.38136534939) / 133458.54550748816 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

### Run Information

Architecture	arm64
OS	ubuntu 20.04
Baseline	b2af65a406bc28c25f0a25ed87b4e48c98f52fef
Compare	cdb6e1d5f9075214c8a58ca75d5314b5dc64daed
Diff	Diff

Improvements in System.Buffers.Text.Tests.Base64EncodeDecodeInPlaceTests

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
Base64EncodeInPlace - Duration of single invocation	229.57 ms	191.70 ms	0.84	0.00	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Buffers.Text.Tests.Base64EncodeDecodeInPlaceTests*'

Details

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

System.Buffers.Text.Tests.Base64EncodeDecodeInPlaceTests.Base64EncodeInPlace(NumberOfBytes: 200000000)

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 191.7000837142857 < 218.09361305333329.
IsChangePoint: Marked as a change because one of 9/27/2022 6:39:02 PM, 9/29/2022 12:14:35 AM falls between 9/20/2022 9:08:11 AM and 9/29/2022 12:14:35 AM.
IsImprovementStdDev: Marked as improvement because 1342.3504808976215 (T) = (0 -191686064.37997556) / Math.Sqrt((28704370527.8369 / (299)) + (2096450393.6750095 / (3))) is greater than 1.9679030112610798 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (3) - 2, .975) and 0.16487687542743332 = (229530303.66400698 - 191686064.37997556) / 229530303.66400698 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	arm64
OS	ubuntu 20.04
Baseline	b2af65a406bc28c25f0a25ed87b4e48c98f52fef
Compare	cdb6e1d5f9075214c8a58ca75d5314b5dc64daed
Diff	Diff

Improvements in System.Globalization.Tests.StringHash

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
GetHashCode - Duration of single invocation	177.35 ns	166.78 ns	0.94	0.01	False
GetHashCode - Duration of single invocation	173.07 μs	163.78 μs	0.95	0.00	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Globalization.Tests.StringHash*'

Details

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

System.Globalization.Tests.StringHash.GetHashCode(Count: 128, Options: (en-US, OrdinalIgnoreCase))

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 166.7824348176412 < 168.4722167082727.
IsChangePoint: Marked as a change because one of 7/2/2022 7:35:06 PM, 7/6/2022 3:55:24 AM, 9/27/2022 6:39:02 PM, 9/29/2022 12:14:35 AM falls between 9/20/2022 9:08:11 AM and 9/29/2022 12:14:35 AM.
IsImprovementStdDev: Marked as improvement because 20.210250717628917 (T) = (0 -166.3328541152158) / Math.Sqrt((0.3423242447788745 / (299)) + (0.8562752650716605 / (3))) is greater than 1.9679030112610798 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (3) - 2, .975) and 0.061071889118082374 = (177.15185240218494 - 166.3328541152158) / 177.15185240218494 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Globalization.Tests.StringHash.GetHashCode(Count: 131072, Options: (en-US, OrdinalIgnoreCase))

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 163.77776692708335 < 164.41776637460754.
IsChangePoint: Marked as a change because one of 9/27/2022 6:39:02 PM, 9/29/2022 12:14:35 AM falls between 9/20/2022 9:08:11 AM and 9/29/2022 12:14:35 AM.
IsImprovementStdDev: Marked as improvement because 29.528149596311174 (T) = (0 -163173.8290943287) / Math.Sqrt((28387.76673580448 / (299)) + (338042.23681399703 / (3))) is greater than 1.9679030112610798 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (3) - 2, .975) and 0.05728909987500213 = (173089.99935472565 - 163173.8290943287) / 173089.99935472565 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

[performanceautofiler]

Run Information

Architecture	arm64
OS	Windows 10.0.19041
Baseline	b2af65a406bc28c25f0a25ed87b4e48c98f52fef
Compare	cdb6e1d5f9075214c8a58ca75d5314b5dc64daed
Diff	Diff

Improvements in Benchmark.GetChildKeysTests

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
AddChainedConfigurationEmpty - Duration of single invocation	39.29 ms	36.11 ms	0.92	0.02	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'Benchmark.GetChildKeysTests*'

Details

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

Benchmark.GetChildKeysTests.AddChainedConfigurationEmpty

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 36.11018333333333 < 37.32392664417989.
IsChangePoint: Marked as a change because one of 9/27/2022 6:39:02 PM, 9/29/2022 12:14:35 AM falls between 9/20/2022 9:08:11 AM and 9/29/2022 12:14:35 AM.
IsImprovementStdDev: Marked as improvement because 46.271353057494295 (T) = (0 -36096563.33333333) / Math.Sqrt((601095176868.1947 / (127)) + (607449959.8078725 / (3))) is greater than 1.9786708498375942 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (127) + (3) - 2, .975) and 0.08261593579782066 = (39347275.30363785 - 36096563.33333333) / 39347275.30363785 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

### Run Information

Architecture	arm64
OS	Windows 10.0.19041
Baseline	b2af65a406bc28c25f0a25ed87b4e48c98f52fef
Compare	cdb6e1d5f9075214c8a58ca75d5314b5dc64daed
Diff	Diff

Improvements in System.Tests.Perf_HashCode

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
Combine_3 - Duration of single invocation	76.35 μs	66.80 μs	0.87	0.00	False
Combine_6 - Duration of single invocation	115.32 μs	103.37 μs	0.90	0.00	False
Combine_1 - Duration of single invocation	50.87 μs	41.46 μs	0.81	0.00	False
Combine_4 - Duration of single invocation	82.29 μs	71.84 μs	0.87	0.00	False
Combine_2 - Duration of single invocation	63.63 μs	54.07 μs	0.85	0.00	False
Combine_8 - Duration of single invocation	112.88 μs	102.97 μs	0.91	0.00	False
Combine_7 - Duration of single invocation	127.33 μs	113.00 μs	0.89	0.00	False
Combine_5 - Duration of single invocation	99.35 μs	87.44 μs	0.88	0.00	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Tests.Perf_HashCode*'

Details

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

System.Tests.Perf_HashCode.Combine_3

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 66.79983796296297 < 72.52389786585366.
IsChangePoint: Marked as a change because one of 9/27/2022 6:39:02 PM, 9/29/2022 12:14:35 AM falls between 9/20/2022 9:08:11 AM and 9/29/2022 12:14:35 AM.
IsImprovementStdDev: Marked as improvement because 2342.08493714798 (T) = (0 -66795.99950233765) / Math.Sqrt((880.5250183329754 / (299)) + (40.99127881790004 / (3))) is greater than 1.9679030112610798 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (3) - 2, .975) and 0.12502959904670144 = (76340.86756484793 - 66795.99950233765) / 76340.86756484793 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_HashCode.Combine_6

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 103.36550164473684 < 109.60422135416664.
IsChangePoint: Marked as a change because one of 9/27/2022 6:39:02 PM, 9/29/2022 12:14:35 AM falls between 9/20/2022 9:08:11 AM and 9/29/2022 12:14:35 AM.
IsImprovementStdDev: Marked as improvement because 3200.916053190844 (T) = (0 -103370.5573177736) / Math.Sqrt((1250.6715161186055 / (299)) + (29.58917176689475 / (3))) is greater than 1.9679030112610798 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (3) - 2, .975) and 0.10398432984153634 = (115366.90792415732 - 103370.5573177736) / 115366.90792415732 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_HashCode.Combine_1

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 41.460978626810856 < 48.33551852666878.
IsChangePoint: Marked as a change because one of 9/27/2022 6:39:02 PM, 9/29/2022 12:14:35 AM falls between 9/20/2022 9:08:11 AM and 9/29/2022 12:14:35 AM.
IsImprovementStdDev: Marked as improvement because 231.339921619171 (T) = (0 -41379.72535439761) / Math.Sqrt((94.39478603806242 / (208)) + (5064.258976282072 / (3))) is greater than 1.9713794615474485 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (208) + (3) - 2, .975) and 0.18681370242108913 = (50885.910740991254 - 41379.72535439761) / 50885.910740991254 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_HashCode.Combine_4

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 71.84096903669723 < 78.18141183035713.
IsChangePoint: Marked as a change because one of 9/27/2022 6:39:02 PM, 9/29/2022 12:14:35 AM falls between 9/20/2022 9:08:11 AM and 9/29/2022 12:14:35 AM.
IsImprovementStdDev: Marked as improvement because 104.70810682784476 (T) = (0 -71950.47936090191) / Math.Sqrt((849.7880690963324 / (299)) + (29358.252882045846 / (3))) is greater than 1.9679030112610798 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (3) - 2, .975) and 0.12586187805091753 = (82310.19509877061 - 71950.47936090191) / 82310.19509877061 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_HashCode.Combine_2

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 54.07307958477508 < 60.435572662601615.
IsChangePoint: Marked as a change because one of 9/27/2022 6:39:02 PM, 9/29/2022 12:14:35 AM falls between 9/20/2022 9:08:11 AM and 9/29/2022 12:14:35 AM.
IsImprovementStdDev: Marked as improvement because 732.128466166073 (T) = (0 -54079.98943242455) / Math.Sqrt((579.9807150444534 / (299)) + (502.9359295563638 / (3))) is greater than 1.9679030112610798 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (3) - 2, .975) and 0.14987443141003703 = (63614.11940841023 - 54079.98943242455) / 63614.11940841023 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_HashCode.Combine_8

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 102.97331098178137 < 107.2682931654676.
IsChangePoint: Marked as a change because one of 9/27/2022 6:39:02 PM, 9/29/2022 12:14:35 AM falls between 9/20/2022 9:08:11 AM and 9/29/2022 12:14:35 AM.
IsImprovementStdDev: Marked as improvement because 67.89515587099245 (T) = (0 -103126.32680961218) / Math.Sqrt((4101.217834066228 / (299)) + (62319.529750445916 / (3))) is greater than 1.9679030112610798 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (3) - 2, .975) and 0.08669241395688282 = (112915.21978526913 - 103126.32680961218) / 112915.21978526913 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_HashCode.Combine_7

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 112.99861211031177 < 120.96474399457252.
IsChangePoint: Marked as a change because one of 9/27/2022 6:39:02 PM, 9/29/2022 12:14:35 AM falls between 9/20/2022 9:08:11 AM and 9/29/2022 12:14:35 AM.
IsImprovementStdDev: Marked as improvement because 394.23795741703043 (T) = (0 -112953.23825554941) / Math.Sqrt((1895.3070167530045 / (299)) + (3971.9833943696676 / (3))) is greater than 1.9679030112610798 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (3) - 2, .975) and 0.11292735710492913 = (127332.56871377816 - 112953.23825554941) / 127332.56871377816 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_HashCode.Combine_5

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 87.44384310986965 < 94.38297841790988.
IsChangePoint: Marked as a change because one of 9/27/2022 6:39:02 PM, 9/29/2022 12:14:35 AM falls between 9/20/2022 9:08:11 AM and 9/29/2022 12:14:35 AM.
IsImprovementStdDev: Marked as improvement because 3054.0078228139787 (T) = (0 -87437.87437926752) / Math.Sqrt((1111.989447019193 / (299)) + (34.473122345748976 / (3))) is greater than 1.9679030112610798 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (3) - 2, .975) and 0.11988760486096157 = (99348.53191728343 - 87437.87437926752) / 99348.53191728343 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	arm64
OS	Windows 10.0.19041
Baseline	b2af65a406bc28c25f0a25ed87b4e48c98f52fef
Compare	cdb6e1d5f9075214c8a58ca75d5314b5dc64daed
Diff	Diff

Improvements in System.Globalization.Tests.StringHash

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
GetHashCode - Duration of single invocation	164.99 μs	155.68 μs	0.94	0.00	False
GetHashCode - Duration of single invocation	169.15 ns	159.51 ns	0.94	0.01	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Globalization.Tests.StringHash*'

Details

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

System.Globalization.Tests.StringHash.GetHashCode(Count: 131072, Options: (en-US, OrdinalIgnoreCase))

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 155.6805295261669 < 156.7366108974359.
IsChangePoint: Marked as a change because one of 9/27/2022 6:39:02 PM, 9/29/2022 12:14:35 AM falls between 9/20/2022 9:08:11 AM and 9/29/2022 12:14:35 AM.
IsImprovementStdDev: Marked as improvement because 60.77356849366283 (T) = (0 -155367.7369165488) / Math.Sqrt((3159.9410461629764 / (299)) + (75302.49702832219 / (3))) is greater than 1.9679030112610798 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (3) - 2, .975) and 0.05836746390356571 = (164998.26732902665 - 155367.7369165488) / 164998.26732902665 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Globalization.Tests.StringHash.GetHashCode(Count: 128, Options: (en-US, OrdinalIgnoreCase))

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 159.50879340327756 < 160.64556962024324.
IsChangePoint: Marked as a change because one of 7/2/2022 7:35:06 PM, 7/6/2022 3:55:24 AM, 9/27/2022 6:39:02 PM, 9/29/2022 12:14:35 AM falls between 9/20/2022 9:08:11 AM and 9/29/2022 12:14:35 AM.
IsImprovementStdDev: Marked as improvement because 91.06993053809182 (T) = (0 -159.6628971152965) / Math.Sqrt((0.22336186448768053 / (299)) + (0.029377205763605155 / (3))) is greater than 1.9679030112610798 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (3) - 2, .975) and 0.05531785133826238 = (169.01229407317507 - 159.6628971152965) / 169.01229407317507 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	arm64
OS	Windows 10.0.19041
Baseline	b2af65a406bc28c25f0a25ed87b4e48c98f52fef
Compare	cdb6e1d5f9075214c8a58ca75d5314b5dc64daed
Diff	Diff

Improvements in System.Buffers.Text.Tests.Base64EncodeDecodeInPlaceTests

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
Base64EncodeInPlace - Duration of single invocation	218.31 ms	182.57 ms	0.84	0.00	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Buffers.Text.Tests.Base64EncodeDecodeInPlaceTests*'

Details

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

System.Buffers.Text.Tests.Base64EncodeDecodeInPlaceTests.Base64EncodeInPlace(NumberOfBytes: 200000000)

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 182.57496923076923 < 207.46430238095238.
IsChangePoint: Marked as a change because one of 9/27/2022 6:39:02 PM, 9/29/2022 12:14:35 AM falls between 9/20/2022 9:08:11 AM and 9/29/2022 12:14:35 AM.
IsImprovementStdDev: Marked as improvement because 502.38751080605164 (T) = (0 -182434991.96581197) / Math.Sqrt((21226796746.43577 / (299)) + (15138890039.79694 / (3))) is greater than 1.9679030112610798 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (3) - 2, .975) and 0.16457318966233778 = (218373398.73264962 - 182434991.96581197) / 218373398.73264962 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository