[Perf] Linux/arm64: 1 Regression on 11/10/2022 6:24:39 PM

[performanceautofiler]

Run Information

Architecture	arm64
OS	ubuntu 20.04
Baseline	af494f4060cdc03782d0b4cf68bf073a4d979260
Compare	4820105ba85531da5b388e7b2e98fdcdae9ced07
Diff	Diff

Regressions in System.Collections.IterateForEach<Int32>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
ConcurrentQueue - Duration of single invocation	5.75 μs	8.85 μs	1.54	0.30	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.IterateForEach<Int32>*'

Related Issues

Regressions

Improvements

Details

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

System.Collections.IterateForEach<Int32>.ConcurrentQueue(Size: 512)

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 8.848617223011363 > 6.059765311364238.
IsChangePoint: Marked as a change because one of 11/10/2022 12:18:51 PM, 11/16/2022 10:12:48 PM falls between 11/8/2022 2:29:58 AM and 11/16/2022 10:12:48 PM.
IsRegressionStdDev: Marked as regression because -16.157857994099114 (T) = (0 -7740.350844881171) / Math.Sqrt((96083.54353953287 / (17)) + (152054.13838064845 / (19))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (17) + (19) - 2, .025) and -0.32262979548243903 = (5852.242911296143 - 7740.350844881171) / 5852.242911296143 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

[LoopedBard3]

@VSadov would you consider this to be by design/acceptable due to this change dotnet/runtime#78142? Similar to dotnet/runtime#78407.

Same question with this regression in mind: #9848.

[VSadov]

Yes. This is either noise or a regression due to the bug fix that must be acceptable.