[Perf] Windows/arm64: 1 Regression on 9/27/2022 6:39:02 PM #8757
Description
Run Information
| Architecture | arm64 |
|---|---|
| OS | Windows 10.0.19041 |
| Baseline | 007563949e53bad52dfcdf95927b0ce00101df4d |
| Compare | 6c2cfa4ae26ab71ea42a2cf12b3ae37bb6d134c5 |
| Diff | Diff |
Regressions in PerfLabTests.CastingPerf
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| ObjObjIsFoo - Duration of single invocation | 821.62 μs | 1.41 ms | 1.72 | 0.34 | False |
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'PerfLabTests.CastingPerf*'Payloads
Histogram
Edge Detector Info
PerfLabTests.CastingPerf.ObjObjIsFoo
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.4112518749999998 > 862.0413136101973.
IsChangePoint: Marked as a change because one of 8/31/2022 1:36:07 AM, 9/2/2022 3:08:54 AM, 9/14/2022 9:08:24 AM, 9/15/2022 1:10:12 AM, 9/27/2022 1:53:10 PM, 9/29/2022 12:14:35 AM falls between 9/20/2022 9:08:11 AM and 9/29/2022 12:14:35 AM.
IsRegressionStdDev: Marked as regression because -4.8010479597641025 (T) = (0 -1334448.252003205) / Math.Sqrt((6667549710.146962 / (46)) + (36119569605.4197 / (4))) is less than -2.010634757623041 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (46) + (4) - 2, .025) and -0.5258195173842835 = (874578.0459610671 - 1334448.252003205) / 874578.0459610671 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository