[Perf] Windows/x86: 2 Improvements on 5/4/2023 5:13:34 PM #17546
Description
Run Information
| Name | Value |
|---|---|
| Architecture | x86 |
| OS | Windows 10.0.18362 |
| Queue | TigerWindows |
| Baseline | cb5fe56312c40244524f2bd5d89006279e52d1da |
| Compare | 754d9ecdafb293c6532fc2f00cd701e6b2c485a8 |
| Diff | Diff |
| Configs | CompilationMode:tiered, RunKind:micro |
Improvements in System.Memory.ReadOnlySequence
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| Slice_Start - Duration of single invocation | 14.77 ns | 4.18 ns | 0.28 | 0.00 | True | Trace | Trace |
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Payloads
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Memory.ReadOnlySequence*'Payloads
Histogram
System.Memory.ReadOnlySequence.Slice_Start(Segment: Multiple)
Description of detection logic
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 4.177366046298244 < 14.030420442184878.
IsChangePoint: Marked as a change because one of 5/4/2023 10:11:14 AM, 5/9/2023 9:55:32 AM falls between 4/30/2023 6:17:41 PM and 5/9/2023 9:55:32 AM.
IsImprovementStdDev: Marked as improvement because 1425.2970113115114 (T) = (0 -4.19731710059609) / Math.Sqrt((0.011606864032471574 / (299)) + (0.00016616599082140855 / (10))) is greater than 1.9677212881555053 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (10) - 2, .975) and 0.7165769861066682 = (14.809372897910748 - 4.19731710059609) / 14.809372897910748 is greater than 0.05.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.
JIT Disasms
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
| Name | Value |
|---|---|
| Architecture | x86 |
| OS | Windows 10.0.18362 |
| Queue | TigerWindows |
| Baseline | cb5fe56312c40244524f2bd5d89006279e52d1da |
| Compare | 46693f249bdab5c0d4d008df1cea67d51a38d144 |
| Diff | Diff |
| Configs | CompilationMode:tiered, RunKind:micro |
Improvements in System.Buffers.Binary.Tests.BinaryReadAndWriteTests
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| ReadStructAndReverseLE - Duration of single invocation | 7.13 ns | 0.90 ns | 0.13 | 0.38 | False | Trace | Trace |
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Payloads
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Buffers.Binary.Tests.BinaryReadAndWriteTests*'Payloads
Histogram
System.Buffers.Binary.Tests.BinaryReadAndWriteTests.ReadStructAndReverseLE
Description of detection logic
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 0.8977454609793709 < 6.778227640598473.
IsChangePoint: Marked as a change because one of 3/17/2023 10:06:19 AM, 5/4/2023 10:11:14 AM, 5/9/2023 9:55:32 AM falls between 4/30/2023 6:17:41 PM and 5/9/2023 9:55:32 AM.
IsImprovementStdDev: Marked as improvement because 45.38434206143843 (T) = (0 -0.8581426464537248) / Math.Sqrt((3.516540092493875 / (299)) + (0.0032364168876836447 / (15))) is greater than 1.9675964973877862 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (15) - 2, .975) and 0.8526776722409515 = (5.824932713914561 - 0.8581426464537248) / 5.824932713914561 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
JIT Disasms
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository