-
Notifications
You must be signed in to change notification settings - Fork 4
Description
Run Information
Architecture | x86 |
---|---|
OS | Windows 10.0.18362 |
Baseline | b8acc97aba7662204c2a6de8f6090fc115a41c9f |
Compare | 842b6a87aaa6b6f25555541f541d5ee202d3972a |
Diff | Diff |
Improvements in System.Text.Json.Document.Tests.Perf_EnumerateObject
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
---|---|---|---|---|---|---|---|---|---|---|
PropertyIndexer - Duration of single invocation | 2.86 μs | 2.36 μs | 0.82 | 0.05 | True | |||||
PropertyIndexer - Duration of single invocation | 2.85 μs | 2.36 μs | 0.83 | 0.02 | True |
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Text.Json.Document.Tests.Perf_EnumerateObject*'
Payloads
Histogram
System.Text.Json.Document.Tests.Perf_EnumerateObject.PropertyIndexer(TestCase: NumericProperties)
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 2.355382273834677 < 2.723398237342985.
IsChangePoint: Marked as a change because one of 5/30/2022 12:57:05 PM, 6/7/2022 9:00:42 AM falls between 5/29/2022 5:15:01 PM and 6/7/2022 9:00:42 AM.
IsImprovementStdDev: Marked as improvement because 130.78842684180566 (T) = (0 -2350.6592209514642) / Math.Sqrt((2786.565924657786 / (299)) + (457.3859697638959 / (50))) is greater than 1.9668240032621265 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (50) - 2, .975) and 0.1929634280919092 = (2912.704706050383 - 2350.6592209514642) / 2912.704706050383 is greater than 0.05.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.
```#### System.Text.Json.Document.Tests.Perf_EnumerateObject.PropertyIndexer(TestCase: StringProperties)
```log
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 2.3588424386680775 < 2.710251370003351.
IsChangePoint: Marked as a change because one of 5/30/2022 12:57:05 PM, 6/7/2022 9:00:42 AM falls between 5/29/2022 5:15:01 PM and 6/7/2022 9:00:42 AM.
IsImprovementStdDev: Marked as improvement because 193.22620496466402 (T) = (0 -2349.6247377578684) / Math.Sqrt((2185.389977977836 / (299)) + (48.74692525222397 / (51))) is greater than 1.9668042230483112 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (51) - 2, .975) and 0.1912133308676919 = (2905.1229791888386 - 2349.6247377578684) / 2905.1229791888386 is greater than 0.05.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Architecture | x86 |
---|---|
OS | Windows 10.0.18362 |
Baseline | 9380113a892ec86d147e6e7506a10eda407a82be |
Compare | 842b6a87aaa6b6f25555541f541d5ee202d3972a |
Diff | Diff |
Improvements in System.Collections.IndexerSet<String>
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
---|---|---|---|---|---|---|---|---|---|---|
Dictionary - Duration of single invocation | 18.62 μs | 16.98 μs | 0.91 | 0.01 | True |
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.IndexerSet<String>*'
Payloads
Histogram
System.Collections.IndexerSet<String>.Dictionary(Size: 512)
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 16.978012213077623 < 17.574293707947717.
IsChangePoint: Marked as a change because one of 5/11/2022 7:02:26 PM, 5/30/2022 12:57:05 PM, 6/7/2022 9:00:42 AM falls between 5/29/2022 5:15:01 PM and 6/7/2022 9:00:42 AM.
IsImprovementStdDev: Marked as improvement because 67.52064008356919 (T) = (0 -16618.840575696697) / Math.Sqrt((130085.15368405252 / (299)) + (41334.59859162992 / (49))) is greater than 1.9668438982061167 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (49) - 2, .975) and 0.12685172644039958 = (19033.239919201773 - 16618.840575696697) / 19033.239919201773 is greater than 0.05.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Architecture | x86 |
---|---|
OS | Windows 10.0.18362 |
Baseline | 9380113a892ec86d147e6e7506a10eda407a82be |
Compare | 842b6a87aaa6b6f25555541f541d5ee202d3972a |
Diff | Diff |
Improvements in System.Drawing.Tests.Perf_Color
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
---|---|---|---|---|---|---|---|---|---|---|
GetBrightness - Duration of single invocation | 919.84 ns | 811.09 ns | 0.88 | 0.02 | False | |||||
GetSaturation - Duration of single invocation | 1.12 μs | 1.00 μs | 0.89 | 0.02 | False |
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Drawing.Tests.Perf_Color*'
Payloads
Histogram
System.Drawing.Tests.Perf_Color.GetBrightness
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 811.0875215889464 < 874.0381075811372.
IsChangePoint: Marked as a change because one of 4/20/2022 2:49:46 PM, 5/9/2022 11:56:12 AM, 5/15/2022 3:27:46 PM, 5/20/2022 10:18:01 PM, 5/30/2022 12:57:05 PM, 6/7/2022 9:00:42 AM falls between 5/29/2022 5:15:01 PM and 6/7/2022 9:00:42 AM.
IsImprovementStdDev: Marked as improvement because 20.03463645056563 (T) = (0 -836.659575041358) / Math.Sqrt((1326.0452731925202 / (299)) + (307.24878737050597 / (50))) is greater than 1.9668240032621265 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (50) - 2, .975) and 0.0722603067229467 = (901.8257827106943 - 836.659575041358) / 901.8257827106943 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Drawing.Tests.Perf_Color.GetSaturation
```log
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 1.0016902212360923 < 1.0645903327338126.
IsChangePoint: Marked as a change because one of 4/20/2022 2:49:46 PM, 5/9/2022 11:56:12 AM, 5/15/2022 3:27:46 PM, 5/30/2022 12:57:05 PM, 6/7/2022 9:00:42 AM falls between 5/29/2022 5:15:01 PM and 6/7/2022 9:00:42 AM.
IsImprovementStdDev: Marked as improvement because 23.487560744098523 (T) = (0 -1012.8832125887824) / Math.Sqrt((2601.0137607579554 / (299)) + (82.64480390161472 / (48))) is greater than 1.9668639088811137 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (48) - 2, .975) and 0.06964321313593592 = (1088.7040615922076 - 1012.8832125887824) / 1088.7040615922076 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Architecture | x86 |
---|---|
OS | Windows 10.0.18362 |
Baseline | b8acc97aba7662204c2a6de8f6090fc115a41c9f |
Compare | 842b6a87aaa6b6f25555541f541d5ee202d3972a |
Diff | Diff |
Improvements in System.Tests.Perf_Int32
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
---|---|---|---|---|---|---|---|---|---|---|
ToStringHex - Duration of single invocation | 27.20 ns | 24.63 ns | 0.91 | 0.03 | False |
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Tests.Perf_Int32*'
Payloads
Histogram
System.Tests.Perf_Int32.ToStringHex(value: 2147483647)
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 24.625041883891942 < 25.845249504883363.
IsChangePoint: Marked as a change because one of 4/3/2022 1:52:36 PM, 4/20/2022 2:49:46 PM, 5/30/2022 12:57:05 PM, 6/7/2022 9:00:42 AM falls between 5/29/2022 5:15:01 PM and 6/7/2022 9:00:42 AM.
IsImprovementStdDev: Marked as improvement because 42.810702581334695 (T) = (0 -24.665686843937102) / Math.Sqrt((1.2194679588997428 / (299)) + (0.04492684880258949 / (50))) is greater than 1.9668240032621265 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (50) - 2, .975) and 0.10908842247486325 = (27.685897754809645 - 24.665686843937102) / 27.685897754809645 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Architecture | x86 |
---|---|
OS | Windows 10.0.18362 |
Baseline | b8acc97aba7662204c2a6de8f6090fc115a41c9f |
Compare | 842b6a87aaa6b6f25555541f541d5ee202d3972a |
Diff | Diff |
Improvements in Microsoft.Extensions.Logging.ScopesOverheadBenchmark
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
---|---|---|---|---|---|---|---|---|---|---|
FilteredByLevel - Duration of single invocation | 8.11 ns | 6.75 ns | 0.83 | 0.07 | False | |||||
FilteredByLevel - Duration of single invocation | 8.10 ns | 6.75 ns | 0.83 | 0.08 | False |
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'Microsoft.Extensions.Logging.ScopesOverheadBenchmark*'
Payloads
Histogram
Microsoft.Extensions.Logging.ScopesOverheadBenchmark.FilteredByLevel(HasISupportLoggingScopeLogger: False, CaptureScopes: True)
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 6.745247781155662 < 7.703242226967085.
IsChangePoint: Marked as a change because one of 4/16/2022 5:36:25 PM, 4/26/2022 6:18:08 AM, 5/9/2022 11:56:12 AM, 5/30/2022 10:25:35 AM, 6/7/2022 9:00:42 AM falls between 5/29/2022 5:15:01 PM and 6/7/2022 9:00:42 AM.
IsImprovementStdDev: Marked as improvement because 18.09149982035637 (T) = (0 -7.223849945559164) / Math.Sqrt((0.1127447308778402 / (299)) + (0.040066458664195566 / (49))) is greater than 1.9668438982061167 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (49) - 2, .975) and 0.07966901040725963 = (7.8491868982438815 - 7.223849945559164) / 7.8491868982438815 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### Microsoft.Extensions.Logging.ScopesOverheadBenchmark.FilteredByLevel(HasISupportLoggingScopeLogger: True, CaptureScopes: True)
```log
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 6.74930984818137 < 7.717081285221746.
IsChangePoint: Marked as a change because one of 4/16/2022 5:36:25 PM, 4/26/2022 6:18:08 AM, 5/9/2022 11:56:12 AM, 5/30/2022 12:57:05 PM, 6/7/2022 9:00:42 AM falls between 5/29/2022 5:15:01 PM and 6/7/2022 9:00:42 AM.
IsImprovementStdDev: Marked as improvement because 19.66805011133366 (T) = (0 -7.21201767068903) / Math.Sqrt((0.10973002070236096 / (299)) + (0.036293524450426086 / (50))) is greater than 1.9668240032621265 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (50) - 2, .975) and 0.08269873841253488 = (7.862212745906445 - 7.21201767068903) / 7.862212745906445 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Architecture | x86 |
---|---|
OS | Windows 10.0.18362 |
Baseline | 9380113a892ec86d147e6e7506a10eda407a82be |
Compare | 842b6a87aaa6b6f25555541f541d5ee202d3972a |
Diff | Diff |
Improvements in System.IO.Tests.Perf_Path
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
---|---|---|---|---|---|---|---|---|---|---|
GetFileNameWithoutExtension - Duration of single invocation | 42.62 ns | 35.08 ns | 0.82 | 0.05 | False |
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.IO.Tests.Perf_Path*'
Payloads
Histogram
System.IO.Tests.Perf_Path.GetFileNameWithoutExtension
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 35.07861357284727 < 40.45642825445944.
IsChangePoint: Marked as a change because one of 5/11/2022 3:53:15 AM, 5/30/2022 12:57:05 PM, 6/7/2022 9:00:42 AM falls between 5/29/2022 5:15:01 PM and 6/7/2022 9:00:42 AM.
IsImprovementStdDev: Marked as improvement because 7.633147946394514 (T) = (0 -35.74955250193415) / Math.Sqrt((20.41565302302259 / (299)) + (0.36515324550705336 / (51))) is greater than 1.9668042230483112 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (51) - 2, .975) and 0.05539651300661293 = (37.84609414869164 - 35.74955250193415) / 37.84609414869164 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Architecture | x86 |
---|---|
OS | Windows 10.0.18362 |
Baseline | 9380113a892ec86d147e6e7506a10eda407a82be |
Compare | 842b6a87aaa6b6f25555541f541d5ee202d3972a |
Diff | Diff |
Improvements in System.Buffers.Tests.ReadOnlySequenceTests<Byte>
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
---|---|---|---|---|---|---|---|---|---|---|
IterateForEachTenSegments - Duration of single invocation | 81.40 ns | 76.10 ns | 0.93 | 0.00 | True |
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Buffers.Tests.ReadOnlySequenceTests<Byte>*'
Payloads
Histogram
System.Buffers.Tests.ReadOnlySequenceTests<Byte>.IterateForEachTenSegments
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 76.0984821342621 < 77.31032095116302.
IsChangePoint: Marked as a change because one of 5/30/2022 12:57:05 PM, 6/7/2022 9:00:42 AM falls between 5/29/2022 5:15:01 PM and 6/7/2022 9:00:42 AM.
IsImprovementStdDev: Marked as improvement because 88.14432238386792 (T) = (0 -76.71978980693149) / Math.Sqrt((0.8437794593003767 / (299)) + (0.1472012584956821 / (50))) is greater than 1.9668240032621265 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (50) - 2, .975) and 0.08024152741756299 = (83.41297426869332 - 76.71978980693149) / 83.41297426869332 is greater than 0.05.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Architecture | x86 |
---|---|
OS | Windows 10.0.18362 |
Baseline | 9380113a892ec86d147e6e7506a10eda407a82be |
Compare | 842b6a87aaa6b6f25555541f541d5ee202d3972a |
Diff | Diff |
Improvements in System.Memory.Span<Int32>
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
---|---|---|---|---|---|---|---|---|---|---|
BinarySearch - Duration of single invocation | 23.99 ns | 21.73 ns | 0.91 | 0.05 | True | |||||
IndexOfAnyFourValues - Duration of single invocation | 535.85 ns | 495.27 ns | 0.92 | 0.04 | False |
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Memory.Span<Int32>*'
Payloads
Histogram
System.Memory.Span<Int32>.BinarySearch(Size: 512)
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 21.730202314764348 < 23.353292676465962.
IsChangePoint: Marked as a change because one of 5/30/2022 12:57:05 PM, 6/7/2022 9:00:42 AM falls between 5/29/2022 5:15:01 PM and 6/7/2022 9:00:42 AM.
IsImprovementStdDev: Marked as improvement because 54.521199916918185 (T) = (0 -21.592440899339966) / Math.Sqrt((0.3230539906781484 / (299)) + (0.13435640490633807 / (50))) is greater than 1.9668240032621265 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (50) - 2, .975) and 0.13418923339330335 = (24.938984050712957 - 21.592440899339966) / 24.938984050712957 is greater than 0.05.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.
```#### System.Memory.Span<Int32>.IndexOfAnyFourValues(Size: 512)
```log
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 495.27016065840314 < 510.6289802620745.
IsChangePoint: Marked as a change because one of 4/16/2022 5:36:25 PM, 4/21/2022 3:06:05 PM, 5/9/2022 11:56:12 AM, 5/11/2022 9:09:01 PM, 5/15/2022 3:27:46 PM, 5/28/2022 5:31:50 AM, 5/31/2022 6:06:22 PM, 6/7/2022 9:00:42 AM falls between 5/29/2022 5:15:01 PM and 6/7/2022 9:00:42 AM.
IsImprovementStdDev: Marked as improvement because 24.43504658126752 (T) = (0 -498.286643309251) / Math.Sqrt((258.2985544848657 / (299)) + (19.161326283682964 / (42))) is greater than 1.9669864608404333 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (42) - 2, .975) and 0.05333742273829004 = (526.3614040290694 - 498.286643309251) / 526.3614040290694 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Architecture | x86 |
---|---|
OS | Windows 10.0.18362 |
Baseline | 9380113a892ec86d147e6e7506a10eda407a82be |
Compare | 842b6a87aaa6b6f25555541f541d5ee202d3972a |
Diff | Diff |
Improvements in System.IO.Tests.BinaryWriterExtendedTests
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
---|---|---|---|---|---|---|---|---|---|---|
WriteAsciiString - Duration of single invocation | 27.83 ns | 23.76 ns | 0.85 | 0.14 | True |
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.IO.Tests.BinaryWriterExtendedTests*'
Payloads
Histogram
System.IO.Tests.BinaryWriterExtendedTests.WriteAsciiString(StringLengthInChars: 32)
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 23.76085845093776 < 26.471264291430852.
IsChangePoint: Marked as a change because one of 5/30/2022 12:57:05 PM, 6/7/2022 9:00:42 AM falls between 5/29/2022 5:15:01 PM and 6/7/2022 9:00:42 AM.
IsImprovementStdDev: Marked as improvement because 36.58048756281361 (T) = (0 -23.534179315990833) / Math.Sqrt((0.5199225913450972 / (299)) + (0.4749052580435545 / (50))) is greater than 1.9668240032621265 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (50) - 2, .975) and 0.14146057384971875 = (27.411879523714898 - 23.534179315990833) / 27.411879523714898 is greater than 0.05.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Architecture | x86 |
---|---|
OS | Windows 10.0.18362 |
Baseline | 9380113a892ec86d147e6e7506a10eda407a82be |
Compare | 842b6a87aaa6b6f25555541f541d5ee202d3972a |
Diff | Diff |
Improvements in System.Collections.CreateAddAndClear<Int32>
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
---|---|---|---|---|---|---|---|---|---|---|
IDictionary - Duration of single invocation | 13.40 μs | 12.26 μs | 0.91 | 0.32 | False |
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.CreateAddAndClear<Int32>*'
Payloads
Histogram
System.Collections.CreateAddAndClear<Int32>.IDictionary(Size: 512)
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 12.255830115830117 < 12.689643887442294.
IsChangePoint: Marked as a change because one of 5/30/2022 12:57:05 PM, 6/7/2022 9:00:42 AM falls between 5/29/2022 5:15:01 PM and 6/7/2022 9:00:42 AM.
IsImprovementStdDev: Marked as improvement because 29.685210625297355 (T) = (0 -12013.520578764024) / Math.Sqrt((254917.10380785752 / (299)) + (47701.5515588168 / (50))) is greater than 1.9668240032621265 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (50) - 2, .975) and 0.09504463177505788 = (13275.263068860937 - 12013.520578764024) / 13275.263068860937 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Architecture | x86 |
---|---|
OS | Windows 10.0.18362 |
Baseline | 9380113a892ec86d147e6e7506a10eda407a82be |
Compare | 842b6a87aaa6b6f25555541f541d5ee202d3972a |
Diff | Diff |
Improvements in System.Collections.Tests.Perf_PriorityQueue<String, String>
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
---|---|---|---|---|---|---|---|---|---|---|
Enumerate - Duration of single invocation | 5.94 μs | 5.32 μs | 0.90 | 0.07 | False |
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.Tests.Perf_PriorityQueue<String, String>*'
Payloads
Histogram
System.Collections.Tests.Perf_PriorityQueue<String, String>.Enumerate(Size: 1000)
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 5.3233647075525266 < 5.568666446413161.
IsChangePoint: Marked as a change because one of 3/31/2022 5:34:47 PM, 4/16/2022 5:36:25 PM, 5/30/2022 12:57:05 PM, 6/7/2022 9:00:42 AM falls between 5/29/2022 5:15:01 PM and 6/7/2022 9:00:42 AM.
IsImprovementStdDev: Marked as improvement because 20.22030899035465 (T) = (0 -5348.529026046659) / Math.Sqrt((50864.330981286366 / (299)) + (18263.702382193784 / (51))) is greater than 1.9668042230483112 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (51) - 2, .975) and 0.0799426391097207 = (5813.256057069352 - 5348.529026046659) / 5813.256057069352 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Architecture | x86 |
---|---|
OS | Windows 10.0.18362 |
Baseline | 9380113a892ec86d147e6e7506a10eda407a82be |
Compare | 842b6a87aaa6b6f25555541f541d5ee202d3972a |
Diff | Diff |
Improvements in System.Collections.ContainsKeyTrue<Int32, Int32>
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
---|---|---|---|---|---|---|---|---|---|---|
Dictionary - Duration of single invocation | 6.25 μs | 4.35 μs | 0.70 | 0.06 | False |
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.ContainsKeyTrue<Int32, Int32>*'
Payloads
Histogram
System.Collections.ContainsKeyTrue<Int32, Int32>.Dictionary(Size: 512)
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 4.35249255952381 < 5.887487470001849.
IsChangePoint: Marked as a change because one of 4/21/2022 3:06:05 PM, 5/30/2022 12:57:05 PM, 6/7/2022 9:00:42 AM falls between 5/29/2022 5:15:01 PM and 6/7/2022 9:00:42 AM.
IsImprovementStdDev: Marked as improvement because 28.833020568264956 (T) = (0 -4346.1897166239205) / Math.Sqrt((459695.2357854909 / (299)) + (16540.05410486407 / (50))) is greater than 1.9668240032621265 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (50) - 2, .975) and 0.22284617031469303 = (5592.444572246171 - 4346.1897166239205) / 5592.444572246171 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Architecture | x86 |
---|---|
OS | Windows 10.0.18362 |
Baseline | 9380113a892ec86d147e6e7506a10eda407a82be |
Compare | 842b6a87aaa6b6f25555541f541d5ee202d3972a |
Diff | Diff |
Improvements in System.Collections.IterateForEach<String>
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
---|---|---|---|---|---|---|---|---|---|---|
Dictionary - Duration of single invocation | 4.02 μs | 3.42 μs | 0.85 | 0.08 | False |
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.IterateForEach<String>*'
Payloads
Histogram
System.Collections.IterateForEach<String>.Dictionary(Size: 512)
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 3.4229667706528804 < 3.634838058346579.
IsChangePoint: Marked as a change because one of 4/21/2022 5:54:30 PM, 4/25/2022 5:27:54 PM, 5/28/2022 5:31:50 AM, 5/30/2022 12:57:05 PM, 6/7/2022 9:00:42 AM falls between 5/29/2022 5:15:01 PM and 6/7/2022 9:00:42 AM.
IsImprovementStdDev: Marked as improvement because 13.771288030567385 (T) = (0 -3299.2980132709195) / Math.Sqrt((73463.8013495745 / (299)) + (19025.366712752806 / (49))) is greater than 1.9668438982061167 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (49) - 2, .975) and 0.09510155065441364 = (3646.0422886755296 - 3299.2980132709195) / 3646.0422886755296 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository