Thanks to visit codestin.com
Credit goes to github.com

Skip to content

Immutable session backed by HashMap#8454

Merged
AdamGS merged 6 commits into
developfrom
adamg/immutable-session
Jun 17, 2026
Merged

Immutable session backed by HashMap#8454
AdamGS merged 6 commits into
developfrom
adamg/immutable-session

Conversation

@AdamGS

@AdamGS AdamGS commented Jun 16, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Summary

This PR replaces the current DashMap backed session with one backed by a HashMap. Instead of being initialized on access which might cause deadlocks or otherwise weird performance behavior.

There's also an explicit Builder type for the session, allowing the user to explicitly include the components they want.

@AdamGS AdamGS added the action/benchmark Trigger full benchmarks to run on this PR label Jun 16, 2026
@github-actions github-actions Bot removed the action/benchmark Trigger full benchmarks to run on this PR label Jun 16, 2026
@codspeed-hq

codspeed-hq Bot commented Jun 16, 2026 •
edited
Loading

Copy link
Copy Markdown

Merging this PR will not alter performance

⚠️ Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.

For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

⚠️ Different runtime environments detected

Some benchmarks with significant performance changes were compared across different runtime environments,
which may affect the accuracy of the results.

Open the report in CodSpeed to investigate

⚡ 10 improved benchmarks
❌ 14 regressed benchmarks
✅ 1521 untouched benchmarks
⏩ 10 skipped benchmarks1

Warning

Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
❌ Simulation chunked_bool_canonical_into[(1000, 10)] 20.6 µs 35.3 µs -41.55%
❌ Simulation chunked_dict_primitive_into_canonical[u32, (1000, 10, 10)] 120.7 µs 182.1 µs -33.72%
❌ Simulation encode_varbin[(1000, 2)] 176.1 µs 232.7 µs -24.35%
❌ Simulation chunked_varbinview_canonical_into[(1000, 10)] 161.8 µs 198.2 µs -18.36%
❌ Simulation decompress_rd[f64, (100000, 0.0)] 845.5 µs 1,025.1 µs -17.53%
❌ Simulation chunked_varbinview_into_canonical[(1000, 10)] 177.1 µs 214.6 µs -17.5%
❌ Simulation bench_many_codes_few_values[1024] 393.2 µs 468 µs -15.97%
❌ WallTime cuda/bitpacked_u8/unpack/3bw[100M] 299.5 µs 352.9 µs -15.15%
❌ Simulation decompress_rd[f32, (100000, 0.0)] 499.1 µs 587.5 µs -15.04%
❌ Simulation varbinview_large 112.2 µs 131 µs -14.41%
❌ Simulation bitwise_not_vortex_buffer_mut[128] 186.1 ns 215.3 ns -13.55%
❌ Simulation chunked_varbinview_canonical_into[(100, 100)] 273.8 µs 308.7 µs -11.31%
❌ Simulation chunked_varbinview_into_canonical[(100, 100)] 326.4 µs 367.3 µs -11.13%
❌ Simulation bitwise_not_vortex_buffer_mut[1024] 246.4 ns 275.6 ns -10.58%
⚡ Simulation sum_i32_nullable_all_valid 69.2 µs 35.4 µs +95.43%
⚡ Simulation null_count_run_end[(10000, 4, 0.01)] 125.4 µs 91.7 µs +36.78%
⚡ Simulation encode_varbinview[(1000, 2)] 189 µs 155.4 µs +21.62%
⚡ Simulation chunked_varbinview_opt_into_canonical[(1000, 10)] 229.3 µs 192.9 µs +18.83%
⚡ Simulation take_10k_contiguous 252.8 µs 218 µs +15.97%
⚡ Simulation decompress_rd[f64, (100000, 0.01)] 981.2 µs 846.4 µs +15.93%
... ... ... ... ... ...

ℹ️ Only the first 20 benchmarks are displayed. Go to the app to view all benchmarks.

Tip

Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.

Comparing adamg/immutable-session (f4d7069) with develop (679e2c5)

Open in CodSpeed

Footnotes

  1. 10 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports. ↩

@github-actions

github-actions Bot commented Jun 16, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 49cce3b 2 Explore Profiling Data
Previous Runs (3)
Status Commit Job Attempt Link
🟢 Done 49cce3b 1 Explore Profiling Data
🟢 Done b2facee 1 Explore Profiling Data
🟢 Done 3e9185d 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

github-actions Bot commented Jun 16, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling

Vortex (geomean): 1.186x ❌

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.186x ❌, 0↑ 9↓)
name PR 49cce3b (ns) base 170ff39 (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 124540853 118077150 1.05
polarsignals_q01/datafusion:vortex-file-compressed 🚨 310028704 267989489 1.16
polarsignals_q02/datafusion:vortex-file-compressed 🚨 26162603 23384056 1.12
polarsignals_q03/datafusion:vortex-file-compressed 🚨 336623859 257722546 1.31
polarsignals_q04/datafusion:vortex-file-compressed 🚨 11780553 9272244 1.27
polarsignals_q05/datafusion:vortex-file-compressed 🚨 17020812 13970701 1.22
polarsignals_q06/datafusion:vortex-file-compressed 🚨 22976786 20545374 1.12
polarsignals_q07/datafusion:vortex-file-compressed 🚨 16570218 13202043 1.26
polarsignals_q08/datafusion:vortex-file-compressed 🚨 457876635 377054852 1.21
polarsignals_q09/datafusion:vortex-file-compressed 🚨 13814181 11779910 1.17
File Size Changes (1 files changed, +0.0% overall, 1↑ 0↓)
File Scale Format Base HEAD Change %
stacktraces.vortex 1000000 vortex-file-compressed 685.81 MB 685.83 MB +19.64 KB +0.0%

Totals:

  • vortex-file-compressed: 685.81 MB → 685.83 MB (+0.0%)

@github-actions

github-actions Bot commented Jun 16, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +3.1%
Engines: DataFusion No clear signal (+3.5%, environment too noisy confidence) · DuckDB No clear signal (+2.7%, low confidence)
Vortex (geomean): 0.978x ➖
Parquet (geomean): 0.949x ➖
Shifts: Parquet (control) -5.1% · Median polish -3.6%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.982x ➖, 2↑ 1↓)
name PR 49cce3b (ns) base 170ff39 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚨 6698416 5553468 1.21
fineweb_q01/datafusion:vortex-file-compressed 🚀 32843073 37823933 0.87
fineweb_q02/datafusion:vortex-file-compressed 🚀 37708873 42357854 0.89
fineweb_q03/datafusion:vortex-file-compressed 67578684 61636611 1.10
fineweb_q04/datafusion:vortex-file-compressed 280972314 292821976 0.96
fineweb_q05/datafusion:vortex-file-compressed 219490507 226801215 0.97
fineweb_q06/datafusion:vortex-file-compressed 50352682 53288835 0.94
fineweb_q07/datafusion:vortex-file-compressed 54783942 58026617 0.94
fineweb_q08/datafusion:vortex-file-compressed 23741881 23646511 1.00
datafusion / vortex-compact (0.971x ➖, 1↑ 1↓)
name PR 49cce3b (ns) base 170ff39 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 🚀 5789906 7016208 0.83
fineweb_q01/datafusion:vortex-compact 98695891 102571523 0.96
fineweb_q02/datafusion:vortex-compact 103141559 108372703 0.95
fineweb_q03/datafusion:vortex-compact 862048622 889781955 0.97
fineweb_q04/datafusion:vortex-compact 922203685 933243232 0.99
fineweb_q05/datafusion:vortex-compact 824735539 844475732 0.98
fineweb_q06/datafusion:vortex-compact 471768645 479608019 0.98
fineweb_q07/datafusion:vortex-compact 479787072 493710584 0.97
fineweb_q08/datafusion:vortex-compact 🚨 25266958 22309081 1.13
datafusion / parquet (0.944x ➖, 1↑ 0↓)
name PR 49cce3b (ns) base 170ff39 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 7270647 7761691 0.94
fineweb_q01/datafusion:parquet 282524323 308268874 0.92
fineweb_q02/datafusion:parquet 295387905 300336839 0.98
fineweb_q03/datafusion:parquet 296673697 297610840 1.00
fineweb_q04/datafusion:parquet 311193343 301264424 1.03
fineweb_q05/datafusion:parquet 296536691 319004856 0.93
fineweb_q06/datafusion:parquet 285080447 305285365 0.93
fineweb_q07/datafusion:parquet 🚀 280041788 331180675 0.85
fineweb_q08/datafusion:parquet 283325763 304568076 0.93
duckdb / vortex-file-compressed (0.983x ➖, 0↑ 1↓)
name PR 49cce3b (ns) base 170ff39 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 3355755 3621141 0.93
fineweb_q01/duckdb:vortex-file-compressed 33332163 35012655 0.95
fineweb_q02/duckdb:vortex-file-compressed 40620535 42096536 0.96
fineweb_q03/duckdb:vortex-file-compressed 🚨 134251070 118609902 1.13
fineweb_q04/duckdb:vortex-file-compressed 272831374 277155790 0.98
fineweb_q05/duckdb:vortex-file-compressed 216870643 224371863 0.97
fineweb_q06/duckdb:vortex-file-compressed 50277392 52178812 0.96
fineweb_q07/duckdb:vortex-file-compressed 52695121 53400159 0.99
fineweb_q08/duckdb:vortex-file-compressed 22841306 23335393 0.98
duckdb / vortex-compact (0.979x ➖, 0↑ 1↓)
name PR 49cce3b (ns) base 170ff39 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 4138937 4509119 0.92
fineweb_q01/duckdb:vortex-compact 🚨 108081850 94363435 1.15
fineweb_q02/duckdb:vortex-compact 115454097 117563979 0.98
fineweb_q03/duckdb:vortex-compact 851457857 855727493 1.00
fineweb_q04/duckdb:vortex-compact 898927276 962622761 0.93
fineweb_q05/duckdb:vortex-compact 805094852 835737488 0.96
fineweb_q06/duckdb:vortex-compact 457236502 473122260 0.97
fineweb_q07/duckdb:vortex-compact 480495418 489241551 0.98
fineweb_q08/duckdb:vortex-compact 20092818 21406167 0.94
duckdb / parquet (0.955x ➖, 1↑ 0↓)
name PR 49cce3b (ns) base 170ff39 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 31341937 33600942 0.93
fineweb_q01/duckdb:parquet 84808822 88420773 0.96
fineweb_q02/duckdb:parquet 84781630 88788000 0.95
fineweb_q03/duckdb:parquet 316730339 325532073 0.97
fineweb_q04/duckdb:parquet 446605419 453436630 0.98
fineweb_q05/duckdb:parquet 413711063 419767144 0.99
fineweb_q06/duckdb:parquet 202652527 212010820 0.96
fineweb_q07/duckdb:parquet 215727663 221521946 0.97
fineweb_q08/duckdb:parquet 🚀 32831800 37389916 0.88
File Size Changes (2 files changed, -0.0% overall, 0↑ 2↓)
File Scale Format Base HEAD Change %
sample.vortex 1.0 vortex-compact 1.23 GB 1.23 GB 4.02 KB -0.0%
sample.vortex 1.0 vortex-file-compressed 1.43 GB 1.43 GB 617.07 KB -0.0%

Totals:

  • vortex-compact: 1.23 GB → 1.23 GB (-0.0%)
  • vortex-file-compressed: 1.43 GB → 1.43 GB (-0.0%)

@github-actions

github-actions Bot commented Jun 16, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -0.6%
Engines: DataFusion No clear signal (-0.2%, environment too noisy confidence) · DuckDB No clear signal (-1.1%, environment too noisy confidence)
Vortex (geomean): 0.949x ➖
Parquet (geomean): 0.954x ➖
Shifts: Parquet (control) -4.6% · Median polish -5.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.979x ➖, 0↑ 0↓)
name PR 49cce3b (ns) base c9c8fb7 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 52248042 51427195 1.02
tpch_q02/datafusion:vortex-file-compressed 22464107 23396321 0.96
tpch_q03/datafusion:vortex-file-compressed 30508473 30993574 0.98
tpch_q04/datafusion:vortex-file-compressed 19507081 20487569 0.95
tpch_q05/datafusion:vortex-file-compressed 46688805 48024500 0.97
tpch_q06/datafusion:vortex-file-compressed 9827166 9585077 1.03
tpch_q07/datafusion:vortex-file-compressed 52537810 54670339 0.96
tpch_q08/datafusion:vortex-file-compressed 38547167 40478014 0.95
tpch_q09/datafusion:vortex-file-compressed 52378636 53362134 0.98
tpch_q10/datafusion:vortex-file-compressed 32753078 33796196 0.97
tpch_q11/datafusion:vortex-file-compressed 16213372 16706117 0.97
tpch_q12/datafusion:vortex-file-compressed 23563582 24128940 0.98
tpch_q13/datafusion:vortex-file-compressed 26601677 27388331 0.97
tpch_q14/datafusion:vortex-file-compressed 14500934 15229485 0.95
tpch_q15/datafusion:vortex-file-compressed 22578559 22927577 0.98
tpch_q16/datafusion:vortex-file-compressed 20125296 20256942 0.99
tpch_q17/datafusion:vortex-file-compressed 65453639 67868140 0.96
tpch_q18/datafusion:vortex-file-compressed 76405350 75747576 1.01
tpch_q19/datafusion:vortex-file-compressed 17292623 17429280 0.99
tpch_q20/datafusion:vortex-file-compressed 30246641 30069256 1.01
tpch_q21/datafusion:vortex-file-compressed 69572524 71199302 0.98
tpch_q22/datafusion:vortex-file-compressed 11614349 12045637 0.96
datafusion / vortex-compact (0.984x ➖, 0↑ 0↓)
name PR 49cce3b (ns) base c9c8fb7 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 58978767 59491647 0.99
tpch_q02/datafusion:vortex-compact 25533597 26311970 0.97
tpch_q03/datafusion:vortex-compact 32219463 32525814 0.99
tpch_q04/datafusion:vortex-compact 21843601 22243567 0.98
tpch_q05/datafusion:vortex-compact 47437321 48187088 0.98
tpch_q06/datafusion:vortex-compact 12500548 12489779 1.00
tpch_q07/datafusion:vortex-compact 55047097 55541683 0.99
tpch_q08/datafusion:vortex-compact 42008311 42410661 0.99
tpch_q09/datafusion:vortex-compact 56511676 57013111 0.99
tpch_q10/datafusion:vortex-compact 35778425 36503487 0.98
tpch_q11/datafusion:vortex-compact 17473809 18199845 0.96
tpch_q12/datafusion:vortex-compact 29404636 29839314 0.99
tpch_q13/datafusion:vortex-compact 31707493 31920321 0.99
tpch_q14/datafusion:vortex-compact 18427696 18355658 1.00
tpch_q15/datafusion:vortex-compact 29660275 30299634 0.98
tpch_q16/datafusion:vortex-compact 24814320 25571025 0.97
tpch_q17/datafusion:vortex-compact 67543484 69607095 0.97
tpch_q18/datafusion:vortex-compact 76708123 78082148 0.98
tpch_q19/datafusion:vortex-compact 38984869 39606689 0.98
tpch_q20/datafusion:vortex-compact 35998183 36112255 1.00
tpch_q21/datafusion:vortex-compact 75551476 76855386 0.98
tpch_q22/datafusion:vortex-compact 13406470 13717106 0.98
datafusion / parquet (0.969x ➖, 2↑ 1↓)
name PR 49cce3b (ns) base c9c8fb7 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 🚨 125361539 95902454 1.31
tpch_q02/datafusion:parquet 61430162 64145055 0.96
tpch_q03/datafusion:parquet 77480277 83599337 0.93
tpch_q04/datafusion:parquet 45560883 49662937 0.92
tpch_q05/datafusion:parquet 91801978 93308296 0.98
tpch_q06/datafusion:parquet 🚀 33269435 42931555 0.77
tpch_q07/datafusion:parquet 106750038 101378940 1.05
tpch_q08/datafusion:parquet 90905801 99475819 0.91
tpch_q09/datafusion:parquet 127194152 128513367 0.99
tpch_q10/datafusion:parquet 117296507 126414930 0.93
tpch_q11/datafusion:parquet 40359271 43070313 0.94
tpch_q12/datafusion:parquet 87725805 86478550 1.01
tpch_q13/datafusion:parquet 190318310 195762722 0.97
tpch_q14/datafusion:parquet 39367172 40868108 0.96
tpch_q15/datafusion:parquet 60796735 63414857 0.96
tpch_q16/datafusion:parquet 42614205 42129068 1.01
tpch_q17/datafusion:parquet 🚀 128387383 144094700 0.89
tpch_q18/datafusion:parquet 155583471 162038197 0.96
tpch_q19/datafusion:parquet 80373564 78117432 1.03
tpch_q20/datafusion:parquet 70068177 74735878 0.94
tpch_q21/datafusion:parquet 141383993 140031126 1.01
tpch_q22/datafusion:parquet 43112037 44661727 0.97
datafusion / arrow (0.939x ➖, 3↑ 1↓)
name PR 49cce3b (ns) base c9c8fb7 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 🚀 60655247 69361305 0.87
tpch_q02/datafusion:arrow 16936868 17541238 0.97
tpch_q03/datafusion:arrow 32216765 33798471 0.95
tpch_q04/datafusion:arrow 25707043 27136813 0.95
tpch_q05/datafusion:arrow 56913264 56366279 1.01
tpch_q06/datafusion:arrow 🚨 25546878 21531408 1.19
tpch_q07/datafusion:arrow 103573703 109622637 0.94
tpch_q08/datafusion:arrow 40823039 44961646 0.91
tpch_q09/datafusion:arrow 🚀 64291929 73552932 0.87
tpch_q10/datafusion:arrow 🚀 47764279 54237653 0.88
tpch_q11/datafusion:arrow 9262583 9710615 0.95
tpch_q12/datafusion:arrow 49117705 54111888 0.91
tpch_q13/datafusion:arrow 44841088 49606532 0.90
tpch_q14/datafusion:arrow 22992431 24860942 0.92
tpch_q15/datafusion:arrow 45232060 47556073 0.95
tpch_q16/datafusion:arrow 16465921 17401455 0.95
tpch_q17/datafusion:arrow 64805038 71628609 0.90
tpch_q18/datafusion:arrow 107600303 115644344 0.93
tpch_q19/datafusion:arrow 37102934 40100884 0.93
tpch_q20/datafusion:arrow 35855374 38283824 0.94
tpch_q21/datafusion:arrow 154195042 164008817 0.94
tpch_q22/datafusion:arrow 12058096 12952049 0.93
duckdb / vortex-file-compressed (0.913x ➖, 6↑ 0↓)
name PR 49cce3b (ns) base c9c8fb7 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 31484325 32539951 0.97
tpch_q02/duckdb:vortex-file-compressed 24411563 26480168 0.92
tpch_q03/duckdb:vortex-file-compressed 🚀 32434721 36143250 0.90
tpch_q04/duckdb:vortex-file-compressed 🚀 28388092 31546923 0.90
tpch_q05/duckdb:vortex-file-compressed 36877354 40727010 0.91
tpch_q06/duckdb:vortex-file-compressed 🚀 8426431 9476041 0.89
tpch_q07/duckdb:vortex-file-compressed 34493175 38325134 0.90
tpch_q08/duckdb:vortex-file-compressed 36722966 39961404 0.92
tpch_q09/duckdb:vortex-file-compressed 57729288 63147675 0.91
tpch_q10/duckdb:vortex-file-compressed 40754332 44878560 0.91
tpch_q11/duckdb:vortex-file-compressed 14999065 15903605 0.94
tpch_q12/duckdb:vortex-file-compressed 22635609 23952192 0.95
tpch_q13/duckdb:vortex-file-compressed 41642005 44830680 0.93
tpch_q14/duckdb:vortex-file-compressed 21517752 23686884 0.91
tpch_q15/duckdb:vortex-file-compressed 🚀 16939550 19463621 0.87
tpch_q16/duckdb:vortex-file-compressed 29606550 30115243 0.98
tpch_q17/duckdb:vortex-file-compressed 23534858 26017548 0.90
tpch_q18/duckdb:vortex-file-compressed 52746566 58109927 0.91
tpch_q19/duckdb:vortex-file-compressed 🚀 28791452 32893197 0.88
tpch_q20/duckdb:vortex-file-compressed 32811676 36418117 0.90
tpch_q21/duckdb:vortex-file-compressed 🚀 101173559 113628701 0.89
tpch_q22/duckdb:vortex-file-compressed 16867300 18455810 0.91
duckdb / vortex-compact (0.920x ➖, 6↑ 0↓)
name PR 49cce3b (ns) base c9c8fb7 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 38374420 39826912 0.96
tpch_q02/duckdb:vortex-compact 33691812 35727058 0.94
tpch_q03/duckdb:vortex-compact 33786218 37512992 0.90
tpch_q04/duckdb:vortex-compact 30613196 33197838 0.92
tpch_q05/duckdb:vortex-compact 🚀 40457208 45064340 0.90
tpch_q06/duckdb:vortex-compact 11620126 12190159 0.95
tpch_q07/duckdb:vortex-compact 40224565 44194436 0.91
tpch_q08/duckdb:vortex-compact 42445440 44677363 0.95
tpch_q09/duckdb:vortex-compact 64238065 70460746 0.91
tpch_q10/duckdb:vortex-compact 45908815 49368662 0.93
tpch_q11/duckdb:vortex-compact 🚀 18203654 20319293 0.90
tpch_q12/duckdb:vortex-compact 29765790 30769281 0.97
tpch_q13/duckdb:vortex-compact 46711929 48926967 0.95
tpch_q14/duckdb:vortex-compact 🚀 25577701 28782639 0.89
tpch_q15/duckdb:vortex-compact 19893723 21696514 0.92
tpch_q16/duckdb:vortex-compact 32975164 35715896 0.92
tpch_q17/duckdb:vortex-compact 29520291 31666241 0.93
tpch_q18/duckdb:vortex-compact 53157327 56166936 0.95
tpch_q19/duckdb:vortex-compact 🚀 32778222 38487279 0.85
tpch_q20/duckdb:vortex-compact 39509424 43107910 0.92
tpch_q21/duckdb:vortex-compact 🚀 101104179 113421326 0.89
tpch_q22/duckdb:vortex-compact 🚀 18111810 20280139 0.89
duckdb / parquet (0.939x ➖, 3↑ 0↓)
name PR 49cce3b (ns) base c9c8fb7 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 76887825 80184812 0.96
tpch_q02/duckdb:parquet 39388518 41050099 0.96
tpch_q03/duckdb:parquet 70793152 72630124 0.97
tpch_q04/duckdb:parquet 🚀 49394922 60248845 0.82
tpch_q05/duckdb:parquet 68047396 70507282 0.97
tpch_q06/duckdb:parquet 22539008 23400198 0.96
tpch_q07/duckdb:parquet 72065036 79698438 0.90
tpch_q08/duckdb:parquet 86541809 86867731 1.00
tpch_q09/duckdb:parquet 🚀 141994963 167907057 0.85
tpch_q10/duckdb:parquet 128756073 132369356 0.97
tpch_q11/duckdb:parquet 22328164 23683814 0.94
tpch_q12/duckdb:parquet 🚀 49957155 59468407 0.84
tpch_q13/duckdb:parquet 252522230 277397491 0.91
tpch_q14/duckdb:parquet 50542226 53585597 0.94
tpch_q15/duckdb:parquet 27352323 27175784 1.01
tpch_q16/duckdb:parquet 58128198 61656079 0.94
tpch_q17/duckdb:parquet 57170515 58324771 0.98
tpch_q18/duckdb:parquet 124179413 126861596 0.98
tpch_q19/duckdb:parquet 87815984 95098814 0.92
tpch_q20/duckdb:parquet 65757146 68261787 0.96
tpch_q21/duckdb:parquet 186454306 197227385 0.95
tpch_q22/duckdb:parquet 53531797 56145999 0.95
duckdb / duckdb (0.953x ➖, 0↑ 0↓)
name PR 49cce3b (ns) base c9c8fb7 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 17612123 18422335 0.96
tpch_q02/duckdb:duckdb 14723049 15341950 0.96
tpch_q03/duckdb:duckdb 22515523 24923664 0.90
tpch_q04/duckdb:duckdb 21367173 23321388 0.92
tpch_q05/duckdb:duckdb 22700127 24194184 0.94
tpch_q06/duckdb:duckdb 7092817 7378386 0.96
tpch_q07/duckdb:duckdb 25183002 27606025 0.91
tpch_q08/duckdb:duckdb 24478141 25687946 0.95
tpch_q09/duckdb:duckdb 56942877 61901580 0.92
tpch_q10/duckdb:duckdb 52018244 52780567 0.99
tpch_q11/duckdb:duckdb 7188053 7642379 0.94
tpch_q12/duckdb:duckdb 18119937 18648002 0.97
tpch_q13/duckdb:duckdb 39858899 42106372 0.95
tpch_q14/duckdb:duckdb 21664412 22584427 0.96
tpch_q15/duckdb:duckdb 13811526 14082772 0.98
tpch_q16/duckdb:duckdb 26480951 27325560 0.97
tpch_q17/duckdb:duckdb 16057026 16658689 0.96
tpch_q18/duckdb:duckdb 41058021 42024196 0.98
tpch_q19/duckdb:duckdb 31060549 32400623 0.96
tpch_q20/duckdb:duckdb 25404830 25838691 0.98
tpch_q21/duckdb:duckdb 61967782 65528559 0.95
tpch_q22/duckdb:duckdb 25694860 26424597 0.97
File Size Changes (10 files changed, -0.1% overall, 4↑ 6↓)
File Scale Format Base HEAD Change %
orders_0.vortex 1.0 vortex-compact 31.73 MB 32.20 MB +482.27 KB +1.5%
part_0.vortex 1.0 vortex-file-compressed 4.99 MB 5.01 MB +23.55 KB +0.5%
supplier_0.vortex 1.0 vortex-file-compressed 614.22 KB 616.14 KB +1.92 KB +0.3%
customer_0.vortex 1.0 vortex-file-compressed 8.89 MB 8.90 MB +11.92 KB +0.1%
partsupp_0.vortex 1.0 vortex-file-compressed 23.82 MB 23.79 MB 21.34 KB -0.1%
lineitem_1.vortex 1.0 vortex-file-compressed 84.66 MB 84.58 MB 83.20 KB -0.1%
lineitem_0.vortex 1.0 vortex-file-compressed 85.20 MB 85.12 MB 84.91 KB -0.1%
orders_0.vortex 1.0 vortex-file-compressed 38.55 MB 38.24 MB 324.38 KB -0.8%
partsupp_0.vortex 1.0 vortex-compact 20.88 MB 20.70 MB 184.11 KB -0.9%
part_0.vortex 1.0 vortex-compact 3.45 MB 3.36 MB 93.55 KB -2.6%

Totals:

  • vortex-compact: 190.28 MB → 190.48 MB (+0.1%)
  • vortex-file-compressed: 246.99 MB → 246.53 MB (-0.2%)

@github-actions

github-actions Bot commented Jun 16, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.7%
Engines: DataFusion No clear signal (-1.1%, environment too noisy confidence) · DuckDB No clear signal (-0.3%, low confidence)
Vortex (geomean): 1.000x ➖
Parquet (geomean): 1.009x ➖
Shifts: Parquet (control) +0.9% · Median polish +0.4%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.005x ➖, 0↑ 7↓)
name PR 49cce3b (ns) base 170ff39 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 27334649 26370613 1.04
tpcds_q02/datafusion:vortex-file-compressed 47594908 47176580 1.01
tpcds_q03/datafusion:vortex-file-compressed 15880520 15077531 1.05
tpcds_q04/datafusion:vortex-file-compressed 260952384 255730088 1.02
tpcds_q05/datafusion:vortex-file-compressed 46766054 44241214 1.06
tpcds_q06/datafusion:vortex-file-compressed 🚨 25137684 22515956 1.12
tpcds_q07/datafusion:vortex-file-compressed 🚨 43877087 38922035 1.13
tpcds_q08/datafusion:vortex-file-compressed 29376137 31198528 0.94
tpcds_q09/datafusion:vortex-file-compressed 28704879 30426311 0.94
tpcds_q10/datafusion:vortex-file-compressed 37793045 38903555 0.97
tpcds_q11/datafusion:vortex-file-compressed 135215974 131389564 1.03
tpcds_q12/datafusion:vortex-file-compressed 17407079 18762468 0.93
tpcds_q13/datafusion:vortex-file-compressed 43899442 42824621 1.03
tpcds_q14/datafusion:vortex-file-compressed 158318213 168010349 0.94
tpcds_q15/datafusion:vortex-file-compressed 26711723 26123466 1.02
tpcds_q16/datafusion:vortex-file-compressed 24745965 25638112 0.97
tpcds_q17/datafusion:vortex-file-compressed 60922360 59963808 1.02
tpcds_q18/datafusion:vortex-file-compressed 61954053 63682515 0.97
tpcds_q19/datafusion:vortex-file-compressed 21656595 21689832 1.00
tpcds_q20/datafusion:vortex-file-compressed 19815915 20385495 0.97
tpcds_q21/datafusion:vortex-file-compressed 🚨 39480089 35604280 1.11
tpcds_q22/datafusion:vortex-file-compressed 🚨 162485877 130527255 1.24
tpcds_q23/datafusion:vortex-file-compressed 148600796 154588290 0.96
tpcds_q24/datafusion:vortex-file-compressed 78734885 83165251 0.95
tpcds_q25/datafusion:vortex-file-compressed 63466108 63274738 1.00
tpcds_q26/datafusion:vortex-file-compressed 33102626 33453632 0.99
tpcds_q27/datafusion:vortex-file-compressed 90849922 91791309 0.99
tpcds_q28/datafusion:vortex-file-compressed 29966169 29470834 1.02
tpcds_q29/datafusion:vortex-file-compressed 59377929 61310330 0.97
tpcds_q30/datafusion:vortex-file-compressed 23623760 25223270 0.94
tpcds_q31/datafusion:vortex-file-compressed 73053237 71344316 1.02
tpcds_q32/datafusion:vortex-file-compressed 18502081 19022109 0.97
tpcds_q33/datafusion:vortex-file-compressed 28837335 28448323 1.01
tpcds_q34/datafusion:vortex-file-compressed 24146373 24839029 0.97
tpcds_q35/datafusion:vortex-file-compressed 44412265 44572982 1.00
tpcds_q36/datafusion:vortex-file-compressed 57521682 57473700 1.00
tpcds_q37/datafusion:vortex-file-compressed 🚨 23617514 20673548 1.14
tpcds_q38/datafusion:vortex-file-compressed 🚨 47835821 42404066 1.13
tpcds_q39/datafusion:vortex-file-compressed 116190944 108007606 1.08
tpcds_q40/datafusion:vortex-file-compressed 32699553 31111216 1.05
tpcds_q41/datafusion:vortex-file-compressed 15251211 16157616 0.94
tpcds_q42/datafusion:vortex-file-compressed 13498907 13991476 0.96
tpcds_q43/datafusion:vortex-file-compressed 19178202 18428882 1.04
tpcds_q44/datafusion:vortex-file-compressed 28620540 28963304 0.99
tpcds_q45/datafusion:vortex-file-compressed 26990198 26872528 1.00
tpcds_q46/datafusion:vortex-file-compressed 34070848 36776105 0.93
tpcds_q47/datafusion:vortex-file-compressed 133895357 135038553 0.99
tpcds_q48/datafusion:vortex-file-compressed 32489016 32623075 1.00
tpcds_q49/datafusion:vortex-file-compressed 55963650 57307671 0.98
tpcds_q50/datafusion:vortex-file-compressed 37886526 38943209 0.97
tpcds_q51/datafusion:vortex-file-compressed 90357397 88785649 1.02
tpcds_q52/datafusion:vortex-file-compressed 13692576 14557982 0.94
tpcds_q53/datafusion:vortex-file-compressed 21934244 22513193 0.97
tpcds_q54/datafusion:vortex-file-compressed 33856200 34009523 1.00
tpcds_q55/datafusion:vortex-file-compressed 13636414 13420624 1.02
tpcds_q56/datafusion:vortex-file-compressed 30004131 29275104 1.02
tpcds_q57/datafusion:vortex-file-compressed 109969133 111204128 0.99
tpcds_q58/datafusion:vortex-file-compressed 🚨 60734279 55153272 1.10
tpcds_q59/datafusion:vortex-file-compressed 59983184 57884458 1.04
tpcds_q60/datafusion:vortex-file-compressed 31356821 29160339 1.08
tpcds_q61/datafusion:vortex-file-compressed 41982024 40309169 1.04
tpcds_q62/datafusion:vortex-file-compressed 23280949 23280674 1.00
tpcds_q63/datafusion:vortex-file-compressed 22075898 21587188 1.02
tpcds_q64/datafusion:vortex-file-compressed 370413327 384634329 0.96
tpcds_q65/datafusion:vortex-file-compressed 53872238 50539895 1.07
tpcds_q66/datafusion:vortex-file-compressed 72931536 68702280 1.06
tpcds_q67/datafusion:vortex-file-compressed 157036915 147132308 1.07
tpcds_q68/datafusion:vortex-file-compressed 32115283 33340095 0.96
tpcds_q69/datafusion:vortex-file-compressed 35112239 35931278 0.98
tpcds_q70/datafusion:vortex-file-compressed 90413299 97042731 0.93
tpcds_q71/datafusion:vortex-file-compressed 22863394 22958894 1.00
tpcds_q72/datafusion:vortex-file-compressed 2073723681 2055722978 1.01
tpcds_q73/datafusion:vortex-file-compressed 23017111 24887601 0.92
tpcds_q74/datafusion:vortex-file-compressed 82909868 78555950 1.06
tpcds_q75/datafusion:vortex-file-compressed 107630394 111522890 0.97
tpcds_q76/datafusion:vortex-file-compressed 30530484 31876369 0.96
tpcds_q77/datafusion:vortex-file-compressed 37486275 37137754 1.01
tpcds_q78/datafusion:vortex-file-compressed 110934163 116822123 0.95
tpcds_q79/datafusion:vortex-file-compressed 27542364 30056459 0.92
tpcds_q80/datafusion:vortex-file-compressed 86866564 86854994 1.00
tpcds_q81/datafusion:vortex-file-compressed 24558315 24545812 1.00
tpcds_q82/datafusion:vortex-file-compressed 20774952 21333141 0.97
tpcds_q83/datafusion:vortex-file-compressed 35114589 36559489 0.96
tpcds_q84/datafusion:vortex-file-compressed 12133359 12567790 0.97
tpcds_q85/datafusion:vortex-file-compressed 88299604 85133646 1.04
tpcds_q86/datafusion:vortex-file-compressed 15989862 15047855 1.06
tpcds_q87/datafusion:vortex-file-compressed 42789718 42758764 1.00
tpcds_q88/datafusion:vortex-file-compressed 55008286 57218022 0.96
tpcds_q89/datafusion:vortex-file-compressed 24542626 24836771 0.99
tpcds_q90/datafusion:vortex-file-compressed 13934149 14463335 0.96
tpcds_q91/datafusion:vortex-file-compressed 18551366 18218100 1.02
tpcds_q92/datafusion:vortex-file-compressed 17036036 15527158 1.10
tpcds_q93/datafusion:vortex-file-compressed 31410496 31474616 1.00
tpcds_q94/datafusion:vortex-file-compressed 21426747 20900873 1.03
tpcds_q95/datafusion:vortex-file-compressed 56709955 56440369 1.00
tpcds_q96/datafusion:vortex-file-compressed 12812681 12768305 1.00
tpcds_q97/datafusion:vortex-file-compressed 31632354 29586118 1.07
tpcds_q98/datafusion:vortex-file-compressed 23120755 24352599 0.95
tpcds_q99/datafusion:vortex-file-compressed 27406518 27754057 0.99
datafusion / vortex-compact (0.995x ➖, 1↑ 2↓)
name PR 49cce3b (ns) base 170ff39 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-compact 25197988 24554925 1.03
tpcds_q02/datafusion:vortex-compact 52218026 53330438 0.98
tpcds_q03/datafusion:vortex-compact 19133203 19227824 1.00
tpcds_q04/datafusion:vortex-compact 295700908 286454795 1.03
tpcds_q05/datafusion:vortex-compact 46916898 46384537 1.01
tpcds_q06/datafusion:vortex-compact 26609446 27178458 0.98
tpcds_q07/datafusion:vortex-compact 50971454 51862842 0.98
tpcds_q08/datafusion:vortex-compact 39529150 36629211 1.08
tpcds_q09/datafusion:vortex-compact 41526947 42733584 0.97
tpcds_q10/datafusion:vortex-compact 47594281 50429700 0.94
tpcds_q11/datafusion:vortex-compact 156135804 152295890 1.03
tpcds_q12/datafusion:vortex-compact 25214399 25481462 0.99
tpcds_q13/datafusion:vortex-compact 122638842 119172188 1.03
tpcds_q14/datafusion:vortex-compact 180658793 182907600 0.99
tpcds_q15/datafusion:vortex-compact 29230738 28076909 1.04
tpcds_q16/datafusion:vortex-compact 28409340 28343401 1.00
tpcds_q17/datafusion:vortex-compact 72206590 71321920 1.01
tpcds_q18/datafusion:vortex-compact 72371916 74395325 0.97
tpcds_q19/datafusion:vortex-compact 29404167 29655345 0.99
tpcds_q20/datafusion:vortex-compact 25360391 26273763 0.97
tpcds_q21/datafusion:vortex-compact 40118319 42049439 0.95
tpcds_q22/datafusion:vortex-compact 129546426 119476157 1.08
tpcds_q23/datafusion:vortex-compact 161187452 169426951 0.95
tpcds_q24/datafusion:vortex-compact 92673670 93846209 0.99
tpcds_q25/datafusion:vortex-compact 75505431 80739525 0.94
tpcds_q26/datafusion:vortex-compact 46200834 43946664 1.05
tpcds_q27/datafusion:vortex-compact 115592986 115655984 1.00
tpcds_q28/datafusion:vortex-compact 95967074 95648690 1.00
tpcds_q29/datafusion:vortex-compact 71338480 70854024 1.01
tpcds_q30/datafusion:vortex-compact 28141345 29349504 0.96
tpcds_q31/datafusion:vortex-compact 99007373 99945724 0.99
tpcds_q32/datafusion:vortex-compact 22475868 23045405 0.98
tpcds_q33/datafusion:vortex-compact 36012685 35789102 1.01
tpcds_q34/datafusion:vortex-compact 32634063 35301184 0.92
tpcds_q35/datafusion:vortex-compact 54155534 50951313 1.06
tpcds_q36/datafusion:vortex-compact 73569416 73348162 1.00
tpcds_q37/datafusion:vortex-compact 29796679 30707327 0.97
tpcds_q38/datafusion:vortex-compact 49182144 50502905 0.97
tpcds_q39/datafusion:vortex-compact 109078227 116048114 0.94
tpcds_q40/datafusion:vortex-compact 33747727 34197284 0.99
tpcds_q41/datafusion:vortex-compact 17183712 17625844 0.97
tpcds_q42/datafusion:vortex-compact 18237215 18128893 1.01
tpcds_q43/datafusion:vortex-compact 24345585 24862642 0.98
tpcds_q44/datafusion:vortex-compact 43654429 41188884 1.06
tpcds_q45/datafusion:vortex-compact 30385964 31335375 0.97
tpcds_q46/datafusion:vortex-compact 45864747 46478506 0.99
tpcds_q47/datafusion:vortex-compact 152157061 154568371 0.98
tpcds_q48/datafusion:vortex-compact 80682915 80989594 1.00
tpcds_q49/datafusion:vortex-compact 69347319 67578058 1.03
tpcds_q50/datafusion:vortex-compact 46794746 45981372 1.02
tpcds_q51/datafusion:vortex-compact 94620344 98026460 0.97
tpcds_q52/datafusion:vortex-compact 18185112 18097986 1.00
tpcds_q53/datafusion:vortex-compact 29014997 28774392 1.01
tpcds_q54/datafusion:vortex-compact 40921616 40648400 1.01
tpcds_q55/datafusion:vortex-compact 17798283 17862523 1.00
tpcds_q56/datafusion:vortex-compact 34274201 36488945 0.94
tpcds_q57/datafusion:vortex-compact 121247286 121299364 1.00
tpcds_q58/datafusion:vortex-compact 65204254 64436013 1.01
tpcds_q59/datafusion:vortex-compact 69871731 71186418 0.98
tpcds_q60/datafusion:vortex-compact 🚨 38930356 35028768 1.11
tpcds_q61/datafusion:vortex-compact 53104667 53090125 1.00
tpcds_q62/datafusion:vortex-compact 🚀 23555820 27726625 0.85
tpcds_q63/datafusion:vortex-compact 29776988 28102097 1.06
tpcds_q64/datafusion:vortex-compact 408276973 411579445 0.99
tpcds_q65/datafusion:vortex-compact 64249975 62814195 1.02
tpcds_q66/datafusion:vortex-compact 74783079 76455647 0.98
tpcds_q67/datafusion:vortex-compact 154537851 152789970 1.01
tpcds_q68/datafusion:vortex-compact 44897347 44734567 1.00
tpcds_q69/datafusion:vortex-compact 45084286 45740295 0.99
tpcds_q70/datafusion:vortex-compact 105893713 110419079 0.96
tpcds_q71/datafusion:vortex-compact 30169978 29466545 1.02
tpcds_q72/datafusion:vortex-compact 2040715227 2073801867 0.98
tpcds_q73/datafusion:vortex-compact 31271264 32415796 0.96
tpcds_q74/datafusion:vortex-compact 94057513 90009817 1.04
tpcds_q75/datafusion:vortex-compact 124659156 125922333 0.99
tpcds_q76/datafusion:vortex-compact 34012544 32533967 1.05
tpcds_q77/datafusion:vortex-compact 48373838 46964967 1.03
tpcds_q78/datafusion:vortex-compact 129550267 127923092 1.01
tpcds_q79/datafusion:vortex-compact 38554132 38380944 1.00
tpcds_q80/datafusion:vortex-compact 97513448 100481453 0.97
tpcds_q81/datafusion:vortex-compact 27922227 27518762 1.01
tpcds_q82/datafusion:vortex-compact 31580727 30804326 1.03
tpcds_q83/datafusion:vortex-compact 35168229 35280976 1.00
tpcds_q84/datafusion:vortex-compact 14046883 14055584 1.00
tpcds_q85/datafusion:vortex-compact 144381540 155396560 0.93
tpcds_q86/datafusion:vortex-compact 19475488 20475220 0.95
tpcds_q87/datafusion:vortex-compact 49164952 50067680 0.98
tpcds_q88/datafusion:vortex-compact 77672590 76664383 1.01
tpcds_q89/datafusion:vortex-compact 32865371 31194246 1.05
tpcds_q90/datafusion:vortex-compact 14460692 14649205 0.99
tpcds_q91/datafusion:vortex-compact 32197107 32372976 0.99
tpcds_q92/datafusion:vortex-compact 22067117 23119942 0.95
tpcds_q93/datafusion:vortex-compact 35573638 35869563 0.99
tpcds_q94/datafusion:vortex-compact 23717037 26174439 0.91
tpcds_q95/datafusion:vortex-compact 62790850 60672806 1.03
tpcds_q96/datafusion:vortex-compact 16642029 16963642 0.98
tpcds_q97/datafusion:vortex-compact 33592394 33164247 1.01
tpcds_q98/datafusion:vortex-compact 28897782 30783720 0.94
tpcds_q99/datafusion:vortex-compact 🚨 32760451 29741004 1.10
datafusion / parquet (1.012x ➖, 2↑ 3↓)
name PR 49cce3b (ns) base 170ff39 (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 23545841 24241613 0.97
tpcds_q02/datafusion:parquet 41221507 40991338 1.01
tpcds_q03/datafusion:parquet 13677401 14193772 0.96
tpcds_q04/datafusion:parquet 286200578 298222420 0.96
tpcds_q05/datafusion:parquet 46746254 47631551 0.98
tpcds_q06/datafusion:parquet 23259889 22634944 1.03
tpcds_q07/datafusion:parquet 78501800 77179498 1.02
tpcds_q08/datafusion:parquet 29818672 28404052 1.05
tpcds_q09/datafusion:parquet 40540841 38915069 1.04
tpcds_q10/datafusion:parquet 73007325 69585443 1.05
tpcds_q11/datafusion:parquet 149404795 146577685 1.02
tpcds_q12/datafusion:parquet 17535659 17215032 1.02
tpcds_q13/datafusion:parquet 75339951 73648493 1.02
tpcds_q14/datafusion:parquet 161560622 159602787 1.01
tpcds_q15/datafusion:parquet 22262184 21602421 1.03
tpcds_q16/datafusion:parquet 29941861 29082796 1.03
tpcds_q17/datafusion:parquet 61874923 65368750 0.95
tpcds_q18/datafusion:parquet 106671666 107309906 0.99
tpcds_q19/datafusion:parquet 22708633 22482523 1.01
tpcds_q20/datafusion:parquet 17839588 18573158 0.96
tpcds_q21/datafusion:parquet 18924083 18333287 1.03
tpcds_q22/datafusion:parquet 148357108 156178435 0.95
tpcds_q23/datafusion:parquet 155725399 156489558 1.00
tpcds_q24/datafusion:parquet 86442304 87840795 0.98
tpcds_q25/datafusion:parquet 63830235 62365922 1.02
tpcds_q26/datafusion:parquet 63689205 68594703 0.93
tpcds_q27/datafusion:parquet 🚨 150716792 134263957 1.12
tpcds_q28/datafusion:parquet 45740172 45435388 1.01
tpcds_q29/datafusion:parquet 63811235 62746489 1.02
tpcds_q30/datafusion:parquet 34136093 32309253 1.06
tpcds_q31/datafusion:parquet 66129710 65842569 1.00
tpcds_q32/datafusion:parquet 16349755 16059498 1.02
tpcds_q33/datafusion:parquet 27077212 27112866 1.00
tpcds_q34/datafusion:parquet 🚨 23374301 20749385 1.13
tpcds_q35/datafusion:parquet 71710340 70233853 1.02
tpcds_q36/datafusion:parquet 57646081 57753081 1.00
tpcds_q37/datafusion:parquet 19163357 19040126 1.01
tpcds_q38/datafusion:parquet 40887944 40297143 1.01
tpcds_q39/datafusion:parquet 77283146 74286165 1.04
tpcds_q40/datafusion:parquet 23027087 22605109 1.02
tpcds_q41/datafusion:parquet 15035491 14573002 1.03
tpcds_q42/datafusion:parquet 11561828 11700071 0.99
tpcds_q43/datafusion:parquet 16895695 17560728 0.96
tpcds_q44/datafusion:parquet 31983004 32727752 0.98
tpcds_q45/datafusion:parquet 28415179 29622264 0.96
tpcds_q46/datafusion:parquet 32822984 31969656 1.03
tpcds_q47/datafusion:parquet 133864992 130660268 1.02
tpcds_q48/datafusion:parquet 72683881 69903689 1.04
tpcds_q49/datafusion:parquet 57705954 56982311 1.01
tpcds_q50/datafusion:parquet 43021679 42688053 1.01
tpcds_q51/datafusion:parquet 88295765 88777684 0.99
tpcds_q52/datafusion:parquet 11941468 12572984 0.95
tpcds_q53/datafusion:parquet 18361366 18494800 0.99
tpcds_q54/datafusion:parquet 32190810 32621769 0.99
tpcds_q55/datafusion:parquet 11621432 11438261 1.02
tpcds_q56/datafusion:parquet 28481000 28685739 0.99
tpcds_q57/datafusion:parquet 🚀 94723839 106560366 0.89
tpcds_q58/datafusion:parquet 56306864 56587676 1.00
tpcds_q59/datafusion:parquet 62540363 61049074 1.02
tpcds_q60/datafusion:parquet 28150043 28610739 0.98
tpcds_q61/datafusion:parquet 44521744 42175845 1.06
tpcds_q62/datafusion:parquet 🚨 25842952 19247406 1.34
tpcds_q63/datafusion:parquet 18123715 17757627 1.02
tpcds_q64/datafusion:parquet 326206855 297009657 1.10
tpcds_q65/datafusion:parquet 38776435 36478141 1.06
tpcds_q66/datafusion:parquet 69906438 70127133 1.00
tpcds_q67/datafusion:parquet 151848414 144720402 1.05
tpcds_q68/datafusion:parquet 31457293 31953514 0.98
tpcds_q69/datafusion:parquet 67999507 69197102 0.98
tpcds_q70/datafusion:parquet 32570044 32542474 1.00
tpcds_q71/datafusion:parquet 23597852 22824291 1.03
tpcds_q72/datafusion:parquet 589583576 575080037 1.03
tpcds_q73/datafusion:parquet 21877076 20437334 1.07
tpcds_q74/datafusion:parquet 80979882 82578307 0.98
tpcds_q75/datafusion:parquet 105569399 108081831 0.98
tpcds_q76/datafusion:parquet 30121119 29480670 1.02
tpcds_q77/datafusion:parquet 38461730 37997975 1.01
tpcds_q78/datafusion:parquet 106403906 107423563 0.99
tpcds_q79/datafusion:parquet 26516287 26872550 0.99
tpcds_q80/datafusion:parquet 75607440 75640257 1.00
tpcds_q81/datafusion:parquet 29421992 29605861 0.99
tpcds_q82/datafusion:parquet 19930188 18671567 1.07
tpcds_q83/datafusion:parquet 41604747 40188740 1.04
tpcds_q84/datafusion:parquet 41339537 40138644 1.03
tpcds_q85/datafusion:parquet 157023490 144180061 1.09
tpcds_q86/datafusion:parquet 17017350 15737993 1.08
tpcds_q87/datafusion:parquet 47641862 46016585 1.04
tpcds_q88/datafusion:parquet 59670916 60780932 0.98
tpcds_q89/datafusion:parquet 22759857 22057033 1.03
tpcds_q90/datafusion:parquet 14223805 13873424 1.03
tpcds_q91/datafusion:parquet 57285604 57801477 0.99
tpcds_q92/datafusion:parquet 17417869 18148600 0.96
tpcds_q93/datafusion:parquet 29445532 29561227 1.00
tpcds_q94/datafusion:parquet 21781198 21432902 1.02
tpcds_q95/datafusion:parquet 59743746 58519332 1.02
tpcds_q96/datafusion:parquet 12968234 12266478 1.06
tpcds_q97/datafusion:parquet 31328656 31406726 1.00
tpcds_q98/datafusion:parquet 21951223 21158323 1.04
tpcds_q99/datafusion:parquet 🚀 26166885 32095101 0.82
duckdb / vortex-file-compressed (0.992x ➖, 2↑ 1↓)
name PR 49cce3b (ns) base 170ff39 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 22424374 23850070 0.94
tpcds_q02/duckdb:vortex-file-compressed 33825012 36404516 0.93
tpcds_q03/duckdb:vortex-file-compressed 15020920 15139041 0.99
tpcds_q04/duckdb:vortex-file-compressed 89641268 93342936 0.96
tpcds_q05/duckdb:vortex-file-compressed 32203253 33736776 0.95
tpcds_q06/duckdb:vortex-file-compressed 32710492 32893580 0.99
tpcds_q07/duckdb:vortex-file-compressed 21254016 21279794 1.00
tpcds_q08/duckdb:vortex-file-compressed 25704536 25352172 1.01
tpcds_q09/duckdb:vortex-file-compressed 16564546 16094183 1.03
tpcds_q10/duckdb:vortex-file-compressed 37346339 37235865 1.00
tpcds_q11/duckdb:vortex-file-compressed 65083499 65143725 1.00
tpcds_q12/duckdb:vortex-file-compressed 15576784 15595509 1.00
tpcds_q13/duckdb:vortex-file-compressed 33642545 32945354 1.02
tpcds_q14/duckdb:vortex-file-compressed 96954732 96114409 1.01
tpcds_q15/duckdb:vortex-file-compressed 26568479 26583203 1.00
tpcds_q16/duckdb:vortex-file-compressed 25525046 25731950 0.99
tpcds_q17/duckdb:vortex-file-compressed 45906009 45562284 1.01
tpcds_q18/duckdb:vortex-file-compressed 38424900 36638476 1.05
tpcds_q19/duckdb:vortex-file-compressed 32392030 31790057 1.02
tpcds_q20/duckdb:vortex-file-compressed 18404174 18300526 1.01
tpcds_q21/duckdb:vortex-file-compressed 17305760 16152127 1.07
tpcds_q22/duckdb:vortex-file-compressed 73720930 73954085 1.00
tpcds_q23/duckdb:vortex-file-compressed 97849809 97458992 1.00
tpcds_q24/duckdb:vortex-file-compressed 48335666 49436033 0.98
tpcds_q25/duckdb:vortex-file-compressed 41464698 40751090 1.02
tpcds_q26/duckdb:vortex-file-compressed 19722193 21013554 0.94
tpcds_q27/duckdb:vortex-file-compressed 24403096 23524622 1.04
tpcds_q28/duckdb:vortex-file-compressed 11648763 11648807 1.00
tpcds_q29/duckdb:vortex-file-compressed 39801547 41057774 0.97
tpcds_q30/duckdb:vortex-file-compressed 25091659 24766842 1.01
tpcds_q31/duckdb:vortex-file-compressed 29716138 29394114 1.01
tpcds_q32/duckdb:vortex-file-compressed 13535422 12813336 1.06
tpcds_q33/duckdb:vortex-file-compressed 24396165 24678274 0.99
tpcds_q34/duckdb:vortex-file-compressed 24936294 25330546 0.98
tpcds_q35/duckdb:vortex-file-compressed 63366571 64807113 0.98
tpcds_q36/duckdb:vortex-file-compressed 24744348 25346228 0.98
tpcds_q37/duckdb:vortex-file-compressed 19668239 19507392 1.01
tpcds_q38/duckdb:vortex-file-compressed 38452889 36252364 1.06
tpcds_q39/duckdb:vortex-file-compressed 35316033 35015907 1.01
tpcds_q40/duckdb:vortex-file-compressed 20543951 21525958 0.95
tpcds_q41/duckdb:vortex-file-compressed 9197259 8952423 1.03
tpcds_q42/duckdb:vortex-file-compressed 13661964 12875034 1.06
tpcds_q43/duckdb:vortex-file-compressed 20455516 20689274 0.99
tpcds_q44/duckdb:vortex-file-compressed 20853083 22150652 0.94
tpcds_q45/duckdb:vortex-file-compressed 30006313 29783056 1.01
tpcds_q46/duckdb:vortex-file-compressed 33109276 30755266 1.08
tpcds_q47/duckdb:vortex-file-compressed 51211475 51811612 0.99
tpcds_q48/duckdb:vortex-file-compressed 28555539 28526972 1.00
tpcds_q49/duckdb:vortex-file-compressed 31460609 32870020 0.96
tpcds_q50/duckdb:vortex-file-compressed 26979624 29784384 0.91
tpcds_q51/duckdb:vortex-file-compressed 103664747 106222413 0.98
tpcds_q52/duckdb:vortex-file-compressed 13251473 12849140 1.03
tpcds_q53/duckdb:vortex-file-compressed 23052744 22229882 1.04
tpcds_q54/duckdb:vortex-file-compressed 28681310 28200189 1.02
tpcds_q55/duckdb:vortex-file-compressed 12769199 12643990 1.01
tpcds_q56/duckdb:vortex-file-compressed 25271353 25839264 0.98
tpcds_q57/duckdb:vortex-file-compressed 41847539 41696493 1.00
tpcds_q58/duckdb:vortex-file-compressed 30584435 30740704 0.99
tpcds_q59/duckdb:vortex-file-compressed 56080775 56652373 0.99
tpcds_q60/duckdb:vortex-file-compressed 26342985 25657392 1.03
tpcds_q61/duckdb:vortex-file-compressed 30368151 31817930 0.95
tpcds_q62/duckdb:vortex-file-compressed 15055094 14951562 1.01
tpcds_q63/duckdb:vortex-file-compressed 20667398 20411193 1.01
tpcds_q64/duckdb:vortex-file-compressed 94745577 95389548 0.99
tpcds_q65/duckdb:vortex-file-compressed 23031102 22991748 1.00
tpcds_q66/duckdb:vortex-file-compressed 29952968 30481747 0.98
tpcds_q67/duckdb:vortex-file-compressed 138212295 144179464 0.96
tpcds_q68/duckdb:vortex-file-compressed 30046786 30032150 1.00
tpcds_q69/duckdb:vortex-file-compressed 39563875 39989170 0.99
tpcds_q70/duckdb:vortex-file-compressed 36776943 36893388 1.00
tpcds_q71/duckdb:vortex-file-compressed 21503611 21956235 0.98
tpcds_q72/duckdb:vortex-file-compressed 168859810 169761329 0.99
tpcds_q73/duckdb:vortex-file-compressed 25964727 25718074 1.01
tpcds_q74/duckdb:vortex-file-compressed 42575590 43565929 0.98
tpcds_q75/duckdb:vortex-file-compressed 51490697 50238334 1.02
tpcds_q76/duckdb:vortex-file-compressed 23007813 22333931 1.03
tpcds_q77/duckdb:vortex-file-compressed 24314226 26768131 0.91
tpcds_q78/duckdb:vortex-file-compressed 77669538 79340454 0.98
tpcds_q79/duckdb:vortex-file-compressed 26747214 25242490 1.06
tpcds_q80/duckdb:vortex-file-compressed 48496245 48765361 0.99
tpcds_q81/duckdb:vortex-file-compressed 30270319 30037522 1.01
tpcds_q82/duckdb:vortex-file-compressed 46197876 45601835 1.01
tpcds_q83/duckdb:vortex-file-compressed 🚀 26508957 30942129 0.86
tpcds_q84/duckdb:vortex-file-compressed 🚨 18431189 16700091 1.10
tpcds_q85/duckdb:vortex-file-compressed 42886900 39615830 1.08
tpcds_q86/duckdb:vortex-file-compressed 16482786 16304673 1.01
tpcds_q87/duckdb:vortex-file-compressed 41330153 42895470 0.96
tpcds_q88/duckdb:vortex-file-compressed 50470490 52940172 0.95
tpcds_q89/duckdb:vortex-file-compressed 21634843 21786868 0.99
tpcds_q90/duckdb:vortex-file-compressed 10045839 10537598 0.95
tpcds_q91/duckdb:vortex-file-compressed 21807080 21942915 0.99
tpcds_q92/duckdb:vortex-file-compressed 17983548 17999830 1.00
tpcds_q93/duckdb:vortex-file-compressed 29103268 31961826 0.91
tpcds_q94/duckdb:vortex-file-compressed 21647162 22197080 0.98
tpcds_q95/duckdb:vortex-file-compressed 149226588 156008864 0.96
tpcds_q96/duckdb:vortex-file-compressed 11857675 12533038 0.95
tpcds_q97/duckdb:vortex-file-compressed 38632539 38430624 1.01
tpcds_q98/duckdb:vortex-file-compressed 18583576 18591468 1.00
tpcds_q99/duckdb:vortex-file-compressed 🚀 22337421 28427511 0.79
duckdb / vortex-compact (1.007x ➖, 1↑ 2↓)
name PR 49cce3b (ns) base 170ff39 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-compact 26031017 27158137 0.96
tpcds_q02/duckdb:vortex-compact 32448499 36036716 0.90
tpcds_q03/duckdb:vortex-compact 44744365 45373406 0.99
tpcds_q04/duckdb:vortex-compact 107105943 102685447 1.04
tpcds_q05/duckdb:vortex-compact 39156176 40682651 0.96
tpcds_q06/duckdb:vortex-compact 39665725 40215713 0.99
tpcds_q07/duckdb:vortex-compact 36321785 34957789 1.04
tpcds_q08/duckdb:vortex-compact 39852694 41176389 0.97
tpcds_q09/duckdb:vortex-compact 19371116 19416436 1.00
tpcds_q10/duckdb:vortex-compact 52718881 53423443 0.99
tpcds_q11/duckdb:vortex-compact 73164268 72579901 1.01
tpcds_q12/duckdb:vortex-compact 21829752 22122041 0.99
tpcds_q13/duckdb:vortex-compact 53149336 53576568 0.99
tpcds_q14/duckdb:vortex-compact 122872661 114205483 1.08
tpcds_q15/duckdb:vortex-compact 31687210 30244395 1.05
tpcds_q16/duckdb:vortex-compact 27515933 27220137 1.01
tpcds_q17/duckdb:vortex-compact 56103057 56251869 1.00
tpcds_q18/duckdb:vortex-compact 49781557 50559045 0.98
tpcds_q19/duckdb:vortex-compact 43923133 44144199 0.99
tpcds_q20/duckdb:vortex-compact 21126359 20948872 1.01
tpcds_q21/duckdb:vortex-compact 17957948 17660651 1.02
tpcds_q22/duckdb:vortex-compact 81537991 79002399 1.03
tpcds_q23/duckdb:vortex-compact 104547790 95444535 1.10
tpcds_q24/duckdb:vortex-compact 58749638 58619065 1.00
tpcds_q25/duckdb:vortex-compact 54814180 53987967 1.02
tpcds_q26/duckdb:vortex-compact 32358968 32728921 0.99
tpcds_q27/duckdb:vortex-compact 37467304 37842705 0.99
tpcds_q28/duckdb:vortex-compact 34785739 34936005 1.00
tpcds_q29/duckdb:vortex-compact 54299860 52962785 1.03
tpcds_q30/duckdb:vortex-compact 29446715 28999563 1.02
tpcds_q31/duckdb:vortex-compact 37318476 35772494 1.04
tpcds_q32/duckdb:vortex-compact 21943403 21092347 1.04
tpcds_q33/duckdb:vortex-compact 33154265 33056104 1.00
tpcds_q34/duckdb:vortex-compact 30370103 30432572 1.00
tpcds_q35/duckdb:vortex-compact 75794323 78132011 0.97
tpcds_q36/duckdb:vortex-compact 36408995 35066722 1.04
tpcds_q37/duckdb:vortex-compact 24215315 23527594 1.03
tpcds_q38/duckdb:vortex-compact 45539099 42713886 1.07
tpcds_q39/duckdb:vortex-compact 38635207 39235670 0.98
tpcds_q40/duckdb:vortex-compact 23959506 24201401 0.99
tpcds_q41/duckdb:vortex-compact 10624032 10830468 0.98
tpcds_q42/duckdb:vortex-compact 19672220 18937283 1.04
tpcds_q43/duckdb:vortex-compact 30666568 30068047 1.02
tpcds_q44/duckdb:vortex-compact 27987589 29931942 0.94
tpcds_q45/duckdb:vortex-compact 36407638 36042106 1.01
tpcds_q46/duckdb:vortex-compact 44864697 43286914 1.04
tpcds_q47/duckdb:vortex-compact 62317133 63184409 0.99
tpcds_q48/duckdb:vortex-compact 45250323 45131214 1.00
tpcds_q49/duckdb:vortex-compact 47072970 49738725 0.95
tpcds_q50/duckdb:vortex-compact 37558452 38414882 0.98
tpcds_q51/duckdb:vortex-compact 110873334 111194095 1.00
tpcds_q52/duckdb:vortex-compact 19167165 19473595 0.98
tpcds_q53/duckdb:vortex-compact 32526943 32387670 1.00
tpcds_q54/duckdb:vortex-compact 36768743 36535867 1.01
tpcds_q55/duckdb:vortex-compact 18826301 18398271 1.02
tpcds_q56/duckdb:vortex-compact 34858492 33541985 1.04
tpcds_q57/duckdb:vortex-compact 45721525 44581814 1.03
tpcds_q58/duckdb:vortex-compact 38053738 36411107 1.05
tpcds_q59/duckdb:vortex-compact 68081290 67412098 1.01
tpcds_q60/duckdb:vortex-compact 35073486 36795343 0.95
tpcds_q61/duckdb:vortex-compact 53106630 53745960 0.99
tpcds_q62/duckdb:vortex-compact 20076877 20272273 0.99
tpcds_q63/duckdb:vortex-compact 32050190 30973300 1.03
tpcds_q64/duckdb:vortex-compact 127467680 125629407 1.01
tpcds_q65/duckdb:vortex-compact 30458759 31324695 0.97
tpcds_q66/duckdb:vortex-compact 36477486 35410036 1.03
tpcds_q67/duckdb:vortex-compact 155550047 153508408 1.01
tpcds_q68/duckdb:vortex-compact 44942701 45918156 0.98
tpcds_q69/duckdb:vortex-compact 54779872 54469744 1.01
tpcds_q70/duckdb:vortex-compact 59243241 58366445 1.02
tpcds_q71/duckdb:vortex-compact 30717998 29504042 1.04
tpcds_q72/duckdb:vortex-compact 186666573 184023957 1.01
tpcds_q73/duckdb:vortex-compact 28764917 27870748 1.03
tpcds_q74/duckdb:vortex-compact 49106435 48004418 1.02
tpcds_q75/duckdb:vortex-compact 58564532 62089005 0.94
tpcds_q76/duckdb:vortex-compact 30727398 28820743 1.07
tpcds_q77/duckdb:vortex-compact 🚨 42903702 38397532 1.12
tpcds_q78/duckdb:vortex-compact 85648716 87252695 0.98
tpcds_q79/duckdb:vortex-compact 40985397 41985643 0.98
tpcds_q80/duckdb:vortex-compact 70229074 69816268 1.01
tpcds_q81/duckdb:vortex-compact 34246552 33827895 1.01
tpcds_q82/duckdb:vortex-compact 51444795 50122508 1.03
tpcds_q83/duckdb:vortex-compact 37364685 34166597 1.09
tpcds_q84/duckdb:vortex-compact 🚨 22835840 20559965 1.11
tpcds_q85/duckdb:vortex-compact 55628067 54152018 1.03
tpcds_q86/duckdb:vortex-compact 🚀 21378924 24611760 0.87
tpcds_q87/duckdb:vortex-compact 47311308 47612891 0.99
tpcds_q88/duckdb:vortex-compact 75836377 76075404 1.00
tpcds_q89/duckdb:vortex-compact 31947240 33111149 0.96
tpcds_q90/duckdb:vortex-compact 11393273 10677871 1.07
tpcds_q91/duckdb:vortex-compact 39721643 40969203 0.97
tpcds_q92/duckdb:vortex-compact 45946362 44559640 1.03
tpcds_q93/duckdb:vortex-compact 32355709 32696394 0.99
tpcds_q94/duckdb:vortex-compact 27503670 27572789 1.00
tpcds_q95/duckdb:vortex-compact 163868602 165033952 0.99
tpcds_q96/duckdb:vortex-compact 17147581 16324283 1.05
tpcds_q97/duckdb:vortex-compact 43479794 42221333 1.03
tpcds_q98/duckdb:vortex-compact 27806773 27233813 1.02
tpcds_q99/duckdb:vortex-compact 26217514 26795874 0.98
duckdb / parquet (1.007x ➖, 2↑ 0↓)
name PR 49cce3b (ns) base 170ff39 (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 29236585 29953627 0.98
tpcds_q02/duckdb:parquet 24172115 24435954 0.99
tpcds_q03/duckdb:parquet 🚀 12491975 14018318 0.89
tpcds_q04/duckdb:parquet 171975956 168114225 1.02
tpcds_q05/duckdb:parquet 33108726 31250737 1.06
tpcds_q06/duckdb:parquet 33458122 33594851 1.00
tpcds_q07/duckdb:parquet 24033125 23408818 1.03
tpcds_q08/duckdb:parquet 29083757 29366696 0.99
tpcds_q09/duckdb:parquet 44061650 44364502 0.99
tpcds_q10/duckdb:parquet 37142547 37573834 0.99
tpcds_q11/duckdb:parquet 91818482 91208127 1.01
tpcds_q12/duckdb:parquet 17039129 17337881 0.98
tpcds_q13/duckdb:parquet 35308930 35199497 1.00
tpcds_q14/duckdb:parquet 99466919 102490005 0.97
tpcds_q15/duckdb:parquet 30466970 31168732 0.98
tpcds_q16/duckdb:parquet 22552054 22828112 0.99
tpcds_q17/duckdb:parquet 38396248 38484503 1.00
tpcds_q18/duckdb:parquet 48569090 48455137 1.00
tpcds_q19/duckdb:parquet 31691524 31379188 1.01
tpcds_q20/duckdb:parquet 18614895 18516578 1.01
tpcds_q21/duckdb:parquet 11637988 11466624 1.01
tpcds_q22/duckdb:parquet 71955502 69759957 1.03
tpcds_q23/duckdb:parquet 82294996 83763522 0.98
tpcds_q24/duckdb:parquet 46488892 46526637 1.00
tpcds_q25/duckdb:parquet 35593430 35527469 1.00
tpcds_q26/duckdb:parquet 39600900 38872548 1.02
tpcds_q27/duckdb:parquet 52954823 53105286 1.00
tpcds_q28/duckdb:parquet 42448269 42894240 0.99
tpcds_q29/duckdb:parquet 38065278 40345943 0.94
tpcds_q30/duckdb:parquet 37821265 37285626 1.01
tpcds_q31/duckdb:parquet 29026771 28477765 1.02
tpcds_q32/duckdb:parquet 13532598 12554490 1.08
tpcds_q33/duckdb:parquet 24002360 23013685 1.04
tpcds_q34/duckdb:parquet 23523611 23050126 1.02
tpcds_q35/duckdb:parquet 63187679 61215455 1.03
tpcds_q36/duckdb:parquet 22899344 22724045 1.01
tpcds_q37/duckdb:parquet 14920040 14126294 1.06
tpcds_q38/duckdb:parquet 37703869 36435651 1.03
tpcds_q39/duckdb:parquet 33287721 32000167 1.04
tpcds_q40/duckdb:parquet 20677551 19176016 1.08
tpcds_q41/duckdb:parquet 9193330 8746997 1.05
tpcds_q42/duckdb:parquet 12845464 12675075 1.01
tpcds_q43/duckdb:parquet 19512380 19258234 1.01
tpcds_q44/duckdb:parquet 27772720 26065577 1.07
tpcds_q45/duckdb:parquet 28738410 28600987 1.00
tpcds_q46/duckdb:parquet 49268398 47338178 1.04
tpcds_q47/duckdb:parquet 51018370 49578608 1.03
tpcds_q48/duckdb:parquet 32195137 32350424 1.00
tpcds_q49/duckdb:parquet 29063087 29016215 1.00
tpcds_q50/duckdb:parquet 26577348 26008306 1.02
tpcds_q51/duckdb:parquet 108838866 103639975 1.05
tpcds_q52/duckdb:parquet 13323806 13536934 0.98
tpcds_q53/duckdb:parquet 20025922 18540722 1.08
tpcds_q54/duckdb:parquet 29990763 28791778 1.04
tpcds_q55/duckdb:parquet 12371826 12934006 0.96
tpcds_q56/duckdb:parquet 24224061 24158914 1.00
tpcds_q57/duckdb:parquet 38620960 38239197 1.01
tpcds_q58/duckdb:parquet 26473386 25475774 1.04
tpcds_q59/duckdb:parquet 36271682 36363440 1.00
tpcds_q60/duckdb:parquet 26626866 25841272 1.03
tpcds_q61/duckdb:parquet 34191306 32495788 1.05
tpcds_q62/duckdb:parquet 12842948 12618800 1.02
tpcds_q63/duckdb:parquet 17979849 17285213 1.04
tpcds_q64/duckdb:parquet 82513258 80752693 1.02
tpcds_q65/duckdb:parquet 23243935 23118416 1.01
tpcds_q66/duckdb:parquet 29530954 29062875 1.02
tpcds_q67/duckdb:parquet 139604354 137020614 1.02
tpcds_q68/duckdb:parquet 39171739 38372153 1.02
tpcds_q69/duckdb:parquet 38407167 38315625 1.00
tpcds_q70/duckdb:parquet 22488260 22913458 0.98
tpcds_q71/duckdb:parquet 23102289 22477687 1.03
tpcds_q72/duckdb:parquet 167788997 166418867 1.01
tpcds_q73/duckdb:parquet 21028901 20999461 1.00
tpcds_q74/duckdb:parquet 128210383 127597268 1.00
tpcds_q75/duckdb:parquet 57692167 57721849 1.00
tpcds_q76/duckdb:parquet 21885765 22075800 0.99
tpcds_q77/duckdb:parquet 25099955 26094886 0.96
tpcds_q78/duckdb:parquet 77291535 77758344 0.99
tpcds_q79/duckdb:parquet 30411426 29525394 1.03
tpcds_q80/duckdb:parquet 43699932 45352653 0.96
tpcds_q81/duckdb:parquet 35246524 35264349 1.00
tpcds_q82/duckdb:parquet 16680554 18470127 0.90
tpcds_q83/duckdb:parquet 18601192 18595792 1.00
tpcds_q84/duckdb:parquet 20559720 21781352 0.94
tpcds_q85/duckdb:parquet 42354911 42118982 1.01
tpcds_q86/duckdb:parquet 14069890 13600119 1.03
tpcds_q87/duckdb:parquet 39197814 39119363 1.00
tpcds_q88/duckdb:parquet 54023466 53608603 1.01
tpcds_q89/duckdb:parquet 21935083 22091965 0.99
tpcds_q90/duckdb:parquet 8235764 8430957 0.98
tpcds_q91/duckdb:parquet 25225922 25802324 0.98
tpcds_q92/duckdb:parquet 13359464 12791265 1.04
tpcds_q93/duckdb:parquet 32031838 31507928 1.02
tpcds_q94/duckdb:parquet 18080642 17994389 1.00
tpcds_q95/duckdb:parquet 🚀 131737853 148434931 0.89
tpcds_q96/duckdb:parquet 10928457 10430172 1.05
tpcds_q97/duckdb:parquet 38830015 37902122 1.02
tpcds_q98/duckdb:parquet 24742895 25025023 0.99
tpcds_q99/duckdb:parquet 20260291 20340004 1.00
duckdb / duckdb (1.012x ➖, 1↑ 3↓)
name PR 49cce3b (ns) base 170ff39 (ns) ratio (PR/base)
tpcds_q01/duckdb:duckdb 21461078 22419755 0.96
tpcds_q02/duckdb:duckdb 20837971 19650091 1.06
tpcds_q03/duckdb:duckdb 10360602 10234231 1.01
tpcds_q04/duckdb:duckdb 179302537 179419007 1.00
tpcds_q05/duckdb:duckdb 21418890 21061604 1.02
tpcds_q06/duckdb:duckdb 27705919 28177655 0.98
tpcds_q07/duckdb:duckdb 40119256 40141346 1.00
tpcds_q08/duckdb:duckdb 120734708 120485231 1.00
tpcds_q09/duckdb:duckdb 20692810 20477465 1.01
tpcds_q10/duckdb:duckdb 27523943 27512042 1.00
tpcds_q11/duckdb:duckdb 91757583 94160922 0.97
tpcds_q12/duckdb:duckdb 14057067 13866428 1.01
tpcds_q13/duckdb:duckdb 27832150 26197063 1.06
tpcds_q14/duckdb:duckdb 96092740 98668094 0.97
tpcds_q15/duckdb:duckdb 25248116 24682227 1.02
tpcds_q16/duckdb:duckdb 20701121 19341145 1.07
tpcds_q17/duckdb:duckdb 25393100 24654111 1.03
tpcds_q18/duckdb:duckdb 47322918 46440080 1.02
tpcds_q19/duckdb:duckdb 20137701 19022288 1.06
tpcds_q20/duckdb:duckdb 14567450 14525345 1.00
tpcds_q21/duckdb:duckdb 🚨 8189361 7388187 1.11
tpcds_q22/duckdb:duckdb 62250849 64432053 0.97
tpcds_q23/duckdb:duckdb 81378808 77630407 1.05
tpcds_q24/duckdb:duckdb 26085961 25339207 1.03
tpcds_q25/duckdb:duckdb 19267677 18410150 1.05
tpcds_q26/duckdb:duckdb 29135758 28133035 1.04
tpcds_q27/duckdb:duckdb 42284000 41503379 1.02
tpcds_q28/duckdb:duckdb 26537514 26339072 1.01
tpcds_q29/duckdb:duckdb 23694942 23713392 1.00
tpcds_q30/duckdb:duckdb 31036827 30930674 1.00
tpcds_q31/duckdb:duckdb 51732238 52076444 0.99
tpcds_q32/duckdb:duckdb 8452887 8488063 1.00
tpcds_q33/duckdb:duckdb 16144008 15828501 1.02
tpcds_q34/duckdb:duckdb 17350303 18542118 0.94
tpcds_q35/duckdb:duckdb 37518335 36922554 1.02
tpcds_q36/duckdb:duckdb 72145428 69613717 1.04
tpcds_q37/duckdb:duckdb 8789580 8815729 1.00
tpcds_q38/duckdb:duckdb 32929707 33210603 0.99
tpcds_q39/duckdb:duckdb 28407241 28731337 0.99
tpcds_q40/duckdb:duckdb 14777658 14191664 1.04
tpcds_q41/duckdb:duckdb 9520146 9537703 1.00
tpcds_q42/duckdb:duckdb 8766371 8631339 1.02
tpcds_q43/duckdb:duckdb 14770738 14646781 1.01
tpcds_q44/duckdb:duckdb 15633970 15304388 1.02
tpcds_q45/duckdb:duckdb 18565722 18590504 1.00
tpcds_q46/duckdb:duckdb 38129538 38016543 1.00
tpcds_q47/duckdb:duckdb 46290043 46481928 1.00
tpcds_q48/duckdb:duckdb 25160917 24639634 1.02
tpcds_q49/duckdb:duckdb 20318037 21671646 0.94
tpcds_q50/duckdb:duckdb 15986581 15735929 1.02
tpcds_q51/duckdb:duckdb 100417488 98480510 1.02
tpcds_q52/duckdb:duckdb 🚨 10890436 9228037 1.18
tpcds_q53/duckdb:duckdb 17709731 17600563 1.01
tpcds_q54/duckdb:duckdb 19455451 18493509 1.05
tpcds_q55/duckdb:duckdb 10224246 9408666 1.09
tpcds_q56/duckdb:duckdb 16913922 16773971 1.01
tpcds_q57/duckdb:duckdb 36251475 36071099 1.01
tpcds_q58/duckdb:duckdb 17493044 16645997 1.05
tpcds_q59/duckdb:duckdb 36820895 36954127 1.00
tpcds_q60/duckdb:duckdb 19722874 18017040 1.09
tpcds_q61/duckdb:duckdb 16213602 16525389 0.98
tpcds_q62/duckdb:duckdb 9966410 9624805 1.04
tpcds_q63/duckdb:duckdb 16553886 16138199 1.03
tpcds_q64/duckdb:duckdb 59088543 58674671 1.01
tpcds_q65/duckdb:duckdb 35941677 36410398 0.99
tpcds_q66/duckdb:duckdb 26498827 26533157 1.00
tpcds_q67/duckdb:duckdb 133366261 130635901 1.02
tpcds_q68/duckdb:duckdb 26334351 27383463 0.96
tpcds_q69/duckdb:duckdb 27377952 27363658 1.00
tpcds_q70/duckdb:duckdb 16749429 16780683 1.00
tpcds_q71/duckdb:duckdb 15914165 16440964 0.97
tpcds_q72/duckdb:duckdb 49054539 45482282 1.08
tpcds_q73/duckdb:duckdb 12986410 13823801 0.94
tpcds_q74/duckdb:duckdb 146698417 143986650 1.02
tpcds_q75/duckdb:duckdb 46475885 45983954 1.01
tpcds_q76/duckdb:duckdb 14662221 15172618 0.97
tpcds_q77/duckdb:duckdb 15687920 14901055 1.05
tpcds_q78/duckdb:duckdb 65307819 65476635 1.00
tpcds_q79/duckdb:duckdb 20211108 20314956 0.99
tpcds_q80/duckdb:duckdb 31563738 32586851 0.97
tpcds_q81/duckdb:duckdb 41671931 40451413 1.03
tpcds_q82/duckdb:duckdb 🚨 12027027 10416968 1.15
tpcds_q83/duckdb:duckdb 11184821 10959504 1.02
tpcds_q84/duckdb:duckdb 14798734 15253733 0.97
tpcds_q85/duckdb:duckdb 26524265 25909706 1.02
tpcds_q86/duckdb:duckdb 12361065 11987150 1.03
tpcds_q87/duckdb:duckdb 37676882 35688539 1.06
tpcds_q88/duckdb:duckdb 30716431 29237223 1.05
tpcds_q89/duckdb:duckdb 21953946 22469937 0.98
tpcds_q90/duckdb:duckdb 6577284 6245900 1.05
tpcds_q91/duckdb:duckdb 15279897 14865332 1.03
tpcds_q92/duckdb:duckdb 🚀 9750961 10969474 0.89
tpcds_q93/duckdb:duckdb 23610376 23762960 0.99
tpcds_q94/duckdb:duckdb 14448342 14517425 1.00
tpcds_q95/duckdb:duckdb 118932638 130231876 0.91
tpcds_q96/duckdb:duckdb 5780890 5609572 1.03
tpcds_q97/duckdb:duckdb 31745679 32054685 0.99
tpcds_q98/duckdb:duckdb 21508967 21371443 1.01
tpcds_q99/duckdb:duckdb 16799636 16748398 1.00
File Size Changes (15 files changed, +0.4% overall, 12↑ 3↓)
File Scale Format Base HEAD Change %
date_dim.vortex 1.0 vortex-file-compressed 956.61 KB 1.03 MB +98.77 KB +10.3%
store_returns.vortex 1.0 vortex-file-compressed 10.97 MB 11.39 MB +421.59 KB +3.8%
catalog_returns.vortex 1.0 vortex-file-compressed 7.16 MB 7.43 MB +273.66 KB +3.7%
item.vortex 1.0 vortex-file-compressed 1.63 MB 1.66 MB +30.27 KB +1.8%
date_dim.vortex 1.0 vortex-compact 151.55 KB 154.03 KB +2.48 KB +1.6%
catalog_page.vortex 1.0 vortex-file-compressed 565.70 KB 571.28 KB +5.59 KB +1.0%
store_sales.vortex 1.0 vortex-file-compressed 96.34 MB 97.04 MB +721.73 KB +0.7%
catalog_sales.vortex 1.0 vortex-file-compressed 70.45 MB 70.78 MB +340.13 KB +0.5%
customer_address.vortex 1.0 vortex-file-compressed 826.70 KB 830.46 KB +3.77 KB +0.5%
web_sales.vortex 1.0 vortex-file-compressed 34.20 MB 34.27 MB +64.74 KB +0.2%
time_dim.vortex 1.0 vortex-file-compressed 380.14 KB 380.43 KB +296 B +0.1%
customer.vortex 1.0 vortex-file-compressed 4.26 MB 4.26 MB +1.00 KB +0.0%
catalog_sales.vortex 1.0 vortex-compact 59.32 MB 59.31 MB 3.31 KB -0.0%
item.vortex 1.0 vortex-compact 994.96 KB 994.60 KB 376 B -0.0%
catalog_page.vortex 1.0 vortex-compact 363.54 KB 362.70 KB 856 B -0.2%

Totals:

  • vortex-compact: 207.50 MB → 207.50 MB (-0.0%)
  • vortex-file-compressed: 269.94 MB → 271.85 MB (+0.7%)

@github-actions

github-actions Bot commented Jun 16, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +0.2%
Engines: DataFusion No clear signal (+1.1%, environment too noisy confidence) · DuckDB No clear signal (-0.8%, environment too noisy confidence)
Vortex (geomean): 0.953x ➖
Parquet (geomean): 0.952x ➖
Shifts: Parquet (control) -4.8% · Median polish +0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.861x ➖, 3↑ 0↓)
name PR 49cce3b (ns) base 170ff39 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚀 32713708 58056486 0.56
fineweb_q01/datafusion:vortex-file-compressed 🚀 527124533 937154062 0.56
fineweb_q02/datafusion:vortex-file-compressed 🚀 548117693 1127276431 0.49
fineweb_q03/datafusion:vortex-file-compressed 1168799479 1103499245 1.06
fineweb_q04/datafusion:vortex-file-compressed 1182809635 1194896020 0.99
fineweb_q05/datafusion:vortex-file-compressed 1222767619 1082798970 1.13
fineweb_q06/datafusion:vortex-file-compressed 1382402027 1234600721 1.12
fineweb_q07/datafusion:vortex-file-compressed 1237598748 1093375150 1.13
fineweb_q08/datafusion:vortex-file-compressed 533195140 472412303 1.13
datafusion / vortex-compact (1.022x ➖, 0↑ 1↓)
name PR 49cce3b (ns) base 170ff39 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 35608225 34917389 1.02
fineweb_q01/datafusion:vortex-compact 583164288 686749634 0.85
fineweb_q02/datafusion:vortex-compact 602843134 667842892 0.90
fineweb_q03/datafusion:vortex-compact 1398647637 1421877621 0.98
fineweb_q04/datafusion:vortex-compact 1641538421 1668964614 0.98
fineweb_q05/datafusion:vortex-compact 1405991500 1398070712 1.01
fineweb_q06/datafusion:vortex-compact 1407967681 1280269679 1.10
fineweb_q07/datafusion:vortex-compact 1305320015 1190017921 1.10
fineweb_q08/datafusion:vortex-compact 🚨 532445310 401352795 1.33
datafusion / parquet (0.928x ➖, 0↑ 0↓)
name PR 49cce3b (ns) base 170ff39 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 1169817868 1249166954 0.94
fineweb_q01/datafusion:parquet 1884901576 2059002849 0.92
fineweb_q02/datafusion:parquet 1729991624 2038131450 0.85
fineweb_q03/datafusion:parquet 1776679370 1992849704 0.89
fineweb_q04/datafusion:parquet 1800172312 2252363844 0.80
fineweb_q05/datafusion:parquet 1902953296 1982499013 0.96
fineweb_q06/datafusion:parquet 2154238357 1991358477 1.08
fineweb_q07/datafusion:parquet 1956230080 2021315605 0.97
fineweb_q08/datafusion:parquet 2000185971 2040726365 0.98
duckdb / vortex-file-compressed (0.976x ➖, 0↑ 0↓)
name PR 49cce3b (ns) base 170ff39 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 82983653 116288544 0.71
fineweb_q01/duckdb:vortex-file-compressed 621928291 564857781 1.10
fineweb_q02/duckdb:vortex-file-compressed 544362058 608347989 0.89
fineweb_q03/duckdb:vortex-file-compressed 1512899729 1353588040 1.12
fineweb_q04/duckdb:vortex-file-compressed 1491661198 1506569378 0.99
fineweb_q05/duckdb:vortex-file-compressed 1358896699 1343787616 1.01
fineweb_q06/duckdb:vortex-file-compressed 1553700350 1503136771 1.03
fineweb_q07/duckdb:vortex-file-compressed 1322867049 1302501826 1.02
fineweb_q08/duckdb:vortex-file-compressed 543965189 560345620 0.97
duckdb / vortex-compact (0.961x ➖, 0↑ 0↓)
name PR 49cce3b (ns) base 170ff39 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 60599661 79611417 0.76
fineweb_q01/duckdb:vortex-compact 616148181 748738932 0.82
fineweb_q02/duckdb:vortex-compact 626459476 594742705 1.05
fineweb_q03/duckdb:vortex-compact 1796148171 1748136637 1.03
fineweb_q04/duckdb:vortex-compact 1875693501 1863499205 1.01
fineweb_q05/duckdb:vortex-compact 1701253206 1622519790 1.05
fineweb_q06/duckdb:vortex-compact 1563046885 1580393614 0.99
fineweb_q07/duckdb:vortex-compact 1449978192 1449341134 1.00
fineweb_q08/duckdb:vortex-compact 482085957 488131053 0.99
duckdb / parquet (0.976x ➖, 0↑ 0↓)
name PR 49cce3b (ns) base 170ff39 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1225634018 1081923257 1.13
fineweb_q01/duckdb:parquet 1377203384 1412027782 0.98
fineweb_q02/duckdb:parquet 1322178800 1456825258 0.91
fineweb_q03/duckdb:parquet 3868558639 3981742189 0.97
fineweb_q04/duckdb:parquet 2036246756 2057732586 0.99
fineweb_q05/duckdb:parquet 2150576261 2258784859 0.95
fineweb_q06/duckdb:parquet 4474586642 4698061354 0.95
fineweb_q07/duckdb:parquet 2752844535 2841859934 0.97
fineweb_q08/duckdb:parquet 1120552330 1183123142 0.95

@github-actions

github-actions Bot commented Jun 16, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: Statistical and Population Genetics

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -3.8%
Engines: DuckDB No clear signal (-3.8%, low confidence)
Vortex (geomean): 0.958x ➖
Parquet (geomean): 0.996x ➖
Shifts: Parquet (control) -0.4% · Median polish -1.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
duckdb / vortex-file-compressed (0.923x ➖, 2↑ 0↓)
name PR 49cce3b (ns) base 170ff39 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 13018442 12221685 1.07
statpopgen_q01/duckdb:vortex-file-compressed 27620973 27417673 1.01
statpopgen_q02/duckdb:vortex-file-compressed 533907208 526802614 1.01
statpopgen_q03/duckdb:vortex-file-compressed 1041723190 1052238254 0.99
statpopgen_q04/duckdb:vortex-file-compressed 1056778745 1078132351 0.98
statpopgen_q05/duckdb:vortex-file-compressed 508033552 507088490 1.00
statpopgen_q06/duckdb:vortex-file-compressed 1541001765 1559061850 0.99
statpopgen_q07/duckdb:vortex-file-compressed 🚀 200444352 310895986 0.64
statpopgen_q08/duckdb:vortex-file-compressed 🚀 229362269 349739499 0.66
statpopgen_q09/duckdb:vortex-file-compressed 834596353 865818385 0.96
statpopgen_q10/duckdb:vortex-file-compressed 2555699575 2614796580 0.98
duckdb / vortex-compact (0.994x ➖, 0↑ 0↓)
name PR 49cce3b (ns) base 170ff39 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact 12225410 12067905 1.01
statpopgen_q01/duckdb:vortex-compact 222605805 217419058 1.02
statpopgen_q02/duckdb:vortex-compact 568592526 574609281 0.99
statpopgen_q03/duckdb:vortex-compact 1160859388 1179151794 0.98
statpopgen_q04/duckdb:vortex-compact 1166044564 1192579637 0.98
statpopgen_q05/duckdb:vortex-compact 590384009 577521942 1.02
statpopgen_q06/duckdb:vortex-compact 1502753390 1504375232 1.00
statpopgen_q07/duckdb:vortex-compact 894668870 905503485 0.99
statpopgen_q08/duckdb:vortex-compact 937593880 946734010 0.99
statpopgen_q09/duckdb:vortex-compact 927976174 965291933 0.96
statpopgen_q10/duckdb:vortex-compact 2632930984 2655912685 0.99
duckdb / parquet (0.996x ➖, 0↑ 0↓)
name PR 49cce3b (ns) base 170ff39 (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 309658618 315518711 0.98
statpopgen_q01/duckdb:parquet 392972253 394678602 1.00
statpopgen_q02/duckdb:parquet 777684603 786261916 0.99
statpopgen_q03/duckdb:parquet 1198915964 1186297501 1.01
statpopgen_q04/duckdb:parquet 1218148894 1216121586 1.00
statpopgen_q05/duckdb:parquet 823319628 830003632 0.99
statpopgen_q06/duckdb:parquet 1435406551 1435349110 1.00
statpopgen_q07/duckdb:parquet 874752642 872859580 1.00
statpopgen_q08/duckdb:parquet 872310165 882432522 0.99
statpopgen_q09/duckdb:parquet 1042692572 1033307426 1.01
statpopgen_q10/duckdb:parquet 2250934695 2271644645 0.99
File Size Changes (1 files changed, +4.7% overall, 1↑ 0↓)
File Scale Format Base HEAD Change %
gnomad.genomes.v3.1.2.hgdp_tgp.chr21.vortex 100000 vortex-file-compressed 1.83 GB 1.96 GB +132.13 MB +7.1%

Totals:

  • vortex-compact: 959.62 MB → 959.62 MB (0.0%)
  • vortex-file-compressed: 1.83 GB → 1.96 GB (+7.0%)

@github-actions

github-actions Bot commented Jun 16, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: Random Access

Vortex (geomean): 0.936x ➖
Parquet (geomean): 1.014x ➖

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
unknown / unknown (1.017x ➖, 5↑ 1↓)
name PR 49cce3b (ns) base 170ff39 (ns) ratio (PR/base)
random-access/feature-vectors/correlated/lance-tokio-local-disk 🚨 1786391 365662 4.89
random-access/feature-vectors/correlated/lance-tokio-local-disk-footer 1049953 1021646 1.03
random-access/feature-vectors/correlated/parquet-tokio-local-disk 8431154399 8384729372 1.01
random-access/feature-vectors/correlated/parquet-tokio-local-disk-footer 8324492482 8164452716 1.02
random-access/feature-vectors/correlated/vortex-tokio-local-disk 3476039 3599036 0.97
random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer 🚀 2577087 2949613 0.87
random-access/feature-vectors/uniform/lance-tokio-local-disk 1199476 1147730 1.05
random-access/feature-vectors/uniform/lance-tokio-local-disk-footer 1867570 1796914 1.04
random-access/feature-vectors/uniform/parquet-tokio-local-disk 8318645798 8269580832 1.01
random-access/feature-vectors/uniform/parquet-tokio-local-disk-footer 8287111277 8295239860 1.00
random-access/feature-vectors/uniform/vortex-tokio-local-disk 3512365 3514007 1.00
random-access/feature-vectors/uniform/vortex-tokio-local-disk-footer 5884216 5900126 1.00
random-access/lance-tokio-local-disk 628964 618415 1.02
random-access/lance-tokio-local-disk-footer 1279221 1270293 1.01
random-access/nested-lists/correlated/lance-tokio-local-disk 235569 238172 0.99
random-access/nested-lists/correlated/lance-tokio-local-disk-footer 577096 578151 1.00
random-access/nested-lists/correlated/parquet-tokio-local-disk 129412163 126963475 1.02
random-access/nested-lists/correlated/parquet-tokio-local-disk-footer 129281826 126837414 1.02
random-access/nested-lists/correlated/vortex-tokio-local-disk 425556 453829 0.94
random-access/nested-lists/correlated/vortex-tokio-local-disk-footer 557504 586536 0.95
random-access/nested-lists/uniform/lance-tokio-local-disk 1011302 1001602 1.01
random-access/nested-lists/uniform/lance-tokio-local-disk-footer 1358669 1345697 1.01
random-access/nested-lists/uniform/parquet-tokio-local-disk 129408248 128519979 1.01
random-access/nested-lists/uniform/parquet-tokio-local-disk-footer 129364215 129416281 1.00
random-access/nested-lists/uniform/vortex-tokio-local-disk 1973596 1971989 1.00
random-access/nested-lists/uniform/vortex-tokio-local-disk-footer 2092244 2100357 1.00
random-access/nested-structs/correlated/lance-tokio-local-disk 364845 362890 1.01
random-access/nested-structs/correlated/lance-tokio-local-disk-footer 542676 541737 1.00
random-access/nested-structs/correlated/parquet-tokio-local-disk 21655307 21168216 1.02
random-access/nested-structs/correlated/parquet-tokio-local-disk-footer 22019172 21143797 1.04
random-access/nested-structs/correlated/vortex-tokio-local-disk 547281 555974 0.98
random-access/nested-structs/correlated/vortex-tokio-local-disk-footer 706449 724300 0.98
random-access/nested-structs/uniform/lance-tokio-local-disk 2649651 2615540 1.01
random-access/nested-structs/uniform/lance-tokio-local-disk-footer 2788016 2745542 1.02
random-access/nested-structs/uniform/parquet-tokio-local-disk 21862534 21294905 1.03
random-access/nested-structs/uniform/parquet-tokio-local-disk-footer 21841372 21211021 1.03
random-access/nested-structs/uniform/vortex-tokio-local-disk 1414803 1385444 1.02
random-access/nested-structs/uniform/vortex-tokio-local-disk-footer 1509936 1526184 0.99
random-access/parquet-tokio-local-disk 164591479 163441980 1.01
random-access/parquet-tokio-local-disk-footer 164880808 163549995 1.01
random-access/taxi/correlated/lance-tokio-local-disk 922877 908155 1.02
random-access/taxi/correlated/lance-tokio-local-disk-footer 1770929 1753021 1.01
random-access/taxi/correlated/parquet-tokio-local-disk 246772920 244599416 1.01
random-access/taxi/correlated/parquet-tokio-local-disk-footer 246667413 245284623 1.01
random-access/taxi/correlated/vortex-tokio-local-disk 🚀 976942 1212179 0.81
random-access/taxi/correlated/vortex-tokio-local-disk-footer 1489823 1651915 0.90
random-access/taxi/uniform/lance-tokio-local-disk 9296415 9090796 1.02
random-access/taxi/uniform/lance-tokio-local-disk-footer 9829644 9655089 1.02
random-access/taxi/uniform/parquet-tokio-local-disk 262493602 259927190 1.01
random-access/taxi/uniform/parquet-tokio-local-disk-footer 266218563 260929983 1.02
random-access/taxi/uniform/vortex-tokio-local-disk 🚀 3069347 3663187 0.84
random-access/taxi/uniform/vortex-tokio-local-disk-footer 3918487 4243989 0.92
random-access/vortex-tokio-local-disk 🚀 653482 771374 0.85
random-access/vortex-tokio-local-disk-footer 🚀 1008461 1144952 0.88

@github-actions

github-actions Bot commented Jun 16, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +4.9%
Engines: DataFusion No clear signal (+4.8%, environment too noisy confidence) · DuckDB No clear signal (+5.1%, environment too noisy confidence)
Vortex (geomean): 1.300x ❌
Parquet (geomean): 1.237x ❌
Shifts: Parquet (control) +23.7% · Median polish +27.4%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.383x ❌, 0↑ 22↓)
name PR 49cce3b (ns) base c9c8fb7 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 🚨 528448060 428742489 1.23
tpch_q02/datafusion:vortex-file-compressed 🚨 138059267 103203847 1.34
tpch_q03/datafusion:vortex-file-compressed 🚨 275543649 199197372 1.38
tpch_q04/datafusion:vortex-file-compressed 🚨 138291324 99235107 1.39
tpch_q05/datafusion:vortex-file-compressed 🚨 484885942 337309953 1.44
tpch_q06/datafusion:vortex-file-compressed 🚨 51836280 36663885 1.41
tpch_q07/datafusion:vortex-file-compressed 🚨 735955941 456110389 1.61
tpch_q08/datafusion:vortex-file-compressed 🚨 462813547 340024691 1.36
tpch_q09/datafusion:vortex-file-compressed 🚨 817185905 597471103 1.37
tpch_q10/datafusion:vortex-file-compressed 🚨 312740530 228718249 1.37
tpch_q11/datafusion:vortex-file-compressed 🚨 109353488 78208890 1.40
tpch_q12/datafusion:vortex-file-compressed 🚨 147267504 109112759 1.35
tpch_q13/datafusion:vortex-file-compressed 🚨 264616913 199548209 1.33
tpch_q14/datafusion:vortex-file-compressed 🚨 60667619 49354336 1.23
tpch_q15/datafusion:vortex-file-compressed 🚨 128141909 97148706 1.32
tpch_q16/datafusion:vortex-file-compressed 🚨 109709979 74363312 1.48
tpch_q17/datafusion:vortex-file-compressed 🚨 866486639 577490429 1.50
tpch_q18/datafusion:vortex-file-compressed 🚨 1179999943 837181187 1.41
tpch_q19/datafusion:vortex-file-compressed 🚨 79897272 66968066 1.19
tpch_q20/datafusion:vortex-file-compressed 🚨 220818239 158243307 1.40
tpch_q21/datafusion:vortex-file-compressed 🚨 1008271762 614947262 1.64
tpch_q22/datafusion:vortex-file-compressed 🚨 74978092 54754017 1.37
datafusion / vortex-compact (1.346x ❌, 0↑ 22↓)
name PR 49cce3b (ns) base c9c8fb7 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 🚨 576615289 458943580 1.26
tpch_q02/datafusion:vortex-compact 🚨 155919299 106556808 1.46
tpch_q03/datafusion:vortex-compact 🚨 270784302 199355990 1.36
tpch_q04/datafusion:vortex-compact 🚨 145270663 111878769 1.30
tpch_q05/datafusion:vortex-compact 🚨 472184349 337300535 1.40
tpch_q06/datafusion:vortex-compact 🚨 75116662 60341148 1.24
tpch_q07/datafusion:vortex-compact 🚨 658173603 465883870 1.41
tpch_q08/datafusion:vortex-compact 🚨 515752227 347894160 1.48
tpch_q09/datafusion:vortex-compact 🚨 847123019 597627067 1.42
tpch_q10/datafusion:vortex-compact 🚨 335143501 240157008 1.40
tpch_q11/datafusion:vortex-compact 🚨 104079098 79747153 1.31
tpch_q12/datafusion:vortex-compact 🚨 193816237 153950511 1.26
tpch_q13/datafusion:vortex-compact 🚨 309644572 245169840 1.26
tpch_q14/datafusion:vortex-compact 🚨 83413875 64385224 1.30
tpch_q15/datafusion:vortex-compact 🚨 206721490 151652127 1.36
tpch_q16/datafusion:vortex-compact 🚨 106249268 78920112 1.35
tpch_q17/datafusion:vortex-compact 🚨 881056604 588778762 1.50
tpch_q18/datafusion:vortex-compact 🚨 1137597574 830786688 1.37
tpch_q19/datafusion:vortex-compact 🚨 232356283 207568755 1.12
tpch_q20/datafusion:vortex-compact 🚨 231845327 181574717 1.28
tpch_q21/datafusion:vortex-compact 🚨 963714526 635766881 1.52
tpch_q22/datafusion:vortex-compact 🚨 88312555 65149384 1.36
datafusion / parquet (1.315x ❌, 0↑ 22↓)
name PR 49cce3b (ns) base c9c8fb7 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 🚨 639834181 483586803 1.32
tpch_q02/datafusion:parquet 🚨 273123386 172689732 1.58
tpch_q03/datafusion:parquet 🚨 338067592 264748323 1.28
tpch_q04/datafusion:parquet 🚨 148057192 120910880 1.22
tpch_q05/datafusion:parquet 🚨 529881221 401583548 1.32
tpch_q06/datafusion:parquet 🚨 168988419 130668983 1.29
tpch_q07/datafusion:parquet 🚨 747369712 563440091 1.33
tpch_q08/datafusion:parquet 🚨 599131327 450725998 1.33
tpch_q09/datafusion:parquet 🚨 1013807460 724893280 1.40
tpch_q10/datafusion:parquet 🚨 805236562 577307018 1.39
tpch_q11/datafusion:parquet 🚨 154782700 123771216 1.25
tpch_q12/datafusion:parquet 🚨 250387456 211151113 1.19
tpch_q13/datafusion:parquet 🚨 408172411 350149874 1.17
tpch_q14/datafusion:parquet 🚨 194337003 150572365 1.29
tpch_q15/datafusion:parquet 🚨 350833371 256565051 1.37
tpch_q16/datafusion:parquet 🚨 164667446 120403224 1.37
tpch_q17/datafusion:parquet 🚨 915572694 663099244 1.38
tpch_q18/datafusion:parquet 🚨 1229706348 872280806 1.41
tpch_q19/datafusion:parquet 🚨 349719696 284933857 1.23
tpch_q20/datafusion:parquet 🚨 391209571 298739801 1.31
tpch_q21/datafusion:parquet 🚨 934271246 643555227 1.45
tpch_q22/datafusion:parquet 🚨 244795919 213918180 1.14
datafusion / arrow (1.408x ❌, 0↑ 22↓)
name PR 49cce3b (ns) base c9c8fb7 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 🚨 964282199 690936568 1.40
tpch_q02/datafusion:arrow 🚨 154884816 113060698 1.37
tpch_q03/datafusion:arrow 🚨 735367079 504635893 1.46
tpch_q04/datafusion:arrow 🚨 542615594 379786480 1.43
tpch_q05/datafusion:arrow 🚨 1056507873 741618619 1.42
tpch_q06/datafusion:arrow 🚨 482706310 329311014 1.47
tpch_q07/datafusion:arrow 🚨 1644690623 1160837439 1.42
tpch_q08/datafusion:arrow 🚨 1342209354 960494828 1.40
tpch_q09/datafusion:arrow 🚨 1467270314 1081725119 1.36
tpch_q10/datafusion:arrow 🚨 938612947 631948814 1.49
tpch_q11/datafusion:arrow 🚨 134543711 92115825 1.46
tpch_q12/datafusion:arrow 🚨 1983237376 1352986785 1.47
tpch_q13/datafusion:arrow 🚨 607064801 474490195 1.28
tpch_q14/datafusion:arrow 🚨 605525978 363747302 1.66
tpch_q15/datafusion:arrow 🚨 1058602420 746225149 1.42
tpch_q16/datafusion:arrow 🚨 108153624 81968538 1.32
tpch_q17/datafusion:arrow 🚨 1297239438 974469187 1.33
tpch_q18/datafusion:arrow 🚨 2559304216 1874060739 1.37
tpch_q19/datafusion:arrow 🚨 828009032 555319565 1.49
tpch_q20/datafusion:arrow 🚨 710985426 515070732 1.38
tpch_q21/datafusion:arrow 🚨 4022773992 3125364339 1.29
tpch_q22/datafusion:arrow 🚨 114111880 84104863 1.36
duckdb / vortex-file-compressed (1.251x ❌, 0↑ 22↓)
name PR 49cce3b (ns) base c9c8fb7 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 🚨 191673696 170561242 1.12
tpch_q02/duckdb:vortex-file-compressed 🚨 58648356 50962680 1.15
tpch_q03/duckdb:vortex-file-compressed 🚨 153096592 121671930 1.26
tpch_q04/duckdb:vortex-file-compressed 🚨 209016622 157373536 1.33
tpch_q05/duckdb:vortex-file-compressed 🚨 172563196 137245294 1.26
tpch_q06/duckdb:vortex-file-compressed 🚨 42548279 32661650 1.30
tpch_q07/duckdb:vortex-file-compressed 🚨 198877056 132448895 1.50
tpch_q08/duckdb:vortex-file-compressed 🚨 273110858 173613130 1.57
tpch_q09/duckdb:vortex-file-compressed 🚨 473364476 396161599 1.19
tpch_q10/duckdb:vortex-file-compressed 🚨 231431834 190513450 1.21
tpch_q11/duckdb:vortex-file-compressed 🚨 36421153 32759253 1.11
tpch_q12/duckdb:vortex-file-compressed 🚨 133768053 100109467 1.34
tpch_q13/duckdb:vortex-file-compressed 🚨 334252139 275108330 1.21
tpch_q14/duckdb:vortex-file-compressed 🚨 61463746 52493211 1.17
tpch_q15/duckdb:vortex-file-compressed 🚨 106980868 88603906 1.21
tpch_q16/duckdb:vortex-file-compressed 🚨 91329702 77943211 1.17
tpch_q17/duckdb:vortex-file-compressed 🚨 114718293 92524273 1.24
tpch_q18/duckdb:vortex-file-compressed 🚨 344451125 284948071 1.21
tpch_q19/duckdb:vortex-file-compressed 🚨 92105413 78677590 1.17
tpch_q20/duckdb:vortex-file-compressed 🚨 179568928 142652486 1.26
tpch_q21/duckdb:vortex-file-compressed 🚨 674614434 493131669 1.37
tpch_q22/duckdb:vortex-file-compressed 🚨 79815716 63716930 1.25
duckdb / vortex-compact (1.224x ❌, 0↑ 22↓)
name PR 49cce3b (ns) base c9c8fb7 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 🚨 265366634 232255981 1.14
tpch_q02/duckdb:vortex-compact 🚨 67506870 56424210 1.20
tpch_q03/duckdb:vortex-compact 🚨 186895610 136765224 1.37
tpch_q04/duckdb:vortex-compact 🚨 218202738 170664569 1.28
tpch_q05/duckdb:vortex-compact 🚨 205330897 165711195 1.24
tpch_q06/duckdb:vortex-compact 🚨 66255846 57180730 1.16
tpch_q07/duckdb:vortex-compact 🚨 214099631 173049371 1.24
tpch_q08/duckdb:vortex-compact 🚨 237045065 187956414 1.26
tpch_q09/duckdb:vortex-compact 🚨 528214171 426450678 1.24
tpch_q10/duckdb:vortex-compact 🚨 289011603 221522946 1.30
tpch_q11/duckdb:vortex-compact 🚨 45876169 39138343 1.17
tpch_q12/duckdb:vortex-compact 🚨 197343230 162131650 1.22
tpch_q13/duckdb:vortex-compact 🚨 385278619 329984546 1.17
tpch_q14/duckdb:vortex-compact 🚨 88893114 71785029 1.24
tpch_q15/duckdb:vortex-compact 🚨 136211252 114857418 1.19
tpch_q16/duckdb:vortex-compact 🚨 97597613 81926202 1.19
tpch_q17/duckdb:vortex-compact 🚨 144335767 107198759 1.35
tpch_q18/duckdb:vortex-compact 🚨 338568175 289709324 1.17
tpch_q19/duckdb:vortex-compact 🚨 111381063 95543526 1.17
tpch_q20/duckdb:vortex-compact 🚨 211796623 176859274 1.20
tpch_q21/duckdb:vortex-compact 🚨 662677679 516640290 1.28
tpch_q22/duckdb:vortex-compact 🚨 85914914 70859243 1.21
duckdb / parquet (1.162x ❌, 0↑ 19↓)
name PR 49cce3b (ns) base c9c8fb7 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 🚨 305786246 266927033 1.15
tpch_q02/duckdb:parquet 🚨 115429677 101387418 1.14
tpch_q03/duckdb:parquet 🚨 251091098 201717387 1.24
tpch_q04/duckdb:parquet 🚨 167680362 132745071 1.26
tpch_q05/duckdb:parquet 🚨 273629356 229327616 1.19
tpch_q06/duckdb:parquet 79842370 75040439 1.06
tpch_q07/duckdb:parquet 🚨 214211308 185896284 1.15
tpch_q08/duckdb:parquet 🚨 319563763 268862979 1.19
tpch_q09/duckdb:parquet 🚨 595171105 472952983 1.26
tpch_q10/duckdb:parquet 🚨 713442685 624122822 1.14
tpch_q11/duckdb:parquet 🚨 72446210 62986504 1.15
tpch_q12/duckdb:parquet 🚨 149424373 129591615 1.15
tpch_q13/duckdb:parquet 🚨 488385755 435419072 1.12
tpch_q14/duckdb:parquet 198060933 180162701 1.10
tpch_q15/duckdb:parquet 🚨 119831091 104944130 1.14
tpch_q16/duckdb:parquet 🚨 187064698 160648468 1.16
tpch_q17/duckdb:parquet 🚨 198102434 179874523 1.10
tpch_q18/duckdb:parquet 🚨 422566906 366030611 1.15
tpch_q19/duckdb:parquet 🚨 345199081 286439941 1.21
tpch_q20/duckdb:parquet 🚨 260425673 223503172 1.17
tpch_q21/duckdb:parquet 🚨 705773837 555284642 1.27
tpch_q22/duckdb:parquet 319211574 295346922 1.08
duckdb / duckdb (1.189x ❌, 0↑ 20↓)
name PR 49cce3b (ns) base c9c8fb7 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 129766445 120231438 1.08
tpch_q02/duckdb:duckdb 🚨 58927237 49107959 1.20
tpch_q03/duckdb:duckdb 🚨 122843056 103334787 1.19
tpch_q04/duckdb:duckdb 🚨 168518990 139515125 1.21
tpch_q05/duckdb:duckdb 🚨 140638531 118647968 1.19
tpch_q06/duckdb:duckdb 49690274 45290715 1.10
tpch_q07/duckdb:duckdb 🚨 113008390 90773216 1.24
tpch_q08/duckdb:duckdb 🚨 139802261 117953448 1.19
tpch_q09/duckdb:duckdb 🚨 364284319 280760691 1.30
tpch_q10/duckdb:duckdb 🚨 265464295 213839758 1.24
tpch_q11/duckdb:duckdb 🚨 22790994 19203610 1.19
tpch_q12/duckdb:duckdb 🚨 104665344 89989428 1.16
tpch_q13/duckdb:duckdb 🚨 283259201 229754956 1.23
tpch_q14/duckdb:duckdb 🚨 92706114 77996418 1.19
tpch_q15/duckdb:duckdb 🚨 98292311 81864891 1.20
tpch_q16/duckdb:duckdb 🚨 100825103 76453795 1.32
tpch_q17/duckdb:duckdb 🚨 98323918 87715634 1.12
tpch_q18/duckdb:duckdb 🚨 273328670 232729286 1.17
tpch_q19/duckdb:duckdb 🚨 140944329 123567535 1.14
tpch_q20/duckdb:duckdb 🚨 131358684 117549613 1.12
tpch_q21/duckdb:duckdb 🚨 369747991 302995750 1.22
tpch_q22/duckdb:duckdb 🚨 82233165 68592920 1.20
File Size Changes (26 files changed, +0.1% overall, 17↑ 9↓)
File Scale Format Base HEAD Change %
orders_0.vortex 10.0 vortex-file-compressed 144.07 MB 145.14 MB +1.07 MB +0.7%
partsupp_0.vortex 10.0 vortex-compact 104.81 MB 105.54 MB +744.99 KB +0.7%
part_1.vortex 10.0 vortex-compact 16.96 MB 17.05 MB +90.87 KB +0.5%
part_0.vortex 10.0 vortex-compact 16.88 MB 16.95 MB +67.55 KB +0.4%
orders_2.vortex 10.0 vortex-file-compressed 145.74 MB 145.99 MB +257.24 KB +0.2%
partsupp_1.vortex 10.0 vortex-compact 104.90 MB 105.03 MB +133.20 KB +0.1%
part_1.vortex 10.0 vortex-file-compressed 24.75 MB 24.78 MB +30.00 KB +0.1%
lineitem_8.vortex 10.0 vortex-file-compressed 133.54 MB 133.69 MB +160.85 KB +0.1%
lineitem_10.vortex 10.0 vortex-file-compressed 134.03 MB 134.17 MB +147.16 KB +0.1%
lineitem_1.vortex 10.0 vortex-file-compressed 133.65 MB 133.76 MB +114.08 KB +0.1%
lineitem_3.vortex 10.0 vortex-file-compressed 133.27 MB 133.36 MB +99.13 KB +0.1%
lineitem_7.vortex 10.0 vortex-file-compressed 133.57 MB 133.65 MB +80.91 KB +0.1%
lineitem_5.vortex 10.0 vortex-file-compressed 133.48 MB 133.53 MB +52.00 KB +0.0%
orders_1.vortex 10.0 vortex-file-compressed 145.46 MB 145.51 MB +56.37 KB +0.0%
part_0.vortex 10.0 vortex-file-compressed 24.71 MB 24.72 MB +9.33 KB +0.0%
customer_0.vortex 10.0 vortex-file-compressed 88.51 MB 88.54 MB +31.31 KB +0.0%
lineitem_11.vortex 10.0 vortex-file-compressed 134.36 MB 134.39 MB +28.09 KB +0.0%
partsupp_0.vortex 10.0 vortex-file-compressed 120.32 MB 120.32 MB 1.55 KB -0.0%
lineitem_6.vortex 10.0 vortex-file-compressed 132.79 MB 132.77 MB 23.76 KB -0.0%
partsupp_1.vortex 10.0 vortex-file-compressed 120.32 MB 120.30 MB 25.27 KB -0.0%
lineitem_2.vortex 10.0 vortex-file-compressed 134.07 MB 134.02 MB 42.45 KB -0.0%
lineitem_9.vortex 10.0 vortex-file-compressed 134.20 MB 134.13 MB 72.07 KB -0.1%
lineitem_0.vortex 10.0 vortex-file-compressed 134.27 MB 134.14 MB 132.41 KB -0.1%
lineitem_12.vortex 10.0 vortex-file-compressed 134.18 MB 133.99 MB 195.80 KB -0.1%
lineitem_4.vortex 10.0 vortex-file-compressed 133.97 MB 133.76 MB 207.12 KB -0.2%
supplier_0.vortex 10.0 vortex-file-compressed 5.73 MB 5.68 MB 45.86 KB -0.8%

Totals:

  • vortex-compact: 1.93 GB → 1.93 GB (+0.1%)
  • vortex-file-compressed: 2.50 GB → 2.50 GB (+0.1%)

@github-actions

github-actions Bot commented Jun 16, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.6%
Engines: DataFusion No clear signal (+0.5%, low confidence) · DuckDB No clear signal (+0.7%, low confidence)
Vortex (geomean): 0.996x ➖
Parquet (geomean): 0.994x ➖
Shifts: Parquet (control) -0.6% · Median polish -0.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.001x ➖, 0↑ 1↓)
name PR 49cce3b (ns) base 31fda42 (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 1638673 1607326 1.02
clickbench_q01/datafusion:vortex-file-compressed 15779940 15736842 1.00
clickbench_q02/datafusion:vortex-file-compressed 33020629 33861692 0.98
clickbench_q03/datafusion:vortex-file-compressed 37877461 37759033 1.00
clickbench_q04/datafusion:vortex-file-compressed 225686072 234732481 0.96
clickbench_q05/datafusion:vortex-file-compressed 298902759 298692003 1.00
clickbench_q06/datafusion:vortex-file-compressed 1593202 1700593 0.94
clickbench_q07/datafusion:vortex-file-compressed 18397918 18054187 1.02
clickbench_q08/datafusion:vortex-file-compressed 327376660 321712977 1.02
clickbench_q09/datafusion:vortex-file-compressed 438903216 433390658 1.01
clickbench_q10/datafusion:vortex-file-compressed 67655738 69062895 0.98
clickbench_q11/datafusion:vortex-file-compressed 77053808 77705351 0.99
clickbench_q12/datafusion:vortex-file-compressed 251529044 257838598 0.98
clickbench_q13/datafusion:vortex-file-compressed 409041495 416380663 0.98
clickbench_q14/datafusion:vortex-file-compressed 258055319 247360057 1.04
clickbench_q15/datafusion:vortex-file-compressed 273074599 274585295 0.99
clickbench_q16/datafusion:vortex-file-compressed 637553958 639938864 1.00
clickbench_q17/datafusion:vortex-file-compressed 643048891 633577746 1.01
clickbench_q18/datafusion:vortex-file-compressed 1357489331 1312416652 1.03
clickbench_q19/datafusion:vortex-file-compressed 25987323 27460662 0.95
clickbench_q20/datafusion:vortex-file-compressed 310888098 312452101 0.99
clickbench_q21/datafusion:vortex-file-compressed 392640343 398266238 0.99
clickbench_q22/datafusion:vortex-file-compressed 491350506 491961416 1.00
clickbench_q23/datafusion:vortex-file-compressed 511319795 511273404 1.00
clickbench_q24/datafusion:vortex-file-compressed 🚨 46427672 40608229 1.14
clickbench_q25/datafusion:vortex-file-compressed 72511107 71385858 1.02
clickbench_q26/datafusion:vortex-file-compressed 43260032 44097815 0.98
clickbench_q27/datafusion:vortex-file-compressed 421161623 426302137 0.99
clickbench_q28/datafusion:vortex-file-compressed 2345759547 2367631189 0.99
clickbench_q29/datafusion:vortex-file-compressed 44450973 47468687 0.94
clickbench_q30/datafusion:vortex-file-compressed 215573648 214821377 1.00
clickbench_q31/datafusion:vortex-file-compressed 230206089 232347255 0.99
clickbench_q32/datafusion:vortex-file-compressed 1016874584 1012040647 1.00
clickbench_q33/datafusion:vortex-file-compressed 1379365954 1354972755 1.02
clickbench_q34/datafusion:vortex-file-compressed 1378169309 1360370563 1.01
clickbench_q35/datafusion:vortex-file-compressed 231152133 234584508 0.99
clickbench_q36/datafusion:vortex-file-compressed 59794212 56294287 1.06
clickbench_q37/datafusion:vortex-file-compressed 24570887 25643880 0.96
clickbench_q38/datafusion:vortex-file-compressed 16012707 15029381 1.07
clickbench_q39/datafusion:vortex-file-compressed 120583394 124831602 0.97
clickbench_q40/datafusion:vortex-file-compressed 12380329 12066424 1.03
clickbench_q41/datafusion:vortex-file-compressed 12158469 11876110 1.02
clickbench_q42/datafusion:vortex-file-compressed 11041270 11127557 0.99
datafusion / parquet (0.995x ➖, 0↑ 0↓)
name PR 49cce3b (ns) base 31fda42 (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 1490903 1542514 0.97
clickbench_q01/datafusion:parquet 19388676 19381630 1.00
clickbench_q02/datafusion:parquet 43574604 43897753 0.99
clickbench_q03/datafusion:parquet 34789088 33856516 1.03
clickbench_q04/datafusion:parquet 260972612 271497198 0.96
clickbench_q05/datafusion:parquet 323540593 309766817 1.04
clickbench_q06/datafusion:parquet 1538197 1504277 1.02
clickbench_q07/datafusion:parquet 21283335 20180710 1.05
clickbench_q08/datafusion:parquet 323296557 323237122 1.00
clickbench_q09/datafusion:parquet 460707029 474282261 0.97
clickbench_q10/datafusion:parquet 90088701 90226428 1.00
clickbench_q11/datafusion:parquet 113835690 113857975 1.00
clickbench_q12/datafusion:parquet 293864818 292118791 1.01
clickbench_q13/datafusion:parquet 458420448 456197287 1.00
clickbench_q14/datafusion:parquet 299960063 309205664 0.97
clickbench_q15/datafusion:parquet 275318675 267207184 1.03
clickbench_q16/datafusion:parquet 632168215 667414266 0.95
clickbench_q17/datafusion:parquet 629002244 630650912 1.00
clickbench_q18/datafusion:parquet 1361544421 1338981642 1.02
clickbench_q19/datafusion:parquet 26823547 26173911 1.02
clickbench_q20/datafusion:parquet 570597468 551892378 1.03
clickbench_q21/datafusion:parquet 617199993 610312559 1.01
clickbench_q22/datafusion:parquet 899185036 899600703 1.00
clickbench_q23/datafusion:parquet 3995319669 4019170096 0.99
clickbench_q24/datafusion:parquet 54316878 51643907 1.05
clickbench_q25/datafusion:parquet 124652341 129582035 0.96
clickbench_q26/datafusion:parquet 53690358 53035409 1.01
clickbench_q27/datafusion:parquet 639262786 637706127 1.00
clickbench_q28/datafusion:parquet 2408686029 2422487362 0.99
clickbench_q29/datafusion:parquet 49161639 50988031 0.96
clickbench_q30/datafusion:parquet 313657406 314884867 1.00
clickbench_q31/datafusion:parquet 333745198 335804397 0.99
clickbench_q32/datafusion:parquet 1104184680 1120662115 0.99
clickbench_q33/datafusion:parquet 1486467005 1481841042 1.00
clickbench_q34/datafusion:parquet 1459171070 1484844093 0.98
clickbench_q35/datafusion:parquet 236926893 244444187 0.97
clickbench_q36/datafusion:parquet 106525582 109904781 0.97
clickbench_q37/datafusion:parquet 40761680 41506954 0.98
clickbench_q38/datafusion:parquet 58954709 59885116 0.98
clickbench_q39/datafusion:parquet 201598039 211248063 0.95
clickbench_q40/datafusion:parquet 21813993 22268171 0.98
clickbench_q41/datafusion:parquet 21072024 21988880 0.96
clickbench_q42/datafusion:parquet 21611422 21849915 0.99
duckdb / vortex-file-compressed (0.991x ➖, 4↑ 1↓)
name PR 49cce3b (ns) base 31fda42 (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 6872357 6791071 1.01
clickbench_q01/duckdb:vortex-file-compressed 10756372 10526285 1.02
clickbench_q02/duckdb:vortex-file-compressed 24854918 26118843 0.95
clickbench_q03/duckdb:vortex-file-compressed 29657156 30020834 0.99
clickbench_q04/duckdb:vortex-file-compressed 187709852 188058720 1.00
clickbench_q05/duckdb:vortex-file-compressed 183481279 177754393 1.03
clickbench_q06/duckdb:vortex-file-compressed 19428930 19528024 0.99
clickbench_q07/duckdb:vortex-file-compressed 15087199 14100108 1.07
clickbench_q08/duckdb:vortex-file-compressed 262714262 265966997 0.99
clickbench_q09/duckdb:vortex-file-compressed 340871600 333483648 1.02
clickbench_q10/duckdb:vortex-file-compressed 67565884 67331637 1.00
clickbench_q11/duckdb:vortex-file-compressed 78085668 76748818 1.02
clickbench_q12/duckdb:vortex-file-compressed 197372187 198238510 1.00
clickbench_q13/duckdb:vortex-file-compressed 400542393 404954315 0.99
clickbench_q14/duckdb:vortex-file-compressed 227077371 229103279 0.99
clickbench_q15/duckdb:vortex-file-compressed 242812483 244824569 0.99
clickbench_q16/duckdb:vortex-file-compressed 523742028 526937424 0.99
clickbench_q17/duckdb:vortex-file-compressed 420748263 421629140 1.00
clickbench_q18/duckdb:vortex-file-compressed 942367110 945219168 1.00
clickbench_q19/duckdb:vortex-file-compressed 21782110 21742172 1.00
clickbench_q20/duckdb:vortex-file-compressed 301203148 309269086 0.97
clickbench_q21/duckdb:vortex-file-compressed 407333153 416218113 0.98
clickbench_q22/duckdb:vortex-file-compressed 1191731348 1099595181 1.08
clickbench_q23/duckdb:vortex-file-compressed 211200856 204191458 1.03
clickbench_q24/duckdb:vortex-file-compressed 🚨 42043770 33688593 1.25
clickbench_q25/duckdb:vortex-file-compressed 80672395 79766911 1.01
clickbench_q26/duckdb:vortex-file-compressed 50967715 47081861 1.08
clickbench_q27/duckdb:vortex-file-compressed 423191412 413449748 1.02
clickbench_q28/duckdb:vortex-file-compressed 3007731343 3046001116 0.99
clickbench_q29/duckdb:vortex-file-compressed 28139602 28411363 0.99
clickbench_q30/duckdb:vortex-file-compressed 185524337 189204471 0.98
clickbench_q31/duckdb:vortex-file-compressed 278667569 288330831 0.97
clickbench_q32/duckdb:vortex-file-compressed 1108705943 1101275053 1.01
clickbench_q33/duckdb:vortex-file-compressed 1091700559 1112710978 0.98
clickbench_q34/duckdb:vortex-file-compressed 1174553202 1182082028 0.99
clickbench_q35/duckdb:vortex-file-compressed 373524307 374962411 1.00
clickbench_q36/duckdb:vortex-file-compressed 🚀 24812741 28358016 0.87
clickbench_q37/duckdb:vortex-file-compressed 🚀 17748170 20128613 0.88
clickbench_q38/duckdb:vortex-file-compressed 🚀 18432874 21371154 0.86
clickbench_q39/duckdb:vortex-file-compressed 41385184 45880271 0.90
clickbench_q40/duckdb:vortex-file-compressed 16691349 18386668 0.91
clickbench_q41/duckdb:vortex-file-compressed 🚀 16414936 18474718 0.89
clickbench_q42/duckdb:vortex-file-compressed 19788879 20356797 0.97
duckdb / parquet (0.993x ➖, 0↑ 0↓)
name PR 49cce3b (ns) base 31fda42 (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 23400690 24105016 0.97
clickbench_q01/duckdb:parquet 29667392 29338632 1.01
clickbench_q02/duckdb:parquet 49828887 50329994 0.99
clickbench_q03/duckdb:parquet 39631616 39496393 1.00
clickbench_q04/duckdb:parquet 204441901 203845195 1.00
clickbench_q05/duckdb:parquet 256699625 259543918 0.99
clickbench_q06/duckdb:parquet 47434479 47544060 1.00
clickbench_q07/duckdb:parquet 31308857 31159599 1.00
clickbench_q08/duckdb:parquet 271887180 270012212 1.01
clickbench_q09/duckdb:parquet 402453374 399022851 1.01
clickbench_q10/duckdb:parquet 83629786 81614178 1.02
clickbench_q11/duckdb:parquet 100977756 101292229 1.00
clickbench_q12/duckdb:parquet 282024712 283337383 1.00
clickbench_q13/duckdb:parquet 470107449 470002310 1.00
clickbench_q14/duckdb:parquet 312417733 312104906 1.00
clickbench_q15/duckdb:parquet 255312391 255479636 1.00
clickbench_q16/duckdb:parquet 590110826 597071053 0.99
clickbench_q17/duckdb:parquet 493007574 493480017 1.00
clickbench_q18/duckdb:parquet 1030704958 1031064073 1.00
clickbench_q19/duckdb:parquet 27218701 27848259 0.98
clickbench_q20/duckdb:parquet 417915110 419807443 1.00
clickbench_q21/duckdb:parquet 531184782 531463973 1.00
clickbench_q22/duckdb:parquet 922910258 912180837 1.01
clickbench_q23/duckdb:parquet 264128015 268377358 0.98
clickbench_q24/duckdb:parquet 70552202 71069471 0.99
clickbench_q25/duckdb:parquet 162440928 162876871 1.00
clickbench_q26/duckdb:parquet 53538347 56600394 0.95
clickbench_q27/duckdb:parquet 467144014 466883731 1.00
clickbench_q28/duckdb:parquet 4744058672 4766419470 1.00
clickbench_q29/duckdb:parquet 42320411 41411397 1.02
clickbench_q30/duckdb:parquet 312017553 307944996 1.01
clickbench_q31/duckdb:parquet 368592932 376052002 0.98
clickbench_q32/duckdb:parquet 1108588866 1108684565 1.00
clickbench_q33/duckdb:parquet 1094491038 1098214975 1.00
clickbench_q34/duckdb:parquet 1153232505 1145603988 1.01
clickbench_q35/duckdb:parquet 369149535 367438665 1.00
clickbench_q36/duckdb:parquet 44841799 49083692 0.91
clickbench_q37/duckdb:parquet 36330257 34435687 1.06
clickbench_q38/duckdb:parquet 35883472 37119440 0.97
clickbench_q39/duckdb:parquet 76049639 82126251 0.93
clickbench_q40/duckdb:parquet 20662369 20509295 1.01
clickbench_q41/duckdb:parquet 20693065 20147725 1.03
clickbench_q42/duckdb:parquet 23043115 24885524 0.93
duckdb / duckdb (1.010x ➖, 0↑ 1↓)
name PR 49cce3b (ns) base 31fda42 (ns) ratio (PR/base)
clickbench_q00/duckdb:duckdb 17651009 16739273 1.05
clickbench_q01/duckdb:duckdb 35359815 33666875 1.05
clickbench_q02/duckdb:duckdb 53625121 51130220 1.05
clickbench_q03/duckdb:duckdb 58618090 55990798 1.05
clickbench_q04/duckdb:duckdb 223489294 212764646 1.05
clickbench_q05/duckdb:duckdb 280515524 282335633 0.99
clickbench_q06/duckdb:duckdb 32485121 32972106 0.99
clickbench_q07/duckdb:duckdb 34822386 34647828 1.01
clickbench_q08/duckdb:duckdb 280249707 275952095 1.02
clickbench_q09/duckdb:duckdb 386310794 389080267 0.99
clickbench_q10/duckdb:duckdb 116411433 114882197 1.01
clickbench_q11/duckdb:duckdb 127104129 125817454 1.01
clickbench_q12/duckdb:duckdb 257864123 257111510 1.00
clickbench_q13/duckdb:duckdb 440919974 442616700 1.00
clickbench_q14/duckdb:duckdb 286172486 282911766 1.01
clickbench_q15/duckdb:duckdb 239818380 243719086 0.98
clickbench_q16/duckdb:duckdb 559976568 555063543 1.01
clickbench_q17/duckdb:duckdb 467228264 470515607 0.99
clickbench_q18/duckdb:duckdb 984715793 1008487138 0.98
clickbench_q19/duckdb:duckdb 34540791 33928275 1.02
clickbench_q20/duckdb:duckdb 463202704 471977622 0.98
clickbench_q21/duckdb:duckdb 475596745 474058873 1.00
clickbench_q22/duckdb:duckdb 543898237 545268492 1.00
clickbench_q23/duckdb:duckdb 252269102 252563904 1.00
clickbench_q24/duckdb:duckdb 60916677 60161687 1.01
clickbench_q25/duckdb:duckdb 147886625 148578651 1.00
clickbench_q26/duckdb:duckdb 61435105 61753911 0.99
clickbench_q27/duckdb:duckdb 418488096 415037804 1.01
clickbench_q28/duckdb:duckdb 4373802285 4367416091 1.00
clickbench_q29/duckdb:duckdb 51023135 50502369 1.01
clickbench_q30/duckdb:duckdb 274942655 276949241 0.99
clickbench_q31/duckdb:duckdb 367321699 364207071 1.01
clickbench_q32/duckdb:duckdb 1105222112 1115928247 0.99
clickbench_q33/duckdb:duckdb 1112690994 1119293551 0.99
clickbench_q34/duckdb:duckdb 1191681251 1190141196 1.00
clickbench_q35/duckdb:duckdb 295266144 300051410 0.98
clickbench_q36/duckdb:duckdb 50836984 47777151 1.06
clickbench_q37/duckdb:duckdb 28037178 28049519 1.00
clickbench_q38/duckdb:duckdb 33737771 32750544 1.03
clickbench_q39/duckdb:duckdb 🚨 88348710 78940371 1.12
clickbench_q40/duckdb:duckdb 27136663 27457341 0.99
clickbench_q41/duckdb:duckdb 26506649 26677088 0.99
clickbench_q42/duckdb:duckdb 29247471 29281306 1.00
File Size Changes (103 files changed, -0.0% overall, 50↑ 53↓)
File Scale Format Base HEAD Change %
hits_27.vortex 1.0 vortex-file-compressed 122.38 MB 123.04 MB +669.25 KB +0.5%
hits_82.vortex 1.0 vortex-file-compressed 99.86 MB 100.30 MB +449.70 KB +0.4%
hits_16.vortex 1.0 vortex-file-compressed 79.98 MB 80.22 MB +252.88 KB +0.3%
hits_97.vortex 1.0 vortex-file-compressed 107.00 MB 107.29 MB +296.75 KB +0.3%
hits_60.vortex 1.0 vortex-file-compressed 103.40 MB 103.66 MB +266.89 KB +0.3%
hits_80.vortex 1.0 vortex-file-compressed 104.88 MB 105.12 MB +245.07 KB +0.2%
hits_31.vortex 1.0 vortex-file-compressed 90.08 MB 90.23 MB +154.55 KB +0.2%
hits_33.vortex 1.0 vortex-file-compressed 57.21 MB 57.30 MB +91.22 KB +0.2%
hits_36.vortex 1.0 vortex-file-compressed 68.46 MB 68.57 MB +105.71 KB +0.2%
hits_85.vortex 1.0 vortex-file-compressed 91.89 MB 92.00 MB +115.81 KB +0.1%
hits_42.vortex 1.0 vortex-file-compressed 223.11 MB 223.37 MB +264.12 KB +0.1%
hits_40.vortex 1.0 vortex-file-compressed 117.78 MB 117.91 MB +133.02 KB +0.1%
hits_76.vortex 1.0 vortex-file-compressed 114.43 MB 114.55 MB +124.18 KB +0.1%
hits_67.vortex 1.0 vortex-file-compressed 184.02 MB 184.20 MB +178.00 KB +0.1%
hits_9.vortex 1.0 vortex-file-compressed 99.19 MB 99.28 MB +91.45 KB +0.1%
hits_26.vortex 1.0 vortex-file-compressed 110.09 MB 110.19 MB +92.73 KB +0.1%
hits_46.vortex 1.0 vortex-file-compressed 69.44 MB 69.49 MB +57.31 KB +0.1%
hits_77.vortex 1.0 vortex-file-compressed 168.59 MB 168.72 MB +131.80 KB +0.1%
hits_68.vortex 1.0 vortex-file-compressed 123.12 MB 123.21 MB +95.41 KB +0.1%
hits_39.vortex 1.0 vortex-file-compressed 80.34 MB 80.40 MB +60.25 KB +0.1%
hits_93.vortex 1.0 vortex-file-compressed 90.52 MB 90.58 MB +67.18 KB +0.1%
hits_56.vortex 1.0 vortex-file-compressed 123.48 MB 123.57 MB +89.51 KB +0.1%
hits_17.vortex 1.0 vortex-file-compressed 87.47 MB 87.53 MB +62.51 KB +0.1%
hits_44.vortex 1.0 vortex-file-compressed 186.86 MB 186.99 MB +131.77 KB +0.1%
hits_1.vortex 1.0 vortex-file-compressed 138.57 MB 138.65 MB +88.38 KB +0.1%
hits_81.vortex 1.0 vortex-file-compressed 100.81 MB 100.86 MB +53.37 KB +0.1%
hits_49.vortex 1.0 vortex-file-compressed 75.78 MB 75.82 MB +33.14 KB +0.0%
hits_71.vortex 1.0 vortex-file-compressed 102.06 MB 102.10 MB +43.58 KB +0.0%
hits_66.vortex 1.0 vortex-file-compressed 90.27 MB 90.30 MB +36.59 KB +0.0%
hits_30.vortex 1.0 vortex-file-compressed 87.10 MB 87.13 MB +34.41 KB +0.0%
hits_18.vortex 1.0 vortex-file-compressed 104.81 MB 104.84 MB +38.70 KB +0.0%
hits_96.vortex 1.0 vortex-file-compressed 135.79 MB 135.84 MB +49.65 KB +0.0%
hits_50.vortex 1.0 vortex-file-compressed 179.35 MB 179.41 MB +58.97 KB +0.0%
hits_2.vortex 1.0 vortex-file-compressed 186.48 MB 186.54 MB +58.78 KB +0.0%
hits_0.vortex 1.0 vortex-file-compressed 89.55 MB 89.58 MB +28.08 KB +0.0%
hits_8.vortex 1.0 vortex-file-compressed 93.26 MB 93.28 MB +27.32 KB +0.0%
hits_32.vortex 1.0 vortex-file-compressed 66.86 MB 66.88 MB +19.05 KB +0.0%
hits_98.vortex 1.0 vortex-file-compressed 118.41 MB 118.44 MB +26.26 KB +0.0%
hits_84.vortex 1.0 vortex-file-compressed 117.34 MB 117.37 MB +24.78 KB +0.0%
hits_22.vortex 1.0 vortex-file-compressed 78.59 MB 78.60 MB +16.05 KB +0.0%
hits_87.vortex 1.0 vortex-file-compressed 172.61 MB 172.64 MB +30.89 KB +0.0%
hits_11.vortex 1.0 vortex-file-compressed 80.01 MB 80.02 MB +12.14 KB +0.0%
hits_95.vortex 1.0 vortex-file-compressed 96.59 MB 96.60 MB +11.68 KB +0.0%
hits_52.vortex 1.0 vortex-file-compressed 105.08 MB 105.09 MB +9.40 KB +0.0%
hits_5.vortex 1.0 vortex-file-compressed 92.92 MB 92.93 MB +6.91 KB +0.0%
hits_59.vortex 1.0 vortex-file-compressed 101.91 MB 101.91 MB +4.88 KB +0.0%
hits_79.vortex 1.0 vortex-file-compressed 145.09 MB 145.09 MB +4.16 KB +0.0%
hits_47.vortex 1.0 vortex-file-compressed 41.32 MB 41.32 MB +736 B +0.0%
hits_61.vortex 1.0 vortex-file-compressed 101.30 MB 101.30 MB +1.25 KB +0.0%
hits_3.vortex 1.0 vortex-file-compressed 142.23 MB 142.24 MB +456 B +0.0%
hits_63.vortex 1.0 vortex-file-compressed 69.32 MB 69.32 MB 1.20 KB -0.0%
hits_48.vortex 1.0 vortex-file-compressed 28.03 MB 28.03 MB 600 B -0.0%
hits_83.vortex 1.0 vortex-file-compressed 89.85 MB 89.85 MB 3.20 KB -0.0%
hits_92.vortex 1.0 vortex-file-compressed 146.96 MB 146.95 MB 6.66 KB -0.0%
hits_54.vortex 1.0 vortex-file-compressed 221.41 MB 221.40 MB 11.80 KB -0.0%
hits_43.vortex 1.0 vortex-file-compressed 227.33 MB 227.32 MB 16.75 KB -0.0%
hits_24.vortex 1.0 vortex-file-compressed 77.45 MB 77.44 MB 6.15 KB -0.0%
hits_13.vortex 1.0 vortex-file-compressed 99.26 MB 99.24 MB 13.99 KB -0.0%
hits_45.vortex 1.0 vortex-file-compressed 122.18 MB 122.16 MB 17.48 KB -0.0%
hits_51.vortex 1.0 vortex-file-compressed 277.61 MB 277.56 MB 45.74 KB -0.0%
hits_28.vortex 1.0 vortex-file-compressed 119.93 MB 119.90 MB 25.19 KB -0.0%
hits_94.vortex 1.0 vortex-file-compressed 138.81 MB 138.78 MB 30.57 KB -0.0%
hits_35.vortex 1.0 vortex-file-compressed 115.18 MB 115.16 MB 25.88 KB -0.0%
hits_38.vortex 1.0 vortex-file-compressed 99.29 MB 99.26 MB 25.98 KB -0.0%
hits_7.vortex 1.0 vortex-file-compressed 94.02 MB 94.00 MB 26.46 KB -0.0%
hits_55.vortex 1.0 vortex-file-compressed 169.28 MB 169.24 MB 48.42 KB -0.0%
hits_20.vortex 1.0 vortex-file-compressed 62.97 MB 62.95 MB 18.87 KB -0.0%
hits_72.vortex 1.0 vortex-file-compressed 84.85 MB 84.82 MB 25.59 KB -0.0%
hits_29.vortex 1.0 vortex-file-compressed 59.80 MB 59.78 MB 19.53 KB -0.0%
hits_65.vortex 1.0 vortex-file-compressed 183.83 MB 183.77 MB 60.55 KB -0.0%
hits_78.vortex 1.0 vortex-file-compressed 164.26 MB 164.21 MB 54.74 KB -0.0%
hits_23.vortex 1.0 vortex-file-compressed 77.97 MB 77.95 MB 26.33 KB -0.0%
hits_99.vortex 1.0 vortex-file-compressed 123.24 MB 123.20 MB 46.20 KB -0.0%
hits_89.vortex 1.0 vortex-file-compressed 184.68 MB 184.60 MB 74.45 KB -0.0%
hits_69.vortex 1.0 vortex-file-compressed 122.98 MB 122.93 MB 51.53 KB -0.0%
hits_86.vortex 1.0 vortex-file-compressed 69.43 MB 69.40 MB 32.86 KB -0.0%
hits_57.vortex 1.0 vortex-file-compressed 128.36 MB 128.30 MB 60.90 KB -0.0%
hits_4.vortex 1.0 vortex-file-compressed 108.80 MB 108.75 MB 52.39 KB -0.0%
hits_37.vortex 1.0 vortex-file-compressed 85.91 MB 85.87 MB 45.78 KB -0.1%
hits_6.vortex 1.0 vortex-file-compressed 93.37 MB 93.32 MB 52.66 KB -0.1%
hits_41.vortex 1.0 vortex-file-compressed 224.33 MB 224.18 MB 156.84 KB -0.1%
hits_91.vortex 1.0 vortex-file-compressed 97.26 MB 97.19 MB 68.27 KB -0.1%
hits_19.vortex 1.0 vortex-file-compressed 73.66 MB 73.60 MB 60.08 KB -0.1%
hits_75.vortex 1.0 vortex-file-compressed 63.41 MB 63.36 MB 54.86 KB -0.1%
hits_14.vortex 1.0 vortex-file-compressed 111.49 MB 111.39 MB 100.82 KB -0.1%
hits_12.vortex 1.0 vortex-file-compressed 101.13 MB 101.03 MB 100.10 KB -0.1%
hits_73.vortex 1.0 vortex-file-compressed 110.62 MB 110.51 MB 109.88 KB -0.1%
hits_58.vortex 1.0 vortex-file-compressed 90.40 MB 90.31 MB 92.34 KB -0.1%
hits_88.vortex 1.0 vortex-file-compressed 111.47 MB 111.36 MB 114.43 KB -0.1%
hits_74.vortex 1.0 vortex-file-compressed 120.04 MB 119.91 MB 124.57 KB -0.1%
hits_10.vortex 1.0 vortex-file-compressed 69.65 MB 69.58 MB 72.88 KB -0.1%
hits_70.vortex 1.0 vortex-file-compressed 93.78 MB 93.67 MB 113.98 KB -0.1%
hits_64.vortex 1.0 vortex-file-compressed 81.40 MB 81.30 MB 100.91 KB -0.1%
hits_15.vortex 1.0 vortex-file-compressed 89.43 MB 89.29 MB 146.73 KB -0.2%
hits_34.vortex 1.0 vortex-file-compressed 98.01 MB 97.76 MB 260.84 KB -0.3%
hits_62.vortex 1.0 vortex-file-compressed 117.57 MB 117.26 MB 321.77 KB -0.3%
hits_21.vortex 1.0 vortex-compact 51.53 MB 51.39 MB 144.64 KB -0.3%
hits_25.vortex 1.0 vortex-file-compressed 114.31 MB 113.97 MB 356.37 KB -0.3%
hits_53.vortex 1.0 vortex-file-compressed 87.70 MB 87.40 MB 307.34 KB -0.3%
hits_21.vortex 1.0 vortex-file-compressed 94.34 MB 93.97 MB 380.43 KB -0.4%
hits_71.vortex 1.0 vortex-compact 69.46 MB 69.18 MB 284.83 KB -0.4%
hits_90.vortex 1.0 vortex-file-compressed 142.09 MB 140.10 MB 1.99 MB -1.4%
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%

Totals:

  • vortex-compact: 7.05 GB → 7.05 GB (-0.0%)
  • vortex-file-compressed: 11.02 GB → 11.02 GB (-0.0%)

@github-actions

github-actions Bot commented Jun 16, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +0.4%
Engines: DataFusion No clear signal (-2.5%, environment too noisy confidence) · DuckDB No clear signal (+3.3%, environment too noisy confidence)
Vortex (geomean): 0.990x ➖
Parquet (geomean): 0.986x ➖
Shifts: Parquet (control) -1.4% · Median polish -3.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.093x ➖, 0↑ 2↓)
name PR 49cce3b (ns) base 170ff39 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 247549328 257210593 0.96
tpch_q02/datafusion:vortex-file-compressed 495222582 455968817 1.09
tpch_q03/datafusion:vortex-file-compressed 569025590 462020346 1.23
tpch_q04/datafusion:vortex-file-compressed 309473684 292177072 1.06
tpch_q05/datafusion:vortex-file-compressed 508680014 422742364 1.20
tpch_q06/datafusion:vortex-file-compressed 319841734 313905428 1.02
tpch_q07/datafusion:vortex-file-compressed 477127321 448907330 1.06
tpch_q08/datafusion:vortex-file-compressed 637904670 723406421 0.88
tpch_q09/datafusion:vortex-file-compressed 486261340 605747933 0.80
tpch_q10/datafusion:vortex-file-compressed 608341694 696691693 0.87
tpch_q11/datafusion:vortex-file-compressed 394501842 320022188 1.23
tpch_q12/datafusion:vortex-file-compressed 456179877 387396351 1.18
tpch_q13/datafusion:vortex-file-compressed 🚨 253492801 187101741 1.35
tpch_q14/datafusion:vortex-file-compressed 320307792 247283264 1.30
tpch_q15/datafusion:vortex-file-compressed 513771329 437791095 1.17
tpch_q16/datafusion:vortex-file-compressed 205297777 210022433 0.98
tpch_q17/datafusion:vortex-file-compressed 444413089 457371297 0.97
tpch_q18/datafusion:vortex-file-compressed 383462273 311136888 1.23
tpch_q19/datafusion:vortex-file-compressed 🚨 757267904 541428403 1.40
tpch_q20/datafusion:vortex-file-compressed 436043435 457078570 0.95
tpch_q21/datafusion:vortex-file-compressed 676532343 552854399 1.22
tpch_q22/datafusion:vortex-file-compressed 168246976 149798404 1.12
datafusion / vortex-compact (0.905x ➖, 1↑ 0↓)
name PR 49cce3b (ns) base 170ff39 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 287113290 265146191 1.08
tpch_q02/datafusion:vortex-compact 492540503 498479428 0.99
tpch_q03/datafusion:vortex-compact 402349833 449381124 0.90
tpch_q04/datafusion:vortex-compact 228025682 247240258 0.92
tpch_q05/datafusion:vortex-compact 401133802 444434425 0.90
tpch_q06/datafusion:vortex-compact 309184627 341591306 0.91
tpch_q07/datafusion:vortex-compact 438827280 514209584 0.85
tpch_q08/datafusion:vortex-compact 613077152 573698440 1.07
tpch_q09/datafusion:vortex-compact 469685345 477507754 0.98
tpch_q10/datafusion:vortex-compact 492735645 486419712 1.01
tpch_q11/datafusion:vortex-compact 307493125 421279043 0.73
tpch_q12/datafusion:vortex-compact 410802381 420241478 0.98
tpch_q13/datafusion:vortex-compact 177300253 192894828 0.92
tpch_q14/datafusion:vortex-compact 277709988 253431354 1.10
tpch_q15/datafusion:vortex-compact 447237949 568745141 0.79
tpch_q16/datafusion:vortex-compact 207999581 226409873 0.92
tpch_q17/datafusion:vortex-compact 373877680 427305699 0.87
tpch_q18/datafusion:vortex-compact 🚀 303806800 497647357 0.61
tpch_q19/datafusion:vortex-compact 578306174 698727457 0.83
tpch_q20/datafusion:vortex-compact 465772283 502886159 0.93
tpch_q21/datafusion:vortex-compact 568560157 629184383 0.90
tpch_q22/datafusion:vortex-compact 206838171 233857682 0.88
datafusion / parquet (1.020x ➖, 0↑ 0↓)
name PR 49cce3b (ns) base 170ff39 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 248513896 225011188 1.10
tpch_q02/datafusion:parquet 401883450 406039079 0.99
tpch_q03/datafusion:parquet 312264425 362895443 0.86
tpch_q04/datafusion:parquet 170085515 179249678 0.95
tpch_q05/datafusion:parquet 448428324 505219009 0.89
tpch_q06/datafusion:parquet 181278860 182282113 0.99
tpch_q07/datafusion:parquet 573733231 488422044 1.17
tpch_q08/datafusion:parquet 617984439 651417913 0.95
tpch_q09/datafusion:parquet 602594456 515008298 1.17
tpch_q10/datafusion:parquet 572322449 507161058 1.13
tpch_q11/datafusion:parquet 377302677 413334233 0.91
tpch_q12/datafusion:parquet 306326409 249383403 1.23
tpch_q13/datafusion:parquet 440818253 436146199 1.01
tpch_q14/datafusion:parquet 222899328 214383100 1.04
tpch_q15/datafusion:parquet 328510051 348344207 0.94
tpch_q16/datafusion:parquet 176756578 178463248 0.99
tpch_q17/datafusion:parquet 412804057 359256471 1.15
tpch_q18/datafusion:parquet 441714122 440317685 1.00
tpch_q19/datafusion:parquet 343093757 314771181 1.09
tpch_q20/datafusion:parquet 313698531 387982724 0.81
tpch_q21/datafusion:parquet 560543309 589780151 0.95
tpch_q22/datafusion:parquet 194583887 154658350 1.26
duckdb / vortex-file-compressed (1.026x ➖, 0↑ 0↓)
name PR 49cce3b (ns) base 170ff39 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 254789706 291190051 0.87
tpch_q02/duckdb:vortex-file-compressed 895126347 948800111 0.94
tpch_q03/duckdb:vortex-file-compressed 678185340 622356799 1.09
tpch_q04/duckdb:vortex-file-compressed 443736222 419446038 1.06
tpch_q05/duckdb:vortex-file-compressed 890801738 755772907 1.18
tpch_q06/duckdb:vortex-file-compressed 353021399 311607695 1.13
tpch_q07/duckdb:vortex-file-compressed 894858720 881815830 1.01
tpch_q08/duckdb:vortex-file-compressed 943019875 964021303 0.98
tpch_q09/duckdb:vortex-file-compressed 878087558 948035590 0.93
tpch_q10/duckdb:vortex-file-compressed 768118103 681115784 1.13
tpch_q11/duckdb:vortex-file-compressed 564810379 481351649 1.17
tpch_q12/duckdb:vortex-file-compressed 577455897 607907686 0.95
tpch_q13/duckdb:vortex-file-compressed 449309343 409856077 1.10
tpch_q14/duckdb:vortex-file-compressed 409646641 378805977 1.08
tpch_q15/duckdb:vortex-file-compressed 277135850 275667944 1.01
tpch_q16/duckdb:vortex-file-compressed 342557363 353970286 0.97
tpch_q17/duckdb:vortex-file-compressed 729627667 679327123 1.07
tpch_q18/duckdb:vortex-file-compressed 565704673 499221188 1.13
tpch_q19/duckdb:vortex-file-compressed 516570497 469900431 1.10
tpch_q20/duckdb:vortex-file-compressed 746588609 811115335 0.92
tpch_q21/duckdb:vortex-file-compressed 964006132 972298321 0.99
tpch_q22/duckdb:vortex-file-compressed 252001517 293265993 0.86
duckdb / vortex-compact (0.945x ➖, 0↑ 0↓)
name PR 49cce3b (ns) base 170ff39 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 315702973 346079222 0.91
tpch_q02/duckdb:vortex-compact 824730094 973278457 0.85
tpch_q03/duckdb:vortex-compact 618072712 647436331 0.95
tpch_q04/duckdb:vortex-compact 359187172 371189507 0.97
tpch_q05/duckdb:vortex-compact 716110024 809917375 0.88
tpch_q06/duckdb:vortex-compact 341616215 347845195 0.98
tpch_q07/duckdb:vortex-compact 822504384 889572996 0.92
tpch_q08/duckdb:vortex-compact 956215330 977044598 0.98
tpch_q09/duckdb:vortex-compact 859690533 979303565 0.88
tpch_q10/duckdb:vortex-compact 612182615 667117220 0.92
tpch_q11/duckdb:vortex-compact 435442943 525118274 0.83
tpch_q12/duckdb:vortex-compact 577993340 621429293 0.93
tpch_q13/duckdb:vortex-compact 380438959 367587181 1.03
tpch_q14/duckdb:vortex-compact 348014567 370518793 0.94
tpch_q15/duckdb:vortex-compact 304074632 319981570 0.95
tpch_q16/duckdb:vortex-compact 304938995 316918631 0.96
tpch_q17/duckdb:vortex-compact 642011400 590603512 1.09
tpch_q18/duckdb:vortex-compact 482579680 480498929 1.00
tpch_q19/duckdb:vortex-compact 444195344 410690110 1.08
tpch_q20/duckdb:vortex-compact 706621275 768223278 0.92
tpch_q21/duckdb:vortex-compact 903096166 956195352 0.94
tpch_q22/duckdb:vortex-compact 255205226 278639956 0.92
duckdb / parquet (0.954x ➖, 0↑ 0↓)
name PR 49cce3b (ns) base 170ff39 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 499797189 513526356 0.97
tpch_q02/duckdb:parquet 1015793511 1186620313 0.86
tpch_q03/duckdb:parquet 1117249664 1184313831 0.94
tpch_q04/duckdb:parquet 622489808 666273141 0.93
tpch_q05/duckdb:parquet 1269134112 1251951542 1.01
tpch_q06/duckdb:parquet 401886937 485343600 0.83
tpch_q07/duckdb:parquet 1199063049 1176239717 1.02
tpch_q08/duckdb:parquet 1402350719 1477591118 0.95
tpch_q09/duckdb:parquet 1350201542 1455540751 0.93
tpch_q10/duckdb:parquet 1272069419 1302236258 0.98
tpch_q11/duckdb:parquet 634221964 739896087 0.86
tpch_q12/duckdb:parquet 690069700 747108425 0.92
tpch_q13/duckdb:parquet 869315868 922690736 0.94
tpch_q14/duckdb:parquet 694493414 670470993 1.04
tpch_q15/duckdb:parquet 538605991 535905250 1.01
tpch_q16/duckdb:parquet 651921979 631429194 1.03
tpch_q17/duckdb:parquet 752341676 787331925 0.96
tpch_q18/duckdb:parquet 870599144 891940186 0.98
tpch_q19/duckdb:parquet 755135287 732832220 1.03
tpch_q20/duckdb:parquet 912702881 1085876732 0.84
tpch_q21/duckdb:parquet 1135880172 1042098433 1.09
tpch_q22/duckdb:parquet 529476378 573337348 0.92

@github-actions

github-actions Bot commented Jun 16, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: Appian on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.7%
Engines: DataFusion No clear signal (+0.5%, environment too noisy confidence) · DuckDB No clear signal (-1.4%, environment too noisy confidence)
Vortex (geomean): 1.353x ❌
Parquet (geomean): 1.352x ❌
Shifts: Parquet (control) +35.2% · Median polish +33.6%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.395x ❌, 0↑ 8↓)
name PR 49cce3b (ns) base 0c1d631 (ns) ratio (PR/base)
appian_q01/datafusion:vortex-file-compressed 🚨 170938592 127810089 1.34
appian_q02/datafusion:vortex-file-compressed 🚨 802852815 606888117 1.32
appian_q03/datafusion:vortex-file-compressed 🚨 489956117 345614752 1.42
appian_q04/datafusion:vortex-file-compressed 🚨 53294738940 42671188099 1.25
appian_q05/datafusion:vortex-file-compressed 🚨 355537376 249958065 1.42
appian_q06/datafusion:vortex-file-compressed 🚨 497600772 328317284 1.52
appian_q07/datafusion:vortex-file-compressed 🚨 603011956 416519060 1.45
appian_q08/datafusion:vortex-file-compressed 🚨 2822657080 1923151061 1.47
datafusion / parquet (1.388x ❌, 0↑ 8↓)
name PR 49cce3b (ns) base 0c1d631 (ns) ratio (PR/base)
appian_q01/datafusion:parquet 🚨 199908215 135146961 1.48
appian_q02/datafusion:parquet 🚨 925225408 611559596 1.51
appian_q03/datafusion:parquet 🚨 462703619 345295610 1.34
appian_q04/datafusion:parquet 🚨 52878151060 42861698615 1.23
appian_q05/datafusion:parquet 🚨 408557210 277672842 1.47
appian_q06/datafusion:parquet 🚨 499025084 356082777 1.40
appian_q07/datafusion:parquet 🚨 592882244 457044033 1.30
appian_q08/datafusion:parquet 🚨 2682258675 1923533170 1.39
duckdb / vortex-file-compressed (1.312x ❌, 0↑ 8↓)
name PR 49cce3b (ns) base 0c1d631 (ns) ratio (PR/base)
appian_q01/duckdb:vortex-file-compressed 🚨 251630216 194144569 1.30
appian_q02/duckdb:vortex-file-compressed 🚨 823877934 623014036 1.32
appian_q03/duckdb:vortex-file-compressed 🚨 391582185 256796911 1.52
appian_q04/duckdb:vortex-file-compressed 🚨 1657945383 1321789770 1.25
appian_q05/duckdb:vortex-file-compressed 🚨 395455274 298452395 1.33
appian_q06/duckdb:vortex-file-compressed 🚨 965702147 798331889 1.21
appian_q07/duckdb:vortex-file-compressed 🚨 450193766 345574838 1.30
appian_q08/duckdb:vortex-file-compressed 🚨 1666163003 1296793515 1.28
duckdb / parquet (1.316x ❌, 0↑ 8↓)
name PR 49cce3b (ns) base 0c1d631 (ns) ratio (PR/base)
appian_q01/duckdb:parquet 🚨 271667577 202580537 1.34
appian_q02/duckdb:parquet 🚨 799752737 610554793 1.31
appian_q03/duckdb:parquet 🚨 385689783 292899286 1.32
appian_q04/duckdb:parquet 🚨 1783058291 1328068984 1.34
appian_q05/duckdb:parquet 🚨 430117091 307448283 1.40
appian_q06/duckdb:parquet 🚨 915637808 795225255 1.15
appian_q07/duckdb:parquet 🚨 482854633 361399843 1.34
appian_q08/duckdb:parquet 🚨 1714425560 1274158212 1.35
duckdb / duckdb (1.283x ❌, 0↑ 8↓)
name PR 49cce3b (ns) base 0c1d631 (ns) ratio (PR/base)
appian_q01/duckdb:duckdb 🚨 225996412 171583617 1.32
appian_q02/duckdb:duckdb 🚨 739952075 553954955 1.34
appian_q03/duckdb:duckdb 🚨 454226466 398526447 1.14
appian_q04/duckdb:duckdb 🚨 1732951784 1306292897 1.33
appian_q05/duckdb:duckdb 🚨 375673701 275261532 1.36
appian_q06/duckdb:duckdb 🚨 888074245 784828246 1.13
appian_q07/duckdb:duckdb 🚨 425159350 325199397 1.31
appian_q08/duckdb:duckdb 🚨 1673395175 1226382937 1.36
File Size Changes (6 files changed, +4.9% overall, 4↑ 2↓)
File Scale Format Base HEAD Change %
orderitemview.vortex 1.0 vortex-file-compressed 265.21 MB 294.88 MB +29.67 MB +11.2%
orderview.vortex 1.0 vortex-file-compressed 76.17 MB 81.08 MB +4.92 MB +6.5%
creditcardview.vortex 1.0 vortex-file-compressed 58.32 MB 61.06 MB +2.74 MB +4.7%
addressview.vortex 1.0 vortex-file-compressed 34.62 MB 34.62 MB +352 B +0.0%
customerview.vortex 1.0 vortex-file-compressed 19.97 MB 19.91 MB 70.57 KB -0.3%
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%

Totals:

  • vortex-compact: 271.96 MB → 271.69 MB (-0.1%)
  • vortex-file-compressed: 476.52 MB → 513.77 MB (+7.8%)

@github-actions

github-actions Bot commented Jun 16, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: Compression

Vortex (geomean): 0.995x ➖
Parquet (geomean): 0.943x ➖

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
unknown / unknown (0.925x ➖, 54↑ 2↓)
name PR 49cce3b (ns) base 31fda42 (ns) ratio (PR/base)
compress time/Arade 1122789546 1222555785 0.92
compress time/Bimbo 🚀 5427983763 6643494707 0.82
compress time/CMSprovider 🚀 2730474135 3124008589 0.87
compress time/Euro2016 🚀 449685359 542294660 0.83
compress time/Food 🚀 370758071 415714303 0.89
compress time/HashTags 🚀 837762521 1048426194 0.80
compress time/TPC-H l_comment canonical 🚀 1185432029 1362097994 0.87
compress time/TPC-H l_comment chunked 1209940107 1333735708 0.91
compress time/taxi 🚀 668666282 748359871 0.89
compress time/wide table cols=100 chunks=1 rows=1000 11449552 12610604 0.91
compress time/wide table cols=100 chunks=50 rows=1000 🚀 12563244 15643464 0.80
compress time/wide table cols=1000 chunks=1 rows=1000 🚀 126410735 149757040 0.84
compress time/wide table cols=1000 chunks=50 rows=1000 🚀 128085810 149010485 0.86
compress time/wide table cols=10000 chunks=1 rows=1000 1502189354 1643288686 0.91
compress time/wide table cols=10000 chunks=50 rows=1000 🚀 1497750422 1709147985 0.88
decompress time/Arade 🚀 28849682 32659707 0.88
decompress time/Bimbo 🚀 76293352 97173736 0.79
decompress time/CMSprovider 🚀 77451098 102264142 0.76
decompress time/Euro2016 🚀 19200687 23901497 0.80
decompress time/Food 🚀 8219995 10943563 0.75
decompress time/HashTags 🚀 85938350 109233142 0.79
decompress time/TPC-H l_comment canonical 🚀 38442431 47113331 0.82
decompress time/TPC-H l_comment chunked 🚀 39518003 44683686 0.88
decompress time/taxi 🚀 14739904 20082987 0.73
decompress time/wide table cols=100 chunks=1 rows=1000 🚀 2446976 2786456 0.88
decompress time/wide table cols=100 chunks=50 rows=1000 🚀 2431137 2967692 0.82
decompress time/wide table cols=1000 chunks=1 rows=1000 🚀 20980385 26109292 0.80
decompress time/wide table cols=1000 chunks=50 rows=1000 🚀 21386058 26314679 0.81
decompress time/wide table cols=10000 chunks=1 rows=1000 🚀 228794303 274595647 0.83
decompress time/wide table cols=10000 chunks=50 rows=1000 🚀 245889242 288270999 0.85
parquet size/Arade 258014282 258014282 1.00
parquet size/Bimbo 384517292 384517292 1.00
parquet size/CMSprovider 376885545 376885545 1.00
parquet size/Euro2016 122975499 122975499 1.00
parquet size/Food 35699500 35699500 1.00
parquet size/HashTags 133510943 133510943 1.00
parquet size/TPC-H l_comment canonical 158358238 158358238 1.00
parquet size/TPC-H l_comment chunked 158358238 158358238 1.00
parquet size/taxi 55283635 55283635 1.00
parquet size/wide table cols=100 chunks=1 rows=1000 932404 932404 1.00
parquet size/wide table cols=100 chunks=50 rows=1000 932404 932404 1.00
parquet size/wide table cols=1000 chunks=1 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=1000 chunks=50 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=10000 chunks=1 rows=1000 93240004 93240004 1.00
parquet size/wide table cols=10000 chunks=50 rows=1000 93240004 93240004 1.00
parquet_rs-zstd compress time/Arade 🚀 2612601300 3073503186 0.85
parquet_rs-zstd compress time/Bimbo 🚀 12940423619 14700039813 0.88
parquet_rs-zstd compress time/CMSprovider 🚀 6838372086 8790778716 0.78
parquet_rs-zstd compress time/Euro2016 🚀 1305820176 1571099547 0.83
parquet_rs-zstd compress time/Food 🚀 790664189 927337533 0.85
parquet_rs-zstd compress time/HashTags 🚀 2153104455 2634418045 0.82
parquet_rs-zstd compress time/TPC-H l_comment canonical 🚀 3171813493 3584038081 0.88
parquet_rs-zstd compress time/TPC-H l_comment chunked 🚀 3176544014 3672384427 0.86
parquet_rs-zstd compress time/taxi 🚀 1213531606 1363903037 0.89
parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000 🚀 6123467 8211018 0.75
parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000 🚀 6022351 8141273 0.74
parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000 74854641 82909371 0.90
parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000 🚀 74783027 86883571 0.86
parquet_rs-zstd compress time/wide table cols=10000 chunks=1 rows=1000 837068864 866329038 0.97
parquet_rs-zstd compress time/wide table cols=10000 chunks=50 rows=1000 🚀 757454719 885955374 0.85
parquet_rs-zstd decompress time/Arade 🚀 617867078 697569673 0.89
parquet_rs-zstd decompress time/Bimbo 1698574346 1790665834 0.95
parquet_rs-zstd decompress time/CMSprovider 🚀 1693531445 2197039465 0.77
parquet_rs-zstd decompress time/Euro2016 🚀 372247007 456844447 0.81
parquet_rs-zstd decompress time/Food 🚀 197377671 243829906 0.81
parquet_rs-zstd decompress time/HashTags 🚀 625686208 861502231 0.73
parquet_rs-zstd decompress time/TPC-H l_comment canonical 🚀 584951889 687656201 0.85
parquet_rs-zstd decompress time/TPC-H l_comment chunked 🚀 584734129 703121860 0.83
parquet_rs-zstd decompress time/taxi 247776765 274476977 0.90
parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000 🚀 2847448 3553852 0.80
parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000 🚀 2825141 3466524 0.81
parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000 32712042 35800299 0.91
parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000 🚀 33409498 38265420 0.87
parquet_rs-zstd decompress time/wide table cols=10000 chunks=1 rows=1000 348314723 370991280 0.94
parquet_rs-zstd decompress time/wide table cols=10000 chunks=50 rows=1000 🚀 351414447 399582631 0.88
vortex-file-compressed size/Arade 145363860 145363860 1.00
vortex-file-compressed size/Bimbo 468763396 468763396 1.00
vortex-file-compressed size/CMSprovider 417904748 417860068 1.00
vortex-file-compressed size/Euro2016 158624476 157922996 1.00
vortex-file-compressed size/Food 41927000 41927000 1.00
vortex-file-compressed size/HashTags 185669420 186019508 1.00
vortex-file-compressed size/TPC-H l_comment canonical 178484056 178391424 1.00
vortex-file-compressed size/TPC-H l_comment chunked 178489632 178609880 1.00
vortex-file-compressed size/taxi 52364012 52364012 1.00
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000 930912 930912 1.00
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000 930912 930912 1.00
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000 9293712 9293712 1.00
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000 9293712 9293712 1.00
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000 92957712 92957712 1.00
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000 92957712 92957712 1.00
vortex:parquet-zstd ratio compress time/Arade 0 0 1.08
vortex:parquet-zstd ratio compress time/Bimbo 0 0 0.93
vortex:parquet-zstd ratio compress time/CMSprovider 🚨 0 0 1.12
vortex:parquet-zstd ratio compress time/Euro2016 0 0 1.00
vortex:parquet-zstd ratio compress time/Food 0 0 1.05
vortex:parquet-zstd ratio compress time/HashTags 0 0 0.98
vortex:parquet-zstd ratio compress time/TPC-H l_comment canonical 0 0 0.98
vortex:parquet-zstd ratio compress time/TPC-H l_comment chunked 0 0 1.05
vortex:parquet-zstd ratio compress time/taxi 0 0 1.00
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=1 rows=1000 🚨 1 1 1.22
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=50 rows=1000 2 1 1.09
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=1 rows=1000 1 1 0.93
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=50 rows=1000 1 1 1.00
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=1 rows=1000 1 1 0.95
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=50 rows=1000 1 1 1.02
vortex:parquet-zstd ratio decompress time/Arade 0 0 1.00
vortex:parquet-zstd ratio decompress time/Bimbo 🚀 0 0 0.83
vortex:parquet-zstd ratio decompress time/CMSprovider 0 0 0.98
vortex:parquet-zstd ratio decompress time/Euro2016 0 0 0.99
vortex:parquet-zstd ratio decompress time/Food 0 0 0.93
vortex:parquet-zstd ratio decompress time/HashTags 0 0 1.08
vortex:parquet-zstd ratio decompress time/TPC-H l_comment canonical 0 0 0.96
vortex:parquet-zstd ratio decompress time/TPC-H l_comment chunked 0 0 1.06
vortex:parquet-zstd ratio decompress time/taxi 🚀 0 0 0.81
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=1 rows=1000 0 0 1.10
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=50 rows=1000 0 0 1.01
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=1 rows=1000 🚀 0 0 0.88
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=50 rows=1000 0 0 0.93
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=1 rows=1000 🚀 0 0 0.89
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=50 rows=1000 0 0 0.97
vortex:parquet-zstd size/Arade 0 0 1.00
vortex:parquet-zstd size/Bimbo 1 1 1.00
vortex:parquet-zstd size/CMSprovider 1 1 1.00
vortex:parquet-zstd size/Euro2016 1 1 1.00
vortex:parquet-zstd size/Food 1 1 1.00
vortex:parquet-zstd size/HashTags 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment canonical 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment chunked 1 1 1.00
vortex:parquet-zstd size/taxi 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=50 rows=1000 0 0 1.00

@github-actions

github-actions Bot commented Jun 16, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +0.3%
Engines: DataFusion No clear signal (+1.2%, environment too noisy confidence) · DuckDB No clear signal (-0.5%, environment too noisy confidence)
Vortex (geomean): 1.046x ➖
Parquet (geomean): 1.042x ➖
Shifts: Parquet (control) +4.2% · Median polish +5.7%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.072x ➖, 0↑ 1↓)
name PR 49cce3b (ns) base 170ff39 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 731205192 772695091 0.95
tpch_q02/datafusion:vortex-file-compressed 787830199 914067685 0.86
tpch_q03/datafusion:vortex-file-compressed 827171014 792524988 1.04
tpch_q04/datafusion:vortex-file-compressed 545477727 463876999 1.18
tpch_q05/datafusion:vortex-file-compressed 994005445 876737828 1.13
tpch_q06/datafusion:vortex-file-compressed 576682423 602731559 0.96
tpch_q07/datafusion:vortex-file-compressed 1146348745 1087894465 1.05
tpch_q08/datafusion:vortex-file-compressed 1270328280 1202864447 1.06
tpch_q09/datafusion:vortex-file-compressed 1363683690 1138587445 1.20
tpch_q10/datafusion:vortex-file-compressed 🚨 1258479382 883882726 1.42
tpch_q11/datafusion:vortex-file-compressed 538683037 480478424 1.12
tpch_q12/datafusion:vortex-file-compressed 845729358 741230602 1.14
tpch_q13/datafusion:vortex-file-compressed 469129151 420266312 1.12
tpch_q14/datafusion:vortex-file-compressed 552101149 557700903 0.99
tpch_q15/datafusion:vortex-file-compressed 963284904 955247469 1.01
tpch_q16/datafusion:vortex-file-compressed 441508289 431906524 1.02
tpch_q17/datafusion:vortex-file-compressed 1158583428 1182247932 0.98
tpch_q18/datafusion:vortex-file-compressed 1250173832 1156595605 1.08
tpch_q19/datafusion:vortex-file-compressed 910984958 893222870 1.02
tpch_q20/datafusion:vortex-file-compressed 905859804 850604801 1.06
tpch_q21/datafusion:vortex-file-compressed 1639440844 1378697327 1.19
tpch_q22/datafusion:vortex-file-compressed 442805691 393659063 1.12
datafusion / vortex-compact (0.991x ➖, 0↑ 1↓)
name PR 49cce3b (ns) base 170ff39 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 736532615 715530610 1.03
tpch_q02/datafusion:vortex-compact 742264268 668608947 1.11
tpch_q03/datafusion:vortex-compact 🚨 901605531 674126705 1.34
tpch_q04/datafusion:vortex-compact 428479384 451678986 0.95
tpch_q05/datafusion:vortex-compact 923759133 950742660 0.97
tpch_q06/datafusion:vortex-compact 567526914 562710352 1.01
tpch_q07/datafusion:vortex-compact 949592940 964500055 0.98
tpch_q08/datafusion:vortex-compact 1142314109 1120803540 1.02
tpch_q09/datafusion:vortex-compact 1172117533 1047796109 1.12
tpch_q10/datafusion:vortex-compact 930765695 778072646 1.20
tpch_q11/datafusion:vortex-compact 468005053 515110575 0.91
tpch_q12/datafusion:vortex-compact 693962848 882811822 0.79
tpch_q13/datafusion:vortex-compact 430708131 427264368 1.01
tpch_q14/datafusion:vortex-compact 473163243 513720093 0.92
tpch_q15/datafusion:vortex-compact 819800462 954938815 0.86
tpch_q16/datafusion:vortex-compact 385671462 439824205 0.88
tpch_q17/datafusion:vortex-compact 1078019541 1086820245 0.99
tpch_q18/datafusion:vortex-compact 1167443139 1074662921 1.09
tpch_q19/datafusion:vortex-compact 972690684 1113996121 0.87
tpch_q20/datafusion:vortex-compact 840838471 1023406447 0.82
tpch_q21/datafusion:vortex-compact 1335016134 1273243168 1.05
tpch_q22/datafusion:vortex-compact 478764937 451348707 1.06
datafusion / parquet (1.018x ➖, 0↑ 0↓)
name PR 49cce3b (ns) base 170ff39 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 901462769 931375673 0.97
tpch_q02/datafusion:parquet 983641024 1062021464 0.93
tpch_q03/datafusion:parquet 1031473888 883679541 1.17
tpch_q04/datafusion:parquet 468532720 448593100 1.04
tpch_q05/datafusion:parquet 1202320012 1083850606 1.11
tpch_q06/datafusion:parquet 546638204 532005610 1.03
tpch_q07/datafusion:parquet 1385816036 1309438890 1.06
tpch_q08/datafusion:parquet 1938331891 1558263757 1.24
tpch_q09/datafusion:parquet 1897569329 1672385239 1.13
tpch_q10/datafusion:parquet 2435179161 2335838237 1.04
tpch_q11/datafusion:parquet 505431365 691082655 0.73
tpch_q12/datafusion:parquet 686656231 826250381 0.83
tpch_q13/datafusion:parquet 721640200 932615732 0.77
tpch_q14/datafusion:parquet 828804866 782794590 1.06
tpch_q15/datafusion:parquet 1299367307 1293355777 1.00
tpch_q16/datafusion:parquet 401730807 462553118 0.87
tpch_q17/datafusion:parquet 1497253472 1365544707 1.10
tpch_q18/datafusion:parquet 1574604145 1505418544 1.05
tpch_q19/datafusion:parquet 1040845498 943703833 1.10
tpch_q20/datafusion:parquet 1331850312 1076754045 1.24
tpch_q21/datafusion:parquet 1952322267 1845426430 1.06
tpch_q22/datafusion:parquet 741587970 694141362 1.07
duckdb / vortex-file-compressed (1.098x ➖, 0↑ 1↓)
name PR 49cce3b (ns) base 170ff39 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 690134434 603816901 1.14
tpch_q02/duckdb:vortex-file-compressed 1324583314 1084876747 1.22
tpch_q03/duckdb:vortex-file-compressed 1044661481 822165867 1.27
tpch_q04/duckdb:vortex-file-compressed 🚨 822765332 601068997 1.37
tpch_q05/duckdb:vortex-file-compressed 1279982597 1147332790 1.12
tpch_q06/duckdb:vortex-file-compressed 593502669 552997754 1.07
tpch_q07/duckdb:vortex-file-compressed 1338965604 1152124320 1.16
tpch_q08/duckdb:vortex-file-compressed 1563376482 1498390219 1.04
tpch_q09/duckdb:vortex-file-compressed 1801049981 1641907635 1.10
tpch_q10/duckdb:vortex-file-compressed 1356437747 1126179999 1.20
tpch_q11/duckdb:vortex-file-compressed 665204077 719146764 0.92
tpch_q12/duckdb:vortex-file-compressed 1389918817 1249395412 1.11
tpch_q13/duckdb:vortex-file-compressed 995225287 783280787 1.27
tpch_q14/duckdb:vortex-file-compressed 713173417 696870592 1.02
tpch_q15/duckdb:vortex-file-compressed 623979105 644658002 0.97
tpch_q16/duckdb:vortex-file-compressed 563357744 527578704 1.07
tpch_q17/duckdb:vortex-file-compressed 1011057631 1007831223 1.00
tpch_q18/duckdb:vortex-file-compressed 1144573563 970861035 1.18
tpch_q19/duckdb:vortex-file-compressed 803640020 867518670 0.93
tpch_q20/duckdb:vortex-file-compressed 1322433232 1341124214 0.99
tpch_q21/duckdb:vortex-file-compressed 2108280727 1862345770 1.13
tpch_q22/duckdb:vortex-file-compressed 514100795 515724403 1.00
duckdb / vortex-compact (1.026x ➖, 0↑ 0↓)
name PR 49cce3b (ns) base 170ff39 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 627451815 621729215 1.01
tpch_q02/duckdb:vortex-compact 1245177342 1119522700 1.11
tpch_q03/duckdb:vortex-compact 914540936 970645092 0.94
tpch_q04/duckdb:vortex-compact 684554963 715422570 0.96
tpch_q05/duckdb:vortex-compact 1095903143 1220547049 0.90
tpch_q06/duckdb:vortex-compact 639614934 576550152 1.11
tpch_q07/duckdb:vortex-compact 1257434049 1170554360 1.07
tpch_q08/duckdb:vortex-compact 1467130056 1466553685 1.00
tpch_q09/duckdb:vortex-compact 1826170739 1602606068 1.14
tpch_q10/duckdb:vortex-compact 1336963915 1256338861 1.06
tpch_q11/duckdb:vortex-compact 765972442 772051261 0.99
tpch_q12/duckdb:vortex-compact 1222024038 1099609520 1.11
tpch_q13/duckdb:vortex-compact 768143877 845227800 0.91
tpch_q14/duckdb:vortex-compact 695726432 699162637 1.00
tpch_q15/duckdb:vortex-compact 607081901 574274603 1.06
tpch_q16/duckdb:vortex-compact 469917524 489530734 0.96
tpch_q17/duckdb:vortex-compact 993818249 1062425326 0.94
tpch_q18/duckdb:vortex-compact 883413484 912640498 0.97
tpch_q19/duckdb:vortex-compact 922803399 832506282 1.11
tpch_q20/duckdb:vortex-compact 1365372737 1335062530 1.02
tpch_q21/duckdb:vortex-compact 1836692459 1802876600 1.02
tpch_q22/duckdb:vortex-compact 516520032 406558475 1.27
duckdb / parquet (1.067x ➖, 0↑ 0↓)
name PR 49cce3b (ns) base 170ff39 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 795496470 864532913 0.92
tpch_q02/duckdb:parquet 1352114402 1211533103 1.12
tpch_q03/duckdb:parquet 1760153356 1638361814 1.07
tpch_q04/duckdb:parquet 1142978584 1001725806 1.14
tpch_q05/duckdb:parquet 2065604193 1711503249 1.21
tpch_q06/duckdb:parquet 781581929 802489604 0.97
tpch_q07/duckdb:parquet 1921503439 1773816792 1.08
tpch_q08/duckdb:parquet 2334253895 2330684003 1.00
tpch_q09/duckdb:parquet 2724192595 2382209678 1.14
tpch_q10/duckdb:parquet 3060936236 3017564685 1.01
tpch_q11/duckdb:parquet 843087801 861799369 0.98
tpch_q12/duckdb:parquet 1250761994 1100934657 1.14
tpch_q13/duckdb:parquet 1279812645 1345542306 0.95
tpch_q14/duckdb:parquet 1338330995 1351711012 0.99
tpch_q15/duckdb:parquet 943666760 816453444 1.16
tpch_q16/duckdb:parquet 793272128 805360925 0.98
tpch_q17/duckdb:parquet 1289662309 1326853388 0.97
tpch_q18/duckdb:parquet 1748922688 1361037762 1.28
tpch_q19/duckdb:parquet 1474119111 1553797040 0.95
tpch_q20/duckdb:parquet 2037763431 1700750557 1.20
tpch_q21/duckdb:parquet 2069738762 1689730704 1.22
tpch_q22/duckdb:parquet 1099568126 1016091036 1.08

@AdamGS AdamGS added the action/benchmark Trigger full benchmarks to run on this PR label Jun 16, 2026
@github-actions github-actions Bot removed the action/benchmark Trigger full benchmarks to run on this PR label Jun 16, 2026
@AdamGS AdamGS changed the title [WIP] Immutable session backed by HashMap Immutable session backed by HashMap Jun 17, 2026
@AdamGS AdamGS marked this pull request as ready for review June 17, 2026 10:38
@AdamGS AdamGS requested a review from a team June 17, 2026 10:38
@AdamGS AdamGS added the changelog/chore A trivial change label Jun 17, 2026
@AdamGS AdamGS force-pushed the adamg/immutable-session branch from 912bcb2 to 49cce3b Compare June 17, 2026 10:39
@joseph-isaacs joseph-isaacs added the action/benchmark Trigger full benchmarks to run on this PR label Jun 17, 2026
@github-actions github-actions Bot removed the action/benchmark Trigger full benchmarks to run on this PR label Jun 17, 2026
@AdamGS AdamGS force-pushed the adamg/immutable-session branch from db60bc0 to ae0e5bc Compare June 17, 2026 10:54
@AdamGS AdamGS force-pushed the adamg/immutable-session branch 2 times, most recently from 73cc48b to b799708 Compare June 17, 2026 12:02
@AdamGS AdamGS mentioned this pull request Jun 17, 2026
Merged
AdamGS added a commit that referenced this pull request Jun 17, 2026
@AdamGS
Suppress TSAN false positives in crossbeam crate due to use of memory…
679e2c5 
… fences (#8464)

## Summary

This PR adds a few additional ThreadSanitizer suppressions to deal with
false positives caused by `crossbeam`. They have been surfaced by #8454
and in other cases in the past.

Signed-off-by: Adam Gutglick <[email protected]>
AdamGS added 6 commits June 17, 2026 13:12
@AdamGS
Core change
8cdf4c0 
Signed-off-by: Adam Gutglick <[email protected]>
@AdamGS
Try and fix CUDA stuff
14e8fa5 
Signed-off-by: Adam Gutglick <[email protected]>
@AdamGS
fix
9314a63 
Signed-off-by: Adam Gutglick <[email protected]>
@AdamGS
last changes
1abbef4 
Signed-off-by: Adam Gutglick <[email protected]>
@AdamGS
clippy
6a1ffdf 
Signed-off-by: Adam Gutglick <[email protected]>
@AdamGS
thing
f4d7069 
Signed-off-by: Adam Gutglick <[email protected]>
@AdamGS AdamGS force-pushed the adamg/immutable-session branch from b799708 to f4d7069 Compare June 17, 2026 12:12
@AdamGS AdamGS merged commit 9f494a1 into develop Jun 17, 2026
64 of 65 checks passed
@AdamGS AdamGS deleted the adamg/immutable-session branch June 17, 2026 12:20
@connortsui20 connortsui20 mentioned this pull request Jun 20, 2026
Draft
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@robert3005 robert3005 robert3005 approved these changes

@joseph-isaacs joseph-isaacs Awaiting requested review from joseph-isaacs

Assignees

No one assigned

Labels

changelog/chore A trivial change

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@AdamGS @robert3005 @joseph-isaacs