Thanks to visit codestin.com
Credit goes to github.com

Skip to content

Immutable session backed by HashMap#8454

Open
AdamGS wants to merge 6 commits into
developfrom
adamg/immutable-session
Open

Immutable session backed by HashMap#8454
AdamGS wants to merge 6 commits into
developfrom
adamg/immutable-session

Conversation

@AdamGS

@AdamGS AdamGS commented Jun 16, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Summary

This PR replaces the current DashMap backed session with one backed by a HashMap. Instead of being initialized on access which might cause deadlocks or otherwise weird performance behavior.

There's also an explicit Builder type for the session, allowing the user to explicitly include the components they want.

@AdamGS
Core change
3e9185d 
Signed-off-by: Adam Gutglick <[email protected]>
@AdamGS AdamGS added the action/benchmark Trigger full benchmarks to run on this PR label Jun 16, 2026
@github-actions github-actions Bot removed the action/benchmark Trigger full benchmarks to run on this PR label Jun 16, 2026
@codspeed-hq

codspeed-hq Bot commented Jun 16, 2026 •
edited
Loading

Copy link
Copy Markdown

Merging this PR will not alter performance

⚡ 1 improved benchmark
❌ 2 regressed benchmarks
✅ 359 untouched benchmarks
⏩ 1193 skipped benchmarks1

Warning

Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
❌ Simulation bitwise_not_vortex_buffer_mut[128] 186.1 ns 215.3 ns -13.55%
❌ Simulation bitwise_not_vortex_buffer_mut[1024] 246.4 ns 275.6 ns -10.58%
⚡ Simulation null_count_run_end[(10000, 4, 0.01)] 129.3 µs 92.3 µs +40.16%

Tip

Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.

Comparing adamg/immutable-session (49cce3b) with develop (c9c8fb7)2

Open in CodSpeed

Footnotes

  1. 1193 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports. ↩

  2. No successful run was found on develop (170ff39) during the generation of this report, so c9c8fb7 was used instead as the comparison base. There might be some changes unrelated to this pull request in this report. ↩

@AdamGS
Try and fix CUDA stuff
5191279 
Signed-off-by: Adam Gutglick <[email protected]>
@github-actions

github-actions Bot commented Jun 16, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟡 In Progress 49cce3b 1 Explore Profiling Data
Previous Runs (2)
Status Commit Job Attempt Link
🟢 Done b2facee 1 Explore Profiling Data
🟢 Done 3e9185d 1 Explore Profiling Data

Powered by Polar Signals Cloud

@AdamGS
fix
931b84d 
Signed-off-by: Adam Gutglick <[email protected]>
@github-actions

github-actions Bot commented Jun 16, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling

Vortex (geomean): 1.186x ❌

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.186x ❌, 0↑ 9↓)
name PR 49cce3b (ns) base 170ff39 (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 124540853 118077150 1.05
polarsignals_q01/datafusion:vortex-file-compressed 🚨 310028704 267989489 1.16
polarsignals_q02/datafusion:vortex-file-compressed 🚨 26162603 23384056 1.12
polarsignals_q03/datafusion:vortex-file-compressed 🚨 336623859 257722546 1.31
polarsignals_q04/datafusion:vortex-file-compressed 🚨 11780553 9272244 1.27
polarsignals_q05/datafusion:vortex-file-compressed 🚨 17020812 13970701 1.22
polarsignals_q06/datafusion:vortex-file-compressed 🚨 22976786 20545374 1.12
polarsignals_q07/datafusion:vortex-file-compressed 🚨 16570218 13202043 1.26
polarsignals_q08/datafusion:vortex-file-compressed 🚨 457876635 377054852 1.21
polarsignals_q09/datafusion:vortex-file-compressed 🚨 13814181 11779910 1.17
File Size Changes (1 files changed, +0.0% overall, 1↑ 0↓)
File Scale Format Base HEAD Change %
stacktraces.vortex 1000000 vortex-file-compressed 685.81 MB 685.83 MB +19.64 KB +0.0%

Totals:

  • vortex-file-compressed: 685.81 MB → 685.83 MB (+0.0%)

@github-actions

github-actions Bot commented Jun 16, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +3.1%
Engines: DataFusion No clear signal (+3.5%, environment too noisy confidence) · DuckDB No clear signal (+2.7%, low confidence)
Vortex (geomean): 0.978x ➖
Parquet (geomean): 0.949x ➖
Shifts: Parquet (control) -5.1% · Median polish -3.6%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.982x ➖, 2↑ 1↓)
name PR 49cce3b (ns) base 170ff39 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚨 6698416 5553468 1.21
fineweb_q01/datafusion:vortex-file-compressed 🚀 32843073 37823933 0.87
fineweb_q02/datafusion:vortex-file-compressed 🚀 37708873 42357854 0.89
fineweb_q03/datafusion:vortex-file-compressed 67578684 61636611 1.10
fineweb_q04/datafusion:vortex-file-compressed 280972314 292821976 0.96
fineweb_q05/datafusion:vortex-file-compressed 219490507 226801215 0.97
fineweb_q06/datafusion:vortex-file-compressed 50352682 53288835 0.94
fineweb_q07/datafusion:vortex-file-compressed 54783942 58026617 0.94
fineweb_q08/datafusion:vortex-file-compressed 23741881 23646511 1.00
datafusion / vortex-compact (0.971x ➖, 1↑ 1↓)
name PR 49cce3b (ns) base 170ff39 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 🚀 5789906 7016208 0.83
fineweb_q01/datafusion:vortex-compact 98695891 102571523 0.96
fineweb_q02/datafusion:vortex-compact 103141559 108372703 0.95
fineweb_q03/datafusion:vortex-compact 862048622 889781955 0.97
fineweb_q04/datafusion:vortex-compact 922203685 933243232 0.99
fineweb_q05/datafusion:vortex-compact 824735539 844475732 0.98
fineweb_q06/datafusion:vortex-compact 471768645 479608019 0.98
fineweb_q07/datafusion:vortex-compact 479787072 493710584 0.97
fineweb_q08/datafusion:vortex-compact 🚨 25266958 22309081 1.13
datafusion / parquet (0.944x ➖, 1↑ 0↓)
name PR 49cce3b (ns) base 170ff39 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 7270647 7761691 0.94
fineweb_q01/datafusion:parquet 282524323 308268874 0.92
fineweb_q02/datafusion:parquet 295387905 300336839 0.98
fineweb_q03/datafusion:parquet 296673697 297610840 1.00
fineweb_q04/datafusion:parquet 311193343 301264424 1.03
fineweb_q05/datafusion:parquet 296536691 319004856 0.93
fineweb_q06/datafusion:parquet 285080447 305285365 0.93
fineweb_q07/datafusion:parquet 🚀 280041788 331180675 0.85
fineweb_q08/datafusion:parquet 283325763 304568076 0.93
duckdb / vortex-file-compressed (0.983x ➖, 0↑ 1↓)
name PR 49cce3b (ns) base 170ff39 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 3355755 3621141 0.93
fineweb_q01/duckdb:vortex-file-compressed 33332163 35012655 0.95
fineweb_q02/duckdb:vortex-file-compressed 40620535 42096536 0.96
fineweb_q03/duckdb:vortex-file-compressed 🚨 134251070 118609902 1.13
fineweb_q04/duckdb:vortex-file-compressed 272831374 277155790 0.98
fineweb_q05/duckdb:vortex-file-compressed 216870643 224371863 0.97
fineweb_q06/duckdb:vortex-file-compressed 50277392 52178812 0.96
fineweb_q07/duckdb:vortex-file-compressed 52695121 53400159 0.99
fineweb_q08/duckdb:vortex-file-compressed 22841306 23335393 0.98
duckdb / vortex-compact (0.979x ➖, 0↑ 1↓)
name PR 49cce3b (ns) base 170ff39 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 4138937 4509119 0.92
fineweb_q01/duckdb:vortex-compact 🚨 108081850 94363435 1.15
fineweb_q02/duckdb:vortex-compact 115454097 117563979 0.98
fineweb_q03/duckdb:vortex-compact 851457857 855727493 1.00
fineweb_q04/duckdb:vortex-compact 898927276 962622761 0.93
fineweb_q05/duckdb:vortex-compact 805094852 835737488 0.96
fineweb_q06/duckdb:vortex-compact 457236502 473122260 0.97
fineweb_q07/duckdb:vortex-compact 480495418 489241551 0.98
fineweb_q08/duckdb:vortex-compact 20092818 21406167 0.94
duckdb / parquet (0.955x ➖, 1↑ 0↓)
name PR 49cce3b (ns) base 170ff39 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 31341937 33600942 0.93
fineweb_q01/duckdb:parquet 84808822 88420773 0.96
fineweb_q02/duckdb:parquet 84781630 88788000 0.95
fineweb_q03/duckdb:parquet 316730339 325532073 0.97
fineweb_q04/duckdb:parquet 446605419 453436630 0.98
fineweb_q05/duckdb:parquet 413711063 419767144 0.99
fineweb_q06/duckdb:parquet 202652527 212010820 0.96
fineweb_q07/duckdb:parquet 215727663 221521946 0.97
fineweb_q08/duckdb:parquet 🚀 32831800 37389916 0.88
File Size Changes (2 files changed, -0.0% overall, 0↑ 2↓)
File Scale Format Base HEAD Change %
sample.vortex 1.0 vortex-compact 1.23 GB 1.23 GB 4.02 KB -0.0%
sample.vortex 1.0 vortex-file-compressed 1.43 GB 1.43 GB 617.07 KB -0.0%

Totals:

  • vortex-compact: 1.23 GB → 1.23 GB (-0.0%)
  • vortex-file-compressed: 1.43 GB → 1.43 GB (-0.0%)

@github-actions

github-actions Bot commented Jun 16, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -0.6%
Engines: DataFusion No clear signal (-0.2%, environment too noisy confidence) · DuckDB No clear signal (-1.1%, environment too noisy confidence)
Vortex (geomean): 0.949x ➖
Parquet (geomean): 0.954x ➖
Shifts: Parquet (control) -4.6% · Median polish -5.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.979x ➖, 0↑ 0↓)
name PR 49cce3b (ns) base c9c8fb7 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 52248042 51427195 1.02
tpch_q02/datafusion:vortex-file-compressed 22464107 23396321 0.96
tpch_q03/datafusion:vortex-file-compressed 30508473 30993574 0.98
tpch_q04/datafusion:vortex-file-compressed 19507081 20487569 0.95
tpch_q05/datafusion:vortex-file-compressed 46688805 48024500 0.97
tpch_q06/datafusion:vortex-file-compressed 9827166 9585077 1.03
tpch_q07/datafusion:vortex-file-compressed 52537810 54670339 0.96
tpch_q08/datafusion:vortex-file-compressed 38547167 40478014 0.95
tpch_q09/datafusion:vortex-file-compressed 52378636 53362134 0.98
tpch_q10/datafusion:vortex-file-compressed 32753078 33796196 0.97
tpch_q11/datafusion:vortex-file-compressed 16213372 16706117 0.97
tpch_q12/datafusion:vortex-file-compressed 23563582 24128940 0.98
tpch_q13/datafusion:vortex-file-compressed 26601677 27388331 0.97
tpch_q14/datafusion:vortex-file-compressed 14500934 15229485 0.95
tpch_q15/datafusion:vortex-file-compressed 22578559 22927577 0.98
tpch_q16/datafusion:vortex-file-compressed 20125296 20256942 0.99
tpch_q17/datafusion:vortex-file-compressed 65453639 67868140 0.96
tpch_q18/datafusion:vortex-file-compressed 76405350 75747576 1.01
tpch_q19/datafusion:vortex-file-compressed 17292623 17429280 0.99
tpch_q20/datafusion:vortex-file-compressed 30246641 30069256 1.01
tpch_q21/datafusion:vortex-file-compressed 69572524 71199302 0.98
tpch_q22/datafusion:vortex-file-compressed 11614349 12045637 0.96
datafusion / vortex-compact (0.984x ➖, 0↑ 0↓)
name PR 49cce3b (ns) base c9c8fb7 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 58978767 59491647 0.99
tpch_q02/datafusion:vortex-compact 25533597 26311970 0.97
tpch_q03/datafusion:vortex-compact 32219463 32525814 0.99
tpch_q04/datafusion:vortex-compact 21843601 22243567 0.98
tpch_q05/datafusion:vortex-compact 47437321 48187088 0.98
tpch_q06/datafusion:vortex-compact 12500548 12489779 1.00
tpch_q07/datafusion:vortex-compact 55047097 55541683 0.99
tpch_q08/datafusion:vortex-compact 42008311 42410661 0.99
tpch_q09/datafusion:vortex-compact 56511676 57013111 0.99
tpch_q10/datafusion:vortex-compact 35778425 36503487 0.98
tpch_q11/datafusion:vortex-compact 17473809 18199845 0.96
tpch_q12/datafusion:vortex-compact 29404636 29839314 0.99
tpch_q13/datafusion:vortex-compact 31707493 31920321 0.99
tpch_q14/datafusion:vortex-compact 18427696 18355658 1.00
tpch_q15/datafusion:vortex-compact 29660275 30299634 0.98
tpch_q16/datafusion:vortex-compact 24814320 25571025 0.97
tpch_q17/datafusion:vortex-compact 67543484 69607095 0.97
tpch_q18/datafusion:vortex-compact 76708123 78082148 0.98
tpch_q19/datafusion:vortex-compact 38984869 39606689 0.98
tpch_q20/datafusion:vortex-compact 35998183 36112255 1.00
tpch_q21/datafusion:vortex-compact 75551476 76855386 0.98
tpch_q22/datafusion:vortex-compact 13406470 13717106 0.98
datafusion / parquet (0.969x ➖, 2↑ 1↓)
name PR 49cce3b (ns) base c9c8fb7 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 🚨 125361539 95902454 1.31
tpch_q02/datafusion:parquet 61430162 64145055 0.96
tpch_q03/datafusion:parquet 77480277 83599337 0.93
tpch_q04/datafusion:parquet 45560883 49662937 0.92
tpch_q05/datafusion:parquet 91801978 93308296 0.98
tpch_q06/datafusion:parquet 🚀 33269435 42931555 0.77
tpch_q07/datafusion:parquet 106750038 101378940 1.05
tpch_q08/datafusion:parquet 90905801 99475819 0.91
tpch_q09/datafusion:parquet 127194152 128513367 0.99
tpch_q10/datafusion:parquet 117296507 126414930 0.93
tpch_q11/datafusion:parquet 40359271 43070313 0.94
tpch_q12/datafusion:parquet 87725805 86478550 1.01
tpch_q13/datafusion:parquet 190318310 195762722 0.97
tpch_q14/datafusion:parquet 39367172 40868108 0.96
tpch_q15/datafusion:parquet 60796735 63414857 0.96
tpch_q16/datafusion:parquet 42614205 42129068 1.01
tpch_q17/datafusion:parquet 🚀 128387383 144094700 0.89
tpch_q18/datafusion:parquet 155583471 162038197 0.96
tpch_q19/datafusion:parquet 80373564 78117432 1.03
tpch_q20/datafusion:parquet 70068177 74735878 0.94
tpch_q21/datafusion:parquet 141383993 140031126 1.01
tpch_q22/datafusion:parquet 43112037 44661727 0.97
datafusion / arrow (0.939x ➖, 3↑ 1↓)
name PR 49cce3b (ns) base c9c8fb7 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 🚀 60655247 69361305 0.87
tpch_q02/datafusion:arrow 16936868 17541238 0.97
tpch_q03/datafusion:arrow 32216765 33798471 0.95
tpch_q04/datafusion:arrow 25707043 27136813 0.95
tpch_q05/datafusion:arrow 56913264 56366279 1.01
tpch_q06/datafusion:arrow 🚨 25546878 21531408 1.19
tpch_q07/datafusion:arrow 103573703 109622637 0.94
tpch_q08/datafusion:arrow 40823039 44961646 0.91
tpch_q09/datafusion:arrow 🚀 64291929 73552932 0.87
tpch_q10/datafusion:arrow 🚀 47764279 54237653 0.88
tpch_q11/datafusion:arrow 9262583 9710615 0.95
tpch_q12/datafusion:arrow 49117705 54111888 0.91
tpch_q13/datafusion:arrow 44841088 49606532 0.90
tpch_q14/datafusion:arrow 22992431 24860942 0.92
tpch_q15/datafusion:arrow 45232060 47556073 0.95
tpch_q16/datafusion:arrow 16465921 17401455 0.95
tpch_q17/datafusion:arrow 64805038 71628609 0.90
tpch_q18/datafusion:arrow 107600303 115644344 0.93
tpch_q19/datafusion:arrow 37102934 40100884 0.93
tpch_q20/datafusion:arrow 35855374 38283824 0.94
tpch_q21/datafusion:arrow 154195042 164008817 0.94
tpch_q22/datafusion:arrow 12058096 12952049 0.93
duckdb / vortex-file-compressed (0.913x ➖, 6↑ 0↓)
name PR 49cce3b (ns) base c9c8fb7 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 31484325 32539951 0.97
tpch_q02/duckdb:vortex-file-compressed 24411563 26480168 0.92
tpch_q03/duckdb:vortex-file-compressed 🚀 32434721 36143250 0.90
tpch_q04/duckdb:vortex-file-compressed 🚀 28388092 31546923 0.90
tpch_q05/duckdb:vortex-file-compressed 36877354 40727010 0.91
tpch_q06/duckdb:vortex-file-compressed 🚀 8426431 9476041 0.89
tpch_q07/duckdb:vortex-file-compressed 34493175 38325134 0.90
tpch_q08/duckdb:vortex-file-compressed 36722966 39961404 0.92
tpch_q09/duckdb:vortex-file-compressed 57729288 63147675 0.91
tpch_q10/duckdb:vortex-file-compressed 40754332 44878560 0.91
tpch_q11/duckdb:vortex-file-compressed 14999065 15903605 0.94
tpch_q12/duckdb:vortex-file-compressed 22635609 23952192 0.95
tpch_q13/duckdb:vortex-file-compressed 41642005 44830680 0.93
tpch_q14/duckdb:vortex-file-compressed 21517752 23686884 0.91
tpch_q15/duckdb:vortex-file-compressed 🚀 16939550 19463621 0.87
tpch_q16/duckdb:vortex-file-compressed 29606550 30115243 0.98
tpch_q17/duckdb:vortex-file-compressed 23534858 26017548 0.90
tpch_q18/duckdb:vortex-file-compressed 52746566 58109927 0.91
tpch_q19/duckdb:vortex-file-compressed 🚀 28791452 32893197 0.88
tpch_q20/duckdb:vortex-file-compressed 32811676 36418117 0.90
tpch_q21/duckdb:vortex-file-compressed 🚀 101173559 113628701 0.89
tpch_q22/duckdb:vortex-file-compressed 16867300 18455810 0.91
duckdb / vortex-compact (0.920x ➖, 6↑ 0↓)
name PR 49cce3b (ns) base c9c8fb7 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 38374420 39826912 0.96
tpch_q02/duckdb:vortex-compact 33691812 35727058 0.94
tpch_q03/duckdb:vortex-compact 33786218 37512992 0.90
tpch_q04/duckdb:vortex-compact 30613196 33197838 0.92
tpch_q05/duckdb:vortex-compact 🚀 40457208 45064340 0.90
tpch_q06/duckdb:vortex-compact 11620126 12190159 0.95
tpch_q07/duckdb:vortex-compact 40224565 44194436 0.91
tpch_q08/duckdb:vortex-compact 42445440 44677363 0.95
tpch_q09/duckdb:vortex-compact 64238065 70460746 0.91
tpch_q10/duckdb:vortex-compact 45908815 49368662 0.93
tpch_q11/duckdb:vortex-compact 🚀 18203654 20319293 0.90
tpch_q12/duckdb:vortex-compact 29765790 30769281 0.97
tpch_q13/duckdb:vortex-compact 46711929 48926967 0.95
tpch_q14/duckdb:vortex-compact 🚀 25577701 28782639 0.89
tpch_q15/duckdb:vortex-compact 19893723 21696514 0.92
tpch_q16/duckdb:vortex-compact 32975164 35715896 0.92
tpch_q17/duckdb:vortex-compact 29520291 31666241 0.93
tpch_q18/duckdb:vortex-compact 53157327 56166936 0.95
tpch_q19/duckdb:vortex-compact 🚀 32778222 38487279 0.85
tpch_q20/duckdb:vortex-compact 39509424 43107910 0.92
tpch_q21/duckdb:vortex-compact 🚀 101104179 113421326 0.89
tpch_q22/duckdb:vortex-compact 🚀 18111810 20280139 0.89
duckdb / parquet (0.939x ➖, 3↑ 0↓)
name PR 49cce3b (ns) base c9c8fb7 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 76887825 80184812 0.96
tpch_q02/duckdb:parquet 39388518 41050099 0.96
tpch_q03/duckdb:parquet 70793152 72630124 0.97
tpch_q04/duckdb:parquet 🚀 49394922 60248845 0.82
tpch_q05/duckdb:parquet 68047396 70507282 0.97
tpch_q06/duckdb:parquet 22539008 23400198 0.96
tpch_q07/duckdb:parquet 72065036 79698438 0.90
tpch_q08/duckdb:parquet 86541809 86867731 1.00
tpch_q09/duckdb:parquet 🚀 141994963 167907057 0.85
tpch_q10/duckdb:parquet 128756073 132369356 0.97
tpch_q11/duckdb:parquet 22328164 23683814 0.94
tpch_q12/duckdb:parquet 🚀 49957155 59468407 0.84
tpch_q13/duckdb:parquet 252522230 277397491 0.91
tpch_q14/duckdb:parquet 50542226 53585597 0.94
tpch_q15/duckdb:parquet 27352323 27175784 1.01
tpch_q16/duckdb:parquet 58128198 61656079 0.94
tpch_q17/duckdb:parquet 57170515 58324771 0.98
tpch_q18/duckdb:parquet 124179413 126861596 0.98
tpch_q19/duckdb:parquet 87815984 95098814 0.92
tpch_q20/duckdb:parquet 65757146 68261787 0.96
tpch_q21/duckdb:parquet 186454306 197227385 0.95
tpch_q22/duckdb:parquet 53531797 56145999 0.95
duckdb / duckdb (0.953x ➖, 0↑ 0↓)
name PR 49cce3b (ns) base c9c8fb7 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 17612123 18422335 0.96
tpch_q02/duckdb:duckdb 14723049 15341950 0.96
tpch_q03/duckdb:duckdb 22515523 24923664 0.90
tpch_q04/duckdb:duckdb 21367173 23321388 0.92
tpch_q05/duckdb:duckdb 22700127 24194184 0.94
tpch_q06/duckdb:duckdb 7092817 7378386 0.96
tpch_q07/duckdb:duckdb 25183002 27606025 0.91
tpch_q08/duckdb:duckdb 24478141 25687946 0.95
tpch_q09/duckdb:duckdb 56942877 61901580 0.92
tpch_q10/duckdb:duckdb 52018244 52780567 0.99
tpch_q11/duckdb:duckdb 7188053 7642379 0.94
tpch_q12/duckdb:duckdb 18119937 18648002 0.97
tpch_q13/duckdb:duckdb 39858899 42106372 0.95
tpch_q14/duckdb:duckdb 21664412 22584427 0.96
tpch_q15/duckdb:duckdb 13811526 14082772 0.98
tpch_q16/duckdb:duckdb 26480951 27325560 0.97
tpch_q17/duckdb:duckdb 16057026 16658689 0.96
tpch_q18/duckdb:duckdb 41058021 42024196 0.98
tpch_q19/duckdb:duckdb 31060549 32400623 0.96
tpch_q20/duckdb:duckdb 25404830 25838691 0.98
tpch_q21/duckdb:duckdb 61967782 65528559 0.95
tpch_q22/duckdb:duckdb 25694860 26424597 0.97
File Size Changes (10 files changed, -0.1% overall, 4↑ 6↓)
File Scale Format Base HEAD Change %
orders_0.vortex 1.0 vortex-compact 31.73 MB 32.20 MB +482.27 KB +1.5%
part_0.vortex 1.0 vortex-file-compressed 4.99 MB 5.01 MB +23.55 KB +0.5%
supplier_0.vortex 1.0 vortex-file-compressed 614.22 KB 616.14 KB +1.92 KB +0.3%
customer_0.vortex 1.0 vortex-file-compressed 8.89 MB 8.90 MB +11.92 KB +0.1%
partsupp_0.vortex 1.0 vortex-file-compressed 23.82 MB 23.79 MB 21.34 KB -0.1%
lineitem_1.vortex 1.0 vortex-file-compressed 84.66 MB 84.58 MB 83.20 KB -0.1%
lineitem_0.vortex 1.0 vortex-file-compressed 85.20 MB 85.12 MB 84.91 KB -0.1%
orders_0.vortex 1.0 vortex-file-compressed 38.55 MB 38.24 MB 324.38 KB -0.8%
partsupp_0.vortex 1.0 vortex-compact 20.88 MB 20.70 MB 184.11 KB -0.9%
part_0.vortex 1.0 vortex-compact 3.45 MB 3.36 MB 93.55 KB -2.6%

Totals:

  • vortex-compact: 190.28 MB → 190.48 MB (+0.1%)
  • vortex-file-compressed: 246.99 MB → 246.53 MB (-0.2%)

@github-actions

github-actions Bot commented Jun 16, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.7%
Engines: DataFusion No clear signal (-1.1%, environment too noisy confidence) · DuckDB No clear signal (-0.3%, low confidence)
Vortex (geomean): 1.000x ➖
Parquet (geomean): 1.009x ➖
Shifts: Parquet (control) +0.9% · Median polish +0.4%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.005x ➖, 0↑ 7↓)
name PR 49cce3b (ns) base 170ff39 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 27334649 26370613 1.04
tpcds_q02/datafusion:vortex-file-compressed 47594908 47176580 1.01
tpcds_q03/datafusion:vortex-file-compressed 15880520 15077531 1.05
tpcds_q04/datafusion:vortex-file-compressed 260952384 255730088 1.02
tpcds_q05/datafusion:vortex-file-compressed 46766054 44241214 1.06
tpcds_q06/datafusion:vortex-file-compressed 🚨 25137684 22515956 1.12
tpcds_q07/datafusion:vortex-file-compressed 🚨 43877087 38922035 1.13
tpcds_q08/datafusion:vortex-file-compressed 29376137 31198528 0.94
tpcds_q09/datafusion:vortex-file-compressed 28704879 30426311 0.94
tpcds_q10/datafusion:vortex-file-compressed 37793045 38903555 0.97
tpcds_q11/datafusion:vortex-file-compressed 135215974 131389564 1.03
tpcds_q12/datafusion:vortex-file-compressed 17407079 18762468 0.93
tpcds_q13/datafusion:vortex-file-compressed 43899442 42824621 1.03
tpcds_q14/datafusion:vortex-file-compressed 158318213 168010349 0.94
tpcds_q15/datafusion:vortex-file-compressed 26711723 26123466 1.02
tpcds_q16/datafusion:vortex-file-compressed 24745965 25638112 0.97
tpcds_q17/datafusion:vortex-file-compressed 60922360 59963808 1.02
tpcds_q18/datafusion:vortex-file-compressed 61954053 63682515 0.97
tpcds_q19/datafusion:vortex-file-compressed 21656595 21689832 1.00
tpcds_q20/datafusion:vortex-file-compressed 19815915 20385495 0.97
tpcds_q21/datafusion:vortex-file-compressed 🚨 39480089 35604280 1.11
tpcds_q22/datafusion:vortex-file-compressed 🚨 162485877 130527255 1.24
tpcds_q23/datafusion:vortex-file-compressed 148600796 154588290 0.96
tpcds_q24/datafusion:vortex-file-compressed 78734885 83165251 0.95
tpcds_q25/datafusion:vortex-file-compressed 63466108 63274738 1.00
tpcds_q26/datafusion:vortex-file-compressed 33102626 33453632 0.99
tpcds_q27/datafusion:vortex-file-compressed 90849922 91791309 0.99
tpcds_q28/datafusion:vortex-file-compressed 29966169 29470834 1.02
tpcds_q29/datafusion:vortex-file-compressed 59377929 61310330 0.97
tpcds_q30/datafusion:vortex-file-compressed 23623760 25223270 0.94
tpcds_q31/datafusion:vortex-file-compressed 73053237 71344316 1.02
tpcds_q32/datafusion:vortex-file-compressed 18502081 19022109 0.97
tpcds_q33/datafusion:vortex-file-compressed 28837335 28448323 1.01
tpcds_q34/datafusion:vortex-file-compressed 24146373 24839029 0.97
tpcds_q35/datafusion:vortex-file-compressed 44412265 44572982 1.00
tpcds_q36/datafusion:vortex-file-compressed 57521682 57473700 1.00
tpcds_q37/datafusion:vortex-file-compressed 🚨 23617514 20673548 1.14
tpcds_q38/datafusion:vortex-file-compressed 🚨 47835821 42404066 1.13
tpcds_q39/datafusion:vortex-file-compressed 116190944 108007606 1.08
tpcds_q40/datafusion:vortex-file-compressed 32699553 31111216 1.05
tpcds_q41/datafusion:vortex-file-compressed 15251211 16157616 0.94
tpcds_q42/datafusion:vortex-file-compressed 13498907 13991476 0.96
tpcds_q43/datafusion:vortex-file-compressed 19178202 18428882 1.04
tpcds_q44/datafusion:vortex-file-compressed 28620540 28963304 0.99
tpcds_q45/datafusion:vortex-file-compressed 26990198 26872528 1.00
tpcds_q46/datafusion:vortex-file-compressed 34070848 36776105 0.93
tpcds_q47/datafusion:vortex-file-compressed 133895357 135038553 0.99
tpcds_q48/datafusion:vortex-file-compressed 32489016 32623075 1.00
tpcds_q49/datafusion:vortex-file-compressed 55963650 57307671 0.98
tpcds_q50/datafusion:vortex-file-compressed 37886526 38943209 0.97
tpcds_q51/datafusion:vortex-file-compressed 90357397 88785649 1.02
tpcds_q52/datafusion:vortex-file-compressed 13692576 14557982 0.94
tpcds_q53/datafusion:vortex-file-compressed 21934244 22513193 0.97
tpcds_q54/datafusion:vortex-file-compressed 33856200 34009523 1.00
tpcds_q55/datafusion:vortex-file-compressed 13636414 13420624 1.02
tpcds_q56/datafusion:vortex-file-compressed 30004131 29275104 1.02
tpcds_q57/datafusion:vortex-file-compressed 109969133 111204128 0.99
tpcds_q58/datafusion:vortex-file-compressed 🚨 60734279 55153272 1.10
tpcds_q59/datafusion:vortex-file-compressed 59983184 57884458 1.04
tpcds_q60/datafusion:vortex-file-compressed 31356821 29160339 1.08
tpcds_q61/datafusion:vortex-file-compressed 41982024 40309169 1.04
tpcds_q62/datafusion:vortex-file-compressed 23280949 23280674 1.00
tpcds_q63/datafusion:vortex-file-compressed 22075898 21587188 1.02
tpcds_q64/datafusion:vortex-file-compressed 370413327 384634329 0.96
tpcds_q65/datafusion:vortex-file-compressed 53872238 50539895 1.07
tpcds_q66/datafusion:vortex-file-compressed 72931536 68702280 1.06
tpcds_q67/datafusion:vortex-file-compressed 157036915 147132308 1.07
tpcds_q68/datafusion:vortex-file-compressed 32115283 33340095 0.96
tpcds_q69/datafusion:vortex-file-compressed 35112239 35931278 0.98
tpcds_q70/datafusion:vortex-file-compressed 90413299 97042731 0.93
tpcds_q71/datafusion:vortex-file-compressed 22863394 22958894 1.00
tpcds_q72/datafusion:vortex-file-compressed 2073723681 2055722978 1.01
tpcds_q73/datafusion:vortex-file-compressed 23017111 24887601 0.92
tpcds_q74/datafusion:vortex-file-compressed 82909868 78555950 1.06
tpcds_q75/datafusion:vortex-file-compressed 107630394 111522890 0.97
tpcds_q76/datafusion:vortex-file-compressed 30530484 31876369 0.96
tpcds_q77/datafusion:vortex-file-compressed 37486275 37137754 1.01
tpcds_q78/datafusion:vortex-file-compressed 110934163 116822123 0.95
tpcds_q79/datafusion:vortex-file-compressed 27542364 30056459 0.92
tpcds_q80/datafusion:vortex-file-compressed 86866564 86854994 1.00
tpcds_q81/datafusion:vortex-file-compressed 24558315 24545812 1.00
tpcds_q82/datafusion:vortex-file-compressed 20774952 21333141 0.97
tpcds_q83/datafusion:vortex-file-compressed 35114589 36559489 0.96
tpcds_q84/datafusion:vortex-file-compressed 12133359 12567790 0.97
tpcds_q85/datafusion:vortex-file-compressed 88299604 85133646 1.04
tpcds_q86/datafusion:vortex-file-compressed 15989862 15047855 1.06
tpcds_q87/datafusion:vortex-file-compressed 42789718 42758764 1.00
tpcds_q88/datafusion:vortex-file-compressed 55008286 57218022 0.96
tpcds_q89/datafusion:vortex-file-compressed 24542626 24836771 0.99
tpcds_q90/datafusion:vortex-file-compressed 13934149 14463335 0.96
tpcds_q91/datafusion:vortex-file-compressed 18551366 18218100 1.02
tpcds_q92/datafusion:vortex-file-compressed 17036036 15527158 1.10
tpcds_q93/datafusion:vortex-file-compressed 31410496 31474616 1.00
tpcds_q94/datafusion:vortex-file-compressed 21426747 20900873 1.03
tpcds_q95/datafusion:vortex-file-compressed 56709955 56440369 1.00
tpcds_q96/datafusion:vortex-file-compressed 12812681 12768305 1.00
tpcds_q97/datafusion:vortex-file-compressed 31632354 29586118 1.07
tpcds_q98/datafusion:vortex-file-compressed 23120755 24352599 0.95
tpcds_q99/datafusion:vortex-file-compressed 27406518 27754057 0.99
datafusion / vortex-compact (0.995x ➖, 1↑ 2↓)
name PR 49cce3b (ns) base 170ff39 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-compact 25197988 24554925 1.03
tpcds_q02/datafusion:vortex-compact 52218026 53330438 0.98
tpcds_q03/datafusion:vortex-compact 19133203 19227824 1.00
tpcds_q04/datafusion:vortex-compact 295700908 286454795 1.03
tpcds_q05/datafusion:vortex-compact 46916898 46384537 1.01
tpcds_q06/datafusion:vortex-compact 26609446 27178458 0.98
tpcds_q07/datafusion:vortex-compact 50971454 51862842 0.98
tpcds_q08/datafusion:vortex-compact 39529150 36629211 1.08
tpcds_q09/datafusion:vortex-compact 41526947 42733584 0.97
tpcds_q10/datafusion:vortex-compact 47594281 50429700 0.94
tpcds_q11/datafusion:vortex-compact 156135804 152295890 1.03
tpcds_q12/datafusion:vortex-compact 25214399 25481462 0.99
tpcds_q13/datafusion:vortex-compact 122638842 119172188 1.03
tpcds_q14/datafusion:vortex-compact 180658793 182907600 0.99
tpcds_q15/datafusion:vortex-compact 29230738 28076909 1.04
tpcds_q16/datafusion:vortex-compact 28409340 28343401 1.00
tpcds_q17/datafusion:vortex-compact 72206590 71321920 1.01
tpcds_q18/datafusion:vortex-compact 72371916 74395325 0.97
tpcds_q19/datafusion:vortex-compact 29404167 29655345 0.99
tpcds_q20/datafusion:vortex-compact 25360391 26273763 0.97
tpcds_q21/datafusion:vortex-compact 40118319 42049439 0.95
tpcds_q22/datafusion:vortex-compact 129546426 119476157 1.08
tpcds_q23/datafusion:vortex-compact 161187452 169426951 0.95
tpcds_q24/datafusion:vortex-compact 92673670 93846209 0.99
tpcds_q25/datafusion:vortex-compact 75505431 80739525 0.94
tpcds_q26/datafusion:vortex-compact 46200834 43946664 1.05
tpcds_q27/datafusion:vortex-compact 115592986 115655984 1.00
tpcds_q28/datafusion:vortex-compact 95967074 95648690 1.00
tpcds_q29/datafusion:vortex-compact 71338480 70854024 1.01
tpcds_q30/datafusion:vortex-compact 28141345 29349504 0.96
tpcds_q31/datafusion:vortex-compact 99007373 99945724 0.99
tpcds_q32/datafusion:vortex-compact 22475868 23045405 0.98
tpcds_q33/datafusion:vortex-compact 36012685 35789102 1.01
tpcds_q34/datafusion:vortex-compact 32634063 35301184 0.92
tpcds_q35/datafusion:vortex-compact 54155534 50951313 1.06
tpcds_q36/datafusion:vortex-compact 73569416 73348162 1.00
tpcds_q37/datafusion:vortex-compact 29796679 30707327 0.97
tpcds_q38/datafusion:vortex-compact 49182144 50502905 0.97
tpcds_q39/datafusion:vortex-compact 109078227 116048114 0.94
tpcds_q40/datafusion:vortex-compact 33747727 34197284 0.99
tpcds_q41/datafusion:vortex-compact 17183712 17625844 0.97
tpcds_q42/datafusion:vortex-compact 18237215 18128893 1.01
tpcds_q43/datafusion:vortex-compact 24345585 24862642 0.98
tpcds_q44/datafusion:vortex-compact 43654429 41188884 1.06
tpcds_q45/datafusion:vortex-compact 30385964 31335375 0.97
tpcds_q46/datafusion:vortex-compact 45864747 46478506 0.99
tpcds_q47/datafusion:vortex-compact 152157061 154568371 0.98
tpcds_q48/datafusion:vortex-compact 80682915 80989594 1.00
tpcds_q49/datafusion:vortex-compact 69347319 67578058 1.03
tpcds_q50/datafusion:vortex-compact 46794746 45981372 1.02
tpcds_q51/datafusion:vortex-compact 94620344 98026460 0.97
tpcds_q52/datafusion:vortex-compact 18185112 18097986 1.00
tpcds_q53/datafusion:vortex-compact 29014997 28774392 1.01
tpcds_q54/datafusion:vortex-compact 40921616 40648400 1.01
tpcds_q55/datafusion:vortex-compact 17798283 17862523 1.00
tpcds_q56/datafusion:vortex-compact 34274201 36488945 0.94
tpcds_q57/datafusion:vortex-compact 121247286 121299364 1.00
tpcds_q58/datafusion:vortex-compact 65204254 64436013 1.01
tpcds_q59/datafusion:vortex-compact 69871731 71186418 0.98
tpcds_q60/datafusion:vortex-compact 🚨 38930356 35028768 1.11
tpcds_q61/datafusion:vortex-compact 53104667 53090125 1.00
tpcds_q62/datafusion:vortex-compact 🚀 23555820 27726625 0.85
tpcds_q63/datafusion:vortex-compact 29776988 28102097 1.06
tpcds_q64/datafusion:vortex-compact 408276973 411579445 0.99
tpcds_q65/datafusion:vortex-compact 64249975 62814195 1.02
tpcds_q66/datafusion:vortex-compact 74783079 76455647 0.98
tpcds_q67/datafusion:vortex-compact 154537851 152789970 1.01
tpcds_q68/datafusion:vortex-compact 44897347 44734567 1.00
tpcds_q69/datafusion:vortex-compact 45084286 45740295 0.99
tpcds_q70/datafusion:vortex-compact 105893713 110419079 0.96
tpcds_q71/datafusion:vortex-compact 30169978 29466545 1.02
tpcds_q72/datafusion:vortex-compact 2040715227 2073801867 0.98
tpcds_q73/datafusion:vortex-compact 31271264 32415796 0.96
tpcds_q74/datafusion:vortex-compact 94057513 90009817 1.04
tpcds_q75/datafusion:vortex-compact 124659156 125922333 0.99
tpcds_q76/datafusion:vortex-compact 34012544 32533967 1.05
tpcds_q77/datafusion:vortex-compact 48373838 46964967 1.03
tpcds_q78/datafusion:vortex-compact 129550267 127923092 1.01
tpcds_q79/datafusion:vortex-compact 38554132 38380944 1.00
tpcds_q80/datafusion:vortex-compact 97513448 100481453 0.97
tpcds_q81/datafusion:vortex-compact 27922227 27518762 1.01
tpcds_q82/datafusion:vortex-compact 31580727 30804326 1.03
tpcds_q83/datafusion:vortex-compact 35168229 35280976 1.00
tpcds_q84/datafusion:vortex-compact 14046883 14055584 1.00
tpcds_q85/datafusion:vortex-compact 144381540 155396560 0.93
tpcds_q86/datafusion:vortex-compact 19475488 20475220 0.95
tpcds_q87/datafusion:vortex-compact 49164952 50067680 0.98
tpcds_q88/datafusion:vortex-compact 77672590 76664383 1.01
tpcds_q89/datafusion:vortex-compact 32865371 31194246 1.05
tpcds_q90/datafusion:vortex-compact 14460692 14649205 0.99
tpcds_q91/datafusion:vortex-compact 32197107 32372976 0.99
tpcds_q92/datafusion:vortex-compact 22067117 23119942 0.95
tpcds_q93/datafusion:vortex-compact 35573638 35869563 0.99
tpcds_q94/datafusion:vortex-compact 23717037 26174439 0.91
tpcds_q95/datafusion:vortex-compact 62790850 60672806 1.03
tpcds_q96/datafusion:vortex-compact 16642029 16963642 0.98
tpcds_q97/datafusion:vortex-compact 33592394 33164247 1.01
tpcds_q98/datafusion:vortex-compact 28897782 30783720 0.94
tpcds_q99/datafusion:vortex-compact 🚨 32760451 29741004 1.10
datafusion / parquet (1.012x ➖, 2↑ 3↓)
name PR 49cce3b (ns) base 170ff39 (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 23545841 24241613 0.97
tpcds_q02/datafusion:parquet 41221507 40991338 1.01
tpcds_q03/datafusion:parquet 13677401 14193772 0.96
tpcds_q04/datafusion:parquet 286200578 298222420 0.96
tpcds_q05/datafusion:parquet 46746254 47631551 0.98
tpcds_q06/datafusion:parquet 23259889 22634944 1.03
tpcds_q07/datafusion:parquet 78501800 77179498 1.02
tpcds_q08/datafusion:parquet 29818672 28404052 1.05
tpcds_q09/datafusion:parquet 40540841 38915069 1.04
tpcds_q10/datafusion:parquet 73007325 69585443 1.05
tpcds_q11/datafusion:parquet 149404795 146577685 1.02
tpcds_q12/datafusion:parquet 17535659 17215032 1.02
tpcds_q13/datafusion:parquet 75339951 73648493 1.02
tpcds_q14/datafusion:parquet 161560622 159602787 1.01
tpcds_q15/datafusion:parquet 22262184 21602421 1.03
tpcds_q16/datafusion:parquet 29941861 29082796 1.03
tpcds_q17/datafusion:parquet 61874923 65368750 0.95
tpcds_q18/datafusion:parquet 106671666 107309906 0.99
tpcds_q19/datafusion:parquet 22708633 22482523 1.01
tpcds_q20/datafusion:parquet 17839588 18573158 0.96
tpcds_q21/datafusion:parquet 18924083 18333287 1.03
tpcds_q22/datafusion:parquet 148357108 156178435 0.95
tpcds_q23/datafusion:parquet 155725399 156489558 1.00
tpcds_q24/datafusion:parquet 86442304 87840795 0.98
tpcds_q25/datafusion:parquet 63830235 62365922 1.02
tpcds_q26/datafusion:parquet 63689205 68594703 0.93
tpcds_q27/datafusion:parquet 🚨 150716792 134263957 1.12
tpcds_q28/datafusion:parquet 45740172 45435388 1.01
tpcds_q29/datafusion:parquet 63811235 62746489 1.02
tpcds_q30/datafusion:parquet 34136093 32309253 1.06
tpcds_q31/datafusion:parquet 66129710 65842569 1.00
tpcds_q32/datafusion:parquet 16349755 16059498 1.02
tpcds_q33/datafusion:parquet 27077212 27112866 1.00
tpcds_q34/datafusion:parquet 🚨 23374301 20749385 1.13
tpcds_q35/datafusion:parquet 71710340 70233853 1.02
tpcds_q36/datafusion:parquet 57646081 57753081 1.00
tpcds_q37/datafusion:parquet 19163357 19040126 1.01
tpcds_q38/datafusion:parquet 40887944 40297143 1.01
tpcds_q39/datafusion:parquet 77283146 74286165 1.04
tpcds_q40/datafusion:parquet 23027087 22605109 1.02
tpcds_q41/datafusion:parquet 15035491 14573002 1.03
tpcds_q42/datafusion:parquet 11561828 11700071 0.99
tpcds_q43/datafusion:parquet 16895695 17560728 0.96
tpcds_q44/datafusion:parquet 31983004 32727752 0.98
tpcds_q45/datafusion:parquet 28415179 29622264 0.96
tpcds_q46/datafusion:parquet 32822984 31969656 1.03
tpcds_q47/datafusion:parquet 133864992 130660268 1.02
tpcds_q48/datafusion:parquet 72683881 69903689 1.04
tpcds_q49/datafusion:parquet 57705954 56982311 1.01
tpcds_q50/datafusion:parquet 43021679 42688053 1.01
tpcds_q51/datafusion:parquet 88295765 88777684 0.99
tpcds_q52/datafusion:parquet 11941468 12572984 0.95
tpcds_q53/datafusion:parquet 18361366 18494800 0.99
tpcds_q54/datafusion:parquet 32190810 32621769 0.99
tpcds_q55/datafusion:parquet 11621432 11438261 1.02
tpcds_q56/datafusion:parquet 28481000 28685739 0.99
tpcds_q57/datafusion:parquet 🚀 94723839 106560366 0.89
tpcds_q58/datafusion:parquet 56306864 56587676 1.00
tpcds_q59/datafusion:parquet 62540363 61049074 1.02
tpcds_q60/datafusion:parquet 28150043 28610739 0.98
tpcds_q61/datafusion:parquet 44521744 42175845 1.06
tpcds_q62/datafusion:parquet 🚨 25842952 19247406 1.34
tpcds_q63/datafusion:parquet 18123715 17757627 1.02
tpcds_q64/datafusion:parquet 326206855 297009657 1.10
tpcds_q65/datafusion:parquet 38776435 36478141 1.06
tpcds_q66/datafusion:parquet 69906438 70127133 1.00
tpcds_q67/datafusion:parquet 151848414 144720402 1.05
tpcds_q68/datafusion:parquet 31457293 31953514 0.98
tpcds_q69/datafusion:parquet 67999507 69197102 0.98
tpcds_q70/datafusion:parquet 32570044 32542474 1.00
tpcds_q71/datafusion:parquet 23597852 22824291 1.03
tpcds_q72/datafusion:parquet 589583576 575080037 1.03
tpcds_q73/datafusion:parquet 21877076 20437334 1.07
tpcds_q74/datafusion:parquet 80979882 82578307 0.98
tpcds_q75/datafusion:parquet 105569399 108081831 0.98
tpcds_q76/datafusion:parquet 30121119 29480670 1.02
tpcds_q77/datafusion:parquet 38461730 37997975 1.01
tpcds_q78/datafusion:parquet 106403906 107423563 0.99
tpcds_q79/datafusion:parquet 26516287 26872550 0.99
tpcds_q80/datafusion:parquet 75607440 75640257 1.00
tpcds_q81/datafusion:parquet 29421992 29605861 0.99
tpcds_q82/datafusion:parquet 19930188 18671567 1.07
tpcds_q83/datafusion:parquet 41604747 40188740 1.04
tpcds_q84/datafusion:parquet 41339537 40138644 1.03
tpcds_q85/datafusion:parquet 157023490 144180061 1.09
tpcds_q86/datafusion:parquet 17017350 15737993 1.08
tpcds_q87/datafusion:parquet 47641862 46016585 1.04
tpcds_q88/datafusion:parquet 59670916 60780932 0.98
tpcds_q89/datafusion:parquet 22759857 22057033 1.03
tpcds_q90/datafusion:parquet 14223805 13873424 1.03
tpcds_q91/datafusion:parquet 57285604 57801477 0.99
tpcds_q92/datafusion:parquet 17417869 18148600 0.96
tpcds_q93/datafusion:parquet 29445532 29561227 1.00
tpcds_q94/datafusion:parquet 21781198 21432902 1.02
tpcds_q95/datafusion:parquet 59743746 58519332 1.02
tpcds_q96/datafusion:parquet 12968234 12266478 1.06
tpcds_q97/datafusion:parquet 31328656 31406726 1.00
tpcds_q98/datafusion:parquet 21951223 21158323 1.04
tpcds_q99/datafusion:parquet 🚀 26166885 32095101 0.82
duckdb / vortex-file-compressed (0.992x ➖, 2↑ 1↓)
name PR 49cce3b (ns) base 170ff39 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 22424374 23850070 0.94
tpcds_q02/duckdb:vortex-file-compressed 33825012 36404516 0.93
tpcds_q03/duckdb:vortex-file-compressed 15020920 15139041 0.99
tpcds_q04/duckdb:vortex-file-compressed 89641268 93342936 0.96
tpcds_q05/duckdb:vortex-file-compressed 32203253 33736776 0.95
tpcds_q06/duckdb:vortex-file-compressed 32710492 32893580 0.99
tpcds_q07/duckdb:vortex-file-compressed 21254016 21279794 1.00
tpcds_q08/duckdb:vortex-file-compressed 25704536 25352172 1.01
tpcds_q09/duckdb:vortex-file-compressed 16564546 16094183 1.03
tpcds_q10/duckdb:vortex-file-compressed 37346339 37235865 1.00
tpcds_q11/duckdb:vortex-file-compressed 65083499 65143725 1.00
tpcds_q12/duckdb:vortex-file-compressed 15576784 15595509 1.00
tpcds_q13/duckdb:vortex-file-compressed 33642545 32945354 1.02
tpcds_q14/duckdb:vortex-file-compressed 96954732 96114409 1.01
tpcds_q15/duckdb:vortex-file-compressed 26568479 26583203 1.00
tpcds_q16/duckdb:vortex-file-compressed 25525046 25731950 0.99
tpcds_q17/duckdb:vortex-file-compressed 45906009 45562284 1.01
tpcds_q18/duckdb:vortex-file-compressed 38424900 36638476 1.05
tpcds_q19/duckdb:vortex-file-compressed 32392030 31790057 1.02
tpcds_q20/duckdb:vortex-file-compressed 18404174 18300526 1.01
tpcds_q21/duckdb:vortex-file-compressed 17305760 16152127 1.07
tpcds_q22/duckdb:vortex-file-compressed 73720930 73954085 1.00
tpcds_q23/duckdb:vortex-file-compressed 97849809 97458992 1.00
tpcds_q24/duckdb:vortex-file-compressed 48335666 49436033 0.98
tpcds_q25/duckdb:vortex-file-compressed 41464698 40751090 1.02
tpcds_q26/duckdb:vortex-file-compressed 19722193 21013554 0.94
tpcds_q27/duckdb:vortex-file-compressed 24403096 23524622 1.04
tpcds_q28/duckdb:vortex-file-compressed 11648763 11648807 1.00
tpcds_q29/duckdb:vortex-file-compressed 39801547 41057774 0.97
tpcds_q30/duckdb:vortex-file-compressed 25091659 24766842 1.01
tpcds_q31/duckdb:vortex-file-compressed 29716138 29394114 1.01
tpcds_q32/duckdb:vortex-file-compressed 13535422 12813336 1.06
tpcds_q33/duckdb:vortex-file-compressed 24396165 24678274 0.99
tpcds_q34/duckdb:vortex-file-compressed 24936294 25330546 0.98
tpcds_q35/duckdb:vortex-file-compressed 63366571 64807113 0.98
tpcds_q36/duckdb:vortex-file-compressed 24744348 25346228 0.98
tpcds_q37/duckdb:vortex-file-compressed 19668239 19507392 1.01
tpcds_q38/duckdb:vortex-file-compressed 38452889 36252364 1.06
tpcds_q39/duckdb:vortex-file-compressed 35316033 35015907 1.01
tpcds_q40/duckdb:vortex-file-compressed 20543951 21525958 0.95
tpcds_q41/duckdb:vortex-file-compressed 9197259 8952423 1.03
tpcds_q42/duckdb:vortex-file-compressed 13661964 12875034 1.06
tpcds_q43/duckdb:vortex-file-compressed 20455516 20689274 0.99
tpcds_q44/duckdb:vortex-file-compressed 20853083 22150652 0.94
tpcds_q45/duckdb:vortex-file-compressed 30006313 29783056 1.01
tpcds_q46/duckdb:vortex-file-compressed 33109276 30755266 1.08
tpcds_q47/duckdb:vortex-file-compressed 51211475 51811612 0.99
tpcds_q48/duckdb:vortex-file-compressed 28555539 28526972 1.00
tpcds_q49/duckdb:vortex-file-compressed 31460609 32870020 0.96
tpcds_q50/duckdb:vortex-file-compressed 26979624 29784384 0.91
tpcds_q51/duckdb:vortex-file-compressed 103664747 106222413 0.98
tpcds_q52/duckdb:vortex-file-compressed 13251473 12849140 1.03
tpcds_q53/duckdb:vortex-file-compressed 23052744 22229882 1.04
tpcds_q54/duckdb:vortex-file-compressed 28681310 28200189 1.02
tpcds_q55/duckdb:vortex-file-compressed 12769199 12643990 1.01
tpcds_q56/duckdb:vortex-file-compressed 25271353 25839264 0.98
tpcds_q57/duckdb:vortex-file-compressed 41847539 41696493 1.00
tpcds_q58/duckdb:vortex-file-compressed 30584435 30740704 0.99
tpcds_q59/duckdb:vortex-file-compressed 56080775 56652373 0.99
tpcds_q60/duckdb:vortex-file-compressed 26342985 25657392 1.03
tpcds_q61/duckdb:vortex-file-compressed 30368151 31817930 0.95
tpcds_q62/duckdb:vortex-file-compressed 15055094 14951562 1.01
tpcds_q63/duckdb:vortex-file-compressed 20667398 20411193 1.01
tpcds_q64/duckdb:vortex-file-compressed 94745577 95389548 0.99
tpcds_q65/duckdb:vortex-file-compressed 23031102 22991748 1.00
tpcds_q66/duckdb:vortex-file-compressed 29952968 30481747 0.98
tpcds_q67/duckdb:vortex-file-compressed 138212295 144179464 0.96
tpcds_q68/duckdb:vortex-file-compressed 30046786 30032150 1.00
tpcds_q69/duckdb:vortex-file-compressed 39563875 39989170 0.99
tpcds_q70/duckdb:vortex-file-compressed 36776943 36893388 1.00
tpcds_q71/duckdb:vortex-file-compressed 21503611 21956235 0.98
tpcds_q72/duckdb:vortex-file-compressed 168859810 169761329 0.99
tpcds_q73/duckdb:vortex-file-compressed 25964727 25718074 1.01
tpcds_q74/duckdb:vortex-file-compressed 42575590 43565929 0.98
tpcds_q75/duckdb:vortex-file-compressed 51490697 50238334 1.02
tpcds_q76/duckdb:vortex-file-compressed 23007813 22333931 1.03
tpcds_q77/duckdb:vortex-file-compressed 24314226 26768131 0.91
tpcds_q78/duckdb:vortex-file-compressed 77669538 79340454 0.98
tpcds_q79/duckdb:vortex-file-compressed 26747214 25242490 1.06
tpcds_q80/duckdb:vortex-file-compressed 48496245 48765361 0.99
tpcds_q81/duckdb:vortex-file-compressed 30270319 30037522 1.01
tpcds_q82/duckdb:vortex-file-compressed 46197876 45601835 1.01
tpcds_q83/duckdb:vortex-file-compressed 🚀 26508957 30942129 0.86
tpcds_q84/duckdb:vortex-file-compressed 🚨 18431189 16700091 1.10
tpcds_q85/duckdb:vortex-file-compressed 42886900 39615830 1.08
tpcds_q86/duckdb:vortex-file-compressed 16482786 16304673 1.01
tpcds_q87/duckdb:vortex-file-compressed 41330153 42895470 0.96
tpcds_q88/duckdb:vortex-file-compressed 50470490 52940172 0.95
tpcds_q89/duckdb:vortex-file-compressed 21634843 21786868 0.99
tpcds_q90/duckdb:vortex-file-compressed 10045839 10537598 0.95
tpcds_q91/duckdb:vortex-file-compressed 21807080 21942915 0.99
tpcds_q92/duckdb:vortex-file-compressed 17983548 17999830 1.00
tpcds_q93/duckdb:vortex-file-compressed 29103268 31961826 0.91
tpcds_q94/duckdb:vortex-file-compressed 21647162 22197080 0.98
tpcds_q95/duckdb:vortex-file-compressed 149226588 156008864 0.96
tpcds_q96/duckdb:vortex-file-compressed 11857675 12533038 0.95
tpcds_q97/duckdb:vortex-file-compressed 38632539 38430624 1.01
tpcds_q98/duckdb:vortex-file-compressed 18583576 18591468 1.00
tpcds_q99/duckdb:vortex-file-compressed 🚀 22337421 28427511 0.79
duckdb / vortex-compact (1.007x ➖, 1↑ 2↓)
name PR 49cce3b (ns) base 170ff39 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-compact 26031017 27158137 0.96
tpcds_q02/duckdb:vortex-compact 32448499 36036716 0.90
tpcds_q03/duckdb:vortex-compact 44744365 45373406 0.99
tpcds_q04/duckdb:vortex-compact 107105943 102685447 1.04
tpcds_q05/duckdb:vortex-compact 39156176 40682651 0.96
tpcds_q06/duckdb:vortex-compact 39665725 40215713 0.99
tpcds_q07/duckdb:vortex-compact 36321785 34957789 1.04
tpcds_q08/duckdb:vortex-compact 39852694 41176389 0.97
tpcds_q09/duckdb:vortex-compact 19371116 19416436 1.00
tpcds_q10/duckdb:vortex-compact 52718881 53423443 0.99
tpcds_q11/duckdb:vortex-compact 73164268 72579901 1.01
tpcds_q12/duckdb:vortex-compact 21829752 22122041 0.99
tpcds_q13/duckdb:vortex-compact 53149336 53576568 0.99
tpcds_q14/duckdb:vortex-compact 122872661 114205483 1.08
tpcds_q15/duckdb:vortex-compact 31687210 30244395 1.05
tpcds_q16/duckdb:vortex-compact 27515933 27220137 1.01
tpcds_q17/duckdb:vortex-compact 56103057 56251869 1.00
tpcds_q18/duckdb:vortex-compact 49781557 50559045 0.98
tpcds_q19/duckdb:vortex-compact 43923133 44144199 0.99
tpcds_q20/duckdb:vortex-compact 21126359 20948872 1.01
tpcds_q21/duckdb:vortex-compact 17957948 17660651 1.02
tpcds_q22/duckdb:vortex-compact 81537991 79002399 1.03
tpcds_q23/duckdb:vortex-compact 104547790 95444535 1.10
tpcds_q24/duckdb:vortex-compact 58749638 58619065 1.00
tpcds_q25/duckdb:vortex-compact 54814180 53987967 1.02
tpcds_q26/duckdb:vortex-compact 32358968 32728921 0.99
tpcds_q27/duckdb:vortex-compact 37467304 37842705 0.99
tpcds_q28/duckdb:vortex-compact 34785739 34936005 1.00
tpcds_q29/duckdb:vortex-compact 54299860 52962785 1.03
tpcds_q30/duckdb:vortex-compact 29446715 28999563 1.02
tpcds_q31/duckdb:vortex-compact 37318476 35772494 1.04
tpcds_q32/duckdb:vortex-compact 21943403 21092347 1.04
tpcds_q33/duckdb:vortex-compact 33154265 33056104 1.00
tpcds_q34/duckdb:vortex-compact 30370103 30432572 1.00
tpcds_q35/duckdb:vortex-compact 75794323 78132011 0.97
tpcds_q36/duckdb:vortex-compact 36408995 35066722 1.04
tpcds_q37/duckdb:vortex-compact 24215315 23527594 1.03
tpcds_q38/duckdb:vortex-compact 45539099 42713886 1.07
tpcds_q39/duckdb:vortex-compact 38635207 39235670 0.98
tpcds_q40/duckdb:vortex-compact 23959506 24201401 0.99
tpcds_q41/duckdb:vortex-compact 10624032 10830468 0.98
tpcds_q42/duckdb:vortex-compact 19672220 18937283 1.04
tpcds_q43/duckdb:vortex-compact 30666568 30068047 1.02
tpcds_q44/duckdb:vortex-compact 27987589 29931942 0.94
tpcds_q45/duckdb:vortex-compact 36407638 36042106 1.01
tpcds_q46/duckdb:vortex-compact 44864697 43286914 1.04
tpcds_q47/duckdb:vortex-compact 62317133 63184409 0.99
tpcds_q48/duckdb:vortex-compact 45250323 45131214 1.00
tpcds_q49/duckdb:vortex-compact 47072970 49738725 0.95
tpcds_q50/duckdb:vortex-compact 37558452 38414882 0.98
tpcds_q51/duckdb:vortex-compact 110873334 111194095 1.00
tpcds_q52/duckdb:vortex-compact 19167165 19473595 0.98
tpcds_q53/duckdb:vortex-compact 32526943 32387670 1.00
tpcds_q54/duckdb:vortex-compact 36768743 36535867 1.01
tpcds_q55/duckdb:vortex-compact 18826301 18398271 1.02
tpcds_q56/duckdb:vortex-compact 34858492 33541985 1.04
tpcds_q57/duckdb:vortex-compact 45721525 44581814 1.03
tpcds_q58/duckdb:vortex-compact 38053738 36411107 1.05
tpcds_q59/duckdb:vortex-compact 68081290 67412098 1.01
tpcds_q60/duckdb:vortex-compact 35073486 36795343 0.95
tpcds_q61/duckdb:vortex-compact 53106630 53745960 0.99
tpcds_q62/duckdb:vortex-compact 20076877 20272273 0.99
tpcds_q63/duckdb:vortex-compact 32050190 30973300 1.03
tpcds_q64/duckdb:vortex-compact 127467680 125629407 1.01
tpcds_q65/duckdb:vortex-compact 30458759 31324695 0.97
tpcds_q66/duckdb:vortex-compact 36477486 35410036 1.03
tpcds_q67/duckdb:vortex-compact 155550047 153508408 1.01
tpcds_q68/duckdb:vortex-compact 44942701 45918156 0.98
tpcds_q69/duckdb:vortex-compact 54779872 54469744 1.01
tpcds_q70/duckdb:vortex-compact 59243241 58366445 1.02
tpcds_q71/duckdb:vortex-compact 30717998 29504042 1.04
tpcds_q72/duckdb:vortex-compact 186666573 184023957 1.01
tpcds_q73/duckdb:vortex-compact 28764917 27870748 1.03
tpcds_q74/duckdb:vortex-compact 49106435 48004418 1.02
tpcds_q75/duckdb:vortex-compact 58564532 62089005 0.94
tpcds_q76/duckdb:vortex-compact 30727398 28820743 1.07
tpcds_q77/duckdb:vortex-compact 🚨 42903702 38397532 1.12
tpcds_q78/duckdb:vortex-compact 85648716 87252695 0.98
tpcds_q79/duckdb:vortex-compact 40985397 41985643 0.98
tpcds_q80/duckdb:vortex-compact 70229074 69816268 1.01
tpcds_q81/duckdb:vortex-compact 34246552 33827895 1.01
tpcds_q82/duckdb:vortex-compact 51444795 50122508 1.03
tpcds_q83/duckdb:vortex-compact 37364685 34166597 1.09
tpcds_q84/duckdb:vortex-compact 🚨 22835840 20559965 1.11
tpcds_q85/duckdb:vortex-compact 55628067 54152018 1.03
tpcds_q86/duckdb:vortex-compact 🚀 21378924 24611760 0.87
tpcds_q87/duckdb:vortex-compact 47311308 47612891 0.99
tpcds_q88/duckdb:vortex-compact 75836377 76075404 1.00
tpcds_q89/duckdb:vortex-compact 31947240 33111149 0.96
tpcds_q90/duckdb:vortex-compact 11393273 10677871 1.07
tpcds_q91/duckdb:vortex-compact 39721643 40969203 0.97
tpcds_q92/duckdb:vortex-compact 45946362 44559640 1.03
tpcds_q93/duckdb:vortex-compact 32355709 32696394 0.99
tpcds_q94/duckdb:vortex-compact 27503670 27572789 1.00
tpcds_q95/duckdb:vortex-compact 163868602 165033952 0.99
tpcds_q96/duckdb:vortex-compact 17147581 16324283 1.05
tpcds_q97/duckdb:vortex-compact 43479794 42221333 1.03
tpcds_q98/duckdb:vortex-compact 27806773 27233813 1.02
tpcds_q99/duckdb:vortex-compact 26217514 26795874 0.98
duckdb / parquet (1.007x ➖, 2↑ 0↓)
name PR 49cce3b (ns) base 170ff39 (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 29236585 29953627 0.98
tpcds_q02/duckdb:parquet 24172115 24435954 0.99
tpcds_q03/duckdb:parquet 🚀 12491975 14018318 0.89
tpcds_q04/duckdb:parquet 171975956 168114225 1.02
tpcds_q05/duckdb:parquet 33108726 31250737 1.06
tpcds_q06/duckdb:parquet 33458122 33594851 1.00
tpcds_q07/duckdb:parquet 24033125 23408818 1.03
tpcds_q08/duckdb:parquet 29083757 29366696 0.99
tpcds_q09/duckdb:parquet 44061650 44364502 0.99
tpcds_q10/duckdb:parquet 37142547 37573834 0.99
tpcds_q11/duckdb:parquet 91818482 91208127 1.01
tpcds_q12/duckdb:parquet 17039129 17337881 0.98
tpcds_q13/duckdb:parquet 35308930 35199497 1.00
tpcds_q14/duckdb:parquet 99466919 102490005 0.97
tpcds_q15/duckdb:parquet 30466970 31168732 0.98
tpcds_q16/duckdb:parquet 22552054 22828112 0.99
tpcds_q17/duckdb:parquet 38396248 38484503 1.00
tpcds_q18/duckdb:parquet 48569090 48455137 1.00
tpcds_q19/duckdb:parquet 31691524 31379188 1.01
tpcds_q20/duckdb:parquet 18614895 18516578 1.01
tpcds_q21/duckdb:parquet 11637988 11466624 1.01
tpcds_q22/duckdb:parquet 71955502 69759957 1.03
tpcds_q23/duckdb:parquet 82294996 83763522 0.98
tpcds_q24/duckdb:parquet 46488892 46526637 1.00
tpcds_q25/duckdb:parquet 35593430 35527469 1.00
tpcds_q26/duckdb:parquet 39600900 38872548 1.02
tpcds_q27/duckdb:parquet 52954823 53105286 1.00
tpcds_q28/duckdb:parquet 42448269 42894240 0.99
tpcds_q29/duckdb:parquet 38065278 40345943 0.94
tpcds_q30/duckdb:parquet 37821265 37285626 1.01
tpcds_q31/duckdb:parquet 29026771 28477765 1.02
tpcds_q32/duckdb:parquet 13532598 12554490 1.08
tpcds_q33/duckdb:parquet 24002360 23013685 1.04
tpcds_q34/duckdb:parquet 23523611 23050126 1.02
tpcds_q35/duckdb:parquet 63187679 61215455 1.03
tpcds_q36/duckdb:parquet 22899344 22724045 1.01
tpcds_q37/duckdb:parquet 14920040 14126294 1.06
tpcds_q38/duckdb:parquet 37703869 36435651 1.03
tpcds_q39/duckdb:parquet 33287721 32000167 1.04
tpcds_q40/duckdb:parquet 20677551 19176016 1.08
tpcds_q41/duckdb:parquet 9193330 8746997 1.05
tpcds_q42/duckdb:parquet 12845464 12675075 1.01
tpcds_q43/duckdb:parquet 19512380 19258234 1.01
tpcds_q44/duckdb:parquet 27772720 26065577 1.07
tpcds_q45/duckdb:parquet 28738410 28600987 1.00
tpcds_q46/duckdb:parquet 49268398 47338178 1.04
tpcds_q47/duckdb:parquet 51018370 49578608 1.03
tpcds_q48/duckdb:parquet 32195137 32350424 1.00
tpcds_q49/duckdb:parquet 29063087 29016215 1.00
tpcds_q50/duckdb:parquet 26577348 26008306 1.02
tpcds_q51/duckdb:parquet 108838866 103639975 1.05
tpcds_q52/duckdb:parquet 13323806 13536934 0.98
tpcds_q53/duckdb:parquet 20025922 18540722 1.08
tpcds_q54/duckdb:parquet 29990763 28791778 1.04
tpcds_q55/duckdb:parquet 12371826 12934006 0.96
tpcds_q56/duckdb:parquet 24224061 24158914 1.00
tpcds_q57/duckdb:parquet 38620960 38239197 1.01
tpcds_q58/duckdb:parquet 26473386 25475774 1.04
tpcds_q59/duckdb:parquet 36271682 36363440 1.00
tpcds_q60/duckdb:parquet 26626866 25841272 1.03
tpcds_q61/duckdb:parquet 34191306 32495788 1.05
tpcds_q62/duckdb:parquet 12842948 12618800 1.02
tpcds_q63/duckdb:parquet 17979849 17285213 1.04
tpcds_q64/duckdb:parquet 82513258 80752693 1.02
tpcds_q65/duckdb:parquet 23243935 23118416 1.01
tpcds_q66/duckdb:parquet 29530954 29062875 1.02
tpcds_q67/duckdb:parquet 139604354 137020614 1.02
tpcds_q68/duckdb:parquet 39171739 38372153 1.02
tpcds_q69/duckdb:parquet 38407167 38315625 1.00
tpcds_q70/duckdb:parquet 22488260 22913458 0.98
tpcds_q71/duckdb:parquet 23102289 22477687 1.03
tpcds_q72/duckdb:parquet 167788997 166418867 1.01
tpcds_q73/duckdb:parquet 21028901 20999461 1.00
tpcds_q74/duckdb:parquet 128210383 127597268 1.00
tpcds_q75/duckdb:parquet 57692167 57721849 1.00
tpcds_q76/duckdb:parquet 21885765 22075800 0.99
tpcds_q77/duckdb:parquet 25099955 26094886 0.96
tpcds_q78/duckdb:parquet 77291535 77758344 0.99
tpcds_q79/duckdb:parquet 30411426 29525394 1.03
tpcds_q80/duckdb:parquet 43699932 45352653 0.96
tpcds_q81/duckdb:parquet 35246524 35264349 1.00
tpcds_q82/duckdb:parquet 16680554 18470127 0.90
tpcds_q83/duckdb:parquet 18601192 18595792 1.00
tpcds_q84/duckdb:parquet 20559720 21781352 0.94
tpcds_q85/duckdb:parquet 42354911 42118982 1.01
tpcds_q86/duckdb:parquet 14069890 13600119 1.03
tpcds_q87/duckdb:parquet 39197814 39119363 1.00
tpcds_q88/duckdb:parquet 54023466 53608603 1.01
tpcds_q89/duckdb:parquet 21935083 22091965 0.99
tpcds_q90/duckdb:parquet 8235764 8430957 0.98
tpcds_q91/duckdb:parquet 25225922 25802324 0.98
tpcds_q92/duckdb:parquet 13359464 12791265 1.04
tpcds_q93/duckdb:parquet 32031838 31507928 1.02
tpcds_q94/duckdb:parquet 18080642 17994389 1.00
tpcds_q95/duckdb:parquet 🚀 131737853 148434931 0.89
tpcds_q96/duckdb:parquet 10928457 10430172 1.05
tpcds_q97/duckdb:parquet 38830015 37902122 1.02
tpcds_q98/duckdb:parquet 24742895 25025023 0.99
tpcds_q99/duckdb:parquet 20260291 20340004 1.00
duckdb / duckdb (1.012x ➖, 1↑ 3↓)
name PR 49cce3b (ns) base 170ff39 (ns) ratio (PR/base)
tpcds_q01/duckdb:duckdb 21461078 22419755 0.96
tpcds_q02/duckdb:duckdb 20837971 19650091 1.06
tpcds_q03/duckdb:duckdb 10360602 10234231 1.01
tpcds_q04/duckdb:duckdb 179302537 179419007 1.00
tpcds_q05/duckdb:duckdb 21418890 21061604 1.02
tpcds_q06/duckdb:duckdb 27705919 28177655 0.98
tpcds_q07/duckdb:duckdb 40119256 40141346 1.00
tpcds_q08/duckdb:duckdb 120734708 120485231 1.00
tpcds_q09/duckdb:duckdb 20692810 20477465 1.01
tpcds_q10/duckdb:duckdb 27523943 27512042 1.00
tpcds_q11/duckdb:duckdb 91757583 94160922 0.97
tpcds_q12/duckdb:duckdb 14057067 13866428 1.01
tpcds_q13/duckdb:duckdb 27832150 26197063 1.06
tpcds_q14/duckdb:duckdb 96092740 98668094 0.97
tpcds_q15/duckdb:duckdb 25248116 24682227 1.02
tpcds_q16/duckdb:duckdb 20701121 19341145 1.07
tpcds_q17/duckdb:duckdb 25393100 24654111 1.03
tpcds_q18/duckdb:duckdb 47322918 46440080 1.02
tpcds_q19/duckdb:duckdb 20137701 19022288 1.06
tpcds_q20/duckdb:duckdb 14567450 14525345 1.00
tpcds_q21/duckdb:duckdb 🚨 8189361 7388187 1.11
tpcds_q22/duckdb:duckdb 62250849 64432053 0.97
tpcds_q23/duckdb:duckdb 81378808 77630407 1.05
tpcds_q24/duckdb:duckdb 26085961 25339207 1.03
tpcds_q25/duckdb:duckdb 19267677 18410150 1.05
tpcds_q26/duckdb:duckdb 29135758 28133035 1.04
tpcds_q27/duckdb:duckdb 42284000 41503379 1.02
tpcds_q28/duckdb:duckdb 26537514 26339072 1.01
tpcds_q29/duckdb:duckdb 23694942 23713392 1.00
tpcds_q30/duckdb:duckdb 31036827 30930674 1.00
tpcds_q31/duckdb:duckdb 51732238 52076444 0.99
tpcds_q32/duckdb:duckdb 8452887 8488063 1.00
tpcds_q33/duckdb:duckdb 16144008 15828501 1.02
tpcds_q34/duckdb:duckdb 17350303 18542118 0.94
tpcds_q35/duckdb:duckdb 37518335 36922554 1.02
tpcds_q36/duckdb:duckdb 72145428 69613717 1.04
tpcds_q37/duckdb:duckdb 8789580 8815729 1.00
tpcds_q38/duckdb:duckdb 32929707 33210603 0.99
tpcds_q39/duckdb:duckdb 28407241 28731337 0.99
tpcds_q40/duckdb:duckdb 14777658 14191664 1.04
tpcds_q41/duckdb:duckdb 9520146 9537703 1.00
tpcds_q42/duckdb:duckdb 8766371 8631339 1.02
tpcds_q43/duckdb:duckdb 14770738 14646781 1.01
tpcds_q44/duckdb:duckdb 15633970 15304388 1.02
tpcds_q45/duckdb:duckdb 18565722 18590504 1.00
tpcds_q46/duckdb:duckdb 38129538 38016543 1.00
tpcds_q47/duckdb:duckdb 46290043 46481928 1.00
tpcds_q48/duckdb:duckdb 25160917 24639634 1.02
tpcds_q49/duckdb:duckdb 20318037 21671646 0.94
tpcds_q50/duckdb:duckdb 15986581 15735929 1.02
tpcds_q51/duckdb:duckdb 100417488 98480510 1.02
tpcds_q52/duckdb:duckdb 🚨 10890436 9228037 1.18
tpcds_q53/duckdb:duckdb 17709731 17600563 1.01
tpcds_q54/duckdb:duckdb 19455451 18493509 1.05
tpcds_q55/duckdb:duckdb 10224246 9408666 1.09
tpcds_q56/duckdb:duckdb 16913922 16773971 1.01
tpcds_q57/duckdb:duckdb 36251475 36071099 1.01
tpcds_q58/duckdb:duckdb 17493044 16645997 1.05
tpcds_q59/duckdb:duckdb 36820895 36954127 1.00
tpcds_q60/duckdb:duckdb 19722874 18017040 1.09
tpcds_q61/duckdb:duckdb 16213602 16525389 0.98
tpcds_q62/duckdb:duckdb 9966410 9624805 1.04
tpcds_q63/duckdb:duckdb 16553886 16138199 1.03
tpcds_q64/duckdb:duckdb 59088543 58674671 1.01
tpcds_q65/duckdb:duckdb 35941677 36410398 0.99
tpcds_q66/duckdb:duckdb 26498827 26533157 1.00
tpcds_q67/duckdb:duckdb 133366261 130635901 1.02
tpcds_q68/duckdb:duckdb 26334351 27383463 0.96
tpcds_q69/duckdb:duckdb 27377952 27363658 1.00
tpcds_q70/duckdb:duckdb 16749429 16780683 1.00
tpcds_q71/duckdb:duckdb 15914165 16440964 0.97
tpcds_q72/duckdb:duckdb 49054539 45482282 1.08
tpcds_q73/duckdb:duckdb 12986410 13823801 0.94
tpcds_q74/duckdb:duckdb 146698417 143986650 1.02
tpcds_q75/duckdb:duckdb 46475885 45983954 1.01
tpcds_q76/duckdb:duckdb 14662221 15172618 0.97
tpcds_q77/duckdb:duckdb 15687920 14901055 1.05
tpcds_q78/duckdb:duckdb 65307819 65476635 1.00
tpcds_q79/duckdb:duckdb 20211108 20314956 0.99
tpcds_q80/duckdb:duckdb 31563738 32586851 0.97
tpcds_q81/duckdb:duckdb 41671931 40451413 1.03
tpcds_q82/duckdb:duckdb 🚨 12027027 10416968 1.15
tpcds_q83/duckdb:duckdb 11184821 10959504 1.02
tpcds_q84/duckdb:duckdb 14798734 15253733 0.97
tpcds_q85/duckdb:duckdb 26524265 25909706 1.02
tpcds_q86/duckdb:duckdb 12361065 11987150 1.03
tpcds_q87/duckdb:duckdb 37676882 35688539 1.06
tpcds_q88/duckdb:duckdb 30716431 29237223 1.05
tpcds_q89/duckdb:duckdb 21953946 22469937 0.98
tpcds_q90/duckdb:duckdb 6577284 6245900 1.05
tpcds_q91/duckdb:duckdb 15279897 14865332 1.03
tpcds_q92/duckdb:duckdb 🚀 9750961 10969474 0.89
tpcds_q93/duckdb:duckdb 23610376 23762960 0.99
tpcds_q94/duckdb:duckdb 14448342 14517425 1.00
tpcds_q95/duckdb:duckdb 118932638 130231876 0.91
tpcds_q96/duckdb:duckdb 5780890 5609572 1.03
tpcds_q97/duckdb:duckdb 31745679 32054685 0.99
tpcds_q98/duckdb:duckdb 21508967 21371443 1.01
tpcds_q99/duckdb:duckdb 16799636 16748398 1.00
File Size Changes (15 files changed, +0.4% overall, 12↑ 3↓)
File Scale Format Base HEAD Change %
date_dim.vortex 1.0 vortex-file-compressed 956.61 KB 1.03 MB +98.77 KB +10.3%
store_returns.vortex 1.0 vortex-file-compressed 10.97 MB 11.39 MB +421.59 KB +3.8%
catalog_returns.vortex 1.0 vortex-file-compressed 7.16 MB 7.43 MB +273.66 KB +3.7%
item.vortex 1.0 vortex-file-compressed 1.63 MB 1.66 MB +30.27 KB +1.8%
date_dim.vortex 1.0 vortex-compact 151.55 KB 154.03 KB +2.48 KB +1.6%
catalog_page.vortex 1.0 vortex-file-compressed 565.70 KB 571.28 KB +5.59 KB +1.0%
store_sales.vortex 1.0 vortex-file-compressed 96.34 MB 97.04 MB +721.73 KB +0.7%
catalog_sales.vortex 1.0 vortex-file-compressed 70.45 MB 70.78 MB +340.13 KB +0.5%
customer_address.vortex 1.0 vortex-file-compressed 826.70 KB 830.46 KB +3.77 KB +0.5%
web_sales.vortex 1.0 vortex-file-compressed 34.20 MB 34.27 MB +64.74 KB +0.2%
time_dim.vortex 1.0 vortex-file-compressed 380.14 KB 380.43 KB +296 B +0.1%
customer.vortex 1.0 vortex-file-compressed 4.26 MB 4.26 MB +1.00 KB +0.0%
catalog_sales.vortex 1.0 vortex-compact 59.32 MB 59.31 MB 3.31 KB -0.0%
item.vortex 1.0 vortex-compact 994.96 KB 994.60 KB 376 B -0.0%
catalog_page.vortex 1.0 vortex-compact 363.54 KB 362.70 KB 856 B -0.2%

Totals:

  • vortex-compact: 207.50 MB → 207.50 MB (-0.0%)
  • vortex-file-compressed: 269.94 MB → 271.85 MB (+0.7%)

@github-actions

github-actions Bot commented Jun 16, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -4.6%
Engines: DataFusion No clear signal (-7.4%, environment too noisy confidence) · DuckDB No clear signal (-1.8%, environment too noisy confidence)
Vortex (geomean): 0.996x ➖
Parquet (geomean): 1.044x ➖
Shifts: Parquet (control) +4.4% · Median polish +3.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.914x ➖, 2↑ 1↓)
name PR b2facee (ns) base 67a2b22 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 41370941 55973209 0.74
fineweb_q01/datafusion:vortex-file-compressed 🚨 1298652678 829385521 1.57
fineweb_q02/datafusion:vortex-file-compressed 1285928769 1017114368 1.26
fineweb_q03/datafusion:vortex-file-compressed 1853777692 1445121949 1.28
fineweb_q04/datafusion:vortex-file-compressed 1234027423 1387298689 0.89
fineweb_q05/datafusion:vortex-file-compressed 1090507897 1344174496 0.81
fineweb_q06/datafusion:vortex-file-compressed 1581397465 1651959304 0.96
fineweb_q07/datafusion:vortex-file-compressed 🚀 1283009358 1993229024 0.64
fineweb_q08/datafusion:vortex-file-compressed 🚀 647221980 1207571626 0.54
datafusion / vortex-compact (0.960x ➖, 1↑ 0↓)
name PR b2facee (ns) base 67a2b22 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 34097078 38483687 0.89
fineweb_q01/datafusion:vortex-compact 873502562 791035084 1.10
fineweb_q02/datafusion:vortex-compact 🚀 619423361 1016348737 0.61
fineweb_q03/datafusion:vortex-compact 1397341892 1382315285 1.01
fineweb_q04/datafusion:vortex-compact 1727259500 1667786737 1.04
fineweb_q05/datafusion:vortex-compact 1388258445 1371599777 1.01
fineweb_q06/datafusion:vortex-compact 1450811958 1343766300 1.08
fineweb_q07/datafusion:vortex-compact 1212519589 1202530877 1.01
fineweb_q08/datafusion:vortex-compact 476257390 475099191 1.00
datafusion / parquet (1.012x ➖, 0↑ 1↓)
name PR b2facee (ns) base 67a2b22 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 1827276570 1839294105 0.99
fineweb_q01/datafusion:parquet 2495498638 2787575791 0.90
fineweb_q02/datafusion:parquet 2532329391 2584324806 0.98
fineweb_q03/datafusion:parquet 2348467721 3273549973 0.72
fineweb_q04/datafusion:parquet 2848336153 3136015217 0.91
fineweb_q05/datafusion:parquet 2802601158 2749213731 1.02
fineweb_q06/datafusion:parquet 3266797754 2650854360 1.23
fineweb_q07/datafusion:parquet 2862483928 2676018892 1.07
fineweb_q08/datafusion:parquet 🚨 3345683411 2300174486 1.45
duckdb / vortex-file-compressed (1.103x ➖, 0↑ 0↓)
name PR b2facee (ns) base 67a2b22 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 129075144 116416849 1.11
fineweb_q01/duckdb:vortex-file-compressed 988126564 833234963 1.19
fineweb_q02/duckdb:vortex-file-compressed 843281363 715471418 1.18
fineweb_q03/duckdb:vortex-file-compressed 1649329826 1556539204 1.06
fineweb_q04/duckdb:vortex-file-compressed 1485375724 1532362095 0.97
fineweb_q05/duckdb:vortex-file-compressed 1838769642 1491987029 1.23
fineweb_q06/duckdb:vortex-file-compressed 1718066805 1656793162 1.04
fineweb_q07/duckdb:vortex-file-compressed 1586909711 1595632991 0.99
fineweb_q08/duckdb:vortex-file-compressed 677461831 567854636 1.19
duckdb / vortex-compact (1.016x ➖, 0↑ 1↓)
name PR b2facee (ns) base 67a2b22 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 90377916 121812293 0.74
fineweb_q01/duckdb:vortex-compact 746203308 685520877 1.09
fineweb_q02/duckdb:vortex-compact 🚨 891757824 678599037 1.31
fineweb_q03/duckdb:vortex-compact 1997831130 1794236143 1.11
fineweb_q04/duckdb:vortex-compact 1912009607 1985993133 0.96
fineweb_q05/duckdb:vortex-compact 1838858521 1778177565 1.03
fineweb_q06/duckdb:vortex-compact 1746902310 1827617648 0.96
fineweb_q07/duckdb:vortex-compact 1608256069 1749960143 0.92
fineweb_q08/duckdb:vortex-compact 684414194 613850610 1.11
duckdb / parquet (1.078x ➖, 0↑ 0↓)
name PR b2facee (ns) base 67a2b22 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1334889321 1223884806 1.09
fineweb_q01/duckdb:parquet 1649260444 1610131315 1.02
fineweb_q02/duckdb:parquet 1590702210 1616995630 0.98
fineweb_q03/duckdb:parquet 4257757954 4075381406 1.04
fineweb_q04/duckdb:parquet 2227588742 2495007803 0.89
fineweb_q05/duckdb:parquet 3129781674 2459824120 1.27
fineweb_q06/duckdb:parquet 5744440464 4975811383 1.15
fineweb_q07/duckdb:parquet 3532494583 3119657327 1.13
fineweb_q08/duckdb:parquet 1458426339 1269734719 1.15

@github-actions

github-actions Bot commented Jun 16, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: Statistical and Population Genetics

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +2.9%
Engines: DuckDB No clear signal (+2.9%, low confidence)
Vortex (geomean): 1.000x ➖
Parquet (geomean): 0.972x ➖
Shifts: Parquet (control) -2.8% · Median polish -0.5%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
duckdb / vortex-file-compressed (0.994x ➖, 0↑ 0↓)
name PR b2facee (ns) base 67a2b22 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 12341004 12404078 0.99
statpopgen_q01/duckdb:vortex-file-compressed 27847721 27771306 1.00
statpopgen_q02/duckdb:vortex-file-compressed 520955886 536178580 0.97
statpopgen_q03/duckdb:vortex-file-compressed 1061126558 1067724394 0.99
statpopgen_q04/duckdb:vortex-file-compressed 1062019754 1071825212 0.99
statpopgen_q05/duckdb:vortex-file-compressed 470150232 488019239 0.96
statpopgen_q06/duckdb:vortex-file-compressed 1547247561 1553362335 1.00
statpopgen_q07/duckdb:vortex-file-compressed 204119442 198272648 1.03
statpopgen_q08/duckdb:vortex-file-compressed 240026453 236324908 1.02
statpopgen_q09/duckdb:vortex-file-compressed 833924439 850837706 0.98
statpopgen_q10/duckdb:vortex-file-compressed 2606907995 2628991199 0.99
duckdb / vortex-compact (1.007x ➖, 0↑ 0↓)
name PR b2facee (ns) base 67a2b22 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact 12430965 12623473 0.98
statpopgen_q01/duckdb:vortex-compact 219957453 219358331 1.00
statpopgen_q02/duckdb:vortex-compact 571423214 574507944 0.99
statpopgen_q03/duckdb:vortex-compact 1171502401 1161621248 1.01
statpopgen_q04/duckdb:vortex-compact 1165085528 1182111143 0.99
statpopgen_q05/duckdb:vortex-compact 581320327 571540306 1.02
statpopgen_q06/duckdb:vortex-compact 1518855737 1510369609 1.01
statpopgen_q07/duckdb:vortex-compact 924141121 918282531 1.01
statpopgen_q08/duckdb:vortex-compact 970592092 946326241 1.03
statpopgen_q09/duckdb:vortex-compact 976552399 961666330 1.02
statpopgen_q10/duckdb:vortex-compact 2761929624 2664136964 1.04
duckdb / parquet (0.972x ➖, 0↑ 0↓)
name PR b2facee (ns) base 67a2b22 (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 305766268 311413760 0.98
statpopgen_q01/duckdb:parquet 391040847 392038922 1.00
statpopgen_q02/duckdb:parquet 766926469 789235474 0.97
statpopgen_q03/duckdb:parquet 1185975464 1224758704 0.97
statpopgen_q04/duckdb:parquet 1187285935 1230979316 0.96
statpopgen_q05/duckdb:parquet 812050206 833538257 0.97
statpopgen_q06/duckdb:parquet 1432853893 1468506527 0.98
statpopgen_q07/duckdb:parquet 865523721 893070886 0.97
statpopgen_q08/duckdb:parquet 868672247 906767986 0.96
statpopgen_q09/duckdb:parquet 1032008324 1047315583 0.99
statpopgen_q10/duckdb:parquet 2199631069 2320149908 0.95
File Size Changes (1 files changed, +0.0% overall, 1↑ 0↓)
File Scale Format Base HEAD Change %
gnomad.genomes.v3.1.2.hgdp_tgp.chr21.vortex 100000 vortex-file-compressed 1.96 GB 1.96 GB +220.00 KB +0.0%

Totals:

  • vortex-compact: 959.62 MB → 959.62 MB (0.0%)
  • vortex-file-compressed: 1.96 GB → 1.96 GB (+0.0%)

@github-actions

github-actions Bot commented Jun 16, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: Random Access

Vortex (geomean): 0.928x ➖
Parquet (geomean): 0.984x ➖

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
unknown / unknown (1.002x ➖, 6↑ 1↓)
name PR b2facee (ns) base 67a2b22 (ns) ratio (PR/base)
random-access/feature-vectors/correlated/lance-tokio-local-disk 🚨 1601964 386893 4.14
random-access/feature-vectors/correlated/lance-tokio-local-disk-footer 1071413 1048359 1.02
random-access/feature-vectors/correlated/parquet-tokio-local-disk 8294196744 8604747124 0.96
random-access/feature-vectors/correlated/parquet-tokio-local-disk-footer 8204307633 8468545109 0.97
random-access/feature-vectors/correlated/vortex-tokio-local-disk 🚀 2947903 4077350 0.72
random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer 🚀 2622275 2970054 0.88
random-access/feature-vectors/uniform/lance-tokio-local-disk 1231382 1171188 1.05
random-access/feature-vectors/uniform/lance-tokio-local-disk-footer 1891905 1817836 1.04
random-access/feature-vectors/uniform/parquet-tokio-local-disk 8301478888 8317022562 1.00
random-access/feature-vectors/uniform/parquet-tokio-local-disk-footer 8235369592 8370128029 0.98
random-access/feature-vectors/uniform/vortex-tokio-local-disk 3488263 3480441 1.00
random-access/feature-vectors/uniform/vortex-tokio-local-disk-footer 5806017 5866721 0.99
random-access/lance-tokio-local-disk 642541 633163 1.01
random-access/lance-tokio-local-disk-footer 1300032 1276153 1.02
random-access/nested-lists/correlated/lance-tokio-local-disk 236315 241365 0.98
random-access/nested-lists/correlated/lance-tokio-local-disk-footer 581761 587451 0.99
random-access/nested-lists/correlated/parquet-tokio-local-disk 127657561 128928080 0.99
random-access/nested-lists/correlated/parquet-tokio-local-disk-footer 128864838 127541622 1.01
random-access/nested-lists/correlated/vortex-tokio-local-disk 439806 474461 0.93
random-access/nested-lists/correlated/vortex-tokio-local-disk-footer 582246 603820 0.96
random-access/nested-lists/uniform/lance-tokio-local-disk 1034068 1004104 1.03
random-access/nested-lists/uniform/lance-tokio-local-disk-footer 1385264 1355909 1.02
random-access/nested-lists/uniform/parquet-tokio-local-disk 127244474 127791475 1.00
random-access/nested-lists/uniform/parquet-tokio-local-disk-footer 126925322 127458247 1.00
random-access/nested-lists/uniform/vortex-tokio-local-disk 1922070 1957201 0.98
random-access/nested-lists/uniform/vortex-tokio-local-disk-footer 2031615 2075261 0.98
random-access/nested-structs/correlated/lance-tokio-local-disk 369473 368104 1.00
random-access/nested-structs/correlated/lance-tokio-local-disk-footer 545847 549709 0.99
random-access/nested-structs/correlated/parquet-tokio-local-disk 21813098 22196441 0.98
random-access/nested-structs/correlated/parquet-tokio-local-disk-footer 21357815 22147155 0.96
random-access/nested-structs/correlated/vortex-tokio-local-disk 555226 561635 0.99
random-access/nested-structs/correlated/vortex-tokio-local-disk-footer 714316 734679 0.97
random-access/nested-structs/uniform/lance-tokio-local-disk 2715007 2611970 1.04
random-access/nested-structs/uniform/lance-tokio-local-disk-footer 2857188 2748713 1.04
random-access/nested-structs/uniform/parquet-tokio-local-disk 21696383 22188651 0.98
random-access/nested-structs/uniform/parquet-tokio-local-disk-footer 21466454 22281290 0.96
random-access/nested-structs/uniform/vortex-tokio-local-disk 1350866 1449595 0.93
random-access/nested-structs/uniform/vortex-tokio-local-disk-footer 1562096 1553559 1.01
random-access/parquet-tokio-local-disk 165129035 167230862 0.99
random-access/parquet-tokio-local-disk-footer 165353068 167026441 0.99
random-access/taxi/correlated/lance-tokio-local-disk 946903 935882 1.01
random-access/taxi/correlated/lance-tokio-local-disk-footer 1817629 1821879 1.00
random-access/taxi/correlated/parquet-tokio-local-disk 247569784 250043638 0.99
random-access/taxi/correlated/parquet-tokio-local-disk-footer 248099371 250943198 0.99
random-access/taxi/correlated/vortex-tokio-local-disk 🚀 993850 1205643 0.82
random-access/taxi/correlated/vortex-tokio-local-disk-footer 🚀 1463783 1639853 0.89
random-access/taxi/uniform/lance-tokio-local-disk 9569318 9287669 1.03
random-access/taxi/uniform/lance-tokio-local-disk-footer 10134225 9785165 1.04
random-access/taxi/uniform/parquet-tokio-local-disk 262579267 266653335 0.98
random-access/taxi/uniform/parquet-tokio-local-disk-footer 263063414 266823014 0.99
random-access/taxi/uniform/vortex-tokio-local-disk 3372188 3455617 0.98
random-access/taxi/uniform/vortex-tokio-local-disk-footer 3849747 4050774 0.95
random-access/vortex-tokio-local-disk 🚀 647106 744164 0.87
random-access/vortex-tokio-local-disk-footer 🚀 1009119 1123690 0.90

@github-actions

github-actions Bot commented Jun 16, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.4%
Engines: DataFusion No clear signal (-0.8%, low confidence) · DuckDB No clear signal (-0.0%, low confidence)
Vortex (geomean): 1.014x ➖
Parquet (geomean): 1.023x ➖
Shifts: Parquet (control) +2.3% · Median polish +1.5%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.007x ➖, 0↑ 0↓)
name PR b2facee (ns) base 67a2b22 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 408631446 422940188 0.97
tpch_q02/datafusion:vortex-file-compressed 101894247 103191526 0.99
tpch_q03/datafusion:vortex-file-compressed 196587170 192992516 1.02
tpch_q04/datafusion:vortex-file-compressed 98633196 99816954 0.99
tpch_q05/datafusion:vortex-file-compressed 331837643 334887654 0.99
tpch_q06/datafusion:vortex-file-compressed 36635381 36777051 1.00
tpch_q07/datafusion:vortex-file-compressed 454295169 446366257 1.02
tpch_q08/datafusion:vortex-file-compressed 341998039 336040237 1.02
tpch_q09/datafusion:vortex-file-compressed 587333820 591528163 0.99
tpch_q10/datafusion:vortex-file-compressed 229808413 226506833 1.01
tpch_q11/datafusion:vortex-file-compressed 79747224 78643922 1.01
tpch_q12/datafusion:vortex-file-compressed 108196776 106327657 1.02
tpch_q13/datafusion:vortex-file-compressed 199149502 197723755 1.01
tpch_q14/datafusion:vortex-file-compressed 47574415 46697806 1.02
tpch_q15/datafusion:vortex-file-compressed 96969166 94543572 1.03
tpch_q16/datafusion:vortex-file-compressed 76872002 72152711 1.07
tpch_q17/datafusion:vortex-file-compressed 592017297 575088431 1.03
tpch_q18/datafusion:vortex-file-compressed 849815960 818666886 1.04
tpch_q19/datafusion:vortex-file-compressed 63060263 64854070 0.97
tpch_q20/datafusion:vortex-file-compressed 156721946 156458715 1.00
tpch_q21/datafusion:vortex-file-compressed 614907477 609558538 1.01
tpch_q22/datafusion:vortex-file-compressed 52935906 54721784 0.97
datafusion / vortex-compact (1.006x ➖, 0↑ 0↓)
name PR b2facee (ns) base 67a2b22 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 445738352 451495630 0.99
tpch_q02/datafusion:vortex-compact 104414098 105405438 0.99
tpch_q03/datafusion:vortex-compact 197091201 196598527 1.00
tpch_q04/datafusion:vortex-compact 110607888 109888368 1.01
tpch_q05/datafusion:vortex-compact 342535967 338153589 1.01
tpch_q06/datafusion:vortex-compact 60039837 59992619 1.00
tpch_q07/datafusion:vortex-compact 464334284 473396606 0.98
tpch_q08/datafusion:vortex-compact 349163381 343840651 1.02
tpch_q09/datafusion:vortex-compact 595282528 596114904 1.00
tpch_q10/datafusion:vortex-compact 241788373 243631339 0.99
tpch_q11/datafusion:vortex-compact 80381978 79830767 1.01
tpch_q12/datafusion:vortex-compact 151510299 152306998 0.99
tpch_q13/datafusion:vortex-compact 248032770 244955807 1.01
tpch_q14/datafusion:vortex-compact 66114620 64836372 1.02
tpch_q15/datafusion:vortex-compact 150087860 149434120 1.00
tpch_q16/datafusion:vortex-compact 81099552 78005495 1.04
tpch_q17/datafusion:vortex-compact 575075700 578994973 0.99
tpch_q18/datafusion:vortex-compact 824003540 827003358 1.00
tpch_q19/datafusion:vortex-compact 207425971 205046235 1.01
tpch_q20/datafusion:vortex-compact 180130696 177130140 1.02
tpch_q21/datafusion:vortex-compact 627725747 622823153 1.01
tpch_q22/datafusion:vortex-compact 64735621 61881042 1.05
datafusion / parquet (1.016x ➖, 0↑ 0↓)
name PR b2facee (ns) base 67a2b22 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 484056039 479982836 1.01
tpch_q02/datafusion:parquet 173866591 174947434 0.99
tpch_q03/datafusion:parquet 263562344 255362638 1.03
tpch_q04/datafusion:parquet 123478967 122127523 1.01
tpch_q05/datafusion:parquet 397242788 399839424 0.99
tpch_q06/datafusion:parquet 133271106 127442929 1.05
tpch_q07/datafusion:parquet 566176791 550017877 1.03
tpch_q08/datafusion:parquet 457767383 447797385 1.02
tpch_q09/datafusion:parquet 744891599 737118337 1.01
tpch_q10/datafusion:parquet 586782050 571487736 1.03
tpch_q11/datafusion:parquet 120048173 118359318 1.01
tpch_q12/datafusion:parquet 211139192 210571084 1.00
tpch_q13/datafusion:parquet 351010949 348416512 1.01
tpch_q14/datafusion:parquet 155455555 151428034 1.03
tpch_q15/datafusion:parquet 261812961 257458103 1.02
tpch_q16/datafusion:parquet 125589507 121394847 1.03
tpch_q17/datafusion:parquet 667717112 665433716 1.00
tpch_q18/datafusion:parquet 885741393 870075111 1.02
tpch_q19/datafusion:parquet 280096088 279024789 1.00
tpch_q20/datafusion:parquet 294452046 297622507 0.99
tpch_q21/datafusion:parquet 647659775 652552251 0.99
tpch_q22/datafusion:parquet 224212295 207828920 1.08
datafusion / arrow (1.013x ➖, 1↑ 0↓)
name PR b2facee (ns) base 67a2b22 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 678394871 690662237 0.98
tpch_q02/datafusion:arrow 112928011 114302299 0.99
tpch_q03/datafusion:arrow 514248982 493881217 1.04
tpch_q04/datafusion:arrow 372300248 362709469 1.03
tpch_q05/datafusion:arrow 759925168 729654142 1.04
tpch_q06/datafusion:arrow 343556714 322435518 1.07
tpch_q07/datafusion:arrow 1133474181 1156555989 0.98
tpch_q08/datafusion:arrow 949050192 917714126 1.03
tpch_q09/datafusion:arrow 1081391692 1062443425 1.02
tpch_q10/datafusion:arrow 637200737 612158774 1.04
tpch_q11/datafusion:arrow 92018912 90867671 1.01
tpch_q12/datafusion:arrow 🚀 1192358944 1364918767 0.87
tpch_q13/datafusion:arrow 475827281 475379881 1.00
tpch_q14/datafusion:arrow 365201454 352436947 1.04
tpch_q15/datafusion:arrow 772219738 737583214 1.05
tpch_q16/datafusion:arrow 83219106 80853835 1.03
tpch_q17/datafusion:arrow 985561661 951870538 1.04
tpch_q18/datafusion:arrow 1852880998 1843361529 1.01
tpch_q19/datafusion:arrow 564031746 550643136 1.02
tpch_q20/datafusion:arrow 499933408 499729549 1.00
tpch_q21/datafusion:arrow 3126475761 3098068921 1.01
tpch_q22/datafusion:arrow 81738169 81112403 1.01
duckdb / vortex-file-compressed (1.012x ➖, 0↑ 0↓)
name PR b2facee (ns) base 67a2b22 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 170537979 169786083 1.00
tpch_q02/duckdb:vortex-file-compressed 51733741 52567394 0.98
tpch_q03/duckdb:vortex-file-compressed 123539550 122032375 1.01
tpch_q04/duckdb:vortex-file-compressed 163630061 157614064 1.04
tpch_q05/duckdb:vortex-file-compressed 138852850 134989696 1.03
tpch_q06/duckdb:vortex-file-compressed 33274311 33179207 1.00
tpch_q07/duckdb:vortex-file-compressed 131993309 132259206 1.00
tpch_q08/duckdb:vortex-file-compressed 169095525 166553089 1.02
tpch_q09/duckdb:vortex-file-compressed 393333844 394358982 1.00
tpch_q10/duckdb:vortex-file-compressed 187902939 191953288 0.98
tpch_q11/duckdb:vortex-file-compressed 32016670 31633922 1.01
tpch_q12/duckdb:vortex-file-compressed 99254774 98799501 1.00
tpch_q13/duckdb:vortex-file-compressed 273748425 271780024 1.01
tpch_q14/duckdb:vortex-file-compressed 54322294 53082758 1.02
tpch_q15/duckdb:vortex-file-compressed 88322895 88494204 1.00
tpch_q16/duckdb:vortex-file-compressed 76725804 77035538 1.00
tpch_q17/duckdb:vortex-file-compressed 92956961 92370139 1.01
tpch_q18/duckdb:vortex-file-compressed 290860785 285091799 1.02
tpch_q19/duckdb:vortex-file-compressed 81006099 79361540 1.02
tpch_q20/duckdb:vortex-file-compressed 146364748 140611663 1.04
tpch_q21/duckdb:vortex-file-compressed 517371225 496765538 1.04
tpch_q22/duckdb:vortex-file-compressed 65907743 63242042 1.04
duckdb / vortex-compact (1.031x ➖, 0↑ 1↓)
name PR b2facee (ns) base 67a2b22 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 235616733 230435090 1.02
tpch_q02/duckdb:vortex-compact 58660477 55940332 1.05
tpch_q03/duckdb:vortex-compact 143277524 135460640 1.06
tpch_q04/duckdb:vortex-compact 175821393 171524740 1.03
tpch_q05/duckdb:vortex-compact 167841080 164192212 1.02
tpch_q06/duckdb:vortex-compact 🚨 62568746 55679759 1.12
tpch_q07/duckdb:vortex-compact 176407758 172953496 1.02
tpch_q08/duckdb:vortex-compact 195947231 186080968 1.05
tpch_q09/duckdb:vortex-compact 429182542 425200638 1.01
tpch_q10/duckdb:vortex-compact 219567091 220248489 1.00
tpch_q11/duckdb:vortex-compact 38677259 38146734 1.01
tpch_q12/duckdb:vortex-compact 163188248 163295607 1.00
tpch_q13/duckdb:vortex-compact 330596081 324653557 1.02
tpch_q14/duckdb:vortex-compact 73475389 71610723 1.03
tpch_q15/duckdb:vortex-compact 116030105 115251695 1.01
tpch_q16/duckdb:vortex-compact 82763796 81708056 1.01
tpch_q17/duckdb:vortex-compact 106539182 107084606 0.99
tpch_q18/duckdb:vortex-compact 296071583 287972434 1.03
tpch_q19/duckdb:vortex-compact 99785066 96286102 1.04
tpch_q20/duckdb:vortex-compact 183063511 176064488 1.04
tpch_q21/duckdb:vortex-compact 551720070 513176707 1.08
tpch_q22/duckdb:vortex-compact 74877590 71079309 1.05
duckdb / parquet (1.031x ➖, 0↑ 1↓)
name PR b2facee (ns) base 67a2b22 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 265370576 261820622 1.01
tpch_q02/duckdb:parquet 103090202 98658625 1.04
tpch_q03/duckdb:parquet 208675950 206533360 1.01
tpch_q04/duckdb:parquet 136714090 132662985 1.03
tpch_q05/duckdb:parquet 222606531 224787400 0.99
tpch_q06/duckdb:parquet 74532913 74080610 1.01
tpch_q07/duckdb:parquet 187465004 185774764 1.01
tpch_q08/duckdb:parquet 267391213 265436450 1.01
tpch_q09/duckdb:parquet 497197454 485649827 1.02
tpch_q10/duckdb:parquet 640746251 619989311 1.03
tpch_q11/duckdb:parquet 🚨 72529018 59627457 1.22
tpch_q12/duckdb:parquet 142471430 130352948 1.09
tpch_q13/duckdb:parquet 454934788 433002537 1.05
tpch_q14/duckdb:parquet 181170345 182469510 0.99
tpch_q15/duckdb:parquet 105919882 101319001 1.05
tpch_q16/duckdb:parquet 163190350 163940965 1.00
tpch_q17/duckdb:parquet 181792286 178535336 1.02
tpch_q18/duckdb:parquet 373569716 362532623 1.03
tpch_q19/duckdb:parquet 293712328 284541927 1.03
tpch_q20/duckdb:parquet 236136657 229777950 1.03
tpch_q21/duckdb:parquet 572690399 558378667 1.03
tpch_q22/duckdb:parquet 293088529 294531862 1.00
duckdb / duckdb (1.049x ➖, 0↑ 1↓)
name PR b2facee (ns) base 67a2b22 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 122254825 120264404 1.02
tpch_q02/duckdb:duckdb 52058231 49620436 1.05
tpch_q03/duckdb:duckdb 103860500 104273364 1.00
tpch_q04/duckdb:duckdb 139556284 138410539 1.01
tpch_q05/duckdb:duckdb 120074962 119493974 1.00
tpch_q06/duckdb:duckdb 45300103 44544811 1.02
tpch_q07/duckdb:duckdb 92868917 90160839 1.03
tpch_q08/duckdb:duckdb 123347306 118133836 1.04
tpch_q09/duckdb:duckdb 293087817 279942373 1.05
tpch_q10/duckdb:duckdb 224911595 209073170 1.08
tpch_q11/duckdb:duckdb 20347558 19202667 1.06
tpch_q12/duckdb:duckdb 98909881 91019798 1.09
tpch_q13/duckdb:duckdb 🚨 257326203 228480696 1.13
tpch_q14/duckdb:duckdb 84238616 77416174 1.09
tpch_q15/duckdb:duckdb 83488191 82055808 1.02
tpch_q16/duckdb:duckdb 81726053 76399680 1.07
tpch_q17/duckdb:duckdb 90577473 88368345 1.02
tpch_q18/duckdb:duckdb 247785950 234463357 1.06
tpch_q19/duckdb:duckdb 131893761 123768120 1.07
tpch_q20/duckdb:duckdb 127401528 117332468 1.09
tpch_q21/duckdb:duckdb 317764764 296829554 1.07
tpch_q22/duckdb:duckdb 74322030 71072810 1.05
File Size Changes (26 files changed, +0.0% overall, 12↑ 14↓)
File Scale Format Base HEAD Change %
partsupp_1.vortex 10.0 vortex-compact 104.73 MB 105.49 MB +777.66 KB +0.7%
supplier_0.vortex 10.0 vortex-file-compressed 5.73 MB 5.77 MB +41.93 KB +0.7%
orders_0.vortex 10.0 vortex-file-compressed 144.11 MB 144.99 MB +901.50 KB +0.6%
lineitem_3.vortex 10.0 vortex-file-compressed 133.12 MB 133.29 MB +172.01 KB +0.1%
lineitem_0.vortex 10.0 vortex-file-compressed 134.16 MB 134.31 MB +154.52 KB +0.1%
lineitem_4.vortex 10.0 vortex-file-compressed 133.96 MB 134.10 MB +135.92 KB +0.1%
partsupp_1.vortex 10.0 vortex-file-compressed 120.27 MB 120.38 MB +118.34 KB +0.1%
customer_0.vortex 10.0 vortex-file-compressed 88.49 MB 88.53 MB +36.47 KB +0.0%
lineitem_6.vortex 10.0 vortex-file-compressed 132.80 MB 132.84 MB +46.23 KB +0.0%
lineitem_11.vortex 10.0 vortex-file-compressed 134.28 MB 134.31 MB +30.26 KB +0.0%
lineitem_8.vortex 10.0 vortex-file-compressed 133.55 MB 133.56 MB +8.59 KB +0.0%
partsupp_0.vortex 10.0 vortex-file-compressed 120.30 MB 120.30 MB +144 B +0.0%
lineitem_5.vortex 10.0 vortex-file-compressed 133.57 MB 133.52 MB 58.46 KB -0.0%
lineitem_9.vortex 10.0 vortex-file-compressed 134.31 MB 134.25 MB 59.84 KB -0.0%
lineitem_1.vortex 10.0 vortex-file-compressed 133.79 MB 133.71 MB 82.48 KB -0.1%
lineitem_2.vortex 10.0 vortex-file-compressed 134.07 MB 133.98 MB 89.25 KB -0.1%
lineitem_12.vortex 10.0 vortex-file-compressed 134.11 MB 134.00 MB 121.13 KB -0.1%
lineitem_10.vortex 10.0 vortex-file-compressed 134.15 MB 134.02 MB 130.48 KB -0.1%
orders_2.vortex 10.0 vortex-file-compressed 145.89 MB 145.73 MB 170.80 KB -0.1%
lineitem_7.vortex 10.0 vortex-file-compressed 133.72 MB 133.56 MB 166.31 KB -0.1%
partsupp_0.vortex 10.0 vortex-compact 105.53 MB 105.36 MB 177.61 KB -0.2%
part_1.vortex 10.0 vortex-compact 16.94 MB 16.91 MB 30.84 KB -0.2%
orders_1.vortex 10.0 vortex-file-compressed 145.83 MB 145.51 MB 323.70 KB -0.2%
part_0.vortex 10.0 vortex-file-compressed 24.80 MB 24.68 MB 116.81 KB -0.5%
part_1.vortex 10.0 vortex-file-compressed 24.77 MB 24.62 MB 148.53 KB -0.6%
part_0.vortex 10.0 vortex-compact 17.07 MB 16.81 MB 264.97 KB -1.5%

Totals:

  • vortex-compact: 1.93 GB → 1.93 GB (+0.0%)
  • vortex-file-compressed: 2.50 GB → 2.50 GB (+0.0%)

@github-actions

github-actions Bot commented Jun 16, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.0%
Engines: DataFusion No clear signal (+2.6%, environment too noisy confidence) · DuckDB No clear signal (-1.6%, low confidence)
Vortex (geomean): 0.992x ➖
Parquet (geomean): 0.992x ➖
Shifts: Parquet (control) -0.8% · Median polish -1.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.013x ➖, 0↑ 2↓)
name PR b2facee (ns) base 67a2b22 (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 1702300 1698770 1.00
clickbench_q01/datafusion:vortex-file-compressed 16109378 16495370 0.98
clickbench_q02/datafusion:vortex-file-compressed 35467181 38061493 0.93
clickbench_q03/datafusion:vortex-file-compressed 41616569 40852380 1.02
clickbench_q04/datafusion:vortex-file-compressed 248287605 254996983 0.97
clickbench_q05/datafusion:vortex-file-compressed 322355189 323338594 1.00
clickbench_q06/datafusion:vortex-file-compressed 1893131 1770961 1.07
clickbench_q07/datafusion:vortex-file-compressed 20421721 19993246 1.02
clickbench_q08/datafusion:vortex-file-compressed 348362413 353773483 0.98
clickbench_q09/datafusion:vortex-file-compressed 492526542 486486414 1.01
clickbench_q10/datafusion:vortex-file-compressed 75227633 76262917 0.99
clickbench_q11/datafusion:vortex-file-compressed 81279729 83959950 0.97
clickbench_q12/datafusion:vortex-file-compressed 282293566 275833037 1.02
clickbench_q13/datafusion:vortex-file-compressed 444637631 450257818 0.99
clickbench_q14/datafusion:vortex-file-compressed 260092619 274201454 0.95
clickbench_q15/datafusion:vortex-file-compressed 295949858 299140356 0.99
clickbench_q16/datafusion:vortex-file-compressed 695665670 694757196 1.00
clickbench_q17/datafusion:vortex-file-compressed 667823219 711222754 0.94
clickbench_q18/datafusion:vortex-file-compressed 1433832542 1436781228 1.00
clickbench_q19/datafusion:vortex-file-compressed 🚨 33236866 28265762 1.18
clickbench_q20/datafusion:vortex-file-compressed 337294876 348322354 0.97
clickbench_q21/datafusion:vortex-file-compressed 422800948 434905286 0.97
clickbench_q22/datafusion:vortex-file-compressed 532556351 528553549 1.01
clickbench_q23/datafusion:vortex-file-compressed 575829362 537744726 1.07
clickbench_q24/datafusion:vortex-file-compressed 44820285 43488894 1.03
clickbench_q25/datafusion:vortex-file-compressed 77680114 75510092 1.03
clickbench_q26/datafusion:vortex-file-compressed 43623811 42089476 1.04
clickbench_q27/datafusion:vortex-file-compressed 455616423 448019430 1.02
clickbench_q28/datafusion:vortex-file-compressed 2468981365 2475845887 1.00
clickbench_q29/datafusion:vortex-file-compressed 53600895 51764637 1.04
clickbench_q30/datafusion:vortex-file-compressed 236392017 238987541 0.99
clickbench_q31/datafusion:vortex-file-compressed 264373856 256493581 1.03
clickbench_q32/datafusion:vortex-file-compressed 1129182485 1121943579 1.01
clickbench_q33/datafusion:vortex-file-compressed 1500761774 1510074733 0.99
clickbench_q34/datafusion:vortex-file-compressed 1535414230 1481425220 1.04
clickbench_q35/datafusion:vortex-file-compressed 247401411 244412067 1.01
clickbench_q36/datafusion:vortex-file-compressed 🚨 67366331 60740853 1.11
clickbench_q37/datafusion:vortex-file-compressed 26277576 25787865 1.02
clickbench_q38/datafusion:vortex-file-compressed 17175131 15637334 1.10
clickbench_q39/datafusion:vortex-file-compressed 130766007 135368641 0.97
clickbench_q40/datafusion:vortex-file-compressed 13958609 13343591 1.05
clickbench_q41/datafusion:vortex-file-compressed 14180258 13508047 1.05
clickbench_q42/datafusion:vortex-file-compressed 14059144 13020462 1.08
datafusion / parquet (0.987x ➖, 1↑ 2↓)
name PR b2facee (ns) base 67a2b22 (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 1559410 1585076 0.98
clickbench_q01/datafusion:parquet 19932550 20821532 0.96
clickbench_q02/datafusion:parquet 42472081 46020839 0.92
clickbench_q03/datafusion:parquet 33924620 35558430 0.95
clickbench_q04/datafusion:parquet 266736084 281407216 0.95
clickbench_q05/datafusion:parquet 329319234 328508049 1.00
clickbench_q06/datafusion:parquet 🚨 2292191 1785667 1.28
clickbench_q07/datafusion:parquet 22952101 21451476 1.07
clickbench_q08/datafusion:parquet 342657722 368497049 0.93
clickbench_q09/datafusion:parquet 495949579 503639439 0.98
clickbench_q10/datafusion:parquet 93613707 97876207 0.96
clickbench_q11/datafusion:parquet 117266741 123850403 0.95
clickbench_q12/datafusion:parquet 301546089 313988954 0.96
clickbench_q13/datafusion:parquet 🚀 460864276 517725722 0.89
clickbench_q14/datafusion:parquet 309673206 331320418 0.93
clickbench_q15/datafusion:parquet 286284293 302235132 0.95
clickbench_q16/datafusion:parquet 668308596 716034896 0.93
clickbench_q17/datafusion:parquet 668333136 683166322 0.98
clickbench_q18/datafusion:parquet 1443089163 1550967748 0.93
clickbench_q19/datafusion:parquet 27004496 28839378 0.94
clickbench_q20/datafusion:parquet 574962473 585324439 0.98
clickbench_q21/datafusion:parquet 631869690 658415182 0.96
clickbench_q22/datafusion:parquet 947745614 959084009 0.99
clickbench_q23/datafusion:parquet 4322465337 4337525397 1.00
clickbench_q24/datafusion:parquet 53641612 54219325 0.99
clickbench_q25/datafusion:parquet 130810448 137417805 0.95
clickbench_q26/datafusion:parquet 52767065 54377817 0.97
clickbench_q27/datafusion:parquet 677219414 688367653 0.98
clickbench_q28/datafusion:parquet 2499787875 2532753909 0.99
clickbench_q29/datafusion:parquet 51208943 46664833 1.10
clickbench_q30/datafusion:parquet 325435880 334926834 0.97
clickbench_q31/datafusion:parquet 360488419 371027748 0.97
clickbench_q32/datafusion:parquet 1207861268 1139715160 1.06
clickbench_q33/datafusion:parquet 1598152498 1578874571 1.01
clickbench_q34/datafusion:parquet 1583705503 1599588251 0.99
clickbench_q35/datafusion:parquet 265012586 262641089 1.01
clickbench_q36/datafusion:parquet 110830953 114114184 0.97
clickbench_q37/datafusion:parquet 47017620 44193192 1.06
clickbench_q38/datafusion:parquet 67653635 63250338 1.07
clickbench_q39/datafusion:parquet 220286952 220327784 1.00
clickbench_q40/datafusion:parquet 23861675 24113842 0.99
clickbench_q41/datafusion:parquet 21984625 22557887 0.97
clickbench_q42/datafusion:parquet 🚨 25716778 23307380 1.10
duckdb / vortex-file-compressed (0.972x ➖, 2↑ 0↓)
name PR b2facee (ns) base 67a2b22 (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 6873179 7558924 0.91
clickbench_q01/duckdb:vortex-file-compressed 11125726 11256042 0.99
clickbench_q02/duckdb:vortex-file-compressed 26410521 27985802 0.94
clickbench_q03/duckdb:vortex-file-compressed 30744550 30941532 0.99
clickbench_q04/duckdb:vortex-file-compressed 194832994 199764161 0.98
clickbench_q05/duckdb:vortex-file-compressed 184427331 187445004 0.98
clickbench_q06/duckdb:vortex-file-compressed 21540915 20377892 1.06
clickbench_q07/duckdb:vortex-file-compressed 15789812 15152789 1.04
clickbench_q08/duckdb:vortex-file-compressed 269214900 277049664 0.97
clickbench_q09/duckdb:vortex-file-compressed 349181752 359425733 0.97
clickbench_q10/duckdb:vortex-file-compressed 71366284 73283571 0.97
clickbench_q11/duckdb:vortex-file-compressed 79139132 82731449 0.96
clickbench_q12/duckdb:vortex-file-compressed 202985920 213014832 0.95
clickbench_q13/duckdb:vortex-file-compressed 439502770 438416352 1.00
clickbench_q14/duckdb:vortex-file-compressed 240758218 254171843 0.95
clickbench_q15/duckdb:vortex-file-compressed 248699691 252469353 0.99
clickbench_q16/duckdb:vortex-file-compressed 541293012 562879429 0.96
clickbench_q17/duckdb:vortex-file-compressed 433030458 462432382 0.94
clickbench_q18/duckdb:vortex-file-compressed 982591924 1004294260 0.98
clickbench_q19/duckdb:vortex-file-compressed 21138379 22626430 0.93
clickbench_q20/duckdb:vortex-file-compressed 325932784 344839837 0.95
clickbench_q21/duckdb:vortex-file-compressed 421423897 442194193 0.95
clickbench_q22/duckdb:vortex-file-compressed 1221201492 1166599395 1.05
clickbench_q23/duckdb:vortex-file-compressed 🚀 184507088 221846945 0.83
clickbench_q24/duckdb:vortex-file-compressed 37841591 41443898 0.91
clickbench_q25/duckdb:vortex-file-compressed 80909027 81149194 1.00
clickbench_q26/duckdb:vortex-file-compressed 50392371 50308847 1.00
clickbench_q27/duckdb:vortex-file-compressed 443908563 463889125 0.96
clickbench_q28/duckdb:vortex-file-compressed 3055769972 3076319994 0.99
clickbench_q29/duckdb:vortex-file-compressed 30114168 28965061 1.04
clickbench_q30/duckdb:vortex-file-compressed 203526677 196053864 1.04
clickbench_q31/duckdb:vortex-file-compressed 298499211 306886705 0.97
clickbench_q32/duckdb:vortex-file-compressed 1150107997 1191181120 0.97
clickbench_q33/duckdb:vortex-file-compressed 1149570538 1235852156 0.93
clickbench_q34/duckdb:vortex-file-compressed 1215822625 1287688869 0.94
clickbench_q35/duckdb:vortex-file-compressed 387273139 392837397 0.99
clickbench_q36/duckdb:vortex-file-compressed 28592534 29043837 0.98
clickbench_q37/duckdb:vortex-file-compressed 19152643 18430353 1.04
clickbench_q38/duckdb:vortex-file-compressed 21473211 22383361 0.96
clickbench_q39/duckdb:vortex-file-compressed 44348153 46295150 0.96
clickbench_q40/duckdb:vortex-file-compressed 19198746 19257969 1.00
clickbench_q41/duckdb:vortex-file-compressed 20529349 19677188 1.04
clickbench_q42/duckdb:vortex-file-compressed 🚀 19941991 22676316 0.88
duckdb / parquet (0.996x ➖, 0↑ 0↓)
name PR b2facee (ns) base 67a2b22 (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 24936668 23457527 1.06
clickbench_q01/duckdb:parquet 30868701 28910157 1.07
clickbench_q02/duckdb:parquet 50230278 50623842 0.99
clickbench_q03/duckdb:parquet 40374793 41285461 0.98
clickbench_q04/duckdb:parquet 213795661 213162395 1.00
clickbench_q05/duckdb:parquet 265548946 267009526 0.99
clickbench_q06/duckdb:parquet 48613143 48163633 1.01
clickbench_q07/duckdb:parquet 32435236 31403167 1.03
clickbench_q08/duckdb:parquet 280358592 279575674 1.00
clickbench_q09/duckdb:parquet 407718176 411867504 0.99
clickbench_q10/duckdb:parquet 84022429 85899151 0.98
clickbench_q11/duckdb:parquet 101825250 103202223 0.99
clickbench_q12/duckdb:parquet 289685283 292008730 0.99
clickbench_q13/duckdb:parquet 491718981 494119661 1.00
clickbench_q14/duckdb:parquet 325276034 332753568 0.98
clickbench_q15/duckdb:parquet 266235648 273015898 0.98
clickbench_q16/duckdb:parquet 612897460 626776553 0.98
clickbench_q17/duckdb:parquet 511194099 520601903 0.98
clickbench_q18/duckdb:parquet 1076090472 1099999312 0.98
clickbench_q19/duckdb:parquet 29452622 28792981 1.02
clickbench_q20/duckdb:parquet 428633049 427455802 1.00
clickbench_q21/duckdb:parquet 538535741 545382841 0.99
clickbench_q22/duckdb:parquet 928348371 943798631 0.98
clickbench_q23/duckdb:parquet 266701825 270974344 0.98
clickbench_q24/duckdb:parquet 72986018 70757602 1.03
clickbench_q25/duckdb:parquet 163612744 167465241 0.98
clickbench_q26/duckdb:parquet 56530528 55153884 1.02
clickbench_q27/duckdb:parquet 479911523 481262007 1.00
clickbench_q28/duckdb:parquet 4808042597 4912061031 0.98
clickbench_q29/duckdb:parquet 42856108 43153517 0.99
clickbench_q30/duckdb:parquet 315533164 321908572 0.98
clickbench_q31/duckdb:parquet 380650316 401611225 0.95
clickbench_q32/duckdb:parquet 1125290605 1168134217 0.96
clickbench_q33/duckdb:parquet 1140036359 1171264560 0.97
clickbench_q34/duckdb:parquet 1193790148 1216725688 0.98
clickbench_q35/duckdb:parquet 379054161 381539844 0.99
clickbench_q36/duckdb:parquet 49193318 46603380 1.06
clickbench_q37/duckdb:parquet 34843346 34434537 1.01
clickbench_q38/duckdb:parquet 36060567 35776173 1.01
clickbench_q39/duckdb:parquet 92759298 93356827 0.99
clickbench_q40/duckdb:parquet 20610017 20435848 1.01
clickbench_q41/duckdb:parquet 21673184 21079580 1.03
clickbench_q42/duckdb:parquet 22659824 23715704 0.96
duckdb / duckdb (0.990x ➖, 0↑ 1↓)
name PR b2facee (ns) base 67a2b22 (ns) ratio (PR/base)
clickbench_q00/duckdb:duckdb 17090312 17560246 0.97
clickbench_q01/duckdb:duckdb 34511554 35278093 0.98
clickbench_q02/duckdb:duckdb 51136788 52201340 0.98
clickbench_q03/duckdb:duckdb 55911051 56700905 0.99
clickbench_q04/duckdb:duckdb 212726696 219189996 0.97
clickbench_q05/duckdb:duckdb 286578365 293978685 0.97
clickbench_q06/duckdb:duckdb 34319486 35437934 0.97
clickbench_q07/duckdb:duckdb 35480356 36324930 0.98
clickbench_q08/duckdb:duckdb 275212588 286538178 0.96
clickbench_q09/duckdb:duckdb 399145780 401536786 0.99
clickbench_q10/duckdb:duckdb 117922466 119066496 0.99
clickbench_q11/duckdb:duckdb 127142513 129924020 0.98
clickbench_q12/duckdb:duckdb 261608783 273502367 0.96
clickbench_q13/duckdb:duckdb 449909731 462090054 0.97
clickbench_q14/duckdb:duckdb 291991248 298835713 0.98
clickbench_q15/duckdb:duckdb 244113081 247446272 0.99
clickbench_q16/duckdb:duckdb 575009823 591043943 0.97
clickbench_q17/duckdb:duckdb 480146606 494619325 0.97
clickbench_q18/duckdb:duckdb 1061386416 1058890342 1.00
clickbench_q19/duckdb:duckdb 35788534 36174487 0.99
clickbench_q20/duckdb:duckdb 469985519 515564070 0.91
clickbench_q21/duckdb:duckdb 478022140 524394388 0.91
clickbench_q22/duckdb:duckdb 564567374 545493648 1.03
clickbench_q23/duckdb:duckdb 258343107 258713362 1.00
clickbench_q24/duckdb:duckdb 62989486 63476389 0.99
clickbench_q25/duckdb:duckdb 152641958 151710662 1.01
clickbench_q26/duckdb:duckdb 63885232 62868413 1.02
clickbench_q27/duckdb:duckdb 418056272 424827610 0.98
clickbench_q28/duckdb:duckdb 4485283489 4532039586 0.99
clickbench_q29/duckdb:duckdb 51917978 50821059 1.02
clickbench_q30/duckdb:duckdb 283088277 288092485 0.98
clickbench_q31/duckdb:duckdb 376492862 379190953 0.99
clickbench_q32/duckdb:duckdb 1150878835 1155392147 1.00
clickbench_q33/duckdb:duckdb 1202619021 1186787562 1.01
clickbench_q34/duckdb:duckdb 1248843079 1291510709 0.97
clickbench_q35/duckdb:duckdb 309340059 318828079 0.97
clickbench_q36/duckdb:duckdb 49409100 48861079 1.01
clickbench_q37/duckdb:duckdb 29470179 28689055 1.03
clickbench_q38/duckdb:duckdb 34433305 33296510 1.03
clickbench_q39/duckdb:duckdb 🚨 92804794 81326270 1.14
clickbench_q40/duckdb:duckdb 28668683 28400614 1.01
clickbench_q41/duckdb:duckdb 27794434 27534318 1.01
clickbench_q42/duckdb:duckdb 31319390 31071781 1.01
File Size Changes (104 files changed, -0.0% overall, 51↑ 53↓)
File Scale Format Base HEAD Change %
hits_16.vortex 1.0 vortex-file-compressed 79.97 MB 80.25 MB +284.66 KB +0.3%
hits_16.vortex 1.0 vortex-compact 48.08 MB 48.22 MB +140.69 KB +0.3%
hits_65.vortex 1.0 vortex-compact 129.39 MB 129.71 MB +327.21 KB +0.2%
hits_25.vortex 1.0 vortex-file-compressed 113.96 MB 114.20 MB +245.08 KB +0.2%
hits_2.vortex 1.0 vortex-file-compressed 186.45 MB 186.77 MB +324.82 KB +0.2%
hits_4.vortex 1.0 vortex-file-compressed 108.71 MB 108.89 MB +176.02 KB +0.2%
hits_34.vortex 1.0 vortex-file-compressed 97.84 MB 97.97 MB +133.07 KB +0.1%
hits_96.vortex 1.0 vortex-file-compressed 135.67 MB 135.80 MB +129.65 KB +0.1%
hits_31.vortex 1.0 vortex-file-compressed 90.11 MB 90.19 MB +73.81 KB +0.1%
hits_84.vortex 1.0 vortex-file-compressed 117.28 MB 117.37 MB +94.70 KB +0.1%
hits_30.vortex 1.0 vortex-file-compressed 87.11 MB 87.16 MB +58.65 KB +0.1%
hits_98.vortex 1.0 vortex-file-compressed 118.35 MB 118.43 MB +75.42 KB +0.1%
hits_43.vortex 1.0 vortex-file-compressed 227.30 MB 227.44 MB +143.05 KB +0.1%
hits_68.vortex 1.0 vortex-file-compressed 123.22 MB 123.29 MB +76.48 KB +0.1%
hits_92.vortex 1.0 vortex-file-compressed 147.02 MB 147.11 MB +87.94 KB +0.1%
hits_76.vortex 1.0 vortex-file-compressed 114.43 MB 114.50 MB +68.35 KB +0.1%
hits_99.vortex 1.0 vortex-file-compressed 123.17 MB 123.24 MB +70.57 KB +0.1%
hits_38.vortex 1.0 vortex-file-compressed 99.24 MB 99.29 MB +54.20 KB +0.1%
hits_11.vortex 1.0 vortex-file-compressed 80.05 MB 80.09 MB +42.71 KB +0.1%
hits_19.vortex 1.0 vortex-file-compressed 73.56 MB 73.60 MB +39.10 KB +0.1%
hits_41.vortex 1.0 vortex-file-compressed 224.07 MB 224.18 MB +113.80 KB +0.0%
hits_53.vortex 1.0 vortex-file-compressed 87.23 MB 87.27 MB +42.74 KB +0.0%
hits_78.vortex 1.0 vortex-file-compressed 164.19 MB 164.27 MB +78.45 KB +0.0%
hits_20.vortex 1.0 vortex-file-compressed 62.98 MB 63.01 MB +28.34 KB +0.0%
hits_42.vortex 1.0 vortex-file-compressed 222.98 MB 223.06 MB +90.15 KB +0.0%
hits_65.vortex 1.0 vortex-file-compressed 183.85 MB 183.92 MB +70.24 KB +0.0%
hits_54.vortex 1.0 vortex-file-compressed 221.38 MB 221.45 MB +76.45 KB +0.0%
hits_3.vortex 1.0 vortex-file-compressed 142.29 MB 142.34 MB +49.09 KB +0.0%
hits_63.vortex 1.0 vortex-file-compressed 69.26 MB 69.28 MB +23.52 KB +0.0%
hits_57.vortex 1.0 vortex-file-compressed 128.21 MB 128.25 MB +40.93 KB +0.0%
hits_39.vortex 1.0 vortex-file-compressed 80.34 MB 80.36 MB +25.49 KB +0.0%
hits_22.vortex 1.0 vortex-file-compressed 78.62 MB 78.64 MB +24.55 KB +0.0%
hits_5.vortex 1.0 vortex-file-compressed 92.95 MB 92.98 MB +28.35 KB +0.0%
hits_94.vortex 1.0 vortex-file-compressed 138.77 MB 138.80 MB +37.57 KB +0.0%
hits_23.vortex 1.0 vortex-file-compressed 77.92 MB 77.94 MB +20.62 KB +0.0%
hits_52.vortex 1.0 vortex-file-compressed 105.06 MB 105.09 MB +26.39 KB +0.0%
hits_9.vortex 1.0 vortex-file-compressed 99.26 MB 99.29 MB +24.60 KB +0.0%
hits_59.vortex 1.0 vortex-file-compressed 101.82 MB 101.84 MB +24.57 KB +0.0%
hits_46.vortex 1.0 vortex-file-compressed 69.46 MB 69.48 MB +16.36 KB +0.0%
hits_66.vortex 1.0 vortex-file-compressed 90.29 MB 90.32 MB +21.26 KB +0.0%
hits_71.vortex 1.0 vortex-file-compressed 102.07 MB 102.09 MB +23.38 KB +0.0%
hits_70.vortex 1.0 vortex-file-compressed 93.66 MB 93.68 MB +20.36 KB +0.0%
hits_36.vortex 1.0 vortex-file-compressed 68.46 MB 68.47 MB +14.73 KB +0.0%
hits_77.vortex 1.0 vortex-file-compressed 168.60 MB 168.63 MB +33.66 KB +0.0%
hits_29.vortex 1.0 vortex-file-compressed 59.81 MB 59.82 MB +11.57 KB +0.0%
hits_87.vortex 1.0 vortex-file-compressed 172.59 MB 172.61 MB +25.65 KB +0.0%
hits_35.vortex 1.0 vortex-file-compressed 115.21 MB 115.23 MB +15.20 KB +0.0%
hits_47.vortex 1.0 vortex-file-compressed 41.32 MB 41.32 MB +4.23 KB +0.0%
hits_44.vortex 1.0 vortex-file-compressed 186.88 MB 186.90 MB +15.16 KB +0.0%
hits_48.vortex 1.0 vortex-file-compressed 28.03 MB 28.03 MB +1.95 KB +0.0%
hits_89.vortex 1.0 vortex-file-compressed 184.52 MB 184.53 MB +8.68 KB +0.0%
hits_27.vortex 1.0 vortex-file-compressed 122.37 MB 122.36 MB 2.32 KB -0.0%
hits_72.vortex 1.0 vortex-file-compressed 84.90 MB 84.90 MB 3.63 KB -0.0%
hits_91.vortex 1.0 vortex-file-compressed 97.25 MB 97.24 MB 4.54 KB -0.0%
hits_93.vortex 1.0 vortex-file-compressed 90.55 MB 90.55 MB 4.81 KB -0.0%
hits_18.vortex 1.0 vortex-file-compressed 104.86 MB 104.85 MB 7.66 KB -0.0%
hits_51.vortex 1.0 vortex-file-compressed 277.55 MB 277.52 MB 29.40 KB -0.0%
hits_62.vortex 1.0 vortex-file-compressed 117.63 MB 117.61 MB 14.84 KB -0.0%
hits_6.vortex 1.0 vortex-file-compressed 93.37 MB 93.36 MB 12.08 KB -0.0%
hits_55.vortex 1.0 vortex-file-compressed 169.28 MB 169.25 MB 23.30 KB -0.0%
hits_61.vortex 1.0 vortex-file-compressed 101.30 MB 101.28 MB 14.71 KB -0.0%
hits_26.vortex 1.0 vortex-file-compressed 110.16 MB 110.14 MB 17.46 KB -0.0%
hits_33.vortex 1.0 vortex-file-compressed 57.27 MB 57.25 MB 12.05 KB -0.0%
hits_56.vortex 1.0 vortex-file-compressed 123.57 MB 123.54 MB 31.39 KB -0.0%
hits_74.vortex 1.0 vortex-file-compressed 119.92 MB 119.88 MB 35.15 KB -0.0%
hits_7.vortex 1.0 vortex-file-compressed 94.02 MB 93.99 MB 27.86 KB -0.0%
hits_75.vortex 1.0 vortex-file-compressed 63.31 MB 63.29 MB 19.93 KB -0.0%
hits_83.vortex 1.0 vortex-file-compressed 89.86 MB 89.82 MB 37.25 KB -0.0%
hits_24.vortex 1.0 vortex-file-compressed 77.50 MB 77.47 MB 33.73 KB -0.0%
hits_15.vortex 1.0 vortex-file-compressed 89.32 MB 89.28 MB 38.98 KB -0.0%
hits_50.vortex 1.0 vortex-file-compressed 179.47 MB 179.39 MB 79.46 KB -0.0%
hits_45.vortex 1.0 vortex-file-compressed 122.15 MB 122.09 MB 57.76 KB -0.0%
hits_28.vortex 1.0 vortex-file-compressed 119.90 MB 119.84 MB 61.78 KB -0.1%
hits_82.vortex 1.0 vortex-file-compressed 99.87 MB 99.82 MB 52.14 KB -0.1%
hits_80.vortex 1.0 vortex-file-compressed 104.98 MB 104.92 MB 60.47 KB -0.1%
hits_81.vortex 1.0 vortex-file-compressed 100.85 MB 100.79 MB 59.40 KB -0.1%
hits_14.vortex 1.0 vortex-file-compressed 111.45 MB 111.38 MB 74.33 KB -0.1%
hits_85.vortex 1.0 vortex-file-compressed 91.89 MB 91.83 MB 63.32 KB -0.1%
hits_12.vortex 1.0 vortex-file-compressed 101.13 MB 101.06 MB 72.23 KB -0.1%
hits_17.vortex 1.0 vortex-file-compressed 87.58 MB 87.52 MB 63.48 KB -0.1%
hits_79.vortex 1.0 vortex-file-compressed 145.20 MB 145.10 MB 105.82 KB -0.1%
hits_1.vortex 1.0 vortex-file-compressed 138.59 MB 138.49 MB 101.66 KB -0.1%
hits_32.vortex 1.0 vortex-file-compressed 66.87 MB 66.82 MB 50.92 KB -0.1%
hits_10.vortex 1.0 vortex-file-compressed 69.70 MB 69.64 MB 54.50 KB -0.1%
hits_69.vortex 1.0 vortex-file-compressed 123.07 MB 122.97 MB 96.55 KB -0.1%
hits_0.vortex 1.0 vortex-file-compressed 89.67 MB 89.60 MB 72.23 KB -0.1%
hits_64.vortex 1.0 vortex-file-compressed 81.35 MB 81.28 MB 69.09 KB -0.1%
hits_49.vortex 1.0 vortex-file-compressed 75.86 MB 75.79 MB 64.80 KB -0.1%
hits_97.vortex 1.0 vortex-file-compressed 107.10 MB 107.01 MB 92.52 KB -0.1%
hits_13.vortex 1.0 vortex-file-compressed 99.37 MB 99.29 MB 86.24 KB -0.1%
hits_95.vortex 1.0 vortex-file-compressed 96.75 MB 96.66 MB 95.36 KB -0.1%
hits_67.vortex 1.0 vortex-file-compressed 184.30 MB 184.11 MB 199.84 KB -0.1%
hits_88.vortex 1.0 vortex-file-compressed 111.49 MB 111.35 MB 145.93 KB -0.1%
hits_40.vortex 1.0 vortex-file-compressed 117.98 MB 117.82 MB 166.55 KB -0.1%
hits_86.vortex 1.0 vortex-file-compressed 69.45 MB 69.35 MB 101.18 KB -0.1%
hits_58.vortex 1.0 vortex-file-compressed 90.52 MB 90.35 MB 169.09 KB -0.2%
hits_27.vortex 1.0 vortex-compact 69.95 MB 69.81 MB 143.06 KB -0.2%
hits_8.vortex 1.0 vortex-file-compressed 93.38 MB 93.18 MB 208.49 KB -0.2%
hits_60.vortex 1.0 vortex-file-compressed 103.61 MB 103.37 MB 240.30 KB -0.2%
hits_37.vortex 1.0 vortex-file-compressed 86.03 MB 85.83 MB 205.13 KB -0.2%
hits_73.vortex 1.0 vortex-file-compressed 110.72 MB 110.43 MB 293.53 KB -0.3%
hits_21.vortex 1.0 vortex-file-compressed 94.33 MB 94.05 MB 288.34 KB -0.3%
hits_90.vortex 1.0 vortex-file-compressed 142.18 MB 140.17 MB 2.01 MB -1.4%
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%

Totals:

  • vortex-compact: 7.04 GB → 7.04 GB (+0.0%)
  • vortex-file-compressed: 11.02 GB → 11.02 GB (-0.0%)

@github-actions

github-actions Bot commented Jun 16, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -7.4%
Engines: DataFusion No clear signal (-15.5%, environment too noisy confidence) · DuckDB No clear signal (+1.3%, environment too noisy confidence)
Vortex (geomean): 1.118x ➖
Parquet (geomean): 1.208x ➖
Shifts: Parquet (control) +20.8% · Median polish +10.7%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.040x ➖, 1↑ 4↓)
name PR b2facee (ns) base 67a2b22 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 315768627 291105420 1.08
tpch_q02/datafusion:vortex-file-compressed 595012867 679482629 0.88
tpch_q03/datafusion:vortex-file-compressed 🚨 758039526 582976253 1.30
tpch_q04/datafusion:vortex-file-compressed 🚨 425605337 291274268 1.46
tpch_q05/datafusion:vortex-file-compressed 🚨 693191494 482352684 1.44
tpch_q06/datafusion:vortex-file-compressed 422561932 345226870 1.22
tpch_q07/datafusion:vortex-file-compressed 745437453 579862854 1.29
tpch_q08/datafusion:vortex-file-compressed 916615436 861947978 1.06
tpch_q09/datafusion:vortex-file-compressed 🚨 741963488 563446832 1.32
tpch_q10/datafusion:vortex-file-compressed 902926420 900507489 1.00
tpch_q11/datafusion:vortex-file-compressed 672111051 520677637 1.29
tpch_q12/datafusion:vortex-file-compressed 735349488 639699465 1.15
tpch_q13/datafusion:vortex-file-compressed 229028368 271355524 0.84
tpch_q14/datafusion:vortex-file-compressed 🚀 319116655 513083760 0.62
tpch_q15/datafusion:vortex-file-compressed 552527682 744697865 0.74
tpch_q16/datafusion:vortex-file-compressed 295985764 350281289 0.84
tpch_q17/datafusion:vortex-file-compressed 487893860 534087891 0.91
tpch_q18/datafusion:vortex-file-compressed 470295757 445608893 1.06
tpch_q19/datafusion:vortex-file-compressed 874701731 702073231 1.25
tpch_q20/datafusion:vortex-file-compressed 505773040 530860266 0.95
tpch_q21/datafusion:vortex-file-compressed 778078623 943237099 0.82
tpch_q22/datafusion:vortex-file-compressed 371667147 416312293 0.89
datafusion / vortex-compact (1.237x ➖, 0↑ 10↓)
name PR b2facee (ns) base 67a2b22 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 346806035 361050123 0.96
tpch_q02/datafusion:vortex-compact 531179945 520298260 1.02
tpch_q03/datafusion:vortex-compact 🚨 570663800 391928612 1.46
tpch_q04/datafusion:vortex-compact 304348352 236875442 1.28
tpch_q05/datafusion:vortex-compact 🚨 733949096 494604651 1.48
tpch_q06/datafusion:vortex-compact 440796062 432603102 1.02
tpch_q07/datafusion:vortex-compact 814619960 667247495 1.22
tpch_q08/datafusion:vortex-compact 983210877 940704165 1.05
tpch_q09/datafusion:vortex-compact 🚨 817595830 601414121 1.36
tpch_q10/datafusion:vortex-compact 🚨 858693483 521922738 1.65
tpch_q11/datafusion:vortex-compact 🚨 481341046 363932928 1.32
tpch_q12/datafusion:vortex-compact 511604934 616128229 0.83
tpch_q13/datafusion:vortex-compact 207454171 227887062 0.91
tpch_q14/datafusion:vortex-compact 325762433 392460018 0.83
tpch_q15/datafusion:vortex-compact 🚨 573966961 438642764 1.31
tpch_q16/datafusion:vortex-compact 🚨 341213689 195371888 1.75
tpch_q17/datafusion:vortex-compact 🚨 944624028 423870808 2.23
tpch_q18/datafusion:vortex-compact 🚨 826684332 462398576 1.79
tpch_q19/datafusion:vortex-compact 972262207 941326189 1.03
tpch_q20/datafusion:vortex-compact 553339989 546010506 1.01
tpch_q21/datafusion:vortex-compact 781443689 711274311 1.10
tpch_q22/datafusion:vortex-compact 🚨 368824126 234791464 1.57
datafusion / parquet (1.342x ❌, 0↑ 8↓)
name PR b2facee (ns) base 67a2b22 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 293609540 271419103 1.08
tpch_q02/datafusion:parquet 510876232 476931161 1.07
tpch_q03/datafusion:parquet 541747021 419354749 1.29
tpch_q04/datafusion:parquet 273167304 223845181 1.22
tpch_q05/datafusion:parquet 729518628 655991222 1.11
tpch_q06/datafusion:parquet 258596674 229619986 1.13
tpch_q07/datafusion:parquet 724794168 587282189 1.23
tpch_q08/datafusion:parquet 799790218 807370949 0.99
tpch_q09/datafusion:parquet 609059431 494449112 1.23
tpch_q10/datafusion:parquet 718807636 760194267 0.95
tpch_q11/datafusion:parquet 🚨 738659240 439591756 1.68
tpch_q12/datafusion:parquet 🚨 481564144 303577758 1.59
tpch_q13/datafusion:parquet 649620892 505025210 1.29
tpch_q14/datafusion:parquet 377825140 313070552 1.21
tpch_q15/datafusion:parquet 600176396 528348852 1.14
tpch_q16/datafusion:parquet 🚨 292295444 185690116 1.57
tpch_q17/datafusion:parquet 🚨 1120131228 526973317 2.13
tpch_q18/datafusion:parquet 🚨 987992674 477121039 2.07
tpch_q19/datafusion:parquet 🚨 537766822 406959443 1.32
tpch_q20/datafusion:parquet 473965085 382974255 1.24
tpch_q21/datafusion:parquet 🚨 1032486907 599340575 1.72
tpch_q22/datafusion:parquet 🚨 539424376 251305363 2.15
duckdb / vortex-file-compressed (1.115x ➖, 0↑ 1↓)
name PR b2facee (ns) base 67a2b22 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 🚨 400705757 284880917 1.41
tpch_q02/duckdb:vortex-file-compressed 1161575730 1072272057 1.08
tpch_q03/duckdb:vortex-file-compressed 937122715 767109130 1.22
tpch_q04/duckdb:vortex-file-compressed 483478630 562205638 0.86
tpch_q05/duckdb:vortex-file-compressed 1092200946 1090587515 1.00
tpch_q06/duckdb:vortex-file-compressed 439032759 409868503 1.07
tpch_q07/duckdb:vortex-file-compressed 1139016547 1023686423 1.11
tpch_q08/duckdb:vortex-file-compressed 1466674485 1201755602 1.22
tpch_q09/duckdb:vortex-file-compressed 1301174065 1151166552 1.13
tpch_q10/duckdb:vortex-file-compressed 1064036795 851810446 1.25
tpch_q11/duckdb:vortex-file-compressed 550613689 583519421 0.94
tpch_q12/duckdb:vortex-file-compressed 904053491 872422874 1.04
tpch_q13/duckdb:vortex-file-compressed 652603863 537982188 1.21
tpch_q14/duckdb:vortex-file-compressed 591399037 457217533 1.29
tpch_q15/duckdb:vortex-file-compressed 430000281 352910828 1.22
tpch_q16/duckdb:vortex-file-compressed 383896848 384448231 1.00
tpch_q17/duckdb:vortex-file-compressed 823441841 868012310 0.95
tpch_q18/duckdb:vortex-file-compressed 748923647 695229500 1.08
tpch_q19/duckdb:vortex-file-compressed 585140996 520217139 1.12
tpch_q20/duckdb:vortex-file-compressed 1186842767 938618619 1.26
tpch_q21/duckdb:vortex-file-compressed 1310472090 1306319016 1.00
tpch_q22/duckdb:vortex-file-compressed 381931371 311204547 1.23
duckdb / vortex-compact (1.088x ➖, 0↑ 2↓)
name PR b2facee (ns) base 67a2b22 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 🚨 404484102 284316907 1.42
tpch_q02/duckdb:vortex-compact 1221306722 1030855579 1.18
tpch_q03/duckdb:vortex-compact 707514911 676828890 1.05
tpch_q04/duckdb:vortex-compact 🚨 692977867 463916306 1.49
tpch_q05/duckdb:vortex-compact 931845085 1002528945 0.93
tpch_q06/duckdb:vortex-compact 478704578 375064930 1.28
tpch_q07/duckdb:vortex-compact 1149946238 1091503431 1.05
tpch_q08/duckdb:vortex-compact 1110636850 1129545935 0.98
tpch_q09/duckdb:vortex-compact 1113901900 1068255528 1.04
tpch_q10/duckdb:vortex-compact 893451794 908688902 0.98
tpch_q11/duckdb:vortex-compact 580867493 551569778 1.05
tpch_q12/duckdb:vortex-compact 843676999 702178604 1.20
tpch_q13/duckdb:vortex-compact 555678385 447669368 1.24
tpch_q14/duckdb:vortex-compact 587937925 478933613 1.23
tpch_q15/duckdb:vortex-compact 321131604 426988727 0.75
tpch_q16/duckdb:vortex-compact 413232062 391586960 1.06
tpch_q17/duckdb:vortex-compact 961809143 835714397 1.15
tpch_q18/duckdb:vortex-compact 600367313 572306564 1.05
tpch_q19/duckdb:vortex-compact 539617159 543941543 0.99
tpch_q20/duckdb:vortex-compact 954095914 866191482 1.10
tpch_q21/duckdb:vortex-compact 1156413502 1321014663 0.88
tpch_q22/duckdb:vortex-compact 348027118 316092241 1.10
duckdb / parquet (1.087x ➖, 0↑ 1↓)
name PR b2facee (ns) base 67a2b22 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 671815020 630371612 1.07
tpch_q02/duckdb:parquet 1563490963 1307393017 1.20
tpch_q03/duckdb:parquet 1329886593 1304795229 1.02
tpch_q04/duckdb:parquet 948876345 796616253 1.19
tpch_q05/duckdb:parquet 1752474377 1559784295 1.12
tpch_q06/duckdb:parquet 640425189 591879338 1.08
tpch_q07/duckdb:parquet 1561562355 1535480331 1.02
tpch_q08/duckdb:parquet 2001158228 1771948575 1.13
tpch_q09/duckdb:parquet 1767425380 1741282705 1.02
tpch_q10/duckdb:parquet 1590973427 1411691247 1.13
tpch_q11/duckdb:parquet 859773437 835830135 1.03
tpch_q12/duckdb:parquet 982472665 910666240 1.08
tpch_q13/duckdb:parquet 1092198234 969607540 1.13
tpch_q14/duckdb:parquet 🚨 1054881674 797021583 1.32
tpch_q15/duckdb:parquet 683672770 724883355 0.94
tpch_q16/duckdb:parquet 878798560 810504981 1.08
tpch_q17/duckdb:parquet 1101957373 949712716 1.16
tpch_q18/duckdb:parquet 1127316547 1048116359 1.08
tpch_q19/duckdb:parquet 927079464 733015323 1.26
tpch_q20/duckdb:parquet 1568840559 1326411626 1.18
tpch_q21/duckdb:parquet 1287679849 1345696557 0.96
tpch_q22/duckdb:parquet 560355715 665267819 0.84

@github-actions

github-actions Bot commented Jun 16, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: Appian on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.7%
Engines: DataFusion No clear signal (+0.2%, low confidence) · DuckDB No clear signal (-1.4%, low confidence)
Vortex (geomean): 1.047x ➖
Parquet (geomean): 1.046x ➖
Shifts: Parquet (control) +4.6% · Median polish +5.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.041x ➖, 0↑ 1↓)
name PR b2facee (ns) base 67a2b22 (ns) ratio (PR/base)
appian_q01/datafusion:vortex-file-compressed 135366988 128202658 1.06
appian_q02/datafusion:vortex-file-compressed 603988133 580977248 1.04
appian_q03/datafusion:vortex-file-compressed 319769115 344014134 0.93
appian_q04/datafusion:vortex-file-compressed 42776962910 42710236175 1.00
appian_q05/datafusion:vortex-file-compressed 🚨 269386146 244267701 1.10
appian_q06/datafusion:vortex-file-compressed 353660564 326538165 1.08
appian_q07/datafusion:vortex-file-compressed 443075360 415509399 1.07
appian_q08/datafusion:vortex-file-compressed 2037605603 1923014385 1.06
datafusion / parquet (1.039x ➖, 0↑ 0↓)
name PR b2facee (ns) base 67a2b22 (ns) ratio (PR/base)
appian_q01/datafusion:parquet 124929941 131384080 0.95
appian_q02/datafusion:parquet 650505410 613876165 1.06
appian_q03/datafusion:parquet 354676904 329955153 1.07
appian_q04/datafusion:parquet 44792029669 42444387144 1.06
appian_q05/datafusion:parquet 293613076 281981191 1.04
appian_q06/datafusion:parquet 368154674 354698397 1.04
appian_q07/datafusion:parquet 462859369 446024269 1.04
appian_q08/datafusion:parquet 2041515992 1929989586 1.06
duckdb / vortex-file-compressed (1.053x ➖, 0↑ 0↓)
name PR b2facee (ns) base 67a2b22 (ns) ratio (PR/base)
appian_q01/duckdb:vortex-file-compressed 209176918 194352228 1.08
appian_q02/duckdb:vortex-file-compressed 644272734 608244289 1.06
appian_q03/duckdb:vortex-file-compressed 272981443 259136551 1.05
appian_q04/duckdb:vortex-file-compressed 1381023975 1337824832 1.03
appian_q05/duckdb:vortex-file-compressed 315759200 291385604 1.08
appian_q06/duckdb:vortex-file-compressed 816289102 811211197 1.01
appian_q07/duckdb:vortex-file-compressed 361199085 340813973 1.06
appian_q08/duckdb:vortex-file-compressed 1345917799 1279682053 1.05
duckdb / parquet (1.052x ➖, 0↑ 0↓)
name PR b2facee (ns) base 67a2b22 (ns) ratio (PR/base)
appian_q01/duckdb:parquet 216376117 203049852 1.07
appian_q02/duckdb:parquet 629293317 605359560 1.04
appian_q03/duckdb:parquet 303848313 285624667 1.06
appian_q04/duckdb:parquet 1368956903 1321897100 1.04
appian_q05/duckdb:parquet 338831828 312483229 1.08
appian_q06/duckdb:parquet 813693590 793166702 1.03
appian_q07/duckdb:parquet 382527543 360956316 1.06
appian_q08/duckdb:parquet 1324301011 1267720765 1.04
duckdb / duckdb (1.023x ➖, 0↑ 0↓)
name PR b2facee (ns) base 67a2b22 (ns) ratio (PR/base)
appian_q01/duckdb:duckdb 180891043 171778156 1.05
appian_q02/duckdb:duckdb 570550538 546159552 1.04
appian_q03/duckdb:duckdb 394809347 397400692 0.99
appian_q04/duckdb:duckdb 1340190497 1305356975 1.03
appian_q05/duckdb:duckdb 302552284 281220147 1.08
appian_q06/duckdb:duckdb 790231673 795859958 0.99
appian_q07/duckdb:duckdb 324818533 326521967 0.99
appian_q08/duckdb:duckdb 1229953458 1225118925 1.00
File Size Changes (4 files changed, -0.0% overall, 2↑ 2↓)
File Scale Format Base HEAD Change %
orderview.vortex 1.0 vortex-file-compressed 81.04 MB 81.10 MB +64.22 KB +0.1%
addressview.vortex 1.0 vortex-file-compressed 34.62 MB 34.62 MB +56 B +0.0%
creditcardview.vortex 1.0 vortex-file-compressed 61.02 MB 60.93 MB 90.20 KB -0.1%
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%

Totals:

  • vortex-compact: 271.96 MB → 271.69 MB (-0.1%)
  • vortex-file-compressed: 513.69 MB → 513.67 MB (-0.0%)

@github-actions

github-actions Bot commented Jun 16, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: Compression

Vortex (geomean): 0.997x ➖
Parquet (geomean): 0.984x ➖

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
unknown / unknown (0.979x ➖, 8↑ 3↓)
name PR b2facee (ns) base 67a2b22 (ns) ratio (PR/base)
compress time/Arade 1074697311 1144905922 0.94
compress time/Bimbo 5493165604 5894895623 0.93
compress time/CMSprovider 2739445344 2796466447 0.98
compress time/Euro2016 465309320 481345175 0.97
compress time/Food 364013335 380818335 0.96
compress time/HashTags 827865733 883397095 0.94
compress time/TPC-H l_comment canonical 1228348743 1236181487 0.99
compress time/TPC-H l_comment chunked 1205531499 1215785451 0.99
compress time/taxi 662420426 692053907 0.96
compress time/wide table cols=100 chunks=1 rows=1000 11758173 11791093 1.00
compress time/wide table cols=100 chunks=50 rows=1000 12517161 12231568 1.02
compress time/wide table cols=1000 chunks=1 rows=1000 130474728 133617817 0.98
compress time/wide table cols=1000 chunks=50 rows=1000 128137768 138684931 0.92
compress time/wide table cols=10000 chunks=1 rows=1000 1517933464 1521347551 1.00
compress time/wide table cols=10000 chunks=50 rows=1000 1539148252 1517670810 1.01
decompress time/Arade 26063275 26477330 0.98
decompress time/Bimbo 78017928 79524450 0.98
decompress time/CMSprovider 77962925 81553501 0.96
decompress time/Euro2016 🚀 18793230 21225988 0.89
decompress time/Food 8142852 8555349 0.95
decompress time/HashTags 89537464 90304976 0.99
decompress time/TPC-H l_comment canonical 38672584 39128005 0.99
decompress time/TPC-H l_comment chunked 39574948 41782756 0.95
decompress time/taxi 🚀 14477110 16104211 0.90
decompress time/wide table cols=100 chunks=1 rows=1000 2343077 2540078 0.92
decompress time/wide table cols=100 chunks=50 rows=1000 🚀 2176629 2679947 0.81
decompress time/wide table cols=1000 chunks=1 rows=1000 21662407 23569224 0.92
decompress time/wide table cols=1000 chunks=50 rows=1000 🚀 20504032 23650051 0.87
decompress time/wide table cols=10000 chunks=1 rows=1000 247036693 249008603 0.99
decompress time/wide table cols=10000 chunks=50 rows=1000 246404555 253553979 0.97
parquet size/Arade 258014282 258014282 1.00
parquet size/Bimbo 384517292 384517292 1.00
parquet size/CMSprovider 376885545 376885545 1.00
parquet size/Euro2016 122975499 122975499 1.00
parquet size/Food 35699500 35699500 1.00
parquet size/HashTags 133510943 133510943 1.00
parquet size/TPC-H l_comment canonical 158358238 158358238 1.00
parquet size/TPC-H l_comment chunked 158358238 158358238 1.00
parquet size/taxi 55283635 55283635 1.00
parquet size/wide table cols=100 chunks=1 rows=1000 932404 932404 1.00
parquet size/wide table cols=100 chunks=50 rows=1000 932404 932404 1.00
parquet size/wide table cols=1000 chunks=1 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=1000 chunks=50 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=10000 chunks=1 rows=1000 93240004 93240004 1.00
parquet size/wide table cols=10000 chunks=50 rows=1000 93240004 93240004 1.00
parquet_rs-zstd compress time/Arade 2631457055 2672343399 0.98
parquet_rs-zstd compress time/Bimbo 13898810559 12910799795 1.08
parquet_rs-zstd compress time/CMSprovider 6970129438 7328824529 0.95
parquet_rs-zstd compress time/Euro2016 1294951409 1353120179 0.96
parquet_rs-zstd compress time/Food 795993103 815854225 0.98
parquet_rs-zstd compress time/HashTags 2155782395 2316773424 0.93
parquet_rs-zstd compress time/TPC-H l_comment canonical 3164135363 3322109307 0.95
parquet_rs-zstd compress time/TPC-H l_comment chunked 3167996280 3303462939 0.96
parquet_rs-zstd compress time/taxi 1220437894 1239444214 0.98
parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000 🚀 6208450 7060054 0.88
parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000 🚀 5995736 6901945 0.87
parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000 75625244 79010064 0.96
parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000 76523170 79786280 0.96
parquet_rs-zstd compress time/wide table cols=10000 chunks=1 rows=1000 797427441 823623106 0.97
parquet_rs-zstd compress time/wide table cols=10000 chunks=50 rows=1000 770928956 836869610 0.92
parquet_rs-zstd decompress time/Arade 623535689 634492695 0.98
parquet_rs-zstd decompress time/Bimbo 1700595491 1723914292 0.99
parquet_rs-zstd decompress time/CMSprovider 1719085518 1798885573 0.96
parquet_rs-zstd decompress time/Euro2016 372954421 383800057 0.97
parquet_rs-zstd decompress time/Food 196285036 204562979 0.96
parquet_rs-zstd decompress time/HashTags 634302560 697931210 0.91
parquet_rs-zstd decompress time/TPC-H l_comment canonical 586275045 609013221 0.96
parquet_rs-zstd decompress time/TPC-H l_comment chunked 590750126 608843753 0.97
parquet_rs-zstd decompress time/taxi 246167483 250686896 0.98
parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000 2865799 2926749 0.98
parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000 2790754 2889124 0.97
parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000 33261904 34463074 0.97
parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000 34015074 35657725 0.95
parquet_rs-zstd decompress time/wide table cols=10000 chunks=1 rows=1000 354160438 354030760 1.00
parquet_rs-zstd decompress time/wide table cols=10000 chunks=50 rows=1000 347465182 367528744 0.95
vortex-file-compressed size/Arade 145363860 145363860 1.00
vortex-file-compressed size/Bimbo 468763396 468763396 1.00
vortex-file-compressed size/CMSprovider 417903964 417904012 1.00
vortex-file-compressed size/Euro2016 158397452 157621940 1.00
vortex-file-compressed size/Food 41927000 41927000 1.00
vortex-file-compressed size/HashTags 185260964 186036700 1.00
vortex-file-compressed size/TPC-H l_comment canonical 178567968 178408000 1.00
vortex-file-compressed size/TPC-H l_comment chunked 178613672 178325216 1.00
vortex-file-compressed size/taxi 52364012 52364012 1.00
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000 930912 930912 1.00
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000 930912 930912 1.00
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000 9293712 9293712 1.00
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000 9293712 9293712 1.00
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000 92957712 92957712 1.00
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000 92957712 92957712 1.00
vortex:parquet-zstd ratio compress time/Arade 0 0 0.95
vortex:parquet-zstd ratio compress time/Bimbo 🚀 0 0 0.87
vortex:parquet-zstd ratio compress time/CMSprovider 0 0 1.03
vortex:parquet-zstd ratio compress time/Euro2016 0 0 1.01
vortex:parquet-zstd ratio compress time/Food 0 0 0.98
vortex:parquet-zstd ratio compress time/HashTags 0 0 1.01
vortex:parquet-zstd ratio compress time/TPC-H l_comment canonical 0 0 1.04
vortex:parquet-zstd ratio compress time/TPC-H l_comment chunked 0 0 1.03
vortex:parquet-zstd ratio compress time/taxi 0 0 0.97
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=1 rows=1000 🚨 1 1 1.13
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=50 rows=1000 🚨 2 1 1.18
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=1 rows=1000 1 1 1.02
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=50 rows=1000 1 1 0.96
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=1 rows=1000 1 1 1.03
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=50 rows=1000 🚨 1 1 1.10
vortex:parquet-zstd ratio decompress time/Arade 0 0 1.00
vortex:parquet-zstd ratio decompress time/Bimbo 0 0 0.99
vortex:parquet-zstd ratio decompress time/CMSprovider 0 0 1.00
vortex:parquet-zstd ratio decompress time/Euro2016 0 0 0.91
vortex:parquet-zstd ratio decompress time/Food 0 0 0.99
vortex:parquet-zstd ratio decompress time/HashTags 0 0 1.09
vortex:parquet-zstd ratio decompress time/TPC-H l_comment canonical 0 0 1.03
vortex:parquet-zstd ratio decompress time/TPC-H l_comment chunked 0 0 0.98
vortex:parquet-zstd ratio decompress time/taxi 0 0 0.92
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=1 rows=1000 0 0 0.94
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=50 rows=1000 🚀 0 0 0.84
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=1 rows=1000 0 0 0.95
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=50 rows=1000 0 0 0.91
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=1 rows=1000 0 0 0.99
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=50 rows=1000 0 0 1.03
vortex:parquet-zstd size/Arade 0 0 1.00
vortex:parquet-zstd size/Bimbo 1 1 1.00
vortex:parquet-zstd size/CMSprovider 1 1 1.00
vortex:parquet-zstd size/Euro2016 1 1 1.00
vortex:parquet-zstd size/Food 1 1 1.00
vortex:parquet-zstd size/HashTags 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment canonical 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment chunked 1 1 1.00
vortex:parquet-zstd size/taxi 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=50 rows=1000 0 0 1.00

@github-actions

github-actions Bot commented Jun 16, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +0.2%
Engines: DataFusion No clear signal (+4.7%, environment too noisy confidence) · DuckDB No clear signal (-4.0%, environment too noisy confidence)
Vortex (geomean): 1.092x ➖
Parquet (geomean): 1.089x ➖
Shifts: Parquet (control) +8.9% · Median polish +10.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.156x ➖, 0↑ 4↓)
name PR b2facee (ns) base 67a2b22 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 828261035 816787415 1.01
tpch_q02/datafusion:vortex-file-compressed 🚨 1344842878 964556334 1.39
tpch_q03/datafusion:vortex-file-compressed 1264590385 1075028587 1.18
tpch_q04/datafusion:vortex-file-compressed 🚨 1116669011 665678955 1.68
tpch_q05/datafusion:vortex-file-compressed 🚨 2260448738 1039067380 2.18
tpch_q06/datafusion:vortex-file-compressed 846209528 663041865 1.28
tpch_q07/datafusion:vortex-file-compressed 🚨 1570025411 1074576541 1.46
tpch_q08/datafusion:vortex-file-compressed 1760880811 1409782865 1.25
tpch_q09/datafusion:vortex-file-compressed 1369939413 1398236362 0.98
tpch_q10/datafusion:vortex-file-compressed 1288330403 1438675808 0.90
tpch_q11/datafusion:vortex-file-compressed 650235258 670581844 0.97
tpch_q12/datafusion:vortex-file-compressed 1232919916 1004764951 1.23
tpch_q13/datafusion:vortex-file-compressed 594681939 572956094 1.04
tpch_q14/datafusion:vortex-file-compressed 705458738 611683644 1.15
tpch_q15/datafusion:vortex-file-compressed 1134588375 1265528981 0.90
tpch_q16/datafusion:vortex-file-compressed 572236191 515325282 1.11
tpch_q17/datafusion:vortex-file-compressed 1353536139 1256979706 1.08
tpch_q18/datafusion:vortex-file-compressed 1680279341 1418379657 1.18
tpch_q19/datafusion:vortex-file-compressed 1113758215 1021003484 1.09
tpch_q20/datafusion:vortex-file-compressed 1110086385 1155198453 0.96
tpch_q21/datafusion:vortex-file-compressed 1822911360 1935276446 0.94
tpch_q22/datafusion:vortex-file-compressed 721186073 657223931 1.10
datafusion / vortex-compact (1.027x ➖, 0↑ 5↓)
name PR b2facee (ns) base 67a2b22 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 766182125 875532243 0.88
tpch_q02/datafusion:vortex-compact 1012915120 837356052 1.21
tpch_q03/datafusion:vortex-compact 🚨 1142495929 860323732 1.33
tpch_q04/datafusion:vortex-compact 469706939 651252538 0.72
tpch_q05/datafusion:vortex-compact 1168259818 1624517619 0.72
tpch_q06/datafusion:vortex-compact 624305199 672804112 0.93
tpch_q07/datafusion:vortex-compact 1083940253 1181318649 0.92
tpch_q08/datafusion:vortex-compact 1435864863 1560241298 0.92
tpch_q09/datafusion:vortex-compact 1378232731 1656797052 0.83
tpch_q10/datafusion:vortex-compact 🚨 1722171418 1267429235 1.36
tpch_q11/datafusion:vortex-compact 633724328 743492132 0.85
tpch_q12/datafusion:vortex-compact 993389546 986600521 1.01
tpch_q13/datafusion:vortex-compact 516496530 512341419 1.01
tpch_q14/datafusion:vortex-compact 590282384 647780480 0.91
tpch_q15/datafusion:vortex-compact 1187587631 966798191 1.23
tpch_q16/datafusion:vortex-compact 🚨 715604959 518590107 1.38
tpch_q17/datafusion:vortex-compact 🚨 1629777643 1184298539 1.38
tpch_q18/datafusion:vortex-compact 🚨 1587114476 1207639378 1.31
tpch_q19/datafusion:vortex-compact 1411955350 1095903116 1.29
tpch_q20/datafusion:vortex-compact 1011375188 978471125 1.03
tpch_q21/datafusion:vortex-compact 1464578218 1494061439 0.98
tpch_q22/datafusion:vortex-compact 853142457 957215990 0.89
datafusion / parquet (1.041x ➖, 4↑ 6↓)
name PR b2facee (ns) base 67a2b22 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 1029422953 908302866 1.13
tpch_q02/datafusion:parquet 🚨 1223739825 910870053 1.34
tpch_q03/datafusion:parquet 🚨 1484073194 1110037167 1.34
tpch_q04/datafusion:parquet 🚨 834507242 480341229 1.74
tpch_q05/datafusion:parquet 1612420528 1418068987 1.14
tpch_q06/datafusion:parquet 🚨 851206158 595367882 1.43
tpch_q07/datafusion:parquet 1768849135 1485632139 1.19
tpch_q08/datafusion:parquet 2083763728 1749691847 1.19
tpch_q09/datafusion:parquet 2312850189 2371400320 0.98
tpch_q10/datafusion:parquet 🚨 4211176558 2927196494 1.44
tpch_q11/datafusion:parquet 🚨 1482295663 744725048 1.99
tpch_q12/datafusion:parquet 🚀 779090208 1256198865 0.62
tpch_q13/datafusion:parquet 🚀 860490906 2590834681 0.33
tpch_q14/datafusion:parquet 🚀 930409622 2385780209 0.39
tpch_q15/datafusion:parquet 🚀 1571256724 2508521382 0.63
tpch_q16/datafusion:parquet 639704891 601737267 1.06
tpch_q17/datafusion:parquet 1660181242 1518714968 1.09
tpch_q18/datafusion:parquet 1945960723 1701191432 1.14
tpch_q19/datafusion:parquet 1252743825 1157197785 1.08
tpch_q20/datafusion:parquet 2091853644 1795339071 1.17
tpch_q21/datafusion:parquet 2422524919 2241303034 1.08
tpch_q22/datafusion:parquet 1470836844 1250618578 1.18
duckdb / vortex-file-compressed (1.058x ➖, 0↑ 0↓)
name PR b2facee (ns) base 67a2b22 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 853636723 682838129 1.25
tpch_q02/duckdb:vortex-file-compressed 1191956617 1482371347 0.80
tpch_q03/duckdb:vortex-file-compressed 1197288350 1227222890 0.98
tpch_q04/duckdb:vortex-file-compressed 1032075739 905285358 1.14
tpch_q05/duckdb:vortex-file-compressed 1409915088 1436403480 0.98
tpch_q06/duckdb:vortex-file-compressed 603855487 596527699 1.01
tpch_q07/duckdb:vortex-file-compressed 1562103884 1474390807 1.06
tpch_q08/duckdb:vortex-file-compressed 1760700899 1447419411 1.22
tpch_q09/duckdb:vortex-file-compressed 2063600223 1912683126 1.08
tpch_q10/duckdb:vortex-file-compressed 1650621019 1505739764 1.10
tpch_q11/duckdb:vortex-file-compressed 732717653 783934902 0.93
tpch_q12/duckdb:vortex-file-compressed 1292369745 1264342523 1.02
tpch_q13/duckdb:vortex-file-compressed 997065147 1059854301 0.94
tpch_q14/duckdb:vortex-file-compressed 739736868 656272546 1.13
tpch_q15/duckdb:vortex-file-compressed 659798519 597563076 1.10
tpch_q16/duckdb:vortex-file-compressed 796837919 760542189 1.05
tpch_q17/duckdb:vortex-file-compressed 1132320476 1118510241 1.01
tpch_q18/duckdb:vortex-file-compressed 1254482286 1094407705 1.15
tpch_q19/duckdb:vortex-file-compressed 1008779487 883933288 1.14
tpch_q20/duckdb:vortex-file-compressed 1628532283 1327763714 1.23
tpch_q21/duckdb:vortex-file-compressed 2537323100 2311069005 1.10
tpch_q22/duckdb:vortex-file-compressed 632337775 643563744 0.98
duckdb / vortex-compact (1.130x ➖, 0↑ 3↓)
name PR b2facee (ns) base 67a2b22 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 669877701 678315315 0.99
tpch_q02/duckdb:vortex-compact 1451212713 1297536484 1.12
tpch_q03/duckdb:vortex-compact 1040636762 909590464 1.14
tpch_q04/duckdb:vortex-compact 709230845 685904667 1.03
tpch_q05/duckdb:vortex-compact 1279571530 1362957851 0.94
tpch_q06/duckdb:vortex-compact 532972673 635563937 0.84
tpch_q07/duckdb:vortex-compact 1721760210 1411294604 1.22
tpch_q08/duckdb:vortex-compact 1692466378 1564049321 1.08
tpch_q09/duckdb:vortex-compact 1953234673 1872691306 1.04
tpch_q10/duckdb:vortex-compact 🚨 2010791694 1290705160 1.56
tpch_q11/duckdb:vortex-compact 🚨 1036046789 684539928 1.51
tpch_q12/duckdb:vortex-compact 1219299466 1178041754 1.04
tpch_q13/duckdb:vortex-compact 914488421 868191564 1.05
tpch_q14/duckdb:vortex-compact 749352581 641457022 1.17
tpch_q15/duckdb:vortex-compact 595658037 587510581 1.01
tpch_q16/duckdb:vortex-compact 521485468 434221374 1.20
tpch_q17/duckdb:vortex-compact 1196809597 986730083 1.21
tpch_q18/duckdb:vortex-compact 1108223967 912565015 1.21
tpch_q19/duckdb:vortex-compact 909984931 821586418 1.11
tpch_q20/duckdb:vortex-compact 1535981194 1391601862 1.10
tpch_q21/duckdb:vortex-compact 1961438010 1882758101 1.04
tpch_q22/duckdb:vortex-compact 🚨 825366796 543401174 1.52
duckdb / parquet (1.140x ➖, 0↑ 1↓)
name PR b2facee (ns) base 67a2b22 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 1294093480 1017515670 1.27
tpch_q02/duckdb:parquet 1645391983 1579676935 1.04
tpch_q03/duckdb:parquet 2729975325 2192642501 1.25
tpch_q04/duckdb:parquet 1372789648 1276834504 1.08
tpch_q05/duckdb:parquet 2524940428 2246929481 1.12
tpch_q06/duckdb:parquet 1086252083 983737751 1.10
tpch_q07/duckdb:parquet 2498917393 2064382964 1.21
tpch_q08/duckdb:parquet 3076229668 2898851012 1.06
tpch_q09/duckdb:parquet 3116869590 2819493802 1.11
tpch_q10/duckdb:parquet 3855447778 3281623615 1.17
tpch_q11/duckdb:parquet 1184925294 1112688985 1.06
tpch_q12/duckdb:parquet 1510601991 1593594632 0.95
tpch_q13/duckdb:parquet 1761641303 1563329010 1.13
tpch_q14/duckdb:parquet 1852177488 1570824195 1.18
tpch_q15/duckdb:parquet 1276590911 997894812 1.28
tpch_q16/duckdb:parquet 1144197781 1009005302 1.13
tpch_q17/duckdb:parquet 1754572234 1383181296 1.27
tpch_q18/duckdb:parquet 🚨 2190877673 1556046859 1.41
tpch_q19/duckdb:parquet 1850322230 1621612860 1.14
tpch_q20/duckdb:parquet 2658254205 2226887157 1.19
tpch_q21/duckdb:parquet 2303232266 2241013860 1.03
tpch_q22/duckdb:parquet 1241380436 1249923378 0.99

@AdamGS
last changes
b2facee 
Signed-off-by: Adam Gutglick <[email protected]>
@AdamGS AdamGS added the action/benchmark Trigger full benchmarks to run on this PR label Jun 16, 2026
@github-actions github-actions Bot removed the action/benchmark Trigger full benchmarks to run on this PR label Jun 16, 2026
@AdamGS AdamGS changed the title [WIP] Immutable session backed by HashMap Immutable session backed by HashMap Jun 17, 2026
@AdamGS AdamGS marked this pull request as ready for review June 17, 2026 10:38
@AdamGS AdamGS requested a review from a team June 17, 2026 10:38
@AdamGS AdamGS added the changelog/chore A trivial change label Jun 17, 2026
@AdamGS
clippy
49cce3b 
Signed-off-by: Adam Gutglick <[email protected]>
@AdamGS AdamGS force-pushed the adamg/immutable-session branch from 912bcb2 to 49cce3b Compare June 17, 2026 10:39
@joseph-isaacs joseph-isaacs added the action/benchmark Trigger full benchmarks to run on this PR label Jun 17, 2026
@github-actions github-actions Bot removed the action/benchmark Trigger full benchmarks to run on this PR label Jun 17, 2026
@AdamGS
thing
db60bc0 
Signed-off-by: Adam Gutglick <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@robert3005 robert3005 Awaiting requested review from robert3005

@joseph-isaacs joseph-isaacs Awaiting requested review from joseph-isaacs

At least 1 approving review is required to merge this pull request.

Assignees

No one assigned

Labels

changelog/chore A trivial change

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@AdamGS @joseph-isaacs