Thanks to visit codestin.com
Credit goes to github.com

Skip to content

ReusableDict for RunEnd duckdb exporter#8538

Merged
myrrc merged 1 commit into
developfrom
myrrc/run-end-reusable-dict-exporter
Jun 23, 2026
Merged

ReusableDict for RunEnd duckdb exporter#8538
myrrc merged 1 commit into
developfrom
myrrc/run-end-reusable-dict-exporter

Conversation

@myrrc

@myrrc myrrc commented Jun 22, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Move shared logic of creating a ReusableDict or using a created one from dict.rs to a shared file. Use this logic for RunEnd duckdb exporter as well.

Make Constant and Sequence exportes obey flatten=true flag, otherwise ReusableDict values exporting failed for them, reading garbage data.

@myrrc myrrc added action/benchmark Trigger full benchmarks to run on this PR changelog/performance A performance improvement labels Jun 22, 2026
@github-actions github-actions Bot removed the action/benchmark Trigger full benchmarks to run on this PR label Jun 22, 2026
@myrrc myrrc added the ext/duckdb Relates to the DuckDB integration label Jun 22, 2026
@myrrc myrrc changed the title ReusableDict for RunEnd exporter ReusableDict for RunEnd duckdb exporter Jun 22, 2026
@codspeed-hq

codspeed-hq Bot commented Jun 22, 2026 •
edited
Loading

Copy link
Copy Markdown

Merging this PR will improve performance by 10.13%

⚠️ Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.

For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

⚡ 5 improved benchmarks
❌ 2 regressed benchmarks
✅ 1576 untouched benchmarks

Warning

Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
❌ Simulation chunked_varbinview_into_canonical[(1000, 10)] 168.9 µs 205.6 µs -17.86%
❌ Simulation encode_varbinview[(10000, 2)] 1.1 ms 1.2 ms -12.99%
⚡ Simulation chunked_bool_canonical_into[(1000, 10)] 27.1 µs 16.2 µs +67.38%
⚡ Simulation chunked_varbinview_canonical_into[(100, 100)] 258.9 µs 223.8 µs +15.71%
⚡ Simulation bitwise_not_vortex_buffer_mut[128] 244.4 ns 215.3 ns +13.55%
⚡ Simulation chunked_varbinview_into_canonical[(100, 100)] 306 µs 270.8 µs +13.02%
⚡ Simulation bitwise_not_vortex_buffer_mut[1024] 304.7 ns 275.6 ns +10.58%

Tip

Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.

Comparing myrrc/run-end-reusable-dict-exporter (1f9bcaa) with develop (5a764e6)

Open in CodSpeed

@github-actions

github-actions Bot commented Jun 22, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 1f9bcaa 2 Explore Profiling Data
Previous Runs (6)
Status Commit Job Attempt Link
🟢 Done 1f9bcaa 1 Explore Profiling Data
🟢 Done 40004d4 2 Explore Profiling Data
🟢 Done 40004d4 1 Explore Profiling Data
🟢 Done 6b621e6 1 Explore Profiling Data
🟢 Done 787625b 1 Explore Profiling Data
🟢 Done 0efa890 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

github-actions Bot commented Jun 22, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling

Vortex (geomean): 0.991x ➖

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.991x ➖, 0↑ 0↓)
name PR 1f9bcaa (ns) base 5a764e6 (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 117512033 122810676 0.96
polarsignals_q01/datafusion:vortex-file-compressed 260297379 285244904 0.91
polarsignals_q02/datafusion:vortex-file-compressed 23009404 23732086 0.97
polarsignals_q03/datafusion:vortex-file-compressed 272725185 275361820 0.99
polarsignals_q04/datafusion:vortex-file-compressed 10590914 10324852 1.03
polarsignals_q05/datafusion:vortex-file-compressed 13724372 13822326 0.99
polarsignals_q06/datafusion:vortex-file-compressed 22463442 20731797 1.08
polarsignals_q07/datafusion:vortex-file-compressed 12504779 11492711 1.09
polarsignals_q08/datafusion:vortex-file-compressed 410337953 411986744 1.00
polarsignals_q09/datafusion:vortex-file-compressed 11634574 12746125 0.91

No file size changes detected.

@github-actions

github-actions Bot commented Jun 22, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.2%
Engines: DataFusion No clear signal (+0.8%, low confidence) · DuckDB No clear signal (-1.1%, low confidence)
Vortex (geomean): 1.011x ➖
Parquet (geomean): 1.013x ➖
Shifts: Parquet (control) +1.3% · Median polish +1.4%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.013x ➖, 0↑ 1↓)
name PR 1f9bcaa (ns) base 5a764e6 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚨 5556987 4767876 1.17
fineweb_q01/datafusion:vortex-file-compressed 32729540 34751396 0.94
fineweb_q02/datafusion:vortex-file-compressed 38095851 36869325 1.03
fineweb_q03/datafusion:vortex-file-compressed 58553902 64896781 0.90
fineweb_q04/datafusion:vortex-file-compressed 278902904 275633838 1.01
fineweb_q05/datafusion:vortex-file-compressed 220807040 217844756 1.01
fineweb_q06/datafusion:vortex-file-compressed 49971481 49698946 1.01
fineweb_q07/datafusion:vortex-file-compressed 55406478 55337848 1.00
fineweb_q08/datafusion:vortex-file-compressed 23174477 21866457 1.06
datafusion / vortex-compact (1.021x ➖, 0↑ 1↓)
name PR 1f9bcaa (ns) base 5a764e6 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 🚨 6080381 5231705 1.16
fineweb_q01/datafusion:vortex-compact 95717818 100608626 0.95
fineweb_q02/datafusion:vortex-compact 110236580 105600053 1.04
fineweb_q03/datafusion:vortex-compact 891857802 862203500 1.03
fineweb_q04/datafusion:vortex-compact 931789850 919023744 1.01
fineweb_q05/datafusion:vortex-compact 833695672 816287081 1.02
fineweb_q06/datafusion:vortex-compact 467137991 465998929 1.00
fineweb_q07/datafusion:vortex-compact 486535189 484579551 1.00
fineweb_q08/datafusion:vortex-compact 20205027 20924558 0.97
datafusion / parquet (1.009x ➖, 0↑ 0↓)
name PR 1f9bcaa (ns) base 5a764e6 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 6915563 6992474 0.99
fineweb_q01/datafusion:parquet 294173066 294414985 1.00
fineweb_q02/datafusion:parquet 296494736 298912073 0.99
fineweb_q03/datafusion:parquet 304410428 281551629 1.08
fineweb_q04/datafusion:parquet 305105527 304280013 1.00
fineweb_q05/datafusion:parquet 302223948 298475775 1.01
fineweb_q06/datafusion:parquet 288005623 297094351 0.97
fineweb_q07/datafusion:parquet 283598554 280570540 1.01
fineweb_q08/datafusion:parquet 283821545 277222496 1.02
duckdb / vortex-file-compressed (1.005x ➖, 0↑ 0↓)
name PR 1f9bcaa (ns) base 5a764e6 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 3666133 3394668 1.08
fineweb_q01/duckdb:vortex-file-compressed 32932566 33072434 1.00
fineweb_q02/duckdb:vortex-file-compressed 37780238 39499326 0.96
fineweb_q03/duckdb:vortex-file-compressed 110352919 115915078 0.95
fineweb_q04/duckdb:vortex-file-compressed 273313757 267579057 1.02
fineweb_q05/duckdb:vortex-file-compressed 214249506 219041990 0.98
fineweb_q06/duckdb:vortex-file-compressed 51451466 50249354 1.02
fineweb_q07/duckdb:vortex-file-compressed 54833659 52592571 1.04
fineweb_q08/duckdb:vortex-file-compressed 21369362 21332785 1.00
duckdb / vortex-compact (1.006x ➖, 0↑ 0↓)
name PR 1f9bcaa (ns) base 5a764e6 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 4285795 4465993 0.96
fineweb_q01/duckdb:vortex-compact 109895864 111018798 0.99
fineweb_q02/duckdb:vortex-compact 112153237 108750296 1.03
fineweb_q03/duckdb:vortex-compact 863875185 851768550 1.01
fineweb_q04/duckdb:vortex-compact 908004096 906078942 1.00
fineweb_q05/duckdb:vortex-compact 810909729 798105587 1.02
fineweb_q06/duckdb:vortex-compact 476219370 461489486 1.03
fineweb_q07/duckdb:vortex-compact 474395423 475218779 1.00
fineweb_q08/duckdb:vortex-compact 18975990 18813437 1.01
duckdb / parquet (1.017x ➖, 0↑ 0↓)
name PR 1f9bcaa (ns) base 5a764e6 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 32399515 30718219 1.05
fineweb_q01/duckdb:parquet 84492886 84325652 1.00
fineweb_q02/duckdb:parquet 85736754 84957437 1.01
fineweb_q03/duckdb:parquet 322744693 315536639 1.02
fineweb_q04/duckdb:parquet 449590422 448464800 1.00
fineweb_q05/duckdb:parquet 415894937 414824152 1.00
fineweb_q06/duckdb:parquet 206770115 203498108 1.02
fineweb_q07/duckdb:parquet 219307601 217817512 1.01
fineweb_q08/duckdb:parquet 34165038 32950583 1.04
File Size Changes (1 files changed, +0.0% overall, 1↑ 0↓)
File Scale Format Base HEAD Change %
sample.vortex 1.0 vortex-file-compressed 1.43 GB 1.43 GB +997.44 KB +0.1%

Totals:

  • vortex-compact: 1.23 GB → 1.23 GB (0.0%)
  • vortex-file-compressed: 1.43 GB → 1.43 GB (+0.1%)

@github-actions

github-actions Bot commented Jun 22, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -2.4%
Engines: DataFusion No clear signal (+1.0%, low confidence) · DuckDB No clear signal (-5.6%, environment too noisy confidence)
Vortex (geomean): 0.995x ➖
Parquet (geomean): 1.024x ➖
Shifts: Parquet (control) +2.4% · Median polish +1.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.034x ➖, 0↑ 0↓)
name PR 1f9bcaa (ns) base 5a764e6 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 56007347 54805886 1.02
tpch_q02/datafusion:vortex-file-compressed 23767287 22842173 1.04
tpch_q03/datafusion:vortex-file-compressed 32277933 30700233 1.05
tpch_q04/datafusion:vortex-file-compressed 20276515 20008306 1.01
tpch_q05/datafusion:vortex-file-compressed 49142994 47288819 1.04
tpch_q06/datafusion:vortex-file-compressed 10162043 9775304 1.04
tpch_q07/datafusion:vortex-file-compressed 54440688 52395384 1.04
tpch_q08/datafusion:vortex-file-compressed 40627142 39548595 1.03
tpch_q09/datafusion:vortex-file-compressed 54171590 52318012 1.04
tpch_q10/datafusion:vortex-file-compressed 35721832 34666899 1.03
tpch_q11/datafusion:vortex-file-compressed 17068947 16321297 1.05
tpch_q12/datafusion:vortex-file-compressed 24019730 23847440 1.01
tpch_q13/datafusion:vortex-file-compressed 28364278 27170540 1.04
tpch_q14/datafusion:vortex-file-compressed 15739180 15050923 1.05
tpch_q15/datafusion:vortex-file-compressed 23493923 23185181 1.01
tpch_q16/datafusion:vortex-file-compressed 20216876 19772475 1.02
tpch_q17/datafusion:vortex-file-compressed 69515990 64197900 1.08
tpch_q18/datafusion:vortex-file-compressed 78967569 75749017 1.04
tpch_q19/datafusion:vortex-file-compressed 34513465 32665254 1.06
tpch_q20/datafusion:vortex-file-compressed 31795287 31820764 1.00
tpch_q21/datafusion:vortex-file-compressed 73398047 70011387 1.05
tpch_q22/datafusion:vortex-file-compressed 12455199 12356406 1.01
datafusion / vortex-compact (1.019x ➖, 0↑ 0↓)
name PR 1f9bcaa (ns) base 5a764e6 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 64797424 64050105 1.01
tpch_q02/datafusion:vortex-compact 26885170 26159818 1.03
tpch_q03/datafusion:vortex-compact 33403951 32977111 1.01
tpch_q04/datafusion:vortex-compact 22700033 22162000 1.02
tpch_q05/datafusion:vortex-compact 49391097 48280002 1.02
tpch_q06/datafusion:vortex-compact 13247432 12634857 1.05
tpch_q07/datafusion:vortex-compact 56971079 55089109 1.03
tpch_q08/datafusion:vortex-compact 43671815 42726644 1.02
tpch_q09/datafusion:vortex-compact 57116575 55751297 1.02
tpch_q10/datafusion:vortex-compact 37756585 37321306 1.01
tpch_q11/datafusion:vortex-compact 18188607 17904239 1.02
tpch_q12/datafusion:vortex-compact 30195600 30965776 0.98
tpch_q13/datafusion:vortex-compact 32939350 32144734 1.02
tpch_q14/datafusion:vortex-compact 18802055 18496222 1.02
tpch_q15/datafusion:vortex-compact 31060267 30970305 1.00
tpch_q16/datafusion:vortex-compact 25873115 25759479 1.00
tpch_q17/datafusion:vortex-compact 70596881 68781914 1.03
tpch_q18/datafusion:vortex-compact 79078340 78412965 1.01
tpch_q19/datafusion:vortex-compact 53184587 54004696 0.98
tpch_q20/datafusion:vortex-compact 37846497 36034256 1.05
tpch_q21/datafusion:vortex-compact 78407834 75849632 1.03
tpch_q22/datafusion:vortex-compact 13921547 13461531 1.03
datafusion / parquet (1.024x ➖, 0↑ 0↓)
name PR 1f9bcaa (ns) base 5a764e6 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 140459937 137837475 1.02
tpch_q02/datafusion:parquet 66267773 61623664 1.08
tpch_q03/datafusion:parquet 85789504 82993655 1.03
tpch_q04/datafusion:parquet 47963260 47181260 1.02
tpch_q05/datafusion:parquet 95808847 95754729 1.00
tpch_q06/datafusion:parquet 43340354 41063504 1.06
tpch_q07/datafusion:parquet 113929167 107687390 1.06
tpch_q08/datafusion:parquet 98552835 100996183 0.98
tpch_q09/datafusion:parquet 129796097 128069729 1.01
tpch_q10/datafusion:parquet 117906652 119627225 0.99
tpch_q11/datafusion:parquet 44388071 41507836 1.07
tpch_q12/datafusion:parquet 86466763 88480381 0.98
tpch_q13/datafusion:parquet 202825806 194011659 1.05
tpch_q14/datafusion:parquet 43182494 46635138 0.93
tpch_q15/datafusion:parquet 62147450 59053004 1.05
tpch_q16/datafusion:parquet 44609091 43769375 1.02
tpch_q17/datafusion:parquet 155029710 142402091 1.09
tpch_q18/datafusion:parquet 165245013 158340025 1.04
tpch_q19/datafusion:parquet 77305847 73833239 1.05
tpch_q20/datafusion:parquet 70228670 73009773 0.96
tpch_q21/datafusion:parquet 142362704 134105241 1.06
tpch_q22/datafusion:parquet 46227955 45602185 1.01
datafusion / arrow (1.048x ➖, 0↑ 3↓)
name PR 1f9bcaa (ns) base 5a764e6 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 63251201 60827355 1.04
tpch_q02/datafusion:arrow 17668515 17298818 1.02
tpch_q03/datafusion:arrow 34541376 33826781 1.02
tpch_q04/datafusion:arrow 27594414 27808898 0.99
tpch_q05/datafusion:arrow 58691865 57053015 1.03
tpch_q06/datafusion:arrow 🚨 26026020 21477486 1.21
tpch_q07/datafusion:arrow 113041386 108220507 1.04
tpch_q08/datafusion:arrow 44806032 43868479 1.02
tpch_q09/datafusion:arrow 69066541 73927990 0.93
tpch_q10/datafusion:arrow 53807830 51272156 1.05
tpch_q11/datafusion:arrow 9543658 9407797 1.01
tpch_q12/datafusion:arrow 54596247 51488817 1.06
tpch_q13/datafusion:arrow 🚨 52083257 45219653 1.15
tpch_q14/datafusion:arrow 24885709 23352609 1.07
tpch_q15/datafusion:arrow 49579060 48406440 1.02
tpch_q16/datafusion:arrow 17300517 16675889 1.04
tpch_q17/datafusion:arrow 73363490 69877928 1.05
tpch_q18/datafusion:arrow 115503097 109989417 1.05
tpch_q19/datafusion:arrow 🚨 41180066 37185760 1.11
tpch_q20/datafusion:arrow 38844892 36479655 1.06
tpch_q21/datafusion:arrow 162550309 155004209 1.05
tpch_q22/datafusion:arrow 12728784 12210881 1.04
duckdb / vortex-file-compressed (0.993x ➖, 0↑ 0↓)
name PR 1f9bcaa (ns) base 5a764e6 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 31647750 31609000 1.00
tpch_q02/duckdb:vortex-file-compressed 26576698 25917386 1.03
tpch_q03/duckdb:vortex-file-compressed 33587752 33767670 0.99
tpch_q04/duckdb:vortex-file-compressed 30038030 29558076 1.02
tpch_q05/duckdb:vortex-file-compressed 39752951 38155045 1.04
tpch_q06/duckdb:vortex-file-compressed 8386514 8345787 1.00
tpch_q07/duckdb:vortex-file-compressed 37775575 36049314 1.05
tpch_q08/duckdb:vortex-file-compressed 41709682 40778693 1.02
tpch_q09/duckdb:vortex-file-compressed 62279329 60415266 1.03
tpch_q10/duckdb:vortex-file-compressed 43806291 43057182 1.02
tpch_q11/duckdb:vortex-file-compressed 15883389 15049456 1.06
tpch_q12/duckdb:vortex-file-compressed 23116290 24111594 0.96
tpch_q13/duckdb:vortex-file-compressed 42192300 43430651 0.97
tpch_q14/duckdb:vortex-file-compressed 22606203 23254135 0.97
tpch_q15/duckdb:vortex-file-compressed 17399820 18192774 0.96
tpch_q16/duckdb:vortex-file-compressed 30227374 31075524 0.97
tpch_q17/duckdb:vortex-file-compressed 24501338 25431139 0.96
tpch_q18/duckdb:vortex-file-compressed 56808818 58177785 0.98
tpch_q19/duckdb:vortex-file-compressed 30892802 31909980 0.97
tpch_q20/duckdb:vortex-file-compressed 34604897 36160621 0.96
tpch_q21/duckdb:vortex-file-compressed 108686448 112674423 0.96
tpch_q22/duckdb:vortex-file-compressed 18133034 19287393 0.94
duckdb / vortex-compact (0.937x ➖, 3↑ 0↓)
name PR 1f9bcaa (ns) base 5a764e6 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 39219641 39590562 0.99
tpch_q02/duckdb:vortex-compact 34347227 35590714 0.97
tpch_q03/duckdb:vortex-compact 35430854 36693935 0.97
tpch_q04/duckdb:vortex-compact 32135107 32240700 1.00
tpch_q05/duckdb:vortex-compact 43029395 45906929 0.94
tpch_q06/duckdb:vortex-compact 10631037 11628898 0.91
tpch_q07/duckdb:vortex-compact 43258452 46629583 0.93
tpch_q08/duckdb:vortex-compact 47606525 52054414 0.91
tpch_q09/duckdb:vortex-compact 🚀 67454366 75171361 0.90
tpch_q10/duckdb:vortex-compact 47694942 49928670 0.96
tpch_q11/duckdb:vortex-compact 18712702 20682321 0.90
tpch_q12/duckdb:vortex-compact 31364838 33380055 0.94
tpch_q13/duckdb:vortex-compact 47246307 51050359 0.93
tpch_q14/duckdb:vortex-compact 27802672 29436228 0.94
tpch_q15/duckdb:vortex-compact 20494268 22284645 0.92
tpch_q16/duckdb:vortex-compact 33935609 36647606 0.93
tpch_q17/duckdb:vortex-compact 29718616 32543672 0.91
tpch_q18/duckdb:vortex-compact 58923282 58965350 1.00
tpch_q19/duckdb:vortex-compact 🚀 35332347 39532265 0.89
tpch_q20/duckdb:vortex-compact 41072441 44722690 0.92
tpch_q21/duckdb:vortex-compact 🚀 110247448 123673614 0.89
tpch_q22/duckdb:vortex-compact 19556916 19671332 0.99
duckdb / parquet (1.024x ➖, 0↑ 3↓)
name PR 1f9bcaa (ns) base 5a764e6 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 77170110 76969943 1.00
tpch_q02/duckdb:parquet 40719606 39650361 1.03
tpch_q03/duckdb:parquet 71997631 71416194 1.01
tpch_q04/duckdb:parquet 50541090 52131875 0.97
tpch_q05/duckdb:parquet 69066163 68909904 1.00
tpch_q06/duckdb:parquet 22796262 22651940 1.01
tpch_q07/duckdb:parquet 72401394 70281734 1.03
tpch_q08/duckdb:parquet 88818005 83223402 1.07
tpch_q09/duckdb:parquet 140875574 154249975 0.91
tpch_q10/duckdb:parquet 128355691 126128054 1.02
tpch_q11/duckdb:parquet 23287574 22367809 1.04
tpch_q12/duckdb:parquet 🚨 56737168 46620891 1.22
tpch_q13/duckdb:parquet 267302726 253130559 1.06
tpch_q14/duckdb:parquet 52906656 58453291 0.91
tpch_q15/duckdb:parquet 26835057 26318534 1.02
tpch_q16/duckdb:parquet 60325508 57759978 1.04
tpch_q17/duckdb:parquet 🚨 60128888 54192510 1.11
tpch_q18/duckdb:parquet 121524558 122133156 1.00
tpch_q19/duckdb:parquet 78224676 79060630 0.99
tpch_q20/duckdb:parquet 🚨 76597775 66394021 1.15
tpch_q21/duckdb:parquet 178549890 182963223 0.98
tpch_q22/duckdb:parquet 55121920 53893681 1.02
duckdb / duckdb (0.971x ➖, 0↑ 0↓)
name PR 1f9bcaa (ns) base 5a764e6 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 17979460 17899780 1.00
tpch_q02/duckdb:duckdb 15038719 15260635 0.99
tpch_q03/duckdb:duckdb 23926521 23401354 1.02
tpch_q04/duckdb:duckdb 21763773 23282881 0.93
tpch_q05/duckdb:duckdb 24058888 24390922 0.99
tpch_q06/duckdb:duckdb 7257797 7216521 1.01
tpch_q07/duckdb:duckdb 26406584 26366484 1.00
tpch_q08/duckdb:duckdb 24652780 24724650 1.00
tpch_q09/duckdb:duckdb 60924668 62869596 0.97
tpch_q10/duckdb:duckdb 52508161 53720437 0.98
tpch_q11/duckdb:duckdb 7515182 7726337 0.97
tpch_q12/duckdb:duckdb 18389531 19099889 0.96
tpch_q13/duckdb:duckdb 40419676 42919980 0.94
tpch_q14/duckdb:duckdb 22109467 23424081 0.94
tpch_q15/duckdb:duckdb 13910546 14275475 0.97
tpch_q16/duckdb:duckdb 26652605 28243724 0.94
tpch_q17/duckdb:duckdb 16532886 17013741 0.97
tpch_q18/duckdb:duckdb 41324547 43029286 0.96
tpch_q19/duckdb:duckdb 32294953 33955064 0.95
tpch_q20/duckdb:duckdb 25283939 26599827 0.95
tpch_q21/duckdb:duckdb 63644174 67176393 0.95
tpch_q22/duckdb:duckdb 26115978 26977173 0.97
File Size Changes (10 files changed, +0.3% overall, 9↑ 1↓)
File Scale Format Base HEAD Change %
orders_0.vortex 1.0 vortex-compact 31.73 MB 32.20 MB +482.26 KB +1.5%
partsupp_0.vortex 1.0 vortex-compact 20.89 MB 21.14 MB +262.10 KB +1.2%
orders_0.vortex 1.0 vortex-file-compressed 35.15 MB 35.57 MB +426.62 KB +1.2%
supplier_0.vortex 1.0 vortex-file-compressed 613.90 KB 619.52 KB +5.62 KB +0.9%
part_0.vortex 1.0 vortex-file-compressed 4.94 MB 4.97 MB +35.27 KB +0.7%
lineitem_0.vortex 1.0 vortex-file-compressed 82.15 MB 82.29 MB +145.23 KB +0.2%
lineitem_1.vortex 1.0 vortex-file-compressed 81.99 MB 82.09 MB +97.12 KB +0.1%
customer_0.vortex 1.0 vortex-file-compressed 8.90 MB 8.91 MB +6.02 KB +0.1%
partsupp_0.vortex 1.0 vortex-file-compressed 23.69 MB 23.70 MB +8.20 KB +0.0%
part_0.vortex 1.0 vortex-compact 3.40 MB 3.39 MB 6.50 KB -0.2%

Totals:

  • vortex-compact: 190.24 MB → 190.96 MB (+0.4%)
  • vortex-file-compressed: 237.70 MB → 238.41 MB (+0.3%)

@github-actions

github-actions Bot commented Jun 22, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.1%
Engines: DataFusion No clear signal (+0.8%, environment too noisy confidence) · DuckDB No clear signal (-1.3%, low confidence)
Vortex (geomean): 0.931x ➖
Parquet (geomean): 0.940x ➖
Shifts: Parquet (control) -6.0% · Median polish -5.8%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.921x ➖, 29↑ 0↓)
name PR 1f9bcaa (ns) base 5a764e6 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 25957554 27675276 0.94
tpcds_q02/datafusion:vortex-file-compressed 48376286 49604814 0.98
tpcds_q03/datafusion:vortex-file-compressed 🚀 15061789 17635053 0.85
tpcds_q04/datafusion:vortex-file-compressed 255831741 270135669 0.95
tpcds_q05/datafusion:vortex-file-compressed 46041011 47048212 0.98
tpcds_q06/datafusion:vortex-file-compressed 23666978 24581715 0.96
tpcds_q07/datafusion:vortex-file-compressed 40393417 43994342 0.92
tpcds_q08/datafusion:vortex-file-compressed 29268359 31835360 0.92
tpcds_q09/datafusion:vortex-file-compressed 30526252 33862800 0.90
tpcds_q10/datafusion:vortex-file-compressed 🚀 38709432 43889656 0.88
tpcds_q11/datafusion:vortex-file-compressed 135325240 140978593 0.96
tpcds_q12/datafusion:vortex-file-compressed 🚀 18588934 21756752 0.85
tpcds_q13/datafusion:vortex-file-compressed 49374452 54237338 0.91
tpcds_q14/datafusion:vortex-file-compressed 162392834 173484879 0.94
tpcds_q15/datafusion:vortex-file-compressed 26930402 28104632 0.96
tpcds_q16/datafusion:vortex-file-compressed 25496323 28121704 0.91
tpcds_q17/datafusion:vortex-file-compressed 63995721 67187299 0.95
tpcds_q18/datafusion:vortex-file-compressed 64332355 70021128 0.92
tpcds_q19/datafusion:vortex-file-compressed 🚀 21796933 24594262 0.89
tpcds_q20/datafusion:vortex-file-compressed 21419099 21533549 0.99
tpcds_q21/datafusion:vortex-file-compressed 36272627 39500596 0.92
tpcds_q22/datafusion:vortex-file-compressed 139314727 138434018 1.01
tpcds_q23/datafusion:vortex-file-compressed 148033917 158201467 0.94
tpcds_q24/datafusion:vortex-file-compressed 83777602 89296459 0.94
tpcds_q25/datafusion:vortex-file-compressed 65074198 68352387 0.95
tpcds_q26/datafusion:vortex-file-compressed 34531389 36028375 0.96
tpcds_q27/datafusion:vortex-file-compressed 🚀 91671617 104201114 0.88
tpcds_q28/datafusion:vortex-file-compressed 30445522 31568375 0.96
tpcds_q29/datafusion:vortex-file-compressed 62120177 66966747 0.93
tpcds_q30/datafusion:vortex-file-compressed 23527236 24819630 0.95
tpcds_q31/datafusion:vortex-file-compressed 74601883 80706602 0.92
tpcds_q32/datafusion:vortex-file-compressed 🚀 19207193 21386507 0.90
tpcds_q33/datafusion:vortex-file-compressed 🚀 28762440 32113371 0.90
tpcds_q34/datafusion:vortex-file-compressed 25469092 28178803 0.90
tpcds_q35/datafusion:vortex-file-compressed 45919168 48306619 0.95
tpcds_q36/datafusion:vortex-file-compressed 58275022 62937796 0.93
tpcds_q37/datafusion:vortex-file-compressed 21624340 22696697 0.95
tpcds_q38/datafusion:vortex-file-compressed 45285511 47696188 0.95
tpcds_q39/datafusion:vortex-file-compressed 🚀 105433236 118572606 0.89
tpcds_q40/datafusion:vortex-file-compressed 32105523 34566849 0.93
tpcds_q41/datafusion:vortex-file-compressed 🚀 20039046 22700533 0.88
tpcds_q42/datafusion:vortex-file-compressed 14220395 14510106 0.98
tpcds_q43/datafusion:vortex-file-compressed 18682521 19626136 0.95
tpcds_q44/datafusion:vortex-file-compressed 28575874 30897366 0.92
tpcds_q45/datafusion:vortex-file-compressed 28166008 28833330 0.98
tpcds_q46/datafusion:vortex-file-compressed 36205139 37722385 0.96
tpcds_q47/datafusion:vortex-file-compressed 139198657 142018157 0.98
tpcds_q48/datafusion:vortex-file-compressed 35088461 36121082 0.97
tpcds_q49/datafusion:vortex-file-compressed 59337590 62605715 0.95
tpcds_q50/datafusion:vortex-file-compressed 40732690 42296085 0.96
tpcds_q51/datafusion:vortex-file-compressed 88259403 97421522 0.91
tpcds_q52/datafusion:vortex-file-compressed 🚀 14539841 16829023 0.86
tpcds_q53/datafusion:vortex-file-compressed 🚀 21895168 27028146 0.81
tpcds_q54/datafusion:vortex-file-compressed 🚀 34726953 40698989 0.85
tpcds_q55/datafusion:vortex-file-compressed 13903516 15447149 0.90
tpcds_q56/datafusion:vortex-file-compressed 31458597 34275579 0.92
tpcds_q57/datafusion:vortex-file-compressed 111175927 117315057 0.95
tpcds_q58/datafusion:vortex-file-compressed 59358099 62306436 0.95
tpcds_q59/datafusion:vortex-file-compressed 58406333 60812621 0.96
tpcds_q60/datafusion:vortex-file-compressed 29680076 31469282 0.94
tpcds_q61/datafusion:vortex-file-compressed 🚀 40416966 45161899 0.89
tpcds_q62/datafusion:vortex-file-compressed 27741489 27768814 1.00
tpcds_q63/datafusion:vortex-file-compressed 23243946 24860501 0.93
tpcds_q64/datafusion:vortex-file-compressed 384150795 425470845 0.90
tpcds_q65/datafusion:vortex-file-compressed 52677699 55538322 0.95
tpcds_q66/datafusion:vortex-file-compressed 🚀 70983201 79701407 0.89
tpcds_q67/datafusion:vortex-file-compressed 🚀 147397417 170081059 0.87
tpcds_q68/datafusion:vortex-file-compressed 🚀 33803305 38754934 0.87
tpcds_q69/datafusion:vortex-file-compressed 🚀 36644718 41228444 0.89
tpcds_q70/datafusion:vortex-file-compressed 104402598 110711153 0.94
tpcds_q71/datafusion:vortex-file-compressed 23250830 25442316 0.91
tpcds_q72/datafusion:vortex-file-compressed 🚀 2128695854 2456434710 0.87
tpcds_q73/datafusion:vortex-file-compressed 26162352 26560833 0.98
tpcds_q74/datafusion:vortex-file-compressed 🚀 79133759 89313324 0.89
tpcds_q75/datafusion:vortex-file-compressed 120409520 121636221 0.99
tpcds_q76/datafusion:vortex-file-compressed 🚀 27556630 30819083 0.89
tpcds_q77/datafusion:vortex-file-compressed 37556317 40867663 0.92
tpcds_q78/datafusion:vortex-file-compressed 117646294 125502488 0.94
tpcds_q79/datafusion:vortex-file-compressed 29260273 31147676 0.94
tpcds_q80/datafusion:vortex-file-compressed 🚀 86735922 98905000 0.88
tpcds_q81/datafusion:vortex-file-compressed 24480243 25680673 0.95
tpcds_q82/datafusion:vortex-file-compressed 22509717 23983952 0.94
tpcds_q83/datafusion:vortex-file-compressed 37753611 38828530 0.97
tpcds_q84/datafusion:vortex-file-compressed 14027057 15017665 0.93
tpcds_q85/datafusion:vortex-file-compressed 97539757 106897229 0.91
tpcds_q86/datafusion:vortex-file-compressed 🚀 15383745 20446649 0.75
tpcds_q87/datafusion:vortex-file-compressed 46435657 47914150 0.97
tpcds_q88/datafusion:vortex-file-compressed 57258471 63243084 0.91
tpcds_q89/datafusion:vortex-file-compressed 🚀 25212097 29055299 0.87
tpcds_q90/datafusion:vortex-file-compressed 🚀 14181782 16785584 0.84
tpcds_q91/datafusion:vortex-file-compressed 🚀 18348055 20974397 0.87
tpcds_q92/datafusion:vortex-file-compressed 🚀 17311605 19515054 0.89
tpcds_q93/datafusion:vortex-file-compressed 🚀 31519115 37478248 0.84
tpcds_q94/datafusion:vortex-file-compressed 23565105 25086939 0.94
tpcds_q95/datafusion:vortex-file-compressed 60693214 65090801 0.93
tpcds_q96/datafusion:vortex-file-compressed 13520082 13801564 0.98
tpcds_q97/datafusion:vortex-file-compressed 30542830 32658993 0.94
tpcds_q98/datafusion:vortex-file-compressed 🚀 23561625 26459644 0.89
tpcds_q99/datafusion:vortex-file-compressed 🚀 27583322 33887980 0.81
datafusion / vortex-compact (0.943x ➖, 17↑ 2↓)
name PR 1f9bcaa (ns) base 5a764e6 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-compact 27503921 28969895 0.95
tpcds_q02/datafusion:vortex-compact 53023088 58080645 0.91
tpcds_q03/datafusion:vortex-compact 19225639 21289191 0.90
tpcds_q04/datafusion:vortex-compact 🚀 290016326 323073186 0.90
tpcds_q05/datafusion:vortex-compact 50289949 52448491 0.96
tpcds_q06/datafusion:vortex-compact 26318361 28469446 0.92
tpcds_q07/datafusion:vortex-compact 55078733 56511614 0.97
tpcds_q08/datafusion:vortex-compact 37291825 39191277 0.95
tpcds_q09/datafusion:vortex-compact 44426078 48040339 0.92
tpcds_q10/datafusion:vortex-compact 49469782 53067450 0.93
tpcds_q11/datafusion:vortex-compact 151887514 163075552 0.93
tpcds_q12/datafusion:vortex-compact 🚀 22893901 26445392 0.87
tpcds_q13/datafusion:vortex-compact 125513386 131817783 0.95
tpcds_q14/datafusion:vortex-compact 182736174 198893369 0.92
tpcds_q15/datafusion:vortex-compact 28900945 31470126 0.92
tpcds_q16/datafusion:vortex-compact 31821440 31672540 1.00
tpcds_q17/datafusion:vortex-compact 🚀 73821375 82091126 0.90
tpcds_q18/datafusion:vortex-compact 🚀 73106170 84700668 0.86
tpcds_q19/datafusion:vortex-compact 30627556 31214923 0.98
tpcds_q20/datafusion:vortex-compact 🚀 25718562 28888421 0.89
tpcds_q21/datafusion:vortex-compact 40481613 42141317 0.96
tpcds_q22/datafusion:vortex-compact 🚨 156557636 138763921 1.13
tpcds_q23/datafusion:vortex-compact 162742322 173484718 0.94
tpcds_q24/datafusion:vortex-compact 98502098 100359051 0.98
tpcds_q25/datafusion:vortex-compact 77587610 85426763 0.91
tpcds_q26/datafusion:vortex-compact 45682437 47787752 0.96
tpcds_q27/datafusion:vortex-compact 🚀 113259724 135180479 0.84
tpcds_q28/datafusion:vortex-compact 99104596 99231103 1.00
tpcds_q29/datafusion:vortex-compact 71530742 75621993 0.95
tpcds_q30/datafusion:vortex-compact 🚀 27223984 30952044 0.88
tpcds_q31/datafusion:vortex-compact 100320364 108597833 0.92
tpcds_q32/datafusion:vortex-compact 24780024 27088823 0.91
tpcds_q33/datafusion:vortex-compact 36810692 40474902 0.91
tpcds_q34/datafusion:vortex-compact 34056058 36090198 0.94
tpcds_q35/datafusion:vortex-compact 52826166 55480286 0.95
tpcds_q36/datafusion:vortex-compact 77261823 82048473 0.94
tpcds_q37/datafusion:vortex-compact 30832482 32331076 0.95
tpcds_q38/datafusion:vortex-compact 50744745 55344544 0.92
tpcds_q39/datafusion:vortex-compact 114690572 118877437 0.96
tpcds_q40/datafusion:vortex-compact 34700395 37327308 0.93
tpcds_q41/datafusion:vortex-compact 23144814 24311644 0.95
tpcds_q42/datafusion:vortex-compact 18661877 19166960 0.97
tpcds_q43/datafusion:vortex-compact 25166531 25530916 0.99
tpcds_q44/datafusion:vortex-compact 43702973 43509399 1.00
tpcds_q45/datafusion:vortex-compact 31228375 33787684 0.92
tpcds_q46/datafusion:vortex-compact 46429765 46405513 1.00
tpcds_q47/datafusion:vortex-compact 159850493 158732869 1.01
tpcds_q48/datafusion:vortex-compact 80089970 83404120 0.96
tpcds_q49/datafusion:vortex-compact 70331034 72686530 0.97
tpcds_q50/datafusion:vortex-compact 46114604 49486898 0.93
tpcds_q51/datafusion:vortex-compact 96679522 105862827 0.91
tpcds_q52/datafusion:vortex-compact 🚀 18489294 21090656 0.88
tpcds_q53/datafusion:vortex-compact 31742699 30375979 1.04
tpcds_q54/datafusion:vortex-compact 41554195 42878873 0.97
tpcds_q55/datafusion:vortex-compact 🚀 18160437 20410635 0.89
tpcds_q56/datafusion:vortex-compact 35595219 38129447 0.93
tpcds_q57/datafusion:vortex-compact 🚀 114834333 132305960 0.87
tpcds_q58/datafusion:vortex-compact 64408196 71204165 0.90
tpcds_q59/datafusion:vortex-compact 70625595 76180846 0.93
tpcds_q60/datafusion:vortex-compact 39081329 38160455 1.02
tpcds_q61/datafusion:vortex-compact 53572970 57317480 0.93
tpcds_q62/datafusion:vortex-compact 27877570 26275096 1.06
tpcds_q63/datafusion:vortex-compact 🚀 29159644 32903490 0.89
tpcds_q64/datafusion:vortex-compact 416891920 459717186 0.91
tpcds_q65/datafusion:vortex-compact 68246480 70211440 0.97
tpcds_q66/datafusion:vortex-compact 🚀 74599074 82966636 0.90
tpcds_q67/datafusion:vortex-compact 🚀 157261261 181512492 0.87
tpcds_q68/datafusion:vortex-compact 46875256 48020826 0.98
tpcds_q69/datafusion:vortex-compact 46253415 50132189 0.92
tpcds_q70/datafusion:vortex-compact 107151172 112251538 0.95
tpcds_q71/datafusion:vortex-compact 30547003 31115198 0.98
tpcds_q72/datafusion:vortex-compact 2136807959 2274083010 0.94
tpcds_q73/datafusion:vortex-compact 32773408 32864623 1.00
tpcds_q74/datafusion:vortex-compact 🚀 91604823 106636797 0.86
tpcds_q75/datafusion:vortex-compact 128268557 141025117 0.91
tpcds_q76/datafusion:vortex-compact 🚀 31951896 36565636 0.87
tpcds_q77/datafusion:vortex-compact 48048476 50419911 0.95
tpcds_q78/datafusion:vortex-compact 128682182 141560653 0.91
tpcds_q79/datafusion:vortex-compact 38754269 41208020 0.94
tpcds_q80/datafusion:vortex-compact 98065782 107235122 0.91
tpcds_q81/datafusion:vortex-compact 28537685 29659447 0.96
tpcds_q82/datafusion:vortex-compact 31568202 32332456 0.98
tpcds_q83/datafusion:vortex-compact 35547722 37732458 0.94
tpcds_q84/datafusion:vortex-compact 14743253 15876625 0.93
tpcds_q85/datafusion:vortex-compact 158630276 163949412 0.97
tpcds_q86/datafusion:vortex-compact 🚨 21556776 19503794 1.11
tpcds_q87/datafusion:vortex-compact 🚀 49153209 56083896 0.88
tpcds_q88/datafusion:vortex-compact 77547579 80324337 0.97
tpcds_q89/datafusion:vortex-compact 32243223 32877118 0.98
tpcds_q90/datafusion:vortex-compact 15381246 15941476 0.96
tpcds_q91/datafusion:vortex-compact 33168386 34403286 0.96
tpcds_q92/datafusion:vortex-compact 22376272 24551129 0.91
tpcds_q93/datafusion:vortex-compact 37090262 38261068 0.97
tpcds_q94/datafusion:vortex-compact 🚀 24398948 29009240 0.84
tpcds_q95/datafusion:vortex-compact 62361553 62763781 0.99
tpcds_q96/datafusion:vortex-compact 17322430 17364856 1.00
tpcds_q97/datafusion:vortex-compact 34999127 36500602 0.96
tpcds_q98/datafusion:vortex-compact 31186827 31621061 0.99
tpcds_q99/datafusion:vortex-compact 34464623 31679240 1.09
datafusion / parquet (0.924x ➖, 24↑ 0↓)
name PR 1f9bcaa (ns) base 5a764e6 (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 23104828 25391031 0.91
tpcds_q02/datafusion:parquet 41319464 44279661 0.93
tpcds_q03/datafusion:parquet 14174075 13831041 1.02
tpcds_q04/datafusion:parquet 🚀 284867757 326817725 0.87
tpcds_q05/datafusion:parquet 🚀 45046201 50506595 0.89
tpcds_q06/datafusion:parquet 23515569 25173066 0.93
tpcds_q07/datafusion:parquet 81086206 85093847 0.95
tpcds_q08/datafusion:parquet 28667554 30955287 0.93
tpcds_q09/datafusion:parquet 39376378 42816735 0.92
tpcds_q10/datafusion:parquet 72934576 78457699 0.93
tpcds_q11/datafusion:parquet 150803072 163930854 0.92
tpcds_q12/datafusion:parquet 18471841 19361543 0.95
tpcds_q13/datafusion:parquet 76584174 81441286 0.94
tpcds_q14/datafusion:parquet 158918948 173667400 0.92
tpcds_q15/datafusion:parquet 21507867 22621983 0.95
tpcds_q16/datafusion:parquet 🚀 27668136 32175161 0.86
tpcds_q17/datafusion:parquet 60179138 66490653 0.91
tpcds_q18/datafusion:parquet 111188724 113062502 0.98
tpcds_q19/datafusion:parquet 🚀 22384805 26560955 0.84
tpcds_q20/datafusion:parquet 🚀 17558085 19654497 0.89
tpcds_q21/datafusion:parquet 19614750 19925188 0.98
tpcds_q22/datafusion:parquet 🚀 155511611 199534198 0.78
tpcds_q23/datafusion:parquet 151289612 167199070 0.90
tpcds_q24/datafusion:parquet 92687025 94360639 0.98
tpcds_q25/datafusion:parquet 62720902 66984486 0.94
tpcds_q26/datafusion:parquet 🚀 63039819 73263426 0.86
tpcds_q27/datafusion:parquet 🚀 135025851 151008041 0.89
tpcds_q28/datafusion:parquet 46475793 48827463 0.95
tpcds_q29/datafusion:parquet 64671604 69641853 0.93
tpcds_q30/datafusion:parquet 33512732 34585112 0.97
tpcds_q31/datafusion:parquet 🚀 65785771 73614401 0.89
tpcds_q32/datafusion:parquet 17871703 17965106 0.99
tpcds_q33/datafusion:parquet 28062196 28879476 0.97
tpcds_q34/datafusion:parquet 22326097 23432621 0.95
tpcds_q35/datafusion:parquet 71532564 76823250 0.93
tpcds_q36/datafusion:parquet 57507038 62468428 0.92
tpcds_q37/datafusion:parquet 19814200 20635091 0.96
tpcds_q38/datafusion:parquet 41927635 45951218 0.91
tpcds_q39/datafusion:parquet 🚀 74878052 85017147 0.88
tpcds_q40/datafusion:parquet 22863195 25320447 0.90
tpcds_q41/datafusion:parquet 🚀 14679888 16620347 0.88
tpcds_q42/datafusion:parquet 🚀 11827461 13316843 0.89
tpcds_q43/datafusion:parquet 17016443 17336189 0.98
tpcds_q44/datafusion:parquet 32882902 34874169 0.94
tpcds_q45/datafusion:parquet 28064702 29145325 0.96
tpcds_q46/datafusion:parquet 🚀 32228433 36262146 0.89
tpcds_q47/datafusion:parquet 127370885 136489553 0.93
tpcds_q48/datafusion:parquet 🚀 68620459 77105652 0.89
tpcds_q49/datafusion:parquet 58520261 61974238 0.94
tpcds_q50/datafusion:parquet 44040495 47300616 0.93
tpcds_q51/datafusion:parquet 90800671 97936331 0.93
tpcds_q52/datafusion:parquet 12416238 13296943 0.93
tpcds_q53/datafusion:parquet 🚀 18193881 21385931 0.85
tpcds_q54/datafusion:parquet 32207718 35576819 0.91
tpcds_q55/datafusion:parquet 12016720 12623857 0.95
tpcds_q56/datafusion:parquet 28457030 29280832 0.97
tpcds_q57/datafusion:parquet 🚀 96884394 110076974 0.88
tpcds_q58/datafusion:parquet 🚀 56027230 62560541 0.90
tpcds_q59/datafusion:parquet 62411908 67091937 0.93
tpcds_q60/datafusion:parquet 28048259 29417740 0.95
tpcds_q61/datafusion:parquet 43749900 46823474 0.93
tpcds_q62/datafusion:parquet 24868515 27477044 0.91
tpcds_q63/datafusion:parquet 🚀 17648009 19886981 0.89
tpcds_q64/datafusion:parquet 298927327 330216458 0.91
tpcds_q65/datafusion:parquet 37278729 41261990 0.90
tpcds_q66/datafusion:parquet 70923729 73353911 0.97
tpcds_q67/datafusion:parquet 🚀 141616017 164627556 0.86
tpcds_q68/datafusion:parquet 🚀 31562928 36203469 0.87
tpcds_q69/datafusion:parquet 66078484 73050134 0.90
tpcds_q70/datafusion:parquet 32707232 36244104 0.90
tpcds_q71/datafusion:parquet 23092943 23864539 0.97
tpcds_q72/datafusion:parquet 🚀 579307454 664572827 0.87
tpcds_q73/datafusion:parquet 21508422 22603785 0.95
tpcds_q74/datafusion:parquet 87421177 88430507 0.99
tpcds_q75/datafusion:parquet 102666680 111887368 0.92
tpcds_q76/datafusion:parquet 30517688 31905063 0.96
tpcds_q77/datafusion:parquet 38059162 40141979 0.95
tpcds_q78/datafusion:parquet 110310779 118680893 0.93
tpcds_q79/datafusion:parquet 26610617 28263759 0.94
tpcds_q80/datafusion:parquet 78120299 80784654 0.97
tpcds_q81/datafusion:parquet 29855340 31830846 0.94
tpcds_q82/datafusion:parquet 19823583 20102872 0.99
tpcds_q83/datafusion:parquet 40626550 43546806 0.93
tpcds_q84/datafusion:parquet 41431863 42361121 0.98
tpcds_q85/datafusion:parquet 147586849 158024672 0.93
tpcds_q86/datafusion:parquet 🚀 13955664 18820413 0.74
tpcds_q87/datafusion:parquet 43908384 48745786 0.90
tpcds_q88/datafusion:parquet 60772564 62092753 0.98
tpcds_q89/datafusion:parquet 22355388 23985241 0.93
tpcds_q90/datafusion:parquet 🚀 14313840 15965680 0.90
tpcds_q91/datafusion:parquet 57218060 62303293 0.92
tpcds_q92/datafusion:parquet 🚀 17403613 19582934 0.89
tpcds_q93/datafusion:parquet 30046730 32638256 0.92
tpcds_q94/datafusion:parquet 21242126 22380230 0.95
tpcds_q95/datafusion:parquet 62676562 62665854 1.00
tpcds_q96/datafusion:parquet 13154151 13062988 1.01
tpcds_q97/datafusion:parquet 30559913 31838943 0.96
tpcds_q98/datafusion:parquet 21464873 23491991 0.91
tpcds_q99/datafusion:parquet 26247259 27837142 0.94
duckdb / vortex-file-compressed (0.927x ➖, 29↑ 0↓)
name PR 1f9bcaa (ns) base 5a764e6 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 25300211 24046435 1.05
tpcds_q02/duckdb:vortex-file-compressed 36860686 34205127 1.08
tpcds_q03/duckdb:vortex-file-compressed 🚀 15063589 16822100 0.90
tpcds_q04/duckdb:vortex-file-compressed 🚀 92285576 105327822 0.88
tpcds_q05/duckdb:vortex-file-compressed 35675386 39368658 0.91
tpcds_q06/duckdb:vortex-file-compressed 34778645 37545690 0.93
tpcds_q07/duckdb:vortex-file-compressed 25084938 26929774 0.93
tpcds_q08/duckdb:vortex-file-compressed 🚀 27795333 32393777 0.86
tpcds_q09/duckdb:vortex-file-compressed 18073428 18144529 1.00
tpcds_q10/duckdb:vortex-file-compressed 🚀 37820479 44366733 0.85
tpcds_q11/duckdb:vortex-file-compressed 66700806 70113687 0.95
tpcds_q12/duckdb:vortex-file-compressed 15582578 17008995 0.92
tpcds_q13/duckdb:vortex-file-compressed 34305811 34978562 0.98
tpcds_q14/duckdb:vortex-file-compressed 99120700 105561033 0.94
tpcds_q15/duckdb:vortex-file-compressed 27558554 29339254 0.94
tpcds_q16/duckdb:vortex-file-compressed 26035712 27872789 0.93
tpcds_q17/duckdb:vortex-file-compressed 49677411 51993204 0.96
tpcds_q18/duckdb:vortex-file-compressed 38488090 42729598 0.90
tpcds_q19/duckdb:vortex-file-compressed 31891604 35328301 0.90
tpcds_q20/duckdb:vortex-file-compressed 17268080 18972035 0.91
tpcds_q21/duckdb:vortex-file-compressed 16162588 17590490 0.92
tpcds_q22/duckdb:vortex-file-compressed 🚀 73716822 82602625 0.89
tpcds_q23/duckdb:vortex-file-compressed 96496817 98127184 0.98
tpcds_q24/duckdb:vortex-file-compressed 49674567 52897118 0.94
tpcds_q25/duckdb:vortex-file-compressed 40905004 43279182 0.95
tpcds_q26/duckdb:vortex-file-compressed 21446505 21230422 1.01
tpcds_q27/duckdb:vortex-file-compressed 27941976 28027570 1.00
tpcds_q28/duckdb:vortex-file-compressed 12054903 12875564 0.94
tpcds_q29/duckdb:vortex-file-compressed 44899592 48486698 0.93
tpcds_q30/duckdb:vortex-file-compressed 26719988 27399138 0.98
tpcds_q31/duckdb:vortex-file-compressed 30966340 32088401 0.97
tpcds_q32/duckdb:vortex-file-compressed 🚀 13491351 15971934 0.84
tpcds_q33/duckdb:vortex-file-compressed 🚀 24402225 28411184 0.86
tpcds_q34/duckdb:vortex-file-compressed 26208307 27539329 0.95
tpcds_q35/duckdb:vortex-file-compressed 65461983 70088788 0.93
tpcds_q36/duckdb:vortex-file-compressed 25377381 27451915 0.92
tpcds_q37/duckdb:vortex-file-compressed 19566389 21393590 0.91
tpcds_q38/duckdb:vortex-file-compressed 36076321 38978561 0.93
tpcds_q39/duckdb:vortex-file-compressed 35732786 38674974 0.92
tpcds_q40/duckdb:vortex-file-compressed 🚀 20453168 22886063 0.89
tpcds_q41/duckdb:vortex-file-compressed 12565675 13480981 0.93
tpcds_q42/duckdb:vortex-file-compressed 13985344 14257235 0.98
tpcds_q43/duckdb:vortex-file-compressed 🚀 20871564 23515591 0.89
tpcds_q44/duckdb:vortex-file-compressed 🚀 21723310 24240891 0.90
tpcds_q45/duckdb:vortex-file-compressed 34579126 32852612 1.05
tpcds_q46/duckdb:vortex-file-compressed 35895683 35447411 1.01
tpcds_q47/duckdb:vortex-file-compressed 51655163 56008347 0.92
tpcds_q48/duckdb:vortex-file-compressed 29207502 32259247 0.91
tpcds_q49/duckdb:vortex-file-compressed 41314392 39100420 1.06
tpcds_q50/duckdb:vortex-file-compressed 🚀 27498622 30558802 0.90
tpcds_q51/duckdb:vortex-file-compressed 107686315 113103074 0.95
tpcds_q52/duckdb:vortex-file-compressed 13552310 14023598 0.97
tpcds_q53/duckdb:vortex-file-compressed 22823376 25084158 0.91
tpcds_q54/duckdb:vortex-file-compressed 30939967 32781598 0.94
tpcds_q55/duckdb:vortex-file-compressed 🚀 12955309 16116637 0.80
tpcds_q56/duckdb:vortex-file-compressed 🚀 26327779 29408026 0.90
tpcds_q57/duckdb:vortex-file-compressed 42585929 45093083 0.94
tpcds_q58/duckdb:vortex-file-compressed 31015725 32164276 0.96
tpcds_q59/duckdb:vortex-file-compressed 55927304 59342928 0.94
tpcds_q60/duckdb:vortex-file-compressed 27906249 28442854 0.98
tpcds_q61/duckdb:vortex-file-compressed 31235532 31988177 0.98
tpcds_q62/duckdb:vortex-file-compressed 🚀 15679546 17756029 0.88
tpcds_q63/duckdb:vortex-file-compressed 🚀 21015120 25130382 0.84
tpcds_q64/duckdb:vortex-file-compressed 97108769 104181478 0.93
tpcds_q65/duckdb:vortex-file-compressed 🚀 22739200 25484401 0.89
tpcds_q66/duckdb:vortex-file-compressed 29299140 32124057 0.91
tpcds_q67/duckdb:vortex-file-compressed 141354972 154237977 0.92
tpcds_q68/duckdb:vortex-file-compressed 🚀 32391408 36197120 0.89
tpcds_q69/duckdb:vortex-file-compressed 40452854 44188459 0.92
tpcds_q70/duckdb:vortex-file-compressed 37860068 41104366 0.92
tpcds_q71/duckdb:vortex-file-compressed 21464855 22869446 0.94
tpcds_q72/duckdb:vortex-file-compressed 178135466 189438704 0.94
tpcds_q73/duckdb:vortex-file-compressed 25414947 26514837 0.96
tpcds_q74/duckdb:vortex-file-compressed 44826948 46401451 0.97
tpcds_q75/duckdb:vortex-file-compressed 49983462 54853158 0.91
tpcds_q76/duckdb:vortex-file-compressed 18867254 20465458 0.92
tpcds_q77/duckdb:vortex-file-compressed 26296798 27293156 0.96
tpcds_q78/duckdb:vortex-file-compressed 80733994 84096659 0.96
tpcds_q79/duckdb:vortex-file-compressed 24657223 26209186 0.94
tpcds_q80/duckdb:vortex-file-compressed 🚀 46811751 53369511 0.88
tpcds_q81/duckdb:vortex-file-compressed 🚀 31336115 34911788 0.90
tpcds_q82/duckdb:vortex-file-compressed 🚀 45940939 51646936 0.89
tpcds_q83/duckdb:vortex-file-compressed 🚀 31317702 35477836 0.88
tpcds_q84/duckdb:vortex-file-compressed 16975022 17959403 0.95
tpcds_q85/duckdb:vortex-file-compressed 🚀 45277493 50806664 0.89
tpcds_q86/duckdb:vortex-file-compressed 🚀 16600108 19069348 0.87
tpcds_q87/duckdb:vortex-file-compressed 🚀 39835334 44952293 0.89
tpcds_q88/duckdb:vortex-file-compressed 53595615 59391529 0.90
tpcds_q89/duckdb:vortex-file-compressed 24549070 25473515 0.96
tpcds_q90/duckdb:vortex-file-compressed 🚀 10777739 12409226 0.87
tpcds_q91/duckdb:vortex-file-compressed 23196445 25076547 0.93
tpcds_q92/duckdb:vortex-file-compressed 🚀 18085258 20830820 0.87
tpcds_q93/duckdb:vortex-file-compressed 🚀 29992845 33830619 0.89
tpcds_q94/duckdb:vortex-file-compressed 22958141 24949344 0.92
tpcds_q95/duckdb:vortex-file-compressed 161447835 167721313 0.96
tpcds_q96/duckdb:vortex-file-compressed 13478748 14310744 0.94
tpcds_q97/duckdb:vortex-file-compressed 39505962 42755277 0.92
tpcds_q98/duckdb:vortex-file-compressed 🚀 19616276 22110897 0.89
tpcds_q99/duckdb:vortex-file-compressed 🚀 22656050 25304628 0.90
duckdb / vortex-compact (0.932x ➖, 18↑ 0↓)
name PR 1f9bcaa (ns) base 5a764e6 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-compact 🚀 24984450 30145898 0.83
tpcds_q02/duckdb:vortex-compact 🚀 36912778 44533760 0.83
tpcds_q03/duckdb:vortex-compact 46911500 48188154 0.97
tpcds_q04/duckdb:vortex-compact 107075854 113411521 0.94
tpcds_q05/duckdb:vortex-compact 43090675 46851769 0.92
tpcds_q06/duckdb:vortex-compact 38715585 41930974 0.92
tpcds_q07/duckdb:vortex-compact 42832459 44916379 0.95
tpcds_q08/duckdb:vortex-compact 41421124 44015554 0.94
tpcds_q09/duckdb:vortex-compact 20316493 21062782 0.96
tpcds_q10/duckdb:vortex-compact 52167233 57349915 0.91
tpcds_q11/duckdb:vortex-compact 🚀 72941730 82869585 0.88
tpcds_q12/duckdb:vortex-compact 21893812 23884211 0.92
tpcds_q13/duckdb:vortex-compact 52962821 54371719 0.97
tpcds_q14/duckdb:vortex-compact 118585236 125301100 0.95
tpcds_q15/duckdb:vortex-compact 🚀 30202800 34724912 0.87
tpcds_q16/duckdb:vortex-compact 🚀 27377750 30601764 0.89
tpcds_q17/duckdb:vortex-compact 60300083 65723609 0.92
tpcds_q18/duckdb:vortex-compact 🚀 49209513 55287458 0.89
tpcds_q19/duckdb:vortex-compact 45984477 47539720 0.97
tpcds_q20/duckdb:vortex-compact 20912945 22737334 0.92
tpcds_q21/duckdb:vortex-compact 18006320 19288804 0.93
tpcds_q22/duckdb:vortex-compact 🚀 76370717 87419780 0.87
tpcds_q23/duckdb:vortex-compact 🚀 102798804 117620037 0.87
tpcds_q24/duckdb:vortex-compact 59489263 63105729 0.94
tpcds_q25/duckdb:vortex-compact 52522775 56963740 0.92
tpcds_q26/duckdb:vortex-compact 🚀 31285428 35679943 0.88
tpcds_q27/duckdb:vortex-compact 42788526 45205215 0.95
tpcds_q28/duckdb:vortex-compact 35239221 37024273 0.95
tpcds_q29/duckdb:vortex-compact 58847926 62358237 0.94
tpcds_q30/duckdb:vortex-compact 29352980 32174330 0.91
tpcds_q31/duckdb:vortex-compact 36099843 38706045 0.93
tpcds_q32/duckdb:vortex-compact 🚀 21191763 24029348 0.88
tpcds_q33/duckdb:vortex-compact 32908356 36019633 0.91
tpcds_q34/duckdb:vortex-compact 30363998 32814675 0.93
tpcds_q35/duckdb:vortex-compact 76576595 82455191 0.93
tpcds_q36/duckdb:vortex-compact 🚀 36459639 41155293 0.89
tpcds_q37/duckdb:vortex-compact 23663177 25965752 0.91
tpcds_q38/duckdb:vortex-compact 42421506 44622040 0.95
tpcds_q39/duckdb:vortex-compact 39965048 43681128 0.91
tpcds_q40/duckdb:vortex-compact 24825735 27522812 0.90
tpcds_q41/duckdb:vortex-compact 14283935 15643140 0.91
tpcds_q42/duckdb:vortex-compact 20503309 21871882 0.94
tpcds_q43/duckdb:vortex-compact 31781051 33100986 0.96
tpcds_q44/duckdb:vortex-compact 29879787 32862597 0.91
tpcds_q45/duckdb:vortex-compact 🚀 35901120 41933127 0.86
tpcds_q46/duckdb:vortex-compact 46188329 48380638 0.95
tpcds_q47/duckdb:vortex-compact 64123043 67581692 0.95
tpcds_q48/duckdb:vortex-compact 46601685 47081187 0.99
tpcds_q49/duckdb:vortex-compact 53770649 52999362 1.01
tpcds_q50/duckdb:vortex-compact 39344874 39802096 0.99
tpcds_q51/duckdb:vortex-compact 112852505 115255077 0.98
tpcds_q52/duckdb:vortex-compact 20551696 20423583 1.01
tpcds_q53/duckdb:vortex-compact 34148591 35350075 0.97
tpcds_q54/duckdb:vortex-compact 36343013 40378164 0.90
tpcds_q55/duckdb:vortex-compact 19036664 21059538 0.90
tpcds_q56/duckdb:vortex-compact 🚀 33311450 37335308 0.89
tpcds_q57/duckdb:vortex-compact 45014032 47422263 0.95
tpcds_q58/duckdb:vortex-compact 38913216 38414651 1.01
tpcds_q59/duckdb:vortex-compact 67682506 70234366 0.96
tpcds_q60/duckdb:vortex-compact 39006345 40534329 0.96
tpcds_q61/duckdb:vortex-compact 54638683 59800860 0.91
tpcds_q62/duckdb:vortex-compact 🚀 20866971 23213898 0.90
tpcds_q63/duckdb:vortex-compact 33823558 33966463 1.00
tpcds_q64/duckdb:vortex-compact 127129772 138959730 0.91
tpcds_q65/duckdb:vortex-compact 31592230 32759618 0.96
tpcds_q66/duckdb:vortex-compact 35852998 39680495 0.90
tpcds_q67/duckdb:vortex-compact 152955463 160652156 0.95
tpcds_q68/duckdb:vortex-compact 45586060 50520424 0.90
tpcds_q69/duckdb:vortex-compact 56334892 60125577 0.94
tpcds_q70/duckdb:vortex-compact 🚀 55909157 62513563 0.89
tpcds_q71/duckdb:vortex-compact 29206143 32201833 0.91
tpcds_q72/duckdb:vortex-compact 193771290 198895761 0.97
tpcds_q73/duckdb:vortex-compact 28516147 29597645 0.96
tpcds_q74/duckdb:vortex-compact 51451259 50024817 1.03
tpcds_q75/duckdb:vortex-compact 63088345 67020362 0.94
tpcds_q76/duckdb:vortex-compact 31163866 32033453 0.97
tpcds_q77/duckdb:vortex-compact 39082072 40958056 0.95
tpcds_q78/duckdb:vortex-compact 87251888 92776661 0.94
tpcds_q79/duckdb:vortex-compact 42190461 42613647 0.99
tpcds_q80/duckdb:vortex-compact 71109700 74744155 0.95
tpcds_q81/duckdb:vortex-compact 33856620 35443217 0.96
tpcds_q82/duckdb:vortex-compact 51239741 53323081 0.96
tpcds_q83/duckdb:vortex-compact 37111346 38074863 0.97
tpcds_q84/duckdb:vortex-compact 21556250 22124920 0.97
tpcds_q85/duckdb:vortex-compact 58281037 61555162 0.95
tpcds_q86/duckdb:vortex-compact 🚀 20557948 23017776 0.89
tpcds_q87/duckdb:vortex-compact 44582835 48375128 0.92
tpcds_q88/duckdb:vortex-compact 80845758 82048979 0.99
tpcds_q89/duckdb:vortex-compact 34519048 35382074 0.98
tpcds_q90/duckdb:vortex-compact 12074928 12218686 0.99
tpcds_q91/duckdb:vortex-compact 40826260 43661225 0.94
tpcds_q92/duckdb:vortex-compact 42292934 45114030 0.94
tpcds_q93/duckdb:vortex-compact 32587197 35015777 0.93
tpcds_q94/duckdb:vortex-compact 27189799 28878252 0.94
tpcds_q95/duckdb:vortex-compact 🚀 144990510 173049833 0.84
tpcds_q96/duckdb:vortex-compact 16155575 17881605 0.90
tpcds_q97/duckdb:vortex-compact 🚀 43045501 49339440 0.87
tpcds_q98/duckdb:vortex-compact 27779249 30016828 0.93
tpcds_q99/duckdb:vortex-compact 26263887 29013597 0.91
duckdb / parquet (0.956x ➖, 3↑ 0↓)
name PR 1f9bcaa (ns) base 5a764e6 (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 28878917 31251399 0.92
tpcds_q02/duckdb:parquet 24226955 25080948 0.97
tpcds_q03/duckdb:parquet 13184415 13069926 1.01
tpcds_q04/duckdb:parquet 169141909 176211427 0.96
tpcds_q05/duckdb:parquet 31299358 32748047 0.96
tpcds_q06/duckdb:parquet 33300855 34341011 0.97
tpcds_q07/duckdb:parquet 24763188 25240633 0.98
tpcds_q08/duckdb:parquet 29273490 30959768 0.95
tpcds_q09/duckdb:parquet 45029525 46226501 0.97
tpcds_q10/duckdb:parquet 37285136 40412923 0.92
tpcds_q11/duckdb:parquet 🚀 87590682 99116007 0.88
tpcds_q12/duckdb:parquet 17183710 17880398 0.96
tpcds_q13/duckdb:parquet 35064738 36324764 0.97
tpcds_q14/duckdb:parquet 102083312 108054397 0.94
tpcds_q15/duckdb:parquet 31125504 32350798 0.96
tpcds_q16/duckdb:parquet 22676770 23519051 0.96
tpcds_q17/duckdb:parquet 38059822 40902025 0.93
tpcds_q18/duckdb:parquet 47866467 50970359 0.94
tpcds_q19/duckdb:parquet 31753013 33251528 0.95
tpcds_q20/duckdb:parquet 18891663 19975879 0.95
tpcds_q21/duckdb:parquet 11612403 12760851 0.91
tpcds_q22/duckdb:parquet 73320583 78720762 0.93
tpcds_q23/duckdb:parquet 81494616 85326015 0.96
tpcds_q24/duckdb:parquet 46689324 50101806 0.93
tpcds_q25/duckdb:parquet 35994879 38056123 0.95
tpcds_q26/duckdb:parquet 40177734 40789149 0.99
tpcds_q27/duckdb:parquet 53099894 55520753 0.96
tpcds_q28/duckdb:parquet 43780957 43710269 1.00
tpcds_q29/duckdb:parquet 39117490 40174611 0.97
tpcds_q30/duckdb:parquet 38661064 40086290 0.96
tpcds_q31/duckdb:parquet 🚀 27396356 30567829 0.90
tpcds_q32/duckdb:parquet 13519520 13578682 1.00
tpcds_q33/duckdb:parquet 23939989 24621598 0.97
tpcds_q34/duckdb:parquet 22739892 23836592 0.95
tpcds_q35/duckdb:parquet 62869420 66047309 0.95
tpcds_q36/duckdb:parquet 22847650 23277178 0.98
tpcds_q37/duckdb:parquet 14605051 15392590 0.95
tpcds_q38/duckdb:parquet 36531850 38883694 0.94
tpcds_q39/duckdb:parquet 32019586 34024562 0.94
tpcds_q40/duckdb:parquet 20127201 21229692 0.95
tpcds_q41/duckdb:parquet 9192234 9582609 0.96
tpcds_q42/duckdb:parquet 13534461 12701142 1.07
tpcds_q43/duckdb:parquet 18163926 19481370 0.93
tpcds_q44/duckdb:parquet 26458309 27838862 0.95
tpcds_q45/duckdb:parquet 28517957 30967586 0.92
tpcds_q46/duckdb:parquet 48374816 51346301 0.94
tpcds_q47/duckdb:parquet 49845360 52709932 0.95
tpcds_q48/duckdb:parquet 32495867 33542192 0.97
tpcds_q49/duckdb:parquet 28523429 30777810 0.93
tpcds_q50/duckdb:parquet 26028247 27239288 0.96
tpcds_q51/duckdb:parquet 105275844 110765393 0.95
tpcds_q52/duckdb:parquet 13497558 12673101 1.07
tpcds_q53/duckdb:parquet 19056277 19628505 0.97
tpcds_q54/duckdb:parquet 29251512 30444973 0.96
tpcds_q55/duckdb:parquet 13150785 13161545 1.00
tpcds_q56/duckdb:parquet 23697319 24366298 0.97
tpcds_q57/duckdb:parquet 37904397 39798762 0.95
tpcds_q58/duckdb:parquet 26437902 27269624 0.97
tpcds_q59/duckdb:parquet 36376183 37601277 0.97
tpcds_q60/duckdb:parquet 🚀 24616838 27397343 0.90
tpcds_q61/duckdb:parquet 34094956 35603506 0.96
tpcds_q62/duckdb:parquet 12402922 13496181 0.92
tpcds_q63/duckdb:parquet 17815134 18762198 0.95
tpcds_q64/duckdb:parquet 77075639 84817746 0.91
tpcds_q65/duckdb:parquet 24421724 24418406 1.00
tpcds_q66/duckdb:parquet 29881047 31731285 0.94
tpcds_q67/duckdb:parquet 136252743 142690526 0.95
tpcds_q68/duckdb:parquet 39612101 40555598 0.98
tpcds_q69/duckdb:parquet 38462853 40676923 0.95
tpcds_q70/duckdb:parquet 22413612 23507321 0.95
tpcds_q71/duckdb:parquet 23116178 23150157 1.00
tpcds_q72/duckdb:parquet 166776837 170792053 0.98
tpcds_q73/duckdb:parquet 21374526 21606829 0.99
tpcds_q74/duckdb:parquet 127130924 134745226 0.94
tpcds_q75/duckdb:parquet 57141887 60601371 0.94
tpcds_q76/duckdb:parquet 21546044 23828891 0.90
tpcds_q77/duckdb:parquet 25266149 26733626 0.95
tpcds_q78/duckdb:parquet 77825487 82097978 0.95
tpcds_q79/duckdb:parquet 30337721 31311902 0.97
tpcds_q80/duckdb:parquet 43787958 45491410 0.96
tpcds_q81/duckdb:parquet 35879373 36954201 0.97
tpcds_q82/duckdb:parquet 17247336 17546369 0.98
tpcds_q83/duckdb:parquet 18314913 19283440 0.95
tpcds_q84/duckdb:parquet 21552424 21624944 1.00
tpcds_q85/duckdb:parquet 42674558 42679047 1.00
tpcds_q86/duckdb:parquet 15508100 14434781 1.07
tpcds_q87/duckdb:parquet 39544274 42092311 0.94
tpcds_q88/duckdb:parquet 53445909 54967082 0.97
tpcds_q89/duckdb:parquet 20607760 22383694 0.92
tpcds_q90/duckdb:parquet 8514872 8966480 0.95
tpcds_q91/duckdb:parquet 24836707 27215178 0.91
tpcds_q92/duckdb:parquet 13141876 14251641 0.92
tpcds_q93/duckdb:parquet 32690009 34857931 0.94
tpcds_q94/duckdb:parquet 18597355 20181436 0.92
tpcds_q95/duckdb:parquet 145051181 156340278 0.93
tpcds_q96/duckdb:parquet 10850103 11394571 0.95
tpcds_q97/duckdb:parquet 39221329 41134389 0.95
tpcds_q98/duckdb:parquet 24738651 25887030 0.96
tpcds_q99/duckdb:parquet 19900877 20955635 0.95
duckdb / duckdb (0.973x ➖, 7↑ 1↓)
name PR 1f9bcaa (ns) base 5a764e6 (ns) ratio (PR/base)
tpcds_q01/duckdb:duckdb 22704984 23662432 0.96
tpcds_q02/duckdb:duckdb 21613959 20350375 1.06
tpcds_q03/duckdb:duckdb 10447370 11261723 0.93
tpcds_q04/duckdb:duckdb 181912707 187669613 0.97
tpcds_q05/duckdb:duckdb 21324606 22409972 0.95
tpcds_q06/duckdb:duckdb 31098169 30686784 1.01
tpcds_q07/duckdb:duckdb 44001323 42853106 1.03
tpcds_q08/duckdb:duckdb 123030639 122137678 1.01
tpcds_q09/duckdb:duckdb 21095663 21121433 1.00
tpcds_q10/duckdb:duckdb 28865190 29063839 0.99
tpcds_q11/duckdb:duckdb 97698125 96281260 1.01
tpcds_q12/duckdb:duckdb 14492285 14845964 0.98
tpcds_q13/duckdb:duckdb 26460897 27206493 0.97
tpcds_q14/duckdb:duckdb 100734953 99140047 1.02
tpcds_q15/duckdb:duckdb 28227034 26409051 1.07
tpcds_q16/duckdb:duckdb 20208413 21086226 0.96
tpcds_q17/duckdb:duckdb 24989759 25402901 0.98
tpcds_q18/duckdb:duckdb 49533251 49918613 0.99
tpcds_q19/duckdb:duckdb 20234204 20005879 1.01
tpcds_q20/duckdb:duckdb 14922658 15790798 0.95
tpcds_q21/duckdb:duckdb 8363947 8196059 1.02
tpcds_q22/duckdb:duckdb 70636049 70298185 1.00
tpcds_q23/duckdb:duckdb 82614232 82365310 1.00
tpcds_q24/duckdb:duckdb 27050232 29338142 0.92
tpcds_q25/duckdb:duckdb 19656305 20051325 0.98
tpcds_q26/duckdb:duckdb 30340483 30364410 1.00
tpcds_q27/duckdb:duckdb 42891536 43687087 0.98
tpcds_q28/duckdb:duckdb 26332617 26390915 1.00
tpcds_q29/duckdb:duckdb 24368834 24995735 0.97
tpcds_q30/duckdb:duckdb 🚀 31391911 35241867 0.89
tpcds_q31/duckdb:duckdb 54513058 55779591 0.98
tpcds_q32/duckdb:duckdb 8602027 8958022 0.96
tpcds_q33/duckdb:duckdb 16923405 17219865 0.98
tpcds_q34/duckdb:duckdb 🚀 19879630 22190882 0.90
tpcds_q35/duckdb:duckdb 43064154 39857515 1.08
tpcds_q36/duckdb:duckdb 77658943 76621709 1.01
tpcds_q37/duckdb:duckdb 9390252 9531645 0.99
tpcds_q38/duckdb:duckdb 38549571 37069199 1.04
tpcds_q39/duckdb:duckdb 29820676 29632309 1.01
tpcds_q40/duckdb:duckdb 15377417 15961693 0.96
tpcds_q41/duckdb:duckdb 9718513 9876540 0.98
tpcds_q42/duckdb:duckdb 9897796 9310645 1.06
tpcds_q43/duckdb:duckdb 14908899 15411706 0.97
tpcds_q44/duckdb:duckdb 15716340 16238822 0.97
tpcds_q45/duckdb:duckdb 21219338 20275284 1.05
tpcds_q46/duckdb:duckdb 43993596 44333163 0.99
tpcds_q47/duckdb:duckdb 48737222 48750918 1.00
tpcds_q48/duckdb:duckdb 25629621 25969748 0.99
tpcds_q49/duckdb:duckdb 21128409 21989766 0.96
tpcds_q50/duckdb:duckdb 16418324 17051870 0.96
tpcds_q51/duckdb:duckdb 99952390 105883198 0.94
tpcds_q52/duckdb:duckdb 9540860 10147576 0.94
tpcds_q53/duckdb:duckdb 18042400 18996146 0.95
tpcds_q54/duckdb:duckdb 19420613 19807406 0.98
tpcds_q55/duckdb:duckdb 10436300 10574203 0.99
tpcds_q56/duckdb:duckdb 17971722 17579317 1.02
tpcds_q57/duckdb:duckdb 37209221 38527284 0.97
tpcds_q58/duckdb:duckdb 17283641 17877111 0.97
tpcds_q59/duckdb:duckdb 37617633 39518686 0.95
tpcds_q60/duckdb:duckdb 18927610 19880531 0.95
tpcds_q61/duckdb:duckdb 16363621 17754188 0.92
tpcds_q62/duckdb:duckdb 10184863 10734489 0.95
tpcds_q63/duckdb:duckdb 16477710 17515540 0.94
tpcds_q64/duckdb:duckdb 60013964 61230095 0.98
tpcds_q65/duckdb:duckdb 37328341 39681240 0.94
tpcds_q66/duckdb:duckdb 27079653 28560735 0.95
tpcds_q67/duckdb:duckdb 133624850 137759509 0.97
tpcds_q68/duckdb:duckdb 🚀 26385004 32445521 0.81
tpcds_q69/duckdb:duckdb 28666392 29650314 0.97
tpcds_q70/duckdb:duckdb 17864971 17149534 1.04
tpcds_q71/duckdb:duckdb 🚨 18479817 16500884 1.12
tpcds_q72/duckdb:duckdb 48620065 48417568 1.00
tpcds_q73/duckdb:duckdb 14790308 15114320 0.98
tpcds_q74/duckdb:duckdb 148801321 155798949 0.96
tpcds_q75/duckdb:duckdb 47181727 48440253 0.97
tpcds_q76/duckdb:duckdb 15949574 15309752 1.04
tpcds_q77/duckdb:duckdb 16608308 17127788 0.97
tpcds_q78/duckdb:duckdb 68231814 70668185 0.97
tpcds_q79/duckdb:duckdb 🚀 20935765 24397285 0.86
tpcds_q80/duckdb:duckdb 32890589 33955123 0.97
tpcds_q81/duckdb:duckdb 🚀 41268004 46667865 0.88
tpcds_q82/duckdb:duckdb 10470190 10991342 0.95
tpcds_q83/duckdb:duckdb 11312427 12250811 0.92
tpcds_q84/duckdb:duckdb 🚀 15108748 18992150 0.80
tpcds_q85/duckdb:duckdb 26839590 28480195 0.94
tpcds_q86/duckdb:duckdb 12503017 13077169 0.96
tpcds_q87/duckdb:duckdb 🚀 36751483 41463136 0.89
tpcds_q88/duckdb:duckdb 32072323 32107131 1.00
tpcds_q89/duckdb:duckdb 23688973 22964806 1.03
tpcds_q90/duckdb:duckdb 6869315 6885949 1.00
tpcds_q91/duckdb:duckdb 15033894 15707917 0.96
tpcds_q92/duckdb:duckdb 10135214 10733853 0.94
tpcds_q93/duckdb:duckdb 24657648 25284367 0.98
tpcds_q94/duckdb:duckdb 14952242 15606974 0.96
tpcds_q95/duckdb:duckdb 134393632 136900903 0.98
tpcds_q96/duckdb:duckdb 5971038 6603044 0.90
tpcds_q97/duckdb:duckdb 32693656 34426566 0.95
tpcds_q98/duckdb:duckdb 21693606 21662356 1.00
tpcds_q99/duckdb:duckdb 17337549 17765679 0.98
File Size Changes (6 files changed, -0.0% overall, 1↑ 5↓)
File Scale Format Base HEAD Change %
item.vortex 1.0 vortex-compact 993.65 KB 994.02 KB +376 B +0.0%
item.vortex 1.0 vortex-file-compressed 1.64 MB 1.64 MB 256 B -0.0%
customer.vortex 1.0 vortex-file-compressed 4.27 MB 4.26 MB 2.38 KB -0.1%
customer_address.vortex 1.0 vortex-file-compressed 827.32 KB 826.77 KB 568 B -0.1%
catalog_page.vortex 1.0 vortex-file-compressed 566.05 KB 565.23 KB 832 B -0.1%
time_dim.vortex 1.0 vortex-file-compressed 438.13 KB 379.69 KB 58.45 KB -13.3%

Totals:

  • vortex-compact: 207.47 MB → 207.47 MB (+0.0%)
  • vortex-file-compressed: 270.05 MB → 269.99 MB (-0.0%)

@github-actions

github-actions Bot commented Jun 22, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb S3

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -3.8%
Engines: DataFusion No clear signal (-15.7%, environment too noisy confidence) · DuckDB No clear signal (+9.8%, environment too noisy confidence)
Vortex (geomean): 1.024x ➖
Parquet (geomean): 1.064x ➖
Shifts: Parquet (control) +6.4% · Median polish +5.7%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.837x ➖, 1↑ 0↓)
name PR 1f9bcaa (ns) base 5a764e6 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚀 32958762 82168646 0.40
fineweb_q01/datafusion:vortex-file-compressed 727635655 789000753 0.92
fineweb_q02/datafusion:vortex-file-compressed 489581873 557061298 0.88
fineweb_q03/datafusion:vortex-file-compressed 1138450392 1180462463 0.96
fineweb_q04/datafusion:vortex-file-compressed 1198942346 1378440894 0.87
fineweb_q05/datafusion:vortex-file-compressed 1119237352 1195063655 0.94
fineweb_q06/datafusion:vortex-file-compressed 1263454043 1538070249 0.82
fineweb_q07/datafusion:vortex-file-compressed 1129888712 1266657262 0.89
fineweb_q08/datafusion:vortex-file-compressed 535813232 498039303 1.08
datafusion / vortex-compact (0.987x ➖, 1↑ 1↓)
name PR 1f9bcaa (ns) base 5a764e6 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 🚀 38539947 68723793 0.56
fineweb_q01/datafusion:vortex-compact 🚨 945687961 724945067 1.30
fineweb_q02/datafusion:vortex-compact 707800613 705875451 1.00
fineweb_q03/datafusion:vortex-compact 1446902264 1339543512 1.08
fineweb_q04/datafusion:vortex-compact 1727096292 1654150050 1.04
fineweb_q05/datafusion:vortex-compact 1425945681 1336956905 1.07
fineweb_q06/datafusion:vortex-compact 1307934201 1293140147 1.01
fineweb_q07/datafusion:vortex-compact 1212394203 1174145499 1.03
fineweb_q08/datafusion:vortex-compact 407453459 422101708 0.97
datafusion / parquet (1.078x ➖, 0↑ 0↓)
name PR 1f9bcaa (ns) base 5a764e6 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 1341841351 1281179386 1.05
fineweb_q01/datafusion:parquet 2161469032 1971763366 1.10
fineweb_q02/datafusion:parquet 2214401536 1924599597 1.15
fineweb_q03/datafusion:parquet 2025028460 1848147498 1.10
fineweb_q04/datafusion:parquet 2049873451 2299786888 0.89
fineweb_q05/datafusion:parquet 2077710152 1937872448 1.07
fineweb_q06/datafusion:parquet 2359289919 2033354667 1.16
fineweb_q07/datafusion:parquet 2147533901 2036137484 1.05
fineweb_q08/datafusion:parquet 2390760402 2065949014 1.16
duckdb / vortex-file-compressed (1.120x ➖, 0↑ 1↓)
name PR 1f9bcaa (ns) base 5a764e6 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 🚨 120523179 81210680 1.48
fineweb_q01/duckdb:vortex-file-compressed 582136363 565353562 1.03
fineweb_q02/duckdb:vortex-file-compressed 500223461 561041819 0.89
fineweb_q03/duckdb:vortex-file-compressed 1451967659 1280417248 1.13
fineweb_q04/duckdb:vortex-file-compressed 1659315545 1443913246 1.15
fineweb_q05/duckdb:vortex-file-compressed 1459373910 1277660302 1.14
fineweb_q06/duckdb:vortex-file-compressed 1626028402 1460402734 1.11
fineweb_q07/duckdb:vortex-file-compressed 1397083294 1381570095 1.01
fineweb_q08/duckdb:vortex-file-compressed 660539185 545902777 1.21
duckdb / vortex-compact (1.189x ➖, 0↑ 1↓)
name PR 1f9bcaa (ns) base 5a764e6 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 89228586 69245687 1.29
fineweb_q01/duckdb:vortex-compact 745216662 678125710 1.10
fineweb_q02/duckdb:vortex-compact 704990463 587620648 1.20
fineweb_q03/duckdb:vortex-compact 1811686425 1692840160 1.07
fineweb_q04/duckdb:vortex-compact 2067463137 1817640829 1.14
fineweb_q05/duckdb:vortex-compact 1819726791 1578015147 1.15
fineweb_q06/duckdb:vortex-compact 1782945556 1643764254 1.08
fineweb_q07/duckdb:vortex-compact 1725688700 1426386395 1.21
fineweb_q08/duckdb:vortex-compact 🚨 719917291 475682681 1.51
duckdb / parquet (1.050x ➖, 0↑ 0↓)
name PR 1f9bcaa (ns) base 5a764e6 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1229152720 1094536747 1.12
fineweb_q01/duckdb:parquet 1483068021 1482300944 1.00
fineweb_q02/duckdb:parquet 1535515991 1539464767 1.00
fineweb_q03/duckdb:parquet 3902035827 3836154478 1.02
fineweb_q04/duckdb:parquet 2120384409 1957168228 1.08
fineweb_q05/duckdb:parquet 2244480597 2327382979 0.96
fineweb_q06/duckdb:parquet 4826384589 4354280688 1.11
fineweb_q07/duckdb:parquet 2959927421 2715836479 1.09
fineweb_q08/duckdb:parquet 1182803751 1092642802 1.08

@github-actions

github-actions Bot commented Jun 22, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: Statistical and Population Genetics

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.6%
Engines: DuckDB No clear signal (+0.6%, low confidence)
Vortex (geomean): 1.002x ➖
Parquet (geomean): 0.996x ➖
Shifts: Parquet (control) -0.4% · Median polish -0.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
duckdb / vortex-file-compressed (1.008x ➖, 0↑ 0↓)
name PR 1f9bcaa (ns) base 5a764e6 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 11893873 11531494 1.03
statpopgen_q01/duckdb:vortex-file-compressed 26700213 28299256 0.94
statpopgen_q02/duckdb:vortex-file-compressed 510162126 510282506 1.00
statpopgen_q03/duckdb:vortex-file-compressed 1050830169 1047235725 1.00
statpopgen_q04/duckdb:vortex-file-compressed 1066072441 1035476108 1.03
statpopgen_q05/duckdb:vortex-file-compressed 467733938 467666305 1.00
statpopgen_q06/duckdb:vortex-file-compressed 1534009930 1517390350 1.01
statpopgen_q07/duckdb:vortex-file-compressed 199354557 187194329 1.06
statpopgen_q08/duckdb:vortex-file-compressed 232327732 228546913 1.02
statpopgen_q09/duckdb:vortex-file-compressed 820131829 821023097 1.00
statpopgen_q10/duckdb:vortex-file-compressed 2532934291 2546043848 0.99
duckdb / vortex-compact (0.997x ➖, 0↑ 0↓)
name PR 1f9bcaa (ns) base 5a764e6 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact 11584741 11575323 1.00
statpopgen_q01/duckdb:vortex-compact 213719101 212032357 1.01
statpopgen_q02/duckdb:vortex-compact 560131043 569813790 0.98
statpopgen_q03/duckdb:vortex-compact 1160907897 1139096171 1.02
statpopgen_q04/duckdb:vortex-compact 1135294011 1167627201 0.97
statpopgen_q05/duckdb:vortex-compact 564626724 569888853 0.99
statpopgen_q06/duckdb:vortex-compact 1518917505 1514066058 1.00
statpopgen_q07/duckdb:vortex-compact 899007060 897458019 1.00
statpopgen_q08/duckdb:vortex-compact 924266151 929385208 0.99
statpopgen_q09/duckdb:vortex-compact 908719395 923188730 0.98
statpopgen_q10/duckdb:vortex-compact 2591102326 2578040437 1.01
duckdb / parquet (0.996x ➖, 0↑ 0↓)
name PR 1f9bcaa (ns) base 5a764e6 (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 293381844 303009510 0.97
statpopgen_q01/duckdb:parquet 391656209 379725945 1.03
statpopgen_q02/duckdb:parquet 760814378 764971052 0.99
statpopgen_q03/duckdb:parquet 1177217149 1176698143 1.00
statpopgen_q04/duckdb:parquet 1181536474 1181947597 1.00
statpopgen_q05/duckdb:parquet 807207795 811320688 0.99
statpopgen_q06/duckdb:parquet 1409938545 1427261727 0.99
statpopgen_q07/duckdb:parquet 849655332 849046790 1.00
statpopgen_q08/duckdb:parquet 851870929 854546566 1.00
statpopgen_q09/duckdb:parquet 999155982 1011336596 0.99
statpopgen_q10/duckdb:parquet 2192620459 2193692766 1.00
File Size Changes (1 files changed, +0.0% overall, 1↑ 0↓)
File Scale Format Base HEAD Change %
gnomad.genomes.v3.1.2.hgdp_tgp.chr21.vortex 100000 vortex-file-compressed 1.96 GB 1.96 GB +272.42 KB +0.0%

Totals:

  • vortex-compact: 959.59 MB → 959.59 MB (0.0%)
  • vortex-file-compressed: 1.96 GB → 1.96 GB (+0.0%)

@github-actions

github-actions Bot commented Jun 22, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.4%
Engines: DataFusion No clear signal (+0.4%, low confidence) · DuckDB No clear signal (+0.5%, low confidence)
Vortex (geomean): 1.000x ➖
Parquet (geomean): 0.995x ➖
Shifts: Parquet (control) -0.5% · Median polish -0.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.000x ➖, 0↑ 0↓)
name PR 1f9bcaa (ns) base 5a764e6 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 460406624 471386153 0.98
tpch_q02/datafusion:vortex-file-compressed 104472013 105727583 0.99
tpch_q03/datafusion:vortex-file-compressed 197355259 197729813 1.00
tpch_q04/datafusion:vortex-file-compressed 98711284 96614807 1.02
tpch_q05/datafusion:vortex-file-compressed 339505605 342135275 0.99
tpch_q06/datafusion:vortex-file-compressed 36188058 36434651 0.99
tpch_q07/datafusion:vortex-file-compressed 454288456 461346811 0.98
tpch_q08/datafusion:vortex-file-compressed 340454226 346417872 0.98
tpch_q09/datafusion:vortex-file-compressed 595566152 593947400 1.00
tpch_q10/datafusion:vortex-file-compressed 227585533 228909932 0.99
tpch_q11/datafusion:vortex-file-compressed 80504547 76612695 1.05
tpch_q12/datafusion:vortex-file-compressed 110488455 109667914 1.01
tpch_q13/datafusion:vortex-file-compressed 200207201 198588182 1.01
tpch_q14/datafusion:vortex-file-compressed 48337620 49199503 0.98
tpch_q15/datafusion:vortex-file-compressed 95491089 95688790 1.00
tpch_q16/datafusion:vortex-file-compressed 76812183 74442723 1.03
tpch_q17/datafusion:vortex-file-compressed 575548150 582150859 0.99
tpch_q18/datafusion:vortex-file-compressed 835379491 839770782 0.99
tpch_q19/datafusion:vortex-file-compressed 231207807 226874221 1.02
tpch_q20/datafusion:vortex-file-compressed 157850043 157692487 1.00
tpch_q21/datafusion:vortex-file-compressed 609927371 603384387 1.01
tpch_q22/datafusion:vortex-file-compressed 55448676 56953348 0.97
datafusion / vortex-compact (0.999x ➖, 0↑ 0↓)
name PR 1f9bcaa (ns) base 5a764e6 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 487901153 501016364 0.97
tpch_q02/datafusion:vortex-compact 109406149 107673310 1.02
tpch_q03/datafusion:vortex-compact 202065418 199113361 1.01
tpch_q04/datafusion:vortex-compact 109013165 112541816 0.97
tpch_q05/datafusion:vortex-compact 344718089 344611432 1.00
tpch_q06/datafusion:vortex-compact 59795245 59663219 1.00
tpch_q07/datafusion:vortex-compact 484945571 474569220 1.02
tpch_q08/datafusion:vortex-compact 348741374 348733272 1.00
tpch_q09/datafusion:vortex-compact 589009049 597395570 0.99
tpch_q10/datafusion:vortex-compact 241906962 241990703 1.00
tpch_q11/datafusion:vortex-compact 79818084 79375170 1.01
tpch_q12/datafusion:vortex-compact 152949861 153381567 1.00
tpch_q13/datafusion:vortex-compact 239454465 245677278 0.97
tpch_q14/datafusion:vortex-compact 65287788 66296052 0.98
tpch_q15/datafusion:vortex-compact 150008582 151312025 0.99
tpch_q16/datafusion:vortex-compact 81876216 79168615 1.03
tpch_q17/datafusion:vortex-compact 580529520 590503396 0.98
tpch_q18/datafusion:vortex-compact 822356091 834709023 0.99
tpch_q19/datafusion:vortex-compact 327671718 323981965 1.01
tpch_q20/datafusion:vortex-compact 179311044 181893978 0.99
tpch_q21/datafusion:vortex-compact 626807445 630476718 0.99
tpch_q22/datafusion:vortex-compact 66275648 63402629 1.05
datafusion / parquet (0.994x ➖, 0↑ 0↓)
name PR 1f9bcaa (ns) base 5a764e6 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 484133219 484117543 1.00
tpch_q02/datafusion:parquet 174959482 175291318 1.00
tpch_q03/datafusion:parquet 261735616 263366783 0.99
tpch_q04/datafusion:parquet 119174093 122740885 0.97
tpch_q05/datafusion:parquet 397033486 397172147 1.00
tpch_q06/datafusion:parquet 131605704 132267101 0.99
tpch_q07/datafusion:parquet 564383651 572337489 0.99
tpch_q08/datafusion:parquet 447706283 447415056 1.00
tpch_q09/datafusion:parquet 728792844 741330793 0.98
tpch_q10/datafusion:parquet 588527640 581713949 1.01
tpch_q11/datafusion:parquet 119785913 121321386 0.99
tpch_q12/datafusion:parquet 213953920 209952297 1.02
tpch_q13/datafusion:parquet 348331898 353080686 0.99
tpch_q14/datafusion:parquet 154722069 153308599 1.01
tpch_q15/datafusion:parquet 260946192 269708601 0.97
tpch_q16/datafusion:parquet 120565306 123992926 0.97
tpch_q17/datafusion:parquet 673344545 674302134 1.00
tpch_q18/datafusion:parquet 870754692 872926547 1.00
tpch_q19/datafusion:parquet 280358936 284535589 0.99
tpch_q20/datafusion:parquet 302079598 295163263 1.02
tpch_q21/datafusion:parquet 643574718 653132568 0.99
tpch_q22/datafusion:parquet 207204167 206064029 1.01
datafusion / arrow (0.996x ➖, 0↑ 0↓)
name PR 1f9bcaa (ns) base 5a764e6 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 721867582 706667643 1.02
tpch_q02/datafusion:arrow 117880419 114072242 1.03
tpch_q03/datafusion:arrow 512750865 503759063 1.02
tpch_q04/datafusion:arrow 373460144 363557455 1.03
tpch_q05/datafusion:arrow 751330907 747994615 1.00
tpch_q06/datafusion:arrow 329067501 328141790 1.00
tpch_q07/datafusion:arrow 1136018331 1148648663 0.99
tpch_q08/datafusion:arrow 928085169 944592198 0.98
tpch_q09/datafusion:arrow 1077826654 1101076765 0.98
tpch_q10/datafusion:arrow 627423784 650417139 0.96
tpch_q11/datafusion:arrow 91781928 93666162 0.98
tpch_q12/datafusion:arrow 1317444335 1281629295 1.03
tpch_q13/datafusion:arrow 476379006 484123743 0.98
tpch_q14/datafusion:arrow 362059108 372625127 0.97
tpch_q15/datafusion:arrow 750926702 759320852 0.99
tpch_q16/datafusion:arrow 81420559 83205523 0.98
tpch_q17/datafusion:arrow 966326125 965543930 1.00
tpch_q18/datafusion:arrow 1843787369 1850644704 1.00
tpch_q19/datafusion:arrow 545696246 544784446 1.00
tpch_q20/datafusion:arrow 506390955 510035707 0.99
tpch_q21/datafusion:arrow 3084182024 3153463953 0.98
tpch_q22/datafusion:arrow 81371172 81951678 0.99
duckdb / vortex-file-compressed (1.004x ➖, 0↑ 0↓)
name PR 1f9bcaa (ns) base 5a764e6 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 169235613 168946184 1.00
tpch_q02/duckdb:vortex-file-compressed 54384473 54706456 0.99
tpch_q03/duckdb:vortex-file-compressed 122687324 124285490 0.99
tpch_q04/duckdb:vortex-file-compressed 156805158 158516177 0.99
tpch_q05/duckdb:vortex-file-compressed 146638459 139094796 1.05
tpch_q06/duckdb:vortex-file-compressed 32385384 32366897 1.00
tpch_q07/duckdb:vortex-file-compressed 136052196 138426512 0.98
tpch_q08/duckdb:vortex-file-compressed 173840172 174628079 1.00
tpch_q09/duckdb:vortex-file-compressed 399445002 398983367 1.00
tpch_q10/duckdb:vortex-file-compressed 197493767 200281669 0.99
tpch_q11/duckdb:vortex-file-compressed 32802871 32943735 1.00
tpch_q12/duckdb:vortex-file-compressed 105144575 105901819 0.99
tpch_q13/duckdb:vortex-file-compressed 271341064 272903065 0.99
tpch_q14/duckdb:vortex-file-compressed 55671586 53152726 1.05
tpch_q15/duckdb:vortex-file-compressed 92042490 88496404 1.04
tpch_q16/duckdb:vortex-file-compressed 78547735 77968272 1.01
tpch_q17/duckdb:vortex-file-compressed 92710504 92621064 1.00
tpch_q18/duckdb:vortex-file-compressed 289694242 295481879 0.98
tpch_q19/duckdb:vortex-file-compressed 79483659 78878943 1.01
tpch_q20/duckdb:vortex-file-compressed 146165730 140284241 1.04
tpch_q21/duckdb:vortex-file-compressed 496682853 495746837 1.00
tpch_q22/duckdb:vortex-file-compressed 63906662 64614388 0.99
duckdb / vortex-compact (0.998x ➖, 0↑ 0↓)
name PR 1f9bcaa (ns) base 5a764e6 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 231344057 229614701 1.01
tpch_q02/duckdb:vortex-compact 62890176 60519396 1.04
tpch_q03/duckdb:vortex-compact 136907857 138945586 0.99
tpch_q04/duckdb:vortex-compact 170837996 172731482 0.99
tpch_q05/duckdb:vortex-compact 163081372 164605944 0.99
tpch_q06/duckdb:vortex-compact 54497576 54025556 1.01
tpch_q07/duckdb:vortex-compact 175312598 173595166 1.01
tpch_q08/duckdb:vortex-compact 200753619 197882525 1.01
tpch_q09/duckdb:vortex-compact 422969333 427922729 0.99
tpch_q10/duckdb:vortex-compact 228777745 223939387 1.02
tpch_q11/duckdb:vortex-compact 38599393 39641366 0.97
tpch_q12/duckdb:vortex-compact 165983789 164940573 1.01
tpch_q13/duckdb:vortex-compact 320410035 324425784 0.99
tpch_q14/duckdb:vortex-compact 72540663 72422286 1.00
tpch_q15/duckdb:vortex-compact 112941582 114487373 0.99
tpch_q16/duckdb:vortex-compact 81292910 81158029 1.00
tpch_q17/duckdb:vortex-compact 104743704 108441648 0.97
tpch_q18/duckdb:vortex-compact 304596191 293216356 1.04
tpch_q19/duckdb:vortex-compact 96012577 96615402 0.99
tpch_q20/duckdb:vortex-compact 174298989 176920548 0.99
tpch_q21/duckdb:vortex-compact 525865601 532110294 0.99
tpch_q22/duckdb:vortex-compact 70936184 72334059 0.98
duckdb / parquet (0.996x ➖, 0↑ 0↓)
name PR 1f9bcaa (ns) base 5a764e6 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 262500372 261407028 1.00
tpch_q02/duckdb:parquet 97194318 102101598 0.95
tpch_q03/duckdb:parquet 210802763 206754761 1.02
tpch_q04/duckdb:parquet 136007309 135697104 1.00
tpch_q05/duckdb:parquet 223370009 228692734 0.98
tpch_q06/duckdb:parquet 75293457 73390161 1.03
tpch_q07/duckdb:parquet 189298498 187313854 1.01
tpch_q08/duckdb:parquet 268495360 264265756 1.02
tpch_q09/duckdb:parquet 477803664 483794561 0.99
tpch_q10/duckdb:parquet 622137535 625391942 0.99
tpch_q11/duckdb:parquet 64722995 64477622 1.00
tpch_q12/duckdb:parquet 129826789 133827716 0.97
tpch_q13/duckdb:parquet 438590653 435277457 1.01
tpch_q14/duckdb:parquet 177644579 182489009 0.97
tpch_q15/duckdb:parquet 104150497 105392865 0.99
tpch_q16/duckdb:parquet 167563341 162565609 1.03
tpch_q17/duckdb:parquet 181184886 183149673 0.99
tpch_q18/duckdb:parquet 368647706 361472053 1.02
tpch_q19/duckdb:parquet 286370291 289412951 0.99
tpch_q20/duckdb:parquet 224332326 229168520 0.98
tpch_q21/duckdb:parquet 556053152 571001020 0.97
tpch_q22/duckdb:parquet 297279175 295107514 1.01
duckdb / duckdb (1.000x ➖, 0↑ 0↓)
name PR 1f9bcaa (ns) base 5a764e6 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 119353939 119858159 1.00
tpch_q02/duckdb:duckdb 51834757 49165812 1.05
tpch_q03/duckdb:duckdb 103363226 103963633 0.99
tpch_q04/duckdb:duckdb 138149828 139461904 0.99
tpch_q05/duckdb:duckdb 119368447 119985548 0.99
tpch_q06/duckdb:duckdb 44694364 44917036 1.00
tpch_q07/duckdb:duckdb 90772533 91445136 0.99
tpch_q08/duckdb:duckdb 118030739 119029339 0.99
tpch_q09/duckdb:duckdb 279482235 280194344 1.00
tpch_q10/duckdb:duckdb 209521543 216536284 0.97
tpch_q11/duckdb:duckdb 19129246 19063838 1.00
tpch_q12/duckdb:duckdb 90821862 89824618 1.01
tpch_q13/duckdb:duckdb 230762755 233399106 0.99
tpch_q14/duckdb:duckdb 77968022 77674305 1.00
tpch_q15/duckdb:duckdb 81407603 81709539 1.00
tpch_q16/duckdb:duckdb 76820867 76371321 1.01
tpch_q17/duckdb:duckdb 87097467 88481540 0.98
tpch_q18/duckdb:duckdb 237642103 236576046 1.00
tpch_q19/duckdb:duckdb 123417633 124690564 0.99
tpch_q20/duckdb:duckdb 118055501 117610962 1.00
tpch_q21/duckdb:duckdb 314110490 301617205 1.04
tpch_q22/duckdb:duckdb 70407597 69989026 1.01
File Size Changes (27 files changed, +0.0% overall, 16↑ 11↓)
File Scale Format Base HEAD Change %
part_1.vortex 10.0 vortex-compact 16.72 MB 16.90 MB +183.68 KB +1.1%
partsupp_1.vortex 10.0 vortex-compact 104.78 MB 105.63 MB +871.95 KB +0.8%
partsupp_0.vortex 10.0 vortex-compact 104.59 MB 105.34 MB +765.88 KB +0.7%
lineitem_6.vortex 10.0 vortex-file-compressed 129.20 MB 129.49 MB +295.82 KB +0.2%
part_0.vortex 10.0 vortex-file-compressed 24.71 MB 24.75 MB +41.08 KB +0.2%
part_1.vortex 10.0 vortex-file-compressed 24.72 MB 24.75 MB +22.54 KB +0.1%
lineitem_2.vortex 10.0 vortex-file-compressed 129.25 MB 129.35 MB +95.93 KB +0.1%
lineitem_9.vortex 10.0 vortex-file-compressed 129.18 MB 129.25 MB +79.24 KB +0.1%
lineitem_10.vortex 10.0 vortex-file-compressed 129.56 MB 129.63 MB +78.33 KB +0.1%
supplier_0.vortex 10.0 vortex-file-compressed 5.79 MB 5.79 MB +2.79 KB +0.0%
customer_0.vortex 10.0 vortex-file-compressed 88.50 MB 88.54 MB +40.73 KB +0.0%
customer_0.vortex 10.0 vortex-compact 74.09 MB 74.12 MB +25.20 KB +0.0%
partsupp_1.vortex 10.0 vortex-file-compressed 119.77 MB 119.81 MB +39.37 KB +0.0%
lineitem_0.vortex 10.0 vortex-file-compressed 129.37 MB 129.41 MB +41.51 KB +0.0%
lineitem_8.vortex 10.0 vortex-file-compressed 129.19 MB 129.22 MB +21.92 KB +0.0%
lineitem_11.vortex 10.0 vortex-file-compressed 129.08 MB 129.09 MB +9.53 KB +0.0%
lineitem_12.vortex 10.0 vortex-file-compressed 129.57 MB 129.57 MB 1.20 KB -0.0%
lineitem_5.vortex 10.0 vortex-file-compressed 129.73 MB 129.73 MB 2.99 KB -0.0%
orders_1.vortex 10.0 vortex-file-compressed 134.54 MB 134.54 MB 7.63 KB -0.0%
lineitem_7.vortex 10.0 vortex-file-compressed 129.28 MB 129.26 MB 21.21 KB -0.0%
lineitem_4.vortex 10.0 vortex-file-compressed 129.42 MB 129.40 MB 24.88 KB -0.0%
partsupp_0.vortex 10.0 vortex-file-compressed 119.75 MB 119.72 MB 28.64 KB -0.0%
lineitem_1.vortex 10.0 vortex-file-compressed 129.32 MB 129.25 MB 66.35 KB -0.1%
orders_2.vortex 10.0 vortex-file-compressed 134.45 MB 134.31 MB 149.09 KB -0.1%
part_0.vortex 10.0 vortex-compact 16.93 MB 16.91 MB 20.49 KB -0.1%
lineitem_3.vortex 10.0 vortex-file-compressed 129.32 MB 129.15 MB 171.72 KB -0.1%
orders_0.vortex 10.0 vortex-file-compressed 133.29 MB 132.83 MB 466.62 KB -0.3%

Totals:

  • vortex-compact: 1.93 GB → 1.93 GB (+0.1%)
  • vortex-file-compressed: 2.41 GB → 2.41 GB (-0.0%)

@github-actions

github-actions Bot commented Jun 22, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +10.8%
Engines: DataFusion No clear signal (+31.3%, environment too noisy confidence) · DuckDB No clear signal (-6.5%, environment too noisy confidence)
Vortex (geomean): 1.100x ➖
Parquet (geomean): 0.993x ➖
Shifts: Parquet (control) -0.7% · Median polish +7.4%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.189x ➖, 0↑ 4↓)
name PR 1f9bcaa (ns) base 5a764e6 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 🚨 500739408 286235366 1.75
tpch_q02/datafusion:vortex-file-compressed 🚨 1181766064 491498608 2.40
tpch_q03/datafusion:vortex-file-compressed 486095118 454708754 1.07
tpch_q04/datafusion:vortex-file-compressed 265406764 281257239 0.94
tpch_q05/datafusion:vortex-file-compressed 513919238 546730498 0.94
tpch_q06/datafusion:vortex-file-compressed 404699437 386013682 1.05
tpch_q07/datafusion:vortex-file-compressed 526337678 596234290 0.88
tpch_q08/datafusion:vortex-file-compressed 644993425 542533555 1.19
tpch_q09/datafusion:vortex-file-compressed 496005560 413134332 1.20
tpch_q10/datafusion:vortex-file-compressed 426611274 469562553 0.91
tpch_q11/datafusion:vortex-file-compressed 337687688 330264368 1.02
tpch_q12/datafusion:vortex-file-compressed 451176527 413307729 1.09
tpch_q13/datafusion:vortex-file-compressed 198151291 183939651 1.08
tpch_q14/datafusion:vortex-file-compressed 288833589 269376976 1.07
tpch_q15/datafusion:vortex-file-compressed 617685515 523771787 1.18
tpch_q16/datafusion:vortex-file-compressed 🚨 656731469 204924466 3.20
tpch_q17/datafusion:vortex-file-compressed 🚨 820513315 506384955 1.62
tpch_q18/datafusion:vortex-file-compressed 541090858 488068560 1.11
tpch_q19/datafusion:vortex-file-compressed 897057220 721942825 1.24
tpch_q20/datafusion:vortex-file-compressed 500423598 505378084 0.99
tpch_q21/datafusion:vortex-file-compressed 597650840 607186362 0.98
tpch_q22/datafusion:vortex-file-compressed 223415306 251233161 0.89
datafusion / vortex-compact (1.143x ➖, 0↑ 6↓)
name PR 1f9bcaa (ns) base 5a764e6 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 🚨 392824230 273855315 1.43
tpch_q02/datafusion:vortex-compact 🚨 646716567 475489096 1.36
tpch_q03/datafusion:vortex-compact 🚨 772475630 481818280 1.60
tpch_q04/datafusion:vortex-compact 256230821 229548407 1.12
tpch_q05/datafusion:vortex-compact 🚨 503086808 380915354 1.32
tpch_q06/datafusion:vortex-compact 386461490 373697516 1.03
tpch_q07/datafusion:vortex-compact 684474850 538973683 1.27
tpch_q08/datafusion:vortex-compact 1018263492 806080025 1.26
tpch_q09/datafusion:vortex-compact 633494178 560448945 1.13
tpch_q10/datafusion:vortex-compact 624582271 647332308 0.96
tpch_q11/datafusion:vortex-compact 408721093 487788820 0.84
tpch_q12/datafusion:vortex-compact 364473142 439501395 0.83
tpch_q13/datafusion:vortex-compact 202669390 196262878 1.03
tpch_q14/datafusion:vortex-compact 317730539 255476307 1.24
tpch_q15/datafusion:vortex-compact 447143308 444340966 1.01
tpch_q16/datafusion:vortex-compact 228925722 187858951 1.22
tpch_q17/datafusion:vortex-compact 448838362 461509529 0.97
tpch_q18/datafusion:vortex-compact 🚨 375911489 277710136 1.35
tpch_q19/datafusion:vortex-compact 610945626 648088395 0.94
tpch_q20/datafusion:vortex-compact 588389959 470420617 1.25
tpch_q21/datafusion:vortex-compact 613212113 637284294 0.96
tpch_q22/datafusion:vortex-compact 🚨 251526638 181740883 1.38
datafusion / parquet (0.888x ➖, 6↑ 3↓)
name PR 1f9bcaa (ns) base 5a764e6 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 253655009 229917187 1.10
tpch_q02/datafusion:parquet 491868488 418213912 1.18
tpch_q03/datafusion:parquet 367004492 438493405 0.84
tpch_q04/datafusion:parquet 175663587 241626047 0.73
tpch_q05/datafusion:parquet 🚨 832576851 543541821 1.53
tpch_q06/datafusion:parquet 🚨 306102009 156686298 1.95
tpch_q07/datafusion:parquet 🚨 832226651 486121879 1.71
tpch_q08/datafusion:parquet 708106854 569997415 1.24
tpch_q09/datafusion:parquet 523806332 458091135 1.14
tpch_q10/datafusion:parquet 528842688 636209134 0.83
tpch_q11/datafusion:parquet 405707599 447312294 0.91
tpch_q12/datafusion:parquet 🚀 278810566 413776489 0.67
tpch_q13/datafusion:parquet 🚀 434503008 659120244 0.66
tpch_q14/datafusion:parquet 🚀 198555715 416797357 0.48
tpch_q15/datafusion:parquet 🚀 348866975 858579361 0.41
tpch_q16/datafusion:parquet 🚀 212211701 353051756 0.60
tpch_q17/datafusion:parquet 🚀 466986617 728003096 0.64
tpch_q18/datafusion:parquet 516456656 617481840 0.84
tpch_q19/datafusion:parquet 361604352 427425507 0.85
tpch_q20/datafusion:parquet 338094875 428593542 0.79
tpch_q21/datafusion:parquet 627474140 622651827 1.01
tpch_q22/datafusion:parquet 198766302 218497960 0.91
duckdb / vortex-file-compressed (1.071x ➖, 0↑ 1↓)
name PR 1f9bcaa (ns) base 5a764e6 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 🚨 413876533 290915290 1.42
tpch_q02/duckdb:vortex-file-compressed 1135415669 908558638 1.25
tpch_q03/duckdb:vortex-file-compressed 622522679 638930001 0.97
tpch_q04/duckdb:vortex-file-compressed 544574336 434343127 1.25
tpch_q05/duckdb:vortex-file-compressed 909418460 844258008 1.08
tpch_q06/duckdb:vortex-file-compressed 415898819 380503930 1.09
tpch_q07/duckdb:vortex-file-compressed 951102764 915217865 1.04
tpch_q08/duckdb:vortex-file-compressed 1146537599 1215544235 0.94
tpch_q09/duckdb:vortex-file-compressed 1015924583 961146945 1.06
tpch_q10/duckdb:vortex-file-compressed 724499415 717235800 1.01
tpch_q11/duckdb:vortex-file-compressed 546519490 505432980 1.08
tpch_q12/duckdb:vortex-file-compressed 683184482 690239081 0.99
tpch_q13/duckdb:vortex-file-compressed 379547800 375647244 1.01
tpch_q14/duckdb:vortex-file-compressed 409792802 337491008 1.21
tpch_q15/duckdb:vortex-file-compressed 306448032 363458503 0.84
tpch_q16/duckdb:vortex-file-compressed 383404417 389656445 0.98
tpch_q17/duckdb:vortex-file-compressed 749698519 743721906 1.01
tpch_q18/duckdb:vortex-file-compressed 629090063 604688784 1.04
tpch_q19/duckdb:vortex-file-compressed 496998019 437026805 1.14
tpch_q20/duckdb:vortex-file-compressed 940366030 862607328 1.09
tpch_q21/duckdb:vortex-file-compressed 1074759935 1126206430 0.95
tpch_q22/duckdb:vortex-file-compressed 366272025 295530697 1.24
duckdb / vortex-compact (1.008x ➖, 0↑ 0↓)
name PR 1f9bcaa (ns) base 5a764e6 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 325701453 378397300 0.86
tpch_q02/duckdb:vortex-compact 973405988 935757760 1.04
tpch_q03/duckdb:vortex-compact 636504412 604036533 1.05
tpch_q04/duckdb:vortex-compact 422968939 354162858 1.19
tpch_q05/duckdb:vortex-compact 867942489 859253141 1.01
tpch_q06/duckdb:vortex-compact 363413073 391343410 0.93
tpch_q07/duckdb:vortex-compact 882088150 903876520 0.98
tpch_q08/duckdb:vortex-compact 1138370004 1114246430 1.02
tpch_q09/duckdb:vortex-compact 990834177 1001854648 0.99
tpch_q10/duckdb:vortex-compact 741283787 698738015 1.06
tpch_q11/duckdb:vortex-compact 464925357 490402250 0.95
tpch_q12/duckdb:vortex-compact 671951453 649351748 1.03
tpch_q13/duckdb:vortex-compact 435499390 362429121 1.20
tpch_q14/duckdb:vortex-compact 421528270 429270841 0.98
tpch_q15/duckdb:vortex-compact 320102521 305479671 1.05
tpch_q16/duckdb:vortex-compact 339154909 325659291 1.04
tpch_q17/duckdb:vortex-compact 680423383 658194958 1.03
tpch_q18/duckdb:vortex-compact 570552502 589430768 0.97
tpch_q19/duckdb:vortex-compact 489987736 465930745 1.05
tpch_q20/duckdb:vortex-compact 752968815 818802506 0.92
tpch_q21/duckdb:vortex-compact 986652935 1007464592 0.98
tpch_q22/duckdb:vortex-compact 273104766 305104539 0.90
duckdb / parquet (1.111x ➖, 0↑ 1↓)
name PR 1f9bcaa (ns) base 5a764e6 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 457841236 417519930 1.10
tpch_q02/duckdb:parquet 1137192441 974236322 1.17
tpch_q03/duckdb:parquet 1157763168 1040301474 1.11
tpch_q04/duckdb:parquet 622683717 632905220 0.98
tpch_q05/duckdb:parquet 1351040427 1178500987 1.15
tpch_q06/duckdb:parquet 🚨 582423039 439777723 1.32
tpch_q07/duckdb:parquet 1313082132 1121028902 1.17
tpch_q08/duckdb:parquet 1564634070 1425599308 1.10
tpch_q09/duckdb:parquet 1565730676 1449458625 1.08
tpch_q10/duckdb:parquet 1447948000 1194010480 1.21
tpch_q11/duckdb:parquet 727398001 702944197 1.03
tpch_q12/duckdb:parquet 769892921 802772195 0.96
tpch_q13/duckdb:parquet 914068276 902353395 1.01
tpch_q14/duckdb:parquet 740601686 637115021 1.16
tpch_q15/duckdb:parquet 552320965 522970773 1.06
tpch_q16/duckdb:parquet 695479090 628914584 1.11
tpch_q17/duckdb:parquet 948718974 800930929 1.18
tpch_q18/duckdb:parquet 1047587767 893388927 1.17
tpch_q19/duckdb:parquet 804169651 758542091 1.06
tpch_q20/duckdb:parquet 1152845727 1153174209 1.00
tpch_q21/duckdb:parquet 1219872630 1090134595 1.12
tpch_q22/duckdb:parquet 659975296 529471552 1.25

@github-actions

github-actions Bot commented Jun 22, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -3.8%
Engines: DataFusion No clear signal (+2.0%, environment too noisy confidence) · DuckDB No clear signal (-5.5%, environment too noisy confidence)
Vortex (geomean): 1.061x ➖
Parquet (geomean): 1.070x ➖
Shifts: Parquet (control) +7.0% · Median polish +3.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.117x ❌, 0↑ 19↓)
name PR 1f9bcaa (ns) base 5a764e6 (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 1595196 1613208 0.99
clickbench_q01/datafusion:vortex-file-compressed 15947193 15942926 1.00
clickbench_q02/datafusion:vortex-file-compressed 🚨 39846637 33123030 1.20
clickbench_q03/datafusion:vortex-file-compressed 🚨 45840432 38771564 1.18
clickbench_q04/datafusion:vortex-file-compressed 254830469 232589651 1.10
clickbench_q05/datafusion:vortex-file-compressed 328333405 303398584 1.08
clickbench_q06/datafusion:vortex-file-compressed 🚨 1797063 1625799 1.11
clickbench_q07/datafusion:vortex-file-compressed 🚨 22882785 19664560 1.16
clickbench_q08/datafusion:vortex-file-compressed 361635553 333151603 1.09
clickbench_q09/datafusion:vortex-file-compressed 485056193 458211881 1.06
clickbench_q10/datafusion:vortex-file-compressed 🚨 90089780 70481815 1.28
clickbench_q11/datafusion:vortex-file-compressed 92874857 84468327 1.10
clickbench_q12/datafusion:vortex-file-compressed 🚨 315473174 256849718 1.23
clickbench_q13/datafusion:vortex-file-compressed 🚨 492234497 410477287 1.20
clickbench_q14/datafusion:vortex-file-compressed 273295274 254839310 1.07
clickbench_q15/datafusion:vortex-file-compressed 293348759 280812178 1.04
clickbench_q16/datafusion:vortex-file-compressed 686781663 652197627 1.05
clickbench_q17/datafusion:vortex-file-compressed 696160429 635163679 1.10
clickbench_q18/datafusion:vortex-file-compressed 1459295541 1338593075 1.09
clickbench_q19/datafusion:vortex-file-compressed 🚨 31145165 27744725 1.12
clickbench_q20/datafusion:vortex-file-compressed 326669772 305257052 1.07
clickbench_q21/datafusion:vortex-file-compressed 414310687 385184308 1.08
clickbench_q22/datafusion:vortex-file-compressed 🚨 617444498 493380495 1.25
clickbench_q23/datafusion:vortex-file-compressed 🚨 847337203 764956518 1.11
clickbench_q24/datafusion:vortex-file-compressed 🚨 58462570 40499168 1.44
clickbench_q25/datafusion:vortex-file-compressed 78008354 72053182 1.08
clickbench_q26/datafusion:vortex-file-compressed 43538440 43411035 1.00
clickbench_q27/datafusion:vortex-file-compressed 🚨 501074075 406946370 1.23
clickbench_q28/datafusion:vortex-file-compressed 🚨 2626281377 2377955209 1.10
clickbench_q29/datafusion:vortex-file-compressed 🚨 81165488 60733181 1.34
clickbench_q30/datafusion:vortex-file-compressed 🚨 280795785 227195890 1.24
clickbench_q31/datafusion:vortex-file-compressed 🚨 333581932 247315409 1.35
clickbench_q32/datafusion:vortex-file-compressed 🚨 1304872206 1022013349 1.28
clickbench_q33/datafusion:vortex-file-compressed 🚨 1605802884 1398056450 1.15
clickbench_q34/datafusion:vortex-file-compressed 🚨 1561234270 1402252423 1.11
clickbench_q35/datafusion:vortex-file-compressed 249679115 236971793 1.05
clickbench_q36/datafusion:vortex-file-compressed 56110128 58554442 0.96
clickbench_q37/datafusion:vortex-file-compressed 25060855 24157451 1.04
clickbench_q38/datafusion:vortex-file-compressed 15979592 16866599 0.95
clickbench_q39/datafusion:vortex-file-compressed 131534507 121414912 1.08
clickbench_q40/datafusion:vortex-file-compressed 13052296 13101106 1.00
clickbench_q41/datafusion:vortex-file-compressed 13080522 12647984 1.03
clickbench_q42/datafusion:vortex-file-compressed 12140631 11362513 1.07
datafusion / parquet (1.095x ➖, 0↑ 21↓)
name PR 1f9bcaa (ns) base 5a764e6 (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 1575530 1518319 1.04
clickbench_q01/datafusion:parquet 🚨 21136190 19198201 1.10
clickbench_q02/datafusion:parquet 42941946 43501697 0.99
clickbench_q03/datafusion:parquet 🚨 39213204 34051004 1.15
clickbench_q04/datafusion:parquet 🚨 303295569 271696161 1.12
clickbench_q05/datafusion:parquet 🚨 432644212 311225495 1.39
clickbench_q06/datafusion:parquet 🚨 1880816 1475000 1.28
clickbench_q07/datafusion:parquet 🚨 22737057 20471100 1.11
clickbench_q08/datafusion:parquet 🚨 381985064 326356436 1.17
clickbench_q09/datafusion:parquet 🚨 565070784 470214977 1.20
clickbench_q10/datafusion:parquet 90361292 90177626 1.00
clickbench_q11/datafusion:parquet 115708748 114648795 1.01
clickbench_q12/datafusion:parquet 313525054 288085501 1.09
clickbench_q13/datafusion:parquet 478218331 473056695 1.01
clickbench_q14/datafusion:parquet 313536881 307439677 1.02
clickbench_q15/datafusion:parquet 288179326 278821986 1.03
clickbench_q16/datafusion:parquet 677000817 674459957 1.00
clickbench_q17/datafusion:parquet 666740145 632160916 1.05
clickbench_q18/datafusion:parquet 🚨 1542194278 1380059467 1.12
clickbench_q19/datafusion:parquet 28181645 27023963 1.04
clickbench_q20/datafusion:parquet 597613216 559437197 1.07
clickbench_q21/datafusion:parquet 654492253 620462091 1.05
clickbench_q22/datafusion:parquet 983955388 903006691 1.09
clickbench_q23/datafusion:parquet 🚨 4524744540 4033008897 1.12
clickbench_q24/datafusion:parquet 56158835 56428212 1.00
clickbench_q25/datafusion:parquet 🚨 141187756 125528942 1.12
clickbench_q26/datafusion:parquet 🚨 69024907 54359039 1.27
clickbench_q27/datafusion:parquet 🚨 737121689 641714073 1.15
clickbench_q28/datafusion:parquet 2577788798 2416535404 1.07
clickbench_q29/datafusion:parquet 🚨 54008404 48393309 1.12
clickbench_q30/datafusion:parquet 🚨 350530108 312136658 1.12
clickbench_q31/datafusion:parquet 🚨 397986235 339915064 1.17
clickbench_q32/datafusion:parquet 🚨 1426700617 1121648661 1.27
clickbench_q33/datafusion:parquet 🚨 1736903997 1493506980 1.16
clickbench_q34/datafusion:parquet 🚨 1695300073 1478182629 1.15
clickbench_q35/datafusion:parquet 🚨 267021854 241193576 1.11
clickbench_q36/datafusion:parquet 106443882 101705061 1.05
clickbench_q37/datafusion:parquet 42781345 41843185 1.02
clickbench_q38/datafusion:parquet 59328942 61149075 0.97
clickbench_q39/datafusion:parquet 223257906 207693417 1.07
clickbench_q40/datafusion:parquet 23147333 23281178 0.99
clickbench_q41/datafusion:parquet 🚨 24579971 21547156 1.14
clickbench_q42/datafusion:parquet 21704211 21302832 1.02
duckdb / vortex-file-compressed (1.007x ➖, 2↑ 8↓)
name PR 1f9bcaa (ns) base 5a764e6 (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 6650796 7123299 0.93
clickbench_q01/duckdb:vortex-file-compressed 12000409 12176397 0.99
clickbench_q02/duckdb:vortex-file-compressed 🚨 28585046 25125939 1.14
clickbench_q03/duckdb:vortex-file-compressed 30851282 30731053 1.00
clickbench_q04/duckdb:vortex-file-compressed 201578897 193390444 1.04
clickbench_q05/duckdb:vortex-file-compressed 🚨 207177690 188038271 1.10
clickbench_q06/duckdb:vortex-file-compressed 20409245 20424780 1.00
clickbench_q07/duckdb:vortex-file-compressed 🚨 19182337 14770272 1.30
clickbench_q08/duckdb:vortex-file-compressed 291797113 273124685 1.07
clickbench_q09/duckdb:vortex-file-compressed 356012767 357413102 1.00
clickbench_q10/duckdb:vortex-file-compressed 69671609 73464960 0.95
clickbench_q11/duckdb:vortex-file-compressed 87392333 84629631 1.03
clickbench_q12/duckdb:vortex-file-compressed 🚀 206288181 229567882 0.90
clickbench_q13/duckdb:vortex-file-compressed 438219313 461800866 0.95
clickbench_q14/duckdb:vortex-file-compressed 252237323 249633992 1.01
clickbench_q15/duckdb:vortex-file-compressed 260949250 266511991 0.98
clickbench_q16/duckdb:vortex-file-compressed 566134453 600729418 0.94
clickbench_q17/duckdb:vortex-file-compressed 449948366 489605346 0.92
clickbench_q18/duckdb:vortex-file-compressed 1002985254 1049322813 0.96
clickbench_q19/duckdb:vortex-file-compressed 23901786 23111127 1.03
clickbench_q20/duckdb:vortex-file-compressed 321347424 321955046 1.00
clickbench_q21/duckdb:vortex-file-compressed 423539467 426338711 0.99
clickbench_q22/duckdb:vortex-file-compressed 611048724 585848397 1.04
clickbench_q23/duckdb:vortex-file-compressed 🚀 182002269 204698746 0.89
clickbench_q24/duckdb:vortex-file-compressed 39225833 39030863 1.00
clickbench_q25/duckdb:vortex-file-compressed 84033998 86082977 0.98
clickbench_q26/duckdb:vortex-file-compressed 47501418 52199368 0.91
clickbench_q27/duckdb:vortex-file-compressed 223588622 239187855 0.93
clickbench_q28/duckdb:vortex-file-compressed 3057552025 3207612923 0.95
clickbench_q29/duckdb:vortex-file-compressed 28179982 28824415 0.98
clickbench_q30/duckdb:vortex-file-compressed 🚨 222640872 196766493 1.13
clickbench_q31/duckdb:vortex-file-compressed 🚨 336346871 297000881 1.13
clickbench_q32/duckdb:vortex-file-compressed 1295898811 1181349868 1.10
clickbench_q33/duckdb:vortex-file-compressed 🚨 1462384620 1278997629 1.14
clickbench_q34/duckdb:vortex-file-compressed 🚨 1535025716 1382613053 1.11
clickbench_q35/duckdb:vortex-file-compressed 401841256 407339846 0.99
clickbench_q36/duckdb:vortex-file-compressed 30475210 31730723 0.96
clickbench_q37/duckdb:vortex-file-compressed 19937142 22038484 0.90
clickbench_q38/duckdb:vortex-file-compressed 22317859 24346468 0.92
clickbench_q39/duckdb:vortex-file-compressed 45671031 46525511 0.98
clickbench_q40/duckdb:vortex-file-compressed 🚨 28143247 22074653 1.27
clickbench_q41/duckdb:vortex-file-compressed 20230488 20961288 0.97
clickbench_q42/duckdb:vortex-file-compressed 21448814 22468325 0.95
duckdb / parquet (1.045x ➖, 0↑ 7↓)
name PR 1f9bcaa (ns) base 5a764e6 (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 25573715 23926739 1.07
clickbench_q01/duckdb:parquet 28709012 30236814 0.95
clickbench_q02/duckdb:parquet 🚨 54903397 49752648 1.10
clickbench_q03/duckdb:parquet 41489764 40799478 1.02
clickbench_q04/duckdb:parquet 207392574 205730699 1.01
clickbench_q05/duckdb:parquet 272222955 260845224 1.04
clickbench_q06/duckdb:parquet 50231594 48719896 1.03
clickbench_q07/duckdb:parquet 33905869 31305048 1.08
clickbench_q08/duckdb:parquet 292541279 272460143 1.07
clickbench_q09/duckdb:parquet 433186377 403482343 1.07
clickbench_q10/duckdb:parquet 87203186 83537043 1.04
clickbench_q11/duckdb:parquet 102100548 101766399 1.00
clickbench_q12/duckdb:parquet 305503170 281460611 1.09
clickbench_q13/duckdb:parquet 🚨 532224873 476481263 1.12
clickbench_q14/duckdb:parquet 326336766 322739898 1.01
clickbench_q15/duckdb:parquet 257711298 260588876 0.99
clickbench_q16/duckdb:parquet 604536557 612343442 0.99
clickbench_q17/duckdb:parquet 499913089 498154219 1.00
clickbench_q18/duckdb:parquet 🚨 1207593537 1048343366 1.15
clickbench_q19/duckdb:parquet 30642656 28705234 1.07
clickbench_q20/duckdb:parquet 427000530 417581886 1.02
clickbench_q21/duckdb:parquet 537185751 534034190 1.01
clickbench_q22/duckdb:parquet 932492480 932017060 1.00
clickbench_q23/duckdb:parquet 281630066 272059822 1.04
clickbench_q24/duckdb:parquet 70340936 69703213 1.01
clickbench_q25/duckdb:parquet 164396896 164231222 1.00
clickbench_q26/duckdb:parquet 54803250 54652092 1.00
clickbench_q27/duckdb:parquet 484880589 471118373 1.03
clickbench_q28/duckdb:parquet 4970827274 4794228862 1.04
clickbench_q29/duckdb:parquet 42088412 42334507 0.99
clickbench_q30/duckdb:parquet 326555088 319473436 1.02
clickbench_q31/duckdb:parquet 395253660 418084756 0.95
clickbench_q32/duckdb:parquet 1215466941 1227134837 0.99
clickbench_q33/duckdb:parquet 1228506673 1146715877 1.07
clickbench_q34/duckdb:parquet 1244883381 1185739175 1.05
clickbench_q35/duckdb:parquet 397835258 376244395 1.06
clickbench_q36/duckdb:parquet 🚨 54733893 45560506 1.20
clickbench_q37/duckdb:parquet 37231292 34107086 1.09
clickbench_q38/duckdb:parquet 🚨 43305739 35433082 1.22
clickbench_q39/duckdb:parquet 91606325 88683002 1.03
clickbench_q40/duckdb:parquet 20938823 20885127 1.00
clickbench_q41/duckdb:parquet 🚨 24866868 21584941 1.15
clickbench_q42/duckdb:parquet 🚨 25213420 22408233 1.13
duckdb / duckdb (0.969x ➖, 0↑ 0↓)
name PR 1f9bcaa (ns) base 5a764e6 (ns) ratio (PR/base)
clickbench_q00/duckdb:duckdb 17520768 18343234 0.96
clickbench_q01/duckdb:duckdb 34281675 36094732 0.95
clickbench_q02/duckdb:duckdb 51015253 54673410 0.93
clickbench_q03/duckdb:duckdb 54982209 58044808 0.95
clickbench_q04/duckdb:duckdb 209737263 230796741 0.91
clickbench_q05/duckdb:duckdb 285528791 312358743 0.91
clickbench_q06/duckdb:duckdb 33648611 36898205 0.91
clickbench_q07/duckdb:duckdb 35315675 36313537 0.97
clickbench_q08/duckdb:duckdb 275586764 281749198 0.98
clickbench_q09/duckdb:duckdb 399272921 402495391 0.99
clickbench_q10/duckdb:duckdb 117290485 117417001 1.00
clickbench_q11/duckdb:duckdb 125975451 128454698 0.98
clickbench_q12/duckdb:duckdb 257210831 269886648 0.95
clickbench_q13/duckdb:duckdb 441261581 467836600 0.94
clickbench_q14/duckdb:duckdb 282886451 295985730 0.96
clickbench_q15/duckdb:duckdb 244814205 249486833 0.98
clickbench_q16/duckdb:duckdb 567222989 574032309 0.99
clickbench_q17/duckdb:duckdb 479619572 477460014 1.00
clickbench_q18/duckdb:duckdb 1021027845 1020564362 1.00
clickbench_q19/duckdb:duckdb 34001013 34912187 0.97
clickbench_q20/duckdb:duckdb 469488839 473582502 0.99
clickbench_q21/duckdb:duckdb 477831880 483612409 0.99
clickbench_q22/duckdb:duckdb 541137197 566683160 0.95
clickbench_q23/duckdb:duckdb 262800387 268324793 0.98
clickbench_q24/duckdb:duckdb 60517198 63468395 0.95
clickbench_q25/duckdb:duckdb 150103348 152052945 0.99
clickbench_q26/duckdb:duckdb 62078777 64619162 0.96
clickbench_q27/duckdb:duckdb 418701692 426679364 0.98
clickbench_q28/duckdb:duckdb 4422351812 4439505632 1.00
clickbench_q29/duckdb:duckdb 50257838 50483410 1.00
clickbench_q30/duckdb:duckdb 284496846 285046176 1.00
clickbench_q31/duckdb:duckdb 377469661 378032839 1.00
clickbench_q32/duckdb:duckdb 1133526753 1166735003 0.97
clickbench_q33/duckdb:duckdb 1144807640 1156146271 0.99
clickbench_q34/duckdb:duckdb 1238484784 1225570889 1.01
clickbench_q35/duckdb:duckdb 305445294 333029038 0.92
clickbench_q36/duckdb:duckdb 50592510 53488112 0.95
clickbench_q37/duckdb:duckdb 28250810 29870301 0.95
clickbench_q38/duckdb:duckdb 32812306 35256035 0.93
clickbench_q39/duckdb:duckdb 79986083 85226930 0.94
clickbench_q40/duckdb:duckdb 27705386 28196612 0.98
clickbench_q41/duckdb:duckdb 27067407 27535030 0.98
clickbench_q42/duckdb:duckdb 31507413 29920775 1.05
File Size Changes (102 files changed, +0.0% overall, 53↑ 49↓)
File Scale Format Base HEAD Change %
hits_55.vortex 1.0 vortex-file-compressed 166.16 MB 169.05 MB +2.89 MB +1.7%
hits_90.vortex 1.0 vortex-file-compressed 139.87 MB 141.78 MB +1.91 MB +1.4%
hits_65.vortex 1.0 vortex-file-compressed 182.14 MB 183.41 MB +1.27 MB +0.7%
hits_53.vortex 1.0 vortex-file-compressed 85.48 MB 85.85 MB +380.23 KB +0.4%
hits_82.vortex 1.0 vortex-file-compressed 99.49 MB 99.78 MB +291.33 KB +0.3%
hits_37.vortex 1.0 vortex-file-compressed 85.37 MB 85.56 MB +195.97 KB +0.2%
hits_36.vortex 1.0 vortex-file-compressed 68.28 MB 68.41 MB +141.84 KB +0.2%
hits_70.vortex 1.0 vortex-file-compressed 93.32 MB 93.48 MB +166.93 KB +0.2%
hits_84.vortex 1.0 vortex-file-compressed 116.82 MB 116.98 MB +165.84 KB +0.1%
hits_35.vortex 1.0 vortex-file-compressed 114.91 MB 115.06 MB +154.52 KB +0.1%
hits_67.vortex 1.0 vortex-file-compressed 183.82 MB 184.06 MB +245.71 KB +0.1%
hits_11.vortex 1.0 vortex-file-compressed 79.71 MB 79.82 MB +106.53 KB +0.1%
hits_69.vortex 1.0 vortex-file-compressed 122.98 MB 123.13 MB +159.91 KB +0.1%
hits_52.vortex 1.0 vortex-file-compressed 103.58 MB 103.71 MB +131.92 KB +0.1%
hits_40.vortex 1.0 vortex-file-compressed 117.52 MB 117.65 MB +138.12 KB +0.1%
hits_87.vortex 1.0 vortex-file-compressed 172.04 MB 172.23 MB +192.62 KB +0.1%
hits_74.vortex 1.0 vortex-file-compressed 119.39 MB 119.49 MB +103.68 KB +0.1%
hits_97.vortex 1.0 vortex-file-compressed 106.68 MB 106.76 MB +87.10 KB +0.1%
hits_5.vortex 1.0 vortex-file-compressed 92.93 MB 93.00 MB +75.13 KB +0.1%
hits_71.vortex 1.0 vortex-file-compressed 101.59 MB 101.66 MB +76.20 KB +0.1%
hits_62.vortex 1.0 vortex-file-compressed 117.36 MB 117.44 MB +87.98 KB +0.1%
hits_30.vortex 1.0 vortex-file-compressed 86.72 MB 86.78 MB +61.34 KB +0.1%
hits_59.vortex 1.0 vortex-file-compressed 101.53 MB 101.59 MB +63.85 KB +0.1%
hits_18.vortex 1.0 vortex-file-compressed 104.29 MB 104.35 MB +62.92 KB +0.1%
hits_85.vortex 1.0 vortex-file-compressed 91.45 MB 91.50 MB +53.99 KB +0.1%
hits_3.vortex 1.0 vortex-file-compressed 141.64 MB 141.72 MB +78.90 KB +0.1%
hits_57.vortex 1.0 vortex-file-compressed 128.01 MB 128.07 MB +70.29 KB +0.1%
hits_81.vortex 1.0 vortex-file-compressed 100.63 MB 100.68 MB +52.53 KB +0.1%
hits_23.vortex 1.0 vortex-file-compressed 76.43 MB 76.47 MB +39.12 KB +0.0%
hits_96.vortex 1.0 vortex-file-compressed 135.17 MB 135.23 MB +66.39 KB +0.0%
hits_51.vortex 1.0 vortex-file-compressed 277.49 MB 277.63 MB +135.84 KB +0.0%
hits_22.vortex 1.0 vortex-file-compressed 76.85 MB 76.88 MB +37.35 KB +0.0%
hits_12.vortex 1.0 vortex-file-compressed 100.78 MB 100.83 MB +48.32 KB +0.0%
hits_91.vortex 1.0 vortex-file-compressed 96.77 MB 96.81 MB +44.04 KB +0.0%
hits_47.vortex 1.0 vortex-file-compressed 41.24 MB 41.26 MB +16.80 KB +0.0%
hits_80.vortex 1.0 vortex-file-compressed 104.92 MB 104.96 MB +39.47 KB +0.0%
hits_98.vortex 1.0 vortex-file-compressed 118.13 MB 118.17 MB +39.60 KB +0.0%
hits_29.vortex 1.0 vortex-file-compressed 59.35 MB 59.37 MB +19.65 KB +0.0%
hits_88.vortex 1.0 vortex-file-compressed 110.82 MB 110.85 MB +36.50 KB +0.0%
hits_7.vortex 1.0 vortex-file-compressed 93.92 MB 93.94 MB +29.38 KB +0.0%
hits_79.vortex 1.0 vortex-file-compressed 143.80 MB 143.83 MB +37.77 KB +0.0%
hits_78.vortex 1.0 vortex-file-compressed 164.11 MB 164.14 MB +32.26 KB +0.0%
hits_48.vortex 1.0 vortex-file-compressed 28.02 MB 28.02 MB +4.11 KB +0.0%
hits_26.vortex 1.0 vortex-file-compressed 109.18 MB 109.19 MB +13.42 KB +0.0%
hits_83.vortex 1.0 vortex-file-compressed 89.18 MB 89.19 MB +10.34 KB +0.0%
hits_42.vortex 1.0 vortex-file-compressed 221.71 MB 221.73 MB +22.01 KB +0.0%
hits_38.vortex 1.0 vortex-file-compressed 98.97 MB 98.98 MB +9.46 KB +0.0%
hits_8.vortex 1.0 vortex-file-compressed 93.23 MB 93.23 MB +8.02 KB +0.0%
hits_27.vortex 1.0 vortex-file-compressed 122.88 MB 122.89 MB +8.63 KB +0.0%
hits_20.vortex 1.0 vortex-file-compressed 62.52 MB 62.52 MB +2.20 KB +0.0%
hits_44.vortex 1.0 vortex-file-compressed 185.89 MB 185.90 MB +4.95 KB +0.0%
hits_75.vortex 1.0 vortex-file-compressed 63.22 MB 63.22 MB +872 B +0.0%
hits_14.vortex 1.0 vortex-file-compressed 111.17 MB 111.17 MB +816 B +0.0%
hits_64.vortex 1.0 vortex-file-compressed 80.97 MB 80.96 MB 1.45 KB -0.0%
hits_6.vortex 1.0 vortex-file-compressed 93.28 MB 93.28 MB 2.38 KB -0.0%
hits_15.vortex 1.0 vortex-file-compressed 89.10 MB 89.10 MB 2.64 KB -0.0%
hits_4.vortex 1.0 vortex-file-compressed 108.27 MB 108.26 MB 3.34 KB -0.0%
hits_17.vortex 1.0 vortex-file-compressed 87.20 MB 87.20 MB 4.48 KB -0.0%
hits_89.vortex 1.0 vortex-file-compressed 184.26 MB 184.24 MB 15.12 KB -0.0%
hits_73.vortex 1.0 vortex-file-compressed 109.42 MB 109.41 MB 11.24 KB -0.0%
hits_16.vortex 1.0 vortex-file-compressed 79.29 MB 79.28 MB 8.91 KB -0.0%
hits_92.vortex 1.0 vortex-file-compressed 146.47 MB 146.44 MB 24.94 KB -0.0%
hits_39.vortex 1.0 vortex-file-compressed 80.07 MB 80.06 MB 14.41 KB -0.0%
hits_50.vortex 1.0 vortex-file-compressed 179.09 MB 179.06 MB 36.45 KB -0.0%
hits_19.vortex 1.0 vortex-file-compressed 73.15 MB 73.14 MB 15.55 KB -0.0%
hits_25.vortex 1.0 vortex-file-compressed 113.36 MB 113.34 MB 25.78 KB -0.0%
hits_46.vortex 1.0 vortex-file-compressed 69.07 MB 69.06 MB 16.56 KB -0.0%
hits_66.vortex 1.0 vortex-file-compressed 90.19 MB 90.16 MB 25.13 KB -0.0%
hits_45.vortex 1.0 vortex-file-compressed 121.92 MB 121.88 MB 37.41 KB -0.0%
hits_99.vortex 1.0 vortex-file-compressed 122.84 MB 122.80 MB 47.70 KB -0.0%
hits_76.vortex 1.0 vortex-file-compressed 113.90 MB 113.86 MB 45.12 KB -0.0%
hits_0.vortex 1.0 vortex-file-compressed 89.51 MB 89.47 MB 38.20 KB -0.0%
hits_54.vortex 1.0 vortex-file-compressed 221.30 MB 221.21 MB 98.59 KB -0.0%
hits_13.vortex 1.0 vortex-file-compressed 99.09 MB 99.04 MB 49.12 KB -0.0%
hits_1.vortex 1.0 vortex-file-compressed 138.28 MB 138.20 MB 72.91 KB -0.1%
hits_9.vortex 1.0 vortex-file-compressed 99.06 MB 99.01 MB 52.55 KB -0.1%
hits_93.vortex 1.0 vortex-file-compressed 90.20 MB 90.15 MB 49.63 KB -0.1%
hits_72.vortex 1.0 vortex-file-compressed 84.48 MB 84.44 MB 47.68 KB -0.1%
hits_56.vortex 1.0 vortex-file-compressed 123.15 MB 123.09 MB 69.84 KB -0.1%
hits_49.vortex 1.0 vortex-file-compressed 75.46 MB 75.42 MB 43.43 KB -0.1%
hits_34.vortex 1.0 vortex-file-compressed 97.48 MB 97.42 MB 57.00 KB -0.1%
hits_33.vortex 1.0 vortex-file-compressed 57.05 MB 57.01 MB 33.95 KB -0.1%
hits_43.vortex 1.0 vortex-file-compressed 226.32 MB 226.18 MB 134.83 KB -0.1%
hits_61.vortex 1.0 vortex-file-compressed 101.08 MB 101.02 MB 62.10 KB -0.1%
hits_24.vortex 1.0 vortex-file-compressed 75.98 MB 75.94 MB 47.98 KB -0.1%
hits_77.vortex 1.0 vortex-file-compressed 168.15 MB 168.05 MB 106.36 KB -0.1%
hits_86.vortex 1.0 vortex-file-compressed 69.04 MB 69.00 MB 44.88 KB -0.1%
hits_68.vortex 1.0 vortex-file-compressed 122.83 MB 122.75 MB 85.59 KB -0.1%
hits_28.vortex 1.0 vortex-file-compressed 119.74 MB 119.65 MB 84.50 KB -0.1%
hits_21.vortex 1.0 vortex-file-compressed 92.79 MB 92.72 MB 73.10 KB -0.1%
hits_58.vortex 1.0 vortex-file-compressed 90.30 MB 90.23 MB 71.85 KB -0.1%
hits_60.vortex 1.0 vortex-file-compressed 103.12 MB 103.04 MB 83.19 KB -0.1%
hits_41.vortex 1.0 vortex-file-compressed 223.13 MB 222.93 MB 203.03 KB -0.1%
hits_10.vortex 1.0 vortex-file-compressed 69.41 MB 69.34 MB 65.66 KB -0.1%
hits_32.vortex 1.0 vortex-file-compressed 66.55 MB 66.47 MB 81.93 KB -0.1%
hits_95.vortex 1.0 vortex-file-compressed 96.14 MB 96.02 MB 122.40 KB -0.1%
hits_63.vortex 1.0 vortex-file-compressed 69.14 MB 69.05 MB 91.32 KB -0.1%
hits_94.vortex 1.0 vortex-file-compressed 138.54 MB 138.35 MB 191.64 KB -0.1%
hits_2.vortex 1.0 vortex-file-compressed 186.44 MB 185.92 MB 533.30 KB -0.3%
hits_31.vortex 1.0 vortex-file-compressed 90.19 MB 89.93 MB 269.49 KB -0.3%
hits_55.vortex 1.0 vortex-compact 96.03 MB 94.93 MB 1.09 MB -1.1%
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%

Totals:

  • vortex-compact: 7.04 GB → 7.04 GB (-0.0%)
  • vortex-file-compressed: 10.97 GB → 10.98 GB (+0.1%)

@github-actions

github-actions Bot commented Jun 22, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: Appian on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.8%
Engines: DataFusion No clear signal (-1.8%, low confidence) · DuckDB No clear signal (+0.2%, low confidence)
Vortex (geomean): 0.995x ➖
Parquet (geomean): 1.001x ➖
Shifts: Parquet (control) +0.1% · Median polish -1.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.993x ➖, 0↑ 0↓)
name PR 1f9bcaa (ns) base 5a764e6 (ns) ratio (PR/base)
appian_q01/datafusion:vortex-file-compressed 125403386 129952975 0.96
appian_q02/datafusion:vortex-file-compressed 584341077 595985701 0.98
appian_q03/datafusion:vortex-file-compressed 339028565 333618411 1.02
appian_q04/datafusion:vortex-file-compressed 44796122858 44671762137 1.00
appian_q05/datafusion:vortex-file-compressed 252431814 253443563 1.00
appian_q06/datafusion:vortex-file-compressed 328594557 331388972 0.99
appian_q07/datafusion:vortex-file-compressed 421118132 420273926 1.00
appian_q08/datafusion:vortex-file-compressed 1918568734 1930338151 0.99
datafusion / parquet (1.011x ➖, 0↑ 0↓)
name PR 1f9bcaa (ns) base 5a764e6 (ns) ratio (PR/base)
appian_q01/datafusion:parquet 128551361 129824845 0.99
appian_q02/datafusion:parquet 624201154 612732975 1.02
appian_q03/datafusion:parquet 346530894 330868916 1.05
appian_q04/datafusion:parquet 44902007497 44697313282 1.00
appian_q05/datafusion:parquet 275439495 274410901 1.00
appian_q06/datafusion:parquet 351916557 350398912 1.00
appian_q07/datafusion:parquet 448731975 440510157 1.02
appian_q08/datafusion:parquet 1943300605 1939068021 1.00
duckdb / vortex-file-compressed (0.997x ➖, 0↑ 0↓)
name PR 1f9bcaa (ns) base 5a764e6 (ns) ratio (PR/base)
appian_q01/duckdb:vortex-file-compressed 193719925 193523999 1.00
appian_q02/duckdb:vortex-file-compressed 620229465 632757660 0.98
appian_q03/duckdb:vortex-file-compressed 262971837 261042803 1.01
appian_q04/duckdb:vortex-file-compressed 1328582378 1324309959 1.00
appian_q05/duckdb:vortex-file-compressed 294100977 291788151 1.01
appian_q06/duckdb:vortex-file-compressed 793705686 809664367 0.98
appian_q07/duckdb:vortex-file-compressed 346402206 347816540 1.00
appian_q08/duckdb:vortex-file-compressed 1287415956 1282933413 1.00
duckdb / parquet (0.992x ➖, 0↑ 0↓)
name PR 1f9bcaa (ns) base 5a764e6 (ns) ratio (PR/base)
appian_q01/duckdb:parquet 198751802 201840024 0.98
appian_q02/duckdb:parquet 600583549 608061845 0.99
appian_q03/duckdb:parquet 287893967 283200288 1.02
appian_q04/duckdb:parquet 1317623801 1334237764 0.99
appian_q05/duckdb:parquet 298472019 304106964 0.98
appian_q06/duckdb:parquet 782675767 804833563 0.97
appian_q07/duckdb:parquet 364377984 362130053 1.01
appian_q08/duckdb:parquet 1272474745 1276642634 1.00
duckdb / duckdb (0.990x ➖, 0↑ 0↓)
name PR 1f9bcaa (ns) base 5a764e6 (ns) ratio (PR/base)
appian_q01/duckdb:duckdb 170500790 171285976 1.00
appian_q02/duckdb:duckdb 545832826 550447908 0.99
appian_q03/duckdb:duckdb 388804554 382045735 1.02
appian_q04/duckdb:duckdb 1292937624 1313052327 0.98
appian_q05/duckdb:duckdb 278279384 284023033 0.98
appian_q06/duckdb:duckdb 775839045 800391359 0.97
appian_q07/duckdb:duckdb 324823712 329221173 0.99
appian_q08/duckdb:duckdb 1215654423 1225251945 0.99
File Size Changes (3 files changed, -0.0% overall, 1↑ 2↓)
File Scale Format Base HEAD Change %
orderview.vortex 1.0 vortex-file-compressed 76.15 MB 76.17 MB +18.73 KB +0.0%
creditcardview.vortex 1.0 vortex-file-compressed 58.36 MB 58.32 MB 37.50 KB -0.1%
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%

Totals:

  • vortex-compact: 271.94 MB → 271.68 MB (-0.1%)
  • vortex-file-compressed: 476.54 MB → 476.52 MB (-0.0%)

@github-actions

github-actions Bot commented Jun 22, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: Random Access

Vortex (geomean): 1.009x ➖
Parquet (geomean): 0.996x ➖

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
unknown / unknown (0.994x ➖, 2↑ 2↓)
name PR 1f9bcaa (ns) base 5a764e6 (ns) ratio (PR/base)
random-access/feature-vectors/correlated/lance-tokio-local-disk 370492 367852 1.01
random-access/feature-vectors/correlated/lance-tokio-local-disk-footer 997506 1043114 0.96
random-access/feature-vectors/correlated/parquet-tokio-local-disk 8424270384 8152080375 1.03
random-access/feature-vectors/correlated/parquet-tokio-local-disk-footer 8241865388 8215941834 1.00
random-access/feature-vectors/correlated/vortex-tokio-local-disk 🚨 3451223 2930377 1.18
random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer 2446585 2459786 0.99
random-access/feature-vectors/uniform/lance-tokio-local-disk 1119276 1144869 0.98
random-access/feature-vectors/uniform/lance-tokio-local-disk-footer 1763199 1833526 0.96
random-access/feature-vectors/uniform/parquet-tokio-local-disk 8162746048 8511463091 0.96
random-access/feature-vectors/uniform/parquet-tokio-local-disk-footer 8218435103 8151156233 1.01
random-access/feature-vectors/uniform/vortex-tokio-local-disk 3390060 3364665 1.01
random-access/feature-vectors/uniform/vortex-tokio-local-disk-footer 5563274 5473207 1.02
random-access/lance-tokio-local-disk 616530 653697 0.94
random-access/lance-tokio-local-disk-footer 1261803 1327506 0.95
random-access/nested-lists/correlated/lance-tokio-local-disk 223380 218856 1.02
random-access/nested-lists/correlated/lance-tokio-local-disk-footer 553800 554716 1.00
random-access/nested-lists/correlated/parquet-tokio-local-disk 128409198 128516170 1.00
random-access/nested-lists/correlated/parquet-tokio-local-disk-footer 126237881 127943127 0.99
random-access/nested-lists/correlated/vortex-tokio-local-disk 316876 338608 0.94
random-access/nested-lists/correlated/vortex-tokio-local-disk-footer 423839 426097 0.99
random-access/nested-lists/uniform/lance-tokio-local-disk 992227 984532 1.01
random-access/nested-lists/uniform/lance-tokio-local-disk-footer 1310063 1293987 1.01
random-access/nested-lists/uniform/parquet-tokio-local-disk 127960439 128784516 0.99
random-access/nested-lists/uniform/parquet-tokio-local-disk-footer 128636116 126118970 1.02
random-access/nested-lists/uniform/vortex-tokio-local-disk 1831060 1807907 1.01
random-access/nested-lists/uniform/vortex-tokio-local-disk-footer 1929506 1922444 1.00
random-access/nested-structs/correlated/lance-tokio-local-disk 346109 347707 1.00
random-access/nested-structs/correlated/lance-tokio-local-disk-footer 525114 521182 1.01
random-access/nested-structs/correlated/parquet-tokio-local-disk 20057018 20200193 0.99
random-access/nested-structs/correlated/parquet-tokio-local-disk-footer 20398359 19653894 1.04
random-access/nested-structs/correlated/vortex-tokio-local-disk 405014 412426 0.98
random-access/nested-structs/correlated/vortex-tokio-local-disk-footer 544074 538312 1.01
random-access/nested-structs/uniform/lance-tokio-local-disk 2472837 2413539 1.02
random-access/nested-structs/uniform/lance-tokio-local-disk-footer 2667196 2609750 1.02
random-access/nested-structs/uniform/parquet-tokio-local-disk 21017257 20549915 1.02
random-access/nested-structs/uniform/parquet-tokio-local-disk-footer 20391438 19896422 1.02
random-access/nested-structs/uniform/vortex-tokio-local-disk 1018248 971185 1.05
random-access/nested-structs/uniform/vortex-tokio-local-disk-footer 1214242 1172438 1.04
random-access/parquet-tokio-local-disk 165701189 165822213 1.00
random-access/parquet-tokio-local-disk-footer 163741367 167554127 0.98
random-access/taxi/correlated/lance-tokio-local-disk 912629 1011237 0.90
random-access/taxi/correlated/lance-tokio-local-disk-footer 🚀 1743241 1943399 0.90
random-access/taxi/correlated/parquet-tokio-local-disk 248749250 250094199 0.99
random-access/taxi/correlated/parquet-tokio-local-disk-footer 245980955 252520420 0.97
random-access/taxi/correlated/vortex-tokio-local-disk 🚀 1041510 1208697 0.86
random-access/taxi/correlated/vortex-tokio-local-disk-footer 1637066 1676662 0.98
random-access/taxi/uniform/lance-tokio-local-disk 9130032 9503870 0.96
random-access/taxi/uniform/lance-tokio-local-disk-footer 9630239 9951072 0.97
random-access/taxi/uniform/parquet-tokio-local-disk 261966153 274426328 0.95
random-access/taxi/uniform/parquet-tokio-local-disk-footer 261084777 275602566 0.95
random-access/taxi/uniform/vortex-tokio-local-disk 🚨 3548543 3200977 1.11
random-access/taxi/uniform/vortex-tokio-local-disk-footer 4178837 4142291 1.01
random-access/vortex-tokio-local-disk 674207 657726 1.03
random-access/vortex-tokio-local-disk-footer 1116322 1122002 0.99

@github-actions

github-actions Bot commented Jun 22, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +7.4%
Engines: DataFusion No clear signal (+17.6%, environment too noisy confidence) · DuckDB No clear signal (-1.9%, environment too noisy confidence)
Vortex (geomean): 1.164x ➖
Parquet (geomean): 1.084x ➖
Shifts: Parquet (control) +8.4% · Median polish +15.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.307x ❌, 0↑ 11↓)
name PR 1f9bcaa (ns) base 5a764e6 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 771244383 742527668 1.04
tpch_q02/datafusion:vortex-file-compressed 836454229 784601538 1.07
tpch_q03/datafusion:vortex-file-compressed 985100705 832069065 1.18
tpch_q04/datafusion:vortex-file-compressed 🚨 632419446 476804087 1.33
tpch_q05/datafusion:vortex-file-compressed 1184684281 967088502 1.23
tpch_q06/datafusion:vortex-file-compressed 664667982 562330680 1.18
tpch_q07/datafusion:vortex-file-compressed 🚨 1341853903 976198109 1.37
tpch_q08/datafusion:vortex-file-compressed 🚨 1833296806 1129384054 1.62
tpch_q09/datafusion:vortex-file-compressed 1490498310 1152754759 1.29
tpch_q10/datafusion:vortex-file-compressed 🚨 1165957207 862869733 1.35
tpch_q11/datafusion:vortex-file-compressed 606857915 471134812 1.29
tpch_q12/datafusion:vortex-file-compressed 🚨 1078661285 754171544 1.43
tpch_q13/datafusion:vortex-file-compressed 494563067 393528027 1.26
tpch_q14/datafusion:vortex-file-compressed 🚨 743335918 498431209 1.49
tpch_q15/datafusion:vortex-file-compressed 🚨 1241086167 924284477 1.34
tpch_q16/datafusion:vortex-file-compressed 🚨 758502704 502790836 1.51
tpch_q17/datafusion:vortex-file-compressed 1392951305 1124642819 1.24
tpch_q18/datafusion:vortex-file-compressed 1274946493 1147475017 1.11
tpch_q19/datafusion:vortex-file-compressed 🚨 1075222502 799860245 1.34
tpch_q20/datafusion:vortex-file-compressed 🚨 1171558495 817945463 1.43
tpch_q21/datafusion:vortex-file-compressed 1668571108 1398675451 1.19
tpch_q22/datafusion:vortex-file-compressed 🚨 726168330 438173912 1.66
datafusion / vortex-compact (1.250x ➖, 0↑ 6↓)
name PR 1f9bcaa (ns) base 5a764e6 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 956528803 768690440 1.24
tpch_q02/datafusion:vortex-compact 🚨 1380532571 730982563 1.89
tpch_q03/datafusion:vortex-compact 🚨 1058497283 799397958 1.32
tpch_q04/datafusion:vortex-compact 553800461 491953195 1.13
tpch_q05/datafusion:vortex-compact 🚨 1156115302 858723574 1.35
tpch_q06/datafusion:vortex-compact 682086014 538154593 1.27
tpch_q07/datafusion:vortex-compact 1185155989 915112442 1.30
tpch_q08/datafusion:vortex-compact 🚨 1546478285 1153762214 1.34
tpch_q09/datafusion:vortex-compact 1458099871 1123107284 1.30
tpch_q10/datafusion:vortex-compact 1017701130 832794407 1.22
tpch_q11/datafusion:vortex-compact 🚨 600888423 379011708 1.59
tpch_q12/datafusion:vortex-compact 840432962 746101255 1.13
tpch_q13/datafusion:vortex-compact 467576207 436215755 1.07
tpch_q14/datafusion:vortex-compact 508227947 461631863 1.10
tpch_q15/datafusion:vortex-compact 967912816 982450489 0.99
tpch_q16/datafusion:vortex-compact 537525677 475657721 1.13
tpch_q17/datafusion:vortex-compact 1192144985 1133250683 1.05
tpch_q18/datafusion:vortex-compact 1212916944 1042421265 1.16
tpch_q19/datafusion:vortex-compact 1068919818 1012023009 1.06
tpch_q20/datafusion:vortex-compact 994504089 824000420 1.21
tpch_q21/datafusion:vortex-compact 1496175667 1315296234 1.14
tpch_q22/datafusion:vortex-compact 🚨 815755709 411783626 1.98
datafusion / parquet (1.087x ➖, 2↑ 6↓)
name PR 1f9bcaa (ns) base 5a764e6 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 934371074 855141627 1.09
tpch_q02/datafusion:parquet 🚨 1172948060 797107760 1.47
tpch_q03/datafusion:parquet 1105228477 966697674 1.14
tpch_q04/datafusion:parquet 586304208 505409059 1.16
tpch_q05/datafusion:parquet 1265156646 1255747504 1.01
tpch_q06/datafusion:parquet 653436104 593628415 1.10
tpch_q07/datafusion:parquet 1586686173 1264038355 1.26
tpch_q08/datafusion:parquet 1793511984 1513561361 1.18
tpch_q09/datafusion:parquet 1917255045 2018052567 0.95
tpch_q10/datafusion:parquet 3274075119 3072965454 1.07
tpch_q11/datafusion:parquet 🚨 1074528065 725994419 1.48
tpch_q12/datafusion:parquet 693939340 706044377 0.98
tpch_q13/datafusion:parquet 758053636 745843123 1.02
tpch_q14/datafusion:parquet 812062181 1111048365 0.73
tpch_q15/datafusion:parquet 🚀 1418311940 2370252912 0.60
tpch_q16/datafusion:parquet 🚀 459825636 1063066417 0.43
tpch_q17/datafusion:parquet 🚨 1864695377 1341511706 1.39
tpch_q18/datafusion:parquet 🚨 1969207688 1483989768 1.33
tpch_q19/datafusion:parquet 1079633991 921097146 1.17
tpch_q20/datafusion:parquet 1763945300 1364547895 1.29
tpch_q21/datafusion:parquet 🚨 2564494864 1807799075 1.42
tpch_q22/datafusion:parquet 🚨 1542462181 969341829 1.59
duckdb / vortex-file-compressed (1.125x ➖, 0↑ 0↓)
name PR 1f9bcaa (ns) base 5a764e6 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 709038231 649280698 1.09
tpch_q02/duckdb:vortex-file-compressed 1225200399 1190352097 1.03
tpch_q03/duckdb:vortex-file-compressed 859547777 842853060 1.02
tpch_q04/duckdb:vortex-file-compressed 702790802 656989021 1.07
tpch_q05/duckdb:vortex-file-compressed 1370092452 1250218892 1.10
tpch_q06/duckdb:vortex-file-compressed 611577829 563647677 1.09
tpch_q07/duckdb:vortex-file-compressed 1249320565 1222155971 1.02
tpch_q08/duckdb:vortex-file-compressed 1622503938 1406703268 1.15
tpch_q09/duckdb:vortex-file-compressed 2048792594 1711704360 1.20
tpch_q10/duckdb:vortex-file-compressed 1647989144 1345925833 1.22
tpch_q11/duckdb:vortex-file-compressed 834675290 658841437 1.27
tpch_q12/duckdb:vortex-file-compressed 1416877845 1158365752 1.22
tpch_q13/duckdb:vortex-file-compressed 933471075 788380832 1.18
tpch_q14/duckdb:vortex-file-compressed 783959861 669854073 1.17
tpch_q15/duckdb:vortex-file-compressed 630737398 553304031 1.14
tpch_q16/duckdb:vortex-file-compressed 602035405 487136950 1.24
tpch_q17/duckdb:vortex-file-compressed 1171796209 1010998727 1.16
tpch_q18/duckdb:vortex-file-compressed 1076488007 935799503 1.15
tpch_q19/duckdb:vortex-file-compressed 883558607 818963224 1.08
tpch_q20/duckdb:vortex-file-compressed 1424210203 1238003796 1.15
tpch_q21/duckdb:vortex-file-compressed 2213490730 1817574194 1.22
tpch_q22/duckdb:vortex-file-compressed 437552267 505740184 0.87
duckdb / vortex-compact (1.000x ➖, 0↑ 0↓)
name PR 1f9bcaa (ns) base 5a764e6 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 736629665 646256963 1.14
tpch_q02/duckdb:vortex-compact 1299071312 1391509824 0.93
tpch_q03/duckdb:vortex-compact 962616042 986909917 0.98
tpch_q04/duckdb:vortex-compact 630221556 677080309 0.93
tpch_q05/duckdb:vortex-compact 1257300903 1351022724 0.93
tpch_q06/duckdb:vortex-compact 611001874 538720649 1.13
tpch_q07/duckdb:vortex-compact 1263739932 1261080976 1.00
tpch_q08/duckdb:vortex-compact 1868904455 1662905840 1.12
tpch_q09/duckdb:vortex-compact 1883631367 1889474285 1.00
tpch_q10/duckdb:vortex-compact 1595500830 1568367351 1.02
tpch_q11/duckdb:vortex-compact 714545914 755943563 0.95
tpch_q12/duckdb:vortex-compact 1291785318 1130928743 1.14
tpch_q13/duckdb:vortex-compact 777130933 821081029 0.95
tpch_q14/duckdb:vortex-compact 705055562 689847627 1.02
tpch_q15/duckdb:vortex-compact 579357481 567031269 1.02
tpch_q16/duckdb:vortex-compact 442031946 482914006 0.92
tpch_q17/duckdb:vortex-compact 993764007 1018648330 0.98
tpch_q18/duckdb:vortex-compact 890201247 943695845 0.94
tpch_q19/duckdb:vortex-compact 815911765 841978117 0.97
tpch_q20/duckdb:vortex-compact 1280959979 1178222269 1.09
tpch_q21/duckdb:vortex-compact 1904188003 1933939428 0.98
tpch_q22/duckdb:vortex-compact 452436155 495638958 0.91
duckdb / parquet (1.081x ➖, 0↑ 0↓)
name PR 1f9bcaa (ns) base 5a764e6 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 925379346 989069321 0.94
tpch_q02/duckdb:parquet 1440840822 1330988076 1.08
tpch_q03/duckdb:parquet 1958988606 1817668537 1.08
tpch_q04/duckdb:parquet 1136539921 1011293938 1.12
tpch_q05/duckdb:parquet 2124791193 1878920094 1.13
tpch_q06/duckdb:parquet 932903317 914089767 1.02
tpch_q07/duckdb:parquet 2049694635 2015938897 1.02
tpch_q08/duckdb:parquet 2456838823 2502477651 0.98
tpch_q09/duckdb:parquet 2865934387 2506110891 1.14
tpch_q10/duckdb:parquet 3734177777 3770343476 0.99
tpch_q11/duckdb:parquet 1103611972 956901975 1.15
tpch_q12/duckdb:parquet 1255050689 1167175476 1.08
tpch_q13/duckdb:parquet 1501324400 1216167586 1.23
tpch_q14/duckdb:parquet 1487967701 1274329872 1.17
tpch_q15/duckdb:parquet 938412725 950124358 0.99
tpch_q16/duckdb:parquet 853482336 874813686 0.98
tpch_q17/duckdb:parquet 1447967256 1217019834 1.19
tpch_q18/duckdb:parquet 1545535948 1351025231 1.14
tpch_q19/duckdb:parquet 1565772918 1643787535 0.95
tpch_q20/duckdb:parquet 2158430768 1754659983 1.23
tpch_q21/duckdb:parquet 2013580047 1662997965 1.21
tpch_q22/duckdb:parquet 1137720951 1102669280 1.03

@github-actions

github-actions Bot commented Jun 22, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: Compression

Vortex (geomean): 1.011x ➖
Parquet (geomean): 1.032x ➖

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
unknown / unknown (1.043x ➖, 1↑ 29↓)
name PR 1f9bcaa (ns) base 5a764e6 (ns) ratio (PR/base)
compress time/Arade 1660231531 1660721813 1.00
compress time/Bimbo 6221054179 6389658100 0.97
compress time/CMSprovider 4697325877 4860455165 0.97
compress time/Euro2016 745436851 705488253 1.06
compress time/Food 620349829 633702462 0.98
compress time/HashTags 1264592666 1317439380 0.96
compress time/TPC-H l_comment canonical 2984518569 2764166395 1.08
compress time/TPC-H l_comment chunked 2728624035 2789916883 0.98
compress time/taxi 🚨 958010044 847181567 1.13
compress time/wide table cols=100 chunks=1 rows=1000 🚨 14247128 11718833 1.22
compress time/wide table cols=100 chunks=50 rows=1000 🚨 14778331 11609161 1.27
compress time/wide table cols=1000 chunks=1 rows=1000 🚨 152472143 132994097 1.15
compress time/wide table cols=1000 chunks=50 rows=1000 🚨 152410353 131658867 1.16
compress time/wide table cols=10000 chunks=1 rows=1000 🚨 1724032168 1533824341 1.12
compress time/wide table cols=10000 chunks=50 rows=1000 1573625086 1544732125 1.02
decompress time/Arade 28940183 27169950 1.07
decompress time/Bimbo 81689060 80273290 1.02
decompress time/CMSprovider 79438153 79741635 1.00
decompress time/Euro2016 19865894 21407500 0.93
decompress time/Food 8665498 8241254 1.05
decompress time/HashTags 97555803 97112862 1.00
decompress time/TPC-H l_comment canonical 🚨 54949122 41416560 1.33
decompress time/TPC-H l_comment chunked 🚨 55334398 41831953 1.32
decompress time/taxi 🚨 19987976 15129920 1.32
decompress time/wide table cols=100 chunks=1 rows=1000 🚨 3174378 2404715 1.32
decompress time/wide table cols=100 chunks=50 rows=1000 🚨 3044297 2352732 1.29
decompress time/wide table cols=1000 chunks=1 rows=1000 🚨 26758732 22874740 1.17
decompress time/wide table cols=1000 chunks=50 rows=1000 🚨 26844852 22090238 1.22
decompress time/wide table cols=10000 chunks=1 rows=1000 🚨 295375691 245755376 1.20
decompress time/wide table cols=10000 chunks=50 rows=1000 235379061 252325450 0.93
parquet size/Arade 258014282 258014282 1.00
parquet size/Bimbo 384517292 384517292 1.00
parquet size/CMSprovider 376885545 376885545 1.00
parquet size/Euro2016 122975499 122975499 1.00
parquet size/Food 35699500 35699500 1.00
parquet size/HashTags 133510943 133510943 1.00
parquet size/TPC-H l_comment canonical 158358238 158358238 1.00
parquet size/TPC-H l_comment chunked 158358238 158358238 1.00
parquet size/taxi 55283635 55283635 1.00
parquet size/wide table cols=100 chunks=1 rows=1000 932404 932404 1.00
parquet size/wide table cols=100 chunks=50 rows=1000 932404 932404 1.00
parquet size/wide table cols=1000 chunks=1 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=1000 chunks=50 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=10000 chunks=1 rows=1000 93240004 93240004 1.00
parquet size/wide table cols=10000 chunks=50 rows=1000 93240004 93240004 1.00
parquet_rs-zstd compress time/Arade 2702501169 2577080670 1.05
parquet_rs-zstd compress time/Bimbo 12687004885 12606176393 1.01
parquet_rs-zstd compress time/CMSprovider 6794138407 6800206336 1.00
parquet_rs-zstd compress time/Euro2016 1304228571 1342543570 0.97
parquet_rs-zstd compress time/Food 798604654 799636856 1.00
parquet_rs-zstd compress time/HashTags 2176960659 2294715631 0.95
parquet_rs-zstd compress time/TPC-H l_comment canonical 3471899043 3195445026 1.09
parquet_rs-zstd compress time/TPC-H l_comment chunked 3174588135 3198333523 0.99
parquet_rs-zstd compress time/taxi 🚨 1394339501 1188418513 1.17
parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000 🚨 7792561 6034249 1.29
parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000 🚨 7920182 6076797 1.30
parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000 🚨 84911467 74186649 1.14
parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000 🚨 85491434 75215631 1.14
parquet_rs-zstd compress time/wide table cols=10000 chunks=1 rows=1000 🚨 876417304 785364268 1.12
parquet_rs-zstd compress time/wide table cols=10000 chunks=50 rows=1000 881259808 804489848 1.10
parquet_rs-zstd decompress time/Arade 627318584 627819116 1.00
parquet_rs-zstd decompress time/Bimbo 1697553449 1693743057 1.00
parquet_rs-zstd decompress time/CMSprovider 1684106263 1710995511 0.98
parquet_rs-zstd decompress time/Euro2016 383151441 380256785 1.01
parquet_rs-zstd decompress time/Food 200711347 201184751 1.00
parquet_rs-zstd decompress time/HashTags 629409325 681164039 0.92
parquet_rs-zstd decompress time/TPC-H l_comment canonical 633291860 589103359 1.08
parquet_rs-zstd decompress time/TPC-H l_comment chunked 597002066 587342427 1.02
parquet_rs-zstd decompress time/taxi 🚨 286340127 246157706 1.16
parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000 🚨 3300002 2741778 1.20
parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000 🚨 3427282 2749358 1.25
parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000 🚨 36995597 31374130 1.18
parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000 🚨 37562098 32884423 1.14
parquet_rs-zstd decompress time/wide table cols=10000 chunks=1 rows=1000 374740307 344260592 1.09
parquet_rs-zstd decompress time/wide table cols=10000 chunks=50 rows=1000 376193132 350168874 1.07
vortex-file-compressed size/Arade 145358060 145358060 1.00
vortex-file-compressed size/Bimbo 467257556 467257556 1.00
vortex-file-compressed size/CMSprovider 417826428 417826868 1.00
vortex-file-compressed size/Euro2016 157307652 157019492 1.00
vortex-file-compressed size/Food 41976800 41976800 1.00
vortex-file-compressed size/HashTags 184107820 184827444 1.00
vortex-file-compressed size/TPC-H l_comment canonical 171891000 172095064 1.00
vortex-file-compressed size/TPC-H l_comment chunked 172065768 171912488 1.00
vortex-file-compressed size/taxi 52296276 52296276 1.00
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000 932512 932512 1.00
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000 932512 932512 1.00
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000 9309712 9309712 1.00
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000 9309712 9309712 1.00
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000 93117712 93117712 1.00
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000 93117712 93117712 1.00
vortex:parquet-zstd ratio compress time/Arade 0 0 0.95
vortex:parquet-zstd ratio compress time/Bimbo 0 0 0.97
vortex:parquet-zstd ratio compress time/CMSprovider 0 0 0.97
vortex:parquet-zstd ratio compress time/Euro2016 0 0 1.09
vortex:parquet-zstd ratio compress time/Food 0 0 0.98
vortex:parquet-zstd ratio compress time/HashTags 0 0 1.01
vortex:parquet-zstd ratio compress time/TPC-H l_comment canonical 0 0 0.99
vortex:parquet-zstd ratio compress time/TPC-H l_comment chunked 0 0 0.99
vortex:parquet-zstd ratio compress time/taxi 0 0 0.96
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=1 rows=1000 1 1 0.94
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=50 rows=1000 1 1 0.98
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=1 rows=1000 1 1 1.00
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=50 rows=1000 1 1 1.02
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=1 rows=1000 1 1 1.01
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=50 rows=1000 1 1 0.93
vortex:parquet-zstd ratio decompress time/Arade 0 0 1.07
vortex:parquet-zstd ratio decompress time/Bimbo 0 0 1.02
vortex:parquet-zstd ratio decompress time/CMSprovider 0 0 1.01
vortex:parquet-zstd ratio decompress time/Euro2016 0 0 0.92
vortex:parquet-zstd ratio decompress time/Food 0 0 1.05
vortex:parquet-zstd ratio decompress time/HashTags 0 0 1.09
vortex:parquet-zstd ratio decompress time/TPC-H l_comment canonical 🚨 0 0 1.23
vortex:parquet-zstd ratio decompress time/TPC-H l_comment chunked 🚨 0 0 1.30
vortex:parquet-zstd ratio decompress time/taxi 🚨 0 0 1.14
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=1 rows=1000 0 0 1.10
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=50 rows=1000 0 0 1.04
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=1 rows=1000 0 0 0.99
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=50 rows=1000 0 0 1.06
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=1 rows=1000 🚨 0 0 1.10
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=50 rows=1000 🚀 0 0 0.87
vortex:parquet-zstd size/Arade 0 0 1.00
vortex:parquet-zstd size/Bimbo 1 1 1.00
vortex:parquet-zstd size/CMSprovider 1 1 1.00
vortex:parquet-zstd size/Euro2016 1 1 1.00
vortex:parquet-zstd size/Food 1 1 1.00
vortex:parquet-zstd size/HashTags 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment canonical 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment chunked 1 1 1.00
vortex:parquet-zstd size/taxi 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=1 rows=1000 1 1 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=50 rows=1000 1 1 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=50 rows=1000 0 0 1.00

@myrrc

myrrc commented Jun 22, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor Author

Looks like there's some use-after-free happening.
Minimal request that fails with this patch is TPC-H's

~/duckdb-vortex/build/reldebug/duckdb -c " CREATE VIEW t AS (SELECT * FROM '/home/myrrc/vortex/vortex-bench/data/tpch/1.0/vortex-file-compressed/partsupp_0.vortex'); SELECT COUNT(*) FROM t a, t b WHERE a.ps_partkey = b.ps_partkey; "

@myrrc myrrc added the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Jun 22, 2026
@myrrc myrrc force-pushed the myrrc/run-end-reusable-dict-exporter branch from d5f6db4 to 787625b Compare June 22, 2026 12:00
@myrrc myrrc added action/benchmark-sql Trigger SQL benchmarks to run on this PR and removed action/benchmark-sql Trigger SQL benchmarks to run on this PR labels Jun 22, 2026
@github-actions github-actions Bot removed the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Jun 22, 2026
@myrrc

myrrc commented Jun 22, 2026

Copy link
Copy Markdown
Contributor Author

We have two options here:

  1. Fully canonicalize only for reusable dict.
  2. Make Constant and Sequence obey flatten=true and use new_exporter_with_flatten.

The best choice is likely the one that's most performant.

@myrrc myrrc requested a review from robert3005 June 22, 2026 12:06
@github-actions

github-actions Bot commented Jun 22, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe (base)

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +7.8%
Engines: DataFusion No clear signal (+2.8%, low confidence) · DuckDB No clear signal (+13.0%, low confidence)
Vortex (geomean): 1.095x ➖
Parquet (geomean): 1.016x ➖
Shifts: Parquet (control) +1.6% · Median polish +3.5%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.028x ➖, 1↑ 1↓)
name PR 787625b (ns) base e7a7ad9 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚨 5725802 4944485 1.16
fineweb_q01/datafusion:vortex-file-compressed 35028407 33043763 1.06
fineweb_q02/datafusion:vortex-file-compressed 39452522 37650273 1.05
fineweb_q03/datafusion:vortex-file-compressed 🚀 57626642 70082428 0.82
fineweb_q04/datafusion:vortex-file-compressed 283637463 273052890 1.04
fineweb_q05/datafusion:vortex-file-compressed 229417942 218726179 1.05
fineweb_q06/datafusion:vortex-file-compressed 54003994 50372025 1.07
fineweb_q07/datafusion:vortex-file-compressed 56726541 55784961 1.02
fineweb_q08/datafusion:vortex-file-compressed 22700613 22296707 1.02
datafusion / parquet (1.000x ➖, 0↑ 0↓)
name PR 787625b (ns) base e7a7ad9 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 6792522 7039505 0.96
fineweb_q01/datafusion:parquet 281242936 289201348 0.97
fineweb_q02/datafusion:parquet 296147767 297230338 1.00
fineweb_q03/datafusion:parquet 292077404 279225918 1.05
fineweb_q04/datafusion:parquet 309675142 309082387 1.00
fineweb_q05/datafusion:parquet 298464444 308799080 0.97
fineweb_q06/datafusion:parquet 293942277 290076756 1.01
fineweb_q07/datafusion:parquet 284477137 280785664 1.01
fineweb_q08/datafusion:parquet 288362880 280080218 1.03
duckdb / vortex-file-compressed (1.167x ❌, 0↑ 6↓)
name PR 787625b (ns) base e7a7ad9 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 🚨 5047509 3355148 1.50
fineweb_q01/duckdb:vortex-file-compressed 36633389 33666536 1.09
fineweb_q02/duckdb:vortex-file-compressed 41513053 38920426 1.07
fineweb_q03/duckdb:vortex-file-compressed 🚨 122027339 110303929 1.11
fineweb_q04/duckdb:vortex-file-compressed 🚨 300513988 272308717 1.10
fineweb_q05/duckdb:vortex-file-compressed 232832596 219800306 1.06
fineweb_q06/duckdb:vortex-file-compressed 🚨 58378834 51473487 1.13
fineweb_q07/duckdb:vortex-file-compressed 🚨 62627417 51590053 1.21
fineweb_q08/duckdb:vortex-file-compressed 🚨 27403308 21262482 1.29
duckdb / parquet (1.032x ➖, 0↑ 1↓)
name PR 787625b (ns) base e7a7ad9 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 33570678 34183748 0.98
fineweb_q01/duckdb:parquet 89188216 84315022 1.06
fineweb_q02/duckdb:parquet 89277383 84610829 1.06
fineweb_q03/duckdb:parquet 323434096 316035283 1.02
fineweb_q04/duckdb:parquet 458088547 446495047 1.03
fineweb_q05/duckdb:parquet 418762357 414368783 1.01
fineweb_q06/duckdb:parquet 204966710 204435329 1.00
fineweb_q07/duckdb:parquet 216685731 215490285 1.01
fineweb_q08/duckdb:parquet 🚨 37021066 32663261 1.13
File Size Changes (3 files changed, -46.4% overall, 0↑ 3↓)
File Scale Format Base HEAD Change %
sample.vortex 1.0 vortex-file-compressed 1.43 GB 1.43 GB 2.96 MB -0.2%
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%
sample.vortex 1.0 vortex-compact 1.23 GB 0 B 1.23 GB -100.0%

Totals:

  • vortex-compact: 1.23 GB → 0 B (-100.0%)
  • vortex-file-compressed: 1.43 GB → 1.43 GB (-0.2%)

@github-actions

github-actions Bot commented Jun 22, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling (base)

Vortex (geomean): 1.165x ❌

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.165x ❌, 0↑ 5↓)
name PR 787625b (ns) base e7a7ad9 (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 117386067 117143272 1.00
polarsignals_q01/datafusion:vortex-file-compressed 🚨 328473086 268836105 1.22
polarsignals_q02/datafusion:vortex-file-compressed 30290766 30163526 1.00
polarsignals_q03/datafusion:vortex-file-compressed 🚨 393126451 280596777 1.40
polarsignals_q04/datafusion:vortex-file-compressed 🚨 14195946 10013325 1.42
polarsignals_q05/datafusion:vortex-file-compressed 🚨 18409082 13573934 1.36
polarsignals_q06/datafusion:vortex-file-compressed 22285643 20862885 1.07
polarsignals_q07/datafusion:vortex-file-compressed 🚨 14174856 11427005 1.24
polarsignals_q08/datafusion:vortex-file-compressed 406370554 385321330 1.05
polarsignals_q09/datafusion:vortex-file-compressed 12300222 12406173 0.99

No file size changes detected.

@github-actions

github-actions Bot commented Jun 22, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 (base)

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +9.9%
Engines: DataFusion No clear signal (+23.3%, environment too noisy confidence) · DuckDB No clear signal (-2.0%, environment too noisy confidence)
Vortex (geomean): 1.231x ➖
Parquet (geomean): 1.120x ➖
Shifts: Parquet (control) +12.0% · Median polish +12.6%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.373x ❌, 0↑ 14↓)
name PR 787625b (ns) base e7a7ad9 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 328260631 282195896 1.16
tpch_q02/datafusion:vortex-file-compressed 🚨 702841215 506267268 1.39
tpch_q03/datafusion:vortex-file-compressed 651990463 544337127 1.20
tpch_q04/datafusion:vortex-file-compressed 🚨 392250050 251214537 1.56
tpch_q05/datafusion:vortex-file-compressed 🚨 747039118 486442320 1.54
tpch_q06/datafusion:vortex-file-compressed 🚨 553171480 379848050 1.46
tpch_q07/datafusion:vortex-file-compressed 🚨 873954898 527898413 1.66
tpch_q08/datafusion:vortex-file-compressed 🚨 1021942298 595433728 1.72
tpch_q09/datafusion:vortex-file-compressed 🚨 690685465 409823108 1.69
tpch_q10/datafusion:vortex-file-compressed 🚨 755162737 428884971 1.76
tpch_q11/datafusion:vortex-file-compressed 🚨 398084996 301347578 1.32
tpch_q12/datafusion:vortex-file-compressed 495999760 570942443 0.87
tpch_q13/datafusion:vortex-file-compressed 273454640 219552874 1.25
tpch_q14/datafusion:vortex-file-compressed 379855463 326575321 1.16
tpch_q15/datafusion:vortex-file-compressed 687479066 669213457 1.03
tpch_q16/datafusion:vortex-file-compressed 🚨 389878916 265721214 1.47
tpch_q17/datafusion:vortex-file-compressed 🚨 606233297 433991261 1.40
tpch_q18/datafusion:vortex-file-compressed 🚨 505458577 383136556 1.32
tpch_q19/datafusion:vortex-file-compressed 786214830 625199279 1.26
tpch_q20/datafusion:vortex-file-compressed 513490546 453816671 1.13
tpch_q21/datafusion:vortex-file-compressed 🚨 775711399 535914061 1.45
tpch_q22/datafusion:vortex-file-compressed 🚨 383462176 195263562 1.96
datafusion / parquet (1.114x ➖, 0↑ 5↓)
name PR 787625b (ns) base e7a7ad9 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 228408520 211171414 1.08
tpch_q02/datafusion:parquet 450428730 393349141 1.15
tpch_q03/datafusion:parquet 346725227 327751728 1.06
tpch_q04/datafusion:parquet 🚨 196341061 150110761 1.31
tpch_q05/datafusion:parquet 484057339 482023749 1.00
tpch_q06/datafusion:parquet 166688714 215074694 0.78
tpch_q07/datafusion:parquet 500618053 548507749 0.91
tpch_q08/datafusion:parquet 625822576 541449424 1.16
tpch_q09/datafusion:parquet 🚨 671549130 473091200 1.42
tpch_q10/datafusion:parquet 531161571 489913283 1.08
tpch_q11/datafusion:parquet 398930357 379797137 1.05
tpch_q12/datafusion:parquet 344340301 272823520 1.26
tpch_q13/datafusion:parquet 494360599 461882391 1.07
tpch_q14/datafusion:parquet 200008050 221707779 0.90
tpch_q15/datafusion:parquet 428957297 386357209 1.11
tpch_q16/datafusion:parquet 258309456 212501385 1.22
tpch_q17/datafusion:parquet 466187612 504314920 0.92
tpch_q18/datafusion:parquet 533490758 503963803 1.06
tpch_q19/datafusion:parquet 436880676 442100577 0.99
tpch_q20/datafusion:parquet 🚨 543878417 416380289 1.31
tpch_q21/datafusion:parquet 🚨 826945814 593809743 1.39
tpch_q22/datafusion:parquet 🚨 330706339 203656200 1.62
duckdb / vortex-file-compressed (1.104x ➖, 0↑ 3↓)
name PR 787625b (ns) base e7a7ad9 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 🚨 387365289 279707252 1.38
tpch_q02/duckdb:vortex-file-compressed 1088399856 1101014594 0.99
tpch_q03/duckdb:vortex-file-compressed 768120250 651004135 1.18
tpch_q04/duckdb:vortex-file-compressed 491971293 471995232 1.04
tpch_q05/duckdb:vortex-file-compressed 944994842 866485549 1.09
tpch_q06/duckdb:vortex-file-compressed 357030610 371969666 0.96
tpch_q07/duckdb:vortex-file-compressed 1048220626 973273322 1.08
tpch_q08/duckdb:vortex-file-compressed 1183302087 1116968664 1.06
tpch_q09/duckdb:vortex-file-compressed 1105908819 1075942867 1.03
tpch_q10/duckdb:vortex-file-compressed 931041367 740111233 1.26
tpch_q11/duckdb:vortex-file-compressed 486858627 547142655 0.89
tpch_q12/duckdb:vortex-file-compressed 721622109 761465706 0.95
tpch_q13/duckdb:vortex-file-compressed 🚨 543813981 415712510 1.31
tpch_q14/duckdb:vortex-file-compressed 548907626 449576286 1.22
tpch_q15/duckdb:vortex-file-compressed 358476696 319554294 1.12
tpch_q16/duckdb:vortex-file-compressed 404033768 343167064 1.18
tpch_q17/duckdb:vortex-file-compressed 808031840 750758764 1.08
tpch_q18/duckdb:vortex-file-compressed 653267992 605694365 1.08
tpch_q19/duckdb:vortex-file-compressed 🚨 715813597 508240553 1.41
tpch_q20/duckdb:vortex-file-compressed 853167971 807683119 1.06
tpch_q21/duckdb:vortex-file-compressed 1157658651 1073373578 1.08
tpch_q22/duckdb:vortex-file-compressed 281006874 274454169 1.02
duckdb / parquet (1.127x ➖, 0↑ 1↓)
name PR 787625b (ns) base e7a7ad9 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 513688035 509991238 1.01
tpch_q02/duckdb:parquet 1286188484 1149117780 1.12
tpch_q03/duckdb:parquet 1188313762 1062267598 1.12
tpch_q04/duckdb:parquet 804994712 639437392 1.26
tpch_q05/duckdb:parquet 1461458547 1258427161 1.16
tpch_q06/duckdb:parquet 437064451 407939278 1.07
tpch_q07/duckdb:parquet 1381747239 1242171489 1.11
tpch_q08/duckdb:parquet 1924178320 1599550447 1.20
tpch_q09/duckdb:parquet 1621050697 1422332206 1.14
tpch_q10/duckdb:parquet 1318576066 1372008764 0.96
tpch_q11/duckdb:parquet 802113341 836250393 0.96
tpch_q12/duckdb:parquet 893559796 718991425 1.24
tpch_q13/duckdb:parquet 1009553958 990608702 1.02
tpch_q14/duckdb:parquet 905398468 782272508 1.16
tpch_q15/duckdb:parquet 601514848 572312099 1.05
tpch_q16/duckdb:parquet 737902586 624033426 1.18
tpch_q17/duckdb:parquet 926673602 775702993 1.19
tpch_q18/duckdb:parquet 🚨 1203953332 904436693 1.33
tpch_q19/duckdb:parquet 933422424 771798345 1.21
tpch_q20/duckdb:parquet 1251077701 1199316457 1.04
tpch_q21/duckdb:parquet 1311964584 1118275571 1.17
tpch_q22/duckdb:parquet 615904448 531108378 1.16

@myrrc myrrc force-pushed the myrrc/run-end-reusable-dict-exporter branch 2 times, most recently from f64e4a9 to 6b621e6 Compare June 22, 2026 13:00
@myrrc myrrc added the action/benchmark Trigger full benchmarks to run on this PR label Jun 22, 2026
@myrrc myrrc marked this pull request as ready for review June 22, 2026 13:01
@myrrc myrrc requested a review from a team June 22, 2026 13:01
@myrrc myrrc enabled auto-merge (squash) June 22, 2026 13:02
@github-actions github-actions Bot removed the action/benchmark Trigger full benchmarks to run on this PR label Jun 22, 2026
@myrrc myrrc disabled auto-merge June 22, 2026 13:02
@myrrc myrrc force-pushed the myrrc/run-end-reusable-dict-exporter branch from 6b621e6 to 40004d4 Compare June 22, 2026 13:09
@myrrc myrrc added the action/benchmark Trigger full benchmarks to run on this PR label Jun 22, 2026
@github-actions github-actions Bot removed the action/benchmark Trigger full benchmarks to run on this PR label Jun 22, 2026
@myrrc myrrc mentioned this pull request Jun 22, 2026
Merged
@myrrc myrrc removed the request for review from robert3005 June 22, 2026 13:20
@myrrc

myrrc commented Jun 22, 2026

Copy link
Copy Markdown
Contributor Author

There is a fineweb q1 2x regression with flattening constant/sequence, not sure whether it's a real regression

@0ax1 0ax1 self-requested a review June 22, 2026 14:22
@0ax1

0ax1 commented Jun 22, 2026

Copy link
Copy Markdown
Contributor

@claude review in depth

@github-actions

github-actions Bot commented Jun 22, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Claude finished @0ax1's task in 4m 9s —— View job

In-depth review — ReusableDict for RunEnd duckdb exporter

I read the full diff and the surrounding machinery (cached_values_dict, ReusableDict/reuse_dictionary FFI, SelectionVector, the flatten dispatch in mod.rs, and the C++ reusable_dict.cpp). Overall this is a solid, well-motivated change: the shared cached_values_dict helper removes real duplication, and routing Constant/Sequence through flatten=true is the correct fix for the garbage-read the self-join exposed. Below are the things worth addressing.

✅ What's correct

  • Root-cause fix is sound. The "use-after-free"/garbage data came from putting non-flat child vectors (SEQUENCE/CONSTANT, which have no T data buffer) into a ReusableDict and letting duckdb (TupleDataScatter) read them as T. Forcing flatten=true in cached_values_dict canonicalizes those into flat storage. The inline comment in mod.rs:210-214 documents this well.
  • The lifetime is safe. vector->Dictionary(buffer, sel) stores the buffer_ptr<VectorChildBuffer> (a shared_ptr) as the output vector's auxiliary, so the dictionary outlives the exporter/cache. ReusableDict::clone shares the same refcounted buffer. No dangling once the values are flat.
  • Run-end re-indexing is correct. Switching to global_run_idx = start_run_idx + run_idx indexing into the full cached dict (size values.len()) is consistent: end_run_idx ≤ values.len()-1, so all selection indices are in-bounds, and the dict holds every run value globally.
  • end_offset reuse (replacing the recomputed offset.add(len) in the end_run_idx search) is behavior-preserving and a nice cleanup.
  • dict.rs dedup is equivalent to the old inline else branch.

⚠️ Issues / suggestions

1. assert! → debug_assert! downgrade at an unsafe FFI boundary (run_end.rs:119).
The old code had a hard assert!(sel_vec_slice.is_empty(), ...). SelectionVector::with_capacity allocates via duckdb_create_selection_vector and is not zero-initialized (selection_vector.rs:16-27). If the fill loop ever leaves a tail unfilled in a release build, reuse_dictionary will read uninitialized u32 indices and index out-of-bounds into the dictionary child — i.e. exactly the class of memory-safety bug this PR is fixing. The invariant should hold mathematically, but this guard is cheap relative to the per-row work it protects. Recommend keeping it a real assert! (or vortex_ensure!).
Fix this →

2. Eager full materialization is the likely source of the fineweb q1 regression.
Previously run-end values were exported lazily, per output chunk, bounded by values_len ≤ len. Now cached_values_dict canonicalizes and exports the entire values child (all runs) up front, once, into a dict sized values.len(). For tall/high-run-count REE columns this is strictly more eager work, and for Sequence/Constant values the new flatten path materializes what used to be O(1). That tradeoff (correctness over the buggy fast path) is the right call, but it's worth confirming the fineweb q1 2× is this and not something pathological. Note also that when every export call hits the start_run_idx == end_run_idx constant short-circuit, the eagerly-built dict is never used — wasted materialization.

3. List values bypass flatten (mod.rs:257-260).
list::new_exporter does not take/honor flatten, so a REE/Dict whose values are a List array would store a non-flattened list exporter's output into the ReusableDict. List vectors do have real child storage so this is probably safe, but it's the same shape as the bug being fixed here. Worth a quick confirmation (or a guard/test) that reuse_dictionary over a list child is sound.

4. Missing regression test for the actual fix.
Per CLAUDE.md ("add or identify a failing test first; a test that passes before and after the fix does not prove the fix"), the existing run_end_with_chunked_values_exports_across_value_chunks uses primitive values, which would not have reproduced the garbage read. A test that exports a RunEnd (or Dict) whose values are a Sequence/Constant through the reusable-dict path — ideally the self-join shape from the partsupp repro — would fail before the flatten change and pass after. Recommend adding one.

Nits

  • cached_values_dict correctly keys on values.addr() and stores the ArrayRef to pin the address — consistent with the existing cache contract. Good.
  • No leftover unused imports spotted (new_array_exporter_with_flatten removed from both dict.rs and run_end.rs; cached_values_dict/ReusableDict added where used).

I did not run a local build — vortex-duckdb requires the duckdb C++ toolchain, which is heavy for a review pass. The notes above are from static analysis; #1 (the debug_assert!) and #4 (regression test) are the two I'd most want addressed before merge.
· branch myrrc/run-end-reusable-dict-exporter

@myrrc

myrrc commented Jun 22, 2026

Copy link
Copy Markdown
Contributor Author

I'll recheck the performance and merge if it doesn't reproduce

0ax1
0ax1 reviewed Jun 22, 2026
View reviewed changes
Comment thread vortex-duckdb/src/exporter/mod.rs
0ax1
0ax1 reviewed Jun 22, 2026
View reviewed changes
Comment thread vortex-duckdb/src/exporter/sequence.rs
@myrrc myrrc force-pushed the myrrc/run-end-reusable-dict-exporter branch from 40004d4 to 1f9bcaa Compare June 23, 2026 09:25
@myrrc myrrc added the action/benchmark Trigger full benchmarks to run on this PR label Jun 23, 2026
@github-actions github-actions Bot removed the action/benchmark Trigger full benchmarks to run on this PR label Jun 23, 2026
@myrrc

myrrc commented Jun 23, 2026

Copy link
Copy Markdown
Contributor Author

Turns out this was a flaky run, merging

@myrrc myrrc merged commit 40a7857 into develop Jun 23, 2026
109 of 113 checks passed
@myrrc myrrc deleted the myrrc/run-end-reusable-dict-exporter branch June 23, 2026 10:05
@myrrc myrrc mentioned this pull request Jun 23, 2026
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@0ax1 0ax1 0ax1 approved these changes

Assignees

No one assigned

Labels

changelog/performance A performance improvement ext/duckdb Relates to the DuckDB integration

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@myrrc @0ax1