Thanks to visit codestin.com
Credit goes to github.com

Skip to content

mmap for file reads#8450

Draft
myrrc wants to merge 1 commit into
developfrom
myrrc/temp-mmap
Draft

mmap for file reads#8450
myrrc wants to merge 1 commit into
developfrom
myrrc/temp-mmap

Conversation

@myrrc

@myrrc myrrc commented Jun 16, 2026

Copy link
Copy Markdown
Contributor

TODO

@myrrc myrrc added the action/benchmark Trigger full benchmarks to run on this PR label Jun 16, 2026
@github-actions github-actions Bot removed the action/benchmark Trigger full benchmarks to run on this PR label Jun 16, 2026
@github-actions

github-actions Bot commented Jun 16, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done a1510c1 1 Explore Profiling Data

Powered by Polar Signals Cloud

@codspeed-hq

codspeed-hq Bot commented Jun 16, 2026

Copy link
Copy Markdown

Merging this PR will improve performance by 24.12%

⚠️ Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.

For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

⚡ 4 improved benchmarks
✅ 1541 untouched benchmarks
⏩ 10 skipped benchmarks1

Performance Changes

Mode Benchmark BASE HEAD Efficiency
⚡ Simulation decompress_rd[f64, (10000, 0.01)] 137.7 µs 107.2 µs +28.41%
⚡ Simulation decompress_rd[f64, (10000, 0.0)] 138.3 µs 107.8 µs +28.25%
⚡ Simulation decompress_rd[f64, (10000, 0.1)] 138.1 µs 111.6 µs +23.79%
⚡ Simulation varbinview_large 131.2 µs 112.7 µs +16.42%

Tip

Curious why this is faster? Comment @codspeedbot explain why this is faster on this PR, or directly use the CodSpeed MCP with your agent.

Comparing myrrc/temp-mmap (a1510c1) with develop (e1c6ef5)

Open in CodSpeed

Footnotes

  1. 10 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports. ↩

@github-actions

github-actions Bot commented Jun 16, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling

Vortex (geomean): 1.009x ➖

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.009x ➖, 0↑ 0↓)
name PR a1510c1 (ns) base 67a2b22 (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 118334313 113204016 1.05
polarsignals_q01/datafusion:vortex-file-compressed 259773588 261889573 0.99
polarsignals_q02/datafusion:vortex-file-compressed 23177649 24715271 0.94
polarsignals_q03/datafusion:vortex-file-compressed 275153194 268420036 1.03
polarsignals_q04/datafusion:vortex-file-compressed 9454137 9197135 1.03
polarsignals_q05/datafusion:vortex-file-compressed 14077526 14634840 0.96
polarsignals_q06/datafusion:vortex-file-compressed 21243261 20124257 1.06
polarsignals_q07/datafusion:vortex-file-compressed 13801992 13010010 1.06
polarsignals_q08/datafusion:vortex-file-compressed 390355210 386723820 1.01
polarsignals_q09/datafusion:vortex-file-compressed 11573002 11746656 0.99

No file size changes detected.

@github-actions

github-actions Bot commented Jun 16, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -2.4%
Engines: DataFusion No clear signal (-1.7%, low confidence) · DuckDB No clear signal (-3.2%, low confidence)
Vortex (geomean): 0.943x ➖
Parquet (geomean): 0.967x ➖
Shifts: Parquet (control) -3.3% · Median polish -3.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.940x ➖, 2↑ 0↓)
name PR a1510c1 (ns) base 67a2b22 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚀 4835223 5969165 0.81
fineweb_q01/datafusion:vortex-file-compressed 33170634 35113057 0.94
fineweb_q02/datafusion:vortex-file-compressed 37122344 38571488 0.96
fineweb_q03/datafusion:vortex-file-compressed 🚀 63705238 71297663 0.89
fineweb_q04/datafusion:vortex-file-compressed 277316618 285048710 0.97
fineweb_q05/datafusion:vortex-file-compressed 219783722 224428293 0.98
fineweb_q06/datafusion:vortex-file-compressed 49970879 51474277 0.97
fineweb_q07/datafusion:vortex-file-compressed 55035622 59492350 0.93
fineweb_q08/datafusion:vortex-file-compressed 23163285 22813173 1.02
datafusion / vortex-compact (0.966x ➖, 0↑ 0↓)
name PR a1510c1 (ns) base 67a2b22 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 5652172 5851620 0.97
fineweb_q01/datafusion:vortex-compact 98494667 101246582 0.97
fineweb_q02/datafusion:vortex-compact 108449009 115390566 0.94
fineweb_q03/datafusion:vortex-compact 864297121 890089508 0.97
fineweb_q04/datafusion:vortex-compact 908307598 945556437 0.96
fineweb_q05/datafusion:vortex-compact 835564262 849717205 0.98
fineweb_q06/datafusion:vortex-compact 465372831 481856252 0.97
fineweb_q07/datafusion:vortex-compact 479938213 493364540 0.97
fineweb_q08/datafusion:vortex-compact 22529867 23339298 0.97
datafusion / parquet (0.969x ➖, 0↑ 0↓)
name PR a1510c1 (ns) base 67a2b22 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 6598169 6918414 0.95
fineweb_q01/datafusion:parquet 281494371 295703719 0.95
fineweb_q02/datafusion:parquet 292394176 301491875 0.97
fineweb_q03/datafusion:parquet 297816370 300112058 0.99
fineweb_q04/datafusion:parquet 304276239 320480419 0.95
fineweb_q05/datafusion:parquet 301224871 309898019 0.97
fineweb_q06/datafusion:parquet 303973649 306341688 0.99
fineweb_q07/datafusion:parquet 283929300 291119622 0.98
fineweb_q08/datafusion:parquet 275482578 284820869 0.97
duckdb / vortex-file-compressed (0.912x ➖, 1↑ 0↓)
name PR a1510c1 (ns) base 67a2b22 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 3417149 3488362 0.98
fineweb_q01/duckdb:vortex-file-compressed 32075076 33844782 0.95
fineweb_q02/duckdb:vortex-file-compressed 38553717 41795673 0.92
fineweb_q03/duckdb:vortex-file-compressed 🚀 110356853 164892689 0.67
fineweb_q04/duckdb:vortex-file-compressed 282227636 276836330 1.02
fineweb_q05/duckdb:vortex-file-compressed 212497966 221968221 0.96
fineweb_q06/duckdb:vortex-file-compressed 49836282 53125364 0.94
fineweb_q07/duckdb:vortex-file-compressed 50807961 55893733 0.91
fineweb_q08/duckdb:vortex-file-compressed 21252083 23305959 0.91
duckdb / vortex-compact (0.957x ➖, 2↑ 0↓)
name PR a1510c1 (ns) base 67a2b22 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 🚀 4139644 5057193 0.82
fineweb_q01/duckdb:vortex-compact 🚀 101154797 122190141 0.83
fineweb_q02/duckdb:vortex-compact 110166397 114405042 0.96
fineweb_q03/duckdb:vortex-compact 852392170 864308509 0.99
fineweb_q04/duckdb:vortex-compact 901594014 907812047 0.99
fineweb_q05/duckdb:vortex-compact 812359666 804866562 1.01
fineweb_q06/duckdb:vortex-compact 463895288 468265090 0.99
fineweb_q07/duckdb:vortex-compact 481458464 470592287 1.02
fineweb_q08/duckdb:vortex-compact 19274232 18794280 1.03
duckdb / parquet (0.965x ➖, 1↑ 0↓)
name PR a1510c1 (ns) base 67a2b22 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 32602907 33227091 0.98
fineweb_q01/duckdb:parquet 84761201 86284199 0.98
fineweb_q02/duckdb:parquet 84718603 87099323 0.97
fineweb_q03/duckdb:parquet 316488601 320157006 0.99
fineweb_q04/duckdb:parquet 445271929 455080465 0.98
fineweb_q05/duckdb:parquet 414263984 421924800 0.98
fineweb_q06/duckdb:parquet 203435248 209594600 0.97
fineweb_q07/duckdb:parquet 215107518 222389395 0.97
fineweb_q08/duckdb:parquet 🚀 32306776 37318452 0.87
File Size Changes (1 files changed, +0.0% overall, 1↑ 0↓)
File Scale Format Base HEAD Change %
sample.vortex 1.0 vortex-file-compressed 1.43 GB 1.43 GB +1.27 MB +0.1%

Totals:

  • vortex-compact: 1.23 GB → 1.23 GB (0.0%)
  • vortex-file-compressed: 1.43 GB → 1.43 GB (+0.1%)

@github-actions

github-actions Bot commented Jun 16, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -0.0%
Engines: DataFusion No clear signal (+0.6%, environment too noisy confidence) · DuckDB No clear signal (-0.6%, environment too noisy confidence)
Vortex (geomean): 0.939x ➖
Parquet (geomean): 0.936x ➖
Shifts: Parquet (control) -6.4% · Median polish -6.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.932x ➖, 2↑ 0↓)
name PR a1510c1 (ns) base 67a2b22 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 49774152 53872525 0.92
tpch_q02/datafusion:vortex-file-compressed 22880762 25144857 0.91
tpch_q03/datafusion:vortex-file-compressed 🚀 30598500 34383913 0.89
tpch_q04/datafusion:vortex-file-compressed 20775119 21337916 0.97
tpch_q05/datafusion:vortex-file-compressed 46428214 49769136 0.93
tpch_q06/datafusion:vortex-file-compressed 10102991 10467543 0.97
tpch_q07/datafusion:vortex-file-compressed 52234578 56604234 0.92
tpch_q08/datafusion:vortex-file-compressed 40112287 42878972 0.94
tpch_q09/datafusion:vortex-file-compressed 52605260 58413402 0.90
tpch_q10/datafusion:vortex-file-compressed 33509291 36179481 0.93
tpch_q11/datafusion:vortex-file-compressed 17010452 17148357 0.99
tpch_q12/datafusion:vortex-file-compressed 23252023 24672257 0.94
tpch_q13/datafusion:vortex-file-compressed 27143253 29287827 0.93
tpch_q14/datafusion:vortex-file-compressed 14778812 15756040 0.94
tpch_q15/datafusion:vortex-file-compressed 23103620 23795156 0.97
tpch_q16/datafusion:vortex-file-compressed 19778471 21959213 0.90
tpch_q17/datafusion:vortex-file-compressed 66265475 72675316 0.91
tpch_q18/datafusion:vortex-file-compressed 75690273 82027948 0.92
tpch_q19/datafusion:vortex-file-compressed 17738306 17920234 0.99
tpch_q20/datafusion:vortex-file-compressed 31388076 32791735 0.96
tpch_q21/datafusion:vortex-file-compressed 🚀 69752477 80091997 0.87
tpch_q22/datafusion:vortex-file-compressed 12067976 13153899 0.92
datafusion / vortex-compact (0.932x ➖, 2↑ 0↓)
name PR a1510c1 (ns) base 67a2b22 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 58050591 62932709 0.92
tpch_q02/datafusion:vortex-compact 26141601 27357202 0.96
tpch_q03/datafusion:vortex-compact 🚀 32858390 36746639 0.89
tpch_q04/datafusion:vortex-compact 22276355 23795894 0.94
tpch_q05/datafusion:vortex-compact 48360945 52298574 0.92
tpch_q06/datafusion:vortex-compact 12904951 13479151 0.96
tpch_q07/datafusion:vortex-compact 55011055 61095772 0.90
tpch_q08/datafusion:vortex-compact 43175822 46406385 0.93
tpch_q09/datafusion:vortex-compact 54836054 60023287 0.91
tpch_q10/datafusion:vortex-compact 36702923 39690516 0.92
tpch_q11/datafusion:vortex-compact 17453139 18703675 0.93
tpch_q12/datafusion:vortex-compact 29952344 31045770 0.96
tpch_q13/datafusion:vortex-compact 32387292 34255306 0.95
tpch_q14/datafusion:vortex-compact 18607231 20216519 0.92
tpch_q15/datafusion:vortex-compact 30848050 31741472 0.97
tpch_q16/datafusion:vortex-compact 24157966 26442394 0.91
tpch_q17/datafusion:vortex-compact 🚀 69821274 78130109 0.89
tpch_q18/datafusion:vortex-compact 76607024 82390397 0.93
tpch_q19/datafusion:vortex-compact 40299968 42674422 0.94
tpch_q20/datafusion:vortex-compact 36088187 37266177 0.97
tpch_q21/datafusion:vortex-compact 74617175 80656815 0.93
tpch_q22/datafusion:vortex-compact 13415350 14333616 0.94
datafusion / parquet (0.919x ➖, 8↑ 0↓)
name PR a1510c1 (ns) base 67a2b22 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 🚀 111520408 142252236 0.78
tpch_q02/datafusion:parquet 61719459 64494337 0.96
tpch_q03/datafusion:parquet 81649131 87649628 0.93
tpch_q04/datafusion:parquet 46966015 48728662 0.96
tpch_q05/datafusion:parquet 🚀 93024642 105687939 0.88
tpch_q06/datafusion:parquet 42485360 42725649 0.99
tpch_q07/datafusion:parquet 102073898 109801259 0.93
tpch_q08/datafusion:parquet 96088404 95213492 1.01
tpch_q09/datafusion:parquet 129186748 127877035 1.01
tpch_q10/datafusion:parquet 🚀 112643714 126619631 0.89
tpch_q11/datafusion:parquet 40876075 43311421 0.94
tpch_q12/datafusion:parquet 🚀 73157430 90558480 0.81
tpch_q13/datafusion:parquet 🚀 191457350 217003552 0.88
tpch_q14/datafusion:parquet 🚀 42201720 47157559 0.89
tpch_q15/datafusion:parquet 🚀 59508415 67688384 0.88
tpch_q16/datafusion:parquet 42258582 46876342 0.90
tpch_q17/datafusion:parquet 🚀 141956362 158813820 0.89
tpch_q18/datafusion:parquet 156377689 164221620 0.95
tpch_q19/datafusion:parquet 72984811 79918201 0.91
tpch_q20/datafusion:parquet 71385684 77522013 0.92
tpch_q21/datafusion:parquet 142023947 150763496 0.94
tpch_q22/datafusion:parquet 46143345 47668442 0.97
datafusion / arrow (0.907x ➖, 9↑ 0↓)
name PR a1510c1 (ns) base 67a2b22 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 🚀 57404443 63937065 0.90
tpch_q02/datafusion:arrow 17069778 17649671 0.97
tpch_q03/datafusion:arrow 32225989 35685942 0.90
tpch_q04/datafusion:arrow 🚀 26569818 30282743 0.88
tpch_q05/datafusion:arrow 60964786 61601258 0.99
tpch_q06/datafusion:arrow 22428999 23460226 0.96
tpch_q07/datafusion:arrow 107290745 117736288 0.91
tpch_q08/datafusion:arrow 🚀 42718948 47544188 0.90
tpch_q09/datafusion:arrow 🚀 64054895 75253514 0.85
tpch_q10/datafusion:arrow 🚀 48063896 56942525 0.84
tpch_q11/datafusion:arrow 9205523 9537431 0.97
tpch_q12/datafusion:arrow 50287665 54454757 0.92
tpch_q13/datafusion:arrow 44929736 49603802 0.91
tpch_q14/datafusion:arrow 🚀 23030023 26648422 0.86
tpch_q15/datafusion:arrow 🚀 44698811 52471307 0.85
tpch_q16/datafusion:arrow 16571269 18267287 0.91
tpch_q17/datafusion:arrow 68146933 73103694 0.93
tpch_q18/datafusion:arrow 🚀 109030757 122027231 0.89
tpch_q19/datafusion:arrow 36990131 40668608 0.91
tpch_q20/datafusion:arrow 35758297 39282408 0.91
tpch_q21/datafusion:arrow 🚀 153978773 171768713 0.90
tpch_q22/datafusion:arrow 12163332 13156454 0.92
duckdb / vortex-file-compressed (0.945x ➖, 1↑ 0↓)
name PR a1510c1 (ns) base 67a2b22 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 31385844 32503843 0.97
tpch_q02/duckdb:vortex-file-compressed 25572486 26089183 0.98
tpch_q03/duckdb:vortex-file-compressed 33374910 35032159 0.95
tpch_q04/duckdb:vortex-file-compressed 29332686 30706255 0.96
tpch_q05/duckdb:vortex-file-compressed 37153704 40978993 0.91
tpch_q06/duckdb:vortex-file-compressed 8186486 8416719 0.97
tpch_q07/duckdb:vortex-file-compressed 35105350 37279663 0.94
tpch_q08/duckdb:vortex-file-compressed 36604129 40135315 0.91
tpch_q09/duckdb:vortex-file-compressed 58201989 63502479 0.92
tpch_q10/duckdb:vortex-file-compressed 42267808 43493760 0.97
tpch_q11/duckdb:vortex-file-compressed 15433264 15217834 1.01
tpch_q12/duckdb:vortex-file-compressed 22842201 23151131 0.99
tpch_q13/duckdb:vortex-file-compressed 41644043 43734121 0.95
tpch_q14/duckdb:vortex-file-compressed 21991579 23267577 0.95
tpch_q15/duckdb:vortex-file-compressed 16905938 18177302 0.93
tpch_q16/duckdb:vortex-file-compressed 30101275 30374823 0.99
tpch_q17/duckdb:vortex-file-compressed 24186447 26477953 0.91
tpch_q18/duckdb:vortex-file-compressed 53226077 56449095 0.94
tpch_q19/duckdb:vortex-file-compressed 🚀 29344349 33300412 0.88
tpch_q20/duckdb:vortex-file-compressed 33425680 36362033 0.92
tpch_q21/duckdb:vortex-file-compressed 100861958 111409257 0.91
tpch_q22/duckdb:vortex-file-compressed 17519597 18741938 0.93
duckdb / vortex-compact (0.947x ➖, 2↑ 0↓)
name PR a1510c1 (ns) base 67a2b22 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 39283951 39654319 0.99
tpch_q02/duckdb:vortex-compact 32359817 35644039 0.91
tpch_q03/duckdb:vortex-compact 35663704 36723531 0.97
tpch_q04/duckdb:vortex-compact 31668978 33360002 0.95
tpch_q05/duckdb:vortex-compact 41478651 43584282 0.95
tpch_q06/duckdb:vortex-compact 🚀 10405300 12033532 0.86
tpch_q07/duckdb:vortex-compact 41186099 43649582 0.94
tpch_q08/duckdb:vortex-compact 42060350 44864471 0.94
tpch_q09/duckdb:vortex-compact 67019500 68172767 0.98
tpch_q10/duckdb:vortex-compact 46218815 47319548 0.98
tpch_q11/duckdb:vortex-compact 18907061 19590356 0.97
tpch_q12/duckdb:vortex-compact 29947416 30742428 0.97
tpch_q13/duckdb:vortex-compact 47603033 49583108 0.96
tpch_q14/duckdb:vortex-compact 26436604 27697977 0.95
tpch_q15/duckdb:vortex-compact 19877423 21029740 0.95
tpch_q16/duckdb:vortex-compact 31917054 34461611 0.93
tpch_q17/duckdb:vortex-compact 29286721 31869974 0.92
tpch_q18/duckdb:vortex-compact 54156750 55772038 0.97
tpch_q19/duckdb:vortex-compact 🚀 33076738 36843014 0.90
tpch_q20/duckdb:vortex-compact 40739843 41276634 0.99
tpch_q21/duckdb:vortex-compact 103303029 113026863 0.91
tpch_q22/duckdb:vortex-compact 18975898 20060003 0.95
duckdb / parquet (0.953x ➖, 4↑ 0↓)
name PR a1510c1 (ns) base 67a2b22 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 77895707 78381505 0.99
tpch_q02/duckdb:parquet 39974754 41924819 0.95
tpch_q03/duckdb:parquet 71458227 73429613 0.97
tpch_q04/duckdb:parquet 55958210 51648683 1.08
tpch_q05/duckdb:parquet 68747696 70209059 0.98
tpch_q06/duckdb:parquet 23035997 23271204 0.99
tpch_q07/duckdb:parquet 77919372 73394370 1.06
tpch_q08/duckdb:parquet 🚀 82956327 99431102 0.83
tpch_q09/duckdb:parquet 🚀 135418764 152399768 0.89
tpch_q10/duckdb:parquet 127375145 134672469 0.95
tpch_q11/duckdb:parquet 22691021 23396998 0.97
tpch_q12/duckdb:parquet 🚀 46888783 58409713 0.80
tpch_q13/duckdb:parquet 256711616 280371782 0.92
tpch_q14/duckdb:parquet 51463483 52966394 0.97
tpch_q15/duckdb:parquet 26150696 27556720 0.95
tpch_q16/duckdb:parquet 58721931 61323594 0.96
tpch_q17/duckdb:parquet 58337793 58367502 1.00
tpch_q18/duckdb:parquet 121211725 125481877 0.97
tpch_q19/duckdb:parquet 🚀 80267241 93677749 0.86
tpch_q20/duckdb:parquet 66238270 67297567 0.98
tpch_q21/duckdb:parquet 182452419 189257065 0.96
tpch_q22/duckdb:parquet 54008758 55398886 0.97
duckdb / duckdb (0.951x ➖, 0↑ 0↓)
name PR a1510c1 (ns) base 67a2b22 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 17886388 18216398 0.98
tpch_q02/duckdb:duckdb 14950290 15739918 0.95
tpch_q03/duckdb:duckdb 22938509 25149685 0.91
tpch_q04/duckdb:duckdb 22182831 24266041 0.91
tpch_q05/duckdb:duckdb 23832977 23586576 1.01
tpch_q06/duckdb:duckdb 7159763 7215971 0.99
tpch_q07/duckdb:duckdb 25539405 27096796 0.94
tpch_q08/duckdb:duckdb 24348716 25514251 0.95
tpch_q09/duckdb:duckdb 56795281 62734608 0.91
tpch_q10/duckdb:duckdb 50134234 54374551 0.92
tpch_q11/duckdb:duckdb 7360114 7786400 0.95
tpch_q12/duckdb:duckdb 17958002 18873214 0.95
tpch_q13/duckdb:duckdb 39563277 41494891 0.95
tpch_q14/duckdb:duckdb 21700038 23415012 0.93
tpch_q15/duckdb:duckdb 13772382 14114335 0.98
tpch_q16/duckdb:duckdb 26615952 27789501 0.96
tpch_q17/duckdb:duckdb 16325737 16379543 1.00
tpch_q18/duckdb:duckdb 40984293 42282744 0.97
tpch_q19/duckdb:duckdb 31092228 34511354 0.90
tpch_q20/duckdb:duckdb 25372469 25976150 0.98
tpch_q21/duckdb:duckdb 61661295 65820179 0.94
tpch_q22/duckdb:duckdb 25338982 26579177 0.95
File Size Changes (10 files changed, -0.1% overall, 3↑ 7↓)
File Scale Format Base HEAD Change %
supplier_0.vortex 1.0 vortex-file-compressed 600.59 KB 606.28 KB +5.69 KB +0.9%
lineitem_1.vortex 1.0 vortex-file-compressed 84.47 MB 84.67 MB +206.20 KB +0.2%
partsupp_0.vortex 1.0 vortex-file-compressed 23.80 MB 23.81 MB +5.40 KB +0.0%
customer_0.vortex 1.0 vortex-file-compressed 8.89 MB 8.89 MB 2.23 KB -0.0%
orders_0.vortex 1.0 vortex-file-compressed 38.41 MB 38.39 MB 22.62 KB -0.1%
lineitem_0.vortex 1.0 vortex-file-compressed 85.12 MB 85.06 MB 52.14 KB -0.1%
partsupp_0.vortex 1.0 vortex-compact 20.83 MB 20.81 MB 21.21 KB -0.1%
part_0.vortex 1.0 vortex-file-compressed 5.00 MB 4.97 MB 30.45 KB -0.6%
orders_0.vortex 1.0 vortex-compact 32.20 MB 31.73 MB 482.27 KB -1.5%
part_0.vortex 1.0 vortex-compact 3.43 MB 3.37 MB 59.23 KB -1.7%

Totals:

  • vortex-compact: 190.68 MB → 190.13 MB (-0.3%)
  • vortex-file-compressed: 246.55 MB → 246.66 MB (+0.0%)

@github-actions

github-actions Bot commented Jun 16, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.1%
Engines: DataFusion No clear signal (+0.7%, low confidence) · DuckDB No clear signal (-0.5%, low confidence)
Vortex (geomean): 0.999x ➖
Parquet (geomean): 0.995x ➖
Shifts: Parquet (control) -0.5% · Median polish -0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.993x ➖, 4↑ 0↓)
name PR a1510c1 (ns) base 67a2b22 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 24274251 24929707 0.97
tpcds_q02/datafusion:vortex-file-compressed 48272760 46797953 1.03
tpcds_q03/datafusion:vortex-file-compressed 14744580 15114010 0.98
tpcds_q04/datafusion:vortex-file-compressed 256105045 241003429 1.06
tpcds_q05/datafusion:vortex-file-compressed 43208902 47660938 0.91
tpcds_q06/datafusion:vortex-file-compressed 22767438 22935235 0.99
tpcds_q07/datafusion:vortex-file-compressed 41412376 40199174 1.03
tpcds_q08/datafusion:vortex-file-compressed 29361174 29278852 1.00
tpcds_q09/datafusion:vortex-file-compressed 30687188 28930367 1.06
tpcds_q10/datafusion:vortex-file-compressed 37449561 37527969 1.00
tpcds_q11/datafusion:vortex-file-compressed 129465063 124882625 1.04
tpcds_q12/datafusion:vortex-file-compressed 19623054 19558317 1.00
tpcds_q13/datafusion:vortex-file-compressed 44591729 43055675 1.04
tpcds_q14/datafusion:vortex-file-compressed 163386153 159699419 1.02
tpcds_q15/datafusion:vortex-file-compressed 25742740 25366258 1.01
tpcds_q16/datafusion:vortex-file-compressed 23466151 23553142 1.00
tpcds_q17/datafusion:vortex-file-compressed 59683570 61483466 0.97
tpcds_q18/datafusion:vortex-file-compressed 63357472 61279100 1.03
tpcds_q19/datafusion:vortex-file-compressed 22003304 21450003 1.03
tpcds_q20/datafusion:vortex-file-compressed 19983913 19851098 1.01
tpcds_q21/datafusion:vortex-file-compressed 35164902 34691425 1.01
tpcds_q22/datafusion:vortex-file-compressed 🚀 125326034 150655474 0.83
tpcds_q23/datafusion:vortex-file-compressed 153240852 152225097 1.01
tpcds_q24/datafusion:vortex-file-compressed 82504744 80184309 1.03
tpcds_q25/datafusion:vortex-file-compressed 63511139 62640737 1.01
tpcds_q26/datafusion:vortex-file-compressed 33550569 33683463 1.00
tpcds_q27/datafusion:vortex-file-compressed 89235031 90062336 0.99
tpcds_q28/datafusion:vortex-file-compressed 28814466 29167697 0.99
tpcds_q29/datafusion:vortex-file-compressed 60773716 59354298 1.02
tpcds_q30/datafusion:vortex-file-compressed 23735167 23366706 1.02
tpcds_q31/datafusion:vortex-file-compressed 72906496 72480968 1.01
tpcds_q32/datafusion:vortex-file-compressed 18308323 18451916 0.99
tpcds_q33/datafusion:vortex-file-compressed 28379267 28908190 0.98
tpcds_q34/datafusion:vortex-file-compressed 24014051 24404029 0.98
tpcds_q35/datafusion:vortex-file-compressed 44993145 44337847 1.01
tpcds_q36/datafusion:vortex-file-compressed 56750743 56765594 1.00
tpcds_q37/datafusion:vortex-file-compressed 19906133 20486328 0.97
tpcds_q38/datafusion:vortex-file-compressed 42351573 44193048 0.96
tpcds_q39/datafusion:vortex-file-compressed 105209300 105080681 1.00
tpcds_q40/datafusion:vortex-file-compressed 29732351 29135426 1.02
tpcds_q41/datafusion:vortex-file-compressed 15662143 15034025 1.04
tpcds_q42/datafusion:vortex-file-compressed 13426495 13519317 0.99
tpcds_q43/datafusion:vortex-file-compressed 18164194 18104011 1.00
tpcds_q44/datafusion:vortex-file-compressed 29250307 28391526 1.03
tpcds_q45/datafusion:vortex-file-compressed 27569191 27970838 0.99
tpcds_q46/datafusion:vortex-file-compressed 34815410 35036591 0.99
tpcds_q47/datafusion:vortex-file-compressed 133772159 135044910 0.99
tpcds_q48/datafusion:vortex-file-compressed 32505893 32879028 0.99
tpcds_q49/datafusion:vortex-file-compressed 56551390 57138093 0.99
tpcds_q50/datafusion:vortex-file-compressed 37849703 36860840 1.03
tpcds_q51/datafusion:vortex-file-compressed 87464080 89772688 0.97
tpcds_q52/datafusion:vortex-file-compressed 14623112 13972083 1.05
tpcds_q53/datafusion:vortex-file-compressed 21430183 21649569 0.99
tpcds_q54/datafusion:vortex-file-compressed 35066339 34748984 1.01
tpcds_q55/datafusion:vortex-file-compressed 13554538 13835371 0.98
tpcds_q56/datafusion:vortex-file-compressed 28840254 30132496 0.96
tpcds_q57/datafusion:vortex-file-compressed 108892328 111755709 0.97
tpcds_q58/datafusion:vortex-file-compressed 54462209 56430059 0.97
tpcds_q59/datafusion:vortex-file-compressed 57702634 58638399 0.98
tpcds_q60/datafusion:vortex-file-compressed 28545485 28937801 0.99
tpcds_q61/datafusion:vortex-file-compressed 41109344 39632487 1.04
tpcds_q62/datafusion:vortex-file-compressed 🚀 21744965 25744858 0.84
tpcds_q63/datafusion:vortex-file-compressed 21956902 21510505 1.02
tpcds_q64/datafusion:vortex-file-compressed 379285168 379921062 1.00
tpcds_q65/datafusion:vortex-file-compressed 50835886 49781076 1.02
tpcds_q66/datafusion:vortex-file-compressed 70052753 72621991 0.96
tpcds_q67/datafusion:vortex-file-compressed 150395755 147450900 1.02
tpcds_q68/datafusion:vortex-file-compressed 32289900 33206762 0.97
tpcds_q69/datafusion:vortex-file-compressed 36433507 36085344 1.01
tpcds_q70/datafusion:vortex-file-compressed 96117465 93713312 1.03
tpcds_q71/datafusion:vortex-file-compressed 22434095 23481937 0.96
tpcds_q72/datafusion:vortex-file-compressed 2086465832 2068533451 1.01
tpcds_q73/datafusion:vortex-file-compressed 23577010 22725637 1.04
tpcds_q74/datafusion:vortex-file-compressed 78972962 80923017 0.98
tpcds_q75/datafusion:vortex-file-compressed 109908648 106915526 1.03
tpcds_q76/datafusion:vortex-file-compressed 30613893 32782533 0.93
tpcds_q77/datafusion:vortex-file-compressed 36706572 35952866 1.02
tpcds_q78/datafusion:vortex-file-compressed 114966543 111907477 1.03
tpcds_q79/datafusion:vortex-file-compressed 28150522 28389548 0.99
tpcds_q80/datafusion:vortex-file-compressed 86839357 86938640 1.00
tpcds_q81/datafusion:vortex-file-compressed 🚀 23989251 26892962 0.89
tpcds_q82/datafusion:vortex-file-compressed 21723194 22410382 0.97
tpcds_q83/datafusion:vortex-file-compressed 38194360 35257447 1.08
tpcds_q84/datafusion:vortex-file-compressed 12731788 12577734 1.01
tpcds_q85/datafusion:vortex-file-compressed 86328917 82816293 1.04
tpcds_q86/datafusion:vortex-file-compressed 🚀 14740154 18079453 0.82
tpcds_q87/datafusion:vortex-file-compressed 42733539 42817725 1.00
tpcds_q88/datafusion:vortex-file-compressed 55301698 54500107 1.01
tpcds_q89/datafusion:vortex-file-compressed 24620923 24521988 1.00
tpcds_q90/datafusion:vortex-file-compressed 13324750 13714995 0.97
tpcds_q91/datafusion:vortex-file-compressed 17392038 17457076 1.00
tpcds_q92/datafusion:vortex-file-compressed 16227789 16618582 0.98
tpcds_q93/datafusion:vortex-file-compressed 30416747 33450960 0.91
tpcds_q94/datafusion:vortex-file-compressed 21557825 21491062 1.00
tpcds_q95/datafusion:vortex-file-compressed 58085638 56493015 1.03
tpcds_q96/datafusion:vortex-file-compressed 12810616 13004607 0.99
tpcds_q97/datafusion:vortex-file-compressed 29077167 29636116 0.98
tpcds_q98/datafusion:vortex-file-compressed 23368482 23195752 1.01
tpcds_q99/datafusion:vortex-file-compressed 29109136 32269124 0.90
datafusion / vortex-compact (0.999x ➖, 4↑ 1↓)
name PR a1510c1 (ns) base 67a2b22 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-compact 25046993 26254330 0.95
tpcds_q02/datafusion:vortex-compact 55890730 52534244 1.06
tpcds_q03/datafusion:vortex-compact 19428963 20049324 0.97
tpcds_q04/datafusion:vortex-compact 277268004 291754286 0.95
tpcds_q05/datafusion:vortex-compact 47215841 47273641 1.00
tpcds_q06/datafusion:vortex-compact 27190891 26396355 1.03
tpcds_q07/datafusion:vortex-compact 53717358 51878100 1.04
tpcds_q08/datafusion:vortex-compact 36398034 36011631 1.01
tpcds_q09/datafusion:vortex-compact 41987260 41826284 1.00
tpcds_q10/datafusion:vortex-compact 49910755 49129586 1.02
tpcds_q11/datafusion:vortex-compact 156111224 152117604 1.03
tpcds_q12/datafusion:vortex-compact 25732096 23564507 1.09
tpcds_q13/datafusion:vortex-compact 121687819 120150628 1.01
tpcds_q14/datafusion:vortex-compact 181641235 179555324 1.01
tpcds_q15/datafusion:vortex-compact 28256154 28531830 0.99
tpcds_q16/datafusion:vortex-compact 28120399 28650394 0.98
tpcds_q17/datafusion:vortex-compact 76590236 72257479 1.06
tpcds_q18/datafusion:vortex-compact 72302355 72462437 1.00
tpcds_q19/datafusion:vortex-compact 31667558 29027383 1.09
tpcds_q20/datafusion:vortex-compact 24829071 27407137 0.91
tpcds_q21/datafusion:vortex-compact 41851906 40461077 1.03
tpcds_q22/datafusion:vortex-compact 🚀 125377434 149457415 0.84
tpcds_q23/datafusion:vortex-compact 167399079 165150608 1.01
tpcds_q24/datafusion:vortex-compact 96038388 97413680 0.99
tpcds_q25/datafusion:vortex-compact 76997615 77718036 0.99
tpcds_q26/datafusion:vortex-compact 43690462 45304640 0.96
tpcds_q27/datafusion:vortex-compact 117457634 117036089 1.00
tpcds_q28/datafusion:vortex-compact 93952582 96280341 0.98
tpcds_q29/datafusion:vortex-compact 77207468 72313454 1.07
tpcds_q30/datafusion:vortex-compact 27272191 28549078 0.96
tpcds_q31/datafusion:vortex-compact 94567292 97510282 0.97
tpcds_q32/datafusion:vortex-compact 23707457 22969389 1.03
tpcds_q33/datafusion:vortex-compact 36613659 35832213 1.02
tpcds_q34/datafusion:vortex-compact 33651444 33138228 1.02
tpcds_q35/datafusion:vortex-compact 50968499 51917687 0.98
tpcds_q36/datafusion:vortex-compact 75874301 77123694 0.98
tpcds_q37/datafusion:vortex-compact 30250021 30438664 0.99
tpcds_q38/datafusion:vortex-compact 50629040 50208355 1.01
tpcds_q39/datafusion:vortex-compact 117234060 114968986 1.02
tpcds_q40/datafusion:vortex-compact 35578712 34281795 1.04
tpcds_q41/datafusion:vortex-compact 18389918 17584006 1.05
tpcds_q42/datafusion:vortex-compact 18409112 17885209 1.03
tpcds_q43/datafusion:vortex-compact 24315788 24458658 0.99
tpcds_q44/datafusion:vortex-compact 40008969 40746536 0.98
tpcds_q45/datafusion:vortex-compact 30318015 32701593 0.93
tpcds_q46/datafusion:vortex-compact 46194227 45869727 1.01
tpcds_q47/datafusion:vortex-compact 149064208 154136204 0.97
tpcds_q48/datafusion:vortex-compact 78301180 81963889 0.96
tpcds_q49/datafusion:vortex-compact 67297556 66062713 1.02
tpcds_q50/datafusion:vortex-compact 45653386 44711505 1.02
tpcds_q51/datafusion:vortex-compact 100740824 97018549 1.04
tpcds_q52/datafusion:vortex-compact 🚀 17829418 20419598 0.87
tpcds_q53/datafusion:vortex-compact 29033643 27795760 1.04
tpcds_q54/datafusion:vortex-compact 41131576 42449696 0.97
tpcds_q55/datafusion:vortex-compact 17893914 18008755 0.99
tpcds_q56/datafusion:vortex-compact 37999022 35733247 1.06
tpcds_q57/datafusion:vortex-compact 118306846 112358835 1.05
tpcds_q58/datafusion:vortex-compact 65268993 65474254 1.00
tpcds_q59/datafusion:vortex-compact 70243058 69784011 1.01
tpcds_q60/datafusion:vortex-compact 36059403 36020022 1.00
tpcds_q61/datafusion:vortex-compact 53252454 55651594 0.96
tpcds_q62/datafusion:vortex-compact 🚨 28866267 24061210 1.20
tpcds_q63/datafusion:vortex-compact 28710678 28461002 1.01
tpcds_q64/datafusion:vortex-compact 428269550 437675528 0.98
tpcds_q65/datafusion:vortex-compact 64633171 66809973 0.97
tpcds_q66/datafusion:vortex-compact 77533637 76831468 1.01
tpcds_q67/datafusion:vortex-compact 155011989 154525717 1.00
tpcds_q68/datafusion:vortex-compact 46163014 45484467 1.01
tpcds_q69/datafusion:vortex-compact 46103284 45427015 1.01
tpcds_q70/datafusion:vortex-compact 102761894 104022914 0.99
tpcds_q71/datafusion:vortex-compact 30146805 30114267 1.00
tpcds_q72/datafusion:vortex-compact 2056330156 2077398637 0.99
tpcds_q73/datafusion:vortex-compact 30077097 30210811 1.00
tpcds_q74/datafusion:vortex-compact 92379411 89454773 1.03
tpcds_q75/datafusion:vortex-compact 125046651 126722292 0.99
tpcds_q76/datafusion:vortex-compact 32274389 31867323 1.01
tpcds_q77/datafusion:vortex-compact 49696166 46167725 1.08
tpcds_q78/datafusion:vortex-compact 126332478 132760880 0.95
tpcds_q79/datafusion:vortex-compact 39319320 39006469 1.01
tpcds_q80/datafusion:vortex-compact 99923102 104031395 0.96
tpcds_q81/datafusion:vortex-compact 28192604 28328904 1.00
tpcds_q82/datafusion:vortex-compact 31706797 31866537 0.99
tpcds_q83/datafusion:vortex-compact 34866923 34589665 1.01
tpcds_q84/datafusion:vortex-compact 15064432 13886511 1.08
tpcds_q85/datafusion:vortex-compact 154467935 154664161 1.00
tpcds_q86/datafusion:vortex-compact 18869088 19865019 0.95
tpcds_q87/datafusion:vortex-compact 52574181 49938055 1.05
tpcds_q88/datafusion:vortex-compact 75243169 77741628 0.97
tpcds_q89/datafusion:vortex-compact 30664743 31703900 0.97
tpcds_q90/datafusion:vortex-compact 14832366 14065673 1.05
tpcds_q91/datafusion:vortex-compact 33176889 31639265 1.05
tpcds_q92/datafusion:vortex-compact 🚀 20658529 24011144 0.86
tpcds_q93/datafusion:vortex-compact 35756291 35035791 1.02
tpcds_q94/datafusion:vortex-compact 24683855 25167267 0.98
tpcds_q95/datafusion:vortex-compact 59700615 63774616 0.94
tpcds_q96/datafusion:vortex-compact 16968341 16919566 1.00
tpcds_q97/datafusion:vortex-compact 37108135 34490110 1.08
tpcds_q98/datafusion:vortex-compact 29294095 30003844 0.98
tpcds_q99/datafusion:vortex-compact 🚀 31528018 37579517 0.84
datafusion / parquet (0.989x ➖, 4↑ 1↓)
name PR a1510c1 (ns) base 67a2b22 (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 23752843 21995138 1.08
tpcds_q02/datafusion:parquet 42616380 42331546 1.01
tpcds_q03/datafusion:parquet 13404111 14113196 0.95
tpcds_q04/datafusion:parquet 289276683 309893357 0.93
tpcds_q05/datafusion:parquet 47246826 46664554 1.01
tpcds_q06/datafusion:parquet 23196036 23223442 1.00
tpcds_q07/datafusion:parquet 79539036 75345700 1.06
tpcds_q08/datafusion:parquet 30380377 33076417 0.92
tpcds_q09/datafusion:parquet 38527751 37977649 1.01
tpcds_q10/datafusion:parquet 71370367 70778094 1.01
tpcds_q11/datafusion:parquet 150369118 149291587 1.01
tpcds_q12/datafusion:parquet 16411449 17758282 0.92
tpcds_q13/datafusion:parquet 74867343 74639382 1.00
tpcds_q14/datafusion:parquet 159106149 159297579 1.00
tpcds_q15/datafusion:parquet 20610372 21518013 0.96
tpcds_q16/datafusion:parquet 🚀 28195314 31788275 0.89
tpcds_q17/datafusion:parquet 59390850 65737226 0.90
tpcds_q18/datafusion:parquet 108565980 110305323 0.98
tpcds_q19/datafusion:parquet 22779051 23241763 0.98
tpcds_q20/datafusion:parquet 16588599 16766079 0.99
tpcds_q21/datafusion:parquet 18562064 18323717 1.01
tpcds_q22/datafusion:parquet 152144994 153988318 0.99
tpcds_q23/datafusion:parquet 148014695 155826690 0.95
tpcds_q24/datafusion:parquet 89667223 89029856 1.01
tpcds_q25/datafusion:parquet 62081547 61185839 1.01
tpcds_q26/datafusion:parquet 62047823 63592905 0.98
tpcds_q27/datafusion:parquet 135857985 134003167 1.01
tpcds_q28/datafusion:parquet 44652931 43045839 1.04
tpcds_q29/datafusion:parquet 64234393 63596653 1.01
tpcds_q30/datafusion:parquet 33779266 32891345 1.03
tpcds_q31/datafusion:parquet 66304109 66625970 1.00
tpcds_q32/datafusion:parquet 16204803 16619138 0.98
tpcds_q33/datafusion:parquet 26216452 27403511 0.96
tpcds_q34/datafusion:parquet 🚨 23629891 21155948 1.12
tpcds_q35/datafusion:parquet 72135207 69689912 1.04
tpcds_q36/datafusion:parquet 58231178 57742764 1.01
tpcds_q37/datafusion:parquet 19400272 19127756 1.01
tpcds_q38/datafusion:parquet 40487057 43905023 0.92
tpcds_q39/datafusion:parquet 74006359 74390903 0.99
tpcds_q40/datafusion:parquet 22438061 23192937 0.97
tpcds_q41/datafusion:parquet 14104573 14594273 0.97
tpcds_q42/datafusion:parquet 11658146 12215846 0.95
tpcds_q43/datafusion:parquet 16484419 17532094 0.94
tpcds_q44/datafusion:parquet 32547391 33061560 0.98
tpcds_q45/datafusion:parquet 29077564 27643415 1.05
tpcds_q46/datafusion:parquet 32316269 31591777 1.02
tpcds_q47/datafusion:parquet 128138523 129116187 0.99
tpcds_q48/datafusion:parquet 69559264 68857228 1.01
tpcds_q49/datafusion:parquet 56805503 56721233 1.00
tpcds_q50/datafusion:parquet 41435775 42415165 0.98
tpcds_q51/datafusion:parquet 87422248 88538100 0.99
tpcds_q52/datafusion:parquet 12060870 11798974 1.02
tpcds_q53/datafusion:parquet 18031644 18208862 0.99
tpcds_q54/datafusion:parquet 31865954 32316306 0.99
tpcds_q55/datafusion:parquet 11094435 11780812 0.94
tpcds_q56/datafusion:parquet 28334533 27940781 1.01
tpcds_q57/datafusion:parquet 100244014 95034406 1.05
tpcds_q58/datafusion:parquet 54625383 57290862 0.95
tpcds_q59/datafusion:parquet 61603593 63435546 0.97
tpcds_q60/datafusion:parquet 27830982 27589689 1.01
tpcds_q61/datafusion:parquet 42234453 42636019 0.99
tpcds_q62/datafusion:parquet 🚀 20330224 22962440 0.89
tpcds_q63/datafusion:parquet 18038338 18109699 1.00
tpcds_q64/datafusion:parquet 297760034 300008765 0.99
tpcds_q65/datafusion:parquet 37371895 36974240 1.01
tpcds_q66/datafusion:parquet 70200990 71306753 0.98
tpcds_q67/datafusion:parquet 144440342 153462809 0.94
tpcds_q68/datafusion:parquet 31489779 31385772 1.00
tpcds_q69/datafusion:parquet 66333862 65060139 1.02
tpcds_q70/datafusion:parquet 32471453 32332294 1.00
tpcds_q71/datafusion:parquet 22573012 23369244 0.97
tpcds_q72/datafusion:parquet 567983690 562742359 1.01
tpcds_q73/datafusion:parquet 🚀 20184318 22941563 0.88
tpcds_q74/datafusion:parquet 82503323 79812445 1.03
tpcds_q75/datafusion:parquet 109307393 102784484 1.06
tpcds_q76/datafusion:parquet 29811240 30320851 0.98
tpcds_q77/datafusion:parquet 38422958 38412823 1.00
tpcds_q78/datafusion:parquet 106221575 110135389 0.96
tpcds_q79/datafusion:parquet 26068850 26366041 0.99
tpcds_q80/datafusion:parquet 75185481 74524005 1.01
tpcds_q81/datafusion:parquet 28943733 30316704 0.95
tpcds_q82/datafusion:parquet 20372863 19014665 1.07
tpcds_q83/datafusion:parquet 39801202 41252944 0.96
tpcds_q84/datafusion:parquet 38694474 39687548 0.97
tpcds_q85/datafusion:parquet 145251669 144647278 1.00
tpcds_q86/datafusion:parquet 15994604 16176391 0.99
tpcds_q87/datafusion:parquet 42606268 44147726 0.97
tpcds_q88/datafusion:parquet 60493573 60732538 1.00
tpcds_q89/datafusion:parquet 🚀 21198461 25132430 0.84
tpcds_q90/datafusion:parquet 14538430 13897108 1.05
tpcds_q91/datafusion:parquet 58485415 57628162 1.01
tpcds_q92/datafusion:parquet 17236832 17981205 0.96
tpcds_q93/datafusion:parquet 30617414 30785888 0.99
tpcds_q94/datafusion:parquet 22016848 21603946 1.02
tpcds_q95/datafusion:parquet 60930892 59267342 1.03
tpcds_q96/datafusion:parquet 11944716 11938061 1.00
tpcds_q97/datafusion:parquet 30917460 30397605 1.02
tpcds_q98/datafusion:parquet 21737925 21869577 0.99
tpcds_q99/datafusion:parquet 26093370 26025001 1.00
duckdb / vortex-file-compressed (1.004x ➖, 0↑ 1↓)
name PR a1510c1 (ns) base 67a2b22 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 23822410 24041172 0.99
tpcds_q02/duckdb:vortex-file-compressed 33904197 36538058 0.93
tpcds_q03/duckdb:vortex-file-compressed 15259520 15135244 1.01
tpcds_q04/duckdb:vortex-file-compressed 91086192 89792053 1.01
tpcds_q05/duckdb:vortex-file-compressed 34067531 32261540 1.06
tpcds_q06/duckdb:vortex-file-compressed 32716634 32944458 0.99
tpcds_q07/duckdb:vortex-file-compressed 21641788 21690759 1.00
tpcds_q08/duckdb:vortex-file-compressed 26010456 26206864 0.99
tpcds_q09/duckdb:vortex-file-compressed 17665201 16318975 1.08
tpcds_q10/duckdb:vortex-file-compressed 37210341 36809347 1.01
tpcds_q11/duckdb:vortex-file-compressed 64590284 63410965 1.02
tpcds_q12/duckdb:vortex-file-compressed 15582340 15167591 1.03
tpcds_q13/duckdb:vortex-file-compressed 32001627 32520932 0.98
tpcds_q14/duckdb:vortex-file-compressed 95712615 97011682 0.99
tpcds_q15/duckdb:vortex-file-compressed 26439619 26565493 1.00
tpcds_q16/duckdb:vortex-file-compressed 25581110 25920375 0.99
tpcds_q17/duckdb:vortex-file-compressed 43550376 44330365 0.98
tpcds_q18/duckdb:vortex-file-compressed 36199025 37509762 0.97
tpcds_q19/duckdb:vortex-file-compressed 31977394 31417378 1.02
tpcds_q20/duckdb:vortex-file-compressed 17365143 16532046 1.05
tpcds_q21/duckdb:vortex-file-compressed 18188844 16596872 1.10
tpcds_q22/duckdb:vortex-file-compressed 76794264 78783312 0.97
tpcds_q23/duckdb:vortex-file-compressed 95531958 96142328 0.99
tpcds_q24/duckdb:vortex-file-compressed 47041018 47804622 0.98
tpcds_q25/duckdb:vortex-file-compressed 40841458 40505025 1.01
tpcds_q26/duckdb:vortex-file-compressed 20181899 20313481 0.99
tpcds_q27/duckdb:vortex-file-compressed 23519585 24153632 0.97
tpcds_q28/duckdb:vortex-file-compressed 11759247 11488332 1.02
tpcds_q29/duckdb:vortex-file-compressed 39640135 39262060 1.01
tpcds_q30/duckdb:vortex-file-compressed 26044669 25222973 1.03
tpcds_q31/duckdb:vortex-file-compressed 28737054 30025639 0.96
tpcds_q32/duckdb:vortex-file-compressed 13245360 13244365 1.00
tpcds_q33/duckdb:vortex-file-compressed 24383951 24150398 1.01
tpcds_q34/duckdb:vortex-file-compressed 24189136 24454062 0.99
tpcds_q35/duckdb:vortex-file-compressed 65394224 63753110 1.03
tpcds_q36/duckdb:vortex-file-compressed 24254683 26013183 0.93
tpcds_q37/duckdb:vortex-file-compressed 20027742 18971771 1.06
tpcds_q38/duckdb:vortex-file-compressed 36772288 36701690 1.00
tpcds_q39/duckdb:vortex-file-compressed 35265037 35360841 1.00
tpcds_q40/duckdb:vortex-file-compressed 20462728 19692017 1.04
tpcds_q41/duckdb:vortex-file-compressed 8953990 9140237 0.98
tpcds_q42/duckdb:vortex-file-compressed 13604160 13680735 0.99
tpcds_q43/duckdb:vortex-file-compressed 20821819 19882011 1.05
tpcds_q44/duckdb:vortex-file-compressed 20338388 20872859 0.97
tpcds_q45/duckdb:vortex-file-compressed 29737973 29601337 1.00
tpcds_q46/duckdb:vortex-file-compressed 32656695 31685501 1.03
tpcds_q47/duckdb:vortex-file-compressed 51467189 52237987 0.99
tpcds_q48/duckdb:vortex-file-compressed 28636001 28700712 1.00
tpcds_q49/duckdb:vortex-file-compressed 31406107 32058512 0.98
tpcds_q50/duckdb:vortex-file-compressed 27079396 26163022 1.04
tpcds_q51/duckdb:vortex-file-compressed 104246786 106922933 0.97
tpcds_q52/duckdb:vortex-file-compressed 12733024 13020032 0.98
tpcds_q53/duckdb:vortex-file-compressed 23052869 22507472 1.02
tpcds_q54/duckdb:vortex-file-compressed 28766678 28924195 0.99
tpcds_q55/duckdb:vortex-file-compressed 12602280 12583403 1.00
tpcds_q56/duckdb:vortex-file-compressed 25081147 25306350 0.99
tpcds_q57/duckdb:vortex-file-compressed 42013017 41748293 1.01
tpcds_q58/duckdb:vortex-file-compressed 30882766 30856377 1.00
tpcds_q59/duckdb:vortex-file-compressed 54920362 56885034 0.97
tpcds_q60/duckdb:vortex-file-compressed 25655262 25588811 1.00
tpcds_q61/duckdb:vortex-file-compressed 30557451 30696396 1.00
tpcds_q62/duckdb:vortex-file-compressed 15840344 15053388 1.05
tpcds_q63/duckdb:vortex-file-compressed 21059439 20147317 1.05
tpcds_q64/duckdb:vortex-file-compressed 91989421 92520883 0.99
tpcds_q65/duckdb:vortex-file-compressed 24179592 22810471 1.06
tpcds_q66/duckdb:vortex-file-compressed 30802105 30914516 1.00
tpcds_q67/duckdb:vortex-file-compressed 148108623 138826431 1.07
tpcds_q68/duckdb:vortex-file-compressed 31956357 29258963 1.09
tpcds_q69/duckdb:vortex-file-compressed 39925084 39424790 1.01
tpcds_q70/duckdb:vortex-file-compressed 36454817 38312262 0.95
tpcds_q71/duckdb:vortex-file-compressed 21589923 21014046 1.03
tpcds_q72/duckdb:vortex-file-compressed 168419464 173856337 0.97
tpcds_q73/duckdb:vortex-file-compressed 25496190 25001270 1.02
tpcds_q74/duckdb:vortex-file-compressed 42565090 43759190 0.97
tpcds_q75/duckdb:vortex-file-compressed 47572586 50955831 0.93
tpcds_q76/duckdb:vortex-file-compressed 21779907 22377330 0.97
tpcds_q77/duckdb:vortex-file-compressed 23853334 23869963 1.00
tpcds_q78/duckdb:vortex-file-compressed 77174177 81178609 0.95
tpcds_q79/duckdb:vortex-file-compressed 25139644 24375526 1.03
tpcds_q80/duckdb:vortex-file-compressed 48389249 46174722 1.05
tpcds_q81/duckdb:vortex-file-compressed 29252999 29091894 1.01
tpcds_q82/duckdb:vortex-file-compressed 45710131 47013766 0.97
tpcds_q83/duckdb:vortex-file-compressed 25900272 26072139 0.99
tpcds_q84/duckdb:vortex-file-compressed 17422329 16784186 1.04
tpcds_q85/duckdb:vortex-file-compressed 40672370 39389238 1.03
tpcds_q86/duckdb:vortex-file-compressed 16014790 16275251 0.98
tpcds_q87/duckdb:vortex-file-compressed 41141958 42591194 0.97
tpcds_q88/duckdb:vortex-file-compressed 53077982 51293318 1.03
tpcds_q89/duckdb:vortex-file-compressed 21720164 21440975 1.01
tpcds_q90/duckdb:vortex-file-compressed 10327465 10518194 0.98
tpcds_q91/duckdb:vortex-file-compressed 21458449 21163735 1.01
tpcds_q92/duckdb:vortex-file-compressed 17768033 17842547 1.00
tpcds_q93/duckdb:vortex-file-compressed 29675480 29730178 1.00
tpcds_q94/duckdb:vortex-file-compressed 21112005 21375530 0.99
tpcds_q95/duckdb:vortex-file-compressed 158910924 157589619 1.01
tpcds_q96/duckdb:vortex-file-compressed 🚨 13154097 11762832 1.12
tpcds_q97/duckdb:vortex-file-compressed 38581115 38100314 1.01
tpcds_q98/duckdb:vortex-file-compressed 18942274 18983590 1.00
tpcds_q99/duckdb:vortex-file-compressed 22190578 23301181 0.95
duckdb / vortex-compact (0.998x ➖, 1↑ 0↓)
name PR a1510c1 (ns) base 67a2b22 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-compact 26578259 26304581 1.01
tpcds_q02/duckdb:vortex-compact 38256761 39223085 0.98
tpcds_q03/duckdb:vortex-compact 44865583 46977188 0.96
tpcds_q04/duckdb:vortex-compact 103386827 99565682 1.04
tpcds_q05/duckdb:vortex-compact 40990780 40037446 1.02
tpcds_q06/duckdb:vortex-compact 39932669 39482157 1.01
tpcds_q07/duckdb:vortex-compact 34632065 34803299 1.00
tpcds_q08/duckdb:vortex-compact 40197961 39951667 1.01
tpcds_q09/duckdb:vortex-compact 🚀 18763663 20915498 0.90
tpcds_q10/duckdb:vortex-compact 51333148 53348794 0.96
tpcds_q11/duckdb:vortex-compact 71982760 74205768 0.97
tpcds_q12/duckdb:vortex-compact 21143113 22122037 0.96
tpcds_q13/duckdb:vortex-compact 53170517 53970020 0.99
tpcds_q14/duckdb:vortex-compact 115966816 117105585 0.99
tpcds_q15/duckdb:vortex-compact 30984376 31246468 0.99
tpcds_q16/duckdb:vortex-compact 27108741 27686261 0.98
tpcds_q17/duckdb:vortex-compact 54842732 54632485 1.00
tpcds_q18/duckdb:vortex-compact 48496341 48928280 0.99
tpcds_q19/duckdb:vortex-compact 45086603 43246619 1.04
tpcds_q20/duckdb:vortex-compact 20810976 21433038 0.97
tpcds_q21/duckdb:vortex-compact 17774528 17643734 1.01
tpcds_q22/duckdb:vortex-compact 75476407 76380449 0.99
tpcds_q23/duckdb:vortex-compact 110179740 106053749 1.04
tpcds_q24/duckdb:vortex-compact 59145532 59017157 1.00
tpcds_q25/duckdb:vortex-compact 52997547 54475489 0.97
tpcds_q26/duckdb:vortex-compact 30011239 31918734 0.94
tpcds_q27/duckdb:vortex-compact 40318255 37982400 1.06
tpcds_q28/duckdb:vortex-compact 33836714 35336382 0.96
tpcds_q29/duckdb:vortex-compact 51898807 53035641 0.98
tpcds_q30/duckdb:vortex-compact 31253826 30584196 1.02
tpcds_q31/duckdb:vortex-compact 36757189 36104267 1.02
tpcds_q32/duckdb:vortex-compact 21982788 20503323 1.07
tpcds_q33/duckdb:vortex-compact 32698771 30879644 1.06
tpcds_q34/duckdb:vortex-compact 30548599 29698158 1.03
tpcds_q35/duckdb:vortex-compact 75991471 74929316 1.01
tpcds_q36/duckdb:vortex-compact 36115307 35959139 1.00
tpcds_q37/duckdb:vortex-compact 22890966 23390963 0.98
tpcds_q38/duckdb:vortex-compact 41142964 40094106 1.03
tpcds_q39/duckdb:vortex-compact 38548606 37983321 1.01
tpcds_q40/duckdb:vortex-compact 24084584 23925084 1.01
tpcds_q41/duckdb:vortex-compact 10728848 10574980 1.01
tpcds_q42/duckdb:vortex-compact 19028619 18442886 1.03
tpcds_q43/duckdb:vortex-compact 31404690 31722740 0.99
tpcds_q44/duckdb:vortex-compact 29619734 28942429 1.02
tpcds_q45/duckdb:vortex-compact 36221083 34615535 1.05
tpcds_q46/duckdb:vortex-compact 45138630 46319891 0.97
tpcds_q47/duckdb:vortex-compact 62711376 61670847 1.02
tpcds_q48/duckdb:vortex-compact 45717048 44708460 1.02
tpcds_q49/duckdb:vortex-compact 47211405 47357700 1.00
tpcds_q50/duckdb:vortex-compact 38461631 37587117 1.02
tpcds_q51/duckdb:vortex-compact 112037823 122256589 0.92
tpcds_q52/duckdb:vortex-compact 20112048 19036888 1.06
tpcds_q53/duckdb:vortex-compact 32083837 31639945 1.01
tpcds_q54/duckdb:vortex-compact 36920784 36850001 1.00
tpcds_q55/duckdb:vortex-compact 18337080 18448024 0.99
tpcds_q56/duckdb:vortex-compact 34606258 35088189 0.99
tpcds_q57/duckdb:vortex-compact 44410986 45269723 0.98
tpcds_q58/duckdb:vortex-compact 36705249 38246288 0.96
tpcds_q59/duckdb:vortex-compact 67409952 67956393 0.99
tpcds_q60/duckdb:vortex-compact 36674395 37311160 0.98
tpcds_q61/duckdb:vortex-compact 53023876 53411955 0.99
tpcds_q62/duckdb:vortex-compact 20973564 21532815 0.97
tpcds_q63/duckdb:vortex-compact 32591943 31448415 1.04
tpcds_q64/duckdb:vortex-compact 123937681 124018652 1.00
tpcds_q65/duckdb:vortex-compact 32075512 31151777 1.03
tpcds_q66/duckdb:vortex-compact 35982559 36383446 0.99
tpcds_q67/duckdb:vortex-compact 147066374 150575273 0.98
tpcds_q68/duckdb:vortex-compact 45868166 45472392 1.01
tpcds_q69/duckdb:vortex-compact 54334795 55017466 0.99
tpcds_q70/duckdb:vortex-compact 55926438 58166416 0.96
tpcds_q71/duckdb:vortex-compact 28768488 29662598 0.97
tpcds_q72/duckdb:vortex-compact 185371480 183365127 1.01
tpcds_q73/duckdb:vortex-compact 27366177 28215569 0.97
tpcds_q74/duckdb:vortex-compact 47178580 48704196 0.97
tpcds_q75/duckdb:vortex-compact 61684894 60911161 1.01
tpcds_q76/duckdb:vortex-compact 29707507 30020729 0.99
tpcds_q77/duckdb:vortex-compact 36951391 37360235 0.99
tpcds_q78/duckdb:vortex-compact 86888622 88767661 0.98
tpcds_q79/duckdb:vortex-compact 42142026 39001903 1.08
tpcds_q80/duckdb:vortex-compact 71814798 70928439 1.01
tpcds_q81/duckdb:vortex-compact 34368247 33449338 1.03
tpcds_q82/duckdb:vortex-compact 50246277 50791228 0.99
tpcds_q83/duckdb:vortex-compact 36945261 36378640 1.02
tpcds_q84/duckdb:vortex-compact 21770611 21511419 1.01
tpcds_q85/duckdb:vortex-compact 53627276 51562185 1.04
tpcds_q86/duckdb:vortex-compact 20502521 20997226 0.98
tpcds_q87/duckdb:vortex-compact 44117030 47188449 0.93
tpcds_q88/duckdb:vortex-compact 75373090 76015437 0.99
tpcds_q89/duckdb:vortex-compact 31898859 32807958 0.97
tpcds_q90/duckdb:vortex-compact 11608528 11408678 1.02
tpcds_q91/duckdb:vortex-compact 40847228 40622460 1.01
tpcds_q92/duckdb:vortex-compact 43145483 45283980 0.95
tpcds_q93/duckdb:vortex-compact 32620254 31748789 1.03
tpcds_q94/duckdb:vortex-compact 27732672 29582641 0.94
tpcds_q95/duckdb:vortex-compact 163547669 159086473 1.03
tpcds_q96/duckdb:vortex-compact 17079861 16843897 1.01
tpcds_q97/duckdb:vortex-compact 42087520 42942984 0.98
tpcds_q98/duckdb:vortex-compact 27050965 27119304 1.00
tpcds_q99/duckdb:vortex-compact 25514008 25544599 1.00
duckdb / parquet (1.001x ➖, 2↑ 0↓)
name PR a1510c1 (ns) base 67a2b22 (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 29434782 29492550 1.00
tpcds_q02/duckdb:parquet 24021485 24436876 0.98
tpcds_q03/duckdb:parquet 13337337 12561399 1.06
tpcds_q04/duckdb:parquet 171342710 168770543 1.02
tpcds_q05/duckdb:parquet 31361204 31558081 0.99
tpcds_q06/duckdb:parquet 34194658 33199897 1.03
tpcds_q07/duckdb:parquet 23933401 24180012 0.99
tpcds_q08/duckdb:parquet 30213717 29086547 1.04
tpcds_q09/duckdb:parquet 45642622 44660256 1.02
tpcds_q10/duckdb:parquet 38076899 37569522 1.01
tpcds_q11/duckdb:parquet 94111301 94113278 1.00
tpcds_q12/duckdb:parquet 16752894 16991044 0.99
tpcds_q13/duckdb:parquet 34625588 34963549 0.99
tpcds_q14/duckdb:parquet 102587145 98465841 1.04
tpcds_q15/duckdb:parquet 30828836 30201121 1.02
tpcds_q16/duckdb:parquet 22303186 22592292 0.99
tpcds_q17/duckdb:parquet 38517051 38407976 1.00
tpcds_q18/duckdb:parquet 48611840 48220111 1.01
tpcds_q19/duckdb:parquet 31555787 31492555 1.00
tpcds_q20/duckdb:parquet 18538248 18407495 1.01
tpcds_q21/duckdb:parquet 11473050 11599778 0.99
tpcds_q22/duckdb:parquet 73234647 68744607 1.07
tpcds_q23/duckdb:parquet 80899856 83753138 0.97
tpcds_q24/duckdb:parquet 47008059 46914130 1.00
tpcds_q25/duckdb:parquet 35417834 35605982 0.99
tpcds_q26/duckdb:parquet 39589431 38685951 1.02
tpcds_q27/duckdb:parquet 53397319 52541234 1.02
tpcds_q28/duckdb:parquet 42650773 43684304 0.98
tpcds_q29/duckdb:parquet 38741897 39014197 0.99
tpcds_q30/duckdb:parquet 37392084 37838275 0.99
tpcds_q31/duckdb:parquet 28001082 27552441 1.02
tpcds_q32/duckdb:parquet 12663066 12842747 0.99
tpcds_q33/duckdb:parquet 23321360 24466288 0.95
tpcds_q34/duckdb:parquet 23495509 22955469 1.02
tpcds_q35/duckdb:parquet 60881252 61636868 0.99
tpcds_q36/duckdb:parquet 22668787 22760369 1.00
tpcds_q37/duckdb:parquet 14521985 13813565 1.05
tpcds_q38/duckdb:parquet 39136624 36977608 1.06
tpcds_q39/duckdb:parquet 32384497 32576051 0.99
tpcds_q40/duckdb:parquet 19798723 19427142 1.02
tpcds_q41/duckdb:parquet 8843357 8840655 1.00
tpcds_q42/duckdb:parquet 13558429 12529109 1.08
tpcds_q43/duckdb:parquet 17773414 17477447 1.02
tpcds_q44/duckdb:parquet 26726724 26452828 1.01
tpcds_q45/duckdb:parquet 29066865 28707094 1.01
tpcds_q46/duckdb:parquet 47136543 47658360 0.99
tpcds_q47/duckdb:parquet 50855595 50315323 1.01
tpcds_q48/duckdb:parquet 32405146 32445943 1.00
tpcds_q49/duckdb:parquet 29351270 28176928 1.04
tpcds_q50/duckdb:parquet 26221486 26192612 1.00
tpcds_q51/duckdb:parquet 🚀 104522000 128581098 0.81
tpcds_q52/duckdb:parquet 13416450 12906400 1.04
tpcds_q53/duckdb:parquet 19399609 19180890 1.01
tpcds_q54/duckdb:parquet 29201362 28976611 1.01
tpcds_q55/duckdb:parquet 13051718 13230036 0.99
tpcds_q56/duckdb:parquet 23430602 23749143 0.99
tpcds_q57/duckdb:parquet 37991460 38988515 0.97
tpcds_q58/duckdb:parquet 25618422 26200787 0.98
tpcds_q59/duckdb:parquet 36085299 36219670 1.00
tpcds_q60/duckdb:parquet 25029411 24635935 1.02
tpcds_q61/duckdb:parquet 33448195 34040337 0.98
tpcds_q62/duckdb:parquet 12466674 12947257 0.96
tpcds_q63/duckdb:parquet 17016670 17542528 0.97
tpcds_q64/duckdb:parquet 80293729 75667874 1.06
tpcds_q65/duckdb:parquet 23034030 22924711 1.00
tpcds_q66/duckdb:parquet 30296208 32420607 0.93
tpcds_q67/duckdb:parquet 136527174 137122304 1.00
tpcds_q68/duckdb:parquet 39860917 38981998 1.02
tpcds_q69/duckdb:parquet 38650957 40008755 0.97
tpcds_q70/duckdb:parquet 22827978 21994778 1.04
tpcds_q71/duckdb:parquet 23546813 22818436 1.03
tpcds_q72/duckdb:parquet 166915236 166445632 1.00
tpcds_q73/duckdb:parquet 19754478 20212762 0.98
tpcds_q74/duckdb:parquet 126224455 126742494 1.00
tpcds_q75/duckdb:parquet 56388841 57617972 0.98
tpcds_q76/duckdb:parquet 21546553 21998332 0.98
tpcds_q77/duckdb:parquet 25900422 25124809 1.03
tpcds_q78/duckdb:parquet 77681118 77548992 1.00
tpcds_q79/duckdb:parquet 30076763 30358131 0.99
tpcds_q80/duckdb:parquet 45183075 43009812 1.05
tpcds_q81/duckdb:parquet 35493262 35008833 1.01
tpcds_q82/duckdb:parquet 17671619 16283960 1.09
tpcds_q83/duckdb:parquet 17814484 18436313 0.97
tpcds_q84/duckdb:parquet 20485926 20235841 1.01
tpcds_q85/duckdb:parquet 41795508 42648923 0.98
tpcds_q86/duckdb:parquet 13754405 13907391 0.99
tpcds_q87/duckdb:parquet 40206081 39711676 1.01
tpcds_q88/duckdb:parquet 54350180 53644183 1.01
tpcds_q89/duckdb:parquet 21678125 21780129 1.00
tpcds_q90/duckdb:parquet 8310811 8475866 0.98
tpcds_q91/duckdb:parquet 25604600 24543705 1.04
tpcds_q92/duckdb:parquet 13233746 13111968 1.01
tpcds_q93/duckdb:parquet 31697780 32263367 0.98
tpcds_q94/duckdb:parquet 17910290 17925465 1.00
tpcds_q95/duckdb:parquet 🚀 120932718 146067190 0.83
tpcds_q96/duckdb:parquet 10422536 10611334 0.98
tpcds_q97/duckdb:parquet 38776843 39545345 0.98
tpcds_q98/duckdb:parquet 24571538 23436450 1.05
tpcds_q99/duckdb:parquet 20326913 20103052 1.01
duckdb / duckdb (0.987x ➖, 3↑ 0↓)
name PR a1510c1 (ns) base 67a2b22 (ns) ratio (PR/base)
tpcds_q01/duckdb:duckdb 22202662 23599371 0.94
tpcds_q02/duckdb:duckdb 19309805 18964286 1.02
tpcds_q03/duckdb:duckdb 10365231 10119980 1.02
tpcds_q04/duckdb:duckdb 180555676 181780579 0.99
tpcds_q05/duckdb:duckdb 21662559 20935034 1.03
tpcds_q06/duckdb:duckdb 27947721 28305401 0.99
tpcds_q07/duckdb:duckdb 40777453 40289406 1.01
tpcds_q08/duckdb:duckdb 119753446 120336432 1.00
tpcds_q09/duckdb:duckdb 20274893 20736652 0.98
tpcds_q10/duckdb:duckdb 27546176 27920897 0.99
tpcds_q11/duckdb:duckdb 90650918 89509674 1.01
tpcds_q12/duckdb:duckdb 13704589 14035364 0.98
tpcds_q13/duckdb:duckdb 25707856 26370622 0.97
tpcds_q14/duckdb:duckdb 94106105 93303687 1.01
tpcds_q15/duckdb:duckdb 24622004 24846452 0.99
tpcds_q16/duckdb:duckdb 20142416 18856302 1.07
tpcds_q17/duckdb:duckdb 24801200 24889108 1.00
tpcds_q18/duckdb:duckdb 45895035 46406321 0.99
tpcds_q19/duckdb:duckdb 20273818 19487580 1.04
tpcds_q20/duckdb:duckdb 13900378 14354217 0.97
tpcds_q21/duckdb:duckdb 7391502 7625171 0.97
tpcds_q22/duckdb:duckdb 62039783 62107636 1.00
tpcds_q23/duckdb:duckdb 78643926 77346836 1.02
tpcds_q24/duckdb:duckdb 25506398 25617494 1.00
tpcds_q25/duckdb:duckdb 18540348 18597934 1.00
tpcds_q26/duckdb:duckdb 28734394 28119593 1.02
tpcds_q27/duckdb:duckdb 40958565 42817952 0.96
tpcds_q28/duckdb:duckdb 25283043 25868247 0.98
tpcds_q29/duckdb:duckdb 23027875 24075391 0.96
tpcds_q30/duckdb:duckdb 31477861 31289006 1.01
tpcds_q31/duckdb:duckdb 51741061 51313558 1.01
tpcds_q32/duckdb:duckdb 🚀 7978602 9226156 0.86
tpcds_q33/duckdb:duckdb 15887153 16004498 0.99
tpcds_q34/duckdb:duckdb 18477904 18885221 0.98
tpcds_q35/duckdb:duckdb 37532737 36880481 1.02
tpcds_q36/duckdb:duckdb 71445093 70358673 1.02
tpcds_q37/duckdb:duckdb 8717701 8684888 1.00
tpcds_q38/duckdb:duckdb 33435576 36111039 0.93
tpcds_q39/duckdb:duckdb 28561358 28653976 1.00
tpcds_q40/duckdb:duckdb 14647860 14714522 1.00
tpcds_q41/duckdb:duckdb 🚀 9186586 10230897 0.90
tpcds_q42/duckdb:duckdb 9475087 9438697 1.00
tpcds_q43/duckdb:duckdb 14821135 14799959 1.00
tpcds_q44/duckdb:duckdb 15607570 16000218 0.98
tpcds_q45/duckdb:duckdb 18360815 18503097 0.99
tpcds_q46/duckdb:duckdb 39200807 39380693 1.00
tpcds_q47/duckdb:duckdb 47037250 46888004 1.00
tpcds_q48/duckdb:duckdb 24845906 25125763 0.99
tpcds_q49/duckdb:duckdb 21282395 20813553 1.02
tpcds_q50/duckdb:duckdb 15956641 16063322 0.99
tpcds_q51/duckdb:duckdb 98273045 97757195 1.01
tpcds_q52/duckdb:duckdb 🚀 9926990 11168086 0.89
tpcds_q53/duckdb:duckdb 17470259 18329022 0.95
tpcds_q54/duckdb:duckdb 18748722 18702749 1.00
tpcds_q55/duckdb:duckdb 10474696 10494703 1.00
tpcds_q56/duckdb:duckdb 16696531 17288894 0.97
tpcds_q57/duckdb:duckdb 36563626 36427397 1.00
tpcds_q58/duckdb:duckdb 17359798 17957771 0.97
tpcds_q59/duckdb:duckdb 36733645 36792815 1.00
tpcds_q60/duckdb:duckdb 18574536 19110183 0.97
tpcds_q61/duckdb:duckdb 17006885 17471059 0.97
tpcds_q62/duckdb:duckdb 9771267 9932698 0.98
tpcds_q63/duckdb:duckdb 16451767 16889591 0.97
tpcds_q64/duckdb:duckdb 58697037 58360642 1.01
tpcds_q65/duckdb:duckdb 36100666 36690207 0.98
tpcds_q66/duckdb:duckdb 26999445 26874470 1.00
tpcds_q67/duckdb:duckdb 131150980 132297357 0.99
tpcds_q68/duckdb:duckdb 26762713 27546558 0.97
tpcds_q69/duckdb:duckdb 27521799 29646218 0.93
tpcds_q70/duckdb:duckdb 16361496 17231214 0.95
tpcds_q71/duckdb:duckdb 16850818 16887252 1.00
tpcds_q72/duckdb:duckdb 45298314 46919798 0.97
tpcds_q73/duckdb:duckdb 13977715 13729595 1.02
tpcds_q74/duckdb:duckdb 145328336 146784328 0.99
tpcds_q75/duckdb:duckdb 46420013 45816237 1.01
tpcds_q76/duckdb:duckdb 14256384 14884939 0.96
tpcds_q77/duckdb:duckdb 15333712 15537924 0.99
tpcds_q78/duckdb:duckdb 66385832 66072856 1.00
tpcds_q79/duckdb:duckdb 20320437 20209789 1.01
tpcds_q80/duckdb:duckdb 30940503 32732856 0.95
tpcds_q81/duckdb:duckdb 40575660 41037188 0.99
tpcds_q82/duckdb:duckdb 10847800 10065763 1.08
tpcds_q83/duckdb:duckdb 10881610 11214615 0.97
tpcds_q84/duckdb:duckdb 14857168 15059892 0.99
tpcds_q85/duckdb:duckdb 25761827 26521231 0.97
tpcds_q86/duckdb:duckdb 11957259 12259010 0.98
tpcds_q87/duckdb:duckdb 35957735 35967253 1.00
tpcds_q88/duckdb:duckdb 29765618 30649419 0.97
tpcds_q89/duckdb:duckdb 21653880 22823318 0.95
tpcds_q90/duckdb:duckdb 6052714 6134327 0.99
tpcds_q91/duckdb:duckdb 14101308 14973824 0.94
tpcds_q92/duckdb:duckdb 9916699 9795280 1.01
tpcds_q93/duckdb:duckdb 23722705 23572975 1.01
tpcds_q94/duckdb:duckdb 14421155 14678223 0.98
tpcds_q95/duckdb:duckdb 111420611 110350760 1.01
tpcds_q96/duckdb:duckdb 5730673 6214582 0.92
tpcds_q97/duckdb:duckdb 32348311 31836351 1.02
tpcds_q98/duckdb:duckdb 20945777 20338940 1.03
tpcds_q99/duckdb:duckdb 16710020 16856771 0.99
File Size Changes (6 files changed, +0.0% overall, 1↑ 5↓)
File Scale Format Base HEAD Change %
customer_address.vortex 1.0 vortex-file-compressed 820.96 KB 827.05 KB +6.09 KB +0.7%
item.vortex 1.0 vortex-file-compressed 1.66 MB 1.66 MB 144 B -0.0%
item.vortex 1.0 vortex-compact 994.64 KB 994.25 KB 400 B -0.0%
customer.vortex 1.0 vortex-file-compressed 4.27 MB 4.26 MB 1.81 KB -0.0%
catalog_page.vortex 1.0 vortex-file-compressed 572.52 KB 572.19 KB 336 B -0.1%
time_dim.vortex 1.0 vortex-file-compressed 380.87 KB 380.09 KB 800 B -0.2%

Totals:

  • vortex-compact: 207.50 MB → 207.50 MB (-0.0%)
  • vortex-file-compressed: 271.84 MB → 271.85 MB (+0.0%)

@github-actions

github-actions Bot commented Jun 16, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Statistical and Population Genetics

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +2.3%
Engines: DuckDB No clear signal (+2.3%, low confidence)
Vortex (geomean): 0.978x ➖
Parquet (geomean): 0.956x ➖
Shifts: Parquet (control) -4.4% · Median polish -3.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
duckdb / vortex-file-compressed (0.978x ➖, 0↑ 0↓)
name PR a1510c1 (ns) base 67a2b22 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 12063559 12404078 0.97
statpopgen_q01/duckdb:vortex-file-compressed 26910678 27771306 0.97
statpopgen_q02/duckdb:vortex-file-compressed 528894421 536178580 0.99
statpopgen_q03/duckdb:vortex-file-compressed 1021223951 1067724394 0.96
statpopgen_q04/duckdb:vortex-file-compressed 1042875652 1071825212 0.97
statpopgen_q05/duckdb:vortex-file-compressed 485912867 488019239 1.00
statpopgen_q06/duckdb:vortex-file-compressed 1544940192 1553362335 0.99
statpopgen_q07/duckdb:vortex-file-compressed 197643385 198272648 1.00
statpopgen_q08/duckdb:vortex-file-compressed 228454882 236324908 0.97
statpopgen_q09/duckdb:vortex-file-compressed 834621981 850837706 0.98
statpopgen_q10/duckdb:vortex-file-compressed 2535741852 2628991199 0.96
duckdb / vortex-compact (0.977x ➖, 0↑ 0↓)
name PR a1510c1 (ns) base 67a2b22 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact 11590603 12623473 0.92
statpopgen_q01/duckdb:vortex-compact 224250217 219358331 1.02
statpopgen_q02/duckdb:vortex-compact 559473339 574507944 0.97
statpopgen_q03/duckdb:vortex-compact 1140759158 1161621248 0.98
statpopgen_q04/duckdb:vortex-compact 1146309932 1182111143 0.97
statpopgen_q05/duckdb:vortex-compact 587106498 571540306 1.03
statpopgen_q06/duckdb:vortex-compact 1495337447 1510369609 0.99
statpopgen_q07/duckdb:vortex-compact 883799947 918282531 0.96
statpopgen_q08/duckdb:vortex-compact 918142816 946326241 0.97
statpopgen_q09/duckdb:vortex-compact 928406194 961666330 0.97
statpopgen_q10/duckdb:vortex-compact 2595468005 2664136964 0.97
duckdb / parquet (0.956x ➖, 0↑ 0↓)
name PR a1510c1 (ns) base 67a2b22 (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 294460378 311413760 0.95
statpopgen_q01/duckdb:parquet 381033251 392038922 0.97
statpopgen_q02/duckdb:parquet 747285064 789235474 0.95
statpopgen_q03/duckdb:parquet 1191174199 1224758704 0.97
statpopgen_q04/duckdb:parquet 1192906039 1230979316 0.97
statpopgen_q05/duckdb:parquet 809359467 833538257 0.97
statpopgen_q06/duckdb:parquet 1400706254 1468506527 0.95
statpopgen_q07/duckdb:parquet 847634558 893070886 0.95
statpopgen_q08/duckdb:parquet 851833938 906767986 0.94
statpopgen_q09/duckdb:parquet 1001162026 1047315583 0.96
statpopgen_q10/duckdb:parquet 2185593633 2320149908 0.94
File Size Changes (1 files changed, +0.0% overall, 1↑ 0↓)
File Scale Format Base HEAD Change %
gnomad.genomes.v3.1.2.hgdp_tgp.chr21.vortex 100000 vortex-file-compressed 1.96 GB 1.96 GB +111.22 KB +0.0%

Totals:

  • vortex-compact: 959.62 MB → 959.62 MB (0.0%)
  • vortex-file-compressed: 1.96 GB → 1.96 GB (+0.0%)

@github-actions

github-actions Bot commented Jun 16, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -3.4%
Engines: DataFusion No clear signal (-3.4%, environment too noisy confidence) · DuckDB No clear signal (-3.4%, environment too noisy confidence)
Vortex (geomean): 0.969x ➖
Parquet (geomean): 1.003x ➖
Shifts: Parquet (control) +0.3% · Median polish -0.9%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.960x ➖, 1↑ 0↓)
name PR a1510c1 (ns) base 67a2b22 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 50284671 55973209 0.90
fineweb_q01/datafusion:vortex-file-compressed 1021189167 829385521 1.23
fineweb_q02/datafusion:vortex-file-compressed 1286465017 1017114368 1.26
fineweb_q03/datafusion:vortex-file-compressed 1593790972 1445121949 1.10
fineweb_q04/datafusion:vortex-file-compressed 1311100168 1387298689 0.95
fineweb_q05/datafusion:vortex-file-compressed 1209338959 1344174496 0.90
fineweb_q06/datafusion:vortex-file-compressed 1701409715 1651959304 1.03
fineweb_q07/datafusion:vortex-file-compressed 🚀 1268165707 1993229024 0.64
fineweb_q08/datafusion:vortex-file-compressed 973812960 1207571626 0.81
datafusion / vortex-compact (1.003x ➖, 0↑ 0↓)
name PR a1510c1 (ns) base 67a2b22 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 37746932 38483687 0.98
fineweb_q01/datafusion:vortex-compact 1001325812 791035084 1.27
fineweb_q02/datafusion:vortex-compact 818897403 1016348737 0.81
fineweb_q03/datafusion:vortex-compact 1441001230 1382315285 1.04
fineweb_q04/datafusion:vortex-compact 1655954576 1667786737 0.99
fineweb_q05/datafusion:vortex-compact 1423372383 1371599777 1.04
fineweb_q06/datafusion:vortex-compact 1331830019 1343766300 0.99
fineweb_q07/datafusion:vortex-compact 1291556014 1202530877 1.07
fineweb_q08/datafusion:vortex-compact 425400586 475099191 0.90
datafusion / parquet (1.015x ➖, 0↑ 1↓)
name PR a1510c1 (ns) base 67a2b22 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 1555586662 1839294105 0.85
fineweb_q01/datafusion:parquet 2644725775 2787575791 0.95
fineweb_q02/datafusion:parquet 2634586237 2584324806 1.02
fineweb_q03/datafusion:parquet 2779975721 3273549973 0.85
fineweb_q04/datafusion:parquet 3259425601 3136015217 1.04
fineweb_q05/datafusion:parquet 2734929102 2749213731 0.99
fineweb_q06/datafusion:parquet 2554466043 2650854360 0.96
fineweb_q07/datafusion:parquet 3306362759 2676018892 1.24
fineweb_q08/datafusion:parquet 🚨 3086725815 2300174486 1.34
duckdb / vortex-file-compressed (0.990x ➖, 0↑ 0↓)
name PR a1510c1 (ns) base 67a2b22 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 99658997 116416849 0.86
fineweb_q01/duckdb:vortex-file-compressed 780869588 833234963 0.94
fineweb_q02/duckdb:vortex-file-compressed 579334087 715471418 0.81
fineweb_q03/duckdb:vortex-file-compressed 1981841883 1556539204 1.27
fineweb_q04/duckdb:vortex-file-compressed 1636882985 1532362095 1.07
fineweb_q05/duckdb:vortex-file-compressed 1438596247 1491987029 0.96
fineweb_q06/duckdb:vortex-file-compressed 1710263078 1656793162 1.03
fineweb_q07/duckdb:vortex-file-compressed 1411486328 1595632991 0.88
fineweb_q08/duckdb:vortex-file-compressed 667626488 567854636 1.18
duckdb / vortex-compact (0.926x ➖, 1↑ 0↓)
name PR a1510c1 (ns) base 67a2b22 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 🚀 74062276 121812293 0.61
fineweb_q01/duckdb:vortex-compact 720819708 685520877 1.05
fineweb_q02/duckdb:vortex-compact 778130693 678599037 1.15
fineweb_q03/duckdb:vortex-compact 1852101458 1794236143 1.03
fineweb_q04/duckdb:vortex-compact 1982092012 1985993133 1.00
fineweb_q05/duckdb:vortex-compact 1767910551 1778177565 0.99
fineweb_q06/duckdb:vortex-compact 1663911251 1827617648 0.91
fineweb_q07/duckdb:vortex-compact 1541015003 1749960143 0.88
fineweb_q08/duckdb:vortex-compact 512484862 613850610 0.83
duckdb / parquet (0.991x ➖, 0↑ 0↓)
name PR a1510c1 (ns) base 67a2b22 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1274290887 1223884806 1.04
fineweb_q01/duckdb:parquet 1658481331 1610131315 1.03
fineweb_q02/duckdb:parquet 1563852313 1616995630 0.97
fineweb_q03/duckdb:parquet 4110971863 4075381406 1.01
fineweb_q04/duckdb:parquet 2180235371 2495007803 0.87
fineweb_q05/duckdb:parquet 2363163229 2459824120 0.96
fineweb_q06/duckdb:parquet 5142592521 4975811383 1.03
fineweb_q07/duckdb:parquet 3113295962 3119657327 1.00
fineweb_q08/duckdb:parquet 1295742569 1269734719 1.02

@github-actions

github-actions Bot commented Jun 16, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Random Access

Vortex (geomean): 0.479x ✅
Parquet (geomean): 1.010x ➖

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
unknown / unknown (0.781x ✅, 18↑ 0↓)
name PR a1510c1 (ns) base 67a2b22 (ns) ratio (PR/base)
random-access/feature-vectors/correlated/lance-tokio-local-disk 368046 386893 0.95
random-access/feature-vectors/correlated/lance-tokio-local-disk-footer 1013473 1048359 0.97
random-access/feature-vectors/correlated/parquet-tokio-local-disk 8514323014 8604747124 0.99
random-access/feature-vectors/correlated/parquet-tokio-local-disk-footer 8440979243 8468545109 1.00
random-access/feature-vectors/correlated/vortex-tokio-local-disk 🚀 3536216 4077350 0.87
random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer 🚀 2431506 2970054 0.82
random-access/feature-vectors/uniform/lance-tokio-local-disk 1165511 1171188 1.00
random-access/feature-vectors/uniform/lance-tokio-local-disk-footer 1812680 1817836 1.00
random-access/feature-vectors/uniform/parquet-tokio-local-disk 8364023171 8317022562 1.01
random-access/feature-vectors/uniform/parquet-tokio-local-disk-footer 8358321453 8370128029 1.00
random-access/feature-vectors/uniform/vortex-tokio-local-disk 🚀 1180673 3480441 0.34
random-access/feature-vectors/uniform/vortex-tokio-local-disk-footer 🚀 3485022 5866721 0.59
random-access/lance-tokio-local-disk 638379 633163 1.01
random-access/lance-tokio-local-disk-footer 1287153 1276153 1.01
random-access/nested-lists/correlated/lance-tokio-local-disk 228048 241365 0.94
random-access/nested-lists/correlated/lance-tokio-local-disk-footer 570332 587451 0.97
random-access/nested-lists/correlated/parquet-tokio-local-disk 131325658 128928080 1.02
random-access/nested-lists/correlated/parquet-tokio-local-disk-footer 133384941 127541622 1.05
random-access/nested-lists/correlated/vortex-tokio-local-disk 🚀 163271 474461 0.34
random-access/nested-lists/correlated/vortex-tokio-local-disk-footer 🚀 267458 603820 0.44
random-access/nested-lists/uniform/lance-tokio-local-disk 962784 1004104 0.96
random-access/nested-lists/uniform/lance-tokio-local-disk-footer 1306126 1355909 0.96
random-access/nested-lists/uniform/parquet-tokio-local-disk 132480615 127791475 1.04
random-access/nested-lists/uniform/parquet-tokio-local-disk-footer 134635096 127458247 1.06
random-access/nested-lists/uniform/vortex-tokio-local-disk 🚀 577853 1957201 0.30
random-access/nested-lists/uniform/vortex-tokio-local-disk-footer 🚀 705854 2075261 0.34
random-access/nested-structs/correlated/lance-tokio-local-disk 362890 368104 0.99
random-access/nested-structs/correlated/lance-tokio-local-disk-footer 537602 549709 0.98
random-access/nested-structs/correlated/parquet-tokio-local-disk 22482786 22196441 1.01
random-access/nested-structs/correlated/parquet-tokio-local-disk-footer 22062686 22147155 1.00
random-access/nested-structs/correlated/vortex-tokio-local-disk 🚀 216731 561635 0.39
random-access/nested-structs/correlated/vortex-tokio-local-disk-footer 🚀 366508 734679 0.50
random-access/nested-structs/uniform/lance-tokio-local-disk 2557988 2611970 0.98
random-access/nested-structs/uniform/lance-tokio-local-disk-footer 2813715 2748713 1.02
random-access/nested-structs/uniform/parquet-tokio-local-disk 22782781 22188651 1.03
random-access/nested-structs/uniform/parquet-tokio-local-disk-footer 23293732 22281290 1.05
random-access/nested-structs/uniform/vortex-tokio-local-disk 🚀 380970 1449595 0.26
random-access/nested-structs/uniform/vortex-tokio-local-disk-footer 🚀 583894 1553559 0.38
random-access/parquet-tokio-local-disk 165082088 167230862 0.99
random-access/parquet-tokio-local-disk-footer 165596105 167026441 0.99
random-access/taxi/correlated/lance-tokio-local-disk 935431 935882 1.00
random-access/taxi/correlated/lance-tokio-local-disk-footer 1831378 1821879 1.01
random-access/taxi/correlated/parquet-tokio-local-disk 248892020 250043638 1.00
random-access/taxi/correlated/parquet-tokio-local-disk-footer 248620909 250943198 0.99
random-access/taxi/correlated/vortex-tokio-local-disk 🚀 621796 1205643 0.52
random-access/taxi/correlated/vortex-tokio-local-disk-footer 🚀 949112 1639853 0.58
random-access/taxi/uniform/lance-tokio-local-disk 9296364 9287669 1.00
random-access/taxi/uniform/lance-tokio-local-disk-footer 9600497 9785165 0.98
random-access/taxi/uniform/parquet-tokio-local-disk 264148961 266653335 0.99
random-access/taxi/uniform/parquet-tokio-local-disk-footer 265154621 266823014 0.99
random-access/taxi/uniform/vortex-tokio-local-disk 🚀 1893245 3455617 0.55
random-access/taxi/uniform/vortex-tokio-local-disk-footer 🚀 2314134 4050774 0.57
random-access/vortex-tokio-local-disk 🚀 463239 744164 0.62
random-access/vortex-tokio-local-disk-footer 🚀 831638 1123690 0.74

@github-actions

github-actions Bot commented Jun 16, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -3.5%
Engines: DataFusion No clear signal (-3.4%, low confidence) · DuckDB No clear signal (-3.6%, low confidence)
Vortex (geomean): 0.885x ✅
Parquet (geomean): 0.919x ➖
Shifts: Parquet (control) -8.1% · Median polish -10.9%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.865x ✅, 19↑ 0↓)
name PR a1510c1 (ns) base e1c6ef5 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 418787692 458780645 0.91
tpch_q02/datafusion:vortex-file-compressed 🚀 102411805 116486814 0.88
tpch_q03/datafusion:vortex-file-compressed 🚀 192655468 223858435 0.86
tpch_q04/datafusion:vortex-file-compressed 🚀 100283026 112887953 0.89
tpch_q05/datafusion:vortex-file-compressed 🚀 335296887 398973485 0.84
tpch_q06/datafusion:vortex-file-compressed 🚀 35488024 43892896 0.81
tpch_q07/datafusion:vortex-file-compressed 🚀 456895231 534507971 0.85
tpch_q08/datafusion:vortex-file-compressed 🚀 340712480 391624344 0.87
tpch_q09/datafusion:vortex-file-compressed 🚀 584867034 669411312 0.87
tpch_q10/datafusion:vortex-file-compressed 🚀 223249348 260041972 0.86
tpch_q11/datafusion:vortex-file-compressed 🚀 78733647 92722199 0.85
tpch_q12/datafusion:vortex-file-compressed 🚀 106724389 131161617 0.81
tpch_q13/datafusion:vortex-file-compressed 🚀 196751603 231863014 0.85
tpch_q14/datafusion:vortex-file-compressed 🚀 47432667 53381659 0.89
tpch_q15/datafusion:vortex-file-compressed 🚀 94871430 105509825 0.90
tpch_q16/datafusion:vortex-file-compressed 🚀 75007319 88207324 0.85
tpch_q17/datafusion:vortex-file-compressed 🚀 580456907 652680913 0.89
tpch_q18/datafusion:vortex-file-compressed 🚀 827440578 963177821 0.86
tpch_q19/datafusion:vortex-file-compressed 65635362 71800795 0.91
tpch_q20/datafusion:vortex-file-compressed 🚀 157116743 187506488 0.84
tpch_q21/datafusion:vortex-file-compressed 🚀 614018246 756852753 0.81
tpch_q22/datafusion:vortex-file-compressed 56664253 60935656 0.93
datafusion / vortex-compact (0.879x ✅, 18↑ 0↓)
name PR a1510c1 (ns) base e1c6ef5 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 465292858 503922342 0.92
tpch_q02/datafusion:vortex-compact 🚀 105389253 118623726 0.89
tpch_q03/datafusion:vortex-compact 🚀 195640742 223048997 0.88
tpch_q04/datafusion:vortex-compact 🚀 107959463 126260678 0.86
tpch_q05/datafusion:vortex-compact 🚀 337910256 388091314 0.87
tpch_q06/datafusion:vortex-compact 🚀 58857556 67279510 0.87
tpch_q07/datafusion:vortex-compact 🚀 470286578 560008298 0.84
tpch_q08/datafusion:vortex-compact 🚀 348222834 396653616 0.88
tpch_q09/datafusion:vortex-compact 🚀 589203108 679147315 0.87
tpch_q10/datafusion:vortex-compact 🚀 238496995 273383042 0.87
tpch_q11/datafusion:vortex-compact 🚀 79133898 91992264 0.86
tpch_q12/datafusion:vortex-compact 🚀 151695388 174547716 0.87
tpch_q13/datafusion:vortex-compact 🚀 242888306 279321475 0.87
tpch_q14/datafusion:vortex-compact 🚀 65357695 73534228 0.89
tpch_q15/datafusion:vortex-compact 🚀 150529202 171917017 0.88
tpch_q16/datafusion:vortex-compact 80846409 87684735 0.92
tpch_q17/datafusion:vortex-compact 🚀 578867036 689856872 0.84
tpch_q18/datafusion:vortex-compact 🚀 828046841 961074745 0.86
tpch_q19/datafusion:vortex-compact 207224300 224217946 0.92
tpch_q20/datafusion:vortex-compact 🚀 178755265 202700868 0.88
tpch_q21/datafusion:vortex-compact 🚀 624796259 728982370 0.86
tpch_q22/datafusion:vortex-compact 63564707 66142450 0.96
datafusion / parquet (0.900x ➖, 13↑ 0↓)
name PR a1510c1 (ns) base e1c6ef5 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 🚀 479755483 539708767 0.89
tpch_q02/datafusion:parquet 174479457 191212062 0.91
tpch_q03/datafusion:parquet 🚀 258019654 290348200 0.89
tpch_q04/datafusion:parquet 121117072 131680207 0.92
tpch_q05/datafusion:parquet 🚀 398642201 462105432 0.86
tpch_q06/datafusion:parquet 🚀 128630481 147390476 0.87
tpch_q07/datafusion:parquet 🚀 565542609 642848186 0.88
tpch_q08/datafusion:parquet 🚀 442555169 497141277 0.89
tpch_q09/datafusion:parquet 🚀 725371864 841272465 0.86
tpch_q10/datafusion:parquet 🚀 572394146 652744683 0.88
tpch_q11/datafusion:parquet 120638769 125536873 0.96
tpch_q12/datafusion:parquet 217532286 228544265 0.95
tpch_q13/datafusion:parquet 345157872 373027345 0.93
tpch_q14/datafusion:parquet 157019245 169931780 0.92
tpch_q15/datafusion:parquet 🚀 262582783 297410928 0.88
tpch_q16/datafusion:parquet 122976955 130014223 0.95
tpch_q17/datafusion:parquet 🚀 667958667 767269690 0.87
tpch_q18/datafusion:parquet 🚀 874364708 981665589 0.89
tpch_q19/datafusion:parquet 281979826 304110282 0.93
tpch_q20/datafusion:parquet 🚀 293422012 335088341 0.88
tpch_q21/datafusion:parquet 🚀 647480818 744516691 0.87
tpch_q22/datafusion:parquet 206953965 219534103 0.94
datafusion / arrow (0.866x ✅, 20↑ 0↓)
name PR a1510c1 (ns) base e1c6ef5 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 🚀 693201013 780228556 0.89
tpch_q02/datafusion:arrow 🚀 111254418 128118588 0.87
tpch_q03/datafusion:arrow 🚀 499559569 571265860 0.87
tpch_q04/datafusion:arrow 🚀 364441476 427889070 0.85
tpch_q05/datafusion:arrow 🚀 731302786 841651405 0.87
tpch_q06/datafusion:arrow 🚀 319409546 368335906 0.87
tpch_q07/datafusion:arrow 🚀 1120229748 1312366184 0.85
tpch_q08/datafusion:arrow 🚀 930045562 1062924928 0.87
tpch_q09/datafusion:arrow 🚀 1082406495 1203843996 0.90
tpch_q10/datafusion:arrow 🚀 618169620 730020710 0.85
tpch_q11/datafusion:arrow 91858330 101012028 0.91
tpch_q12/datafusion:arrow 🚀 1222873604 1555996372 0.79
tpch_q13/datafusion:arrow 🚀 462151102 519292179 0.89
tpch_q14/datafusion:arrow 🚀 354438935 412298899 0.86
tpch_q15/datafusion:arrow 🚀 735751739 872971628 0.84
tpch_q16/datafusion:arrow 🚀 83121869 92854019 0.90
tpch_q17/datafusion:arrow 🚀 947370168 1107383662 0.86
tpch_q18/datafusion:arrow 🚀 1807867970 2086206573 0.87
tpch_q19/datafusion:arrow 🚀 537429128 625490783 0.86
tpch_q20/datafusion:arrow 🚀 498820031 585967571 0.85
tpch_q21/datafusion:arrow 3092600561 3382320854 0.91
tpch_q22/datafusion:arrow 🚀 80581602 94983059 0.85
duckdb / vortex-file-compressed (0.893x ✅, 13↑ 0↓)
name PR a1510c1 (ns) base e1c6ef5 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 170242257 188388849 0.90
tpch_q02/duckdb:vortex-file-compressed 51428245 55484893 0.93
tpch_q03/duckdb:vortex-file-compressed 🚀 121500699 140130937 0.87
tpch_q04/duckdb:vortex-file-compressed 🚀 159031680 180881002 0.88
tpch_q05/duckdb:vortex-file-compressed 🚀 137169965 152996882 0.90
tpch_q06/duckdb:vortex-file-compressed 33532969 36672587 0.91
tpch_q07/duckdb:vortex-file-compressed 🚀 131636595 151110403 0.87
tpch_q08/duckdb:vortex-file-compressed 🚀 166440357 192877079 0.86
tpch_q09/duckdb:vortex-file-compressed 396482692 436265067 0.91
tpch_q10/duckdb:vortex-file-compressed 🚀 189209848 211804323 0.89
tpch_q11/duckdb:vortex-file-compressed 31823532 34524030 0.92
tpch_q12/duckdb:vortex-file-compressed 99653572 110423440 0.90
tpch_q13/duckdb:vortex-file-compressed 🚀 273648327 308483149 0.89
tpch_q14/duckdb:vortex-file-compressed 🚀 53299529 59425980 0.90
tpch_q15/duckdb:vortex-file-compressed 🚀 88453986 99909424 0.89
tpch_q16/duckdb:vortex-file-compressed 76388267 84355568 0.91
tpch_q17/duckdb:vortex-file-compressed 🚀 93374414 104618851 0.89
tpch_q18/duckdb:vortex-file-compressed 🚀 285031385 322750862 0.88
tpch_q19/duckdb:vortex-file-compressed 80141934 87342161 0.92
tpch_q20/duckdb:vortex-file-compressed 🚀 141070042 161690900 0.87
tpch_q21/duckdb:vortex-file-compressed 🚀 483832244 559804923 0.86
tpch_q22/duckdb:vortex-file-compressed 63426723 69975026 0.91
duckdb / vortex-compact (0.905x ➖, 12↑ 0↓)
name PR a1510c1 (ns) base e1c6ef5 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 229682516 249545099 0.92
tpch_q02/duckdb:vortex-compact 57848139 59156708 0.98
tpch_q03/duckdb:vortex-compact 🚀 135305541 151969524 0.89
tpch_q04/duckdb:vortex-compact 🚀 170543733 191800878 0.89
tpch_q05/duckdb:vortex-compact 🚀 164653491 185081858 0.89
tpch_q06/duckdb:vortex-compact 56833980 60836006 0.93
tpch_q07/duckdb:vortex-compact 🚀 173459437 197850504 0.88
tpch_q08/duckdb:vortex-compact 🚀 188208943 210134559 0.90
tpch_q09/duckdb:vortex-compact 🚀 425791767 475989528 0.89
tpch_q10/duckdb:vortex-compact 🚀 219018104 244060393 0.90
tpch_q11/duckdb:vortex-compact 38783871 42403972 0.91
tpch_q12/duckdb:vortex-compact 162903853 180390531 0.90
tpch_q13/duckdb:vortex-compact 🚀 327065412 365749263 0.89
tpch_q14/duckdb:vortex-compact 72319825 79246591 0.91
tpch_q15/duckdb:vortex-compact 114038176 126623149 0.90
tpch_q16/duckdb:vortex-compact 81148652 87744572 0.92
tpch_q17/duckdb:vortex-compact 🚀 107327908 120189705 0.89
tpch_q18/duckdb:vortex-compact 🚀 287936906 322861305 0.89
tpch_q19/duckdb:vortex-compact 95944656 104081098 0.92
tpch_q20/duckdb:vortex-compact 🚀 174227773 199966138 0.87
tpch_q21/duckdb:vortex-compact 🚀 518122178 583580174 0.89
tpch_q22/duckdb:vortex-compact 71233500 76776410 0.93
duckdb / parquet (0.939x ➖, 0↑ 0↓)
name PR a1510c1 (ns) base e1c6ef5 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 261276655 285154828 0.92
tpch_q02/duckdb:parquet 101831699 104993727 0.97
tpch_q03/duckdb:parquet 209170432 227120914 0.92
tpch_q04/duckdb:parquet 135894237 141946388 0.96
tpch_q05/duckdb:parquet 225141817 239287862 0.94
tpch_q06/duckdb:parquet 74981693 78002739 0.96
tpch_q07/duckdb:parquet 187175644 203044067 0.92
tpch_q08/duckdb:parquet 258501700 285229911 0.91
tpch_q09/duckdb:parquet 470135904 515839520 0.91
tpch_q10/duckdb:parquet 623548131 657945042 0.95
tpch_q11/duckdb:parquet 63820914 69406630 0.92
tpch_q12/duckdb:parquet 133743511 142684511 0.94
tpch_q13/duckdb:parquet 445923967 455930527 0.98
tpch_q14/duckdb:parquet 180240335 195131480 0.92
tpch_q15/duckdb:parquet 104957779 113273509 0.93
tpch_q16/duckdb:parquet 166685883 175050009 0.95
tpch_q17/duckdb:parquet 183258762 191277803 0.96
tpch_q18/duckdb:parquet 364436364 387971096 0.94
tpch_q19/duckdb:parquet 289645871 304830322 0.95
tpch_q20/duckdb:parquet 225743059 243595339 0.93
tpch_q21/duckdb:parquet 556940115 609216669 0.91
tpch_q22/duckdb:parquet 293901339 301215043 0.98
duckdb / duckdb (0.916x ➖, 3↑ 0↓)
name PR a1510c1 (ns) base e1c6ef5 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 120300104 128183128 0.94
tpch_q02/duckdb:duckdb 48674145 54081701 0.90
tpch_q03/duckdb:duckdb 104163610 114175224 0.91
tpch_q04/duckdb:duckdb 🚀 137786340 154764078 0.89
tpch_q05/duckdb:duckdb 119828280 128473414 0.93
tpch_q06/duckdb:duckdb 44492335 48020107 0.93
tpch_q07/duckdb:duckdb 90633933 99637129 0.91
tpch_q08/duckdb:duckdb 118194495 130064494 0.91
tpch_q09/duckdb:duckdb 279903083 307248726 0.91
tpch_q10/duckdb:duckdb 210611461 229835544 0.92
tpch_q11/duckdb:duckdb 19336252 20983507 0.92
tpch_q12/duckdb:duckdb 89592594 99435060 0.90
tpch_q13/duckdb:duckdb 🚀 228943944 259167178 0.88
tpch_q14/duckdb:duckdb 77477123 85137263 0.91
tpch_q15/duckdb:duckdb 81674308 87970409 0.93
tpch_q16/duckdb:duckdb 75550468 83437490 0.91
tpch_q17/duckdb:duckdb 87708737 92029894 0.95
tpch_q18/duckdb:duckdb 232550869 255517055 0.91
tpch_q19/duckdb:duckdb 124228723 133285506 0.93
tpch_q20/duckdb:duckdb 117641262 124916924 0.94
tpch_q21/duckdb:duckdb 🚀 299202722 336066745 0.89
tpch_q22/duckdb:duckdb 67647977 71956389 0.94
File Size Changes (27 files changed, -0.0% overall, 8↑ 19↓)
File Scale Format Base HEAD Change %
part_1.vortex 10.0 vortex-file-compressed 24.66 MB 24.90 MB +250.05 KB +1.0%
part_0.vortex 10.0 vortex-compact 16.75 MB 16.89 MB +138.67 KB +0.8%
partsupp_1.vortex 10.0 vortex-compact 104.93 MB 105.15 MB +225.09 KB +0.2%
customer_0.vortex 10.0 vortex-file-compressed 88.50 MB 88.55 MB +50.45 KB +0.1%
lineitem_8.vortex 10.0 vortex-file-compressed 133.39 MB 133.44 MB +56.20 KB +0.0%
partsupp_0.vortex 10.0 vortex-file-compressed 120.28 MB 120.31 MB +26.57 KB +0.0%
partsupp_1.vortex 10.0 vortex-file-compressed 120.30 MB 120.31 MB +15.05 KB +0.0%
lineitem_10.vortex 10.0 vortex-file-compressed 134.18 MB 134.19 MB +13.70 KB +0.0%
lineitem_3.vortex 10.0 vortex-file-compressed 133.21 MB 133.21 MB 3.37 KB -0.0%
orders_2.vortex 10.0 vortex-file-compressed 145.67 MB 145.65 MB 18.28 KB -0.0%
lineitem_4.vortex 10.0 vortex-file-compressed 133.99 MB 133.97 MB 18.95 KB -0.0%
lineitem_11.vortex 10.0 vortex-file-compressed 134.36 MB 134.34 MB 21.46 KB -0.0%
lineitem_6.vortex 10.0 vortex-file-compressed 132.82 MB 132.79 MB 29.27 KB -0.0%
lineitem_2.vortex 10.0 vortex-file-compressed 134.04 MB 134.00 MB 44.27 KB -0.0%
customer_0.vortex 10.0 vortex-compact 74.12 MB 74.09 MB 25.80 KB -0.0%
lineitem_7.vortex 10.0 vortex-file-compressed 133.75 MB 133.70 MB 47.96 KB -0.0%
lineitem_9.vortex 10.0 vortex-file-compressed 134.32 MB 134.27 MB 54.71 KB -0.0%
lineitem_1.vortex 10.0 vortex-file-compressed 133.81 MB 133.75 MB 69.52 KB -0.1%
partsupp_0.vortex 10.0 vortex-compact 105.05 MB 104.97 MB 84.38 KB -0.1%
lineitem_12.vortex 10.0 vortex-file-compressed 134.10 MB 133.92 MB 180.18 KB -0.1%
orders_1.vortex 10.0 vortex-file-compressed 145.96 MB 145.76 MB 200.16 KB -0.1%
lineitem_5.vortex 10.0 vortex-file-compressed 133.58 MB 133.39 MB 193.46 KB -0.1%
lineitem_0.vortex 10.0 vortex-file-compressed 134.39 MB 134.15 MB 246.12 KB -0.2%
orders_0.vortex 10.0 vortex-file-compressed 144.75 MB 144.28 MB 489.28 KB -0.3%
part_1.vortex 10.0 vortex-compact 16.95 MB 16.88 MB 75.84 KB -0.4%
supplier_0.vortex 10.0 vortex-file-compressed 5.72 MB 5.70 MB 27.07 KB -0.5%
part_0.vortex 10.0 vortex-file-compressed 25.02 MB 24.78 MB 248.10 KB -1.0%

Totals:

  • vortex-compact: 1.93 GB → 1.93 GB (+0.0%)
  • vortex-file-compressed: 2.50 GB → 2.50 GB (-0.1%)

@github-actions

github-actions Bot commented Jun 16, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -2.5%
Engines: DataFusion No clear signal (-1.0%, environment too noisy confidence) · DuckDB No clear signal (-3.6%, low confidence)
Vortex (geomean): 1.017x ➖
Parquet (geomean): 1.045x ➖
Shifts: Parquet (control) +4.5% · Median polish +2.5%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.029x ➖, 1↑ 3↓)
name PR a1510c1 (ns) base e1c6ef5 (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 1786586 1824357 0.98
clickbench_q01/datafusion:vortex-file-compressed 16309994 16274051 1.00
clickbench_q02/datafusion:vortex-file-compressed 35628515 35421442 1.01
clickbench_q03/datafusion:vortex-file-compressed 39747862 40424504 0.98
clickbench_q04/datafusion:vortex-file-compressed 247357280 249884209 0.99
clickbench_q05/datafusion:vortex-file-compressed 321313278 323166556 0.99
clickbench_q06/datafusion:vortex-file-compressed 🚀 1622701 2331766 0.70
clickbench_q07/datafusion:vortex-file-compressed 19256943 19414091 0.99
clickbench_q08/datafusion:vortex-file-compressed 353467519 354745771 1.00
clickbench_q09/datafusion:vortex-file-compressed 475601771 489658355 0.97
clickbench_q10/datafusion:vortex-file-compressed 73835085 73112905 1.01
clickbench_q11/datafusion:vortex-file-compressed 84806802 82595471 1.03
clickbench_q12/datafusion:vortex-file-compressed 298602136 271807388 1.10
clickbench_q13/datafusion:vortex-file-compressed 473301852 451289430 1.05
clickbench_q14/datafusion:vortex-file-compressed 291839734 269198643 1.08
clickbench_q15/datafusion:vortex-file-compressed 311563883 301747201 1.03
clickbench_q16/datafusion:vortex-file-compressed 744152878 703361491 1.06
clickbench_q17/datafusion:vortex-file-compressed 730211842 696292980 1.05
clickbench_q18/datafusion:vortex-file-compressed 1520859250 1519871223 1.00
clickbench_q19/datafusion:vortex-file-compressed 30385656 30214069 1.01
clickbench_q20/datafusion:vortex-file-compressed 358497444 344098290 1.04
clickbench_q21/datafusion:vortex-file-compressed 452599607 431320657 1.05
clickbench_q22/datafusion:vortex-file-compressed 549725029 535551026 1.03
clickbench_q23/datafusion:vortex-file-compressed 593972198 560025133 1.06
clickbench_q24/datafusion:vortex-file-compressed 49160592 45069848 1.09
clickbench_q25/datafusion:vortex-file-compressed 79426166 78741303 1.01
clickbench_q26/datafusion:vortex-file-compressed 43081490 46923502 0.92
clickbench_q27/datafusion:vortex-file-compressed 477511548 442415132 1.08
clickbench_q28/datafusion:vortex-file-compressed 2648627366 2418910823 1.09
clickbench_q29/datafusion:vortex-file-compressed 49153066 47054605 1.04
clickbench_q30/datafusion:vortex-file-compressed 🚨 265077238 234267531 1.13
clickbench_q31/datafusion:vortex-file-compressed 278836522 255254991 1.09
clickbench_q32/datafusion:vortex-file-compressed 🚨 1231961726 1116985571 1.10
clickbench_q33/datafusion:vortex-file-compressed 1635758227 1513622171 1.08
clickbench_q34/datafusion:vortex-file-compressed 1654335634 1505227694 1.10
clickbench_q35/datafusion:vortex-file-compressed 273824366 261963160 1.05
clickbench_q36/datafusion:vortex-file-compressed 64801918 62531498 1.04
clickbench_q37/datafusion:vortex-file-compressed 🚨 29002918 25886186 1.12
clickbench_q38/datafusion:vortex-file-compressed 16769280 15722808 1.07
clickbench_q39/datafusion:vortex-file-compressed 136936398 124863370 1.10
clickbench_q40/datafusion:vortex-file-compressed 13041776 13493869 0.97
clickbench_q41/datafusion:vortex-file-compressed 14424342 13822165 1.04
clickbench_q42/datafusion:vortex-file-compressed 13350519 12923061 1.03
datafusion / parquet (1.039x ➖, 0↑ 3↓)
name PR a1510c1 (ns) base e1c6ef5 (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 1595355 1604039 0.99
clickbench_q01/datafusion:parquet 19741700 20071592 0.98
clickbench_q02/datafusion:parquet 44253626 46594284 0.95
clickbench_q03/datafusion:parquet 36471550 36296000 1.00
clickbench_q04/datafusion:parquet 289127358 289458963 1.00
clickbench_q05/datafusion:parquet 361385259 331702577 1.09
clickbench_q06/datafusion:parquet 🚨 2765126 1746770 1.58
clickbench_q07/datafusion:parquet 22994813 21800270 1.05
clickbench_q08/datafusion:parquet 388315856 354906338 1.09
clickbench_q09/datafusion:parquet 515493904 504752862 1.02
clickbench_q10/datafusion:parquet 97052396 98410147 0.99
clickbench_q11/datafusion:parquet 130487948 122918251 1.06
clickbench_q12/datafusion:parquet 332591041 329499545 1.01
clickbench_q13/datafusion:parquet 🚨 542975586 485027967 1.12
clickbench_q14/datafusion:parquet 350001639 327359461 1.07
clickbench_q15/datafusion:parquet 324586186 295256181 1.10
clickbench_q16/datafusion:parquet 778153817 708372510 1.10
clickbench_q17/datafusion:parquet 732543017 691528271 1.06
clickbench_q18/datafusion:parquet 1577828949 1468483263 1.07
clickbench_q19/datafusion:parquet 28855707 27193976 1.06
clickbench_q20/datafusion:parquet 🚨 643112924 582039341 1.10
clickbench_q21/datafusion:parquet 694428227 651529141 1.07
clickbench_q22/datafusion:parquet 1027307175 955290547 1.08
clickbench_q23/datafusion:parquet 4623051022 4296903133 1.08
clickbench_q24/datafusion:parquet 53630629 56252558 0.95
clickbench_q25/datafusion:parquet 132066385 133299628 0.99
clickbench_q26/datafusion:parquet 54277859 54012230 1.00
clickbench_q27/datafusion:parquet 697303023 695511473 1.00
clickbench_q28/datafusion:parquet 2624705669 2497334781 1.05
clickbench_q29/datafusion:parquet 47444731 49560847 0.96
clickbench_q30/datafusion:parquet 349488925 340635625 1.03
clickbench_q31/datafusion:parquet 393695046 369392238 1.07
clickbench_q32/datafusion:parquet 1256056853 1167176368 1.08
clickbench_q33/datafusion:parquet 1629693223 1587831287 1.03
clickbench_q34/datafusion:parquet 1642879944 1568427836 1.05
clickbench_q35/datafusion:parquet 260844479 259549570 1.00
clickbench_q36/datafusion:parquet 108302350 112690527 0.96
clickbench_q37/datafusion:parquet 45973412 47766662 0.96
clickbench_q38/datafusion:parquet 63415669 63560174 1.00
clickbench_q39/datafusion:parquet 211825375 217467592 0.97
clickbench_q40/datafusion:parquet 24633137 25217446 0.98
clickbench_q41/datafusion:parquet 22348400 22478886 0.99
clickbench_q42/datafusion:parquet 24054972 23729942 1.01
duckdb / vortex-file-compressed (1.004x ➖, 3↑ 3↓)
name PR a1510c1 (ns) base e1c6ef5 (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 7032906 7203843 0.98
clickbench_q01/duckdb:vortex-file-compressed 🚨 12795106 11360882 1.13
clickbench_q02/duckdb:vortex-file-compressed 27596038 27667656 1.00
clickbench_q03/duckdb:vortex-file-compressed 32590290 34262674 0.95
clickbench_q04/duckdb:vortex-file-compressed 211786464 199655563 1.06
clickbench_q05/duckdb:vortex-file-compressed 205483311 189899109 1.08
clickbench_q06/duckdb:vortex-file-compressed 20657308 20612492 1.00
clickbench_q07/duckdb:vortex-file-compressed 🚨 16391160 14518861 1.13
clickbench_q08/duckdb:vortex-file-compressed 296133951 275322335 1.08
clickbench_q09/duckdb:vortex-file-compressed 387482480 355873702 1.09
clickbench_q10/duckdb:vortex-file-compressed 73346439 74523063 0.98
clickbench_q11/duckdb:vortex-file-compressed 88748961 83526716 1.06
clickbench_q12/duckdb:vortex-file-compressed 231339489 215373550 1.07
clickbench_q13/duckdb:vortex-file-compressed 460232619 432747919 1.06
clickbench_q14/duckdb:vortex-file-compressed 254333579 250550342 1.02
clickbench_q15/duckdb:vortex-file-compressed 253798386 251884100 1.01
clickbench_q16/duckdb:vortex-file-compressed 585088060 564649066 1.04
clickbench_q17/duckdb:vortex-file-compressed 481169458 443182820 1.09
clickbench_q18/duckdb:vortex-file-compressed 1028025078 997777737 1.03
clickbench_q19/duckdb:vortex-file-compressed 21422105 23360791 0.92
clickbench_q20/duckdb:vortex-file-compressed 321217622 330107489 0.97
clickbench_q21/duckdb:vortex-file-compressed 433806260 459103651 0.94
clickbench_q22/duckdb:vortex-file-compressed 1273245898 1252545217 1.02
clickbench_q23/duckdb:vortex-file-compressed 185405613 191114643 0.97
clickbench_q24/duckdb:vortex-file-compressed 🚨 39619058 35183200 1.13
clickbench_q25/duckdb:vortex-file-compressed 86730170 82474357 1.05
clickbench_q26/duckdb:vortex-file-compressed 51219295 48499144 1.06
clickbench_q27/duckdb:vortex-file-compressed 453895986 448784772 1.01
clickbench_q28/duckdb:vortex-file-compressed 3095919934 3078911009 1.01
clickbench_q29/duckdb:vortex-file-compressed 🚀 28898254 35824051 0.81
clickbench_q30/duckdb:vortex-file-compressed 200222267 199538695 1.00
clickbench_q31/duckdb:vortex-file-compressed 303936422 302137959 1.01
clickbench_q32/duckdb:vortex-file-compressed 1175942057 1172365488 1.00
clickbench_q33/duckdb:vortex-file-compressed 1190157887 1221465363 0.97
clickbench_q34/duckdb:vortex-file-compressed 1330495397 1280244518 1.04
clickbench_q35/duckdb:vortex-file-compressed 396433015 387522290 1.02
clickbench_q36/duckdb:vortex-file-compressed 27402749 28165889 0.97
clickbench_q37/duckdb:vortex-file-compressed 🚀 17924709 21191775 0.85
clickbench_q38/duckdb:vortex-file-compressed 20544703 21872386 0.94
clickbench_q39/duckdb:vortex-file-compressed 44242085 46385209 0.95
clickbench_q40/duckdb:vortex-file-compressed 🚀 17173541 20525785 0.84
clickbench_q41/duckdb:vortex-file-compressed 19836899 20847642 0.95
clickbench_q42/duckdb:vortex-file-compressed 21252729 20765159 1.02
duckdb / parquet (1.051x ➖, 0↑ 5↓)
name PR a1510c1 (ns) base e1c6ef5 (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 23285054 23931727 0.97
clickbench_q01/duckdb:parquet 31246266 29287392 1.07
clickbench_q02/duckdb:parquet 53392602 51782185 1.03
clickbench_q03/duckdb:parquet 42831683 41210610 1.04
clickbench_q04/duckdb:parquet 231558289 213576252 1.08
clickbench_q05/duckdb:parquet 289432252 268537393 1.08
clickbench_q06/duckdb:parquet 49509811 48417087 1.02
clickbench_q07/duckdb:parquet 33071697 31308590 1.06
clickbench_q08/duckdb:parquet 🚨 306238994 275947948 1.11
clickbench_q09/duckdb:parquet 450118434 411537618 1.09
clickbench_q10/duckdb:parquet 90311819 83409898 1.08
clickbench_q11/duckdb:parquet 111768463 102235663 1.09
clickbench_q12/duckdb:parquet 🚨 326559400 288912071 1.13
clickbench_q13/duckdb:parquet 🚨 550929021 487071378 1.13
clickbench_q14/duckdb:parquet 352711658 323705214 1.09
clickbench_q15/duckdb:parquet 284464364 265565067 1.07
clickbench_q16/duckdb:parquet 671270708 617872758 1.09
clickbench_q17/duckdb:parquet 544172981 515861018 1.05
clickbench_q18/duckdb:parquet 1128082378 1071550731 1.05
clickbench_q19/duckdb:parquet 28892807 28549063 1.01
clickbench_q20/duckdb:parquet 433619362 424822344 1.02
clickbench_q21/duckdb:parquet 570801721 543982988 1.05
clickbench_q22/duckdb:parquet 958803174 938586607 1.02
clickbench_q23/duckdb:parquet 269596292 277486226 0.97
clickbench_q24/duckdb:parquet 73690615 73661730 1.00
clickbench_q25/duckdb:parquet 168907519 165484182 1.02
clickbench_q26/duckdb:parquet 56589144 56873801 0.99
clickbench_q27/duckdb:parquet 497917034 489042147 1.02
clickbench_q28/duckdb:parquet 4888598818 4853868279 1.01
clickbench_q29/duckdb:parquet 43684716 43760362 1.00
clickbench_q30/duckdb:parquet 331826564 317993546 1.04
clickbench_q31/duckdb:parquet 403129817 388562251 1.04
clickbench_q32/duckdb:parquet 1230514976 1166524142 1.05
clickbench_q33/duckdb:parquet 1257140480 1160625100 1.08
clickbench_q34/duckdb:parquet 1305023993 1205160012 1.08
clickbench_q35/duckdb:parquet 🚨 413722872 372755726 1.11
clickbench_q36/duckdb:parquet 52417436 47970824 1.09
clickbench_q37/duckdb:parquet 35270068 34232182 1.03
clickbench_q38/duckdb:parquet 36812927 36009392 1.02
clickbench_q39/duckdb:parquet 🚨 89133819 77504003 1.15
clickbench_q40/duckdb:parquet 21296446 20511684 1.04
clickbench_q41/duckdb:parquet 20816107 20961604 0.99
clickbench_q42/duckdb:parquet 23127756 22902459 1.01
duckdb / duckdb (1.022x ➖, 0↑ 2↓)
name PR a1510c1 (ns) base e1c6ef5 (ns) ratio (PR/base)
clickbench_q00/duckdb:duckdb 18288879 17443556 1.05
clickbench_q01/duckdb:duckdb 36280299 34879604 1.04
clickbench_q02/duckdb:duckdb 55692729 51498430 1.08
clickbench_q03/duckdb:duckdb 60260934 56838141 1.06
clickbench_q04/duckdb:duckdb 🚨 245569048 215970441 1.14
clickbench_q05/duckdb:duckdb 🚨 332081906 290442688 1.14
clickbench_q06/duckdb:duckdb 35398662 35460416 1.00
clickbench_q07/duckdb:duckdb 35312037 35620476 0.99
clickbench_q08/duckdb:duckdb 297982645 281550605 1.06
clickbench_q09/duckdb:duckdb 409980850 407092793 1.01
clickbench_q10/duckdb:duckdb 124698247 118634395 1.05
clickbench_q11/duckdb:duckdb 133538262 128973811 1.04
clickbench_q12/duckdb:duckdb 275849417 265082806 1.04
clickbench_q13/duckdb:duckdb 474897803 464630871 1.02
clickbench_q14/duckdb:duckdb 300674306 293852686 1.02
clickbench_q15/duckdb:duckdb 247569744 253334412 0.98
clickbench_q16/duckdb:duckdb 578069710 585870417 0.99
clickbench_q17/duckdb:duckdb 520507008 486200501 1.07
clickbench_q18/duckdb:duckdb 1069982333 1090050125 0.98
clickbench_q19/duckdb:duckdb 34941697 34697998 1.01
clickbench_q20/duckdb:duckdb 483630531 476798290 1.01
clickbench_q21/duckdb:duckdb 482214763 485568246 0.99
clickbench_q22/duckdb:duckdb 582799277 568914245 1.02
clickbench_q23/duckdb:duckdb 266245057 275346439 0.97
clickbench_q24/duckdb:duckdb 63870457 63539341 1.01
clickbench_q25/duckdb:duckdb 155178711 150968140 1.03
clickbench_q26/duckdb:duckdb 63563767 62992248 1.01
clickbench_q27/duckdb:duckdb 441843972 430433909 1.03
clickbench_q28/duckdb:duckdb 4572286943 4460756456 1.03
clickbench_q29/duckdb:duckdb 50827474 50763494 1.00
clickbench_q30/duckdb:duckdb 283048099 285628521 0.99
clickbench_q31/duckdb:duckdb 389684984 374616475 1.04
clickbench_q32/duckdb:duckdb 1190335085 1164388678 1.02
clickbench_q33/duckdb:duckdb 1194187454 1192677353 1.00
clickbench_q34/duckdb:duckdb 1247877276 1275070115 0.98
clickbench_q35/duckdb:duckdb 308573482 309214721 1.00
clickbench_q36/duckdb:duckdb 50634955 48923403 1.03
clickbench_q37/duckdb:duckdb 29566492 29227634 1.01
clickbench_q38/duckdb:duckdb 35152584 34366260 1.02
clickbench_q39/duckdb:duckdb 87751643 84778787 1.04
clickbench_q40/duckdb:duckdb 28585712 28507557 1.00
clickbench_q41/duckdb:duckdb 27317065 27576347 0.99
clickbench_q42/duckdb:duckdb 30628431 30917124 0.99
File Size Changes (106 files changed, +0.0% overall, 64↑ 42↓)
File Scale Format Base HEAD Change %
hits_55.vortex 1.0 vortex-compact 94.94 MB 96.04 MB +1.09 MB +1.2%
hits_90.vortex 1.0 vortex-compact 81.72 MB 82.52 MB +816.95 KB +1.0%
hits_53.vortex 1.0 vortex-file-compressed 87.00 MB 87.48 MB +498.36 KB +0.6%
hits_97.vortex 1.0 vortex-file-compressed 106.94 MB 107.37 MB +439.44 KB +0.4%
hits_25.vortex 1.0 vortex-file-compressed 113.70 MB 114.13 MB +441.48 KB +0.4%
hits_21.vortex 1.0 vortex-file-compressed 94.00 MB 94.21 MB +216.23 KB +0.2%
hits_29.vortex 1.0 vortex-compact 36.50 MB 36.57 MB +76.70 KB +0.2%
hits_68.vortex 1.0 vortex-file-compressed 123.30 MB 123.54 MB +241.72 KB +0.2%
hits_49.vortex 1.0 vortex-file-compressed 75.85 MB 75.99 MB +143.21 KB +0.2%
hits_4.vortex 1.0 vortex-file-compressed 108.67 MB 108.83 MB +165.55 KB +0.1%
hits_56.vortex 1.0 vortex-file-compressed 123.52 MB 123.70 MB +188.02 KB +0.1%
hits_7.vortex 1.0 vortex-file-compressed 94.00 MB 94.12 MB +121.27 KB +0.1%
hits_60.vortex 1.0 vortex-file-compressed 103.36 MB 103.47 MB +107.85 KB +0.1%
hits_61.vortex 1.0 vortex-file-compressed 101.24 MB 101.34 MB +97.98 KB +0.1%
hits_97.vortex 1.0 vortex-compact 68.98 MB 69.04 MB +60.21 KB +0.1%
hits_73.vortex 1.0 vortex-file-compressed 110.51 MB 110.61 MB +96.02 KB +0.1%
hits_89.vortex 1.0 vortex-file-compressed 184.54 MB 184.70 MB +159.76 KB +0.1%
hits_67.vortex 1.0 vortex-file-compressed 184.07 MB 184.22 MB +155.05 KB +0.1%
hits_74.vortex 1.0 vortex-file-compressed 119.83 MB 119.92 MB +92.85 KB +0.1%
hits_39.vortex 1.0 vortex-file-compressed 80.32 MB 80.38 MB +59.41 KB +0.1%
hits_11.vortex 1.0 vortex-file-compressed 80.02 MB 80.07 MB +57.37 KB +0.1%
hits_59.vortex 1.0 vortex-file-compressed 101.83 MB 101.90 MB +71.05 KB +0.1%
hits_99.vortex 1.0 vortex-file-compressed 123.15 MB 123.23 MB +84.53 KB +0.1%
hits_65.vortex 1.0 vortex-file-compressed 183.76 MB 183.88 MB +123.51 KB +0.1%
hits_55.vortex 1.0 vortex-file-compressed 169.22 MB 169.32 MB +109.80 KB +0.1%
hits_58.vortex 1.0 vortex-file-compressed 90.40 MB 90.46 MB +58.44 KB +0.1%
hits_87.vortex 1.0 vortex-file-compressed 172.54 MB 172.65 MB +110.57 KB +0.1%
hits_9.vortex 1.0 vortex-file-compressed 99.26 MB 99.32 MB +59.18 KB +0.1%
hits_46.vortex 1.0 vortex-file-compressed 69.46 MB 69.50 MB +39.38 KB +0.1%
hits_12.vortex 1.0 vortex-file-compressed 101.11 MB 101.17 MB +57.04 KB +0.1%
hits_82.vortex 1.0 vortex-file-compressed 100.07 MB 100.12 MB +54.93 KB +0.1%
hits_85.vortex 1.0 vortex-file-compressed 91.87 MB 91.92 MB +46.85 KB +0.0%
hits_69.vortex 1.0 vortex-file-compressed 122.95 MB 123.01 MB +60.91 KB +0.0%
hits_90.vortex 1.0 vortex-file-compressed 142.04 MB 142.10 MB +66.01 KB +0.0%
hits_1.vortex 1.0 vortex-file-compressed 138.49 MB 138.54 MB +59.38 KB +0.0%
hits_28.vortex 1.0 vortex-file-compressed 119.91 MB 119.95 MB +46.59 KB +0.0%
hits_17.vortex 1.0 vortex-file-compressed 87.49 MB 87.53 MB +33.46 KB +0.0%
hits_13.vortex 1.0 vortex-file-compressed 99.29 MB 99.33 MB +33.55 KB +0.0%
hits_76.vortex 1.0 vortex-file-compressed 114.38 MB 114.42 MB +36.70 KB +0.0%
hits_77.vortex 1.0 vortex-file-compressed 168.63 MB 168.68 MB +53.98 KB +0.0%
hits_66.vortex 1.0 vortex-file-compressed 90.29 MB 90.32 MB +25.88 KB +0.0%
hits_75.vortex 1.0 vortex-file-compressed 63.34 MB 63.35 MB +17.16 KB +0.0%
hits_94.vortex 1.0 vortex-file-compressed 138.82 MB 138.85 MB +35.83 KB +0.0%
hits_19.vortex 1.0 vortex-file-compressed 73.60 MB 73.62 MB +17.79 KB +0.0%
hits_44.vortex 1.0 vortex-file-compressed 186.85 MB 186.89 MB +39.95 KB +0.0%
hits_50.vortex 1.0 vortex-file-compressed 179.25 MB 179.28 MB +36.74 KB +0.0%
hits_0.vortex 1.0 vortex-file-compressed 89.59 MB 89.61 MB +17.63 KB +0.0%
hits_62.vortex 1.0 vortex-file-compressed 117.68 MB 117.70 MB +23.13 KB +0.0%
hits_81.vortex 1.0 vortex-file-compressed 100.83 MB 100.85 MB +19.68 KB +0.0%
hits_71.vortex 1.0 vortex-file-compressed 102.09 MB 102.11 MB +17.70 KB +0.0%
hits_96.vortex 1.0 vortex-file-compressed 135.73 MB 135.75 MB +19.92 KB +0.0%
hits_30.vortex 1.0 vortex-file-compressed 87.15 MB 87.16 MB +12.78 KB +0.0%
hits_37.vortex 1.0 vortex-file-compressed 85.81 MB 85.82 MB +11.78 KB +0.0%
hits_57.vortex 1.0 vortex-file-compressed 128.28 MB 128.29 MB +14.66 KB +0.0%
hits_42.vortex 1.0 vortex-file-compressed 223.19 MB 223.21 MB +24.37 KB +0.0%
hits_40.vortex 1.0 vortex-file-compressed 117.84 MB 117.85 MB +12.55 KB +0.0%
hits_26.vortex 1.0 vortex-file-compressed 110.10 MB 110.11 MB +11.54 KB +0.0%
hits_92.vortex 1.0 vortex-file-compressed 146.96 MB 146.97 MB +11.11 KB +0.0%
hits_18.vortex 1.0 vortex-file-compressed 104.84 MB 104.85 MB +6.14 KB +0.0%
hits_72.vortex 1.0 vortex-file-compressed 84.83 MB 84.84 MB +4.93 KB +0.0%
hits_41.vortex 1.0 vortex-file-compressed 224.24 MB 224.25 MB +12.16 KB +0.0%
hits_22.vortex 1.0 vortex-file-compressed 78.61 MB 78.61 MB +2.77 KB +0.0%
hits_93.vortex 1.0 vortex-file-compressed 90.60 MB 90.60 MB +2.66 KB +0.0%
hits_24.vortex 1.0 vortex-file-compressed 77.44 MB 77.44 MB +1.79 KB +0.0%
hits_47.vortex 1.0 vortex-file-compressed 41.32 MB 41.32 MB 88 B -0.0%
hits_3.vortex 1.0 vortex-file-compressed 142.31 MB 142.30 MB 4.57 KB -0.0%
hits_80.vortex 1.0 vortex-file-compressed 105.11 MB 105.10 MB 9.68 KB -0.0%
hits_79.vortex 1.0 vortex-file-compressed 145.19 MB 145.17 MB 18.05 KB -0.0%
hits_45.vortex 1.0 vortex-file-compressed 122.10 MB 122.08 MB 16.99 KB -0.0%
hits_48.vortex 1.0 vortex-file-compressed 28.03 MB 28.03 MB 4.38 KB -0.0%
hits_16.vortex 1.0 vortex-file-compressed 79.99 MB 79.98 MB 12.81 KB -0.0%
hits_91.vortex 1.0 vortex-file-compressed 97.23 MB 97.21 MB 16.06 KB -0.0%
hits_20.vortex 1.0 vortex-file-compressed 62.98 MB 62.97 MB 10.88 KB -0.0%
hits_27.vortex 1.0 vortex-file-compressed 122.35 MB 122.32 MB 24.89 KB -0.0%
hits_88.vortex 1.0 vortex-file-compressed 111.45 MB 111.42 MB 31.71 KB -0.0%
hits_51.vortex 1.0 vortex-file-compressed 277.66 MB 277.59 MB 79.73 KB -0.0%
hits_83.vortex 1.0 vortex-file-compressed 89.83 MB 89.80 MB 26.83 KB -0.0%
hits_32.vortex 1.0 vortex-file-compressed 66.87 MB 66.85 MB 23.09 KB -0.0%
hits_33.vortex 1.0 vortex-file-compressed 57.28 MB 57.26 MB 20.03 KB -0.0%
hits_10.vortex 1.0 vortex-file-compressed 69.66 MB 69.64 MB 25.00 KB -0.0%
hits_95.vortex 1.0 vortex-file-compressed 96.62 MB 96.58 MB 40.43 KB -0.0%
hits_35.vortex 1.0 vortex-file-compressed 115.22 MB 115.17 MB 50.19 KB -0.0%
hits_64.vortex 1.0 vortex-file-compressed 81.37 MB 81.34 MB 36.04 KB -0.0%
hits_6.vortex 1.0 vortex-file-compressed 93.40 MB 93.36 MB 42.37 KB -0.0%
hits_63.vortex 1.0 vortex-file-compressed 69.33 MB 69.30 MB 31.78 KB -0.0%
hits_43.vortex 1.0 vortex-file-compressed 227.42 MB 227.31 MB 115.30 KB -0.0%
hits_84.vortex 1.0 vortex-file-compressed 117.54 MB 117.48 MB 59.99 KB -0.0%
hits_78.vortex 1.0 vortex-file-compressed 164.31 MB 164.22 MB 85.20 KB -0.1%
hits_54.vortex 1.0 vortex-file-compressed 221.57 MB 221.44 MB 131.28 KB -0.1%
hits_29.vortex 1.0 vortex-file-compressed 59.82 MB 59.79 MB 35.58 KB -0.1%
hits_5.vortex 1.0 vortex-file-compressed 92.99 MB 92.93 MB 57.28 KB -0.1%
hits_70.vortex 1.0 vortex-file-compressed 93.68 MB 93.62 MB 61.91 KB -0.1%
hits_38.vortex 1.0 vortex-file-compressed 99.27 MB 99.21 MB 69.54 KB -0.1%
hits_23.vortex 1.0 vortex-file-compressed 77.99 MB 77.93 MB 58.78 KB -0.1%
hits_2.vortex 1.0 vortex-file-compressed 186.58 MB 186.44 MB 144.44 KB -0.1%
hits_14.vortex 1.0 vortex-file-compressed 111.42 MB 111.32 MB 97.56 KB -0.1%
hits_36.vortex 1.0 vortex-file-compressed 68.50 MB 68.43 MB 71.21 KB -0.1%
hits_15.vortex 1.0 vortex-file-compressed 89.44 MB 89.34 MB 96.74 KB -0.1%
hits_34.vortex 1.0 vortex-file-compressed 97.93 MB 97.82 MB 106.27 KB -0.1%
hits_8.vortex 1.0 vortex-file-compressed 93.41 MB 93.29 MB 116.84 KB -0.1%
hits_52.vortex 1.0 vortex-file-compressed 105.26 MB 105.08 MB 183.05 KB -0.2%
hits_98.vortex 1.0 vortex-file-compressed 118.62 MB 118.42 MB 208.73 KB -0.2%
hits_86.vortex 1.0 vortex-file-compressed 69.47 MB 69.32 MB 151.38 KB -0.2%
hits_21.vortex 1.0 vortex-compact 51.53 MB 51.39 MB 144.64 KB -0.3%
hits_31.vortex 1.0 vortex-file-compressed 90.34 MB 90.08 MB 270.11 KB -0.3%
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%

Totals:

  • vortex-compact: 7.04 GB → 7.05 GB (+0.0%)
  • vortex-file-compressed: 11.02 GB → 11.02 GB (+0.0%)

@github-actions

github-actions Bot commented Jun 16, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -7.1%
Engines: DataFusion No clear signal (-8.5%, environment too noisy confidence) · DuckDB No clear signal (-5.6%, environment too noisy confidence)
Vortex (geomean): 0.957x ➖
Parquet (geomean): 1.030x ➖
Shifts: Parquet (control) +3.0% · Median polish -4.7%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.899x ➖, 4↑ 1↓)
name PR a1510c1 (ns) base 67a2b22 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 302301774 291105420 1.04
tpch_q02/datafusion:vortex-file-compressed 641497865 679482629 0.94
tpch_q03/datafusion:vortex-file-compressed 634348939 582976253 1.09
tpch_q04/datafusion:vortex-file-compressed 294500705 291274268 1.01
tpch_q05/datafusion:vortex-file-compressed 🚨 655102241 482352684 1.36
tpch_q06/datafusion:vortex-file-compressed 415439399 345226870 1.20
tpch_q07/datafusion:vortex-file-compressed 556155447 579862854 0.96
tpch_q08/datafusion:vortex-file-compressed 🚀 602467079 861947978 0.70
tpch_q09/datafusion:vortex-file-compressed 583470992 563446832 1.04
tpch_q10/datafusion:vortex-file-compressed 769497400 900507489 0.85
tpch_q11/datafusion:vortex-file-compressed 🚀 355048698 520677637 0.68
tpch_q12/datafusion:vortex-file-compressed 451270576 639699465 0.71
tpch_q13/datafusion:vortex-file-compressed 217023816 271355524 0.80
tpch_q14/datafusion:vortex-file-compressed 🚀 324836724 513083760 0.63
tpch_q15/datafusion:vortex-file-compressed 640691398 744697865 0.86
tpch_q16/datafusion:vortex-file-compressed 316228326 350281289 0.90
tpch_q17/datafusion:vortex-file-compressed 505212580 534087891 0.95
tpch_q18/datafusion:vortex-file-compressed 390063639 445608893 0.88
tpch_q19/datafusion:vortex-file-compressed 765738924 702073231 1.09
tpch_q20/datafusion:vortex-file-compressed 528255349 530860266 1.00
tpch_q21/datafusion:vortex-file-compressed 833016323 943237099 0.88
tpch_q22/datafusion:vortex-file-compressed 🚀 253769869 416312293 0.61
datafusion / vortex-compact (1.041x ➖, 0↑ 5↓)
name PR a1510c1 (ns) base 67a2b22 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 313844512 361050123 0.87
tpch_q02/datafusion:vortex-compact 539002121 520298260 1.04
tpch_q03/datafusion:vortex-compact 458051834 391928612 1.17
tpch_q04/datafusion:vortex-compact 278767046 236875442 1.18
tpch_q05/datafusion:vortex-compact 455302952 494604651 0.92
tpch_q06/datafusion:vortex-compact 397388304 432603102 0.92
tpch_q07/datafusion:vortex-compact 637457287 667247495 0.96
tpch_q08/datafusion:vortex-compact 824605589 940704165 0.88
tpch_q09/datafusion:vortex-compact 511487132 601414121 0.85
tpch_q10/datafusion:vortex-compact 🚨 824716627 521922738 1.58
tpch_q11/datafusion:vortex-compact 🚨 517040077 363932928 1.42
tpch_q12/datafusion:vortex-compact 556209113 616128229 0.90
tpch_q13/datafusion:vortex-compact 228447924 227887062 1.00
tpch_q14/datafusion:vortex-compact 317504392 392460018 0.81
tpch_q15/datafusion:vortex-compact 🚨 671413927 438642764 1.53
tpch_q16/datafusion:vortex-compact 🚨 298037094 195371888 1.53
tpch_q17/datafusion:vortex-compact 473642540 423870808 1.12
tpch_q18/datafusion:vortex-compact 382360737 462398576 0.83
tpch_q19/datafusion:vortex-compact 722369914 941326189 0.77
tpch_q20/datafusion:vortex-compact 541573645 546010506 0.99
tpch_q21/datafusion:vortex-compact 660195975 711274311 0.93
tpch_q22/datafusion:vortex-compact 🚨 307258504 234791464 1.31
datafusion / parquet (1.058x ➖, 0↑ 2↓)
name PR a1510c1 (ns) base 67a2b22 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 244271448 271419103 0.90
tpch_q02/datafusion:parquet 516385230 476931161 1.08
tpch_q03/datafusion:parquet 426914946 419354749 1.02
tpch_q04/datafusion:parquet 197613784 223845181 0.88
tpch_q05/datafusion:parquet 558343316 655991222 0.85
tpch_q06/datafusion:parquet 226029127 229619986 0.98
tpch_q07/datafusion:parquet 596450868 587282189 1.02
tpch_q08/datafusion:parquet 676337758 807370949 0.84
tpch_q09/datafusion:parquet 474339372 494449112 0.96
tpch_q10/datafusion:parquet 981545760 760194267 1.29
tpch_q11/datafusion:parquet 🚨 740755463 439591756 1.69
tpch_q12/datafusion:parquet 311770502 303577758 1.03
tpch_q13/datafusion:parquet 482799658 505025210 0.96
tpch_q14/datafusion:parquet 311953596 313070552 1.00
tpch_q15/datafusion:parquet 506157817 528348852 0.96
tpch_q16/datafusion:parquet 199529986 185690116 1.07
tpch_q17/datafusion:parquet 615911091 526973317 1.17
tpch_q18/datafusion:parquet 589188645 477121039 1.23
tpch_q19/datafusion:parquet 449761919 406959443 1.11
tpch_q20/datafusion:parquet 🚨 509531971 382974255 1.33
tpch_q21/datafusion:parquet 666367902 599340575 1.11
tpch_q22/datafusion:parquet 279874223 251305363 1.11
duckdb / vortex-file-compressed (0.951x ➖, 0↑ 0↓)
name PR a1510c1 (ns) base 67a2b22 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 338455027 284880917 1.19
tpch_q02/duckdb:vortex-file-compressed 1129269942 1072272057 1.05
tpch_q03/duckdb:vortex-file-compressed 707202252 767109130 0.92
tpch_q04/duckdb:vortex-file-compressed 525333628 562205638 0.93
tpch_q05/duckdb:vortex-file-compressed 1030880146 1090587515 0.95
tpch_q06/duckdb:vortex-file-compressed 365449605 409868503 0.89
tpch_q07/duckdb:vortex-file-compressed 999297408 1023686423 0.98
tpch_q08/duckdb:vortex-file-compressed 1149052977 1201755602 0.96
tpch_q09/duckdb:vortex-file-compressed 1171460924 1151166552 1.02
tpch_q10/duckdb:vortex-file-compressed 811004569 851810446 0.95
tpch_q11/duckdb:vortex-file-compressed 514944484 583519421 0.88
tpch_q12/duckdb:vortex-file-compressed 660979144 872422874 0.76
tpch_q13/duckdb:vortex-file-compressed 463848970 537982188 0.86
tpch_q14/duckdb:vortex-file-compressed 395084648 457217533 0.86
tpch_q15/duckdb:vortex-file-compressed 346092071 352910828 0.98
tpch_q16/duckdb:vortex-file-compressed 382495820 384448231 0.99
tpch_q17/duckdb:vortex-file-compressed 788541747 868012310 0.91
tpch_q18/duckdb:vortex-file-compressed 615814941 695229500 0.89
tpch_q19/duckdb:vortex-file-compressed 549294451 520217139 1.06
tpch_q20/duckdb:vortex-file-compressed 1022326274 938618619 1.09
tpch_q21/duckdb:vortex-file-compressed 1182545525 1306319016 0.91
tpch_q22/duckdb:vortex-file-compressed 308600096 311204547 0.99
duckdb / vortex-compact (0.941x ➖, 0↑ 0↓)
name PR a1510c1 (ns) base 67a2b22 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 278182936 284316907 0.98
tpch_q02/duckdb:vortex-compact 1005785538 1030855579 0.98
tpch_q03/duckdb:vortex-compact 702024056 676828890 1.04
tpch_q04/duckdb:vortex-compact 455712081 463916306 0.98
tpch_q05/duckdb:vortex-compact 887524205 1002528945 0.89
tpch_q06/duckdb:vortex-compact 357549224 375064930 0.95
tpch_q07/duckdb:vortex-compact 990387424 1091503431 0.91
tpch_q08/duckdb:vortex-compact 939471074 1129545935 0.83
tpch_q09/duckdb:vortex-compact 1123023294 1068255528 1.05
tpch_q10/duckdb:vortex-compact 803823432 908688902 0.88
tpch_q11/duckdb:vortex-compact 526999066 551569778 0.96
tpch_q12/duckdb:vortex-compact 724754119 702178604 1.03
tpch_q13/duckdb:vortex-compact 432401503 447669368 0.97
tpch_q14/duckdb:vortex-compact 441930306 478933613 0.92
tpch_q15/duckdb:vortex-compact 316410419 426988727 0.74
tpch_q16/duckdb:vortex-compact 361924235 391586960 0.92
tpch_q17/duckdb:vortex-compact 731204200 835714397 0.87
tpch_q18/duckdb:vortex-compact 552269128 572306564 0.96
tpch_q19/duckdb:vortex-compact 497384884 543941543 0.91
tpch_q20/duckdb:vortex-compact 892218360 866191482 1.03
tpch_q21/duckdb:vortex-compact 1163700957 1321014663 0.88
tpch_q22/duckdb:vortex-compact 344301072 316092241 1.09
duckdb / parquet (1.003x ➖, 0↑ 1↓)
name PR a1510c1 (ns) base 67a2b22 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 542674057 630371612 0.86
tpch_q02/duckdb:parquet 1335043316 1307393017 1.02
tpch_q03/duckdb:parquet 1279807545 1304795229 0.98
tpch_q04/duckdb:parquet 852864730 796616253 1.07
tpch_q05/duckdb:parquet 1434192240 1559784295 0.92
tpch_q06/duckdb:parquet 470739929 591879338 0.80
tpch_q07/duckdb:parquet 1408580753 1535480331 0.92
tpch_q08/duckdb:parquet 1927475748 1771948575 1.09
tpch_q09/duckdb:parquet 1660584965 1741282705 0.95
tpch_q10/duckdb:parquet 1521576721 1411691247 1.08
tpch_q11/duckdb:parquet 763580661 835830135 0.91
tpch_q12/duckdb:parquet 979802814 910666240 1.08
tpch_q13/duckdb:parquet 1031906570 969607540 1.06
tpch_q14/duckdb:parquet 794339977 797021583 1.00
tpch_q15/duckdb:parquet 713145240 724883355 0.98
tpch_q16/duckdb:parquet 848031612 810504981 1.05
tpch_q17/duckdb:parquet 989431897 949712716 1.04
tpch_q18/duckdb:parquet 1138804640 1048116359 1.09
tpch_q19/duckdb:parquet 🚨 985802525 733015323 1.34
tpch_q20/duckdb:parquet 1324653947 1326411626 1.00
tpch_q21/duckdb:parquet 1360119365 1345696557 1.01
tpch_q22/duckdb:parquet 615924340 665267819 0.93

@github-actions

github-actions Bot commented Jun 16, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Appian on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.7%
Engines: DataFusion No clear signal (+1.5%, low confidence) · DuckDB No clear signal (+0.4%, low confidence)
Vortex (geomean): 1.015x ➖
Parquet (geomean): 1.003x ➖
Shifts: Parquet (control) +0.3% · Median polish +0.8%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.022x ➖, 0↑ 0↓)
name PR a1510c1 (ns) base e1c6ef5 (ns) ratio (PR/base)
appian_q01/datafusion:vortex-file-compressed 127146231 122096261 1.04
appian_q02/datafusion:vortex-file-compressed 592371482 580902961 1.02
appian_q03/datafusion:vortex-file-compressed 344222548 341973566 1.01
appian_q04/datafusion:vortex-file-compressed 44759993970 44189159924 1.01
appian_q05/datafusion:vortex-file-compressed 255592769 246593057 1.04
appian_q06/datafusion:vortex-file-compressed 330425610 323561385 1.02
appian_q07/datafusion:vortex-file-compressed 419706798 408982974 1.03
appian_q08/datafusion:vortex-file-compressed 1937879411 1910083630 1.01
datafusion / parquet (1.007x ➖, 0↑ 0↓)
name PR a1510c1 (ns) base e1c6ef5 (ns) ratio (PR/base)
appian_q01/datafusion:parquet 126981970 130564254 0.97
appian_q02/datafusion:parquet 613608893 615385188 1.00
appian_q03/datafusion:parquet 332561201 329235733 1.01
appian_q04/datafusion:parquet 44911262822 44258274381 1.01
appian_q05/datafusion:parquet 277415922 272917431 1.02
appian_q06/datafusion:parquet 353569814 349387168 1.01
appian_q07/datafusion:parquet 440762408 433035273 1.02
appian_q08/datafusion:parquet 1957327581 1928706989 1.01
duckdb / vortex-file-compressed (1.008x ➖, 0↑ 0↓)
name PR a1510c1 (ns) base e1c6ef5 (ns) ratio (PR/base)
appian_q01/duckdb:vortex-file-compressed 193842415 191863259 1.01
appian_q02/duckdb:vortex-file-compressed 623605345 611512623 1.02
appian_q03/duckdb:vortex-file-compressed 255263325 253251310 1.01
appian_q04/duckdb:vortex-file-compressed 1329547098 1329805464 1.00
appian_q05/duckdb:vortex-file-compressed 289908139 288843082 1.00
appian_q06/duckdb:vortex-file-compressed 812741860 809643678 1.00
appian_q07/duckdb:vortex-file-compressed 345819543 339127744 1.02
appian_q08/duckdb:vortex-file-compressed 1284222060 1283301587 1.00
duckdb / parquet (1.000x ➖, 0↑ 0↓)
name PR a1510c1 (ns) base e1c6ef5 (ns) ratio (PR/base)
appian_q01/duckdb:parquet 203082391 202211161 1.00
appian_q02/duckdb:parquet 607396798 602719918 1.01
appian_q03/duckdb:parquet 285837319 289356778 0.99
appian_q04/duckdb:parquet 1314969473 1329056226 0.99
appian_q05/duckdb:parquet 310374760 312575379 0.99
appian_q06/duckdb:parquet 799770215 793865945 1.01
appian_q07/duckdb:parquet 365867739 362748027 1.01
appian_q08/duckdb:parquet 1270167656 1266124280 1.00
duckdb / duckdb (1.001x ➖, 0↑ 0↓)
name PR a1510c1 (ns) base e1c6ef5 (ns) ratio (PR/base)
appian_q01/duckdb:duckdb 172776656 172704677 1.00
appian_q02/duckdb:duckdb 551019801 549904410 1.00
appian_q03/duckdb:duckdb 388140926 385779506 1.01
appian_q04/duckdb:duckdb 1300929796 1300179191 1.00
appian_q05/duckdb:duckdb 282479436 281091879 1.00
appian_q06/duckdb:duckdb 781327047 789966814 0.99
appian_q07/duckdb:duckdb 325687985 324943707 1.00
appian_q08/duckdb:duckdb 1223535363 1221491525 1.00
File Size Changes (4 files changed, -0.0% overall, 2↑ 2↓)
File Scale Format Base HEAD Change %
orderview.vortex 1.0 vortex-file-compressed 81.00 MB 81.12 MB +116.23 KB +0.1%
creditcardview.vortex 1.0 vortex-file-compressed 61.00 MB 61.09 MB +84.31 KB +0.1%
addressview.vortex 1.0 vortex-file-compressed 34.62 MB 34.62 MB 32 B -0.0%
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%

Totals:

  • vortex-compact: 271.96 MB → 271.69 MB (-0.1%)
  • vortex-file-compressed: 513.64 MB → 513.84 MB (+0.0%)

@github-actions

github-actions Bot commented Jun 16, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Compression

Vortex (geomean): 0.998x ➖
Parquet (geomean): 0.989x ➖

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
unknown / unknown (0.986x ➖, 0↑ 0↓)
name PR a1510c1 (ns) base e1c6ef5 (ns) ratio (PR/base)
compress time/Arade 1073867616 1154906020 0.93
compress time/Bimbo 5515771458 5840497621 0.94
compress time/CMSprovider 2720832354 2804572930 0.97
compress time/Euro2016 488144761 457004582 1.07
compress time/Food 370271272 384977420 0.96
compress time/HashTags 869709082 860542113 1.01
compress time/TPC-H l_comment canonical 1198248243 1278784142 0.94
compress time/TPC-H l_comment chunked 1223094152 1283291680 0.95
compress time/taxi 654374448 697964323 0.94
compress time/wide table cols=100 chunks=1 rows=1000 11714479 12241839 0.96
compress time/wide table cols=100 chunks=50 rows=1000 12085877 12048966 1.00
compress time/wide table cols=1000 chunks=1 rows=1000 127413139 129394697 0.98
compress time/wide table cols=1000 chunks=50 rows=1000 127600318 133197059 0.96
compress time/wide table cols=10000 chunks=1 rows=1000 1455560494 1501731436 0.97
compress time/wide table cols=10000 chunks=50 rows=1000 1462388560 1491156545 0.98
decompress time/Arade 25593640 27701581 0.92
decompress time/Bimbo 77851512 79819666 0.98
decompress time/CMSprovider 76975161 80588645 0.96
decompress time/Euro2016 20339495 19517889 1.04
decompress time/Food 8428500 8324404 1.01
decompress time/HashTags 86791274 92654857 0.94
decompress time/TPC-H l_comment canonical 40344470 41478328 0.97
decompress time/TPC-H l_comment chunked 39587991 40402556 0.98
decompress time/taxi 14314405 15219912 0.94
decompress time/wide table cols=100 chunks=1 rows=1000 2274434 2463370 0.92
decompress time/wide table cols=100 chunks=50 rows=1000 2501130 2654042 0.94
decompress time/wide table cols=1000 chunks=1 rows=1000 21877032 23296481 0.94
decompress time/wide table cols=1000 chunks=50 rows=1000 21965862 22373161 0.98
decompress time/wide table cols=10000 chunks=1 rows=1000 241993150 246351896 0.98
decompress time/wide table cols=10000 chunks=50 rows=1000 238357962 245711171 0.97
parquet size/Arade 258014282 258014282 1.00
parquet size/Bimbo 384517292 384517292 1.00
parquet size/CMSprovider 376885545 376885545 1.00
parquet size/Euro2016 122975499 122975499 1.00
parquet size/Food 35699500 35699500 1.00
parquet size/HashTags 133510943 133510943 1.00
parquet size/TPC-H l_comment canonical 158358238 158358238 1.00
parquet size/TPC-H l_comment chunked 158358238 158358238 1.00
parquet size/taxi 55283635 55283635 1.00
parquet size/wide table cols=100 chunks=1 rows=1000 932404 932404 1.00
parquet size/wide table cols=100 chunks=50 rows=1000 932404 932404 1.00
parquet size/wide table cols=1000 chunks=1 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=1000 chunks=50 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=10000 chunks=1 rows=1000 93240004 93240004 1.00
parquet size/wide table cols=10000 chunks=50 rows=1000 93240004 93240004 1.00
parquet_rs-zstd compress time/Arade 2618216109 2655617384 0.99
parquet_rs-zstd compress time/Bimbo 12648212020 12677859848 1.00
parquet_rs-zstd compress time/CMSprovider 6851536766 7159159352 0.96
parquet_rs-zstd compress time/Euro2016 1316732079 1338926683 0.98
parquet_rs-zstd compress time/Food 807227061 804278263 1.00
parquet_rs-zstd compress time/HashTags 2163506694 2255363349 0.96
parquet_rs-zstd compress time/TPC-H l_comment canonical 3214272981 3245466549 0.99
parquet_rs-zstd compress time/TPC-H l_comment chunked 3191587408 3256266444 0.98
parquet_rs-zstd compress time/taxi 1181578024 1202266983 0.98
parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000 6299755 6485148 0.97
parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000 6039758 6551323 0.92
parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000 74506900 76296076 0.98
parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000 75364969 78761032 0.96
parquet_rs-zstd compress time/wide table cols=10000 chunks=1 rows=1000 790582952 801417152 0.99
parquet_rs-zstd compress time/wide table cols=10000 chunks=50 rows=1000 768109145 789192211 0.97
parquet_rs-zstd decompress time/Arade 621094961 641084007 0.97
parquet_rs-zstd decompress time/Bimbo 1708321184 1706032149 1.00
parquet_rs-zstd decompress time/CMSprovider 1681954668 1755457103 0.96
parquet_rs-zstd decompress time/Euro2016 374790124 386042292 0.97
parquet_rs-zstd decompress time/Food 197921236 201636619 0.98
parquet_rs-zstd decompress time/HashTags 620573577 688488489 0.90
parquet_rs-zstd decompress time/TPC-H l_comment canonical 582953221 603866410 0.97
parquet_rs-zstd decompress time/TPC-H l_comment chunked 588539553 607243597 0.97
parquet_rs-zstd decompress time/taxi 243679847 248986655 0.98
parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000 2856484 2803886 1.02
parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000 2791476 2890258 0.97
parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000 31788546 33538120 0.95
parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000 32804869 35376073 0.93
parquet_rs-zstd decompress time/wide table cols=10000 chunks=1 rows=1000 347666310 348756409 1.00
parquet_rs-zstd decompress time/wide table cols=10000 chunks=50 rows=1000 344909643 351131554 0.98
vortex-file-compressed size/Arade 145363860 145363860 1.00
vortex-file-compressed size/Bimbo 468763396 468763396 1.00
vortex-file-compressed size/CMSprovider 417904940 417861724 1.00
vortex-file-compressed size/Euro2016 158195780 158212596 1.00
vortex-file-compressed size/Food 41927000 41927000 1.00
vortex-file-compressed size/HashTags 185390548 184662140 1.00
vortex-file-compressed size/TPC-H l_comment canonical 178418384 178362760 1.00
vortex-file-compressed size/TPC-H l_comment chunked 178611928 178531808 1.00
vortex-file-compressed size/taxi 52364012 52364012 1.00
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000 930912 930912 1.00
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000 930912 930912 1.00
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000 9293712 9293712 1.00
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000 9293712 9293712 1.00
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000 92957712 92957712 1.00
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000 92957712 92957712 1.00
vortex:parquet-zstd ratio compress time/Arade 0 0 0.94
vortex:parquet-zstd ratio compress time/Bimbo 0 0 0.95
vortex:parquet-zstd ratio compress time/CMSprovider 0 0 1.01
vortex:parquet-zstd ratio compress time/Euro2016 0 0 1.09
vortex:parquet-zstd ratio compress time/Food 0 0 0.96
vortex:parquet-zstd ratio compress time/HashTags 0 0 1.05
vortex:parquet-zstd ratio compress time/TPC-H l_comment canonical 0 0 0.95
vortex:parquet-zstd ratio compress time/TPC-H l_comment chunked 0 0 0.97
vortex:parquet-zstd ratio compress time/taxi 0 0 0.95
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=1 rows=1000 1 1 0.99
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=50 rows=1000 2 1 1.09
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=1 rows=1000 1 1 1.01
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=50 rows=1000 1 1 1.00
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=1 rows=1000 1 1 0.98
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=50 rows=1000 1 1 1.01
vortex:parquet-zstd ratio decompress time/Arade 0 0 0.95
vortex:parquet-zstd ratio decompress time/Bimbo 0 0 0.97
vortex:parquet-zstd ratio decompress time/CMSprovider 0 0 1.00
vortex:parquet-zstd ratio decompress time/Euro2016 0 0 1.07
vortex:parquet-zstd ratio decompress time/Food 0 0 1.03
vortex:parquet-zstd ratio decompress time/HashTags 0 0 1.04
vortex:parquet-zstd ratio decompress time/TPC-H l_comment canonical 0 0 1.01
vortex:parquet-zstd ratio decompress time/TPC-H l_comment chunked 0 0 1.01
vortex:parquet-zstd ratio decompress time/taxi 0 0 0.96
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=1 rows=1000 0 0 0.91
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=50 rows=1000 0 0 0.98
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=1 rows=1000 0 0 0.99
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=50 rows=1000 0 0 1.06
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=1 rows=1000 0 0 0.99
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=50 rows=1000 0 0 0.99
vortex:parquet-zstd size/Arade 0 0 1.00
vortex:parquet-zstd size/Bimbo 1 1 1.00
vortex:parquet-zstd size/CMSprovider 1 1 1.00
vortex:parquet-zstd size/Euro2016 1 1 1.00
vortex:parquet-zstd size/Food 1 1 1.00
vortex:parquet-zstd size/HashTags 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment canonical 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment chunked 1 1 1.00
vortex:parquet-zstd size/taxi 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=50 rows=1000 0 0 1.00

@github-actions

github-actions Bot commented Jun 16, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +0.2%
Engines: DataFusion No clear signal (+2.5%, environment too noisy confidence) · DuckDB No clear signal (-2.1%, environment too noisy confidence)
Vortex (geomean): 0.959x ➖
Parquet (geomean): 0.958x ➖
Shifts: Parquet (control) -4.2% · Median polish -1.5%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.993x ➖, 0↑ 0↓)
name PR a1510c1 (ns) base 67a2b22 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 827519604 816787415 1.01
tpch_q02/datafusion:vortex-file-compressed 1050362203 964556334 1.09
tpch_q03/datafusion:vortex-file-compressed 1172926298 1075028587 1.09
tpch_q04/datafusion:vortex-file-compressed 750633806 665678955 1.13
tpch_q05/datafusion:vortex-file-compressed 1033562793 1039067380 0.99
tpch_q06/datafusion:vortex-file-compressed 719001512 663041865 1.08
tpch_q07/datafusion:vortex-file-compressed 1241996172 1074576541 1.16
tpch_q08/datafusion:vortex-file-compressed 1304487164 1409782865 0.93
tpch_q09/datafusion:vortex-file-compressed 1312555898 1398236362 0.94
tpch_q10/datafusion:vortex-file-compressed 1137957183 1438675808 0.79
tpch_q11/datafusion:vortex-file-compressed 768870637 670581844 1.15
tpch_q12/datafusion:vortex-file-compressed 945392806 1004764951 0.94
tpch_q13/datafusion:vortex-file-compressed 449481918 572956094 0.78
tpch_q14/datafusion:vortex-file-compressed 542074199 611683644 0.89
tpch_q15/datafusion:vortex-file-compressed 1032408116 1265528981 0.82
tpch_q16/datafusion:vortex-file-compressed 518110322 515325282 1.01
tpch_q17/datafusion:vortex-file-compressed 1465698727 1256979706 1.17
tpch_q18/datafusion:vortex-file-compressed 1327966439 1418379657 0.94
tpch_q19/datafusion:vortex-file-compressed 1125179981 1021003484 1.10
tpch_q20/datafusion:vortex-file-compressed 1203697210 1155198453 1.04
tpch_q21/datafusion:vortex-file-compressed 1803057603 1935276446 0.93
tpch_q22/datafusion:vortex-file-compressed 669643081 657223931 1.02
datafusion / vortex-compact (0.888x ➖, 4↑ 0↓)
name PR a1510c1 (ns) base 67a2b22 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 771433323 875532243 0.88
tpch_q02/datafusion:vortex-compact 824193207 837356052 0.98
tpch_q03/datafusion:vortex-compact 856593997 860323732 1.00
tpch_q04/datafusion:vortex-compact 🚀 446500882 651252538 0.69
tpch_q05/datafusion:vortex-compact 🚀 1006772961 1624517619 0.62
tpch_q06/datafusion:vortex-compact 712963506 672804112 1.06
tpch_q07/datafusion:vortex-compact 1095934738 1181318649 0.93
tpch_q08/datafusion:vortex-compact 1338801993 1560241298 0.86
tpch_q09/datafusion:vortex-compact 1318090870 1656797052 0.80
tpch_q10/datafusion:vortex-compact 1151161956 1267429235 0.91
tpch_q11/datafusion:vortex-compact 🚀 498430545 743492132 0.67
tpch_q12/datafusion:vortex-compact 898821706 986600521 0.91
tpch_q13/datafusion:vortex-compact 515270137 512341419 1.01
tpch_q14/datafusion:vortex-compact 568653408 647780480 0.88
tpch_q15/datafusion:vortex-compact 973382391 966798191 1.01
tpch_q16/datafusion:vortex-compact 490689270 518590107 0.95
tpch_q17/datafusion:vortex-compact 1166039081 1184298539 0.98
tpch_q18/datafusion:vortex-compact 1141414568 1207639378 0.95
tpch_q19/datafusion:vortex-compact 1076463766 1095903116 0.98
tpch_q20/datafusion:vortex-compact 1060871562 978471125 1.08
tpch_q21/datafusion:vortex-compact 1493368477 1494061439 1.00
tpch_q22/datafusion:vortex-compact 🚀 615754403 957215990 0.64
datafusion / parquet (0.916x ➖, 4↑ 3↓)
name PR a1510c1 (ns) base 67a2b22 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 943184491 908302866 1.04
tpch_q02/datafusion:parquet 🚨 1426962945 910870053 1.57
tpch_q03/datafusion:parquet 1161843230 1110037167 1.05
tpch_q04/datafusion:parquet 527093516 480341229 1.10
tpch_q05/datafusion:parquet 1356471351 1418068987 0.96
tpch_q06/datafusion:parquet 584837074 595367882 0.98
tpch_q07/datafusion:parquet 1552531387 1485632139 1.05
tpch_q08/datafusion:parquet 2018045377 1749691847 1.15
tpch_q09/datafusion:parquet 2209967537 2371400320 0.93
tpch_q10/datafusion:parquet 🚨 3932265672 2927196494 1.34
tpch_q11/datafusion:parquet 903469208 744725048 1.21
tpch_q12/datafusion:parquet 🚀 794168812 1256198865 0.63
tpch_q13/datafusion:parquet 🚀 820958507 2590834681 0.32
tpch_q14/datafusion:parquet 🚀 989623086 2385780209 0.41
tpch_q15/datafusion:parquet 🚀 1716344439 2508521382 0.68
tpch_q16/datafusion:parquet 🚨 794971272 601737267 1.32
tpch_q17/datafusion:parquet 1620036120 1518714968 1.07
tpch_q18/datafusion:parquet 1890117455 1701191432 1.11
tpch_q19/datafusion:parquet 1083130170 1157197785 0.94
tpch_q20/datafusion:parquet 1394050769 1795339071 0.78
tpch_q21/datafusion:parquet 2059992706 2241303034 0.92
tpch_q22/datafusion:parquet 952893698 1250618578 0.76
duckdb / vortex-file-compressed (0.983x ➖, 0↑ 0↓)
name PR a1510c1 (ns) base 67a2b22 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 611002673 682838129 0.89
tpch_q02/duckdb:vortex-file-compressed 1397165287 1482371347 0.94
tpch_q03/duckdb:vortex-file-compressed 1183199288 1227222890 0.96
tpch_q04/duckdb:vortex-file-compressed 927930920 905285358 1.03
tpch_q05/duckdb:vortex-file-compressed 1293502897 1436403480 0.90
tpch_q06/duckdb:vortex-file-compressed 711811851 596527699 1.19
tpch_q07/duckdb:vortex-file-compressed 1395654157 1474390807 0.95
tpch_q08/duckdb:vortex-file-compressed 1594566569 1447419411 1.10
tpch_q09/duckdb:vortex-file-compressed 1901022419 1912683126 0.99
tpch_q10/duckdb:vortex-file-compressed 1414817135 1505739764 0.94
tpch_q11/duckdb:vortex-file-compressed 752404812 783934902 0.96
tpch_q12/duckdb:vortex-file-compressed 1320430129 1264342523 1.04
tpch_q13/duckdb:vortex-file-compressed 1050585984 1059854301 0.99
tpch_q14/duckdb:vortex-file-compressed 760742247 656272546 1.16
tpch_q15/duckdb:vortex-file-compressed 609235026 597563076 1.02
tpch_q16/duckdb:vortex-file-compressed 573832909 760542189 0.75
tpch_q17/duckdb:vortex-file-compressed 1071029301 1118510241 0.96
tpch_q18/duckdb:vortex-file-compressed 1048557238 1094407705 0.96
tpch_q19/duckdb:vortex-file-compressed 840818276 883933288 0.95
tpch_q20/duckdb:vortex-file-compressed 1510513609 1327763714 1.14
tpch_q21/duckdb:vortex-file-compressed 2194948349 2311069005 0.95
tpch_q22/duckdb:vortex-file-compressed 603734693 643563744 0.94
duckdb / vortex-compact (0.977x ➖, 0↑ 0↓)
name PR a1510c1 (ns) base 67a2b22 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 631290019 678315315 0.93
tpch_q02/duckdb:vortex-compact 1313030208 1297536484 1.01
tpch_q03/duckdb:vortex-compact 921461565 909590464 1.01
tpch_q04/duckdb:vortex-compact 725504628 685904667 1.06
tpch_q05/duckdb:vortex-compact 1195195046 1362957851 0.88
tpch_q06/duckdb:vortex-compact 599276358 635563937 0.94
tpch_q07/duckdb:vortex-compact 1254689748 1411294604 0.89
tpch_q08/duckdb:vortex-compact 1519241583 1564049321 0.97
tpch_q09/duckdb:vortex-compact 1704965206 1872691306 0.91
tpch_q10/duckdb:vortex-compact 1415936632 1290705160 1.10
tpch_q11/duckdb:vortex-compact 725460706 684539928 1.06
tpch_q12/duckdb:vortex-compact 1100584009 1178041754 0.93
tpch_q13/duckdb:vortex-compact 927152846 868191564 1.07
tpch_q14/duckdb:vortex-compact 641636315 641457022 1.00
tpch_q15/duckdb:vortex-compact 606856701 587510581 1.03
tpch_q16/duckdb:vortex-compact 510787049 434221374 1.18
tpch_q17/duckdb:vortex-compact 903067315 986730083 0.92
tpch_q18/duckdb:vortex-compact 839133341 912565015 0.92
tpch_q19/duckdb:vortex-compact 830819887 821586418 1.01
tpch_q20/duckdb:vortex-compact 1294245899 1391601862 0.93
tpch_q21/duckdb:vortex-compact 1734984841 1882758101 0.92
tpch_q22/duckdb:vortex-compact 483915735 543401174 0.89
duckdb / parquet (1.001x ➖, 0↑ 0↓)
name PR a1510c1 (ns) base 67a2b22 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 891327328 1017515670 0.88
tpch_q02/duckdb:parquet 1397140637 1579676935 0.88
tpch_q03/duckdb:parquet 2103323565 2192642501 0.96
tpch_q04/duckdb:parquet 1209420789 1276834504 0.95
tpch_q05/duckdb:parquet 2137078254 2246929481 0.95
tpch_q06/duckdb:parquet 972936694 983737751 0.99
tpch_q07/duckdb:parquet 2413120236 2064382964 1.17
tpch_q08/duckdb:parquet 2770407355 2898851012 0.96
tpch_q09/duckdb:parquet 3052489366 2819493802 1.08
tpch_q10/duckdb:parquet 3973938463 3281623615 1.21
tpch_q11/duckdb:parquet 1108215598 1112688985 1.00
tpch_q12/duckdb:parquet 1562308593 1593594632 0.98
tpch_q13/duckdb:parquet 1451863038 1563329010 0.93
tpch_q14/duckdb:parquet 1560171518 1570824195 0.99
tpch_q15/duckdb:parquet 1126951364 997894812 1.13
tpch_q16/duckdb:parquet 958641609 1009005302 0.95
tpch_q17/duckdb:parquet 1447825301 1383181296 1.05
tpch_q18/duckdb:parquet 1699988106 1556046859 1.09
tpch_q19/duckdb:parquet 1685017336 1621612860 1.04
tpch_q20/duckdb:parquet 2193546765 2226887157 0.99
tpch_q21/duckdb:parquet 2079170252 2241013860 0.93
tpch_q22/duckdb:parquet 1249362335 1249923378 1.00

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@myrrc