Thanks to visit codestin.com
Credit goes to github.com

Skip to content

RLEExporter for duckdb#8539

Merged
myrrc merged 1 commit into
developfrom
myrrc/rle-duckdb
Jun 23, 2026
Merged

RLEExporter for duckdb#8539
myrrc merged 1 commit into
developfrom
myrrc/rle-duckdb

Conversation

@myrrc

@myrrc myrrc commented Jun 22, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Add RLE exporter for fastlanes.rle to Duckdb. Usable only when the underlying column is non-nullable, falls back to canonicalization otherwise.

Resolves: #8247

@myrrc myrrc added action/benchmark Trigger full benchmarks to run on this PR changelog/performance A performance improvement ext/duckdb Relates to the DuckDB integration labels Jun 22, 2026
@github-actions github-actions Bot removed the action/benchmark Trigger full benchmarks to run on this PR label Jun 22, 2026
@github-actions

github-actions Bot commented Jun 22, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done f212fb0 1 Explore Profiling Data
Previous Runs (2)
Status Commit Job Attempt Link
🟢 Done 0315036 1 Explore Profiling Data
🟢 Done f1a627e 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

github-actions Bot commented Jun 22, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling

Vortex (geomean): 1.019x ➖

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.019x ➖, 0↑ 0↓)
name PR f212fb0 (ns) base ba700ca (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 115287824 115920605 0.99
polarsignals_q01/datafusion:vortex-file-compressed 266987608 267601190 1.00
polarsignals_q02/datafusion:vortex-file-compressed 22518606 22216548 1.01
polarsignals_q03/datafusion:vortex-file-compressed 287462248 266614976 1.08
polarsignals_q04/datafusion:vortex-file-compressed 10186200 9469008 1.08
polarsignals_q05/datafusion:vortex-file-compressed 13045529 12965157 1.01
polarsignals_q06/datafusion:vortex-file-compressed 20647612 20930848 0.99
polarsignals_q07/datafusion:vortex-file-compressed 11286911 10766331 1.05
polarsignals_q08/datafusion:vortex-file-compressed 389033387 406778822 0.96
polarsignals_q09/datafusion:vortex-file-compressed 11939541 11531323 1.04

No file size changes detected.

@github-actions

github-actions Bot commented Jun 22, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.2%
Engines: DataFusion No clear signal (+1.2%, environment too noisy confidence) · DuckDB No clear signal (-0.8%, environment too noisy confidence)
Vortex (geomean): 1.017x ➖
Parquet (geomean): 1.020x ➖
Shifts: Parquet (control) +2.0% · Median polish +1.7%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.014x ➖, 0↑ 0↓)
name PR f212fb0 (ns) base ba700ca (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 60392248 57762870 1.05
tpch_q02/datafusion:vortex-file-compressed 24346810 23821580 1.02
tpch_q03/datafusion:vortex-file-compressed 33671390 32435780 1.04
tpch_q04/datafusion:vortex-file-compressed 20286161 19912877 1.02
tpch_q05/datafusion:vortex-file-compressed 51424597 49556164 1.04
tpch_q06/datafusion:vortex-file-compressed 10318183 10174864 1.01
tpch_q07/datafusion:vortex-file-compressed 57455618 56662527 1.01
tpch_q08/datafusion:vortex-file-compressed 43652819 41022623 1.06
tpch_q09/datafusion:vortex-file-compressed 56282664 54850021 1.03
tpch_q10/datafusion:vortex-file-compressed 35602819 35904864 0.99
tpch_q11/datafusion:vortex-file-compressed 17863905 17687390 1.01
tpch_q12/datafusion:vortex-file-compressed 24618006 25004851 0.98
tpch_q13/datafusion:vortex-file-compressed 27624584 28426923 0.97
tpch_q14/datafusion:vortex-file-compressed 16444227 15364944 1.07
tpch_q15/datafusion:vortex-file-compressed 24129207 24829782 0.97
tpch_q16/datafusion:vortex-file-compressed 21090692 20881397 1.01
tpch_q17/datafusion:vortex-file-compressed 71783592 70242761 1.02
tpch_q18/datafusion:vortex-file-compressed 80686576 80759859 1.00
tpch_q19/datafusion:vortex-file-compressed 33942398 33672784 1.01
tpch_q20/datafusion:vortex-file-compressed 32462323 31623858 1.03
tpch_q21/datafusion:vortex-file-compressed 72462648 72193974 1.00
tpch_q22/datafusion:vortex-file-compressed 12381635 12682220 0.98
datafusion / vortex-compact (1.012x ➖, 0↑ 0↓)
name PR f212fb0 (ns) base ba700ca (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 68547778 64511528 1.06
tpch_q02/datafusion:vortex-compact 27174856 26861049 1.01
tpch_q03/datafusion:vortex-compact 34888174 35715509 0.98
tpch_q04/datafusion:vortex-compact 22322673 22686232 0.98
tpch_q05/datafusion:vortex-compact 50585013 50394735 1.00
tpch_q06/datafusion:vortex-compact 12790905 12944281 0.99
tpch_q07/datafusion:vortex-compact 58164523 59787747 0.97
tpch_q08/datafusion:vortex-compact 46331188 43774306 1.06
tpch_q09/datafusion:vortex-compact 59683310 57952729 1.03
tpch_q10/datafusion:vortex-compact 40890359 39372184 1.04
tpch_q11/datafusion:vortex-compact 18791773 18592942 1.01
tpch_q12/datafusion:vortex-compact 31727778 31307587 1.01
tpch_q13/datafusion:vortex-compact 34373877 33339851 1.03
tpch_q14/datafusion:vortex-compact 20294521 18924309 1.07
tpch_q15/datafusion:vortex-compact 32007572 31367401 1.02
tpch_q16/datafusion:vortex-compact 25487665 25793724 0.99
tpch_q17/datafusion:vortex-compact 72954082 73305889 1.00
tpch_q18/datafusion:vortex-compact 84992927 79239372 1.07
tpch_q19/datafusion:vortex-compact 53492388 55317227 0.97
tpch_q20/datafusion:vortex-compact 36353743 35947215 1.01
tpch_q21/datafusion:vortex-compact 79512704 81005689 0.98
tpch_q22/datafusion:vortex-compact 14029882 14331082 0.98
datafusion / parquet (1.009x ➖, 0↑ 1↓)
name PR f212fb0 (ns) base ba700ca (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 🚨 143963617 124933490 1.15
tpch_q02/datafusion:parquet 64931300 65490325 0.99
tpch_q03/datafusion:parquet 78636234 87019479 0.90
tpch_q04/datafusion:parquet 46308558 47587455 0.97
tpch_q05/datafusion:parquet 99543731 93557208 1.06
tpch_q06/datafusion:parquet 38824794 36940655 1.05
tpch_q07/datafusion:parquet 107280480 115788950 0.93
tpch_q08/datafusion:parquet 98731548 102234998 0.97
tpch_q09/datafusion:parquet 132666764 129710649 1.02
tpch_q10/datafusion:parquet 126946511 119675341 1.06
tpch_q11/datafusion:parquet 44903471 44448519 1.01
tpch_q12/datafusion:parquet 83982575 79215198 1.06
tpch_q13/datafusion:parquet 217934239 210298325 1.04
tpch_q14/datafusion:parquet 47925877 46266948 1.04
tpch_q15/datafusion:parquet 60455552 63423810 0.95
tpch_q16/datafusion:parquet 45237987 46245805 0.98
tpch_q17/datafusion:parquet 151403298 152821887 0.99
tpch_q18/datafusion:parquet 164797058 162342655 1.02
tpch_q19/datafusion:parquet 80400052 76000969 1.06
tpch_q20/datafusion:parquet 72935534 77059773 0.95
tpch_q21/datafusion:parquet 152375488 150225370 1.01
tpch_q22/datafusion:parquet 48099344 46771532 1.03
datafusion / arrow (1.039x ➖, 0↑ 5↓)
name PR f212fb0 (ns) base ba700ca (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 63930556 69023449 0.93
tpch_q02/datafusion:arrow 17430957 18298250 0.95
tpch_q03/datafusion:arrow 37615477 35295411 1.07
tpch_q04/datafusion:arrow 🚨 32814423 27934074 1.17
tpch_q05/datafusion:arrow 🚨 68191521 59142008 1.15
tpch_q06/datafusion:arrow 🚨 26751259 22554293 1.19
tpch_q07/datafusion:arrow 114870318 111311950 1.03
tpch_q08/datafusion:arrow 49906722 49163020 1.02
tpch_q09/datafusion:arrow 73575160 76174761 0.97
tpch_q10/datafusion:arrow 🚨 59054806 52948092 1.12
tpch_q11/datafusion:arrow 10032175 9822761 1.02
tpch_q12/datafusion:arrow 53853328 52901938 1.02
tpch_q13/datafusion:arrow 46610417 47177177 0.99
tpch_q14/datafusion:arrow 25753406 25581119 1.01
tpch_q15/datafusion:arrow 🚨 58249509 49455418 1.18
tpch_q16/datafusion:arrow 18140341 17307778 1.05
tpch_q17/datafusion:arrow 75517273 74095933 1.02
tpch_q18/datafusion:arrow 122101274 114305201 1.07
tpch_q19/datafusion:arrow 41671038 40812913 1.02
tpch_q20/datafusion:arrow 39920568 41210687 0.97
tpch_q21/datafusion:arrow 163542937 166326635 0.98
tpch_q22/datafusion:arrow 12973088 12802797 1.01
duckdb / vortex-file-compressed (1.028x ➖, 0↑ 2↓)
name PR f212fb0 (ns) base ba700ca (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 32356657 31955336 1.01
tpch_q02/duckdb:vortex-file-compressed 26915672 27026309 1.00
tpch_q03/duckdb:vortex-file-compressed 34744506 33978266 1.02
tpch_q04/duckdb:vortex-file-compressed 31800849 30279965 1.05
tpch_q05/duckdb:vortex-file-compressed 40481860 39997775 1.01
tpch_q06/duckdb:vortex-file-compressed 8453924 8349984 1.01
tpch_q07/duckdb:vortex-file-compressed 37287050 37237622 1.00
tpch_q08/duckdb:vortex-file-compressed 42864810 42370792 1.01
tpch_q09/duckdb:vortex-file-compressed 62816527 62479380 1.01
tpch_q10/duckdb:vortex-file-compressed 44884830 43941311 1.02
tpch_q11/duckdb:vortex-file-compressed 15981699 15801543 1.01
tpch_q12/duckdb:vortex-file-compressed 24075012 24115423 1.00
tpch_q13/duckdb:vortex-file-compressed 43901582 43031502 1.02
tpch_q14/duckdb:vortex-file-compressed 23310097 22604431 1.03
tpch_q15/duckdb:vortex-file-compressed 18053749 17350007 1.04
tpch_q16/duckdb:vortex-file-compressed 31622438 30968437 1.02
tpch_q17/duckdb:vortex-file-compressed 25838585 25016948 1.03
tpch_q18/duckdb:vortex-file-compressed 58823418 56877401 1.03
tpch_q19/duckdb:vortex-file-compressed 🚨 33881145 30737467 1.10
tpch_q20/duckdb:vortex-file-compressed 35240268 35587339 0.99
tpch_q21/duckdb:vortex-file-compressed 113841114 105952716 1.07
tpch_q22/duckdb:vortex-file-compressed 🚨 20490907 18166009 1.13
duckdb / vortex-compact (1.013x ➖, 0↑ 0↓)
name PR f212fb0 (ns) base ba700ca (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 39737931 39718460 1.00
tpch_q02/duckdb:vortex-compact 36998782 34506448 1.07
tpch_q03/duckdb:vortex-compact 37194707 35943864 1.03
tpch_q04/duckdb:vortex-compact 33291753 31230984 1.07
tpch_q05/duckdb:vortex-compact 44005367 43713182 1.01
tpch_q06/duckdb:vortex-compact 11081039 10638050 1.04
tpch_q07/duckdb:vortex-compact 43134026 43737181 0.99
tpch_q08/duckdb:vortex-compact 49633717 48934989 1.01
tpch_q09/duckdb:vortex-compact 68866866 68455275 1.01
tpch_q10/duckdb:vortex-compact 47821109 48444552 0.99
tpch_q11/duckdb:vortex-compact 18970694 18739147 1.01
tpch_q12/duckdb:vortex-compact 30164782 31175604 0.97
tpch_q13/duckdb:vortex-compact 48093585 47865333 1.00
tpch_q14/duckdb:vortex-compact 27403100 27568912 0.99
tpch_q15/duckdb:vortex-compact 21666114 20634072 1.05
tpch_q16/duckdb:vortex-compact 33935732 34412170 0.99
tpch_q17/duckdb:vortex-compact 30165338 29860905 1.01
tpch_q18/duckdb:vortex-compact 58532790 58561995 1.00
tpch_q19/duckdb:vortex-compact 36060977 35016298 1.03
tpch_q20/duckdb:vortex-compact 40388871 41196125 0.98
tpch_q21/duckdb:vortex-compact 114712866 109572008 1.05
tpch_q22/duckdb:vortex-compact 19958387 20192709 0.99
duckdb / parquet (1.030x ➖, 0↑ 3↓)
name PR f212fb0 (ns) base ba700ca (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 77414195 78397909 0.99
tpch_q02/duckdb:parquet 41294788 40890616 1.01
tpch_q03/duckdb:parquet 73239079 72388186 1.01
tpch_q04/duckdb:parquet 51133281 50600066 1.01
tpch_q05/duckdb:parquet 70820867 69749031 1.02
tpch_q06/duckdb:parquet 23154177 22686282 1.02
tpch_q07/duckdb:parquet 75421508 78532881 0.96
tpch_q08/duckdb:parquet 🚨 97416785 83749612 1.16
tpch_q09/duckdb:parquet 🚨 159758430 138384203 1.15
tpch_q10/duckdb:parquet 134172315 129997999 1.03
tpch_q11/duckdb:parquet 24021709 23340974 1.03
tpch_q12/duckdb:parquet 🚨 55092173 47889378 1.15
tpch_q13/duckdb:parquet 273324561 272229717 1.00
tpch_q14/duckdb:parquet 54367215 52832208 1.03
tpch_q15/duckdb:parquet 27638499 27511767 1.00
tpch_q16/duckdb:parquet 61072699 60056806 1.02
tpch_q17/duckdb:parquet 58767026 57133642 1.03
tpch_q18/duckdb:parquet 124043089 120930224 1.03
tpch_q19/duckdb:parquet 84986144 81996416 1.04
tpch_q20/duckdb:parquet 67403845 66520330 1.01
tpch_q21/duckdb:parquet 186852471 191923665 0.97
tpch_q22/duckdb:parquet 55819945 54658223 1.02
duckdb / duckdb (1.025x ➖, 0↑ 0↓)
name PR f212fb0 (ns) base ba700ca (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 18744661 17993609 1.04
tpch_q02/duckdb:duckdb 15112326 15418536 0.98
tpch_q03/duckdb:duckdb 23745501 23688358 1.00
tpch_q04/duckdb:duckdb 23791046 22094020 1.08
tpch_q05/duckdb:duckdb 24519356 24039141 1.02
tpch_q06/duckdb:duckdb 7405527 7262245 1.02
tpch_q07/duckdb:duckdb 27654601 26323416 1.05
tpch_q08/duckdb:duckdb 25125442 24876029 1.01
tpch_q09/duckdb:duckdb 63406109 61521424 1.03
tpch_q10/duckdb:duckdb 54621955 52831837 1.03
tpch_q11/duckdb:duckdb 7983703 7661161 1.04
tpch_q12/duckdb:duckdb 18585998 18497802 1.00
tpch_q13/duckdb:duckdb 41844784 40410712 1.04
tpch_q14/duckdb:duckdb 22696461 22325784 1.02
tpch_q15/duckdb:duckdb 14227990 13944134 1.02
tpch_q16/duckdb:duckdb 27862206 27112365 1.03
tpch_q17/duckdb:duckdb 16961681 16572377 1.02
tpch_q18/duckdb:duckdb 42933015 41858605 1.03
tpch_q19/duckdb:duckdb 33629664 33065275 1.02
tpch_q20/duckdb:duckdb 26340276 26214062 1.00
tpch_q21/duckdb:duckdb 66298810 64571867 1.03
tpch_q22/duckdb:duckdb 27459236 26216663 1.05
File Size Changes (9 files changed, -0.1% overall, 6↑ 3↓)
File Scale Format Base HEAD Change %
part_0.vortex 1.0 vortex-compact 3.34 MB 3.40 MB +63.12 KB +1.8%
supplier_0.vortex 1.0 vortex-file-compressed 599.45 KB 605.02 KB +5.57 KB +0.9%
part_0.vortex 1.0 vortex-file-compressed 5.05 MB 5.06 MB +14.40 KB +0.3%
lineitem_1.vortex 1.0 vortex-file-compressed 81.90 MB 82.05 MB +150.38 KB +0.2%
partsupp_0.vortex 1.0 vortex-file-compressed 23.69 MB 23.73 MB +32.79 KB +0.1%
partsupp_0.vortex 1.0 vortex-compact 20.88 MB 20.89 MB +12.27 KB +0.1%
lineitem_0.vortex 1.0 vortex-file-compressed 82.34 MB 82.19 MB 144.99 KB -0.2%
customer_0.vortex 1.0 vortex-file-compressed 8.92 MB 8.90 MB 19.87 KB -0.2%
orders_0.vortex 1.0 vortex-file-compressed 35.43 MB 34.99 MB 451.36 KB -1.2%

Totals:

  • vortex-compact: 190.65 MB → 190.72 MB (+0.0%)
  • vortex-file-compressed: 238.20 MB → 237.79 MB (-0.2%)

@github-actions

github-actions Bot commented Jun 22, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.7%
Engines: DataFusion No clear signal (-0.4%, low confidence) · DuckDB No clear signal (+1.9%, low confidence)
Vortex (geomean): 1.005x ➖
Parquet (geomean): 0.998x ➖
Shifts: Parquet (control) -0.2% · Median polish +0.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.994x ➖, 1↑ 1↓)
name PR f212fb0 (ns) base ba700ca (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚨 5677854 5007022 1.13
fineweb_q01/datafusion:vortex-file-compressed 33200120 33399094 0.99
fineweb_q02/datafusion:vortex-file-compressed 39258825 39283597 1.00
fineweb_q03/datafusion:vortex-file-compressed 🚀 54335718 67870199 0.80
fineweb_q04/datafusion:vortex-file-compressed 274674831 275159789 1.00
fineweb_q05/datafusion:vortex-file-compressed 217916077 214878681 1.01
fineweb_q06/datafusion:vortex-file-compressed 53564620 52306044 1.02
fineweb_q07/datafusion:vortex-file-compressed 55552204 55123470 1.01
fineweb_q08/datafusion:vortex-file-compressed 22745965 22615793 1.01
datafusion / vortex-compact (0.993x ➖, 0↑ 0↓)
name PR f212fb0 (ns) base ba700ca (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 5325984 5653929 0.94
fineweb_q01/datafusion:vortex-compact 97390480 93315867 1.04
fineweb_q02/datafusion:vortex-compact 106301313 106135562 1.00
fineweb_q03/datafusion:vortex-compact 870298184 874466269 1.00
fineweb_q04/datafusion:vortex-compact 919172088 914254655 1.01
fineweb_q05/datafusion:vortex-compact 826930572 820937293 1.01
fineweb_q06/datafusion:vortex-compact 472146927 468354650 1.01
fineweb_q07/datafusion:vortex-compact 482138904 479618602 1.01
fineweb_q08/datafusion:vortex-compact 21611226 23134292 0.93
datafusion / parquet (0.998x ➖, 0↑ 0↓)
name PR f212fb0 (ns) base ba700ca (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 7493130 7026736 1.07
fineweb_q01/datafusion:parquet 288520360 291216792 0.99
fineweb_q02/datafusion:parquet 287270190 293072410 0.98
fineweb_q03/datafusion:parquet 289576198 279022331 1.04
fineweb_q04/datafusion:parquet 301396046 303181144 0.99
fineweb_q05/datafusion:parquet 295861823 303588117 0.97
fineweb_q06/datafusion:parquet 286602774 301191124 0.95
fineweb_q07/datafusion:parquet 281432724 282466173 1.00
fineweb_q08/datafusion:parquet 275592247 277726264 0.99
duckdb / vortex-file-compressed (1.014x ➖, 0↑ 0↓)
name PR f212fb0 (ns) base ba700ca (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 3435264 3430257 1.00
fineweb_q01/duckdb:vortex-file-compressed 37271134 34156580 1.09
fineweb_q02/duckdb:vortex-file-compressed 39119987 41639009 0.94
fineweb_q03/duckdb:vortex-file-compressed 116149233 111145628 1.05
fineweb_q04/duckdb:vortex-file-compressed 276509646 265926431 1.04
fineweb_q05/duckdb:vortex-file-compressed 215079554 218462063 0.98
fineweb_q06/duckdb:vortex-file-compressed 50655439 50540976 1.00
fineweb_q07/duckdb:vortex-file-compressed 53590124 52515191 1.02
fineweb_q08/duckdb:vortex-file-compressed 20802666 20655219 1.01
duckdb / vortex-compact (1.021x ➖, 0↑ 1↓)
name PR f212fb0 (ns) base ba700ca (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 4079023 4159815 0.98
fineweb_q01/duckdb:vortex-compact 🚨 125652703 107582025 1.17
fineweb_q02/duckdb:vortex-compact 117125771 107061165 1.09
fineweb_q03/duckdb:vortex-compact 857258031 847422702 1.01
fineweb_q04/duckdb:vortex-compact 897542105 896685807 1.00
fineweb_q05/duckdb:vortex-compact 803362148 799406853 1.00
fineweb_q06/duckdb:vortex-compact 461448051 463521171 1.00
fineweb_q07/duckdb:vortex-compact 480115294 477700372 1.01
fineweb_q08/duckdb:vortex-compact 18841490 19894938 0.95
duckdb / parquet (0.998x ➖, 0↑ 0↓)
name PR f212fb0 (ns) base ba700ca (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 29344445 31775125 0.92
fineweb_q01/duckdb:parquet 86870212 84300745 1.03
fineweb_q02/duckdb:parquet 85009844 84238200 1.01
fineweb_q03/duckdb:parquet 316397456 313603139 1.01
fineweb_q04/duckdb:parquet 445991573 445758556 1.00
fineweb_q05/duckdb:parquet 414696065 412954648 1.00
fineweb_q06/duckdb:parquet 202702654 202370032 1.00
fineweb_q07/duckdb:parquet 217067822 215185865 1.01
fineweb_q08/duckdb:parquet 32357635 32291634 1.00
File Size Changes (1 files changed, +0.0% overall, 1↑ 0↓)
File Scale Format Base HEAD Change %
sample.vortex 1.0 vortex-file-compressed 1.43 GB 1.43 GB +543.35 KB +0.0%

Totals:

  • vortex-compact: 1.23 GB → 1.23 GB (0.0%)
  • vortex-file-compressed: 1.43 GB → 1.43 GB (+0.0%)

@github-actions

github-actions Bot commented Jun 22, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +2.2%
Engines: DataFusion No clear signal (+0.5%, low confidence) · DuckDB No clear signal (+3.2%, low confidence)
Vortex (geomean): 1.048x ➖
Parquet (geomean): 1.028x ➖
Shifts: Parquet (control) +2.8% · Median polish +3.4%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.022x ➖, 2↑ 5↓)
name PR f212fb0 (ns) base ba700ca (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 🚨 28551583 25563181 1.12
tpcds_q02/datafusion:vortex-file-compressed 46968144 46269616 1.02
tpcds_q03/datafusion:vortex-file-compressed 15855394 15031284 1.05
tpcds_q04/datafusion:vortex-file-compressed 254940946 252295275 1.01
tpcds_q05/datafusion:vortex-file-compressed 44678204 44029626 1.01
tpcds_q06/datafusion:vortex-file-compressed 23520232 23028929 1.02
tpcds_q07/datafusion:vortex-file-compressed 39906834 39711046 1.00
tpcds_q08/datafusion:vortex-file-compressed 30295292 29148127 1.04
tpcds_q09/datafusion:vortex-file-compressed 31316158 33616573 0.93
tpcds_q10/datafusion:vortex-file-compressed 38313432 38808198 0.99
tpcds_q11/datafusion:vortex-file-compressed 126928617 129113055 0.98
tpcds_q12/datafusion:vortex-file-compressed 🚀 18681253 22116529 0.84
tpcds_q13/datafusion:vortex-file-compressed 47574360 49266448 0.97
tpcds_q14/datafusion:vortex-file-compressed 165486099 162686133 1.02
tpcds_q15/datafusion:vortex-file-compressed 26649088 26229332 1.02
tpcds_q16/datafusion:vortex-file-compressed 25996963 24876347 1.05
tpcds_q17/datafusion:vortex-file-compressed 62854202 61111090 1.03
tpcds_q18/datafusion:vortex-file-compressed 64514411 62387503 1.03
tpcds_q19/datafusion:vortex-file-compressed 22286516 22072785 1.01
tpcds_q20/datafusion:vortex-file-compressed 21182156 20652917 1.03
tpcds_q21/datafusion:vortex-file-compressed 34967737 36625785 0.95
tpcds_q22/datafusion:vortex-file-compressed 132430027 123378672 1.07
tpcds_q23/datafusion:vortex-file-compressed 153970140 145074479 1.06
tpcds_q24/datafusion:vortex-file-compressed 84949874 85147986 1.00
tpcds_q25/datafusion:vortex-file-compressed 65626914 65216297 1.01
tpcds_q26/datafusion:vortex-file-compressed 34943968 33245465 1.05
tpcds_q27/datafusion:vortex-file-compressed 94702515 95007081 1.00
tpcds_q28/datafusion:vortex-file-compressed 31214885 28798415 1.08
tpcds_q29/datafusion:vortex-file-compressed 62967797 60444071 1.04
tpcds_q30/datafusion:vortex-file-compressed 25081874 23533400 1.07
tpcds_q31/datafusion:vortex-file-compressed 76044192 73739193 1.03
tpcds_q32/datafusion:vortex-file-compressed 19824176 18653806 1.06
tpcds_q33/datafusion:vortex-file-compressed 31221804 29004675 1.08
tpcds_q34/datafusion:vortex-file-compressed 27090540 25039515 1.08
tpcds_q35/datafusion:vortex-file-compressed 47822384 43702594 1.09
tpcds_q36/datafusion:vortex-file-compressed 60921686 58455302 1.04
tpcds_q37/datafusion:vortex-file-compressed 🚨 21901362 19884045 1.10
tpcds_q38/datafusion:vortex-file-compressed 44998248 43021719 1.05
tpcds_q39/datafusion:vortex-file-compressed 107186233 109360756 0.98
tpcds_q40/datafusion:vortex-file-compressed 31022308 32111758 0.97
tpcds_q41/datafusion:vortex-file-compressed 20715927 20576539 1.01
tpcds_q42/datafusion:vortex-file-compressed 13494053 13997407 0.96
tpcds_q43/datafusion:vortex-file-compressed 18591142 18712390 0.99
tpcds_q44/datafusion:vortex-file-compressed 29439390 28665296 1.03
tpcds_q45/datafusion:vortex-file-compressed 28007892 27129430 1.03
tpcds_q46/datafusion:vortex-file-compressed 35514349 35088027 1.01
tpcds_q47/datafusion:vortex-file-compressed 137308649 134287618 1.02
tpcds_q48/datafusion:vortex-file-compressed 34492121 33751863 1.02
tpcds_q49/datafusion:vortex-file-compressed 57271305 57756737 0.99
tpcds_q50/datafusion:vortex-file-compressed 41668613 39162998 1.06
tpcds_q51/datafusion:vortex-file-compressed 92760211 88776498 1.04
tpcds_q52/datafusion:vortex-file-compressed 14289298 13985425 1.02
tpcds_q53/datafusion:vortex-file-compressed 23060166 22165237 1.04
tpcds_q54/datafusion:vortex-file-compressed 🚀 33954509 38643145 0.88
tpcds_q55/datafusion:vortex-file-compressed 14751708 14012567 1.05
tpcds_q56/datafusion:vortex-file-compressed 31687130 30299116 1.05
tpcds_q57/datafusion:vortex-file-compressed 109913706 107096352 1.03
tpcds_q58/datafusion:vortex-file-compressed 56226478 58406410 0.96
tpcds_q59/datafusion:vortex-file-compressed 58945309 57510349 1.02
tpcds_q60/datafusion:vortex-file-compressed 30519009 29181057 1.05
tpcds_q61/datafusion:vortex-file-compressed 40531013 39721354 1.02
tpcds_q62/datafusion:vortex-file-compressed 23476619 23093734 1.02
tpcds_q63/datafusion:vortex-file-compressed 22889468 22911638 1.00
tpcds_q64/datafusion:vortex-file-compressed 378955356 384108650 0.99
tpcds_q65/datafusion:vortex-file-compressed 53485800 50443280 1.06
tpcds_q66/datafusion:vortex-file-compressed 🚨 78727106 68677677 1.15
tpcds_q67/datafusion:vortex-file-compressed 163196483 150707671 1.08
tpcds_q68/datafusion:vortex-file-compressed 34713646 33411606 1.04
tpcds_q69/datafusion:vortex-file-compressed 38105087 35879412 1.06
tpcds_q70/datafusion:vortex-file-compressed 98469106 103543449 0.95
tpcds_q71/datafusion:vortex-file-compressed 23174704 23614618 0.98
tpcds_q72/datafusion:vortex-file-compressed 2103023398 2056778219 1.02
tpcds_q73/datafusion:vortex-file-compressed 24907887 24787670 1.00
tpcds_q74/datafusion:vortex-file-compressed 80279547 79898401 1.00
tpcds_q75/datafusion:vortex-file-compressed 111737111 108403185 1.03
tpcds_q76/datafusion:vortex-file-compressed 26746973 28458219 0.94
tpcds_q77/datafusion:vortex-file-compressed 38697856 37812269 1.02
tpcds_q78/datafusion:vortex-file-compressed 116633457 113868626 1.02
tpcds_q79/datafusion:vortex-file-compressed 29437114 30612191 0.96
tpcds_q80/datafusion:vortex-file-compressed 90586301 89908988 1.01
tpcds_q81/datafusion:vortex-file-compressed 25074970 24503404 1.02
tpcds_q82/datafusion:vortex-file-compressed 21675851 22702759 0.95
tpcds_q83/datafusion:vortex-file-compressed 37416823 36643825 1.02
tpcds_q84/datafusion:vortex-file-compressed 13648770 13263787 1.03
tpcds_q85/datafusion:vortex-file-compressed 96225138 94620496 1.02
tpcds_q86/datafusion:vortex-file-compressed 🚨 17702147 16054034 1.10
tpcds_q87/datafusion:vortex-file-compressed 43279581 42211770 1.03
tpcds_q88/datafusion:vortex-file-compressed 56327095 56281438 1.00
tpcds_q89/datafusion:vortex-file-compressed 25734919 26436046 0.97
tpcds_q90/datafusion:vortex-file-compressed 14341989 13839845 1.04
tpcds_q91/datafusion:vortex-file-compressed 19263994 18064032 1.07
tpcds_q92/datafusion:vortex-file-compressed 17377556 16292933 1.07
tpcds_q93/datafusion:vortex-file-compressed 33959087 31789479 1.07
tpcds_q94/datafusion:vortex-file-compressed 23868324 22346092 1.07
tpcds_q95/datafusion:vortex-file-compressed 62364579 61796010 1.01
tpcds_q96/datafusion:vortex-file-compressed 13339533 13783050 0.97
tpcds_q97/datafusion:vortex-file-compressed 31834869 29629322 1.07
tpcds_q98/datafusion:vortex-file-compressed 24081221 24569192 0.98
tpcds_q99/datafusion:vortex-file-compressed 🚨 32399553 28036004 1.16
datafusion / vortex-compact (1.031x ➖, 0↑ 5↓)
name PR f212fb0 (ns) base ba700ca (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-compact 🚨 28440361 25748452 1.10
tpcds_q02/datafusion:vortex-compact 55534300 54206056 1.02
tpcds_q03/datafusion:vortex-compact 20069997 19622534 1.02
tpcds_q04/datafusion:vortex-compact 294702479 284700383 1.04
tpcds_q05/datafusion:vortex-compact 49963388 47483709 1.05
tpcds_q06/datafusion:vortex-compact 27067221 26742452 1.01
tpcds_q07/datafusion:vortex-compact 53121379 53925344 0.99
tpcds_q08/datafusion:vortex-compact 37112244 36243625 1.02
tpcds_q09/datafusion:vortex-compact 45992715 43842203 1.05
tpcds_q10/datafusion:vortex-compact 52993863 48413647 1.09
tpcds_q11/datafusion:vortex-compact 163935848 162107438 1.01
tpcds_q12/datafusion:vortex-compact 27325038 25643447 1.07
tpcds_q13/datafusion:vortex-compact 129022558 128290590 1.01
tpcds_q14/datafusion:vortex-compact 183981149 186500173 0.99
tpcds_q15/datafusion:vortex-compact 30341065 27761032 1.09
tpcds_q16/datafusion:vortex-compact 29848913 27944939 1.07
tpcds_q17/datafusion:vortex-compact 73943254 73052611 1.01
tpcds_q18/datafusion:vortex-compact 73085036 73700507 0.99
tpcds_q19/datafusion:vortex-compact 30745325 28700628 1.07
tpcds_q20/datafusion:vortex-compact 27210606 26270209 1.04
tpcds_q21/datafusion:vortex-compact 41712125 41575944 1.00
tpcds_q22/datafusion:vortex-compact 140432049 129054394 1.09
tpcds_q23/datafusion:vortex-compact 165400900 170382686 0.97
tpcds_q24/datafusion:vortex-compact 99288472 97335720 1.02
tpcds_q25/datafusion:vortex-compact 79684130 78311014 1.02
tpcds_q26/datafusion:vortex-compact 46686977 44362484 1.05
tpcds_q27/datafusion:vortex-compact 116443216 117174256 0.99
tpcds_q28/datafusion:vortex-compact 97899575 93908593 1.04
tpcds_q29/datafusion:vortex-compact 75325469 73462894 1.03
tpcds_q30/datafusion:vortex-compact 29031051 28526981 1.02
tpcds_q31/datafusion:vortex-compact 106459748 100003951 1.06
tpcds_q32/datafusion:vortex-compact 25728993 24856623 1.04
tpcds_q33/datafusion:vortex-compact 39496936 38309866 1.03
tpcds_q34/datafusion:vortex-compact 34225800 34118718 1.00
tpcds_q35/datafusion:vortex-compact 52779549 53043822 1.00
tpcds_q36/datafusion:vortex-compact 77479049 77496953 1.00
tpcds_q37/datafusion:vortex-compact 30633340 31897849 0.96
tpcds_q38/datafusion:vortex-compact 49115465 51018213 0.96
tpcds_q39/datafusion:vortex-compact 116344191 120866454 0.96
tpcds_q40/datafusion:vortex-compact 35486005 34907744 1.02
tpcds_q41/datafusion:vortex-compact 23147875 22662284 1.02
tpcds_q42/datafusion:vortex-compact 18669347 18202800 1.03
tpcds_q43/datafusion:vortex-compact 24906931 24552449 1.01
tpcds_q44/datafusion:vortex-compact 41849560 41553333 1.01
tpcds_q45/datafusion:vortex-compact 30983413 32443626 0.95
tpcds_q46/datafusion:vortex-compact 46229677 47436125 0.97
tpcds_q47/datafusion:vortex-compact 156832858 150548589 1.04
tpcds_q48/datafusion:vortex-compact 82692163 81433926 1.02
tpcds_q49/datafusion:vortex-compact 71386685 67324247 1.06
tpcds_q50/datafusion:vortex-compact 46569726 50229517 0.93
tpcds_q51/datafusion:vortex-compact 108170094 98409539 1.10
tpcds_q52/datafusion:vortex-compact 20033884 18320369 1.09
tpcds_q53/datafusion:vortex-compact 29525355 28983112 1.02
tpcds_q54/datafusion:vortex-compact 42365162 43700754 0.97
tpcds_q55/datafusion:vortex-compact 18333889 17857970 1.03
tpcds_q56/datafusion:vortex-compact 37795104 36515587 1.04
tpcds_q57/datafusion:vortex-compact 123676688 117881527 1.05
tpcds_q58/datafusion:vortex-compact 69262299 67329386 1.03
tpcds_q59/datafusion:vortex-compact 72318661 71675552 1.01
tpcds_q60/datafusion:vortex-compact 37446485 35623787 1.05
tpcds_q61/datafusion:vortex-compact 55100331 55549340 0.99
tpcds_q62/datafusion:vortex-compact 🚨 28748931 24034870 1.20
tpcds_q63/datafusion:vortex-compact 30331462 29251035 1.04
tpcds_q64/datafusion:vortex-compact 456104207 421654843 1.08
tpcds_q65/datafusion:vortex-compact 67408785 65367370 1.03
tpcds_q66/datafusion:vortex-compact 83352082 77501247 1.08
tpcds_q67/datafusion:vortex-compact 165096102 164840156 1.00
tpcds_q68/datafusion:vortex-compact 47638020 48826971 0.98
tpcds_q69/datafusion:vortex-compact 47238059 45810126 1.03
tpcds_q70/datafusion:vortex-compact 113402474 108266904 1.05
tpcds_q71/datafusion:vortex-compact 32684494 30437264 1.07
tpcds_q72/datafusion:vortex-compact 2135087139 2060163791 1.04
tpcds_q73/datafusion:vortex-compact 33428782 30838268 1.08
tpcds_q74/datafusion:vortex-compact 97247841 92148276 1.06
tpcds_q75/datafusion:vortex-compact 🚨 141400962 125602055 1.13
tpcds_q76/datafusion:vortex-compact 34230839 32944081 1.04
tpcds_q77/datafusion:vortex-compact 48150155 47489335 1.01
tpcds_q78/datafusion:vortex-compact 136439022 132667467 1.03
tpcds_q79/datafusion:vortex-compact 41361813 38796070 1.07
tpcds_q80/datafusion:vortex-compact 103702644 101503335 1.02
tpcds_q81/datafusion:vortex-compact 29289371 30231037 0.97
tpcds_q82/datafusion:vortex-compact 32726900 33030324 0.99
tpcds_q83/datafusion:vortex-compact 36893006 36729779 1.00
tpcds_q84/datafusion:vortex-compact 16082384 15181714 1.06
tpcds_q85/datafusion:vortex-compact 166239086 157634331 1.05
tpcds_q86/datafusion:vortex-compact 20307947 21205254 0.96
tpcds_q87/datafusion:vortex-compact 54275365 51389139 1.06
tpcds_q88/datafusion:vortex-compact 80507249 84099379 0.96
tpcds_q89/datafusion:vortex-compact 33273103 31595774 1.05
tpcds_q90/datafusion:vortex-compact 15780274 14459503 1.09
tpcds_q91/datafusion:vortex-compact 34867159 32593426 1.07
tpcds_q92/datafusion:vortex-compact 🚨 27132753 23429767 1.16
tpcds_q93/datafusion:vortex-compact 37919221 36682480 1.03
tpcds_q94/datafusion:vortex-compact 🚨 26347590 23712794 1.11
tpcds_q95/datafusion:vortex-compact 64916856 66694762 0.97
tpcds_q96/datafusion:vortex-compact 18408527 16774346 1.10
tpcds_q97/datafusion:vortex-compact 37092548 35569019 1.04
tpcds_q98/datafusion:vortex-compact 31744317 29419298 1.08
tpcds_q99/datafusion:vortex-compact 34741838 34836764 1.00
datafusion / parquet (1.021x ➖, 1↑ 4↓)
name PR f212fb0 (ns) base ba700ca (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 25822836 23999103 1.08
tpcds_q02/datafusion:parquet 41280797 43141800 0.96
tpcds_q03/datafusion:parquet 13714910 13527144 1.01
tpcds_q04/datafusion:parquet 288169340 305023290 0.94
tpcds_q05/datafusion:parquet 46522492 46234886 1.01
tpcds_q06/datafusion:parquet 23116521 22293115 1.04
tpcds_q07/datafusion:parquet 77810452 75062841 1.04
tpcds_q08/datafusion:parquet 30019096 29528023 1.02
tpcds_q09/datafusion:parquet 39877377 37840295 1.05
tpcds_q10/datafusion:parquet 🚨 78657333 69607175 1.13
tpcds_q11/datafusion:parquet 151939156 144843674 1.05
tpcds_q12/datafusion:parquet 17515013 16115509 1.09
tpcds_q13/datafusion:parquet 74953833 73801697 1.02
tpcds_q14/datafusion:parquet 159874523 160295666 1.00
tpcds_q15/datafusion:parquet 20308013 21398108 0.95
tpcds_q16/datafusion:parquet 27918914 29417196 0.95
tpcds_q17/datafusion:parquet 62444686 63431705 0.98
tpcds_q18/datafusion:parquet 108497120 108962574 1.00
tpcds_q19/datafusion:parquet 22783256 22591155 1.01
tpcds_q20/datafusion:parquet 16406058 18225764 0.90
tpcds_q21/datafusion:parquet 18960340 18759478 1.01
tpcds_q22/datafusion:parquet 🚨 183757014 160335926 1.15
tpcds_q23/datafusion:parquet 150646180 146684402 1.03
tpcds_q24/datafusion:parquet 89588516 90729804 0.99
tpcds_q25/datafusion:parquet 63542889 60965110 1.04
tpcds_q26/datafusion:parquet 63468505 64064761 0.99
tpcds_q27/datafusion:parquet 136102051 132334965 1.03
tpcds_q28/datafusion:parquet 44494597 44158981 1.01
tpcds_q29/datafusion:parquet 68535615 64497001 1.06
tpcds_q30/datafusion:parquet 34459481 33674598 1.02
tpcds_q31/datafusion:parquet 66405512 66239618 1.00
tpcds_q32/datafusion:parquet 16443358 16226533 1.01
tpcds_q33/datafusion:parquet 28277347 28572230 0.99
tpcds_q34/datafusion:parquet 22596569 23475832 0.96
tpcds_q35/datafusion:parquet 73335050 70744748 1.04
tpcds_q36/datafusion:parquet 57775033 57781735 1.00
tpcds_q37/datafusion:parquet 19747056 19305440 1.02
tpcds_q38/datafusion:parquet 41967435 41955991 1.00
tpcds_q39/datafusion:parquet 74987489 73085875 1.03
tpcds_q40/datafusion:parquet 23521875 22629313 1.04
tpcds_q41/datafusion:parquet 14271462 14438469 0.99
tpcds_q42/datafusion:parquet 11979959 11817532 1.01
tpcds_q43/datafusion:parquet 16936676 16362173 1.04
tpcds_q44/datafusion:parquet 31352177 31340708 1.00
tpcds_q45/datafusion:parquet 29283057 28982193 1.01
tpcds_q46/datafusion:parquet 32587493 31696196 1.03
tpcds_q47/datafusion:parquet 131588175 131220514 1.00
tpcds_q48/datafusion:parquet 70895094 68753686 1.03
tpcds_q49/datafusion:parquet 56278982 55904305 1.01
tpcds_q50/datafusion:parquet 43366762 43211210 1.00
tpcds_q51/datafusion:parquet 91725905 88860296 1.03
tpcds_q52/datafusion:parquet 12820336 11885358 1.08
tpcds_q53/datafusion:parquet 18023490 18105987 1.00
tpcds_q54/datafusion:parquet 32876099 32736381 1.00
tpcds_q55/datafusion:parquet 12179056 12150720 1.00
tpcds_q56/datafusion:parquet 29216880 28055399 1.04
tpcds_q57/datafusion:parquet 99907047 96251251 1.04
tpcds_q58/datafusion:parquet 55429459 55463686 1.00
tpcds_q59/datafusion:parquet 63592740 61304502 1.04
tpcds_q60/datafusion:parquet 28693684 28909126 0.99
tpcds_q61/datafusion:parquet 43642818 42833297 1.02
tpcds_q62/datafusion:parquet 26493173 25900356 1.02
tpcds_q63/datafusion:parquet 18410554 17852109 1.03
tpcds_q64/datafusion:parquet 311956339 306576191 1.02
tpcds_q65/datafusion:parquet 37341525 37394643 1.00
tpcds_q66/datafusion:parquet 70611679 65378749 1.08
tpcds_q67/datafusion:parquet 150733653 138637930 1.09
tpcds_q68/datafusion:parquet 31842679 31132579 1.02
tpcds_q69/datafusion:parquet 71474322 66017576 1.08
tpcds_q70/datafusion:parquet 32723668 33271241 0.98
tpcds_q71/datafusion:parquet 23137122 23139216 1.00
tpcds_q72/datafusion:parquet 581574149 560444703 1.04
tpcds_q73/datafusion:parquet 21756383 19780765 1.10
tpcds_q74/datafusion:parquet 85638026 80925879 1.06
tpcds_q75/datafusion:parquet 105434934 104727861 1.01
tpcds_q76/datafusion:parquet 29953524 29210844 1.03
tpcds_q77/datafusion:parquet 38261593 37427918 1.02
tpcds_q78/datafusion:parquet 111838534 108956317 1.03
tpcds_q79/datafusion:parquet 26457520 26765967 0.99
tpcds_q80/datafusion:parquet 79822264 73110607 1.09
tpcds_q81/datafusion:parquet 29950389 28842782 1.04
tpcds_q82/datafusion:parquet 18910217 19737603 0.96
tpcds_q83/datafusion:parquet 41485064 41448627 1.00
tpcds_q84/datafusion:parquet 40526392 39335710 1.03
tpcds_q85/datafusion:parquet 148188868 142103837 1.04
tpcds_q86/datafusion:parquet 🚨 16514403 14307470 1.15
tpcds_q87/datafusion:parquet 45468998 44774344 1.02
tpcds_q88/datafusion:parquet 60011959 59611489 1.01
tpcds_q89/datafusion:parquet 22269071 22256567 1.00
tpcds_q90/datafusion:parquet 🚀 14438129 16227287 0.89
tpcds_q91/datafusion:parquet 58067322 58841672 0.99
tpcds_q92/datafusion:parquet 18171887 17396229 1.04
tpcds_q93/datafusion:parquet 30895998 29751747 1.04
tpcds_q94/datafusion:parquet 🚨 24226596 21230479 1.14
tpcds_q95/datafusion:parquet 60913806 57486015 1.06
tpcds_q96/datafusion:parquet 11658906 11702962 1.00
tpcds_q97/datafusion:parquet 29493367 29450294 1.00
tpcds_q98/datafusion:parquet 22625883 21148088 1.07
tpcds_q99/datafusion:parquet 27041012 26035918 1.04
duckdb / vortex-file-compressed (1.079x ➖, 0↑ 30↓)
name PR f212fb0 (ns) base ba700ca (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 24763267 24614122 1.01
tpcds_q02/duckdb:vortex-file-compressed 🚨 37364762 33199377 1.13
tpcds_q03/duckdb:vortex-file-compressed 16826388 15811142 1.06
tpcds_q04/duckdb:vortex-file-compressed 94293639 88142373 1.07
tpcds_q05/duckdb:vortex-file-compressed 37189029 34700770 1.07
tpcds_q06/duckdb:vortex-file-compressed 35037772 33440077 1.05
tpcds_q07/duckdb:vortex-file-compressed 25164021 25503064 0.99
tpcds_q08/duckdb:vortex-file-compressed 28922052 28585407 1.01
tpcds_q09/duckdb:vortex-file-compressed 17640645 17039296 1.04
tpcds_q10/duckdb:vortex-file-compressed 40843335 38884142 1.05
tpcds_q11/duckdb:vortex-file-compressed 68662633 65489440 1.05
tpcds_q12/duckdb:vortex-file-compressed 16910850 15636901 1.08
tpcds_q13/duckdb:vortex-file-compressed 34034742 32401119 1.05
tpcds_q14/duckdb:vortex-file-compressed 99896242 102200479 0.98
tpcds_q15/duckdb:vortex-file-compressed 28049755 27541899 1.02
tpcds_q16/duckdb:vortex-file-compressed 26530045 25879212 1.03
tpcds_q17/duckdb:vortex-file-compressed 50876285 47884272 1.06
tpcds_q18/duckdb:vortex-file-compressed 🚨 44832632 38970711 1.15
tpcds_q19/duckdb:vortex-file-compressed 🚨 36820397 31743504 1.16
tpcds_q20/duckdb:vortex-file-compressed 🚨 18080395 16412364 1.10
tpcds_q21/duckdb:vortex-file-compressed 18036897 16415504 1.10
tpcds_q22/duckdb:vortex-file-compressed 🚨 88231633 75353112 1.17
tpcds_q23/duckdb:vortex-file-compressed 104343037 94976117 1.10
tpcds_q24/duckdb:vortex-file-compressed 🚨 58842141 48565471 1.21
tpcds_q25/duckdb:vortex-file-compressed 🚨 45437449 39377540 1.15
tpcds_q26/duckdb:vortex-file-compressed 🚨 22460191 20063772 1.12
tpcds_q27/duckdb:vortex-file-compressed 27710061 25793671 1.07
tpcds_q28/duckdb:vortex-file-compressed 🚨 14196595 11826489 1.20
tpcds_q29/duckdb:vortex-file-compressed 🚨 49416316 43860361 1.13
tpcds_q30/duckdb:vortex-file-compressed 🚨 27408578 24916232 1.10
tpcds_q31/duckdb:vortex-file-compressed 30833007 30605568 1.01
tpcds_q32/duckdb:vortex-file-compressed 🚨 15484620 13049831 1.19
tpcds_q33/duckdb:vortex-file-compressed 🚨 27715946 23985726 1.16
tpcds_q34/duckdb:vortex-file-compressed 🚨 28320656 25712447 1.10
tpcds_q35/duckdb:vortex-file-compressed 67054599 64390965 1.04
tpcds_q36/duckdb:vortex-file-compressed 26444043 24292369 1.09
tpcds_q37/duckdb:vortex-file-compressed 20805493 19342311 1.08
tpcds_q38/duckdb:vortex-file-compressed 41533499 39671893 1.05
tpcds_q39/duckdb:vortex-file-compressed 37744044 35824145 1.05
tpcds_q40/duckdb:vortex-file-compressed 🚨 22548282 20181925 1.12
tpcds_q41/duckdb:vortex-file-compressed 13595698 12379573 1.10
tpcds_q42/duckdb:vortex-file-compressed 14302207 13708501 1.04
tpcds_q43/duckdb:vortex-file-compressed 🚨 23584052 20992211 1.12
tpcds_q44/duckdb:vortex-file-compressed 22715696 21283488 1.07
tpcds_q45/duckdb:vortex-file-compressed 🚨 34467162 30135313 1.14
tpcds_q46/duckdb:vortex-file-compressed 🚨 37083137 32339263 1.15
tpcds_q47/duckdb:vortex-file-compressed 🚨 56192944 50409327 1.11
tpcds_q48/duckdb:vortex-file-compressed 30675040 28774344 1.07
tpcds_q49/duckdb:vortex-file-compressed 🚨 44043472 38243378 1.15
tpcds_q50/duckdb:vortex-file-compressed 28432069 27211840 1.04
tpcds_q51/duckdb:vortex-file-compressed 110071455 109661450 1.00
tpcds_q52/duckdb:vortex-file-compressed 14105635 13331718 1.06
tpcds_q53/duckdb:vortex-file-compressed 24646576 23327444 1.06
tpcds_q54/duckdb:vortex-file-compressed 31205460 28935452 1.08
tpcds_q55/duckdb:vortex-file-compressed 🚨 13885953 12266737 1.13
tpcds_q56/duckdb:vortex-file-compressed 🚨 28394002 25248403 1.12
tpcds_q57/duckdb:vortex-file-compressed 44063918 41290091 1.07
tpcds_q58/duckdb:vortex-file-compressed 32259154 29896625 1.08
tpcds_q59/duckdb:vortex-file-compressed 58164970 55237412 1.05
tpcds_q60/duckdb:vortex-file-compressed 27539397 26109199 1.05
tpcds_q61/duckdb:vortex-file-compressed 32501809 30928340 1.05
tpcds_q62/duckdb:vortex-file-compressed 🚨 17849254 15937312 1.12
tpcds_q63/duckdb:vortex-file-compressed 22769482 21000088 1.08
tpcds_q64/duckdb:vortex-file-compressed 100819847 94698946 1.06
tpcds_q65/duckdb:vortex-file-compressed 23635757 22674972 1.04
tpcds_q66/duckdb:vortex-file-compressed 30269582 30872163 0.98
tpcds_q67/duckdb:vortex-file-compressed 144600196 138103679 1.05
tpcds_q68/duckdb:vortex-file-compressed 31374637 31257632 1.00
tpcds_q69/duckdb:vortex-file-compressed 🚨 43872705 39788962 1.10
tpcds_q70/duckdb:vortex-file-compressed 38703283 37102133 1.04
tpcds_q71/duckdb:vortex-file-compressed 22386787 20945132 1.07
tpcds_q72/duckdb:vortex-file-compressed 183901775 180100238 1.02
tpcds_q73/duckdb:vortex-file-compressed 🚨 27656414 25100507 1.10
tpcds_q74/duckdb:vortex-file-compressed 44375949 41277511 1.08
tpcds_q75/duckdb:vortex-file-compressed 54027598 51018839 1.06
tpcds_q76/duckdb:vortex-file-compressed 🚨 21887129 18693768 1.17
tpcds_q77/duckdb:vortex-file-compressed 26329894 24792990 1.06
tpcds_q78/duckdb:vortex-file-compressed 81319919 81184010 1.00
tpcds_q79/duckdb:vortex-file-compressed 26977452 24718808 1.09
tpcds_q80/duckdb:vortex-file-compressed 52525388 48543255 1.08
tpcds_q81/duckdb:vortex-file-compressed 32258281 29616563 1.09
tpcds_q82/duckdb:vortex-file-compressed 47189716 45974076 1.03
tpcds_q83/duckdb:vortex-file-compressed 33232858 30839576 1.08
tpcds_q84/duckdb:vortex-file-compressed 18472222 16881727 1.09
tpcds_q85/duckdb:vortex-file-compressed 48195123 44445259 1.08
tpcds_q86/duckdb:vortex-file-compressed 17788526 17072190 1.04
tpcds_q87/duckdb:vortex-file-compressed 44296367 40994367 1.08
tpcds_q88/duckdb:vortex-file-compressed 55277790 53224652 1.04
tpcds_q89/duckdb:vortex-file-compressed 23507288 21912535 1.07
tpcds_q90/duckdb:vortex-file-compressed 🚨 12341379 11045686 1.12
tpcds_q91/duckdb:vortex-file-compressed 🚨 26934620 24265835 1.11
tpcds_q92/duckdb:vortex-file-compressed 19899845 18245541 1.09
tpcds_q93/duckdb:vortex-file-compressed 32709837 30565495 1.07
tpcds_q94/duckdb:vortex-file-compressed 🚨 24903959 21917932 1.14
tpcds_q95/duckdb:vortex-file-compressed 162746851 156042644 1.04
tpcds_q96/duckdb:vortex-file-compressed 🚨 13972499 11902483 1.17
tpcds_q97/duckdb:vortex-file-compressed 40919648 37965290 1.08
tpcds_q98/duckdb:vortex-file-compressed 20597968 19676374 1.05
tpcds_q99/duckdb:vortex-file-compressed 23797106 21842127 1.09
duckdb / vortex-compact (1.062x ➖, 0↑ 17↓)
name PR f212fb0 (ns) base ba700ca (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-compact 27212354 25937194 1.05
tpcds_q02/duckdb:vortex-compact 37114287 37976390 0.98
tpcds_q03/duckdb:vortex-compact 47141659 44941155 1.05
tpcds_q04/duckdb:vortex-compact 🚨 112814511 101515111 1.11
tpcds_q05/duckdb:vortex-compact 🚨 44999360 39376036 1.14
tpcds_q06/duckdb:vortex-compact 41504940 39775015 1.04
tpcds_q07/duckdb:vortex-compact 43310687 41866452 1.03
tpcds_q08/duckdb:vortex-compact 43069420 42968192 1.00
tpcds_q09/duckdb:vortex-compact 21358716 21177579 1.01
tpcds_q10/duckdb:vortex-compact 56179413 52058403 1.08
tpcds_q11/duckdb:vortex-compact 78704268 74032332 1.06
tpcds_q12/duckdb:vortex-compact 23865291 22283029 1.07
tpcds_q13/duckdb:vortex-compact 53883471 53667455 1.00
tpcds_q14/duckdb:vortex-compact 123220942 117771690 1.05
tpcds_q15/duckdb:vortex-compact 31966951 29881271 1.07
tpcds_q16/duckdb:vortex-compact 30105654 27668335 1.09
tpcds_q17/duckdb:vortex-compact 64143797 58701755 1.09
tpcds_q18/duckdb:vortex-compact 🚨 56112854 49629061 1.13
tpcds_q19/duckdb:vortex-compact 46559910 44577418 1.04
tpcds_q20/duckdb:vortex-compact 🚨 23364538 20840026 1.12
tpcds_q21/duckdb:vortex-compact 🚨 20260749 17823851 1.14
tpcds_q22/duckdb:vortex-compact 87857765 80482483 1.09
tpcds_q23/duckdb:vortex-compact 🚨 120308097 108795911 1.11
tpcds_q24/duckdb:vortex-compact 60996982 58971255 1.03
tpcds_q25/duckdb:vortex-compact 🚨 57994454 52172180 1.11
tpcds_q26/duckdb:vortex-compact 33796180 32572390 1.04
tpcds_q27/duckdb:vortex-compact 44472157 43581049 1.02
tpcds_q28/duckdb:vortex-compact 34829847 33911995 1.03
tpcds_q29/duckdb:vortex-compact 61335177 56484431 1.09
tpcds_q30/duckdb:vortex-compact 33127800 31915813 1.04
tpcds_q31/duckdb:vortex-compact 36135567 36799307 0.98
tpcds_q32/duckdb:vortex-compact 🚨 23646676 20453035 1.16
tpcds_q33/duckdb:vortex-compact 35406457 33305235 1.06
tpcds_q34/duckdb:vortex-compact 31477785 30713075 1.02
tpcds_q35/duckdb:vortex-compact 81990937 76083628 1.08
tpcds_q36/duckdb:vortex-compact 37306860 38008970 0.98
tpcds_q37/duckdb:vortex-compact 🚨 25759639 23257428 1.11
tpcds_q38/duckdb:vortex-compact 43246359 41629905 1.04
tpcds_q39/duckdb:vortex-compact 40155397 38953587 1.03
tpcds_q40/duckdb:vortex-compact 26528503 24346942 1.09
tpcds_q41/duckdb:vortex-compact 15311969 14020290 1.09
tpcds_q42/duckdb:vortex-compact 21067963 20169840 1.04
tpcds_q43/duckdb:vortex-compact 32066165 30404866 1.05
tpcds_q44/duckdb:vortex-compact 30731747 28615208 1.07
tpcds_q45/duckdb:vortex-compact 39957284 36538098 1.09
tpcds_q46/duckdb:vortex-compact 46468938 47802187 0.97
tpcds_q47/duckdb:vortex-compact 🚨 68421789 61901761 1.11
tpcds_q48/duckdb:vortex-compact 47656740 46750340 1.02
tpcds_q49/duckdb:vortex-compact 51993692 48774612 1.07
tpcds_q50/duckdb:vortex-compact 39372714 37386979 1.05
tpcds_q51/duckdb:vortex-compact 114383531 115944074 0.99
tpcds_q52/duckdb:vortex-compact 20715203 19291315 1.07
tpcds_q53/duckdb:vortex-compact 35213692 33163304 1.06
tpcds_q54/duckdb:vortex-compact 39114409 38300748 1.02
tpcds_q55/duckdb:vortex-compact 🚨 21328517 19381288 1.10
tpcds_q56/duckdb:vortex-compact 36200930 33897486 1.07
tpcds_q57/duckdb:vortex-compact 47321371 45416240 1.04
tpcds_q58/duckdb:vortex-compact 39525083 40295841 0.98
tpcds_q59/duckdb:vortex-compact 69061473 67166050 1.03
tpcds_q60/duckdb:vortex-compact 🚨 39434359 35161913 1.12
tpcds_q61/duckdb:vortex-compact 58823222 53726969 1.09
tpcds_q62/duckdb:vortex-compact 23000486 21572055 1.07
tpcds_q63/duckdb:vortex-compact 34732018 32126271 1.08
tpcds_q64/duckdb:vortex-compact 139199707 129640647 1.07
tpcds_q65/duckdb:vortex-compact 31909435 30737302 1.04
tpcds_q66/duckdb:vortex-compact 40421941 37038722 1.09
tpcds_q67/duckdb:vortex-compact 161461459 153514600 1.05
tpcds_q68/duckdb:vortex-compact 48418276 46293469 1.05
tpcds_q69/duckdb:vortex-compact 59204513 54711839 1.08
tpcds_q70/duckdb:vortex-compact 61274245 58630603 1.05
tpcds_q71/duckdb:vortex-compact 32382444 31279912 1.04
tpcds_q72/duckdb:vortex-compact 200204397 189994524 1.05
tpcds_q73/duckdb:vortex-compact 29771218 28773502 1.03
tpcds_q74/duckdb:vortex-compact 53328546 49084764 1.09
tpcds_q75/duckdb:vortex-compact 64209626 61662092 1.04
tpcds_q76/duckdb:vortex-compact 30467807 29648185 1.03
tpcds_q77/duckdb:vortex-compact 41190729 38521161 1.07
tpcds_q78/duckdb:vortex-compact 94693919 88228447 1.07
tpcds_q79/duckdb:vortex-compact 43618856 39980287 1.09
tpcds_q80/duckdb:vortex-compact 72847448 69041533 1.06
tpcds_q81/duckdb:vortex-compact 36914564 34908427 1.06
tpcds_q82/duckdb:vortex-compact 52692757 50851165 1.04
tpcds_q83/duckdb:vortex-compact 🚨 40393147 36708772 1.10
tpcds_q84/duckdb:vortex-compact 23298167 21916280 1.06
tpcds_q85/duckdb:vortex-compact 61275702 57334815 1.07
tpcds_q86/duckdb:vortex-compact 22220502 21663372 1.03
tpcds_q87/duckdb:vortex-compact 45635088 46174650 0.99
tpcds_q88/duckdb:vortex-compact 82124084 79520175 1.03
tpcds_q89/duckdb:vortex-compact 35200371 33269720 1.06
tpcds_q90/duckdb:vortex-compact 🚨 13184061 11214378 1.18
tpcds_q91/duckdb:vortex-compact 🚨 46215272 40165078 1.15
tpcds_q92/duckdb:vortex-compact 🚨 48281276 41400808 1.17
tpcds_q93/duckdb:vortex-compact 35203852 32768387 1.07
tpcds_q94/duckdb:vortex-compact 🚨 30069017 26416883 1.14
tpcds_q95/duckdb:vortex-compact 171010834 159213548 1.07
tpcds_q96/duckdb:vortex-compact 17137134 16013894 1.07
tpcds_q97/duckdb:vortex-compact 44090123 43279973 1.02
tpcds_q98/duckdb:vortex-compact 28527737 27706509 1.03
tpcds_q99/duckdb:vortex-compact 27521410 25538895 1.08
duckdb / parquet (1.034x ➖, 0↑ 8↓)
name PR f212fb0 (ns) base ba700ca (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 31643067 32574760 0.97
tpcds_q02/duckdb:parquet 24433183 23911651 1.02
tpcds_q03/duckdb:parquet 13172385 12692412 1.04
tpcds_q04/duckdb:parquet 171381536 169375167 1.01
tpcds_q05/duckdb:parquet 30415142 33146080 0.92
tpcds_q06/duckdb:parquet 34322389 33928520 1.01
tpcds_q07/duckdb:parquet 24464072 24260384 1.01
tpcds_q08/duckdb:parquet 30170103 29029831 1.04
tpcds_q09/duckdb:parquet 45211652 44686013 1.01
tpcds_q10/duckdb:parquet 39964886 37107121 1.08
tpcds_q11/duckdb:parquet 94035407 93629723 1.00
tpcds_q12/duckdb:parquet 17563714 17342469 1.01
tpcds_q13/duckdb:parquet 35618766 34952128 1.02
tpcds_q14/duckdb:parquet 104311406 102071024 1.02
tpcds_q15/duckdb:parquet 31451148 30697087 1.02
tpcds_q16/duckdb:parquet 22472773 22305500 1.01
tpcds_q17/duckdb:parquet 41918670 38493169 1.09
tpcds_q18/duckdb:parquet 49940788 47882537 1.04
tpcds_q19/duckdb:parquet 32760207 32006917 1.02
tpcds_q20/duckdb:parquet 19142375 18302672 1.05
tpcds_q21/duckdb:parquet 11697751 12896475 0.91
tpcds_q22/duckdb:parquet 68741269 68493605 1.00
tpcds_q23/duckdb:parquet 82878204 83073035 1.00
tpcds_q24/duckdb:parquet 48450760 46649725 1.04
tpcds_q25/duckdb:parquet 38625285 35420570 1.09
tpcds_q26/duckdb:parquet 40643566 39505782 1.03
tpcds_q27/duckdb:parquet 54999435 53875809 1.02
tpcds_q28/duckdb:parquet 42744928 42100472 1.02
tpcds_q29/duckdb:parquet 38053086 36724406 1.04
tpcds_q30/duckdb:parquet 39133830 37506931 1.04
tpcds_q31/duckdb:parquet 29045758 28126875 1.03
tpcds_q32/duckdb:parquet 13262347 13273101 1.00
tpcds_q33/duckdb:parquet 24319434 23271264 1.05
tpcds_q34/duckdb:parquet 23822400 22015014 1.08
tpcds_q35/duckdb:parquet 63605138 61702792 1.03
tpcds_q36/duckdb:parquet 23298217 22655559 1.03
tpcds_q37/duckdb:parquet 🚨 15990426 13637547 1.17
tpcds_q38/duckdb:parquet 🚨 41571604 36566783 1.14
tpcds_q39/duckdb:parquet 34280462 32461946 1.06
tpcds_q40/duckdb:parquet 🚨 21279973 19344026 1.10
tpcds_q41/duckdb:parquet 9365797 8794493 1.06
tpcds_q42/duckdb:parquet 12540863 12585407 1.00
tpcds_q43/duckdb:parquet 🚨 19827817 17985821 1.10
tpcds_q44/duckdb:parquet 27218171 26256019 1.04
tpcds_q45/duckdb:parquet 30202847 29320349 1.03
tpcds_q46/duckdb:parquet 50222612 48039596 1.05
tpcds_q47/duckdb:parquet 53148632 49106188 1.08
tpcds_q48/duckdb:parquet 33135520 32020158 1.03
tpcds_q49/duckdb:parquet 29483562 28407912 1.04
tpcds_q50/duckdb:parquet 26855991 26055062 1.03
tpcds_q51/duckdb:parquet 🚨 112793674 100953109 1.12
tpcds_q52/duckdb:parquet 13070786 12759671 1.02
tpcds_q53/duckdb:parquet 19553337 19880880 0.98
tpcds_q54/duckdb:parquet 🚨 30869649 28057170 1.10
tpcds_q55/duckdb:parquet 13857424 12759881 1.09
tpcds_q56/duckdb:parquet 25411951 23836966 1.07
tpcds_q57/duckdb:parquet 39539765 37939912 1.04
tpcds_q58/duckdb:parquet 27982634 27019646 1.04
tpcds_q59/duckdb:parquet 36844240 35867731 1.03
tpcds_q60/duckdb:parquet 25783814 25546065 1.01
tpcds_q61/duckdb:parquet 34251183 33729275 1.02
tpcds_q62/duckdb:parquet 13190954 12611738 1.05
tpcds_q63/duckdb:parquet 17786044 17354086 1.02
tpcds_q64/duckdb:parquet 82063147 77349566 1.06
tpcds_q65/duckdb:parquet 23209571 23077183 1.01
tpcds_q66/duckdb:parquet 30672841 30229259 1.01
tpcds_q67/duckdb:parquet 142875190 137617015 1.04
tpcds_q68/duckdb:parquet 39621103 39405831 1.01
tpcds_q69/duckdb:parquet 39762122 38935352 1.02
tpcds_q70/duckdb:parquet 22387110 22189470 1.01
tpcds_q71/duckdb:parquet 23964882 22638398 1.06
tpcds_q72/duckdb:parquet 169209523 167159168 1.01
tpcds_q73/duckdb:parquet 🚨 21551210 18923680 1.14
tpcds_q74/duckdb:parquet 136087571 127225322 1.07
tpcds_q75/duckdb:parquet 59771255 58179190 1.03
tpcds_q76/duckdb:parquet 22665523 22491907 1.01
tpcds_q77/duckdb:parquet 26569435 25723449 1.03
tpcds_q78/duckdb:parquet 83534655 80776731 1.03
tpcds_q79/duckdb:parquet 30333143 30543095 0.99
tpcds_q80/duckdb:parquet 46399222 43318503 1.07
tpcds_q81/duckdb:parquet 37025553 35460519 1.04
tpcds_q82/duckdb:parquet 🚨 18199846 16166397 1.13
tpcds_q83/duckdb:parquet 19488901 18662211 1.04
tpcds_q84/duckdb:parquet 21785023 21248894 1.03
tpcds_q85/duckdb:parquet 43522459 42832436 1.02
tpcds_q86/duckdb:parquet 14338895 14347449 1.00
tpcds_q87/duckdb:parquet 40327491 39137031 1.03
tpcds_q88/duckdb:parquet 54106144 53892970 1.00
tpcds_q89/duckdb:parquet 21426877 22168989 0.97
tpcds_q90/duckdb:parquet 8823345 8373358 1.05
tpcds_q91/duckdb:parquet 26162852 25578650 1.02
tpcds_q92/duckdb:parquet 13951540 13448386 1.04
tpcds_q93/duckdb:parquet 33591816 32098508 1.05
tpcds_q94/duckdb:parquet 18965751 18255562 1.04
tpcds_q95/duckdb:parquet 155345867 145412061 1.07
tpcds_q96/duckdb:parquet 10778939 10866119 0.99
tpcds_q97/duckdb:parquet 38310789 37768787 1.01
tpcds_q98/duckdb:parquet 25849649 25431949 1.02
tpcds_q99/duckdb:parquet 20551890 20207524 1.02
duckdb / duckdb (1.061x ➖, 0↑ 15↓)
name PR f212fb0 (ns) base ba700ca (ns) ratio (PR/base)
tpcds_q01/duckdb:duckdb 22933824 22326901 1.03
tpcds_q02/duckdb:duckdb 🚨 20943475 18934636 1.11
tpcds_q03/duckdb:duckdb 11101056 10275901 1.08
tpcds_q04/duckdb:duckdb 187642385 180108074 1.04
tpcds_q05/duckdb:duckdb 21825257 20820425 1.05
tpcds_q06/duckdb:duckdb 29199334 28264695 1.03
tpcds_q07/duckdb:duckdb 43247387 39916346 1.08
tpcds_q08/duckdb:duckdb 122879816 120312365 1.02
tpcds_q09/duckdb:duckdb 21062807 20883768 1.01
tpcds_q10/duckdb:duckdb 29003790 28596661 1.01
tpcds_q11/duckdb:duckdb 103620210 97390519 1.06
tpcds_q12/duckdb:duckdb 14667135 13931698 1.05
tpcds_q13/duckdb:duckdb 27844307 26928904 1.03
tpcds_q14/duckdb:duckdb 95853111 92396645 1.04
tpcds_q15/duckdb:duckdb 🚨 27309614 24802404 1.10
tpcds_q16/duckdb:duckdb 20761984 20562170 1.01
tpcds_q17/duckdb:duckdb 26857756 25301611 1.06
tpcds_q18/duckdb:duckdb 50341046 46505203 1.08
tpcds_q19/duckdb:duckdb 20807289 19275516 1.08
tpcds_q20/duckdb:duckdb 15269837 14407093 1.06
tpcds_q21/duckdb:duckdb 7963960 7318430 1.09
tpcds_q22/duckdb:duckdb 64084815 61285732 1.05
tpcds_q23/duckdb:duckdb 80723417 80347814 1.00
tpcds_q24/duckdb:duckdb 29672596 28170485 1.05
tpcds_q25/duckdb:duckdb 19403218 18754522 1.03
tpcds_q26/duckdb:duckdb 30141539 28472914 1.06
tpcds_q27/duckdb:duckdb 44475887 40844220 1.09
tpcds_q28/duckdb:duckdb 25235373 26189503 0.96
tpcds_q29/duckdb:duckdb 24527944 24101602 1.02
tpcds_q30/duckdb:duckdb 35581617 32951755 1.08
tpcds_q31/duckdb:duckdb 55982960 52794165 1.06
tpcds_q32/duckdb:duckdb 🚨 9527028 8013361 1.19
tpcds_q33/duckdb:duckdb 17561371 16369594 1.07
tpcds_q34/duckdb:duckdb 22747454 21369799 1.06
tpcds_q35/duckdb:duckdb 38353612 36826349 1.04
tpcds_q36/duckdb:duckdb 🚨 79836745 71481968 1.12
tpcds_q37/duckdb:duckdb 9527373 8889001 1.07
tpcds_q38/duckdb:duckdb 39408163 38542065 1.02
tpcds_q39/duckdb:duckdb 29817520 27562465 1.08
tpcds_q40/duckdb:duckdb 🚨 16629400 14626592 1.14
tpcds_q41/duckdb:duckdb 🚨 10403980 9442370 1.10
tpcds_q42/duckdb:duckdb 🚨 10848978 9808385 1.11
tpcds_q43/duckdb:duckdb 16266346 14927053 1.09
tpcds_q44/duckdb:duckdb 16106869 14792946 1.09
tpcds_q45/duckdb:duckdb 21084982 19212952 1.10
tpcds_q46/duckdb:duckdb 45280853 41661258 1.09
tpcds_q47/duckdb:duckdb 49241574 46204687 1.07
tpcds_q48/duckdb:duckdb 26419556 24914078 1.06
tpcds_q49/duckdb:duckdb 22441239 21049418 1.07
tpcds_q50/duckdb:duckdb 17074824 16104597 1.06
tpcds_q51/duckdb:duckdb 103459133 99855384 1.04
tpcds_q52/duckdb:duckdb 9952750 10510073 0.95
tpcds_q53/duckdb:duckdb 🚨 18984697 17226654 1.10
tpcds_q54/duckdb:duckdb 🚨 20660252 18745338 1.10
tpcds_q55/duckdb:duckdb 9987292 10248928 0.97
tpcds_q56/duckdb:duckdb 17591292 16427033 1.07
tpcds_q57/duckdb:duckdb 38619973 36497746 1.06
tpcds_q58/duckdb:duckdb 16917384 16808263 1.01
tpcds_q59/duckdb:duckdb 37747335 36747045 1.03
tpcds_q60/duckdb:duckdb 19541390 19033078 1.03
tpcds_q61/duckdb:duckdb 17075833 16407813 1.04
tpcds_q62/duckdb:duckdb 🚨 10717102 9712671 1.10
tpcds_q63/duckdb:duckdb 17229345 16195276 1.06
tpcds_q64/duckdb:duckdb 59665166 58022387 1.03
tpcds_q65/duckdb:duckdb 38194901 36325251 1.05
tpcds_q66/duckdb:duckdb 27547654 26519464 1.04
tpcds_q67/duckdb:duckdb 139190574 133788841 1.04
tpcds_q68/duckdb:duckdb 31174733 29570975 1.05
tpcds_q69/duckdb:duckdb 29748419 27578906 1.08
tpcds_q70/duckdb:duckdb 17746429 16379841 1.08
tpcds_q71/duckdb:duckdb 17347960 16869478 1.03
tpcds_q72/duckdb:duckdb 47662307 45998497 1.04
tpcds_q73/duckdb:duckdb 15207682 14287357 1.06
tpcds_q74/duckdb:duckdb 152125986 149465627 1.02
tpcds_q75/duckdb:duckdb 48682401 45544753 1.07
tpcds_q76/duckdb:duckdb 15183776 14603165 1.04
tpcds_q77/duckdb:duckdb 16126095 15513215 1.04
tpcds_q78/duckdb:duckdb 69899420 64907925 1.08
tpcds_q79/duckdb:duckdb 24002085 22824334 1.05
tpcds_q80/duckdb:duckdb 35363236 33060837 1.07
tpcds_q81/duckdb:duckdb 46070863 42324318 1.09
tpcds_q82/duckdb:duckdb 🚨 11043282 9740035 1.13
tpcds_q83/duckdb:duckdb 11886023 10892561 1.09
tpcds_q84/duckdb:duckdb 18760519 17438914 1.08
tpcds_q85/duckdb:duckdb 28027071 25663681 1.09
tpcds_q86/duckdb:duckdb 12817159 12032949 1.07
tpcds_q87/duckdb:duckdb 39847404 38188440 1.04
tpcds_q88/duckdb:duckdb 30245855 30726700 0.98
tpcds_q89/duckdb:duckdb 22652966 21992658 1.03
tpcds_q90/duckdb:duckdb 🚨 6944608 6167477 1.13
tpcds_q91/duckdb:duckdb 15390364 15263412 1.01
tpcds_q92/duckdb:duckdb 🚨 11168441 9913576 1.13
tpcds_q93/duckdb:duckdb 24772134 23378670 1.06
tpcds_q94/duckdb:duckdb 🚨 15920885 14151746 1.13
tpcds_q95/duckdb:duckdb 🚨 138816838 109546647 1.27
tpcds_q96/duckdb:duckdb 6093170 6005288 1.01
tpcds_q97/duckdb:duckdb 33717240 31616031 1.07
tpcds_q98/duckdb:duckdb 20591567 20116286 1.02
tpcds_q99/duckdb:duckdb 17962598 16678702 1.08
File Size Changes (6 files changed, +0.0% overall, 5↑ 1↓)
File Scale Format Base HEAD Change %
customer.vortex 1.0 vortex-file-compressed 4.18 MB 4.27 MB +94.20 KB +2.2%
item.vortex 1.0 vortex-file-compressed 1.63 MB 1.64 MB +4.71 KB +0.3%
catalog_page.vortex 1.0 vortex-file-compressed 565.11 KB 566.05 KB +960 B +0.2%
customer_address.vortex 1.0 vortex-file-compressed 826.72 KB 827.68 KB +984 B +0.1%
item.vortex 1.0 vortex-compact 993.65 KB 993.72 KB +72 B +0.0%
time_dim.vortex 1.0 vortex-file-compressed 437.35 KB 375.73 KB 61.62 KB -14.1%

Totals:

  • vortex-compact: 207.47 MB → 207.47 MB (+0.0%)
  • vortex-file-compressed: 269.96 MB → 270.00 MB (+0.0%)

@codspeed-hq

codspeed-hq Bot commented Jun 22, 2026 •
edited
Loading

Copy link
Copy Markdown

Merging this PR will not alter performance

⚠️ Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.

For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

⚡ 3 improved benchmarks
❌ 1 regressed benchmark
✅ 1579 untouched benchmarks

Warning

Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
❌ Simulation chunked_bool_canonical_into[(1000, 10)] 16.1 µs 26.8 µs -39.91%
⚡ Simulation bitwise_not_vortex_buffer_mut[128] 273.6 ns 215.3 ns +27.1%
⚡ Simulation bitwise_not_vortex_buffer_mut[1024] 333.9 ns 275.6 ns +21.17%
⚡ Simulation bitwise_not_vortex_buffer_mut[2048] 427.8 ns 369.4 ns +15.79%

Tip

Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.

Comparing myrrc/rle-duckdb (f212fb0) with develop (f9ab66b)

Open in CodSpeed

@github-actions

github-actions Bot commented Jun 22, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +13.0%
Engines: DataFusion No clear signal (+37.0%, environment too noisy confidence) · DuckDB No clear signal (-6.7%, low confidence)
Vortex (geomean): 0.886x ➖
Parquet (geomean): 0.784x ➖
Shifts: Parquet (control) -21.6% · Median polish -9.4%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.828x ➖, 2↑ 0↓)
name PR f212fb0 (ns) base ba700ca (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 61288929 73804794 0.83
fineweb_q01/datafusion:vortex-file-compressed 1003348800 1193477080 0.84
fineweb_q02/datafusion:vortex-file-compressed 1032006043 1405158610 0.73
fineweb_q03/datafusion:vortex-file-compressed 🚀 1336291477 1979236479 0.68
fineweb_q04/datafusion:vortex-file-compressed 1188281279 1176634762 1.01
fineweb_q05/datafusion:vortex-file-compressed 1163741146 1088521281 1.07
fineweb_q06/datafusion:vortex-file-compressed 1730437812 2092204908 0.83
fineweb_q07/datafusion:vortex-file-compressed 1281978806 1140773938 1.12
fineweb_q08/datafusion:vortex-file-compressed 🚀 484843720 924789639 0.52
datafusion / vortex-compact (0.944x ➖, 0↑ 1↓)
name PR f212fb0 (ns) base ba700ca (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 34948499 42908055 0.81
fineweb_q01/datafusion:vortex-compact 🚨 1177913249 873554803 1.35
fineweb_q02/datafusion:vortex-compact 1170239958 1196147189 0.98
fineweb_q03/datafusion:vortex-compact 1492052997 1763440825 0.85
fineweb_q04/datafusion:vortex-compact 1730658021 1664096049 1.04
fineweb_q05/datafusion:vortex-compact 1411783835 1416896637 1.00
fineweb_q06/datafusion:vortex-compact 1547084701 1685190372 0.92
fineweb_q07/datafusion:vortex-compact 1441760737 1518668270 0.95
fineweb_q08/datafusion:vortex-compact 442077464 612571380 0.72
datafusion / parquet (0.645x ✅, 6↑ 0↓)
name PR f212fb0 (ns) base ba700ca (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 1545548807 1832711548 0.84
fineweb_q01/datafusion:parquet 🚀 2060987761 3491222581 0.59
fineweb_q02/datafusion:parquet 2625753508 3506820275 0.75
fineweb_q03/datafusion:parquet 2475858470 3424402205 0.72
fineweb_q04/datafusion:parquet 🚀 2224893773 3596112963 0.62
fineweb_q05/datafusion:parquet 🚀 2231192084 4356319549 0.51
fineweb_q06/datafusion:parquet 🚀 2196874757 3842004883 0.57
fineweb_q07/datafusion:parquet 🚀 2451549646 3852763145 0.64
fineweb_q08/datafusion:parquet 🚀 2717346960 4357606131 0.62
duckdb / vortex-file-compressed (0.870x ➖, 1↑ 1↓)
name PR f212fb0 (ns) base ba700ca (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 🚀 87323119 234512048 0.37
fineweb_q01/duckdb:vortex-file-compressed 776407916 760996306 1.02
fineweb_q02/duckdb:vortex-file-compressed 🚨 918820677 652914186 1.41
fineweb_q03/duckdb:vortex-file-compressed 1355874084 1638070538 0.83
fineweb_q04/duckdb:vortex-file-compressed 1612015999 1750149978 0.92
fineweb_q05/duckdb:vortex-file-compressed 1529613375 1874655828 0.82
fineweb_q06/duckdb:vortex-file-compressed 1648910106 1921966842 0.86
fineweb_q07/duckdb:vortex-file-compressed 1520891908 1925169382 0.79
fineweb_q08/duckdb:vortex-file-compressed 831412790 656819520 1.27
duckdb / vortex-compact (0.908x ➖, 0↑ 0↓)
name PR f212fb0 (ns) base ba700ca (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 80726420 107543435 0.75
fineweb_q01/duckdb:vortex-compact 701944692 932395556 0.75
fineweb_q02/duckdb:vortex-compact 816577006 748257848 1.09
fineweb_q03/duckdb:vortex-compact 1739616024 1737168181 1.00
fineweb_q04/duckdb:vortex-compact 1952384670 2059846553 0.95
fineweb_q05/duckdb:vortex-compact 1634613516 2003187481 0.82
fineweb_q06/duckdb:vortex-compact 1623963514 1796480464 0.90
fineweb_q07/duckdb:vortex-compact 1607995238 1552288394 1.04
fineweb_q08/duckdb:vortex-compact 659634458 702081479 0.94
duckdb / parquet (0.953x ➖, 0↑ 0↓)
name PR f212fb0 (ns) base ba700ca (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1442628174 1360242720 1.06
fineweb_q01/duckdb:parquet 1703391214 1748666307 0.97
fineweb_q02/duckdb:parquet 1590004319 1654679724 0.96
fineweb_q03/duckdb:parquet 4233378984 4603707537 0.92
fineweb_q04/duckdb:parquet 2343170006 2474554758 0.95
fineweb_q05/duckdb:parquet 2592953760 2798727434 0.93
fineweb_q06/duckdb:parquet 5263052530 5739857571 0.92
fineweb_q07/duckdb:parquet 3088795524 3325999805 0.93
fineweb_q08/duckdb:parquet 1263456556 1333685270 0.95

@github-actions

github-actions Bot commented Jun 22, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: Statistical and Population Genetics

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.8%
Engines: DuckDB No clear signal (-0.8%, low confidence)
Vortex (geomean): 0.967x ➖
Parquet (geomean): 0.976x ➖
Shifts: Parquet (control) -2.4% · Median polish -2.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
duckdb / vortex-file-compressed (0.954x ➖, 0↑ 0↓)
name PR f212fb0 (ns) base ba700ca (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 12228552 12887948 0.95
statpopgen_q01/duckdb:vortex-file-compressed 26248964 28488796 0.92
statpopgen_q02/duckdb:vortex-file-compressed 514657966 549290750 0.94
statpopgen_q03/duckdb:vortex-file-compressed 1020732455 1066997704 0.96
statpopgen_q04/duckdb:vortex-file-compressed 1031792299 1071984414 0.96
statpopgen_q05/duckdb:vortex-file-compressed 458499493 497731829 0.92
statpopgen_q06/duckdb:vortex-file-compressed 1516930188 1553729410 0.98
statpopgen_q07/duckdb:vortex-file-compressed 196945094 203364624 0.97
statpopgen_q08/duckdb:vortex-file-compressed 228192194 238000268 0.96
statpopgen_q09/duckdb:vortex-file-compressed 828677556 854505449 0.97
statpopgen_q10/duckdb:vortex-file-compressed 2534187815 2610622102 0.97
duckdb / vortex-compact (0.981x ➖, 0↑ 0↓)
name PR f212fb0 (ns) base ba700ca (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact 11541725 12075620 0.96
statpopgen_q01/duckdb:vortex-compact 214376410 217662870 0.98
statpopgen_q02/duckdb:vortex-compact 546677660 576001555 0.95
statpopgen_q03/duckdb:vortex-compact 1146783501 1156597930 0.99
statpopgen_q04/duckdb:vortex-compact 1143820610 1168913375 0.98
statpopgen_q05/duckdb:vortex-compact 566707911 568005285 1.00
statpopgen_q06/duckdb:vortex-compact 1510438129 1497877752 1.01
statpopgen_q07/duckdb:vortex-compact 896681719 910366289 0.98
statpopgen_q08/duckdb:vortex-compact 926135603 937403001 0.99
statpopgen_q09/duckdb:vortex-compact 907119115 930122084 0.98
statpopgen_q10/duckdb:vortex-compact 2589902893 2639308009 0.98
duckdb / parquet (0.976x ➖, 0↑ 0↓)
name PR f212fb0 (ns) base ba700ca (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 296677204 309856673 0.96
statpopgen_q01/duckdb:parquet 384383406 388203807 0.99
statpopgen_q02/duckdb:parquet 757703245 791002371 0.96
statpopgen_q03/duckdb:parquet 1185623679 1205969547 0.98
statpopgen_q04/duckdb:parquet 1194698330 1224490511 0.98
statpopgen_q05/duckdb:parquet 805462879 815006257 0.99
statpopgen_q06/duckdb:parquet 1427609726 1431109522 1.00
statpopgen_q07/duckdb:parquet 847723902 882540177 0.96
statpopgen_q08/duckdb:parquet 853746256 884036358 0.97
statpopgen_q09/duckdb:parquet 1016644773 1031584976 0.99
statpopgen_q10/duckdb:parquet 2205588438 2272365170 0.97
File Size Changes (1 files changed, +0.0% overall, 1↑ 0↓)
File Scale Format Base HEAD Change %
gnomad.genomes.v3.1.2.hgdp_tgp.chr21.vortex 100000 vortex-file-compressed 1.96 GB 1.96 GB +100.05 KB +0.0%

Totals:

  • vortex-compact: 959.59 MB → 959.59 MB (0.0%)
  • vortex-file-compressed: 1.96 GB → 1.96 GB (+0.0%)

@github-actions

github-actions Bot commented Jun 22, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +9.3%
Engines: DataFusion No clear signal (+19.5%, environment too noisy confidence) · DuckDB No clear signal (-0.1%, environment too noisy confidence)
Vortex (geomean): 1.151x ➖
Parquet (geomean): 1.053x ➖
Shifts: Parquet (control) +5.3% · Median polish +5.6%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.424x ❌, 0↑ 13↓)
name PR f212fb0 (ns) base 71319b7 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 337904592 282392296 1.20
tpch_q02/datafusion:vortex-file-compressed 633631628 565305757 1.12
tpch_q03/datafusion:vortex-file-compressed 577312117 547051578 1.06
tpch_q04/datafusion:vortex-file-compressed 334626434 290173546 1.15
tpch_q05/datafusion:vortex-file-compressed 🚨 830104697 553202887 1.50
tpch_q06/datafusion:vortex-file-compressed 🚨 546161224 362107683 1.51
tpch_q07/datafusion:vortex-file-compressed 🚨 853643132 649305524 1.31
tpch_q08/datafusion:vortex-file-compressed 🚨 1086017081 696014777 1.56
tpch_q09/datafusion:vortex-file-compressed 🚨 1243214141 417849732 2.98
tpch_q10/datafusion:vortex-file-compressed 🚨 1449186936 556151004 2.61
tpch_q11/datafusion:vortex-file-compressed 🚨 889354407 497095192 1.79
tpch_q12/datafusion:vortex-file-compressed 614181157 647399090 0.95
tpch_q13/datafusion:vortex-file-compressed 🚨 288320202 204962364 1.41
tpch_q14/datafusion:vortex-file-compressed 🚨 462036583 340062091 1.36
tpch_q15/datafusion:vortex-file-compressed 🚨 958347273 639753801 1.50
tpch_q16/datafusion:vortex-file-compressed 🚨 570344516 277542205 2.05
tpch_q17/datafusion:vortex-file-compressed 🚨 715185245 458840122 1.56
tpch_q18/datafusion:vortex-file-compressed 🚨 617401130 383900507 1.61
tpch_q19/datafusion:vortex-file-compressed 778525718 672548065 1.16
tpch_q20/datafusion:vortex-file-compressed 585334349 515475316 1.14
tpch_q21/datafusion:vortex-file-compressed 731949336 631616461 1.16
tpch_q22/datafusion:vortex-file-compressed 286617137 269888614 1.06
datafusion / vortex-compact (1.210x ➖, 1↑ 10↓)
name PR f212fb0 (ns) base 71319b7 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 🚨 366828447 257600998 1.42
tpch_q02/datafusion:vortex-compact 🚨 640614432 476296611 1.34
tpch_q03/datafusion:vortex-compact 427726051 415862541 1.03
tpch_q04/datafusion:vortex-compact 308445673 280590799 1.10
tpch_q05/datafusion:vortex-compact 652758390 563111446 1.16
tpch_q06/datafusion:vortex-compact 447760299 474378817 0.94
tpch_q07/datafusion:vortex-compact 708496196 897829180 0.79
tpch_q08/datafusion:vortex-compact 🚨 1106153727 808822531 1.37
tpch_q09/datafusion:vortex-compact 770300476 611683071 1.26
tpch_q10/datafusion:vortex-compact 634713651 586205331 1.08
tpch_q11/datafusion:vortex-compact 🚨 564657396 378261294 1.49
tpch_q12/datafusion:vortex-compact 618700074 505481667 1.22
tpch_q13/datafusion:vortex-compact 223808083 204282238 1.10
tpch_q14/datafusion:vortex-compact 🚨 645395576 305858727 2.11
tpch_q15/datafusion:vortex-compact 🚨 685589898 511520510 1.34
tpch_q16/datafusion:vortex-compact 🚨 362462361 213946462 1.69
tpch_q17/datafusion:vortex-compact 🚨 675225354 436799537 1.55
tpch_q18/datafusion:vortex-compact 🚨 515698675 309558572 1.67
tpch_q19/datafusion:vortex-compact 🚨 947256133 599046706 1.58
tpch_q20/datafusion:vortex-compact 612633996 521049375 1.18
tpch_q21/datafusion:vortex-compact 639484847 718553430 0.89
tpch_q22/datafusion:vortex-compact 🚀 196935632 423412032 0.47
datafusion / parquet (1.098x ➖, 0↑ 6↓)
name PR f212fb0 (ns) base 71319b7 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 243573665 296123096 0.82
tpch_q02/datafusion:parquet 448983851 408947185 1.10
tpch_q03/datafusion:parquet 364591391 463071767 0.79
tpch_q04/datafusion:parquet 192035155 215415837 0.89
tpch_q05/datafusion:parquet 681521223 766064294 0.89
tpch_q06/datafusion:parquet 🚨 348906114 250897343 1.39
tpch_q07/datafusion:parquet 584895052 525348203 1.11
tpch_q08/datafusion:parquet 666741539 719589933 0.93
tpch_q09/datafusion:parquet 614381129 560237190 1.10
tpch_q10/datafusion:parquet 852100092 679289746 1.25
tpch_q11/datafusion:parquet 🚨 604607749 412552652 1.47
tpch_q12/datafusion:parquet 🚨 327017809 246872452 1.32
tpch_q13/datafusion:parquet 504129301 443322386 1.14
tpch_q14/datafusion:parquet 🚨 304145472 176462985 1.72
tpch_q15/datafusion:parquet 🚨 517010794 326055920 1.59
tpch_q16/datafusion:parquet 181435449 172138795 1.05
tpch_q17/datafusion:parquet 516885143 614475635 0.84
tpch_q18/datafusion:parquet 536696068 651400661 0.82
tpch_q19/datafusion:parquet 398769233 487220315 0.82
tpch_q20/datafusion:parquet 🚨 666884124 387136736 1.72
tpch_q21/datafusion:parquet 968370797 831337556 1.16
tpch_q22/datafusion:parquet 299283015 308401884 0.97
duckdb / vortex-file-compressed (1.007x ➖, 0↑ 0↓)
name PR f212fb0 (ns) base 71319b7 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 342773718 423451666 0.81
tpch_q02/duckdb:vortex-file-compressed 1222210463 1105311237 1.11
tpch_q03/duckdb:vortex-file-compressed 725266882 713850307 1.02
tpch_q04/duckdb:vortex-file-compressed 504760194 435918382 1.16
tpch_q05/duckdb:vortex-file-compressed 910616539 948253007 0.96
tpch_q06/duckdb:vortex-file-compressed 426355809 407698403 1.05
tpch_q07/duckdb:vortex-file-compressed 1052247272 1123867936 0.94
tpch_q08/duckdb:vortex-file-compressed 1386368389 1202098202 1.15
tpch_q09/duckdb:vortex-file-compressed 1089892349 1038437566 1.05
tpch_q10/duckdb:vortex-file-compressed 762163864 934733355 0.82
tpch_q11/duckdb:vortex-file-compressed 554742425 589346112 0.94
tpch_q12/duckdb:vortex-file-compressed 821310923 738044626 1.11
tpch_q13/duckdb:vortex-file-compressed 486083000 566747469 0.86
tpch_q14/duckdb:vortex-file-compressed 509976459 488599614 1.04
tpch_q15/duckdb:vortex-file-compressed 336123913 400330713 0.84
tpch_q16/duckdb:vortex-file-compressed 426372854 438369457 0.97
tpch_q17/duckdb:vortex-file-compressed 934687680 839210877 1.11
tpch_q18/duckdb:vortex-file-compressed 622194122 625155872 1.00
tpch_q19/duckdb:vortex-file-compressed 584171626 528958318 1.10
tpch_q20/duckdb:vortex-file-compressed 889480629 855999205 1.04
tpch_q21/duckdb:vortex-file-compressed 1250640832 1193980257 1.05
tpch_q22/duckdb:vortex-file-compressed 388553361 335308997 1.16
duckdb / vortex-compact (1.011x ➖, 0↑ 2↓)
name PR f212fb0 (ns) base 71319b7 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 🚨 500215891 318973119 1.57
tpch_q02/duckdb:vortex-compact 1103715819 1004586862 1.10
tpch_q03/duckdb:vortex-compact 712047622 681956003 1.04
tpch_q04/duckdb:vortex-compact 479555733 447067251 1.07
tpch_q05/duckdb:vortex-compact 1015840174 893496281 1.14
tpch_q06/duckdb:vortex-compact 409268009 395311778 1.04
tpch_q07/duckdb:vortex-compact 999467291 1084578375 0.92
tpch_q08/duckdb:vortex-compact 1249719966 1201587218 1.04
tpch_q09/duckdb:vortex-compact 1086987045 1213735741 0.90
tpch_q10/duckdb:vortex-compact 846081879 966840817 0.88
tpch_q11/duckdb:vortex-compact 566578867 695298727 0.81
tpch_q12/duckdb:vortex-compact 715720207 677596320 1.06
tpch_q13/duckdb:vortex-compact 449028378 396104382 1.13
tpch_q14/duckdb:vortex-compact 451112902 560423145 0.80
tpch_q15/duckdb:vortex-compact 🚨 407492069 311457612 1.31
tpch_q16/duckdb:vortex-compact 324287449 368774066 0.88
tpch_q17/duckdb:vortex-compact 809490576 789696666 1.03
tpch_q18/duckdb:vortex-compact 597017856 727101514 0.82
tpch_q19/duckdb:vortex-compact 569290006 579213570 0.98
tpch_q20/duckdb:vortex-compact 931289878 1016709648 0.92
tpch_q21/duckdb:vortex-compact 1326717646 1260851124 1.05
tpch_q22/duckdb:vortex-compact 319457879 306286722 1.04
duckdb / parquet (1.010x ➖, 0↑ 0↓)
name PR f212fb0 (ns) base 71319b7 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 673015705 520959670 1.29
tpch_q02/duckdb:parquet 1070972597 1235505324 0.87
tpch_q03/duckdb:parquet 1417069485 1225404546 1.16
tpch_q04/duckdb:parquet 858707640 772432648 1.11
tpch_q05/duckdb:parquet 1441254419 1524543336 0.95
tpch_q06/duckdb:parquet 575643102 562262911 1.02
tpch_q07/duckdb:parquet 1555111984 1390736678 1.12
tpch_q08/duckdb:parquet 1857113029 1728742867 1.07
tpch_q09/duckdb:parquet 1642256676 1643976516 1.00
tpch_q10/duckdb:parquet 1502925823 1414502752 1.06
tpch_q11/duckdb:parquet 798877880 703810044 1.14
tpch_q12/duckdb:parquet 980630047 795752950 1.23
tpch_q13/duckdb:parquet 940928885 1081679698 0.87
tpch_q14/duckdb:parquet 692386334 830930227 0.83
tpch_q15/duckdb:parquet 587746568 633001533 0.93
tpch_q16/duckdb:parquet 620614576 792607420 0.78
tpch_q17/duckdb:parquet 996562248 957587275 1.04
tpch_q18/duckdb:parquet 1001391107 1051412674 0.95
tpch_q19/duckdb:parquet 974440418 788986610 1.24
tpch_q20/duckdb:parquet 1191049750 1447617291 0.82
tpch_q21/duckdb:parquet 1144623962 1161148549 0.99
tpch_q22/duckdb:parquet 602734289 632033265 0.95

@github-actions

github-actions Bot commented Jun 22, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.1%
Engines: DataFusion No clear signal (-0.1%, low confidence) · DuckDB No clear signal (+2.1%, low confidence)
Vortex (geomean): 1.028x ➖
Parquet (geomean): 1.010x ➖
Shifts: Parquet (control) +1.0% · Median polish +1.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.017x ➖, 0↑ 1↓)
name PR f212fb0 (ns) base 71319b7 (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 1665912 1610190 1.03
clickbench_q01/datafusion:vortex-file-compressed 15640596 15565415 1.00
clickbench_q02/datafusion:vortex-file-compressed 35728711 34251274 1.04
clickbench_q03/datafusion:vortex-file-compressed 40377744 40010632 1.01
clickbench_q04/datafusion:vortex-file-compressed 240210238 232765807 1.03
clickbench_q05/datafusion:vortex-file-compressed 308314805 305845311 1.01
clickbench_q06/datafusion:vortex-file-compressed 1545945 1581008 0.98
clickbench_q07/datafusion:vortex-file-compressed 20241475 19188832 1.05
clickbench_q08/datafusion:vortex-file-compressed 333969309 344972705 0.97
clickbench_q09/datafusion:vortex-file-compressed 449756404 438546562 1.03
clickbench_q10/datafusion:vortex-file-compressed 72398616 70742332 1.02
clickbench_q11/datafusion:vortex-file-compressed 87136234 85676776 1.02
clickbench_q12/datafusion:vortex-file-compressed 263543660 256260611 1.03
clickbench_q13/datafusion:vortex-file-compressed 418869490 417005385 1.00
clickbench_q14/datafusion:vortex-file-compressed 258775832 254763225 1.02
clickbench_q15/datafusion:vortex-file-compressed 285587203 276989146 1.03
clickbench_q16/datafusion:vortex-file-compressed 661083672 656840782 1.01
clickbench_q17/datafusion:vortex-file-compressed 660697558 646729519 1.02
clickbench_q18/datafusion:vortex-file-compressed 1379404478 1346413087 1.02
clickbench_q19/datafusion:vortex-file-compressed 29261633 29985694 0.98
clickbench_q20/datafusion:vortex-file-compressed 315582295 306488801 1.03
clickbench_q21/datafusion:vortex-file-compressed 401550468 398112024 1.01
clickbench_q22/datafusion:vortex-file-compressed 495011684 494958721 1.00
clickbench_q23/datafusion:vortex-file-compressed 761431026 780537780 0.98
clickbench_q24/datafusion:vortex-file-compressed 43715778 43006429 1.02
clickbench_q25/datafusion:vortex-file-compressed 72592140 71501245 1.02
clickbench_q26/datafusion:vortex-file-compressed 41947822 41098364 1.02
clickbench_q27/datafusion:vortex-file-compressed 415620145 414912059 1.00
clickbench_q28/datafusion:vortex-file-compressed 2373816591 2328534050 1.02
clickbench_q29/datafusion:vortex-file-compressed 🚨 61723357 55911828 1.10
clickbench_q30/datafusion:vortex-file-compressed 223283170 223758059 1.00
clickbench_q31/datafusion:vortex-file-compressed 248450494 239325542 1.04
clickbench_q32/datafusion:vortex-file-compressed 1047917140 1025865195 1.02
clickbench_q33/datafusion:vortex-file-compressed 1410484748 1391828702 1.01
clickbench_q34/datafusion:vortex-file-compressed 1436050358 1393348858 1.03
clickbench_q35/datafusion:vortex-file-compressed 244293671 233085016 1.05
clickbench_q36/datafusion:vortex-file-compressed 59231043 56163221 1.05
clickbench_q37/datafusion:vortex-file-compressed 25412617 24454799 1.04
clickbench_q38/datafusion:vortex-file-compressed 16020112 16711813 0.96
clickbench_q39/datafusion:vortex-file-compressed 122571806 122791789 1.00
clickbench_q40/datafusion:vortex-file-compressed 12942738 12248898 1.06
clickbench_q41/datafusion:vortex-file-compressed 12915288 12735390 1.01
clickbench_q42/datafusion:vortex-file-compressed 11478269 11874137 0.97
datafusion / parquet (1.018x ➖, 0↑ 1↓)
name PR f212fb0 (ns) base 71319b7 (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 1529625 1502037 1.02
clickbench_q01/datafusion:parquet 19170683 19265491 1.00
clickbench_q02/datafusion:parquet 43410569 43280104 1.00
clickbench_q03/datafusion:parquet 34427214 35100276 0.98
clickbench_q04/datafusion:parquet 271499019 279440411 0.97
clickbench_q05/datafusion:parquet 326062240 312698825 1.04
clickbench_q06/datafusion:parquet 1480427 1519501 0.97
clickbench_q07/datafusion:parquet 21339831 20758763 1.03
clickbench_q08/datafusion:parquet 329606253 320610223 1.03
clickbench_q09/datafusion:parquet 469301511 470894694 1.00
clickbench_q10/datafusion:parquet 92388341 91364598 1.01
clickbench_q11/datafusion:parquet 118744126 115604886 1.03
clickbench_q12/datafusion:parquet 302872968 292679705 1.03
clickbench_q13/datafusion:parquet 482163461 452507656 1.07
clickbench_q14/datafusion:parquet 309457124 322698238 0.96
clickbench_q15/datafusion:parquet 278649814 276083023 1.01
clickbench_q16/datafusion:parquet 688744700 645907709 1.07
clickbench_q17/datafusion:parquet 660602203 642405531 1.03
clickbench_q18/datafusion:parquet 1394838619 1338300483 1.04
clickbench_q19/datafusion:parquet 27289747 26377765 1.03
clickbench_q20/datafusion:parquet 563015490 567530507 0.99
clickbench_q21/datafusion:parquet 628171296 622451234 1.01
clickbench_q22/datafusion:parquet 915400485 898855238 1.02
clickbench_q23/datafusion:parquet 4090045400 3989352253 1.03
clickbench_q24/datafusion:parquet 55257058 54020874 1.02
clickbench_q25/datafusion:parquet 125001024 125943293 0.99
clickbench_q26/datafusion:parquet 🚨 56373494 50979926 1.11
clickbench_q27/datafusion:parquet 661358217 644918712 1.03
clickbench_q28/datafusion:parquet 2459778960 2393285182 1.03
clickbench_q29/datafusion:parquet 46461116 44211676 1.05
clickbench_q30/datafusion:parquet 320610158 307773798 1.04
clickbench_q31/datafusion:parquet 344335061 348497172 0.99
clickbench_q32/datafusion:parquet 1129227281 1105079739 1.02
clickbench_q33/datafusion:parquet 1486383816 1471504594 1.01
clickbench_q34/datafusion:parquet 1499217670 1487836098 1.01
clickbench_q35/datafusion:parquet 239880933 234635359 1.02
clickbench_q36/datafusion:parquet 103111209 104533897 0.99
clickbench_q37/datafusion:parquet 43187390 42379371 1.02
clickbench_q38/datafusion:parquet 59968862 62326176 0.96
clickbench_q39/datafusion:parquet 212636265 211468142 1.01
clickbench_q40/datafusion:parquet 23656413 22808808 1.04
clickbench_q41/datafusion:parquet 21449321 20605804 1.04
clickbench_q42/datafusion:parquet 22146128 21223936 1.04
duckdb / vortex-file-compressed (1.038x ➖, 0↑ 7↓)
name PR f212fb0 (ns) base 71319b7 (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 6700242 6755654 0.99
clickbench_q01/duckdb:vortex-file-compressed 11997791 10920050 1.10
clickbench_q02/duckdb:vortex-file-compressed 24451602 24596515 0.99
clickbench_q03/duckdb:vortex-file-compressed 30580307 31553267 0.97
clickbench_q04/duckdb:vortex-file-compressed 189424073 186547543 1.02
clickbench_q05/duckdb:vortex-file-compressed 183090852 180671029 1.01
clickbench_q06/duckdb:vortex-file-compressed 19621570 20236355 0.97
clickbench_q07/duckdb:vortex-file-compressed 14652058 14275704 1.03
clickbench_q08/duckdb:vortex-file-compressed 261621427 266977498 0.98
clickbench_q09/duckdb:vortex-file-compressed 343517560 341999465 1.00
clickbench_q10/duckdb:vortex-file-compressed 70390928 69247603 1.02
clickbench_q11/duckdb:vortex-file-compressed 81735673 81270340 1.01
clickbench_q12/duckdb:vortex-file-compressed 203203568 199572269 1.02
clickbench_q13/duckdb:vortex-file-compressed 415156903 403830762 1.03
clickbench_q14/duckdb:vortex-file-compressed 235338802 230443435 1.02
clickbench_q15/duckdb:vortex-file-compressed 240661674 240160231 1.00
clickbench_q16/duckdb:vortex-file-compressed 540846451 529048177 1.02
clickbench_q17/duckdb:vortex-file-compressed 426809207 426164627 1.00
clickbench_q18/duckdb:vortex-file-compressed 957610427 944095844 1.01
clickbench_q19/duckdb:vortex-file-compressed 21261751 22163202 0.96
clickbench_q20/duckdb:vortex-file-compressed 291814472 296329743 0.98
clickbench_q21/duckdb:vortex-file-compressed 400124064 378291479 1.06
clickbench_q22/duckdb:vortex-file-compressed 547823807 564269590 0.97
clickbench_q23/duckdb:vortex-file-compressed 🚨 209983270 180564943 1.16
clickbench_q24/duckdb:vortex-file-compressed 39709166 37273757 1.07
clickbench_q25/duckdb:vortex-file-compressed 🚨 85712683 73054445 1.17
clickbench_q26/duckdb:vortex-file-compressed 50987948 46896683 1.09
clickbench_q27/duckdb:vortex-file-compressed 218040315 212320384 1.03
clickbench_q28/duckdb:vortex-file-compressed 3002158662 3012821899 1.00
clickbench_q29/duckdb:vortex-file-compressed 28570870 27590656 1.04
clickbench_q30/duckdb:vortex-file-compressed 197180753 189439859 1.04
clickbench_q31/duckdb:vortex-file-compressed 290316476 282539287 1.03
clickbench_q32/duckdb:vortex-file-compressed 1123862903 1121792401 1.00
clickbench_q33/duckdb:vortex-file-compressed 1143133899 1125328878 1.02
clickbench_q34/duckdb:vortex-file-compressed 1221920497 1200156101 1.02
clickbench_q35/duckdb:vortex-file-compressed 381338033 376076180 1.01
clickbench_q36/duckdb:vortex-file-compressed 31199779 29537513 1.06
clickbench_q37/duckdb:vortex-file-compressed 🚨 24278076 21037258 1.15
clickbench_q38/duckdb:vortex-file-compressed 🚨 26803909 23345900 1.15
clickbench_q39/duckdb:vortex-file-compressed 47032412 46565330 1.01
clickbench_q40/duckdb:vortex-file-compressed 🚨 23129578 20111738 1.15
clickbench_q41/duckdb:vortex-file-compressed 🚨 23636937 19288429 1.23
clickbench_q42/duckdb:vortex-file-compressed 🚨 23113789 20035414 1.15
duckdb / parquet (1.003x ➖, 0↑ 0↓)
name PR f212fb0 (ns) base 71319b7 (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 23094669 22382016 1.03
clickbench_q01/duckdb:parquet 29381608 29638353 0.99
clickbench_q02/duckdb:parquet 50282158 50172571 1.00
clickbench_q03/duckdb:parquet 39340547 40814769 0.96
clickbench_q04/duckdb:parquet 204020384 202448068 1.01
clickbench_q05/duckdb:parquet 259340049 260108908 1.00
clickbench_q06/duckdb:parquet 46679446 47338188 0.99
clickbench_q07/duckdb:parquet 31702909 31339636 1.01
clickbench_q08/duckdb:parquet 272514990 268548120 1.01
clickbench_q09/duckdb:parquet 401187296 396307605 1.01
clickbench_q10/duckdb:parquet 84098249 83687336 1.00
clickbench_q11/duckdb:parquet 100481477 100875037 1.00
clickbench_q12/duckdb:parquet 280846162 281245656 1.00
clickbench_q13/duckdb:parquet 469726061 470542139 1.00
clickbench_q14/duckdb:parquet 320641290 314118129 1.02
clickbench_q15/duckdb:parquet 257557987 258398348 1.00
clickbench_q16/duckdb:parquet 597126361 594531694 1.00
clickbench_q17/duckdb:parquet 495845151 495545046 1.00
clickbench_q18/duckdb:parquet 1037869231 1031929420 1.01
clickbench_q19/duckdb:parquet 27635798 28157441 0.98
clickbench_q20/duckdb:parquet 409921920 414021558 0.99
clickbench_q21/duckdb:parquet 533622117 538350351 0.99
clickbench_q22/duckdb:parquet 916353006 919245769 1.00
clickbench_q23/duckdb:parquet 262780499 271017338 0.97
clickbench_q24/duckdb:parquet 72012363 70762534 1.02
clickbench_q25/duckdb:parquet 162920675 162799668 1.00
clickbench_q26/duckdb:parquet 55971452 54625569 1.02
clickbench_q27/duckdb:parquet 469934020 470231461 1.00
clickbench_q28/duckdb:parquet 4791539638 4779190105 1.00
clickbench_q29/duckdb:parquet 41655145 42314881 0.98
clickbench_q30/duckdb:parquet 309824168 311289139 1.00
clickbench_q31/duckdb:parquet 376968603 375966636 1.00
clickbench_q32/duckdb:parquet 1115243558 1102565460 1.01
clickbench_q33/duckdb:parquet 1110810519 1104101149 1.01
clickbench_q34/duckdb:parquet 1167189665 1149608215 1.02
clickbench_q35/duckdb:parquet 371903820 366962853 1.01
clickbench_q36/duckdb:parquet 45267039 45859057 0.99
clickbench_q37/duckdb:parquet 34121644 34302067 0.99
clickbench_q38/duckdb:parquet 35781314 34817197 1.03
clickbench_q39/duckdb:parquet 85011032 87507835 0.97
clickbench_q40/duckdb:parquet 20514641 21004678 0.98
clickbench_q41/duckdb:parquet 21529526 19810652 1.09
clickbench_q42/duckdb:parquet 23199716 22065577 1.05
duckdb / duckdb (1.010x ➖, 0↑ 0↓)
name PR f212fb0 (ns) base 71319b7 (ns) ratio (PR/base)
clickbench_q00/duckdb:duckdb 16935118 16694044 1.01
clickbench_q01/duckdb:duckdb 33977392 34049118 1.00
clickbench_q02/duckdb:duckdb 51480445 50882763 1.01
clickbench_q03/duckdb:duckdb 55429675 54975686 1.01
clickbench_q04/duckdb:duckdb 212067650 211954205 1.00
clickbench_q05/duckdb:duckdb 282234466 287874076 0.98
clickbench_q06/duckdb:duckdb 33995849 32969390 1.03
clickbench_q07/duckdb:duckdb 34837809 34492858 1.01
clickbench_q08/duckdb:duckdb 275303219 272636760 1.01
clickbench_q09/duckdb:duckdb 394338193 394637798 1.00
clickbench_q10/duckdb:duckdb 117337644 115705287 1.01
clickbench_q11/duckdb:duckdb 128030934 126537908 1.01
clickbench_q12/duckdb:duckdb 260416103 257867739 1.01
clickbench_q13/duckdb:duckdb 448370269 439448315 1.02
clickbench_q14/duckdb:duckdb 289255905 284528763 1.02
clickbench_q15/duckdb:duckdb 242721390 242048508 1.00
clickbench_q16/duckdb:duckdb 563295935 562054632 1.00
clickbench_q17/duckdb:duckdb 469817844 468343078 1.00
clickbench_q18/duckdb:duckdb 1012021849 1041355547 0.97
clickbench_q19/duckdb:duckdb 35163302 33784379 1.04
clickbench_q20/duckdb:duckdb 496107359 463101293 1.07
clickbench_q21/duckdb:duckdb 476396937 472345127 1.01
clickbench_q22/duckdb:duckdb 530712866 541785651 0.98
clickbench_q23/duckdb:duckdb 253224563 253649829 1.00
clickbench_q24/duckdb:duckdb 61508684 62105861 0.99
clickbench_q25/duckdb:duckdb 150520151 149090611 1.01
clickbench_q26/duckdb:duckdb 62286057 60590735 1.03
clickbench_q27/duckdb:duckdb 418688269 416780061 1.00
clickbench_q28/duckdb:duckdb 4416744176 4410890429 1.00
clickbench_q29/duckdb:duckdb 50572755 50111268 1.01
clickbench_q30/duckdb:duckdb 282235863 274942347 1.03
clickbench_q31/duckdb:duckdb 365020132 363895781 1.00
clickbench_q32/duckdb:duckdb 1109536244 1113066958 1.00
clickbench_q33/duckdb:duckdb 1131152985 1117518370 1.01
clickbench_q34/duckdb:duckdb 1207123104 1195408852 1.01
clickbench_q35/duckdb:duckdb 295382358 296240486 1.00
clickbench_q36/duckdb:duckdb 51073134 48765523 1.05
clickbench_q37/duckdb:duckdb 28512489 28200123 1.01
clickbench_q38/duckdb:duckdb 33156154 33214449 1.00
clickbench_q39/duckdb:duckdb 82994892 78818220 1.05
clickbench_q40/duckdb:duckdb 28038536 27260157 1.03
clickbench_q41/duckdb:duckdb 26889032 26622570 1.01
clickbench_q42/duckdb:duckdb 29276632 29166325 1.00
File Size Changes (106 files changed, -0.0% overall, 56↑ 50↓)
File Scale Format Base HEAD Change %
hits_53.vortex 1.0 vortex-file-compressed 85.57 MB 85.94 MB +378.57 KB +0.4%
hits_10.vortex 1.0 vortex-file-compressed 69.34 MB 69.54 MB +204.55 KB +0.3%
hits_65.vortex 1.0 vortex-compact 129.38 MB 129.70 MB +327.20 KB +0.2%
hits_73.vortex 1.0 vortex-file-compressed 109.36 MB 109.62 MB +265.62 KB +0.2%
hits_36.vortex 1.0 vortex-file-compressed 68.27 MB 68.40 MB +134.24 KB +0.2%
hits_95.vortex 1.0 vortex-file-compressed 96.07 MB 96.25 MB +187.50 KB +0.2%
hits_86.vortex 1.0 vortex-file-compressed 69.07 MB 69.19 MB +131.07 KB +0.2%
hits_7.vortex 1.0 vortex-file-compressed 93.85 MB 94.01 MB +160.02 KB +0.2%
hits_4.vortex 1.0 vortex-file-compressed 108.21 MB 108.38 MB +172.05 KB +0.2%
hits_25.vortex 1.0 vortex-file-compressed 113.19 MB 113.34 MB +155.77 KB +0.1%
hits_18.vortex 1.0 vortex-file-compressed 104.30 MB 104.44 MB +143.02 KB +0.1%
hits_88.vortex 1.0 vortex-file-compressed 110.76 MB 110.89 MB +132.81 KB +0.1%
hits_71.vortex 1.0 vortex-file-compressed 101.54 MB 101.65 MB +107.58 KB +0.1%
hits_44.vortex 1.0 vortex-file-compressed 185.74 MB 185.92 MB +184.31 KB +0.1%
hits_89.vortex 1.0 vortex-file-compressed 184.20 MB 184.38 MB +181.73 KB +0.1%
hits_6.vortex 1.0 vortex-file-compressed 93.25 MB 93.33 MB +89.28 KB +0.1%
hits_85.vortex 1.0 vortex-file-compressed 91.47 MB 91.55 MB +86.09 KB +0.1%
hits_62.vortex 1.0 vortex-file-compressed 117.19 MB 117.30 MB +102.76 KB +0.1%
hits_46.vortex 1.0 vortex-file-compressed 69.10 MB 69.16 MB +59.55 KB +0.1%
hits_2.vortex 1.0 vortex-compact 129.13 MB 129.23 MB +102.38 KB +0.1%
hits_79.vortex 1.0 vortex-file-compressed 143.93 MB 144.04 MB +109.77 KB +0.1%
hits_76.vortex 1.0 vortex-file-compressed 113.69 MB 113.77 MB +78.86 KB +0.1%
hits_23.vortex 1.0 vortex-file-compressed 76.43 MB 76.48 MB +49.28 KB +0.1%
hits_77.vortex 1.0 vortex-file-compressed 168.10 MB 168.21 MB +108.10 KB +0.1%
hits_94.vortex 1.0 vortex-file-compressed 138.41 MB 138.49 MB +87.71 KB +0.1%
hits_5.vortex 1.0 vortex-file-compressed 92.80 MB 92.85 MB +56.98 KB +0.1%
hits_66.vortex 1.0 vortex-file-compressed 90.12 MB 90.17 MB +51.68 KB +0.1%
hits_34.vortex 1.0 vortex-file-compressed 97.39 MB 97.44 MB +49.57 KB +0.0%
hits_91.vortex 1.0 vortex-file-compressed 96.79 MB 96.84 MB +46.37 KB +0.0%
hits_35.vortex 1.0 vortex-file-compressed 114.89 MB 114.93 MB +43.91 KB +0.0%
hits_16.vortex 1.0 vortex-file-compressed 79.27 MB 79.29 MB +26.79 KB +0.0%
hits_50.vortex 1.0 vortex-file-compressed 179.12 MB 179.18 MB +58.70 KB +0.0%
hits_65.vortex 1.0 vortex-file-compressed 183.33 MB 183.39 MB +59.42 KB +0.0%
hits_19.vortex 1.0 vortex-file-compressed 73.24 MB 73.26 MB +21.91 KB +0.0%
hits_68.vortex 1.0 vortex-file-compressed 122.74 MB 122.77 MB +33.21 KB +0.0%
hits_33.vortex 1.0 vortex-file-compressed 57.01 MB 57.02 MB +13.08 KB +0.0%
hits_92.vortex 1.0 vortex-file-compressed 146.41 MB 146.43 MB +28.74 KB +0.0%
hits_81.vortex 1.0 vortex-file-compressed 100.63 MB 100.65 MB +17.95 KB +0.0%
hits_32.vortex 1.0 vortex-file-compressed 66.51 MB 66.53 MB +10.95 KB +0.0%
hits_93.vortex 1.0 vortex-file-compressed 90.17 MB 90.18 MB +13.70 KB +0.0%
hits_64.vortex 1.0 vortex-file-compressed 80.95 MB 80.96 MB +12.18 KB +0.0%
hits_70.vortex 1.0 vortex-file-compressed 93.39 MB 93.40 MB +14.05 KB +0.0%
hits_67.vortex 1.0 vortex-file-compressed 183.94 MB 183.97 MB +27.30 KB +0.0%
hits_13.vortex 1.0 vortex-file-compressed 99.11 MB 99.12 MB +14.40 KB +0.0%
hits_49.vortex 1.0 vortex-file-compressed 75.45 MB 75.46 MB +9.98 KB +0.0%
hits_24.vortex 1.0 vortex-file-compressed 75.94 MB 75.94 MB +9.13 KB +0.0%
hits_74.vortex 1.0 vortex-file-compressed 119.40 MB 119.41 MB +13.91 KB +0.0%
hits_61.vortex 1.0 vortex-file-compressed 101.03 MB 101.04 MB +10.31 KB +0.0%
hits_0.vortex 1.0 vortex-file-compressed 89.50 MB 89.50 MB +8.49 KB +0.0%
hits_78.vortex 1.0 vortex-file-compressed 164.11 MB 164.13 MB +12.95 KB +0.0%
hits_29.vortex 1.0 vortex-file-compressed 59.36 MB 59.36 MB +3.77 KB +0.0%
hits_80.vortex 1.0 vortex-file-compressed 105.05 MB 105.05 MB +3.56 KB +0.0%
hits_60.vortex 1.0 vortex-file-compressed 103.12 MB 103.12 MB +3.14 KB +0.0%
hits_45.vortex 1.0 vortex-file-compressed 121.90 MB 121.90 MB +3.05 KB +0.0%
hits_43.vortex 1.0 vortex-file-compressed 226.42 MB 226.42 MB +3.01 KB +0.0%
hits_51.vortex 1.0 vortex-file-compressed 277.55 MB 277.55 MB +1.99 KB +0.0%
hits_59.vortex 1.0 vortex-file-compressed 101.60 MB 101.59 MB 3.16 KB -0.0%
hits_26.vortex 1.0 vortex-file-compressed 109.21 MB 109.20 MB 5.87 KB -0.0%
hits_9.vortex 1.0 vortex-file-compressed 99.08 MB 99.07 MB 11.55 KB -0.0%
hits_15.vortex 1.0 vortex-file-compressed 89.11 MB 89.10 MB 11.03 KB -0.0%
hits_48.vortex 1.0 vortex-file-compressed 28.02 MB 28.01 MB 4.66 KB -0.0%
hits_56.vortex 1.0 vortex-file-compressed 123.18 MB 123.16 MB 21.06 KB -0.0%
hits_11.vortex 1.0 vortex-file-compressed 79.67 MB 79.66 MB 14.72 KB -0.0%
hits_12.vortex 1.0 vortex-file-compressed 100.76 MB 100.73 MB 23.70 KB -0.0%
hits_31.vortex 1.0 vortex-file-compressed 89.96 MB 89.93 MB 22.67 KB -0.0%
hits_58.vortex 1.0 vortex-file-compressed 90.31 MB 90.29 MB 23.33 KB -0.0%
hits_47.vortex 1.0 vortex-file-compressed 41.25 MB 41.23 MB 11.24 KB -0.0%
hits_21.vortex 1.0 vortex-file-compressed 92.76 MB 92.74 MB 28.02 KB -0.0%
hits_37.vortex 1.0 vortex-file-compressed 85.38 MB 85.35 MB 27.52 KB -0.0%
hits_98.vortex 1.0 vortex-file-compressed 118.17 MB 118.13 MB 40.43 KB -0.0%
hits_55.vortex 1.0 vortex-file-compressed 168.97 MB 168.91 MB 60.78 KB -0.0%
hits_82.vortex 1.0 vortex-file-compressed 99.51 MB 99.48 MB 36.31 KB -0.0%
hits_28.vortex 1.0 vortex-file-compressed 119.74 MB 119.70 MB 45.79 KB -0.0%
hits_38.vortex 1.0 vortex-file-compressed 99.06 MB 99.02 MB 40.12 KB -0.0%
hits_99.vortex 1.0 vortex-file-compressed 122.80 MB 122.75 MB 51.05 KB -0.0%
hits_63.vortex 1.0 vortex-file-compressed 69.07 MB 69.04 MB 29.48 KB -0.0%
hits_75.vortex 1.0 vortex-file-compressed 63.22 MB 63.19 MB 28.52 KB -0.0%
hits_96.vortex 1.0 vortex-file-compressed 135.26 MB 135.20 MB 62.31 KB -0.0%
hits_87.vortex 1.0 vortex-file-compressed 172.14 MB 172.06 MB 84.36 KB -0.0%
hits_41.vortex 1.0 vortex-file-compressed 223.08 MB 222.97 MB 116.51 KB -0.1%
hits_39.vortex 1.0 vortex-file-compressed 80.05 MB 80.01 MB 42.78 KB -0.1%
hits_54.vortex 1.0 vortex-file-compressed 221.29 MB 221.16 MB 129.67 KB -0.1%
hits_40.vortex 1.0 vortex-file-compressed 117.72 MB 117.65 MB 73.29 KB -0.1%
hits_57.vortex 1.0 vortex-file-compressed 128.05 MB 127.96 MB 87.73 KB -0.1%
hits_42.vortex 1.0 vortex-file-compressed 221.83 MB 221.68 MB 160.43 KB -0.1%
hits_72.vortex 1.0 vortex-file-compressed 84.44 MB 84.38 MB 61.45 KB -0.1%
hits_22.vortex 1.0 vortex-file-compressed 76.90 MB 76.85 MB 57.63 KB -0.1%
hits_30.vortex 1.0 vortex-file-compressed 86.78 MB 86.71 MB 68.82 KB -0.1%
hits_1.vortex 1.0 vortex-file-compressed 138.23 MB 138.12 MB 112.02 KB -0.1%
hits_69.vortex 1.0 vortex-file-compressed 123.08 MB 122.98 MB 103.05 KB -0.1%
hits_83.vortex 1.0 vortex-file-compressed 89.22 MB 89.14 MB 75.68 KB -0.1%
hits_97.vortex 1.0 vortex-compact 69.03 MB 68.97 MB 60.21 KB -0.1%
hits_8.vortex 1.0 vortex-file-compressed 93.26 MB 93.18 MB 82.74 KB -0.1%
hits_3.vortex 1.0 vortex-file-compressed 141.72 MB 141.56 MB 171.38 KB -0.1%
hits_14.vortex 1.0 vortex-file-compressed 111.27 MB 111.12 MB 151.45 KB -0.1%
hits_20.vortex 1.0 vortex-file-compressed 62.54 MB 62.46 MB 85.38 KB -0.1%
hits_17.vortex 1.0 vortex-file-compressed 87.24 MB 87.11 MB 129.68 KB -0.1%
hits_27.vortex 1.0 vortex-compact 69.94 MB 69.80 MB 143.06 KB -0.2%
hits_52.vortex 1.0 vortex-file-compressed 103.67 MB 103.44 MB 239.55 KB -0.2%
hits_97.vortex 1.0 vortex-file-compressed 106.95 MB 106.70 MB 247.73 KB -0.2%
hits_2.vortex 1.0 vortex-file-compressed 186.41 MB 185.93 MB 496.80 KB -0.3%
hits_21.vortex 1.0 vortex-compact 51.52 MB 51.38 MB 144.64 KB -0.3%
hits_84.vortex 1.0 vortex-file-compressed 117.10 MB 116.76 MB 345.87 KB -0.3%
hits_27.vortex 1.0 vortex-file-compressed 122.87 MB 122.52 MB 363.05 KB -0.3%
hits_90.vortex 1.0 vortex-file-compressed 141.79 MB 139.71 MB 2.08 MB -1.5%
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%

Totals:

  • vortex-compact: 7.04 GB → 7.04 GB (-0.0%)
  • vortex-file-compressed: 10.98 GB → 10.98 GB (-0.0%)

@github-actions

github-actions Bot commented Jun 22, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.0%
Engines: DataFusion No clear signal (+1.2%, low confidence) · DuckDB No clear signal (+0.7%, low confidence)
Vortex (geomean): 1.000x ➖
Parquet (geomean): 0.995x ➖
Shifts: Parquet (control) -0.5% · Median polish +0.5%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.992x ➖, 1↑ 0↓)
name PR f212fb0 (ns) base ba700ca (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 489094748 475197151 1.03
tpch_q02/datafusion:vortex-file-compressed 109055933 111671761 0.98
tpch_q03/datafusion:vortex-file-compressed 213191094 226584348 0.94
tpch_q04/datafusion:vortex-file-compressed 🚀 100866774 112505411 0.90
tpch_q05/datafusion:vortex-file-compressed 388734955 377070386 1.03
tpch_q06/datafusion:vortex-file-compressed 38263857 38883683 0.98
tpch_q07/datafusion:vortex-file-compressed 486629870 499954273 0.97
tpch_q08/datafusion:vortex-file-compressed 370071864 389064903 0.95
tpch_q09/datafusion:vortex-file-compressed 639706324 636492088 1.01
tpch_q10/datafusion:vortex-file-compressed 247778750 248523353 1.00
tpch_q11/datafusion:vortex-file-compressed 85909434 83247136 1.03
tpch_q12/datafusion:vortex-file-compressed 121196093 115707470 1.05
tpch_q13/datafusion:vortex-file-compressed 216147604 205391958 1.05
tpch_q14/datafusion:vortex-file-compressed 51411149 50559785 1.02
tpch_q15/datafusion:vortex-file-compressed 98266186 104935518 0.94
tpch_q16/datafusion:vortex-file-compressed 79635797 80631847 0.99
tpch_q17/datafusion:vortex-file-compressed 642997588 634231399 1.01
tpch_q18/datafusion:vortex-file-compressed 904217556 921179672 0.98
tpch_q19/datafusion:vortex-file-compressed 255336700 243038260 1.05
tpch_q20/datafusion:vortex-file-compressed 165553397 174762543 0.95
tpch_q21/datafusion:vortex-file-compressed 666867448 665679864 1.00
tpch_q22/datafusion:vortex-file-compressed 56717389 57452671 0.99
datafusion / vortex-compact (1.003x ➖, 0↑ 0↓)
name PR f212fb0 (ns) base ba700ca (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 514491689 536762031 0.96
tpch_q02/datafusion:vortex-compact 119794608 111035819 1.08
tpch_q03/datafusion:vortex-compact 222335204 209021574 1.06
tpch_q04/datafusion:vortex-compact 114490369 114898112 1.00
tpch_q05/datafusion:vortex-compact 365100266 375605798 0.97
tpch_q06/datafusion:vortex-compact 60237818 65517272 0.92
tpch_q07/datafusion:vortex-compact 523681456 506606962 1.03
tpch_q08/datafusion:vortex-compact 367861488 373651215 0.98
tpch_q09/datafusion:vortex-compact 650133191 627062809 1.04
tpch_q10/datafusion:vortex-compact 261631289 258319861 1.01
tpch_q11/datafusion:vortex-compact 82919844 85882938 0.97
tpch_q12/datafusion:vortex-compact 155037289 168894094 0.92
tpch_q13/datafusion:vortex-compact 262243358 256091587 1.02
tpch_q14/datafusion:vortex-compact 68523309 66897327 1.02
tpch_q15/datafusion:vortex-compact 159612751 157309074 1.01
tpch_q16/datafusion:vortex-compact 81734881 82123466 1.00
tpch_q17/datafusion:vortex-compact 623385595 639123885 0.98
tpch_q18/datafusion:vortex-compact 903681433 911685716 0.99
tpch_q19/datafusion:vortex-compact 376820958 348378095 1.08
tpch_q20/datafusion:vortex-compact 193683934 191330552 1.01
tpch_q21/datafusion:vortex-compact 690725308 687031411 1.01
tpch_q22/datafusion:vortex-compact 66489900 64959868 1.02
datafusion / parquet (0.994x ➖, 0↑ 0↓)
name PR f212fb0 (ns) base ba700ca (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 516259572 491070064 1.05
tpch_q02/datafusion:parquet 181232962 188512451 0.96
tpch_q03/datafusion:parquet 281471401 272140656 1.03
tpch_q04/datafusion:parquet 133568824 127066287 1.05
tpch_q05/datafusion:parquet 434319689 437371877 0.99
tpch_q06/datafusion:parquet 132874872 138248264 0.96
tpch_q07/datafusion:parquet 621806073 632712485 0.98
tpch_q08/datafusion:parquet 477862084 509603671 0.94
tpch_q09/datafusion:parquet 784259473 800293136 0.98
tpch_q10/datafusion:parquet 633763810 612543587 1.03
tpch_q11/datafusion:parquet 123461038 127815849 0.97
tpch_q12/datafusion:parquet 211848655 223121413 0.95
tpch_q13/datafusion:parquet 359637690 361171035 1.00
tpch_q14/datafusion:parquet 166867566 161308695 1.03
tpch_q15/datafusion:parquet 272347990 267900811 1.02
tpch_q16/datafusion:parquet 132456443 131202220 1.01
tpch_q17/datafusion:parquet 710658598 701114053 1.01
tpch_q18/datafusion:parquet 952084962 969610698 0.98
tpch_q19/datafusion:parquet 289209124 293304731 0.99
tpch_q20/datafusion:parquet 310937356 320108927 0.97
tpch_q21/datafusion:parquet 688332881 691132496 1.00
tpch_q22/datafusion:parquet 211500199 217417769 0.97
datafusion / arrow (1.023x ➖, 0↑ 2↓)
name PR f212fb0 (ns) base ba700ca (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 752443506 760365363 0.99
tpch_q02/datafusion:arrow 🚨 129196141 115535150 1.12
tpch_q03/datafusion:arrow 559714844 569856954 0.98
tpch_q04/datafusion:arrow 435687460 403206359 1.08
tpch_q05/datafusion:arrow 838918549 803339329 1.04
tpch_q06/datafusion:arrow 370852869 355857152 1.04
tpch_q07/datafusion:arrow 1263116636 1245372858 1.01
tpch_q08/datafusion:arrow 1012753325 1021340281 0.99
tpch_q09/datafusion:arrow 1181854745 1144364996 1.03
tpch_q10/datafusion:arrow 736447775 723422940 1.02
tpch_q11/datafusion:arrow 95900246 98955382 0.97
tpch_q12/datafusion:arrow 1577659961 1510370377 1.04
tpch_q13/datafusion:arrow 487080682 503783154 0.97
tpch_q14/datafusion:arrow 435011279 397891335 1.09
tpch_q15/datafusion:arrow 821759540 808664395 1.02
tpch_q16/datafusion:arrow 85452607 88763737 0.96
tpch_q17/datafusion:arrow 1034688291 1018349030 1.02
tpch_q18/datafusion:arrow 2035760013 2067326533 0.98
tpch_q19/datafusion:arrow 608699070 612618096 0.99
tpch_q20/datafusion:arrow 580732205 563423310 1.03
tpch_q21/datafusion:arrow 3288407550 3292709586 1.00
tpch_q22/datafusion:arrow 🚨 97510269 85184740 1.14
duckdb / vortex-file-compressed (1.001x ➖, 0↑ 0↓)
name PR f212fb0 (ns) base ba700ca (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 176042797 172244764 1.02
tpch_q02/duckdb:vortex-file-compressed 59967213 58224043 1.03
tpch_q03/duckdb:vortex-file-compressed 138291104 138327490 1.00
tpch_q04/duckdb:vortex-file-compressed 169267458 170454538 0.99
tpch_q05/duckdb:vortex-file-compressed 148129697 145389287 1.02
tpch_q06/duckdb:vortex-file-compressed 34474537 32582779 1.06
tpch_q07/duckdb:vortex-file-compressed 144123701 140966070 1.02
tpch_q08/duckdb:vortex-file-compressed 197712940 189760260 1.04
tpch_q09/duckdb:vortex-file-compressed 416141233 421024574 0.99
tpch_q10/duckdb:vortex-file-compressed 204155115 205266045 0.99
tpch_q11/duckdb:vortex-file-compressed 34204581 35779206 0.96
tpch_q12/duckdb:vortex-file-compressed 114863814 112619591 1.02
tpch_q13/duckdb:vortex-file-compressed 289825761 292980581 0.99
tpch_q14/duckdb:vortex-file-compressed 54060795 56692297 0.95
tpch_q15/duckdb:vortex-file-compressed 92137087 95254824 0.97
tpch_q16/duckdb:vortex-file-compressed 81655611 81812241 1.00
tpch_q17/duckdb:vortex-file-compressed 96061376 96429071 1.00
tpch_q18/duckdb:vortex-file-compressed 309504511 306721073 1.01
tpch_q19/duckdb:vortex-file-compressed 85072690 83843686 1.01
tpch_q20/duckdb:vortex-file-compressed 150559066 152017120 0.99
tpch_q21/duckdb:vortex-file-compressed 517496632 528373023 0.98
tpch_q22/duckdb:vortex-file-compressed 68355286 68639311 1.00
duckdb / vortex-compact (1.003x ➖, 0↑ 0↓)
name PR f212fb0 (ns) base ba700ca (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 237083444 241290736 0.98
tpch_q02/duckdb:vortex-compact 61597967 63566500 0.97
tpch_q03/duckdb:vortex-compact 142479267 146303383 0.97
tpch_q04/duckdb:vortex-compact 177456723 184979035 0.96
tpch_q05/duckdb:vortex-compact 169894216 171550867 0.99
tpch_q06/duckdb:vortex-compact 57633902 58042745 0.99
tpch_q07/duckdb:vortex-compact 188582868 189187449 1.00
tpch_q08/duckdb:vortex-compact 212908854 217404399 0.98
tpch_q09/duckdb:vortex-compact 442160398 438907224 1.01
tpch_q10/duckdb:vortex-compact 239725234 240486575 1.00
tpch_q11/duckdb:vortex-compact 42472400 42107275 1.01
tpch_q12/duckdb:vortex-compact 170508506 169001212 1.01
tpch_q13/duckdb:vortex-compact 336447328 331421986 1.02
tpch_q14/duckdb:vortex-compact 76904975 75041480 1.02
tpch_q15/duckdb:vortex-compact 122603008 118463215 1.03
tpch_q16/duckdb:vortex-compact 85928418 84227788 1.02
tpch_q17/duckdb:vortex-compact 119799017 117602325 1.02
tpch_q18/duckdb:vortex-compact 320705332 310548921 1.03
tpch_q19/duckdb:vortex-compact 99811000 98510079 1.01
tpch_q20/duckdb:vortex-compact 180387840 178632745 1.01
tpch_q21/duckdb:vortex-compact 562619223 566141540 0.99
tpch_q22/duckdb:vortex-compact 77088343 73304258 1.05
duckdb / parquet (0.997x ➖, 0↑ 0↓)
name PR f212fb0 (ns) base ba700ca (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 266751145 260111916 1.03
tpch_q02/duckdb:parquet 102173516 104645811 0.98
tpch_q03/duckdb:parquet 217940539 212885285 1.02
tpch_q04/duckdb:parquet 144564404 145797066 0.99
tpch_q05/duckdb:parquet 231915925 230730096 1.01
tpch_q06/duckdb:parquet 74444351 74808105 1.00
tpch_q07/duckdb:parquet 192226943 187489250 1.03
tpch_q08/duckdb:parquet 279358187 275970180 1.01
tpch_q09/duckdb:parquet 498405745 505728772 0.99
tpch_q10/duckdb:parquet 647898426 647736248 1.00
tpch_q11/duckdb:parquet 65541384 66146031 0.99
tpch_q12/duckdb:parquet 136727936 135501186 1.01
tpch_q13/duckdb:parquet 450229214 453736430 0.99
tpch_q14/duckdb:parquet 184573552 187766322 0.98
tpch_q15/duckdb:parquet 106009320 106884586 0.99
tpch_q16/duckdb:parquet 164179793 172084325 0.95
tpch_q17/duckdb:parquet 184260747 184365968 1.00
tpch_q18/duckdb:parquet 381762786 382903695 1.00
tpch_q19/duckdb:parquet 289189169 291854978 0.99
tpch_q20/duckdb:parquet 233405968 236255643 0.99
tpch_q21/duckdb:parquet 589473519 589534012 1.00
tpch_q22/duckdb:parquet 297418827 298154572 1.00
duckdb / duckdb (1.008x ➖, 0↑ 0↓)
name PR f212fb0 (ns) base ba700ca (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 122875763 122413832 1.00
tpch_q02/duckdb:duckdb 53174720 51620219 1.03
tpch_q03/duckdb:duckdb 105225944 108065050 0.97
tpch_q04/duckdb:duckdb 143363487 143667719 1.00
tpch_q05/duckdb:duckdb 122193326 124104769 0.98
tpch_q06/duckdb:duckdb 45165515 45658939 0.99
tpch_q07/duckdb:duckdb 92224427 93164977 0.99
tpch_q08/duckdb:duckdb 126348303 127688857 0.99
tpch_q09/duckdb:duckdb 291461146 291086490 1.00
tpch_q10/duckdb:duckdb 217773637 220553446 0.99
tpch_q11/duckdb:duckdb 19478769 18940931 1.03
tpch_q12/duckdb:duckdb 92355074 91182277 1.01
tpch_q13/duckdb:duckdb 242116861 239203660 1.01
tpch_q14/duckdb:duckdb 84247539 84562510 1.00
tpch_q15/duckdb:duckdb 84106125 82935485 1.01
tpch_q16/duckdb:duckdb 78910862 76608556 1.03
tpch_q17/duckdb:duckdb 91144228 90371158 1.01
tpch_q18/duckdb:duckdb 240746678 237810359 1.01
tpch_q19/duckdb:duckdb 129541663 128191308 1.01
tpch_q20/duckdb:duckdb 125235299 124159577 1.01
tpch_q21/duckdb:duckdb 322710771 309716099 1.04
tpch_q22/duckdb:duckdb 71430460 68008893 1.05
File Size Changes (27 files changed, -0.0% overall, 14↑ 13↓)
File Scale Format Base HEAD Change %
part_1.vortex 10.0 vortex-compact 16.77 MB 17.07 MB +302.10 KB +1.8%
partsupp_1.vortex 10.0 vortex-compact 104.78 MB 105.92 MB +1.14 MB +1.1%
part_0.vortex 10.0 vortex-file-compressed 24.70 MB 24.88 MB +185.62 KB +0.7%
part_0.vortex 10.0 vortex-compact 16.93 MB 17.01 MB +82.38 KB +0.5%
supplier_0.vortex 10.0 vortex-file-compressed 5.70 MB 5.72 MB +14.86 KB +0.3%
lineitem_3.vortex 10.0 vortex-file-compressed 129.25 MB 129.45 MB +206.66 KB +0.2%
lineitem_10.vortex 10.0 vortex-file-compressed 129.58 MB 129.71 MB +127.59 KB +0.1%
lineitem_8.vortex 10.0 vortex-file-compressed 129.18 MB 129.26 MB +85.92 KB +0.1%
partsupp_0.vortex 10.0 vortex-compact 105.14 MB 105.20 MB +60.00 KB +0.1%
lineitem_9.vortex 10.0 vortex-file-compressed 129.23 MB 129.29 MB +60.55 KB +0.0%
customer_0.vortex 10.0 vortex-file-compressed 88.51 MB 88.53 MB +26.04 KB +0.0%
lineitem_1.vortex 10.0 vortex-file-compressed 129.27 MB 129.30 MB +26.08 KB +0.0%
lineitem_6.vortex 10.0 vortex-file-compressed 129.39 MB 129.41 MB +20.36 KB +0.0%
customer_0.vortex 10.0 vortex-compact 74.09 MB 74.09 MB +296 B +0.0%
lineitem_5.vortex 10.0 vortex-file-compressed 129.69 MB 129.68 MB 9.24 KB -0.0%
lineitem_2.vortex 10.0 vortex-file-compressed 129.39 MB 129.38 MB 12.38 KB -0.0%
lineitem_0.vortex 10.0 vortex-file-compressed 129.49 MB 129.44 MB 51.42 KB -0.0%
partsupp_0.vortex 10.0 vortex-file-compressed 119.75 MB 119.70 MB 56.62 KB -0.0%
partsupp_1.vortex 10.0 vortex-file-compressed 119.78 MB 119.71 MB 71.34 KB -0.1%
lineitem_12.vortex 10.0 vortex-file-compressed 129.55 MB 129.44 MB 108.17 KB -0.1%
lineitem_4.vortex 10.0 vortex-file-compressed 129.38 MB 129.23 MB 146.38 KB -0.1%
lineitem_7.vortex 10.0 vortex-file-compressed 129.48 MB 129.33 MB 151.53 KB -0.1%
part_1.vortex 10.0 vortex-file-compressed 24.91 MB 24.88 MB 34.08 KB -0.1%
lineitem_11.vortex 10.0 vortex-file-compressed 129.29 MB 129.04 MB 254.42 KB -0.2%
orders_0.vortex 10.0 vortex-file-compressed 133.29 MB 132.81 MB 498.84 KB -0.4%
orders_2.vortex 10.0 vortex-file-compressed 134.50 MB 133.94 MB 566.93 KB -0.4%
orders_1.vortex 10.0 vortex-file-compressed 134.76 MB 134.07 MB 700.73 KB -0.5%

Totals:

  • vortex-compact: 1.93 GB → 1.93 GB (+0.1%)
  • vortex-file-compressed: 2.41 GB → 2.41 GB (-0.1%)

@github-actions

github-actions Bot commented Jun 22, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: Random Access

Vortex (geomean): 0.753x ✅
Parquet (geomean): 0.902x ➖

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
unknown / unknown (0.821x ✅, 32↑ 4↓)
name PR f212fb0 (ns) base f9ab66b (ns) ratio (PR/base)
random-access/feature-vectors/correlated/lance-tokio-local-disk 🚀 371658 3070487 0.12
random-access/feature-vectors/correlated/lance-tokio-local-disk-footer 1022329 1081226 0.95
random-access/feature-vectors/correlated/parquet-tokio-local-disk 8189549020 8877881973 0.92
random-access/feature-vectors/correlated/parquet-tokio-local-disk-footer 8186694452 8650945448 0.95
random-access/feature-vectors/correlated/vortex-tokio-local-disk 🚀 3040597 4074784 0.75
random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer 🚀 2387500 3825928 0.62
random-access/feature-vectors/uniform/lance-tokio-local-disk 1116671 1209759 0.92
random-access/feature-vectors/uniform/lance-tokio-local-disk-footer 1819611 1901589 0.96
random-access/feature-vectors/uniform/parquet-tokio-local-disk 8172553544 8705315081 0.94
random-access/feature-vectors/uniform/parquet-tokio-local-disk-footer 8101944145 8706599036 0.93
random-access/feature-vectors/uniform/vortex-tokio-local-disk 🚀 3349477 4775111 0.70
random-access/feature-vectors/uniform/vortex-tokio-local-disk-footer 🚀 5487650 7453485 0.74
random-access/lance-tokio-local-disk 641179 641989 1.00
random-access/lance-tokio-local-disk-footer 1257483 1330743 0.94
random-access/nested-lists/correlated/lance-tokio-local-disk 🚀 213618 244839 0.87
random-access/nested-lists/correlated/lance-tokio-local-disk-footer 550625 610329 0.90
random-access/nested-lists/correlated/parquet-tokio-local-disk 🚀 124826949 175962597 0.71
random-access/nested-lists/correlated/parquet-tokio-local-disk-footer 🚀 125757639 175968536 0.71
random-access/nested-lists/correlated/vortex-tokio-local-disk 🚀 322488 445892 0.72
random-access/nested-lists/correlated/vortex-tokio-local-disk-footer 🚀 417167 760035 0.55
random-access/nested-lists/uniform/lance-tokio-local-disk 959734 1063061 0.90
random-access/nested-lists/uniform/lance-tokio-local-disk-footer 🚀 1278108 1673104 0.76
random-access/nested-lists/uniform/parquet-tokio-local-disk 🚀 126467083 147564103 0.86
random-access/nested-lists/uniform/parquet-tokio-local-disk-footer 126346290 137480235 0.92
random-access/nested-lists/uniform/vortex-tokio-local-disk 🚀 1807326 2370670 0.76
random-access/nested-lists/uniform/vortex-tokio-local-disk-footer 🚀 1941871 2315369 0.84
random-access/nested-structs/correlated/lance-tokio-local-disk 🚀 342353 385192 0.89
random-access/nested-structs/correlated/lance-tokio-local-disk-footer 🚀 518508 587923 0.88
random-access/nested-structs/correlated/parquet-tokio-local-disk 🚀 19641714 28226200 0.70
random-access/nested-structs/correlated/parquet-tokio-local-disk-footer 🚀 19988125 30769183 0.65
random-access/nested-structs/correlated/vortex-tokio-local-disk 🚀 396568 473970 0.84
random-access/nested-structs/correlated/vortex-tokio-local-disk-footer 🚀 526753 672995 0.78
random-access/nested-structs/uniform/lance-tokio-local-disk 🚀 2455906 2930863 0.84
random-access/nested-structs/uniform/lance-tokio-local-disk-footer 2556890 2668824 0.96
random-access/nested-structs/uniform/parquet-tokio-local-disk 🚀 20136752 29102425 0.69
random-access/nested-structs/uniform/parquet-tokio-local-disk-footer 🚀 20176213 26993959 0.75
random-access/nested-structs/uniform/vortex-tokio-local-disk 🚀 1031814 1583778 0.65
random-access/nested-structs/uniform/vortex-tokio-local-disk-footer 🚀 1231074 1950000 0.63
random-access/parquet-tokio-local-disk 🚨 199221778 164052472 1.21
random-access/parquet-tokio-local-disk-footer 🚨 196998399 163268214 1.21
random-access/taxi/correlated/lance-tokio-local-disk 926516 960610 0.96
random-access/taxi/correlated/lance-tokio-local-disk-footer 🚀 1758677 1973180 0.89
random-access/taxi/correlated/parquet-tokio-local-disk 🚨 299718951 246273580 1.22
random-access/taxi/correlated/parquet-tokio-local-disk-footer 🚨 294987460 246085294 1.20
random-access/taxi/correlated/vortex-tokio-local-disk 🚀 1033189 1233103 0.84
random-access/taxi/correlated/vortex-tokio-local-disk-footer 🚀 1595040 2015919 0.79
random-access/taxi/uniform/lance-tokio-local-disk 9026885 9658816 0.93
random-access/taxi/uniform/lance-tokio-local-disk-footer 9826295 10096380 0.97
random-access/taxi/uniform/parquet-tokio-local-disk 286960114 269242449 1.07
random-access/taxi/uniform/parquet-tokio-local-disk-footer 274331927 282589768 0.97
random-access/taxi/uniform/vortex-tokio-local-disk 🚀 3291370 3877992 0.85
random-access/taxi/uniform/vortex-tokio-local-disk-footer 🚀 4109972 4690876 0.88
random-access/vortex-tokio-local-disk 🚀 663104 758791 0.87
random-access/vortex-tokio-local-disk-footer 🚀 1109000 1296243 0.86

@github-actions

github-actions Bot commented Jun 22, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +10.4%
Engines: DataFusion No clear signal (+9.5%, environment too noisy confidence) · DuckDB No clear signal (+11.4%, environment too noisy confidence)
Vortex (geomean): 1.040x ➖
Parquet (geomean): 0.942x ➖
Shifts: Parquet (control) -5.8% · Median polish -1.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.987x ➖, 1↑ 3↓)
name PR f212fb0 (ns) base ba700ca (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 902063526 1024914387 0.88
tpch_q02/datafusion:vortex-file-compressed 1286045714 1379359550 0.93
tpch_q03/datafusion:vortex-file-compressed 1160333588 1079289431 1.08
tpch_q04/datafusion:vortex-file-compressed 693425728 597634466 1.16
tpch_q05/datafusion:vortex-file-compressed 1137857010 1106395104 1.03
tpch_q06/datafusion:vortex-file-compressed 726072764 755665224 0.96
tpch_q07/datafusion:vortex-file-compressed 🚨 1683703825 1113160684 1.51
tpch_q08/datafusion:vortex-file-compressed 🚨 2137978925 1598894903 1.34
tpch_q09/datafusion:vortex-file-compressed 1622402164 1799344159 0.90
tpch_q10/datafusion:vortex-file-compressed 1181074058 1189185777 0.99
tpch_q11/datafusion:vortex-file-compressed 688343945 603039198 1.14
tpch_q12/datafusion:vortex-file-compressed 946574931 926324093 1.02
tpch_q13/datafusion:vortex-file-compressed 🚀 459987808 686063726 0.67
tpch_q14/datafusion:vortex-file-compressed 645852777 678654606 0.95
tpch_q15/datafusion:vortex-file-compressed 1118872566 1130958403 0.99
tpch_q16/datafusion:vortex-file-compressed 470384040 552081131 0.85
tpch_q17/datafusion:vortex-file-compressed 🚨 1631085504 1233668776 1.32
tpch_q18/datafusion:vortex-file-compressed 1336596625 1282512835 1.04
tpch_q19/datafusion:vortex-file-compressed 1101438791 1334830450 0.83
tpch_q20/datafusion:vortex-file-compressed 1022322261 1240208142 0.82
tpch_q21/datafusion:vortex-file-compressed 1617697120 1770745249 0.91
tpch_q22/datafusion:vortex-file-compressed 700464967 925655370 0.76
datafusion / vortex-compact (0.956x ➖, 1↑ 1↓)
name PR f212fb0 (ns) base ba700ca (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 1077988636 854193018 1.26
tpch_q02/datafusion:vortex-compact 1216387473 1068239660 1.14
tpch_q03/datafusion:vortex-compact 1033123890 1004853800 1.03
tpch_q04/datafusion:vortex-compact 522618017 607321790 0.86
tpch_q05/datafusion:vortex-compact 1414005154 1230199351 1.15
tpch_q06/datafusion:vortex-compact 727581923 822263215 0.88
tpch_q07/datafusion:vortex-compact 1206134085 1284734269 0.94
tpch_q08/datafusion:vortex-compact 1797427359 2166011268 0.83
tpch_q09/datafusion:vortex-compact 1365064818 1872638239 0.73
tpch_q10/datafusion:vortex-compact 1314970374 1468868580 0.90
tpch_q11/datafusion:vortex-compact 620688712 882350224 0.70
tpch_q12/datafusion:vortex-compact 982023384 1129061290 0.87
tpch_q13/datafusion:vortex-compact 🚨 646340167 494618131 1.31
tpch_q14/datafusion:vortex-compact 791491337 713458855 1.11
tpch_q15/datafusion:vortex-compact 1165050869 1239112005 0.94
tpch_q16/datafusion:vortex-compact 🚀 432575498 659276370 0.66
tpch_q17/datafusion:vortex-compact 1492700443 1512541038 0.99
tpch_q18/datafusion:vortex-compact 1264278667 1341440727 0.94
tpch_q19/datafusion:vortex-compact 1740223200 1362622750 1.28
tpch_q20/datafusion:vortex-compact 1449452690 1346859470 1.08
tpch_q21/datafusion:vortex-compact 1646402223 1933219304 0.85
tpch_q22/datafusion:vortex-compact 755881828 796763993 0.95
datafusion / parquet (0.887x ➖, 5↑ 2↓)
name PR f212fb0 (ns) base ba700ca (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 1014089262 1006821736 1.01
tpch_q02/datafusion:parquet 1501156024 1197002534 1.25
tpch_q03/datafusion:parquet 1519664718 1758984562 0.86
tpch_q04/datafusion:parquet 736909133 694768702 1.06
tpch_q05/datafusion:parquet 1816967727 2164301756 0.84
tpch_q06/datafusion:parquet 908872655 1152202984 0.79
tpch_q07/datafusion:parquet 1629112444 1827320826 0.89
tpch_q08/datafusion:parquet 2130393297 2279499759 0.93
tpch_q09/datafusion:parquet 🚀 1790098760 2716007004 0.66
tpch_q10/datafusion:parquet 5718623561 4430023297 1.29
tpch_q11/datafusion:parquet 🚀 1416271858 2226867233 0.64
tpch_q12/datafusion:parquet 973517488 1107542602 0.88
tpch_q13/datafusion:parquet 🚀 1116225084 1642230770 0.68
tpch_q14/datafusion:parquet 🚀 937910716 1618948566 0.58
tpch_q15/datafusion:parquet 1710376995 2184826775 0.78
tpch_q16/datafusion:parquet 🚀 652846685 1004282916 0.65
tpch_q17/datafusion:parquet 🚨 2602155054 1741682752 1.49
tpch_q18/datafusion:parquet 🚨 3282300156 2200454159 1.49
tpch_q19/datafusion:parquet 1260715998 1548764265 0.81
tpch_q20/datafusion:parquet 2219912204 2185721362 1.02
tpch_q21/datafusion:parquet 2152075157 2566419026 0.84
tpch_q22/datafusion:parquet 1234091405 1609764745 0.77
duckdb / vortex-file-compressed (1.130x ➖, 0↑ 5↓)
name PR f212fb0 (ns) base ba700ca (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 651296462 753763640 0.86
tpch_q02/duckdb:vortex-file-compressed 🚨 1826803293 1404233847 1.30
tpch_q03/duckdb:vortex-file-compressed 1247629743 1141091315 1.09
tpch_q04/duckdb:vortex-file-compressed 1034634428 950568001 1.09
tpch_q05/duckdb:vortex-file-compressed 🚨 1816976235 1300319169 1.40
tpch_q06/duckdb:vortex-file-compressed 774512573 661371234 1.17
tpch_q07/duckdb:vortex-file-compressed 1629661189 1363839195 1.19
tpch_q08/duckdb:vortex-file-compressed 2104433526 1873523912 1.12
tpch_q09/duckdb:vortex-file-compressed 2225631682 2105017881 1.06
tpch_q10/duckdb:vortex-file-compressed 🚨 2411332222 1692230951 1.42
tpch_q11/duckdb:vortex-file-compressed 856365927 747010644 1.15
tpch_q12/duckdb:vortex-file-compressed 1505230240 1380091853 1.09
tpch_q13/duckdb:vortex-file-compressed 910724594 920220337 0.99
tpch_q14/duckdb:vortex-file-compressed 772990304 828100922 0.93
tpch_q15/duckdb:vortex-file-compressed 766884432 699982439 1.10
tpch_q16/duckdb:vortex-file-compressed 🚨 748490965 564583509 1.33
tpch_q17/duckdb:vortex-file-compressed 1339513310 1251443949 1.07
tpch_q18/duckdb:vortex-file-compressed 1240842255 1277352710 0.97
tpch_q19/duckdb:vortex-file-compressed 1026961269 876744587 1.17
tpch_q20/duckdb:vortex-file-compressed 1744921401 1537302638 1.14
tpch_q21/duckdb:vortex-file-compressed 2548312750 2384692009 1.07
tpch_q22/duckdb:vortex-file-compressed 🚨 588699884 440239301 1.34
duckdb / vortex-compact (1.100x ➖, 0↑ 1↓)
name PR f212fb0 (ns) base ba700ca (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 748074581 705940374 1.06
tpch_q02/duckdb:vortex-compact 1628850965 1396503960 1.17
tpch_q03/duckdb:vortex-compact 1261474892 1383935955 0.91
tpch_q04/duckdb:vortex-compact 896668434 709647744 1.26
tpch_q05/duckdb:vortex-compact 🚨 1722790541 1181887797 1.46
tpch_q06/duckdb:vortex-compact 667467206 654135585 1.02
tpch_q07/duckdb:vortex-compact 1683546966 1425129669 1.18
tpch_q08/duckdb:vortex-compact 2198953794 1707507519 1.29
tpch_q09/duckdb:vortex-compact 1873744965 2107739964 0.89
tpch_q10/duckdb:vortex-compact 1937434120 1644198230 1.18
tpch_q11/duckdb:vortex-compact 909325240 750137336 1.21
tpch_q12/duckdb:vortex-compact 1374050457 1536455873 0.89
tpch_q13/duckdb:vortex-compact 937645448 880606112 1.06
tpch_q14/duckdb:vortex-compact 933120810 790550594 1.18
tpch_q15/duckdb:vortex-compact 702441596 625141920 1.12
tpch_q16/duckdb:vortex-compact 480244929 508574682 0.94
tpch_q17/duckdb:vortex-compact 1218352917 1115484540 1.09
tpch_q18/duckdb:vortex-compact 1105683262 1177325215 0.94
tpch_q19/duckdb:vortex-compact 1016094920 993735926 1.02
tpch_q20/duckdb:vortex-compact 1803498369 1414895019 1.27
tpch_q21/duckdb:vortex-compact 2173622417 2120578992 1.03
tpch_q22/duckdb:vortex-compact 736425013 608820637 1.21
duckdb / parquet (1.001x ➖, 0↑ 0↓)
name PR f212fb0 (ns) base ba700ca (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 1064343382 1272818235 0.84
tpch_q02/duckdb:parquet 1521204590 1867964092 0.81
tpch_q03/duckdb:parquet 2211203319 2319934366 0.95
tpch_q04/duckdb:parquet 1338046681 1484359634 0.90
tpch_q05/duckdb:parquet 2600716404 2871888697 0.91
tpch_q06/duckdb:parquet 991363627 1110570495 0.89
tpch_q07/duckdb:parquet 2282174418 2466902733 0.93
tpch_q08/duckdb:parquet 2838478453 3121088705 0.91
tpch_q09/duckdb:parquet 3146476724 3315568148 0.95
tpch_q10/duckdb:parquet 4294896517 4186027633 1.03
tpch_q11/duckdb:parquet 1200736917 1245629225 0.96
tpch_q12/duckdb:parquet 1603714977 1712349237 0.94
tpch_q13/duckdb:parquet 1953554162 1700514629 1.15
tpch_q14/duckdb:parquet 1835109918 1566917082 1.17
tpch_q15/duckdb:parquet 1472277366 1384039339 1.06
tpch_q16/duckdb:parquet 1231900184 1150038445 1.07
tpch_q17/duckdb:parquet 2040971981 1694990223 1.20
tpch_q18/duckdb:parquet 1902665700 1953389893 0.97
tpch_q19/duckdb:parquet 2176325233 1827819561 1.19
tpch_q20/duckdb:parquet 3078125686 2616180644 1.18
tpch_q21/duckdb:parquet 2697627744 2349898120 1.15
tpch_q22/duckdb:parquet 1426320398 1421294232 1.00

@github-actions

github-actions Bot commented Jun 22, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: Appian on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.9%
Engines: DataFusion No clear signal (-0.7%, low confidence) · DuckDB No clear signal (-0.6%, low confidence)
Vortex (geomean): 1.009x ➖
Parquet (geomean): 1.012x ➖
Shifts: Parquet (control) +1.2% · Median polish +0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.014x ➖, 0↑ 0↓)
name PR f212fb0 (ns) base ba700ca (ns) ratio (PR/base)
appian_q01/datafusion:vortex-file-compressed 129995329 124878455 1.04
appian_q02/datafusion:vortex-file-compressed 594221641 603931225 0.98
appian_q03/datafusion:vortex-file-compressed 331533753 337808115 0.98
appian_q04/datafusion:vortex-file-compressed 45013254981 42391222596 1.06
appian_q05/datafusion:vortex-file-compressed 257597746 249556415 1.03
appian_q06/datafusion:vortex-file-compressed 336407236 332860848 1.01
appian_q07/datafusion:vortex-file-compressed 418275275 422907983 0.99
appian_q08/datafusion:vortex-file-compressed 1966424092 1935918899 1.02
datafusion / parquet (1.021x ➖, 0↑ 0↓)
name PR f212fb0 (ns) base ba700ca (ns) ratio (PR/base)
appian_q01/datafusion:parquet 128055012 133313651 0.96
appian_q02/datafusion:parquet 616180070 606192651 1.02
appian_q03/datafusion:parquet 345453282 328211644 1.05
appian_q04/datafusion:parquet 45022170466 43304994579 1.04
appian_q05/datafusion:parquet 280781310 272093548 1.03
appian_q06/datafusion:parquet 360022149 352289734 1.02
appian_q07/datafusion:parquet 449004432 437671463 1.03
appian_q08/datafusion:parquet 1959087521 1919636204 1.02
duckdb / vortex-file-compressed (1.003x ➖, 0↑ 0↓)
name PR f212fb0 (ns) base ba700ca (ns) ratio (PR/base)
appian_q01/duckdb:vortex-file-compressed 196673521 194900345 1.01
appian_q02/duckdb:vortex-file-compressed 636312305 626410519 1.02
appian_q03/duckdb:vortex-file-compressed 264903817 264607837 1.00
appian_q04/duckdb:vortex-file-compressed 1337847122 1337751517 1.00
appian_q05/duckdb:vortex-file-compressed 295542814 295976805 1.00
appian_q06/duckdb:vortex-file-compressed 802603070 812669121 0.99
appian_q07/duckdb:vortex-file-compressed 350094854 350525090 1.00
appian_q08/duckdb:vortex-file-compressed 1308594349 1288283367 1.02
duckdb / parquet (1.003x ➖, 0↑ 0↓)
name PR f212fb0 (ns) base ba700ca (ns) ratio (PR/base)
appian_q01/duckdb:parquet 202781336 201778218 1.00
appian_q02/duckdb:parquet 605845999 606284558 1.00
appian_q03/duckdb:parquet 291322803 287655774 1.01
appian_q04/duckdb:parquet 1332343261 1333130838 1.00
appian_q05/duckdb:parquet 316764631 309618133 1.02
appian_q06/duckdb:parquet 786923179 800186234 0.98
appian_q07/duckdb:parquet 362879482 362618731 1.00
appian_q08/duckdb:parquet 1276932235 1276338928 1.00
duckdb / duckdb (0.990x ➖, 0↑ 0↓)
name PR f212fb0 (ns) base ba700ca (ns) ratio (PR/base)
appian_q01/duckdb:duckdb 173919417 172328987 1.01
appian_q02/duckdb:duckdb 554381117 558420419 0.99
appian_q03/duckdb:duckdb 389223466 397506376 0.98
appian_q04/duckdb:duckdb 1312457670 1320368605 0.99
appian_q05/duckdb:duckdb 285065261 294047773 0.97
appian_q06/duckdb:duckdb 793090902 799056974 0.99
appian_q07/duckdb:duckdb 329809000 332639220 0.99
appian_q08/duckdb:duckdb 1229843131 1235879338 1.00
File Size Changes (4 files changed, -0.0% overall, 2↑ 2↓)
File Scale Format Base HEAD Change %
orderview.vortex 1.0 vortex-file-compressed 76.11 MB 76.13 MB +19.88 KB +0.0%
addressview.vortex 1.0 vortex-file-compressed 34.61 MB 34.62 MB +32 B +0.0%
creditcardview.vortex 1.0 vortex-file-compressed 58.34 MB 58.32 MB 22.36 KB -0.0%
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%

Totals:

  • vortex-compact: 271.94 MB → 271.68 MB (-0.1%)
  • vortex-file-compressed: 476.47 MB → 476.47 MB (-0.0%)

@github-actions

github-actions Bot commented Jun 22, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: Compression

Vortex (geomean): 1.006x ➖
Parquet (geomean): 1.024x ➖

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
unknown / unknown (1.032x ➖, 2↑ 16↓)
name PR f212fb0 (ns) base ba700ca (ns) ratio (PR/base)
compress time/Arade 1736048372 1654031331 1.05
compress time/Bimbo 6779525711 6352831474 1.07
compress time/CMSprovider 5004265200 4915355834 1.02
compress time/Euro2016 766945669 739346376 1.04
compress time/Food 🚨 697058588 612942878 1.14
compress time/HashTags 1331621503 1303916522 1.02
compress time/TPC-H l_comment canonical 2915428814 2764210921 1.05
compress time/TPC-H l_comment chunked 2944630661 2764304188 1.07
compress time/taxi 883999230 855616399 1.03
compress time/wide table cols=100 chunks=1 rows=1000 12498099 12031167 1.04
compress time/wide table cols=100 chunks=50 rows=1000 12872169 11813635 1.09
compress time/wide table cols=1000 chunks=1 rows=1000 141469707 131990514 1.07
compress time/wide table cols=1000 chunks=50 rows=1000 140896370 133227897 1.06
compress time/wide table cols=10000 chunks=1 rows=1000 1622797855 1558327710 1.04
compress time/wide table cols=10000 chunks=50 rows=1000 1613093618 1546703508 1.04
decompress time/Arade 28471181 26514989 1.07
decompress time/Bimbo 🚨 93970386 80700227 1.16
decompress time/CMSprovider 🚨 103422568 84865845 1.22
decompress time/Euro2016 21543387 20220204 1.07
decompress time/Food 8945658 8312638 1.08
decompress time/HashTags 97588451 96427621 1.01
decompress time/TPC-H l_comment canonical 🚨 46171475 41865296 1.10
decompress time/TPC-H l_comment chunked 🚨 47001737 41602149 1.13
decompress time/taxi 🚨 18258513 15087552 1.21
decompress time/wide table cols=100 chunks=1 rows=1000 2808297 2650086 1.06
decompress time/wide table cols=100 chunks=50 rows=1000 2696405 2675907 1.01
decompress time/wide table cols=1000 chunks=1 rows=1000 23174703 22343000 1.04
decompress time/wide table cols=1000 chunks=50 rows=1000 24406389 22821266 1.07
decompress time/wide table cols=10000 chunks=1 rows=1000 🚨 283236752 252273802 1.12
decompress time/wide table cols=10000 chunks=50 rows=1000 259721492 238276746 1.09
parquet size/Arade 258014282 258014282 1.00
parquet size/Bimbo 384517292 384517292 1.00
parquet size/CMSprovider 376885545 376885545 1.00
parquet size/Euro2016 122975499 122975499 1.00
parquet size/Food 35699500 35699500 1.00
parquet size/HashTags 133510943 133510943 1.00
parquet size/TPC-H l_comment canonical 158358238 158358238 1.00
parquet size/TPC-H l_comment chunked 158358238 158358238 1.00
parquet size/taxi 55283635 55283635 1.00
parquet size/wide table cols=100 chunks=1 rows=1000 932404 932404 1.00
parquet size/wide table cols=100 chunks=50 rows=1000 932404 932404 1.00
parquet size/wide table cols=1000 chunks=1 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=1000 chunks=50 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=10000 chunks=1 rows=1000 93240004 93240004 1.00
parquet size/wide table cols=10000 chunks=50 rows=1000 93240004 93240004 1.00
parquet_rs-zstd compress time/Arade 2726271236 2592705084 1.05
parquet_rs-zstd compress time/Bimbo 13248388247 12514289909 1.06
parquet_rs-zstd compress time/CMSprovider 7460248334 6829656164 1.09
parquet_rs-zstd compress time/Euro2016 1379157052 1310218438 1.05
parquet_rs-zstd compress time/Food 821467528 800256427 1.03
parquet_rs-zstd compress time/HashTags 🚨 2396993610 2147924631 1.12
parquet_rs-zstd compress time/TPC-H l_comment canonical 3379746730 3202326670 1.06
parquet_rs-zstd compress time/TPC-H l_comment chunked 3378979095 3173341849 1.06
parquet_rs-zstd compress time/taxi 1247292585 1182820549 1.05
parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000 🚨 7102599 6190638 1.15
parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000 🚨 7342282 6205640 1.18
parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000 78004454 74496116 1.05
parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000 80559541 76276938 1.06
parquet_rs-zstd compress time/wide table cols=10000 chunks=1 rows=1000 819485099 802316024 1.02
parquet_rs-zstd compress time/wide table cols=10000 chunks=50 rows=1000 806344480 810274010 1.00
parquet_rs-zstd decompress time/Arade 630902393 631371312 1.00
parquet_rs-zstd decompress time/Bimbo 1740459228 1692178105 1.03
parquet_rs-zstd decompress time/CMSprovider 1792677307 1719182686 1.04
parquet_rs-zstd decompress time/Euro2016 397416510 375394462 1.06
parquet_rs-zstd decompress time/Food 202752030 198646664 1.02
parquet_rs-zstd decompress time/HashTags 🚨 733385759 631331374 1.16
parquet_rs-zstd decompress time/TPC-H l_comment canonical 616557780 597702304 1.03
parquet_rs-zstd decompress time/TPC-H l_comment chunked 621627963 588244328 1.06
parquet_rs-zstd decompress time/taxi 255889771 245281674 1.04
parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000 3112012 2837013 1.10
parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000 🚨 3271531 2814898 1.16
parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000 34023561 31758756 1.07
parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000 35246970 33762818 1.04
parquet_rs-zstd decompress time/wide table cols=10000 chunks=1 rows=1000 356020864 345591710 1.03
parquet_rs-zstd decompress time/wide table cols=10000 chunks=50 rows=1000 356354235 354759934 1.00
vortex-file-compressed size/Arade 145358060 145358060 1.00
vortex-file-compressed size/Bimbo 467257556 467257556 1.00
vortex-file-compressed size/CMSprovider 417784332 417782588 1.00
vortex-file-compressed size/Euro2016 156984148 157888084 0.99
vortex-file-compressed size/Food 41976800 41976800 1.00
vortex-file-compressed size/HashTags 185062996 184712484 1.00
vortex-file-compressed size/TPC-H l_comment canonical 171878888 172239072 1.00
vortex-file-compressed size/TPC-H l_comment chunked 172130984 172066256 1.00
vortex-file-compressed size/taxi 52296276 52296276 1.00
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000 932512 932512 1.00
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000 932512 932512 1.00
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000 9309712 9309712 1.00
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000 9309712 9309712 1.00
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000 93117712 93117712 1.00
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000 93117712 93117712 1.00
vortex:parquet-zstd ratio compress time/Arade 0 0 1.00
vortex:parquet-zstd ratio compress time/Bimbo 0 0 1.01
vortex:parquet-zstd ratio compress time/CMSprovider 0 0 0.93
vortex:parquet-zstd ratio compress time/Euro2016 0 0 0.99
vortex:parquet-zstd ratio compress time/Food 🚨 0 0 1.11
vortex:parquet-zstd ratio compress time/HashTags 0 0 0.92
vortex:parquet-zstd ratio compress time/TPC-H l_comment canonical 0 0 1.00
vortex:parquet-zstd ratio compress time/TPC-H l_comment chunked 0 0 1.00
vortex:parquet-zstd ratio compress time/taxi 0 0 0.98
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=1 rows=1000 1 1 0.91
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=50 rows=1000 1 1 0.92
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=1 rows=1000 1 1 1.02
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=50 rows=1000 1 1 1.00
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=1 rows=1000 1 1 1.02
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=50 rows=1000 2 1 1.05
vortex:parquet-zstd ratio decompress time/Arade 0 0 1.07
vortex:parquet-zstd ratio decompress time/Bimbo 🚨 0 0 1.13
vortex:parquet-zstd ratio decompress time/CMSprovider 🚨 0 0 1.17
vortex:parquet-zstd ratio decompress time/Euro2016 0 0 1.01
vortex:parquet-zstd ratio decompress time/Food 0 0 1.05
vortex:parquet-zstd ratio decompress time/HashTags 🚀 0 0 0.87
vortex:parquet-zstd ratio decompress time/TPC-H l_comment canonical 0 0 1.07
vortex:parquet-zstd ratio decompress time/TPC-H l_comment chunked 0 0 1.07
vortex:parquet-zstd ratio decompress time/taxi 🚨 0 0 1.16
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=1 rows=1000 0 0 0.97
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=50 rows=1000 🚀 0 0 0.87
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=1 rows=1000 0 0 0.97
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=50 rows=1000 0 0 1.02
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=1 rows=1000 0 0 1.09
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=50 rows=1000 0 0 1.09
vortex:parquet-zstd size/Arade 0 0 1.00
vortex:parquet-zstd size/Bimbo 1 1 1.00
vortex:parquet-zstd size/CMSprovider 1 1 1.00
vortex:parquet-zstd size/Euro2016 1 1 0.99
vortex:parquet-zstd size/Food 1 1 1.00
vortex:parquet-zstd size/HashTags 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment canonical 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment chunked 1 1 1.00
vortex:parquet-zstd size/taxi 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=1 rows=1000 1 1 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=50 rows=1000 1 1 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=50 rows=1000 0 0 1.00

@myrrc myrrc force-pushed the myrrc/rle-duckdb branch from f1a627e to a4374a4 Compare June 23, 2026 15:14
@myrrc myrrc added the action/benchmark-sql-full Run SQL benchmarks with vortex-compact and SF=10 label Jun 23, 2026
@github-actions github-actions Bot removed the action/benchmark-sql-full Run SQL benchmarks with vortex-compact and SF=10 label Jun 23, 2026
@myrrc myrrc mentioned this pull request Jun 23, 2026
Closed
@myrrc myrrc force-pushed the myrrc/rle-duckdb branch 2 times, most recently from 91db8e3 to 0315036 Compare June 23, 2026 15:19
@myrrc myrrc added the action/benchmark-sql-full Run SQL benchmarks with vortex-compact and SF=10 label Jun 23, 2026
@github-actions github-actions Bot removed the action/benchmark-sql-full Run SQL benchmarks with vortex-compact and SF=10 label Jun 23, 2026
@myrrc myrrc force-pushed the myrrc/rle-duckdb branch from 0315036 to 2334309 Compare June 23, 2026 15:36
@myrrc
initial
f212fb0 
Signed-off-by: Mikhail Kot <[email protected]>
@myrrc myrrc force-pushed the myrrc/rle-duckdb branch from 2334309 to f212fb0 Compare June 23, 2026 15:36
@myrrc myrrc added the action/benchmark Trigger full benchmarks to run on this PR label Jun 23, 2026
@github-actions github-actions Bot removed the action/benchmark Trigger full benchmarks to run on this PR label Jun 23, 2026
@myrrc myrrc marked this pull request as ready for review June 23, 2026 15:49
@myrrc myrrc requested a review from a team June 23, 2026 15:49
@myrrc myrrc enabled auto-merge (squash) June 23, 2026 15:50
@myrrc myrrc requested a review from gatesn June 23, 2026 15:59
@myrrc myrrc merged commit b6ba850 into develop Jun 23, 2026
88 of 89 checks passed
@myrrc myrrc deleted the myrrc/rle-duckdb branch June 23, 2026 16:03
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@gatesn gatesn gatesn approved these changes

Assignees

No one assigned

Labels

changelog/performance A performance improvement ext/duckdb Relates to the DuckDB integration

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

Add a RLE array exporter to duckdb

2 participants

@myrrc @gatesn