Thanks to visit codestin.com
Credit goes to github.com

Skip to content

perf: executor use execute_parent kernel registry in execute_until#8448

Open
joseph-isaacs wants to merge 2 commits into
developfrom
ji/perf-executor-execute-parent
Open

perf: executor use execute_parent kernel registry in execute_until#8448
joseph-isaacs wants to merge 2 commits into
developfrom
ji/perf-executor-execute-parent

Conversation

@joseph-isaacs

@joseph-isaacs joseph-isaacs commented Jun 16, 2026

Copy link
Copy Markdown
Contributor

As part of #8445 we need to use execute_parent kernels for in execute_until.

This PR does that change

@joseph-isaacs
u
1195b83 
Signed-off-by: Joe Isaacs <[email protected]>
@joseph-isaacs
u
bb4f00f 
Signed-off-by: Joe Isaacs <[email protected]>
@joseph-isaacs joseph-isaacs requested a review from a team June 16, 2026 12:58
@joseph-isaacs joseph-isaacs added the changelog/performance A performance improvement label Jun 16, 2026
robert3005
robert3005 reviewed Jun 16, 2026
View reviewed changes
Comment thread vortex-array/src/executor.rs
let max_iterations = max_iterations();

let session = ctx.session().clone();
let kernels = session.get::<ArrayKernels>();

@robert3005 robert3005 Jun 16, 2026

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I would really like to get rid of this get method. The fact that it's a read that can cause a write can be very surprising

@joseph-isaacs joseph-isaacs Jun 16, 2026

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Only once, but ye

@joseph-isaacs joseph-isaacs enabled auto-merge (squash) June 16, 2026 13:22
@joseph-isaacs joseph-isaacs disabled auto-merge June 16, 2026 13:22
@codspeed-hq

codspeed-hq Bot commented Jun 16, 2026

Copy link
Copy Markdown

Merging this PR will degrade performance by 18.52%

⚠️ Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.

For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

❌ 28 regressed benchmarks
✅ 1098 untouched benchmarks
⏩ 429 skipped benchmarks1

Warning

Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
❌ Simulation chunked_bool_canonical_into[(1000, 10)] 20.3 µs 37.7 µs -46.09%
❌ Simulation dict_canonicalize_zipfian[16, 1000] 24 µs 36.6 µs -34.5%
❌ Simulation canonicalize[16, 2] 24.2 µs 36.9 µs -34.38%
❌ Simulation filter_powerlaw_by_correlated_runs[1000] 23.4 µs 33.3 µs -29.63%
❌ Simulation decompress_utf8[(1000, 4)] 38.6 µs 49.6 µs -22.24%
❌ Simulation take_struct_sequential_indices 50.6 µs 63.3 µs -20.04%
❌ Simulation chunked_varbinview_into_canonical[(1000, 10)] 176.9 µs 215.6 µs -17.96%
❌ Simulation search_index_mixed_out_of_range 256.3 µs 312 µs -17.85%
❌ Simulation search_index_above_max 256.2 µs 311.8 µs -17.83%
❌ Simulation search_index_below_min 256.2 µs 311.8 µs -17.83%
❌ Simulation search_index_full_range_random 256.6 µs 312.1 µs -17.8%
❌ Simulation search_index_in_range 256.7 µs 312.3 µs -17.79%
❌ Simulation decompress_rd[f64, (100000, 0.0)] 845.4 µs 1,025.7 µs -17.58%
❌ Simulation decode_bool_nullable[10000_10_alternating_mostly_valid] 59.1 µs 71.1 µs -16.82%
❌ Simulation i32_small_overlapping 40 µs 47.3 µs -15.53%
❌ Simulation take_fsl_nullable_random[16, 100] 70.3 µs 83.2 µs -15.46%
❌ Simulation decompress_rd[f32, (100000, 0.0)] 499.1 µs 588.2 µs -15.15%
❌ Simulation encode_varbin[(1000, 2)] 158.2 µs 184.1 µs -14.07%
❌ Simulation chunked_varbinview_opt_into_canonical[(100, 100)] 409.8 µs 472.6 µs -13.29%
❌ Simulation chunked_bool_canonical_into[(10, 1000)] 755.3 µs 865.8 µs -12.76%
... ... ... ... ... ...

ℹ️ Only the first 20 benchmarks are displayed. Go to the app to view all benchmarks.

Tip

Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.

Comparing ji/perf-executor-execute-parent (bb4f00f) with develop (e1c6ef5)

Open in CodSpeed

Footnotes

  1. 429 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports. ↩

@joseph-isaacs joseph-isaacs added the action/benchmark Trigger full benchmarks to run on this PR label Jun 17, 2026
@github-actions github-actions Bot removed the action/benchmark Trigger full benchmarks to run on this PR label Jun 17, 2026
@github-actions

github-actions Bot commented Jun 17, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done bb4f00f 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

github-actions Bot commented Jun 17, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling

Vortex (geomean): 1.045x ➖

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.045x ➖, 0↑ 2↓)
name PR bb4f00f (ns) base d257d09 (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 121810070 116727649 1.04
polarsignals_q01/datafusion:vortex-file-compressed 253554194 265350972 0.96
polarsignals_q02/datafusion:vortex-file-compressed 24794199 23500297 1.06
polarsignals_q03/datafusion:vortex-file-compressed 269161472 263832347 1.02
polarsignals_q04/datafusion:vortex-file-compressed 10116822 9818010 1.03
polarsignals_q05/datafusion:vortex-file-compressed 🚨 16317174 14529032 1.12
polarsignals_q06/datafusion:vortex-file-compressed 21054837 20656023 1.02
polarsignals_q07/datafusion:vortex-file-compressed 🚨 14363077 12706644 1.13
polarsignals_q08/datafusion:vortex-file-compressed 400092361 387457706 1.03
polarsignals_q09/datafusion:vortex-file-compressed 12784946 12175850 1.05

No file size changes detected.

@github-actions

github-actions Bot commented Jun 17, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.1%
Engines: DataFusion No clear signal (+0.6%, environment too noisy confidence) · DuckDB No clear signal (+1.6%, low confidence)
Vortex (geomean): 1.059x ➖
Parquet (geomean): 1.047x ➖
Shifts: Parquet (control) +4.7% · Median polish +4.5%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.081x ➖, 0↑ 3↓)
name PR bb4f00f (ns) base d257d09 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚨 6245099 5386197 1.16
fineweb_q01/datafusion:vortex-file-compressed 35381267 32663258 1.08
fineweb_q02/datafusion:vortex-file-compressed 39564254 40990965 0.97
fineweb_q03/datafusion:vortex-file-compressed 🚨 75885920 59602031 1.27
fineweb_q04/datafusion:vortex-file-compressed 292544171 276440868 1.06
fineweb_q05/datafusion:vortex-file-compressed 239945996 218390081 1.10
fineweb_q06/datafusion:vortex-file-compressed 🚨 57688513 51144012 1.13
fineweb_q07/datafusion:vortex-file-compressed 55961551 55482720 1.01
fineweb_q08/datafusion:vortex-file-compressed 23344805 23703672 0.98
datafusion / vortex-compact (1.009x ➖, 1↑ 1↓)
name PR bb4f00f (ns) base d257d09 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 🚨 6444485 5625805 1.15
fineweb_q01/datafusion:vortex-compact 🚀 102615608 120006839 0.86
fineweb_q02/datafusion:vortex-compact 106213035 103287085 1.03
fineweb_q03/datafusion:vortex-compact 889237907 868453279 1.02
fineweb_q04/datafusion:vortex-compact 963934718 923108533 1.04
fineweb_q05/datafusion:vortex-compact 841702000 836353546 1.01
fineweb_q06/datafusion:vortex-compact 489338769 467423469 1.05
fineweb_q07/datafusion:vortex-compact 490675830 467911716 1.05
fineweb_q08/datafusion:vortex-compact 22755398 24922806 0.91
datafusion / parquet (1.038x ➖, 0↑ 2↓)
name PR bb4f00f (ns) base d257d09 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 7144276 7377997 0.97
fineweb_q01/datafusion:parquet 296643626 306105699 0.97
fineweb_q02/datafusion:parquet 🚨 323120445 291901931 1.11
fineweb_q03/datafusion:parquet 🚨 312663516 279324590 1.12
fineweb_q04/datafusion:parquet 328159401 304904001 1.08
fineweb_q05/datafusion:parquet 312299522 309787801 1.01
fineweb_q06/datafusion:parquet 294169499 294560585 1.00
fineweb_q07/datafusion:parquet 286878315 282582169 1.02
fineweb_q08/datafusion:parquet 303240646 276545422 1.10
duckdb / vortex-file-compressed (1.100x ➖, 0↑ 4↓)
name PR bb4f00f (ns) base d257d09 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 3713884 3508300 1.06
fineweb_q01/duckdb:vortex-file-compressed 34501897 34989810 0.99
fineweb_q02/duckdb:vortex-file-compressed 38914094 40559867 0.96
fineweb_q03/duckdb:vortex-file-compressed 🚨 167370586 117781933 1.42
fineweb_q04/duckdb:vortex-file-compressed 278869685 266168712 1.05
fineweb_q05/duckdb:vortex-file-compressed 🚨 237955143 214114143 1.11
fineweb_q06/duckdb:vortex-file-compressed 🚨 55478991 48572915 1.14
fineweb_q07/duckdb:vortex-file-compressed 57220433 52584786 1.09
fineweb_q08/duckdb:vortex-file-compressed 🚨 24761020 21627192 1.14
duckdb / vortex-compact (1.047x ➖, 0↑ 0↓)
name PR bb4f00f (ns) base d257d09 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 4568745 4247127 1.08
fineweb_q01/duckdb:vortex-compact 110453287 107139372 1.03
fineweb_q02/duckdb:vortex-compact 114559851 113784846 1.01
fineweb_q03/duckdb:vortex-compact 894253875 858694063 1.04
fineweb_q04/duckdb:vortex-compact 933425878 901569694 1.04
fineweb_q05/duckdb:vortex-compact 848543239 803730547 1.06
fineweb_q06/duckdb:vortex-compact 477149753 463738702 1.03
fineweb_q07/duckdb:vortex-compact 511344441 479332206 1.07
fineweb_q08/duckdb:vortex-compact 22584619 20787352 1.09
duckdb / parquet (1.057x ➖, 0↑ 2↓)
name PR bb4f00f (ns) base d257d09 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 🚨 34387553 31209259 1.10
fineweb_q01/duckdb:parquet 91226354 84075814 1.09
fineweb_q02/duckdb:parquet 90255895 84475237 1.07
fineweb_q03/duckdb:parquet 327678518 317999543 1.03
fineweb_q04/duckdb:parquet 455547231 448579906 1.02
fineweb_q05/duckdb:parquet 425867299 415158982 1.03
fineweb_q06/duckdb:parquet 211285635 203543263 1.04
fineweb_q07/duckdb:parquet 225997712 215546343 1.05
fineweb_q08/duckdb:parquet 🚨 35588107 32327483 1.10
File Size Changes (1 files changed, -0.0% overall, 0↑ 1↓)
File Scale Format Base HEAD Change %
sample.vortex 1.0 vortex-file-compressed 1.43 GB 1.43 GB 464.67 KB -0.0%

Totals:

  • vortex-compact: 1.23 GB → 1.23 GB (0.0%)
  • vortex-file-compressed: 1.43 GB → 1.43 GB (-0.0%)

@github-actions

github-actions Bot commented Jun 17, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.6%
Engines: DataFusion No clear signal (+1.9%, low confidence) · DuckDB No clear signal (-2.9%, environment too noisy confidence)
Vortex (geomean): 0.987x ➖
Parquet (geomean): 0.992x ➖
Shifts: Parquet (control) -0.8% · Median polish -1.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.989x ➖, 0↑ 0↓)
name PR bb4f00f (ns) base d257d09 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 50039332 51625494 0.97
tpch_q02/datafusion:vortex-file-compressed 22505396 22591667 1.00
tpch_q03/datafusion:vortex-file-compressed 31137462 30598332 1.02
tpch_q04/datafusion:vortex-file-compressed 20037258 20458493 0.98
tpch_q05/datafusion:vortex-file-compressed 45548132 46429702 0.98
tpch_q06/datafusion:vortex-file-compressed 9717208 9966300 0.98
tpch_q07/datafusion:vortex-file-compressed 52610936 52686913 1.00
tpch_q08/datafusion:vortex-file-compressed 39818808 39196843 1.02
tpch_q09/datafusion:vortex-file-compressed 52709187 51593421 1.02
tpch_q10/datafusion:vortex-file-compressed 31965237 33121507 0.97
tpch_q11/datafusion:vortex-file-compressed 16390948 16986725 0.96
tpch_q12/datafusion:vortex-file-compressed 22683583 23038660 0.98
tpch_q13/datafusion:vortex-file-compressed 26833580 27132170 0.99
tpch_q14/datafusion:vortex-file-compressed 14639766 14908641 0.98
tpch_q15/datafusion:vortex-file-compressed 22447240 23079157 0.97
tpch_q16/datafusion:vortex-file-compressed 19837134 19405525 1.02
tpch_q17/datafusion:vortex-file-compressed 63965336 64364006 0.99
tpch_q18/datafusion:vortex-file-compressed 77285579 75816718 1.02
tpch_q19/datafusion:vortex-file-compressed 17243427 17083196 1.01
tpch_q20/datafusion:vortex-file-compressed 29789947 29868930 1.00
tpch_q21/datafusion:vortex-file-compressed 69091542 70670545 0.98
tpch_q22/datafusion:vortex-file-compressed 11688695 12450292 0.94
datafusion / vortex-compact (0.989x ➖, 0↑ 0↓)
name PR bb4f00f (ns) base d257d09 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 58737647 59797714 0.98
tpch_q02/datafusion:vortex-compact 25473711 25958042 0.98
tpch_q03/datafusion:vortex-compact 32714621 32858906 1.00
tpch_q04/datafusion:vortex-compact 21725353 21580718 1.01
tpch_q05/datafusion:vortex-compact 46463718 47964292 0.97
tpch_q06/datafusion:vortex-compact 12602158 12599911 1.00
tpch_q07/datafusion:vortex-compact 54885481 55631468 0.99
tpch_q08/datafusion:vortex-compact 41202818 42187631 0.98
tpch_q09/datafusion:vortex-compact 55816466 55106959 1.01
tpch_q10/datafusion:vortex-compact 35825515 36398997 0.98
tpch_q11/datafusion:vortex-compact 17542536 17530125 1.00
tpch_q12/datafusion:vortex-compact 29891639 29544618 1.01
tpch_q13/datafusion:vortex-compact 31260679 31785653 0.98
tpch_q14/datafusion:vortex-compact 18216603 19055243 0.96
tpch_q15/datafusion:vortex-compact 30641997 30180348 1.02
tpch_q16/datafusion:vortex-compact 24298884 24396049 1.00
tpch_q17/datafusion:vortex-compact 67011592 68520704 0.98
tpch_q18/datafusion:vortex-compact 75688552 76693536 0.99
tpch_q19/datafusion:vortex-compact 39005715 38980450 1.00
tpch_q20/datafusion:vortex-compact 34201003 34769932 0.98
tpch_q21/datafusion:vortex-compact 73595937 75300117 0.98
tpch_q22/datafusion:vortex-compact 13131868 13349914 0.98
datafusion / parquet (0.969x ➖, 1↑ 0↓)
name PR bb4f00f (ns) base d257d09 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 131517024 136267622 0.97
tpch_q02/datafusion:parquet 60966604 62898216 0.97
tpch_q03/datafusion:parquet 74877328 78504416 0.95
tpch_q04/datafusion:parquet 🚀 41989137 48460225 0.87
tpch_q05/datafusion:parquet 87914534 93694270 0.94
tpch_q06/datafusion:parquet 38517823 39958503 0.96
tpch_q07/datafusion:parquet 102895189 105075483 0.98
tpch_q08/datafusion:parquet 97294705 97500577 1.00
tpch_q09/datafusion:parquet 129326697 127086497 1.02
tpch_q10/datafusion:parquet 115770374 120794320 0.96
tpch_q11/datafusion:parquet 40261277 41605438 0.97
tpch_q12/datafusion:parquet 85546721 84387818 1.01
tpch_q13/datafusion:parquet 189279562 195897623 0.97
tpch_q14/datafusion:parquet 42590887 45366401 0.94
tpch_q15/datafusion:parquet 57345550 60720719 0.94
tpch_q16/datafusion:parquet 42089896 43524606 0.97
tpch_q17/datafusion:parquet 136975800 141013437 0.97
tpch_q18/datafusion:parquet 152995795 155138359 0.99
tpch_q19/datafusion:parquet 78103981 75134782 1.04
tpch_q20/datafusion:parquet 69148251 74870886 0.92
tpch_q21/datafusion:parquet 144846178 141274645 1.03
tpch_q22/datafusion:parquet 43367233 43787142 0.99
datafusion / arrow (0.984x ➖, 1↑ 1↓)
name PR bb4f00f (ns) base d257d09 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 🚀 56206477 64721764 0.87
tpch_q02/datafusion:arrow 16820325 18144949 0.93
tpch_q03/datafusion:arrow 31792213 33322641 0.95
tpch_q04/datafusion:arrow 26678009 25764879 1.04
tpch_q05/datafusion:arrow 58011645 55944267 1.04
tpch_q06/datafusion:arrow 🚨 23777238 21127392 1.13
tpch_q07/datafusion:arrow 103808067 103974104 1.00
tpch_q08/datafusion:arrow 42017061 42396636 0.99
tpch_q09/datafusion:arrow 62399554 63845433 0.98
tpch_q10/datafusion:arrow 48973049 53813998 0.91
tpch_q11/datafusion:arrow 9047446 9528710 0.95
tpch_q12/datafusion:arrow 48473446 50139558 0.97
tpch_q13/datafusion:arrow 44871360 47034334 0.95
tpch_q14/datafusion:arrow 23179461 23076977 1.00
tpch_q15/datafusion:arrow 46822379 44300505 1.06
tpch_q16/datafusion:arrow 16475000 16843724 0.98
tpch_q17/datafusion:arrow 65612738 67730505 0.97
tpch_q18/datafusion:arrow 107191670 107395613 1.00
tpch_q19/datafusion:arrow 38120828 38312918 0.99
tpch_q20/datafusion:arrow 35878168 36503894 0.98
tpch_q21/datafusion:arrow 160208638 155621932 1.03
tpch_q22/datafusion:arrow 11761349 12178589 0.97
duckdb / vortex-file-compressed (0.982x ➖, 0↑ 0↓)
name PR bb4f00f (ns) base d257d09 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 31485681 31294554 1.01
tpch_q02/duckdb:vortex-file-compressed 24522380 25552956 0.96
tpch_q03/duckdb:vortex-file-compressed 32299391 33077623 0.98
tpch_q04/duckdb:vortex-file-compressed 28404244 29251530 0.97
tpch_q05/duckdb:vortex-file-compressed 36918291 38001843 0.97
tpch_q06/duckdb:vortex-file-compressed 8806370 8107105 1.09
tpch_q07/duckdb:vortex-file-compressed 34849673 35848121 0.97
tpch_q08/duckdb:vortex-file-compressed 36561307 38112565 0.96
tpch_q09/duckdb:vortex-file-compressed 56906710 58579649 0.97
tpch_q10/duckdb:vortex-file-compressed 41866440 41360751 1.01
tpch_q11/duckdb:vortex-file-compressed 14615587 15258790 0.96
tpch_q12/duckdb:vortex-file-compressed 22488542 23250697 0.97
tpch_q13/duckdb:vortex-file-compressed 40905604 42084096 0.97
tpch_q14/duckdb:vortex-file-compressed 21250328 22409598 0.95
tpch_q15/duckdb:vortex-file-compressed 17252854 17218676 1.00
tpch_q16/duckdb:vortex-file-compressed 28105312 29085861 0.97
tpch_q17/duckdb:vortex-file-compressed 23951769 24116714 0.99
tpch_q18/duckdb:vortex-file-compressed 52531480 53877459 0.98
tpch_q19/duckdb:vortex-file-compressed 28888524 28817854 1.00
tpch_q20/duckdb:vortex-file-compressed 32568306 33375575 0.98
tpch_q21/duckdb:vortex-file-compressed 98682605 100033306 0.99
tpch_q22/duckdb:vortex-file-compressed 16663294 17124408 0.97
duckdb / vortex-compact (0.986x ➖, 0↑ 0↓)
name PR bb4f00f (ns) base d257d09 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 38160950 38322834 1.00
tpch_q02/duckdb:vortex-compact 34702955 34330424 1.01
tpch_q03/duckdb:vortex-compact 34326380 35109167 0.98
tpch_q04/duckdb:vortex-compact 31096026 30985938 1.00
tpch_q05/duckdb:vortex-compact 40764647 41556997 0.98
tpch_q06/duckdb:vortex-compact 10879262 11782984 0.92
tpch_q07/duckdb:vortex-compact 40547661 40971002 0.99
tpch_q08/duckdb:vortex-compact 41454646 42874015 0.97
tpch_q09/duckdb:vortex-compact 64987032 67060821 0.97
tpch_q10/duckdb:vortex-compact 46163867 45396439 1.02
tpch_q11/duckdb:vortex-compact 18645767 18455235 1.01
tpch_q12/duckdb:vortex-compact 29116518 29846783 0.98
tpch_q13/duckdb:vortex-compact 46565561 47635449 0.98
tpch_q14/duckdb:vortex-compact 26284358 26317381 1.00
tpch_q15/duckdb:vortex-compact 19645468 20076912 0.98
tpch_q16/duckdb:vortex-compact 32982104 32927570 1.00
tpch_q17/duckdb:vortex-compact 29190624 29066545 1.00
tpch_q18/duckdb:vortex-compact 54236586 54414171 1.00
tpch_q19/duckdb:vortex-compact 32496567 33815564 0.96
tpch_q20/duckdb:vortex-compact 40637174 39204878 1.04
tpch_q21/duckdb:vortex-compact 101896138 105208960 0.97
tpch_q22/duckdb:vortex-compact 17945208 18592479 0.97
duckdb / parquet (1.015x ➖, 0↑ 4↓)
name PR bb4f00f (ns) base d257d09 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 76461750 78468652 0.97
tpch_q02/duckdb:parquet 38697118 40421481 0.96
tpch_q03/duckdb:parquet 71356638 71342642 1.00
tpch_q04/duckdb:parquet 49688016 49484336 1.00
tpch_q05/duckdb:parquet 68131562 68907416 0.99
tpch_q06/duckdb:parquet 22458080 22287370 1.01
tpch_q07/duckdb:parquet 82303349 79127420 1.04
tpch_q08/duckdb:parquet 🚨 92343145 82717142 1.12
tpch_q09/duckdb:parquet 🚨 150742996 134383300 1.12
tpch_q10/duckdb:parquet 128888059 127879957 1.01
tpch_q11/duckdb:parquet 22305145 22416660 1.00
tpch_q12/duckdb:parquet 🚨 57188374 49057079 1.17
tpch_q13/duckdb:parquet 249384899 260540329 0.96
tpch_q14/duckdb:parquet 50658127 51600974 0.98
tpch_q15/duckdb:parquet 26042161 26394864 0.99
tpch_q16/duckdb:parquet 57813442 58570078 0.99
tpch_q17/duckdb:parquet 58163165 56997918 1.02
tpch_q18/duckdb:parquet 119022052 121844004 0.98
tpch_q19/duckdb:parquet 🚨 85833312 77967013 1.10
tpch_q20/duckdb:parquet 65733607 66004960 1.00
tpch_q21/duckdb:parquet 179317237 181547359 0.99
tpch_q22/duckdb:parquet 53535537 53939299 0.99
duckdb / duckdb (0.988x ➖, 0↑ 0↓)
name PR bb4f00f (ns) base d257d09 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 17788856 17637964 1.01
tpch_q02/duckdb:duckdb 14690384 14340506 1.02
tpch_q03/duckdb:duckdb 22322444 23237761 0.96
tpch_q04/duckdb:duckdb 22089219 21912385 1.01
tpch_q05/duckdb:duckdb 23561826 23709088 0.99
tpch_q06/duckdb:duckdb 7056430 7052502 1.00
tpch_q07/duckdb:duckdb 25254766 25868171 0.98
tpch_q08/duckdb:duckdb 23853064 24287191 0.98
tpch_q09/duckdb:duckdb 57760124 59316198 0.97
tpch_q10/duckdb:duckdb 49818111 52794003 0.94
tpch_q11/duckdb:duckdb 7222682 7277391 0.99
tpch_q12/duckdb:duckdb 18107539 18162504 1.00
tpch_q13/duckdb:duckdb 39012279 39844197 0.98
tpch_q14/duckdb:duckdb 21269022 22061104 0.96
tpch_q15/duckdb:duckdb 13700988 13592101 1.01
tpch_q16/duckdb:duckdb 26236364 26735829 0.98
tpch_q17/duckdb:duckdb 15879600 16334627 0.97
tpch_q18/duckdb:duckdb 40651973 40940511 0.99
tpch_q19/duckdb:duckdb 32241743 31182480 1.03
tpch_q20/duckdb:duckdb 24997793 25202338 0.99
tpch_q21/duckdb:duckdb 61206277 62448068 0.98
tpch_q22/duckdb:duckdb 25498895 25897236 0.98
File Size Changes (11 files changed, +0.0% overall, 6↑ 5↓)
File Scale Format Base HEAD Change %
orders_0.vortex 1.0 vortex-compact 31.73 MB 32.20 MB +482.27 KB +1.5%
part_0.vortex 1.0 vortex-file-compressed 4.98 MB 5.05 MB +73.09 KB +1.4%
customer_0.vortex 1.0 vortex-compact 7.41 MB 7.43 MB +24.17 KB +0.3%
customer_0.vortex 1.0 vortex-file-compressed 8.89 MB 8.90 MB +8.62 KB +0.1%
lineitem_0.vortex 1.0 vortex-file-compressed 85.07 MB 85.09 MB +25.37 KB +0.0%
supplier_0.vortex 1.0 vortex-file-compressed 603.64 KB 603.78 KB +144 B +0.0%
lineitem_1.vortex 1.0 vortex-file-compressed 84.69 MB 84.63 MB 53.28 KB -0.1%
orders_0.vortex 1.0 vortex-file-compressed 38.37 MB 38.34 MB 35.34 KB -0.1%
partsupp_0.vortex 1.0 vortex-file-compressed 23.81 MB 23.78 MB 22.96 KB -0.1%
partsupp_0.vortex 1.0 vortex-compact 21.05 MB 20.81 MB 241.48 KB -1.1%
part_0.vortex 1.0 vortex-compact 3.49 MB 3.40 MB 86.03 KB -2.4%

Totals:

  • vortex-compact: 190.46 MB → 190.64 MB (+0.1%)
  • vortex-file-compressed: 246.67 MB → 246.66 MB (-0.0%)

@github-actions

github-actions Bot commented Jun 17, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.0%
Engines: DataFusion No clear signal (+0.2%, low confidence) · DuckDB No clear signal (-0.2%, low confidence)
Vortex (geomean): 0.997x ➖
Parquet (geomean): 0.996x ➖
Shifts: Parquet (control) -0.4% · Median polish -0.6%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.995x ➖, 3↑ 1↓)
name PR bb4f00f (ns) base d257d09 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 24662385 25650935 0.96
tpcds_q02/datafusion:vortex-file-compressed 48427901 47069170 1.03
tpcds_q03/datafusion:vortex-file-compressed 14639587 14702154 1.00
tpcds_q04/datafusion:vortex-file-compressed 254325872 254127359 1.00
tpcds_q05/datafusion:vortex-file-compressed 45087472 43615752 1.03
tpcds_q06/datafusion:vortex-file-compressed 22647283 23391523 0.97
tpcds_q07/datafusion:vortex-file-compressed 38607881 38916685 0.99
tpcds_q08/datafusion:vortex-file-compressed 29807142 31170586 0.96
tpcds_q09/datafusion:vortex-file-compressed 28968116 29318368 0.99
tpcds_q10/datafusion:vortex-file-compressed 37671712 37786942 1.00
tpcds_q11/datafusion:vortex-file-compressed 138091815 134244197 1.03
tpcds_q12/datafusion:vortex-file-compressed 🚀 17816784 20209953 0.88
tpcds_q13/datafusion:vortex-file-compressed 43832220 43420087 1.01
tpcds_q14/datafusion:vortex-file-compressed 163717590 160597439 1.02
tpcds_q15/datafusion:vortex-file-compressed 26417118 26975992 0.98
tpcds_q16/datafusion:vortex-file-compressed 23478960 24187689 0.97
tpcds_q17/datafusion:vortex-file-compressed 58809802 60718173 0.97
tpcds_q18/datafusion:vortex-file-compressed 61862266 64068957 0.97
tpcds_q19/datafusion:vortex-file-compressed 21659830 21906058 0.99
tpcds_q20/datafusion:vortex-file-compressed 20263145 20219127 1.00
tpcds_q21/datafusion:vortex-file-compressed 34703516 35363581 0.98
tpcds_q22/datafusion:vortex-file-compressed 131177121 131816862 1.00
tpcds_q23/datafusion:vortex-file-compressed 151445293 151014013 1.00
tpcds_q24/datafusion:vortex-file-compressed 81696313 79437929 1.03
tpcds_q25/datafusion:vortex-file-compressed 64516828 64566985 1.00
tpcds_q26/datafusion:vortex-file-compressed 33348204 32865681 1.01
tpcds_q27/datafusion:vortex-file-compressed 96483452 89438067 1.08
tpcds_q28/datafusion:vortex-file-compressed 28235315 27864241 1.01
tpcds_q29/datafusion:vortex-file-compressed 59934407 58985023 1.02
tpcds_q30/datafusion:vortex-file-compressed 23699328 23718357 1.00
tpcds_q31/datafusion:vortex-file-compressed 72107629 74372391 0.97
tpcds_q32/datafusion:vortex-file-compressed 18328029 18580759 0.99
tpcds_q33/datafusion:vortex-file-compressed 29027842 29547691 0.98
tpcds_q34/datafusion:vortex-file-compressed 25093996 23988877 1.05
tpcds_q35/datafusion:vortex-file-compressed 45573402 44244099 1.03
tpcds_q36/datafusion:vortex-file-compressed 57077440 57363774 1.00
tpcds_q37/datafusion:vortex-file-compressed 20381804 19797391 1.03
tpcds_q38/datafusion:vortex-file-compressed 43532939 42254357 1.03
tpcds_q39/datafusion:vortex-file-compressed 108085665 106520914 1.01
tpcds_q40/datafusion:vortex-file-compressed 30178027 30646898 0.98
tpcds_q41/datafusion:vortex-file-compressed 15222292 16028510 0.95
tpcds_q42/datafusion:vortex-file-compressed 13537157 13206876 1.03
tpcds_q43/datafusion:vortex-file-compressed 18577076 18625692 1.00
tpcds_q44/datafusion:vortex-file-compressed 29220488 29222451 1.00
tpcds_q45/datafusion:vortex-file-compressed 27409507 26867331 1.02
tpcds_q46/datafusion:vortex-file-compressed 34433415 35201612 0.98
tpcds_q47/datafusion:vortex-file-compressed 136049165 133893078 1.02
tpcds_q48/datafusion:vortex-file-compressed 32103740 32546047 0.99
tpcds_q49/datafusion:vortex-file-compressed 57110253 60449019 0.94
tpcds_q50/datafusion:vortex-file-compressed 37099151 38240043 0.97
tpcds_q51/datafusion:vortex-file-compressed 89264186 90978530 0.98
tpcds_q52/datafusion:vortex-file-compressed 13775887 13844765 1.00
tpcds_q53/datafusion:vortex-file-compressed 21729277 22427088 0.97
tpcds_q54/datafusion:vortex-file-compressed 33398797 33982603 0.98
tpcds_q55/datafusion:vortex-file-compressed 13533906 14371571 0.94
tpcds_q56/datafusion:vortex-file-compressed 29524977 28947073 1.02
tpcds_q57/datafusion:vortex-file-compressed 105192595 105898808 0.99
tpcds_q58/datafusion:vortex-file-compressed 57973039 54931775 1.06
tpcds_q59/datafusion:vortex-file-compressed 56958563 58228386 0.98
tpcds_q60/datafusion:vortex-file-compressed 29137419 29118122 1.00
tpcds_q61/datafusion:vortex-file-compressed 39211970 38459251 1.02
tpcds_q62/datafusion:vortex-file-compressed 🚀 21134595 24518236 0.86
tpcds_q63/datafusion:vortex-file-compressed 21290698 22389765 0.95
tpcds_q64/datafusion:vortex-file-compressed 373809039 380864127 0.98
tpcds_q65/datafusion:vortex-file-compressed 50903221 49663238 1.02
tpcds_q66/datafusion:vortex-file-compressed 70415215 71285700 0.99
tpcds_q67/datafusion:vortex-file-compressed 154644315 153111301 1.01
tpcds_q68/datafusion:vortex-file-compressed 32187680 33329833 0.97
tpcds_q69/datafusion:vortex-file-compressed 36070849 36164970 1.00
tpcds_q70/datafusion:vortex-file-compressed 93789131 99169670 0.95
tpcds_q71/datafusion:vortex-file-compressed 22605282 22209011 1.02
tpcds_q72/datafusion:vortex-file-compressed 2107054063 2064233081 1.02
tpcds_q73/datafusion:vortex-file-compressed 24338571 22752756 1.07
tpcds_q74/datafusion:vortex-file-compressed 81920460 82268126 1.00
tpcds_q75/datafusion:vortex-file-compressed 114042101 111748188 1.02
tpcds_q76/datafusion:vortex-file-compressed 31054781 33409039 0.93
tpcds_q77/datafusion:vortex-file-compressed 37051785 36894851 1.00
tpcds_q78/datafusion:vortex-file-compressed 114977690 110545220 1.04
tpcds_q79/datafusion:vortex-file-compressed 27765142 27812284 1.00
tpcds_q80/datafusion:vortex-file-compressed 85369608 88010801 0.97
tpcds_q81/datafusion:vortex-file-compressed 25685359 24627620 1.04
tpcds_q82/datafusion:vortex-file-compressed 20887680 21182658 0.99
tpcds_q83/datafusion:vortex-file-compressed 36157740 35286776 1.02
tpcds_q84/datafusion:vortex-file-compressed 12736279 13301105 0.96
tpcds_q85/datafusion:vortex-file-compressed 83641540 84250306 0.99
tpcds_q86/datafusion:vortex-file-compressed 🚨 17075300 15370344 1.11
tpcds_q87/datafusion:vortex-file-compressed 43271162 43455063 1.00
tpcds_q88/datafusion:vortex-file-compressed 54338582 54738753 0.99
tpcds_q89/datafusion:vortex-file-compressed 26269810 24279507 1.08
tpcds_q90/datafusion:vortex-file-compressed 13783263 13875292 0.99
tpcds_q91/datafusion:vortex-file-compressed 17634791 17516782 1.01
tpcds_q92/datafusion:vortex-file-compressed 16394273 15895679 1.03
tpcds_q93/datafusion:vortex-file-compressed 31851291 32776340 0.97
tpcds_q94/datafusion:vortex-file-compressed 20196427 20388825 0.99
tpcds_q95/datafusion:vortex-file-compressed 57338905 58586561 0.98
tpcds_q96/datafusion:vortex-file-compressed 12500899 12753313 0.98
tpcds_q97/datafusion:vortex-file-compressed 29062459 29552308 0.98
tpcds_q98/datafusion:vortex-file-compressed 23139123 22876494 1.01
tpcds_q99/datafusion:vortex-file-compressed 🚀 27788768 31446910 0.88
datafusion / vortex-compact (0.995x ➖, 2↑ 1↓)
name PR bb4f00f (ns) base d257d09 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-compact 27114888 25459434 1.07
tpcds_q02/datafusion:vortex-compact 53599317 51645082 1.04
tpcds_q03/datafusion:vortex-compact 19234385 19070105 1.01
tpcds_q04/datafusion:vortex-compact 291355084 294358211 0.99
tpcds_q05/datafusion:vortex-compact 46768982 48036339 0.97
tpcds_q06/datafusion:vortex-compact 27592251 26084514 1.06
tpcds_q07/datafusion:vortex-compact 51498422 53085060 0.97
tpcds_q08/datafusion:vortex-compact 36232077 36225471 1.00
tpcds_q09/datafusion:vortex-compact 41815829 42041237 0.99
tpcds_q10/datafusion:vortex-compact 48569753 48060280 1.01
tpcds_q11/datafusion:vortex-compact 156719852 155907023 1.01
tpcds_q12/datafusion:vortex-compact 🚀 22166664 25612577 0.87
tpcds_q13/datafusion:vortex-compact 128265934 123665143 1.04
tpcds_q14/datafusion:vortex-compact 179395614 186153111 0.96
tpcds_q15/datafusion:vortex-compact 27853687 28915138 0.96
tpcds_q16/datafusion:vortex-compact 27854188 28676165 0.97
tpcds_q17/datafusion:vortex-compact 71743584 70667165 1.02
tpcds_q18/datafusion:vortex-compact 74097305 75207967 0.99
tpcds_q19/datafusion:vortex-compact 29479641 29213929 1.01
tpcds_q20/datafusion:vortex-compact 25698947 25348929 1.01
tpcds_q21/datafusion:vortex-compact 39884673 40814172 0.98
tpcds_q22/datafusion:vortex-compact 120906640 122079146 0.99
tpcds_q23/datafusion:vortex-compact 169801075 164658764 1.03
tpcds_q24/datafusion:vortex-compact 95094816 93749531 1.01
tpcds_q25/datafusion:vortex-compact 76608387 78572063 0.98
tpcds_q26/datafusion:vortex-compact 44364222 45355511 0.98
tpcds_q27/datafusion:vortex-compact 117001383 119989585 0.98
tpcds_q28/datafusion:vortex-compact 98003529 95659745 1.02
tpcds_q29/datafusion:vortex-compact 72324057 73613378 0.98
tpcds_q30/datafusion:vortex-compact 28198153 27848867 1.01
tpcds_q31/datafusion:vortex-compact 96257743 99338819 0.97
tpcds_q32/datafusion:vortex-compact 24135068 23566663 1.02
tpcds_q33/datafusion:vortex-compact 35949575 37340939 0.96
tpcds_q34/datafusion:vortex-compact 33257268 33620150 0.99
tpcds_q35/datafusion:vortex-compact 51356774 50764224 1.01
tpcds_q36/datafusion:vortex-compact 75161209 76679418 0.98
tpcds_q37/datafusion:vortex-compact 29625942 29908561 0.99
tpcds_q38/datafusion:vortex-compact 48479617 49538024 0.98
tpcds_q39/datafusion:vortex-compact 113623533 116568278 0.97
tpcds_q40/datafusion:vortex-compact 33807318 33545829 1.01
tpcds_q41/datafusion:vortex-compact 17375856 18002145 0.97
tpcds_q42/datafusion:vortex-compact 18357468 17998295 1.02
tpcds_q43/datafusion:vortex-compact 24329236 24552903 0.99
tpcds_q44/datafusion:vortex-compact 🚀 40334892 45430872 0.89
tpcds_q45/datafusion:vortex-compact 33103156 30561077 1.08
tpcds_q46/datafusion:vortex-compact 45383881 46321225 0.98
tpcds_q47/datafusion:vortex-compact 154034931 153222934 1.01
tpcds_q48/datafusion:vortex-compact 82379813 81501099 1.01
tpcds_q49/datafusion:vortex-compact 68990868 68929657 1.00
tpcds_q50/datafusion:vortex-compact 48119673 46521381 1.03
tpcds_q51/datafusion:vortex-compact 95520093 96888906 0.99
tpcds_q52/datafusion:vortex-compact 19000904 19239593 0.99
tpcds_q53/datafusion:vortex-compact 28078790 29276832 0.96
tpcds_q54/datafusion:vortex-compact 42875606 41372461 1.04
tpcds_q55/datafusion:vortex-compact 17936594 19063778 0.94
tpcds_q56/datafusion:vortex-compact 36763040 35509033 1.04
tpcds_q57/datafusion:vortex-compact 113533148 117655561 0.96
tpcds_q58/datafusion:vortex-compact 62903079 64762362 0.97
tpcds_q59/datafusion:vortex-compact 69805129 71503201 0.98
tpcds_q60/datafusion:vortex-compact 36873371 36350003 1.01
tpcds_q61/datafusion:vortex-compact 54899852 53192120 1.03
tpcds_q62/datafusion:vortex-compact 27816712 27602555 1.01
tpcds_q63/datafusion:vortex-compact 28458276 28938835 0.98
tpcds_q64/datafusion:vortex-compact 428322753 415950510 1.03
tpcds_q65/datafusion:vortex-compact 64788891 67350977 0.96
tpcds_q66/datafusion:vortex-compact 74734629 73163016 1.02
tpcds_q67/datafusion:vortex-compact 161605750 162421672 0.99
tpcds_q68/datafusion:vortex-compact 46400081 45487182 1.02
tpcds_q69/datafusion:vortex-compact 45611010 46684795 0.98
tpcds_q70/datafusion:vortex-compact 107765779 111242237 0.97
tpcds_q71/datafusion:vortex-compact 30419300 30085198 1.01
tpcds_q72/datafusion:vortex-compact 2086463221 2128321913 0.98
tpcds_q73/datafusion:vortex-compact 31915615 32722053 0.98
tpcds_q74/datafusion:vortex-compact 98589764 94373238 1.04
tpcds_q75/datafusion:vortex-compact 131914378 129731910 1.02
tpcds_q76/datafusion:vortex-compact 31831654 32315076 0.99
tpcds_q77/datafusion:vortex-compact 48054202 48924853 0.98
tpcds_q78/datafusion:vortex-compact 126984900 134280784 0.95
tpcds_q79/datafusion:vortex-compact 38637289 39475226 0.98
tpcds_q80/datafusion:vortex-compact 99383920 100532688 0.99
tpcds_q81/datafusion:vortex-compact 🚨 31121808 28015840 1.11
tpcds_q82/datafusion:vortex-compact 34943047 32336216 1.08
tpcds_q83/datafusion:vortex-compact 34754196 38611860 0.90
tpcds_q84/datafusion:vortex-compact 14637701 14234390 1.03
tpcds_q85/datafusion:vortex-compact 143584397 158283886 0.91
tpcds_q86/datafusion:vortex-compact 20105228 18521514 1.09
tpcds_q87/datafusion:vortex-compact 50572287 50776810 1.00
tpcds_q88/datafusion:vortex-compact 76704051 77906351 0.98
tpcds_q89/datafusion:vortex-compact 30629426 31724915 0.97
tpcds_q90/datafusion:vortex-compact 14483568 14826895 0.98
tpcds_q91/datafusion:vortex-compact 31611047 31683315 1.00
tpcds_q92/datafusion:vortex-compact 23156284 23686210 0.98
tpcds_q93/datafusion:vortex-compact 36667307 36230904 1.01
tpcds_q94/datafusion:vortex-compact 25882449 25033663 1.03
tpcds_q95/datafusion:vortex-compact 62124967 60326364 1.03
tpcds_q96/datafusion:vortex-compact 16692987 17634195 0.95
tpcds_q97/datafusion:vortex-compact 34393287 34210454 1.01
tpcds_q98/datafusion:vortex-compact 30065529 30489149 0.99
tpcds_q99/datafusion:vortex-compact 32492659 32986505 0.99
datafusion / parquet (0.993x ➖, 1↑ 2↓)
name PR bb4f00f (ns) base d257d09 (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 22522132 24374240 0.92
tpcds_q02/datafusion:parquet 41104816 41674671 0.99
tpcds_q03/datafusion:parquet 13162266 13063605 1.01
tpcds_q04/datafusion:parquet 291770802 295594586 0.99
tpcds_q05/datafusion:parquet 47536470 46545131 1.02
tpcds_q06/datafusion:parquet 23009831 23319815 0.99
tpcds_q07/datafusion:parquet 77501978 76037142 1.02
tpcds_q08/datafusion:parquet 29056779 28511595 1.02
tpcds_q09/datafusion:parquet 🚨 41489890 37526793 1.11
tpcds_q10/datafusion:parquet 73561013 72427537 1.02
tpcds_q11/datafusion:parquet 151986745 143954407 1.06
tpcds_q12/datafusion:parquet 17982480 18055176 1.00
tpcds_q13/datafusion:parquet 74161192 77170299 0.96
tpcds_q14/datafusion:parquet 158931285 156646033 1.01
tpcds_q15/datafusion:parquet 20887682 21247979 0.98
tpcds_q16/datafusion:parquet 27322224 28911001 0.95
tpcds_q17/datafusion:parquet 🚀 61239532 70287704 0.87
tpcds_q18/datafusion:parquet 104537169 108472053 0.96
tpcds_q19/datafusion:parquet 22319537 23305627 0.96
tpcds_q20/datafusion:parquet 16081335 17478736 0.92
tpcds_q21/datafusion:parquet 18389641 18552788 0.99
tpcds_q22/datafusion:parquet 158947656 157877311 1.01
tpcds_q23/datafusion:parquet 146587316 151204857 0.97
tpcds_q24/datafusion:parquet 87029885 88251846 0.99
tpcds_q25/datafusion:parquet 62156055 65353244 0.95
tpcds_q26/datafusion:parquet 68239348 67090574 1.02
tpcds_q27/datafusion:parquet 134634763 133366221 1.01
tpcds_q28/datafusion:parquet 44368146 43751062 1.01
tpcds_q29/datafusion:parquet 63488826 65067357 0.98
tpcds_q30/datafusion:parquet 34081075 32894603 1.04
tpcds_q31/datafusion:parquet 65207082 67851474 0.96
tpcds_q32/datafusion:parquet 16803867 16406298 1.02
tpcds_q33/datafusion:parquet 26776958 26997368 0.99
tpcds_q34/datafusion:parquet 21227898 21989906 0.97
tpcds_q35/datafusion:parquet 71396476 70980605 1.01
tpcds_q36/datafusion:parquet 58524211 59787706 0.98
tpcds_q37/datafusion:parquet 18955149 20152577 0.94
tpcds_q38/datafusion:parquet 43290825 41280016 1.05
tpcds_q39/datafusion:parquet 72844937 73856970 0.99
tpcds_q40/datafusion:parquet 23020497 23607773 0.98
tpcds_q41/datafusion:parquet 14180929 14304486 0.99
tpcds_q42/datafusion:parquet 12661514 11906487 1.06
tpcds_q43/datafusion:parquet 17111300 17098002 1.00
tpcds_q44/datafusion:parquet 32559104 32364457 1.01
tpcds_q45/datafusion:parquet 🚨 30758074 27534725 1.12
tpcds_q46/datafusion:parquet 33076059 32631378 1.01
tpcds_q47/datafusion:parquet 128124251 128948601 0.99
tpcds_q48/datafusion:parquet 68431357 68729332 1.00
tpcds_q49/datafusion:parquet 57251557 57294775 1.00
tpcds_q50/datafusion:parquet 42116646 42835629 0.98
tpcds_q51/datafusion:parquet 88499800 88790527 1.00
tpcds_q52/datafusion:parquet 11604928 12572783 0.92
tpcds_q53/datafusion:parquet 17466815 18746822 0.93
tpcds_q54/datafusion:parquet 32743112 34064680 0.96
tpcds_q55/datafusion:parquet 11358408 11501906 0.99
tpcds_q56/datafusion:parquet 27054441 28759002 0.94
tpcds_q57/datafusion:parquet 105317030 97198708 1.08
tpcds_q58/datafusion:parquet 56431103 54220862 1.04
tpcds_q59/datafusion:parquet 65811779 62022275 1.06
tpcds_q60/datafusion:parquet 28402926 27942809 1.02
tpcds_q61/datafusion:parquet 43535807 43452623 1.00
tpcds_q62/datafusion:parquet 25768265 25672407 1.00
tpcds_q63/datafusion:parquet 18114007 18446103 0.98
tpcds_q64/datafusion:parquet 308724355 313656298 0.98
tpcds_q65/datafusion:parquet 36612149 37158194 0.99
tpcds_q66/datafusion:parquet 64182413 71269340 0.90
tpcds_q67/datafusion:parquet 153107616 148438914 1.03
tpcds_q68/datafusion:parquet 32263959 32330819 1.00
tpcds_q69/datafusion:parquet 65894329 66681972 0.99
tpcds_q70/datafusion:parquet 33882949 33841167 1.00
tpcds_q71/datafusion:parquet 22756231 22371208 1.02
tpcds_q72/datafusion:parquet 589900044 571730490 1.03
tpcds_q73/datafusion:parquet 21928476 20891805 1.05
tpcds_q74/datafusion:parquet 85889777 84470995 1.02
tpcds_q75/datafusion:parquet 107535684 105078396 1.02
tpcds_q76/datafusion:parquet 29551013 29801580 0.99
tpcds_q77/datafusion:parquet 37853221 40124744 0.94
tpcds_q78/datafusion:parquet 105468351 113902135 0.93
tpcds_q79/datafusion:parquet 25411920 26047904 0.98
tpcds_q80/datafusion:parquet 75175456 75814092 0.99
tpcds_q81/datafusion:parquet 29642339 29902639 0.99
tpcds_q82/datafusion:parquet 19741871 19100533 1.03
tpcds_q83/datafusion:parquet 40678410 40867204 1.00
tpcds_q84/datafusion:parquet 39227711 39608629 0.99
tpcds_q85/datafusion:parquet 148197602 149256549 0.99
tpcds_q86/datafusion:parquet 15792480 15961092 0.99
tpcds_q87/datafusion:parquet 43132443 44827617 0.96
tpcds_q88/datafusion:parquet 59736932 59033080 1.01
tpcds_q89/datafusion:parquet 22984786 21761639 1.06
tpcds_q90/datafusion:parquet 14349398 14122318 1.02
tpcds_q91/datafusion:parquet 56930208 56942374 1.00
tpcds_q92/datafusion:parquet 18125305 17195856 1.05
tpcds_q93/datafusion:parquet 30332704 32702699 0.93
tpcds_q94/datafusion:parquet 21409029 20603625 1.04
tpcds_q95/datafusion:parquet 60169238 61331349 0.98
tpcds_q96/datafusion:parquet 11749618 12672186 0.93
tpcds_q97/datafusion:parquet 31028112 32407413 0.96
tpcds_q98/datafusion:parquet 21069844 21946348 0.96
tpcds_q99/datafusion:parquet 25805070 26008100 0.99
duckdb / vortex-file-compressed (1.001x ➖, 2↑ 2↓)
name PR bb4f00f (ns) base d257d09 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 25276562 23768185 1.06
tpcds_q02/duckdb:vortex-file-compressed 33957630 34284474 0.99
tpcds_q03/duckdb:vortex-file-compressed 14921698 15182804 0.98
tpcds_q04/duckdb:vortex-file-compressed 91967045 94070552 0.98
tpcds_q05/duckdb:vortex-file-compressed 34161970 34227772 1.00
tpcds_q06/duckdb:vortex-file-compressed 32978618 33227764 0.99
tpcds_q07/duckdb:vortex-file-compressed 21874684 22331559 0.98
tpcds_q08/duckdb:vortex-file-compressed 26161800 26479197 0.99
tpcds_q09/duckdb:vortex-file-compressed 17034305 16671000 1.02
tpcds_q10/duckdb:vortex-file-compressed 37475347 36399937 1.03
tpcds_q11/duckdb:vortex-file-compressed 64856218 65220352 0.99
tpcds_q12/duckdb:vortex-file-compressed 15698776 15611207 1.01
tpcds_q13/duckdb:vortex-file-compressed 32336374 32338091 1.00
tpcds_q14/duckdb:vortex-file-compressed 99641868 98617182 1.01
tpcds_q15/duckdb:vortex-file-compressed 26382779 26139653 1.01
tpcds_q16/duckdb:vortex-file-compressed 26287173 25361737 1.04
tpcds_q17/duckdb:vortex-file-compressed 44593618 46052757 0.97
tpcds_q18/duckdb:vortex-file-compressed 36765340 37141204 0.99
tpcds_q19/duckdb:vortex-file-compressed 31380686 31421148 1.00
tpcds_q20/duckdb:vortex-file-compressed 17288789 16638757 1.04
tpcds_q21/duckdb:vortex-file-compressed 🚨 18362938 16499674 1.11
tpcds_q22/duckdb:vortex-file-compressed 79971374 75063499 1.07
tpcds_q23/duckdb:vortex-file-compressed 95214515 94948673 1.00
tpcds_q24/duckdb:vortex-file-compressed 47608460 48537956 0.98
tpcds_q25/duckdb:vortex-file-compressed 40384612 40954647 0.99
tpcds_q26/duckdb:vortex-file-compressed 20694231 20389719 1.01
tpcds_q27/duckdb:vortex-file-compressed 24386116 24761034 0.98
tpcds_q28/duckdb:vortex-file-compressed 11455006 11168425 1.03
tpcds_q29/duckdb:vortex-file-compressed 39155687 39911455 0.98
tpcds_q30/duckdb:vortex-file-compressed 24177201 24750051 0.98
tpcds_q31/duckdb:vortex-file-compressed 31722073 31311892 1.01
tpcds_q32/duckdb:vortex-file-compressed 12785816 13358005 0.96
tpcds_q33/duckdb:vortex-file-compressed 24080354 23980116 1.00
tpcds_q34/duckdb:vortex-file-compressed 24443134 24914172 0.98
tpcds_q35/duckdb:vortex-file-compressed 64059084 63577446 1.01
tpcds_q36/duckdb:vortex-file-compressed 24364168 24985414 0.98
tpcds_q37/duckdb:vortex-file-compressed 19271690 19505668 0.99
tpcds_q38/duckdb:vortex-file-compressed 36829311 36779298 1.00
tpcds_q39/duckdb:vortex-file-compressed 35010821 34970820 1.00
tpcds_q40/duckdb:vortex-file-compressed 21591618 20714524 1.04
tpcds_q41/duckdb:vortex-file-compressed 9043970 9207428 0.98
tpcds_q42/duckdb:vortex-file-compressed 13578579 13039343 1.04
tpcds_q43/duckdb:vortex-file-compressed 20878853 20907591 1.00
tpcds_q44/duckdb:vortex-file-compressed 20646652 20287195 1.02
tpcds_q45/duckdb:vortex-file-compressed 29785189 29833450 1.00
tpcds_q46/duckdb:vortex-file-compressed 29836195 32448270 0.92
tpcds_q47/duckdb:vortex-file-compressed 51939270 52967319 0.98
tpcds_q48/duckdb:vortex-file-compressed 28164475 28158267 1.00
tpcds_q49/duckdb:vortex-file-compressed 32252731 32410404 1.00
tpcds_q50/duckdb:vortex-file-compressed 27935609 25626643 1.09
tpcds_q51/duckdb:vortex-file-compressed 🚀 103876784 128709104 0.81
tpcds_q52/duckdb:vortex-file-compressed 12293317 13098159 0.94
tpcds_q53/duckdb:vortex-file-compressed 23042244 22289505 1.03
tpcds_q54/duckdb:vortex-file-compressed 29739779 28954750 1.03
tpcds_q55/duckdb:vortex-file-compressed 12348678 12385476 1.00
tpcds_q56/duckdb:vortex-file-compressed 25603915 25384799 1.01
tpcds_q57/duckdb:vortex-file-compressed 41001549 41599623 0.99
tpcds_q58/duckdb:vortex-file-compressed 31331074 30628268 1.02
tpcds_q59/duckdb:vortex-file-compressed 56555333 57125187 0.99
tpcds_q60/duckdb:vortex-file-compressed 25929460 25915701 1.00
tpcds_q61/duckdb:vortex-file-compressed 30479926 30200407 1.01
tpcds_q62/duckdb:vortex-file-compressed 15474181 14715887 1.05
tpcds_q63/duckdb:vortex-file-compressed 20586822 20403114 1.01
tpcds_q64/duckdb:vortex-file-compressed 91935086 93412454 0.98
tpcds_q65/duckdb:vortex-file-compressed 24090599 23248300 1.04
tpcds_q66/duckdb:vortex-file-compressed 29830607 29806952 1.00
tpcds_q67/duckdb:vortex-file-compressed 145617557 143087553 1.02
tpcds_q68/duckdb:vortex-file-compressed 29413404 29914559 0.98
tpcds_q69/duckdb:vortex-file-compressed 39311257 39913361 0.98
tpcds_q70/duckdb:vortex-file-compressed 🚀 34419504 38391326 0.90
tpcds_q71/duckdb:vortex-file-compressed 21782322 21557520 1.01
tpcds_q72/duckdb:vortex-file-compressed 167911165 169223519 0.99
tpcds_q73/duckdb:vortex-file-compressed 24764619 25654055 0.97
tpcds_q74/duckdb:vortex-file-compressed 41557505 42079158 0.99
tpcds_q75/duckdb:vortex-file-compressed 52675234 48314818 1.09
tpcds_q76/duckdb:vortex-file-compressed 21564561 21863364 0.99
tpcds_q77/duckdb:vortex-file-compressed 25404039 23781070 1.07
tpcds_q78/duckdb:vortex-file-compressed 77718976 80036837 0.97
tpcds_q79/duckdb:vortex-file-compressed 26561845 24781503 1.07
tpcds_q80/duckdb:vortex-file-compressed 49054502 48163451 1.02
tpcds_q81/duckdb:vortex-file-compressed 29195336 28831321 1.01
tpcds_q82/duckdb:vortex-file-compressed 45449520 45545013 1.00
tpcds_q83/duckdb:vortex-file-compressed 25939537 25303048 1.03
tpcds_q84/duckdb:vortex-file-compressed 17353926 16861501 1.03
tpcds_q85/duckdb:vortex-file-compressed 40240879 38497767 1.05
tpcds_q86/duckdb:vortex-file-compressed 16167900 16751785 0.97
tpcds_q87/duckdb:vortex-file-compressed 42322663 41047601 1.03
tpcds_q88/duckdb:vortex-file-compressed 50918198 51951459 0.98
tpcds_q89/duckdb:vortex-file-compressed 22226942 22023825 1.01
tpcds_q90/duckdb:vortex-file-compressed 10385451 10473254 0.99
tpcds_q91/duckdb:vortex-file-compressed 21733252 22023477 0.99
tpcds_q92/duckdb:vortex-file-compressed 17881511 18471004 0.97
tpcds_q93/duckdb:vortex-file-compressed 29757197 30122272 0.99
tpcds_q94/duckdb:vortex-file-compressed 21081826 21577575 0.98
tpcds_q95/duckdb:vortex-file-compressed 🚨 160244817 145391037 1.10
tpcds_q96/duckdb:vortex-file-compressed 11923957 12263651 0.97
tpcds_q97/duckdb:vortex-file-compressed 38051374 37716286 1.01
tpcds_q98/duckdb:vortex-file-compressed 18499445 18994926 0.97
tpcds_q99/duckdb:vortex-file-compressed 22475965 22970261 0.98
duckdb / vortex-compact (0.996x ➖, 2↑ 1↓)
name PR bb4f00f (ns) base d257d09 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-compact 29216381 26924267 1.09
tpcds_q02/duckdb:vortex-compact 41720103 38970625 1.07
tpcds_q03/duckdb:vortex-compact 45587956 45202315 1.01
tpcds_q04/duckdb:vortex-compact 102171590 105816581 0.97
tpcds_q05/duckdb:vortex-compact 40774937 41409558 0.98
tpcds_q06/duckdb:vortex-compact 40573751 38569777 1.05
tpcds_q07/duckdb:vortex-compact 34964625 35764106 0.98
tpcds_q08/duckdb:vortex-compact 39978953 41271654 0.97
tpcds_q09/duckdb:vortex-compact 19517810 19573591 1.00
tpcds_q10/duckdb:vortex-compact 51905928 53473169 0.97
tpcds_q11/duckdb:vortex-compact 73954800 71868478 1.03
tpcds_q12/duckdb:vortex-compact 21570305 21682070 0.99
tpcds_q13/duckdb:vortex-compact 53436067 53649719 1.00
tpcds_q14/duckdb:vortex-compact 119096621 119126989 1.00
tpcds_q15/duckdb:vortex-compact 29631831 31697539 0.93
tpcds_q16/duckdb:vortex-compact 26568708 27986340 0.95
tpcds_q17/duckdb:vortex-compact 55383584 56209451 0.99
tpcds_q18/duckdb:vortex-compact 48383104 50142497 0.96
tpcds_q19/duckdb:vortex-compact 43793459 44044911 0.99
tpcds_q20/duckdb:vortex-compact 20756250 20734179 1.00
tpcds_q21/duckdb:vortex-compact 17985192 17524563 1.03
tpcds_q22/duckdb:vortex-compact 78921593 79255020 1.00
tpcds_q23/duckdb:vortex-compact 107685267 107091951 1.01
tpcds_q24/duckdb:vortex-compact 58713254 57046529 1.03
tpcds_q25/duckdb:vortex-compact 54602157 54903594 0.99
tpcds_q26/duckdb:vortex-compact 31295325 31618376 0.99
tpcds_q27/duckdb:vortex-compact 37013884 37146030 1.00
tpcds_q28/duckdb:vortex-compact 33922154 34448314 0.98
tpcds_q29/duckdb:vortex-compact 52340833 52132004 1.00
tpcds_q30/duckdb:vortex-compact 28845072 29595326 0.97
tpcds_q31/duckdb:vortex-compact 37091035 35677498 1.04
tpcds_q32/duckdb:vortex-compact 21380770 21436211 1.00
tpcds_q33/duckdb:vortex-compact 32775388 32421253 1.01
tpcds_q34/duckdb:vortex-compact 30161116 30726910 0.98
tpcds_q35/duckdb:vortex-compact 74466595 77018176 0.97
tpcds_q36/duckdb:vortex-compact 35342628 37271034 0.95
tpcds_q37/duckdb:vortex-compact 23651453 23471706 1.01
tpcds_q38/duckdb:vortex-compact 43563262 43087935 1.01
tpcds_q39/duckdb:vortex-compact 39165020 37907707 1.03
tpcds_q40/duckdb:vortex-compact 23642286 24620699 0.96
tpcds_q41/duckdb:vortex-compact 10572873 11046473 0.96
tpcds_q42/duckdb:vortex-compact 19013483 18932121 1.00
tpcds_q43/duckdb:vortex-compact 30020293 31028706 0.97
tpcds_q44/duckdb:vortex-compact 29200059 28573763 1.02
tpcds_q45/duckdb:vortex-compact 35851340 36363616 0.99
tpcds_q46/duckdb:vortex-compact 43957021 43873714 1.00
tpcds_q47/duckdb:vortex-compact 64333863 62512746 1.03
tpcds_q48/duckdb:vortex-compact 45568593 45590429 1.00
tpcds_q49/duckdb:vortex-compact 47676909 48852176 0.98
tpcds_q50/duckdb:vortex-compact 38221516 36953194 1.03
tpcds_q51/duckdb:vortex-compact 109836838 116417631 0.94
tpcds_q52/duckdb:vortex-compact 20747817 19495903 1.06
tpcds_q53/duckdb:vortex-compact 32802947 32328752 1.01
tpcds_q54/duckdb:vortex-compact 36071867 36248696 1.00
tpcds_q55/duckdb:vortex-compact 18365922 18787136 0.98
tpcds_q56/duckdb:vortex-compact 34989527 34183031 1.02
tpcds_q57/duckdb:vortex-compact 44574112 44577709 1.00
tpcds_q58/duckdb:vortex-compact 35963279 38195743 0.94
tpcds_q59/duckdb:vortex-compact 66996862 67550857 0.99
tpcds_q60/duckdb:vortex-compact 37769744 36880874 1.02
tpcds_q61/duckdb:vortex-compact 53965577 54875490 0.98
tpcds_q62/duckdb:vortex-compact 20603882 21092117 0.98
tpcds_q63/duckdb:vortex-compact 32093302 31310979 1.02
tpcds_q64/duckdb:vortex-compact 127002658 124240023 1.02
tpcds_q65/duckdb:vortex-compact 31766168 31239462 1.02
tpcds_q66/duckdb:vortex-compact 37042261 35554623 1.04
tpcds_q67/duckdb:vortex-compact 150376030 152711170 0.98
tpcds_q68/duckdb:vortex-compact 46153550 46557558 0.99
tpcds_q69/duckdb:vortex-compact 53518642 54291698 0.99
tpcds_q70/duckdb:vortex-compact 57775605 57067344 1.01
tpcds_q71/duckdb:vortex-compact 28280470 28611089 0.99
tpcds_q72/duckdb:vortex-compact 183630202 185059338 0.99
tpcds_q73/duckdb:vortex-compact 27651566 28051975 0.99
tpcds_q74/duckdb:vortex-compact 48761037 48473184 1.01
tpcds_q75/duckdb:vortex-compact 62113161 60105791 1.03
tpcds_q76/duckdb:vortex-compact 🚀 27780487 31635208 0.88
tpcds_q77/duckdb:vortex-compact 39612504 38633743 1.03
tpcds_q78/duckdb:vortex-compact 90686633 89943804 1.01
tpcds_q79/duckdb:vortex-compact 39013530 39677937 0.98
tpcds_q80/duckdb:vortex-compact 71882964 72188294 1.00
tpcds_q81/duckdb:vortex-compact 32958316 34780245 0.95
tpcds_q82/duckdb:vortex-compact 48890482 49178526 0.99
tpcds_q83/duckdb:vortex-compact 35704405 36499220 0.98
tpcds_q84/duckdb:vortex-compact 22001930 21082526 1.04
tpcds_q85/duckdb:vortex-compact 51630890 53403274 0.97
tpcds_q86/duckdb:vortex-compact 🚨 23164379 20459318 1.13
tpcds_q87/duckdb:vortex-compact 44769650 44903657 1.00
tpcds_q88/duckdb:vortex-compact 75405536 76156481 0.99
tpcds_q89/duckdb:vortex-compact 32390581 32768353 0.99
tpcds_q90/duckdb:vortex-compact 11338616 11097266 1.02
tpcds_q91/duckdb:vortex-compact 41822965 41276909 1.01
tpcds_q92/duckdb:vortex-compact 🚀 38843143 46127248 0.84
tpcds_q93/duckdb:vortex-compact 32009872 32484393 0.99
tpcds_q94/duckdb:vortex-compact 28674185 28400854 1.01
tpcds_q95/duckdb:vortex-compact 154121816 153143518 1.01
tpcds_q96/duckdb:vortex-compact 16786558 17641858 0.95
tpcds_q97/duckdb:vortex-compact 43036096 42421053 1.01
tpcds_q98/duckdb:vortex-compact 27176388 27428224 0.99
tpcds_q99/duckdb:vortex-compact 25940629 26321833 0.99
duckdb / parquet (1.000x ➖, 0↑ 0↓)
name PR bb4f00f (ns) base d257d09 (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 30432831 29370824 1.04
tpcds_q02/duckdb:parquet 23913241 24668601 0.97
tpcds_q03/duckdb:parquet 12951277 12627424 1.03
tpcds_q04/duckdb:parquet 170276789 167193502 1.02
tpcds_q05/duckdb:parquet 31034243 30856879 1.01
tpcds_q06/duckdb:parquet 33869056 34270509 0.99
tpcds_q07/duckdb:parquet 24137574 24507620 0.98
tpcds_q08/duckdb:parquet 29861883 30775392 0.97
tpcds_q09/duckdb:parquet 43810895 44585818 0.98
tpcds_q10/duckdb:parquet 37449047 38496030 0.97
tpcds_q11/duckdb:parquet 93214563 95265010 0.98
tpcds_q12/duckdb:parquet 17024607 17133782 0.99
tpcds_q13/duckdb:parquet 35123108 34956123 1.00
tpcds_q14/duckdb:parquet 101734925 102341406 0.99
tpcds_q15/duckdb:parquet 29818333 30431900 0.98
tpcds_q16/duckdb:parquet 22653336 22883435 0.99
tpcds_q17/duckdb:parquet 38478712 38952811 0.99
tpcds_q18/duckdb:parquet 48597224 48462961 1.00
tpcds_q19/duckdb:parquet 31760608 31661963 1.00
tpcds_q20/duckdb:parquet 18414707 18620625 0.99
tpcds_q21/duckdb:parquet 11628573 11718718 0.99
tpcds_q22/duckdb:parquet 70437441 65971904 1.07
tpcds_q23/duckdb:parquet 82801750 84112546 0.98
tpcds_q24/duckdb:parquet 46846676 47032468 1.00
tpcds_q25/duckdb:parquet 35700889 35490087 1.01
tpcds_q26/duckdb:parquet 38347358 38787880 0.99
tpcds_q27/duckdb:parquet 53227305 52658126 1.01
tpcds_q28/duckdb:parquet 43538197 42595686 1.02
tpcds_q29/duckdb:parquet 36292850 38551956 0.94
tpcds_q30/duckdb:parquet 37164853 38054731 0.98
tpcds_q31/duckdb:parquet 29728345 28016361 1.06
tpcds_q32/duckdb:parquet 12519815 12712417 0.98
tpcds_q33/duckdb:parquet 24409807 24546824 0.99
tpcds_q34/duckdb:parquet 23293337 22856951 1.02
tpcds_q35/duckdb:parquet 61963215 61425480 1.01
tpcds_q36/duckdb:parquet 22765150 22282962 1.02
tpcds_q37/duckdb:parquet 14313548 14526071 0.99
tpcds_q38/duckdb:parquet 36972770 36487888 1.01
tpcds_q39/duckdb:parquet 32003525 32363181 0.99
tpcds_q40/duckdb:parquet 19588831 19414713 1.01
tpcds_q41/duckdb:parquet 8902574 8660280 1.03
tpcds_q42/duckdb:parquet 12595946 12754610 0.99
tpcds_q43/duckdb:parquet 17789543 17909782 0.99
tpcds_q44/duckdb:parquet 26562698 26491667 1.00
tpcds_q45/duckdb:parquet 29097708 28519524 1.02
tpcds_q46/duckdb:parquet 47884270 47760134 1.00
tpcds_q47/duckdb:parquet 49785925 51403836 0.97
tpcds_q48/duckdb:parquet 32130028 31993034 1.00
tpcds_q49/duckdb:parquet 27793720 28199891 0.99
tpcds_q50/duckdb:parquet 25895470 26217994 0.99
tpcds_q51/duckdb:parquet 101691918 105362344 0.97
tpcds_q52/duckdb:parquet 13642276 12808302 1.07
tpcds_q53/duckdb:parquet 19221512 19048081 1.01
tpcds_q54/duckdb:parquet 29025922 28919736 1.00
tpcds_q55/duckdb:parquet 13113510 12819945 1.02
tpcds_q56/duckdb:parquet 23410054 24219911 0.97
tpcds_q57/duckdb:parquet 37744934 38322195 0.98
tpcds_q58/duckdb:parquet 26820642 25228804 1.06
tpcds_q59/duckdb:parquet 36163175 36267034 1.00
tpcds_q60/duckdb:parquet 25023329 24966389 1.00
tpcds_q61/duckdb:parquet 34340782 33888466 1.01
tpcds_q62/duckdb:parquet 12601968 12556689 1.00
tpcds_q63/duckdb:parquet 17621309 17872501 0.99
tpcds_q64/duckdb:parquet 80343113 75301555 1.07
tpcds_q65/duckdb:parquet 22258005 23071818 0.96
tpcds_q66/duckdb:parquet 30667597 32149039 0.95
tpcds_q67/duckdb:parquet 137968386 134874764 1.02
tpcds_q68/duckdb:parquet 38160897 39194627 0.97
tpcds_q69/duckdb:parquet 38600414 38687053 1.00
tpcds_q70/duckdb:parquet 23263413 22426892 1.04
tpcds_q71/duckdb:parquet 23541683 23447446 1.00
tpcds_q72/duckdb:parquet 165570041 166450538 0.99
tpcds_q73/duckdb:parquet 20931553 21077725 0.99
tpcds_q74/duckdb:parquet 125974383 128678449 0.98
tpcds_q75/duckdb:parquet 56641810 56810911 1.00
tpcds_q76/duckdb:parquet 21884297 22503686 0.97
tpcds_q77/duckdb:parquet 25393635 25307455 1.00
tpcds_q78/duckdb:parquet 77803745 77316819 1.01
tpcds_q79/duckdb:parquet 30071254 30325358 0.99
tpcds_q80/duckdb:parquet 44830699 43537096 1.03
tpcds_q81/duckdb:parquet 35367076 35027535 1.01
tpcds_q82/duckdb:parquet 16459675 17314116 0.95
tpcds_q83/duckdb:parquet 18141130 18383258 0.99
tpcds_q84/duckdb:parquet 21590525 20250741 1.07
tpcds_q85/duckdb:parquet 40954219 44568607 0.92
tpcds_q86/duckdb:parquet 13756875 13737633 1.00
tpcds_q87/duckdb:parquet 39288216 39326825 1.00
tpcds_q88/duckdb:parquet 53670703 53534097 1.00
tpcds_q89/duckdb:parquet 21793506 22180973 0.98
tpcds_q90/duckdb:parquet 8485330 8252222 1.03
tpcds_q91/duckdb:parquet 25418289 24819178 1.02
tpcds_q92/duckdb:parquet 12888330 13134596 0.98
tpcds_q93/duckdb:parquet 32117210 32204094 1.00
tpcds_q94/duckdb:parquet 18183972 18194974 1.00
tpcds_q95/duckdb:parquet 144670159 149272585 0.97
tpcds_q96/duckdb:parquet 10659726 10431729 1.02
tpcds_q97/duckdb:parquet 38172459 37840959 1.01
tpcds_q98/duckdb:parquet 25245930 24151197 1.05
tpcds_q99/duckdb:parquet 20426972 20131400 1.01
duckdb / duckdb (0.996x ➖, 1↑ 0↓)
name PR bb4f00f (ns) base d257d09 (ns) ratio (PR/base)
tpcds_q01/duckdb:duckdb 22427040 22948959 0.98
tpcds_q02/duckdb:duckdb 19171876 19543562 0.98
tpcds_q03/duckdb:duckdb 10385786 10076312 1.03
tpcds_q04/duckdb:duckdb 179920936 178123592 1.01
tpcds_q05/duckdb:duckdb 🚀 20644604 23135516 0.89
tpcds_q06/duckdb:duckdb 28211333 27987445 1.01
tpcds_q07/duckdb:duckdb 40968050 40553401 1.01
tpcds_q08/duckdb:duckdb 120066697 120261671 1.00
tpcds_q09/duckdb:duckdb 20508957 20754279 0.99
tpcds_q10/duckdb:duckdb 27698798 28474826 0.97
tpcds_q11/duckdb:duckdb 93583744 96203954 0.97
tpcds_q12/duckdb:duckdb 13849659 14127292 0.98
tpcds_q13/duckdb:duckdb 26486542 25726494 1.03
tpcds_q14/duckdb:duckdb 93004198 94059262 0.99
tpcds_q15/duckdb:duckdb 24816348 24556899 1.01
tpcds_q16/duckdb:duckdb 19113254 19158262 1.00
tpcds_q17/duckdb:duckdb 26166797 24380544 1.07
tpcds_q18/duckdb:duckdb 46803868 46909841 1.00
tpcds_q19/duckdb:duckdb 20225549 19547989 1.03
tpcds_q20/duckdb:duckdb 14145240 14304277 0.99
tpcds_q21/duckdb:duckdb 7995714 7594868 1.05
tpcds_q22/duckdb:duckdb 64917111 60943886 1.07
tpcds_q23/duckdb:duckdb 77534432 77935887 0.99
tpcds_q24/duckdb:duckdb 25621083 25843730 0.99
tpcds_q25/duckdb:duckdb 19153127 19023094 1.01
tpcds_q26/duckdb:duckdb 28792429 29020340 0.99
tpcds_q27/duckdb:duckdb 41397794 41305709 1.00
tpcds_q28/duckdb:duckdb 26101014 26728747 0.98
tpcds_q29/duckdb:duckdb 23514742 23807815 0.99
tpcds_q30/duckdb:duckdb 30948339 31388493 0.99
tpcds_q31/duckdb:duckdb 49628808 50992513 0.97
tpcds_q32/duckdb:duckdb 8542943 8306480 1.03
tpcds_q33/duckdb:duckdb 16827554 16043294 1.05
tpcds_q34/duckdb:duckdb 18694435 18679166 1.00
tpcds_q35/duckdb:duckdb 38047774 36485093 1.04
tpcds_q36/duckdb:duckdb 69665506 71052175 0.98
tpcds_q37/duckdb:duckdb 9309884 8941347 1.04
tpcds_q38/duckdb:duckdb 33309285 33329908 1.00
tpcds_q39/duckdb:duckdb 27789100 28143514 0.99
tpcds_q40/duckdb:duckdb 14787710 14636842 1.01
tpcds_q41/duckdb:duckdb 9432773 9567357 0.99
tpcds_q42/duckdb:duckdb 8364426 8487112 0.99
tpcds_q43/duckdb:duckdb 14568286 14970841 0.97
tpcds_q44/duckdb:duckdb 15553325 15062380 1.03
tpcds_q45/duckdb:duckdb 18721493 18512052 1.01
tpcds_q46/duckdb:duckdb 38385431 39164577 0.98
tpcds_q47/duckdb:duckdb 46295085 46454633 1.00
tpcds_q48/duckdb:duckdb 25414049 25636106 0.99
tpcds_q49/duckdb:duckdb 20749504 20734040 1.00
tpcds_q50/duckdb:duckdb 16012237 16133992 0.99
tpcds_q51/duckdb:duckdb 100120245 100621937 1.00
tpcds_q52/duckdb:duckdb 9347215 9232974 1.01
tpcds_q53/duckdb:duckdb 17729088 17315613 1.02
tpcds_q54/duckdb:duckdb 18769133 18989969 0.99
tpcds_q55/duckdb:duckdb 9410392 10439038 0.90
tpcds_q56/duckdb:duckdb 16703948 17066681 0.98
tpcds_q57/duckdb:duckdb 36129298 36500457 0.99
tpcds_q58/duckdb:duckdb 17104921 17786476 0.96
tpcds_q59/duckdb:duckdb 36574175 37238769 0.98
tpcds_q60/duckdb:duckdb 18755316 18731364 1.00
tpcds_q61/duckdb:duckdb 17039876 17095755 1.00
tpcds_q62/duckdb:duckdb 9769392 9814439 1.00
tpcds_q63/duckdb:duckdb 16300146 16664985 0.98
tpcds_q64/duckdb:duckdb 58774654 58598200 1.00
tpcds_q65/duckdb:duckdb 36402412 36728980 0.99
tpcds_q66/duckdb:duckdb 25917902 26861191 0.96
tpcds_q67/duckdb:duckdb 132646054 128549004 1.03
tpcds_q68/duckdb:duckdb 27023842 26774371 1.01
tpcds_q69/duckdb:duckdb 27800351 28552434 0.97
tpcds_q70/duckdb:duckdb 16606207 16838287 0.99
tpcds_q71/duckdb:duckdb 16526436 15564977 1.06
tpcds_q72/duckdb:duckdb 45295738 46248638 0.98
tpcds_q73/duckdb:duckdb 14133278 13720777 1.03
tpcds_q74/duckdb:duckdb 144588205 144530768 1.00
tpcds_q75/duckdb:duckdb 46743980 47024913 0.99
tpcds_q76/duckdb:duckdb 14961571 14974446 1.00
tpcds_q77/duckdb:duckdb 15008586 15656773 0.96
tpcds_q78/duckdb:duckdb 65228814 66029091 0.99
tpcds_q79/duckdb:duckdb 20339597 20118865 1.01
tpcds_q80/duckdb:duckdb 33152561 33492369 0.99
tpcds_q81/duckdb:duckdb 40079614 40550577 0.99
tpcds_q82/duckdb:duckdb 10722203 10456766 1.03
tpcds_q83/duckdb:duckdb 11224991 11297647 0.99
tpcds_q84/duckdb:duckdb 14374486 15286689 0.94
tpcds_q85/duckdb:duckdb 25485940 26649115 0.96
tpcds_q86/duckdb:duckdb 12069993 12320078 0.98
tpcds_q87/duckdb:duckdb 39618849 36068202 1.10
tpcds_q88/duckdb:duckdb 30212094 30630849 0.99
tpcds_q89/duckdb:duckdb 20737123 22731254 0.91
tpcds_q90/duckdb:duckdb 6129793 6326162 0.97
tpcds_q91/duckdb:duckdb 14094855 14626272 0.96
tpcds_q92/duckdb:duckdb 9886393 9924108 1.00
tpcds_q93/duckdb:duckdb 23686195 23915556 0.99
tpcds_q94/duckdb:duckdb 14839913 14499459 1.02
tpcds_q95/duckdb:duckdb 129930763 131309577 0.99
tpcds_q96/duckdb:duckdb 5927993 5820759 1.02
tpcds_q97/duckdb:duckdb 31606374 31865179 0.99
tpcds_q98/duckdb:duckdb 20740782 20207051 1.03
tpcds_q99/duckdb:duckdb 17073086 17056881 1.00
File Size Changes (7 files changed, -0.0% overall, 2↑ 5↓)
File Scale Format Base HEAD Change %
customer.vortex 1.0 vortex-file-compressed 4.18 MB 4.27 MB +84.98 KB +2.0%
item.vortex 1.0 vortex-file-compressed 1.66 MB 1.66 MB +416 B +0.0%
item.vortex 1.0 vortex-compact 994.59 KB 994.34 KB 256 B -0.0%
catalog_page.vortex 1.0 vortex-file-compressed 572.14 KB 571.48 KB 672 B -0.1%
customer_address.vortex 1.0 vortex-file-compressed 829.26 KB 826.10 KB 3.16 KB -0.4%
date_dim.vortex 1.0 vortex-file-compressed 1.03 MB 964.20 KB 91.19 KB -8.6%
time_dim.vortex 1.0 vortex-file-compressed 434.59 KB 380.71 KB 53.88 KB -12.4%

Totals:

  • vortex-compact: 207.50 MB → 207.50 MB (-0.0%)
  • vortex-file-compressed: 271.82 MB → 271.76 MB (-0.0%)

@github-actions

github-actions Bot commented Jun 17, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb S3

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +3.8%
Engines: DataFusion No clear signal (+9.0%, environment too noisy confidence) · DuckDB No clear signal (-1.2%, environment too noisy confidence)
Vortex (geomean): 1.039x ➖
Parquet (geomean): 1.001x ➖
Shifts: Parquet (control) +0.1% · Median polish -2.7%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.041x ➖, 0↑ 1↓)
name PR bb4f00f (ns) base d257d09 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚨 95936033 34963093 2.74
fineweb_q01/datafusion:vortex-file-compressed 484873128 592083684 0.82
fineweb_q02/datafusion:vortex-file-compressed 514358765 592328628 0.87
fineweb_q03/datafusion:vortex-file-compressed 1380282691 1202978101 1.15
fineweb_q04/datafusion:vortex-file-compressed 1208191865 1332099721 0.91
fineweb_q05/datafusion:vortex-file-compressed 1109260223 1335697791 0.83
fineweb_q06/datafusion:vortex-file-compressed 1792868841 1747765984 1.03
fineweb_q07/datafusion:vortex-file-compressed 1252261761 1439830639 0.87
fineweb_q08/datafusion:vortex-file-compressed 847025199 890979436 0.95
datafusion / vortex-compact (1.207x ➖, 0↑ 3↓)
name PR bb4f00f (ns) base d257d09 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 43256396 37871095 1.14
fineweb_q01/datafusion:vortex-compact 🚨 731334301 554836064 1.32
fineweb_q02/datafusion:vortex-compact 989203041 859035621 1.15
fineweb_q03/datafusion:vortex-compact 1490710371 1339076682 1.11
fineweb_q04/datafusion:vortex-compact 1762781052 1626906114 1.08
fineweb_q05/datafusion:vortex-compact 1482689248 1419153276 1.04
fineweb_q06/datafusion:vortex-compact 🚨 1823661885 1303917813 1.40
fineweb_q07/datafusion:vortex-compact 1204038366 1171999096 1.03
fineweb_q08/datafusion:vortex-compact 🚨 682145251 395239145 1.73
datafusion / parquet (1.028x ➖, 0↑ 0↓)
name PR bb4f00f (ns) base d257d09 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 1287264100 1522670873 0.85
fineweb_q01/datafusion:parquet 2263918680 2293873255 0.99
fineweb_q02/datafusion:parquet 2413490019 2208899202 1.09
fineweb_q03/datafusion:parquet 2135666311 1849383596 1.15
fineweb_q04/datafusion:parquet 2258767359 1932033730 1.17
fineweb_q05/datafusion:parquet 2050176813 2026423486 1.01
fineweb_q06/datafusion:parquet 2115950115 1992509572 1.06
fineweb_q07/datafusion:parquet 2197123310 2230932675 0.98
fineweb_q08/datafusion:parquet 2061047323 2096843455 0.98
duckdb / vortex-file-compressed (0.893x ➖, 0↑ 0↓)
name PR bb4f00f (ns) base d257d09 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 79530051 80829886 0.98
fineweb_q01/duckdb:vortex-file-compressed 828264074 738302070 1.12
fineweb_q02/duckdb:vortex-file-compressed 789348059 930250307 0.85
fineweb_q03/duckdb:vortex-file-compressed 1269487613 1563523520 0.81
fineweb_q04/duckdb:vortex-file-compressed 1386733044 1784765031 0.78
fineweb_q05/duckdb:vortex-file-compressed 1395513285 1466955157 0.95
fineweb_q06/duckdb:vortex-file-compressed 1625354700 1691924512 0.96
fineweb_q07/duckdb:vortex-file-compressed 1371636536 1512363800 0.91
fineweb_q08/duckdb:vortex-file-compressed 606936468 822831120 0.74
duckdb / vortex-compact (1.039x ➖, 0↑ 1↓)
name PR bb4f00f (ns) base d257d09 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 🚨 94478098 66352331 1.42
fineweb_q01/duckdb:vortex-compact 777743691 606673499 1.28
fineweb_q02/duckdb:vortex-compact 715641175 631039755 1.13
fineweb_q03/duckdb:vortex-compact 1609409437 1820501240 0.88
fineweb_q04/duckdb:vortex-compact 1761491834 1884973710 0.93
fineweb_q05/duckdb:vortex-compact 1595605541 1737870447 0.92
fineweb_q06/duckdb:vortex-compact 1767433366 1779057083 0.99
fineweb_q07/duckdb:vortex-compact 1494336840 1659691450 0.90
fineweb_q08/duckdb:vortex-compact 571350222 568584734 1.00
duckdb / parquet (0.975x ➖, 0↑ 0↓)
name PR bb4f00f (ns) base d257d09 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1185312785 1183983846 1.00
fineweb_q01/duckdb:parquet 1557790185 1424918030 1.09
fineweb_q02/duckdb:parquet 1488280483 1562603929 0.95
fineweb_q03/duckdb:parquet 4150673587 4394795251 0.94
fineweb_q04/duckdb:parquet 2041650439 2254699770 0.91
fineweb_q05/duckdb:parquet 2361982188 2445978733 0.97
fineweb_q06/duckdb:parquet 4441845389 4647433449 0.96
fineweb_q07/duckdb:parquet 2859058729 2922672804 0.98
fineweb_q08/duckdb:parquet 1263199661 1271526892 0.99

@github-actions

github-actions Bot commented Jun 17, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Statistical and Population Genetics

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.9%
Engines: DuckDB No clear signal (+0.9%, low confidence)
Vortex (geomean): 1.015x ➖
Parquet (geomean): 1.006x ➖
Shifts: Parquet (control) +0.6% · Median polish +0.6%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
duckdb / vortex-file-compressed (1.021x ➖, 0↑ 0↓)
name PR bb4f00f (ns) base d257d09 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 12132718 11812484 1.03
statpopgen_q01/duckdb:vortex-file-compressed 26291724 26503482 0.99
statpopgen_q02/duckdb:vortex-file-compressed 522880248 521844632 1.00
statpopgen_q03/duckdb:vortex-file-compressed 1055128625 1036362222 1.02
statpopgen_q04/duckdb:vortex-file-compressed 1051929393 1036184764 1.02
statpopgen_q05/duckdb:vortex-file-compressed 477474537 455770463 1.05
statpopgen_q06/duckdb:vortex-file-compressed 1520758366 1516243086 1.00
statpopgen_q07/duckdb:vortex-file-compressed 194741656 187183130 1.04
statpopgen_q08/duckdb:vortex-file-compressed 233907164 216317337 1.08
statpopgen_q09/duckdb:vortex-file-compressed 819588584 814879544 1.01
statpopgen_q10/duckdb:vortex-file-compressed 2539926619 2540879733 1.00
duckdb / vortex-compact (1.010x ➖, 0↑ 0↓)
name PR bb4f00f (ns) base d257d09 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact 11760327 11547345 1.02
statpopgen_q01/duckdb:vortex-compact 235135043 227348769 1.03
statpopgen_q02/duckdb:vortex-compact 562210977 559281283 1.01
statpopgen_q03/duckdb:vortex-compact 1147060759 1145300586 1.00
statpopgen_q04/duckdb:vortex-compact 1154679269 1164420040 0.99
statpopgen_q05/duckdb:vortex-compact 577154435 556712578 1.04
statpopgen_q06/duckdb:vortex-compact 1486812976 1496495037 0.99
statpopgen_q07/duckdb:vortex-compact 885554217 869502498 1.02
statpopgen_q08/duckdb:vortex-compact 915916293 912850661 1.00
statpopgen_q09/duckdb:vortex-compact 941878386 932675221 1.01
statpopgen_q10/duckdb:vortex-compact 2594307565 2601318683 1.00
duckdb / parquet (1.006x ➖, 0↑ 0↓)
name PR bb4f00f (ns) base d257d09 (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 295857189 299989151 0.99
statpopgen_q01/duckdb:parquet 382965530 375058678 1.02
statpopgen_q02/duckdb:parquet 752879656 754111070 1.00
statpopgen_q03/duckdb:parquet 1174899988 1177600334 1.00
statpopgen_q04/duckdb:parquet 1181552776 1193184637 0.99
statpopgen_q05/duckdb:parquet 806497918 797941123 1.01
statpopgen_q06/duckdb:parquet 1431665897 1419952647 1.01
statpopgen_q07/duckdb:parquet 858089626 844661455 1.02
statpopgen_q08/duckdb:parquet 867587581 847539597 1.02
statpopgen_q09/duckdb:parquet 1021044243 1016658594 1.00
statpopgen_q10/duckdb:parquet 2196053781 2167984073 1.01
File Size Changes (1 files changed, +0.0% overall, 1↑ 0↓)
File Scale Format Base HEAD Change %
gnomad.genomes.v3.1.2.hgdp_tgp.chr21.vortex 100000 vortex-file-compressed 1.96 GB 1.96 GB +169.98 KB +0.0%

Totals:

  • vortex-compact: 959.62 MB → 959.62 MB (0.0%)
  • vortex-file-compressed: 1.96 GB → 1.96 GB (+0.0%)

@github-actions

github-actions Bot commented Jun 17, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Random Access

Vortex (geomean): 0.949x ➖
Parquet (geomean): 0.996x ➖

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
unknown / unknown (1.005x ➖, 3↑ 1↓)
name PR bb4f00f (ns) base d257d09 (ns) ratio (PR/base)
random-access/feature-vectors/correlated/lance-tokio-local-disk 🚨 1553039 371568 4.18
random-access/feature-vectors/correlated/lance-tokio-local-disk-footer 1054519 1037286 1.02
random-access/feature-vectors/correlated/parquet-tokio-local-disk 8316641457 8374194078 0.99
random-access/feature-vectors/correlated/parquet-tokio-local-disk-footer 8241111239 8342173540 0.99
random-access/feature-vectors/correlated/vortex-tokio-local-disk 3668516 3753719 0.98
random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer 2844675 2921426 0.97
random-access/feature-vectors/uniform/lance-tokio-local-disk 1198173 1187035 1.01
random-access/feature-vectors/uniform/lance-tokio-local-disk-footer 1858324 1834282 1.01
random-access/feature-vectors/uniform/parquet-tokio-local-disk 8192471217 8273705985 0.99
random-access/feature-vectors/uniform/parquet-tokio-local-disk-footer 8181065588 8295998871 0.99
random-access/feature-vectors/uniform/vortex-tokio-local-disk 3413829 3436968 0.99
random-access/feature-vectors/uniform/vortex-tokio-local-disk-footer 6070686 5810053 1.04
random-access/lance-tokio-local-disk 640419 638123 1.00
random-access/lance-tokio-local-disk-footer 1294087 1289844 1.00
random-access/nested-lists/correlated/lance-tokio-local-disk 235736 239774 0.98
random-access/nested-lists/correlated/lance-tokio-local-disk-footer 580698 584539 0.99
random-access/nested-lists/correlated/parquet-tokio-local-disk 127689665 126641204 1.01
random-access/nested-lists/correlated/parquet-tokio-local-disk-footer 127417151 126481776 1.01
random-access/nested-lists/correlated/vortex-tokio-local-disk 🚀 430284 490086 0.88
random-access/nested-lists/correlated/vortex-tokio-local-disk-footer 🚀 528960 607208 0.87
random-access/nested-lists/uniform/lance-tokio-local-disk 1005642 1046904 0.96
random-access/nested-lists/uniform/lance-tokio-local-disk-footer 1349836 1400466 0.96
random-access/nested-lists/uniform/parquet-tokio-local-disk 127573376 126843448 1.01
random-access/nested-lists/uniform/parquet-tokio-local-disk-footer 127167157 126813223 1.00
random-access/nested-lists/uniform/vortex-tokio-local-disk 1894501 1922437 0.99
random-access/nested-lists/uniform/vortex-tokio-local-disk-footer 2014610 2036958 0.99
random-access/nested-structs/correlated/lance-tokio-local-disk 365601 372057 0.98
random-access/nested-structs/correlated/lance-tokio-local-disk-footer 544055 550885 0.99
random-access/nested-structs/correlated/parquet-tokio-local-disk 21842385 21629988 1.01
random-access/nested-structs/correlated/parquet-tokio-local-disk-footer 21832500 21823864 1.00
random-access/nested-structs/correlated/vortex-tokio-local-disk 540599 563854 0.96
random-access/nested-structs/correlated/vortex-tokio-local-disk-footer 693079 710182 0.98
random-access/nested-structs/uniform/lance-tokio-local-disk 2681201 2751537 0.97
random-access/nested-structs/uniform/lance-tokio-local-disk-footer 2813598 2879190 0.98
random-access/nested-structs/uniform/parquet-tokio-local-disk 21803088 21937260 0.99
random-access/nested-structs/uniform/parquet-tokio-local-disk-footer 21735844 21674425 1.00
random-access/nested-structs/uniform/vortex-tokio-local-disk 1271066 1325379 0.96
random-access/nested-structs/uniform/vortex-tokio-local-disk-footer 1503200 1563788 0.96
random-access/parquet-tokio-local-disk 164965609 166228162 0.99
random-access/parquet-tokio-local-disk-footer 165595029 165730228 1.00
random-access/taxi/correlated/lance-tokio-local-disk 930688 933918 1.00
random-access/taxi/correlated/lance-tokio-local-disk-footer 1788846 1790253 1.00
random-access/taxi/correlated/parquet-tokio-local-disk 248093600 250160779 0.99
random-access/taxi/correlated/parquet-tokio-local-disk-footer 247512924 251343598 0.98
random-access/taxi/correlated/vortex-tokio-local-disk 🚀 1028196 1185887 0.87
random-access/taxi/correlated/vortex-tokio-local-disk-footer 1467915 1604520 0.91
random-access/taxi/uniform/lance-tokio-local-disk 9328877 9339952 1.00
random-access/taxi/uniform/lance-tokio-local-disk-footer 9864766 9912808 1.00
random-access/taxi/uniform/parquet-tokio-local-disk 261869944 265892313 0.98
random-access/taxi/uniform/parquet-tokio-local-disk-footer 261928351 265963258 0.98
random-access/taxi/uniform/vortex-tokio-local-disk 3230693 3351184 0.96
random-access/taxi/uniform/vortex-tokio-local-disk-footer 3847902 3971748 0.97
random-access/vortex-tokio-local-disk 657481 729537 0.90
random-access/vortex-tokio-local-disk-footer 1012017 1100308 0.92

@github-actions

github-actions Bot commented Jun 17, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.0%
Engines: DataFusion No clear signal (-1.1%, low confidence) · DuckDB No clear signal (-0.9%, low confidence)
Vortex (geomean): 0.995x ➖
Parquet (geomean): 1.001x ➖
Shifts: Parquet (control) +0.1% · Median polish -0.5%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.992x ➖, 0↑ 0↓)
name PR bb4f00f (ns) base d257d09 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 406754045 419390260 0.97
tpch_q02/datafusion:vortex-file-compressed 104201213 101620651 1.03
tpch_q03/datafusion:vortex-file-compressed 194260034 193894357 1.00
tpch_q04/datafusion:vortex-file-compressed 99342081 98687020 1.01
tpch_q05/datafusion:vortex-file-compressed 338673019 337499395 1.00
tpch_q06/datafusion:vortex-file-compressed 36496615 36723536 0.99
tpch_q07/datafusion:vortex-file-compressed 459378942 457244806 1.00
tpch_q08/datafusion:vortex-file-compressed 336314224 342967506 0.98
tpch_q09/datafusion:vortex-file-compressed 588223051 597456280 0.98
tpch_q10/datafusion:vortex-file-compressed 226125406 223654947 1.01
tpch_q11/datafusion:vortex-file-compressed 77146386 78246178 0.99
tpch_q12/datafusion:vortex-file-compressed 106874067 107415418 0.99
tpch_q13/datafusion:vortex-file-compressed 196105324 198295992 0.99
tpch_q14/datafusion:vortex-file-compressed 47128484 48474282 0.97
tpch_q15/datafusion:vortex-file-compressed 95322998 95304374 1.00
tpch_q16/datafusion:vortex-file-compressed 73221912 74931071 0.98
tpch_q17/datafusion:vortex-file-compressed 573053802 579797498 0.99
tpch_q18/datafusion:vortex-file-compressed 818927188 818345733 1.00
tpch_q19/datafusion:vortex-file-compressed 62253055 65457197 0.95
tpch_q20/datafusion:vortex-file-compressed 159897179 155507651 1.03
tpch_q21/datafusion:vortex-file-compressed 609881679 614301362 0.99
tpch_q22/datafusion:vortex-file-compressed 53677988 55117850 0.97
datafusion / vortex-compact (0.997x ➖, 0↑ 0↓)
name PR bb4f00f (ns) base d257d09 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 452280812 468263606 0.97
tpch_q02/datafusion:vortex-compact 105164146 103973661 1.01
tpch_q03/datafusion:vortex-compact 197304373 197303307 1.00
tpch_q04/datafusion:vortex-compact 109238163 109187157 1.00
tpch_q05/datafusion:vortex-compact 336245553 339548755 0.99
tpch_q06/datafusion:vortex-compact 59271535 59120878 1.00
tpch_q07/datafusion:vortex-compact 467153155 473136353 0.99
tpch_q08/datafusion:vortex-compact 349638296 342661631 1.02
tpch_q09/datafusion:vortex-compact 586138645 596983634 0.98
tpch_q10/datafusion:vortex-compact 235830012 239765496 0.98
tpch_q11/datafusion:vortex-compact 79870263 78136362 1.02
tpch_q12/datafusion:vortex-compact 153499253 153130160 1.00
tpch_q13/datafusion:vortex-compact 242572433 243491419 1.00
tpch_q14/datafusion:vortex-compact 65532296 65934550 0.99
tpch_q15/datafusion:vortex-compact 151879939 150368710 1.01
tpch_q16/datafusion:vortex-compact 78525769 80260089 0.98
tpch_q17/datafusion:vortex-compact 578107376 582796381 0.99
tpch_q18/datafusion:vortex-compact 819138474 833169466 0.98
tpch_q19/datafusion:vortex-compact 210030368 208218698 1.01
tpch_q20/datafusion:vortex-compact 180381507 181070692 1.00
tpch_q21/datafusion:vortex-compact 618420874 622548966 0.99
tpch_q22/datafusion:vortex-compact 63604288 63007166 1.01
datafusion / parquet (0.999x ➖, 0↑ 0↓)
name PR bb4f00f (ns) base d257d09 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 478663082 477350071 1.00
tpch_q02/datafusion:parquet 175490129 177482072 0.99
tpch_q03/datafusion:parquet 252252620 262513328 0.96
tpch_q04/datafusion:parquet 119482540 118815961 1.01
tpch_q05/datafusion:parquet 389341956 394187401 0.99
tpch_q06/datafusion:parquet 128681771 130849198 0.98
tpch_q07/datafusion:parquet 554808044 555573376 1.00
tpch_q08/datafusion:parquet 453144918 448950527 1.01
tpch_q09/datafusion:parquet 734645035 731232834 1.00
tpch_q10/datafusion:parquet 575183884 577841643 1.00
tpch_q11/datafusion:parquet 119216747 115333375 1.03
tpch_q12/datafusion:parquet 212750641 213250619 1.00
tpch_q13/datafusion:parquet 343522646 350134075 0.98
tpch_q14/datafusion:parquet 155660730 149388678 1.04
tpch_q15/datafusion:parquet 258150356 261067893 0.99
tpch_q16/datafusion:parquet 121377682 122188904 0.99
tpch_q17/datafusion:parquet 660901504 665825492 0.99
tpch_q18/datafusion:parquet 874744702 864465489 1.01
tpch_q19/datafusion:parquet 278835261 280568431 0.99
tpch_q20/datafusion:parquet 294684533 298068979 0.99
tpch_q21/datafusion:parquet 645555751 647367309 1.00
tpch_q22/datafusion:parquet 214774781 209746458 1.02
datafusion / arrow (0.975x ➖, 0↑ 0↓)
name PR bb4f00f (ns) base d257d09 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 675324201 695254644 0.97
tpch_q02/datafusion:arrow 110939799 112427806 0.99
tpch_q03/datafusion:arrow 487885842 503211466 0.97
tpch_q04/datafusion:arrow 359407065 364360623 0.99
tpch_q05/datafusion:arrow 728748266 728244305 1.00
tpch_q06/datafusion:arrow 319304095 328653901 0.97
tpch_q07/datafusion:arrow 1118551859 1151666529 0.97
tpch_q08/datafusion:arrow 915245054 948236003 0.97
tpch_q09/datafusion:arrow 1065177697 1094235930 0.97
tpch_q10/datafusion:arrow 611667504 621683176 0.98
tpch_q11/datafusion:arrow 93039513 92573919 1.01
tpch_q12/datafusion:arrow 1151987584 1277915870 0.90
tpch_q13/datafusion:arrow 471702263 483926128 0.97
tpch_q14/datafusion:arrow 348373638 355683146 0.98
tpch_q15/datafusion:arrow 723411527 728467371 0.99
tpch_q16/datafusion:arrow 80042002 82655753 0.97
tpch_q17/datafusion:arrow 964800441 955871928 1.01
tpch_q18/datafusion:arrow 1787625523 1854357714 0.96
tpch_q19/datafusion:arrow 527293640 558659657 0.94
tpch_q20/datafusion:arrow 490741095 503876580 0.97
tpch_q21/datafusion:arrow 3075467788 3107294771 0.99
tpch_q22/datafusion:arrow 79754057 81656867 0.98
duckdb / vortex-file-compressed (0.999x ➖, 0↑ 0↓)
name PR bb4f00f (ns) base d257d09 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 169816169 169532550 1.00
tpch_q02/duckdb:vortex-file-compressed 52102741 51363645 1.01
tpch_q03/duckdb:vortex-file-compressed 121418068 122602984 0.99
tpch_q04/duckdb:vortex-file-compressed 155280998 159617386 0.97
tpch_q05/duckdb:vortex-file-compressed 135771882 136066119 1.00
tpch_q06/duckdb:vortex-file-compressed 34784076 33969820 1.02
tpch_q07/duckdb:vortex-file-compressed 132017730 129851876 1.02
tpch_q08/duckdb:vortex-file-compressed 167126129 171513528 0.97
tpch_q09/duckdb:vortex-file-compressed 393284481 391291153 1.01
tpch_q10/duckdb:vortex-file-compressed 191607452 191429511 1.00
tpch_q11/duckdb:vortex-file-compressed 32436784 32327089 1.00
tpch_q12/duckdb:vortex-file-compressed 101187950 99087591 1.02
tpch_q13/duckdb:vortex-file-compressed 273595014 272452532 1.00
tpch_q14/duckdb:vortex-file-compressed 52945102 52884720 1.00
tpch_q15/duckdb:vortex-file-compressed 87960762 89960329 0.98
tpch_q16/duckdb:vortex-file-compressed 76688124 75585489 1.01
tpch_q17/duckdb:vortex-file-compressed 94031195 93686493 1.00
tpch_q18/duckdb:vortex-file-compressed 283328230 285221769 0.99
tpch_q19/duckdb:vortex-file-compressed 79096847 79714903 0.99
tpch_q20/duckdb:vortex-file-compressed 140503283 140637752 1.00
tpch_q21/duckdb:vortex-file-compressed 485812946 494140763 0.98
tpch_q22/duckdb:vortex-file-compressed 62820589 64152651 0.98
duckdb / vortex-compact (0.993x ➖, 0↑ 0↓)
name PR bb4f00f (ns) base d257d09 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 229006927 230674487 0.99
tpch_q02/duckdb:vortex-compact 56078544 56771044 0.99
tpch_q03/duckdb:vortex-compact 137289530 136326833 1.01
tpch_q04/duckdb:vortex-compact 169077499 171176582 0.99
tpch_q05/duckdb:vortex-compact 164354727 167607604 0.98
tpch_q06/duckdb:vortex-compact 55130496 55765687 0.99
tpch_q07/duckdb:vortex-compact 173084185 172861323 1.00
tpch_q08/duckdb:vortex-compact 184612722 187099286 0.99
tpch_q09/duckdb:vortex-compact 427826668 428193063 1.00
tpch_q10/duckdb:vortex-compact 220685263 219019410 1.01
tpch_q11/duckdb:vortex-compact 38298417 38360508 1.00
tpch_q12/duckdb:vortex-compact 163485988 163351608 1.00
tpch_q13/duckdb:vortex-compact 325129966 325313393 1.00
tpch_q14/duckdb:vortex-compact 72027001 71934304 1.00
tpch_q15/duckdb:vortex-compact 112680075 114469985 0.98
tpch_q16/duckdb:vortex-compact 79208397 79726820 0.99
tpch_q17/duckdb:vortex-compact 106886506 106479173 1.00
tpch_q18/duckdb:vortex-compact 285575443 289203171 0.99
tpch_q19/duckdb:vortex-compact 95404844 97519890 0.98
tpch_q20/duckdb:vortex-compact 174864304 174805034 1.00
tpch_q21/duckdb:vortex-compact 511854113 525916625 0.97
tpch_q22/duckdb:vortex-compact 70808354 71605835 0.99
duckdb / parquet (1.003x ➖, 0↑ 0↓)
name PR bb4f00f (ns) base d257d09 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 262500377 259123429 1.01
tpch_q02/duckdb:parquet 104926790 103473959 1.01
tpch_q03/duckdb:parquet 212067916 212610549 1.00
tpch_q04/duckdb:parquet 137657349 137341024 1.00
tpch_q05/duckdb:parquet 223686795 224375058 1.00
tpch_q06/duckdb:parquet 75028116 75645202 0.99
tpch_q07/duckdb:parquet 187572413 185050276 1.01
tpch_q08/duckdb:parquet 265583866 261911586 1.01
tpch_q09/duckdb:parquet 473533129 486590007 0.97
tpch_q10/duckdb:parquet 621498148 622099506 1.00
tpch_q11/duckdb:parquet 68228426 64437667 1.06
tpch_q12/duckdb:parquet 130670148 132578658 0.99
tpch_q13/duckdb:parquet 447857198 448901362 1.00
tpch_q14/duckdb:parquet 181337702 180107188 1.01
tpch_q15/duckdb:parquet 103410585 103892063 1.00
tpch_q16/duckdb:parquet 164577552 162872211 1.01
tpch_q17/duckdb:parquet 181869496 181512027 1.00
tpch_q18/duckdb:parquet 365216835 365740940 1.00
tpch_q19/duckdb:parquet 286667342 288021831 1.00
tpch_q20/duckdb:parquet 225826242 224147980 1.01
tpch_q21/duckdb:parquet 560051052 564589144 0.99
tpch_q22/duckdb:parquet 294465547 294368013 1.00
duckdb / duckdb (0.989x ➖, 0↑ 0↓)
name PR bb4f00f (ns) base d257d09 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 119503677 121511991 0.98
tpch_q02/duckdb:duckdb 49480255 52196218 0.95
tpch_q03/duckdb:duckdb 102423722 103632579 0.99
tpch_q04/duckdb:duckdb 137792524 140523913 0.98
tpch_q05/duckdb:duckdb 118307365 118961646 0.99
tpch_q06/duckdb:duckdb 44716410 44977538 0.99
tpch_q07/duckdb:duckdb 90455642 91145122 0.99
tpch_q08/duckdb:duckdb 117548807 118222974 0.99
tpch_q09/duckdb:duckdb 280113469 282645934 0.99
tpch_q10/duckdb:duckdb 212423903 215231899 0.99
tpch_q11/duckdb:duckdb 19261424 19221015 1.00
tpch_q12/duckdb:duckdb 89749085 91900972 0.98
tpch_q13/duckdb:duckdb 227716392 230292260 0.99
tpch_q14/duckdb:duckdb 77149545 77314358 1.00
tpch_q15/duckdb:duckdb 81882195 82580442 0.99
tpch_q16/duckdb:duckdb 75164712 75782604 0.99
tpch_q17/duckdb:duckdb 87968882 87714224 1.00
tpch_q18/duckdb:duckdb 233878461 235556538 0.99
tpch_q19/duckdb:duckdb 124281004 123943147 1.00
tpch_q20/duckdb:duckdb 117325777 118723028 0.99
tpch_q21/duckdb:duckdb 296570692 302305202 0.98
tpch_q22/duckdb:duckdb 65703477 65907213 1.00
File Size Changes (27 files changed, +0.0% overall, 13↑ 14↓)
File Scale Format Base HEAD Change %
part_0.vortex 10.0 vortex-compact 17.00 MB 17.14 MB +143.16 KB +0.8%
supplier_0.vortex 10.0 vortex-file-compressed 5.73 MB 5.77 MB +43.72 KB +0.7%
part_1.vortex 10.0 vortex-compact 16.85 MB 16.94 MB +91.02 KB +0.5%
orders_1.vortex 10.0 vortex-file-compressed 145.16 MB 145.87 MB +728.39 KB +0.5%
orders_2.vortex 10.0 vortex-file-compressed 144.92 MB 145.61 MB +700.73 KB +0.5%
partsupp_1.vortex 10.0 vortex-compact 105.09 MB 105.44 MB +357.23 KB +0.3%
lineitem_10.vortex 10.0 vortex-file-compressed 134.12 MB 134.27 MB +149.91 KB +0.1%
orders_0.vortex 10.0 vortex-file-compressed 144.54 MB 144.68 MB +149.00 KB +0.1%
lineitem_12.vortex 10.0 vortex-file-compressed 134.12 MB 134.25 MB +131.33 KB +0.1%
customer_0.vortex 10.0 vortex-file-compressed 88.51 MB 88.56 MB +52.08 KB +0.1%
lineitem_1.vortex 10.0 vortex-file-compressed 133.72 MB 133.74 MB +26.23 KB +0.0%
partsupp_0.vortex 10.0 vortex-file-compressed 120.30 MB 120.30 MB +3.10 KB +0.0%
customer_0.vortex 10.0 vortex-compact 74.09 MB 74.09 MB +1.90 KB +0.0%
lineitem_9.vortex 10.0 vortex-file-compressed 134.17 MB 134.16 MB 4.53 KB -0.0%
lineitem_6.vortex 10.0 vortex-file-compressed 132.77 MB 132.76 MB 16.89 KB -0.0%
lineitem_5.vortex 10.0 vortex-file-compressed 133.49 MB 133.46 MB 27.89 KB -0.0%
lineitem_3.vortex 10.0 vortex-file-compressed 133.15 MB 133.09 MB 54.56 KB -0.0%
partsupp_1.vortex 10.0 vortex-file-compressed 120.33 MB 120.27 MB 53.66 KB -0.0%
lineitem_4.vortex 10.0 vortex-file-compressed 134.06 MB 133.97 MB 91.56 KB -0.1%
lineitem_8.vortex 10.0 vortex-file-compressed 133.68 MB 133.56 MB 122.12 KB -0.1%
lineitem_2.vortex 10.0 vortex-file-compressed 134.02 MB 133.88 MB 147.91 KB -0.1%
lineitem_0.vortex 10.0 vortex-file-compressed 134.32 MB 134.13 MB 197.95 KB -0.1%
part_1.vortex 10.0 vortex-file-compressed 24.91 MB 24.87 MB 40.02 KB -0.2%
lineitem_11.vortex 10.0 vortex-file-compressed 134.50 MB 134.29 MB 220.88 KB -0.2%
lineitem_7.vortex 10.0 vortex-file-compressed 133.60 MB 133.38 MB 220.83 KB -0.2%
partsupp_0.vortex 10.0 vortex-compact 105.57 MB 105.35 MB 216.94 KB -0.2%
part_0.vortex 10.0 vortex-file-compressed 24.90 MB 24.65 MB 253.38 KB -1.0%

Totals:

  • vortex-compact: 1.93 GB → 1.93 GB (+0.0%)
  • vortex-file-compressed: 2.50 GB → 2.50 GB (+0.0%)

@github-actions

github-actions Bot commented Jun 17, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.8%
Engines: DataFusion No clear signal (+1.2%, low confidence) · DuckDB No clear signal (+0.7%, low confidence)
Vortex (geomean): 1.010x ➖
Parquet (geomean): 1.000x ➖
Shifts: Parquet (control) +0.0% · Median polish +0.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.015x ➖, 0↑ 3↓)
name PR bb4f00f (ns) base d257d09 (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 1609267 1628433 0.99
clickbench_q01/datafusion:vortex-file-compressed 16089498 15025564 1.07
clickbench_q02/datafusion:vortex-file-compressed 35290408 34904924 1.01
clickbench_q03/datafusion:vortex-file-compressed 38091201 38039238 1.00
clickbench_q04/datafusion:vortex-file-compressed 233817301 232234853 1.01
clickbench_q05/datafusion:vortex-file-compressed 304299492 308870858 0.99
clickbench_q06/datafusion:vortex-file-compressed 1629512 1746496 0.93
clickbench_q07/datafusion:vortex-file-compressed 18405946 18160819 1.01
clickbench_q08/datafusion:vortex-file-compressed 325545262 324721006 1.00
clickbench_q09/datafusion:vortex-file-compressed 464144305 453896437 1.02
clickbench_q10/datafusion:vortex-file-compressed 69654197 67770396 1.03
clickbench_q11/datafusion:vortex-file-compressed 80093860 78939016 1.01
clickbench_q12/datafusion:vortex-file-compressed 260460782 256416547 1.02
clickbench_q13/datafusion:vortex-file-compressed 409420051 406841392 1.01
clickbench_q14/datafusion:vortex-file-compressed 254560034 256535414 0.99
clickbench_q15/datafusion:vortex-file-compressed 275739102 272043937 1.01
clickbench_q16/datafusion:vortex-file-compressed 651894243 641823428 1.02
clickbench_q17/datafusion:vortex-file-compressed 634332709 644321065 0.98
clickbench_q18/datafusion:vortex-file-compressed 1356617685 1367401860 0.99
clickbench_q19/datafusion:vortex-file-compressed 🚨 32552106 25986549 1.25
clickbench_q20/datafusion:vortex-file-compressed 323960590 320521274 1.01
clickbench_q21/datafusion:vortex-file-compressed 401117883 394308635 1.02
clickbench_q22/datafusion:vortex-file-compressed 506685655 497616470 1.02
clickbench_q23/datafusion:vortex-file-compressed 513270062 537263797 0.96
clickbench_q24/datafusion:vortex-file-compressed 🚨 46487106 39267758 1.18
clickbench_q25/datafusion:vortex-file-compressed 73081011 73370054 1.00
clickbench_q26/datafusion:vortex-file-compressed 43354701 43668526 0.99
clickbench_q27/datafusion:vortex-file-compressed 422752934 422061446 1.00
clickbench_q28/datafusion:vortex-file-compressed 2381496901 2368624879 1.01
clickbench_q29/datafusion:vortex-file-compressed 50883035 54128496 0.94
clickbench_q30/datafusion:vortex-file-compressed 224439519 212697398 1.06
clickbench_q31/datafusion:vortex-file-compressed 238350409 237530573 1.00
clickbench_q32/datafusion:vortex-file-compressed 1022240465 1028845463 0.99
clickbench_q33/datafusion:vortex-file-compressed 1400343204 1397803659 1.00
clickbench_q34/datafusion:vortex-file-compressed 1394473403 1374629091 1.01
clickbench_q35/datafusion:vortex-file-compressed 237087941 243553663 0.97
clickbench_q36/datafusion:vortex-file-compressed 55930904 58033200 0.96
clickbench_q37/datafusion:vortex-file-compressed 🚨 30045871 24706560 1.22
clickbench_q38/datafusion:vortex-file-compressed 15818283 15598514 1.01
clickbench_q39/datafusion:vortex-file-compressed 117652675 122457544 0.96
clickbench_q40/datafusion:vortex-file-compressed 12152664 12484910 0.97
clickbench_q41/datafusion:vortex-file-compressed 12136991 12163911 1.00
clickbench_q42/datafusion:vortex-file-compressed 12663652 11682228 1.08
datafusion / parquet (1.003x ➖, 0↑ 0↓)
name PR bb4f00f (ns) base d257d09 (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 1499207 1551885 0.97
clickbench_q01/datafusion:parquet 20027250 19753213 1.01
clickbench_q02/datafusion:parquet 42979655 44580173 0.96
clickbench_q03/datafusion:parquet 34487022 36040036 0.96
clickbench_q04/datafusion:parquet 257194676 270398440 0.95
clickbench_q05/datafusion:parquet 325472836 312231273 1.04
clickbench_q06/datafusion:parquet 1535483 1490409 1.03
clickbench_q07/datafusion:parquet 21695006 20535809 1.06
clickbench_q08/datafusion:parquet 327951424 319146701 1.03
clickbench_q09/datafusion:parquet 457947915 483579417 0.95
clickbench_q10/datafusion:parquet 93305881 90631313 1.03
clickbench_q11/datafusion:parquet 115638292 115579018 1.00
clickbench_q12/datafusion:parquet 297473632 287976653 1.03
clickbench_q13/datafusion:parquet 469681728 463607315 1.01
clickbench_q14/datafusion:parquet 311679614 323292596 0.96
clickbench_q15/datafusion:parquet 282959584 280731428 1.01
clickbench_q16/datafusion:parquet 664088720 650461578 1.02
clickbench_q17/datafusion:parquet 658425448 630267591 1.04
clickbench_q18/datafusion:parquet 1398535925 1358678325 1.03
clickbench_q19/datafusion:parquet 27531942 28241190 0.97
clickbench_q20/datafusion:parquet 561804831 555059914 1.01
clickbench_q21/datafusion:parquet 616956770 623793463 0.99
clickbench_q22/datafusion:parquet 900652488 918741235 0.98
clickbench_q23/datafusion:parquet 4024031232 3984476561 1.01
clickbench_q24/datafusion:parquet 50559718 51667257 0.98
clickbench_q25/datafusion:parquet 126738359 128692260 0.98
clickbench_q26/datafusion:parquet 51986655 54189335 0.96
clickbench_q27/datafusion:parquet 649359741 641488435 1.01
clickbench_q28/datafusion:parquet 2462988635 2415133025 1.02
clickbench_q29/datafusion:parquet 43374091 46225789 0.94
clickbench_q30/datafusion:parquet 314602288 310483449 1.01
clickbench_q31/datafusion:parquet 344056087 337488272 1.02
clickbench_q32/datafusion:parquet 1118332008 1110205559 1.01
clickbench_q33/datafusion:parquet 1502864144 1487392394 1.01
clickbench_q34/datafusion:parquet 1501903821 1479174632 1.02
clickbench_q35/datafusion:parquet 246940843 248296682 0.99
clickbench_q36/datafusion:parquet 105741317 106568536 0.99
clickbench_q37/datafusion:parquet 42844310 43342970 0.99
clickbench_q38/datafusion:parquet 61083905 57485488 1.06
clickbench_q39/datafusion:parquet 205285086 203475657 1.01
clickbench_q40/datafusion:parquet 23610387 23442787 1.01
clickbench_q41/datafusion:parquet 21641722 20824744 1.04
clickbench_q42/datafusion:parquet 23207249 22816605 1.02
duckdb / vortex-file-compressed (1.005x ➖, 1↑ 1↓)
name PR bb4f00f (ns) base d257d09 (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 6717958 6480915 1.04
clickbench_q01/duckdb:vortex-file-compressed 10759149 10011187 1.07
clickbench_q02/duckdb:vortex-file-compressed 26672928 25542943 1.04
clickbench_q03/duckdb:vortex-file-compressed 29957313 29738152 1.01
clickbench_q04/duckdb:vortex-file-compressed 187679042 184205333 1.02
clickbench_q05/duckdb:vortex-file-compressed 178329206 177680410 1.00
clickbench_q06/duckdb:vortex-file-compressed 18954733 19314851 0.98
clickbench_q07/duckdb:vortex-file-compressed 🚀 13384815 15575787 0.86
clickbench_q08/duckdb:vortex-file-compressed 262368124 263047774 1.00
clickbench_q09/duckdb:vortex-file-compressed 333906414 337680911 0.99
clickbench_q10/duckdb:vortex-file-compressed 68487233 66493666 1.03
clickbench_q11/duckdb:vortex-file-compressed 77077061 77481142 0.99
clickbench_q12/duckdb:vortex-file-compressed 197973996 201524242 0.98
clickbench_q13/duckdb:vortex-file-compressed 410922315 411505225 1.00
clickbench_q14/duckdb:vortex-file-compressed 231939459 234214798 0.99
clickbench_q15/duckdb:vortex-file-compressed 237552938 239423001 0.99
clickbench_q16/duckdb:vortex-file-compressed 526984345 528206420 1.00
clickbench_q17/duckdb:vortex-file-compressed 427040639 426678234 1.00
clickbench_q18/duckdb:vortex-file-compressed 950606848 953034005 1.00
clickbench_q19/duckdb:vortex-file-compressed 20419449 21848670 0.93
clickbench_q20/duckdb:vortex-file-compressed 307542788 304698808 1.01
clickbench_q21/duckdb:vortex-file-compressed 409285776 409759788 1.00
clickbench_q22/duckdb:vortex-file-compressed 1148582425 1162576849 0.99
clickbench_q23/duckdb:vortex-file-compressed 186393201 183341617 1.02
clickbench_q24/duckdb:vortex-file-compressed 37473723 36135826 1.04
clickbench_q25/duckdb:vortex-file-compressed 84398263 80897429 1.04
clickbench_q26/duckdb:vortex-file-compressed 46178283 49777173 0.93
clickbench_q27/duckdb:vortex-file-compressed 423158386 409238441 1.03
clickbench_q28/duckdb:vortex-file-compressed 3008964853 3033730086 0.99
clickbench_q29/duckdb:vortex-file-compressed 28443188 27811486 1.02
clickbench_q30/duckdb:vortex-file-compressed 190796977 191270958 1.00
clickbench_q31/duckdb:vortex-file-compressed 286627737 275094103 1.04
clickbench_q32/duckdb:vortex-file-compressed 1122802905 1113289746 1.01
clickbench_q33/duckdb:vortex-file-compressed 1107386662 1112335396 1.00
clickbench_q34/duckdb:vortex-file-compressed 1195515331 1185153751 1.01
clickbench_q35/duckdb:vortex-file-compressed 378893874 374096870 1.01
clickbench_q36/duckdb:vortex-file-compressed 28343949 27982897 1.01
clickbench_q37/duckdb:vortex-file-compressed 20883539 19102632 1.09
clickbench_q38/duckdb:vortex-file-compressed 22451743 21544068 1.04
clickbench_q39/duckdb:vortex-file-compressed 45163236 45624413 0.99
clickbench_q40/duckdb:vortex-file-compressed 19796026 20876100 0.95
clickbench_q41/duckdb:vortex-file-compressed 18349547 18303234 1.00
clickbench_q42/duckdb:vortex-file-compressed 🚨 22128467 19985531 1.11
duckdb / parquet (0.998x ➖, 1↑ 0↓)
name PR bb4f00f (ns) base d257d09 (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 21744419 22490927 0.97
clickbench_q01/duckdb:parquet 28799442 30085051 0.96
clickbench_q02/duckdb:parquet 49603105 49437467 1.00
clickbench_q03/duckdb:parquet 40013888 39426951 1.01
clickbench_q04/duckdb:parquet 203746008 200101742 1.02
clickbench_q05/duckdb:parquet 261701165 259609191 1.01
clickbench_q06/duckdb:parquet 47604482 47230455 1.01
clickbench_q07/duckdb:parquet 31281581 31736148 0.99
clickbench_q08/duckdb:parquet 271850390 274291323 0.99
clickbench_q09/duckdb:parquet 402345374 399807858 1.01
clickbench_q10/duckdb:parquet 83822485 83324938 1.01
clickbench_q11/duckdb:parquet 100618728 98487796 1.02
clickbench_q12/duckdb:parquet 281042752 278929446 1.01
clickbench_q13/duckdb:parquet 469533043 465263800 1.01
clickbench_q14/duckdb:parquet 317687117 313860227 1.01
clickbench_q15/duckdb:parquet 254086389 256957894 0.99
clickbench_q16/duckdb:parquet 600841170 597461802 1.01
clickbench_q17/duckdb:parquet 494887841 495716543 1.00
clickbench_q18/duckdb:parquet 1035326740 1034741187 1.00
clickbench_q19/duckdb:parquet 28200926 27783757 1.02
clickbench_q20/duckdb:parquet 410689517 412808791 0.99
clickbench_q21/duckdb:parquet 539875873 536767686 1.01
clickbench_q22/duckdb:parquet 916922093 928089656 0.99
clickbench_q23/duckdb:parquet 263619851 274520940 0.96
clickbench_q24/duckdb:parquet 70801293 69047137 1.03
clickbench_q25/duckdb:parquet 162928429 162475025 1.00
clickbench_q26/duckdb:parquet 53699375 56127512 0.96
clickbench_q27/duckdb:parquet 469782992 473634698 0.99
clickbench_q28/duckdb:parquet 4784242666 4768135886 1.00
clickbench_q29/duckdb:parquet 42691475 41685080 1.02
clickbench_q30/duckdb:parquet 310117764 309187981 1.00
clickbench_q31/duckdb:parquet 372563517 374446790 0.99
clickbench_q32/duckdb:parquet 1115647924 1118353214 1.00
clickbench_q33/duckdb:parquet 1117034721 1103359572 1.01
clickbench_q34/duckdb:parquet 1157226142 1156336016 1.00
clickbench_q35/duckdb:parquet 370792417 368230477 1.01
clickbench_q36/duckdb:parquet 🚀 46559660 52510296 0.89
clickbench_q37/duckdb:parquet 33972445 33906751 1.00
clickbench_q38/duckdb:parquet 37424991 35117294 1.07
clickbench_q39/duckdb:parquet 76733941 78230886 0.98
clickbench_q40/duckdb:parquet 20616458 20581721 1.00
clickbench_q41/duckdb:parquet 20695455 21304768 0.97
clickbench_q42/duckdb:parquet 22449181 21933961 1.02
duckdb / duckdb (1.005x ➖, 0↑ 0↓)
name PR bb4f00f (ns) base d257d09 (ns) ratio (PR/base)
clickbench_q00/duckdb:duckdb 17198873 16828136 1.02
clickbench_q01/duckdb:duckdb 34174217 33930292 1.01
clickbench_q02/duckdb:duckdb 51224085 51774869 0.99
clickbench_q03/duckdb:duckdb 56104597 56549022 0.99
clickbench_q04/duckdb:duckdb 213067703 210388379 1.01
clickbench_q05/duckdb:duckdb 288280695 282680123 1.02
clickbench_q06/duckdb:duckdb 33241767 32972878 1.01
clickbench_q07/duckdb:duckdb 34935788 34820086 1.00
clickbench_q08/duckdb:duckdb 278967838 272417322 1.02
clickbench_q09/duckdb:duckdb 402013674 392444437 1.02
clickbench_q10/duckdb:duckdb 116636345 116936786 1.00
clickbench_q11/duckdb:duckdb 126825112 126642230 1.00
clickbench_q12/duckdb:duckdb 258957897 259353035 1.00
clickbench_q13/duckdb:duckdb 444511925 441527266 1.01
clickbench_q14/duckdb:duckdb 284795250 283507060 1.00
clickbench_q15/duckdb:duckdb 244517619 240846608 1.02
clickbench_q16/duckdb:duckdb 562271245 558794567 1.01
clickbench_q17/duckdb:duckdb 470818504 470172694 1.00
clickbench_q18/duckdb:duckdb 1007468503 1033498594 0.97
clickbench_q19/duckdb:duckdb 35057129 35354202 0.99
clickbench_q20/duckdb:duckdb 500492219 472489894 1.06
clickbench_q21/duckdb:duckdb 472860275 478687525 0.99
clickbench_q22/duckdb:duckdb 555691959 545442823 1.02
clickbench_q23/duckdb:duckdb 256368775 251737196 1.02
clickbench_q24/duckdb:duckdb 60195802 60961870 0.99
clickbench_q25/duckdb:duckdb 148474834 148967981 1.00
clickbench_q26/duckdb:duckdb 61383109 60594534 1.01
clickbench_q27/duckdb:duckdb 413607260 430657681 0.96
clickbench_q28/duckdb:duckdb 4390017131 4381947652 1.00
clickbench_q29/duckdb:duckdb 49918710 50273765 0.99
clickbench_q30/duckdb:duckdb 277525860 276552808 1.00
clickbench_q31/duckdb:duckdb 361696505 360513268 1.00
clickbench_q32/duckdb:duckdb 1119414787 1114780298 1.00
clickbench_q33/duckdb:duckdb 1114550946 1127788043 0.99
clickbench_q34/duckdb:duckdb 1205209876 1199394821 1.00
clickbench_q35/duckdb:duckdb 305872108 300339493 1.02
clickbench_q36/duckdb:duckdb 52707989 48591624 1.08
clickbench_q37/duckdb:duckdb 28370433 28500714 1.00
clickbench_q38/duckdb:duckdb 32770473 32585618 1.01
clickbench_q39/duckdb:duckdb 79643049 81354462 0.98
clickbench_q40/duckdb:duckdb 27405368 27425715 1.00
clickbench_q41/duckdb:duckdb 26809912 26853167 1.00
clickbench_q42/duckdb:duckdb 28837303 29238923 0.99
File Size Changes (104 files changed, +0.0% overall, 54↑ 50↓)
File Scale Format Base HEAD Change %
hits_55.vortex 1.0 vortex-file-compressed 166.59 MB 169.17 MB +2.58 MB +1.5%
hits_84.vortex 1.0 vortex-file-compressed 117.25 MB 117.70 MB +458.02 KB +0.4%
hits_21.vortex 1.0 vortex-file-compressed 93.99 MB 94.23 MB +247.48 KB +0.3%
hits_2.vortex 1.0 vortex-file-compressed 186.55 MB 186.98 MB +447.09 KB +0.2%
hits_27.vortex 1.0 vortex-compact 69.81 MB 69.95 MB +143.06 KB +0.2%
hits_86.vortex 1.0 vortex-file-compressed 69.40 MB 69.53 MB +137.06 KB +0.2%
hits_23.vortex 1.0 vortex-file-compressed 77.95 MB 78.08 MB +135.77 KB +0.2%
hits_82.vortex 1.0 vortex-file-compressed 99.88 MB 100.05 MB +172.88 KB +0.2%
hits_10.vortex 1.0 vortex-file-compressed 69.68 MB 69.80 MB +118.36 KB +0.2%
hits_58.vortex 1.0 vortex-file-compressed 90.37 MB 90.49 MB +128.78 KB +0.1%
hits_49.vortex 1.0 vortex-file-compressed 75.82 MB 75.92 MB +103.59 KB +0.1%
hits_29.vortex 1.0 vortex-file-compressed 59.84 MB 59.91 MB +75.34 KB +0.1%
hits_14.vortex 1.0 vortex-file-compressed 111.38 MB 111.51 MB +139.43 KB +0.1%
hits_98.vortex 1.0 vortex-file-compressed 118.38 MB 118.51 MB +132.49 KB +0.1%
hits_59.vortex 1.0 vortex-file-compressed 101.82 MB 101.92 MB +107.03 KB +0.1%
hits_81.vortex 1.0 vortex-file-compressed 100.79 MB 100.89 MB +103.09 KB +0.1%
hits_91.vortex 1.0 vortex-file-compressed 97.18 MB 97.26 MB +83.87 KB +0.1%
hits_4.vortex 1.0 vortex-file-compressed 108.74 MB 108.82 MB +89.30 KB +0.1%
hits_2.vortex 1.0 vortex-compact 129.14 MB 129.24 MB +102.38 KB +0.1%
hits_18.vortex 1.0 vortex-file-compressed 104.87 MB 104.95 MB +77.56 KB +0.1%
hits_72.vortex 1.0 vortex-file-compressed 84.86 MB 84.92 MB +56.05 KB +0.1%
hits_50.vortex 1.0 vortex-file-compressed 179.38 MB 179.49 MB +116.09 KB +0.1%
hits_26.vortex 1.0 vortex-file-compressed 110.10 MB 110.16 MB +66.80 KB +0.1%
hits_46.vortex 1.0 vortex-file-compressed 69.47 MB 69.51 MB +40.89 KB +0.1%
hits_89.vortex 1.0 vortex-file-compressed 184.53 MB 184.63 MB +104.35 KB +0.1%
hits_0.vortex 1.0 vortex-file-compressed 89.59 MB 89.64 MB +49.22 KB +0.1%
hits_97.vortex 1.0 vortex-file-compressed 107.29 MB 107.34 MB +57.56 KB +0.1%
hits_76.vortex 1.0 vortex-file-compressed 114.39 MB 114.45 MB +59.92 KB +0.1%
hits_7.vortex 1.0 vortex-file-compressed 94.00 MB 94.05 MB +48.60 KB +0.1%
hits_30.vortex 1.0 vortex-file-compressed 87.15 MB 87.19 MB +43.62 KB +0.0%
hits_45.vortex 1.0 vortex-file-compressed 122.04 MB 122.10 MB +59.48 KB +0.0%
hits_36.vortex 1.0 vortex-file-compressed 68.45 MB 68.48 MB +32.48 KB +0.0%
hits_19.vortex 1.0 vortex-file-compressed 73.61 MB 73.65 MB +34.70 KB +0.0%
hits_41.vortex 1.0 vortex-file-compressed 224.11 MB 224.20 MB +94.49 KB +0.0%
hits_27.vortex 1.0 vortex-file-compressed 122.43 MB 122.48 MB +50.48 KB +0.0%
hits_3.vortex 1.0 vortex-file-compressed 142.27 MB 142.32 MB +57.11 KB +0.0%
hits_43.vortex 1.0 vortex-file-compressed 227.22 MB 227.28 MB +65.27 KB +0.0%
hits_22.vortex 1.0 vortex-file-compressed 78.57 MB 78.59 MB +20.43 KB +0.0%
hits_42.vortex 1.0 vortex-file-compressed 223.18 MB 223.23 MB +56.05 KB +0.0%
hits_57.vortex 1.0 vortex-file-compressed 128.23 MB 128.26 MB +29.70 KB +0.0%
hits_68.vortex 1.0 vortex-file-compressed 123.26 MB 123.29 MB +27.77 KB +0.0%
hits_96.vortex 1.0 vortex-file-compressed 135.68 MB 135.71 MB +25.60 KB +0.0%
hits_87.vortex 1.0 vortex-file-compressed 172.65 MB 172.67 MB +25.75 KB +0.0%
hits_90.vortex 1.0 vortex-file-compressed 142.06 MB 142.08 MB +20.56 KB +0.0%
hits_48.vortex 1.0 vortex-file-compressed 28.02 MB 28.03 MB +3.89 KB +0.0%
hits_78.vortex 1.0 vortex-file-compressed 164.23 MB 164.25 MB +21.94 KB +0.0%
hits_93.vortex 1.0 vortex-file-compressed 90.65 MB 90.66 MB +11.38 KB +0.0%
hits_35.vortex 1.0 vortex-file-compressed 115.17 MB 115.18 MB +12.75 KB +0.0%
hits_88.vortex 1.0 vortex-file-compressed 111.45 MB 111.46 MB +10.05 KB +0.0%
hits_75.vortex 1.0 vortex-file-compressed 63.33 MB 63.34 MB +5.66 KB +0.0%
hits_32.vortex 1.0 vortex-file-compressed 66.83 MB 66.83 MB +5.45 KB +0.0%
hits_92.vortex 1.0 vortex-file-compressed 146.88 MB 146.89 MB +11.56 KB +0.0%
hits_44.vortex 1.0 vortex-file-compressed 186.87 MB 186.88 MB +10.04 KB +0.0%
hits_47.vortex 1.0 vortex-file-compressed 41.32 MB 41.32 MB +1.05 KB +0.0%
hits_6.vortex 1.0 vortex-file-compressed 93.33 MB 93.33 MB 64 B -0.0%
hits_71.vortex 1.0 vortex-file-compressed 102.13 MB 102.13 MB 1.21 KB -0.0%
hits_12.vortex 1.0 vortex-file-compressed 101.08 MB 101.08 MB 1.52 KB -0.0%
hits_38.vortex 1.0 vortex-file-compressed 99.26 MB 99.26 MB 2.23 KB -0.0%
hits_5.vortex 1.0 vortex-file-compressed 92.95 MB 92.95 MB 3.68 KB -0.0%
hits_79.vortex 1.0 vortex-file-compressed 145.09 MB 145.09 MB 6.54 KB -0.0%
hits_17.vortex 1.0 vortex-file-compressed 87.55 MB 87.54 MB 7.46 KB -0.0%
hits_62.vortex 1.0 vortex-file-compressed 117.46 MB 117.45 MB 11.09 KB -0.0%
hits_69.vortex 1.0 vortex-file-compressed 123.09 MB 123.07 MB 15.06 KB -0.0%
hits_13.vortex 1.0 vortex-file-compressed 99.35 MB 99.33 MB 14.73 KB -0.0%
hits_52.vortex 1.0 vortex-file-compressed 105.09 MB 105.07 MB 19.09 KB -0.0%
hits_16.vortex 1.0 vortex-file-compressed 80.01 MB 79.99 MB 15.32 KB -0.0%
hits_99.vortex 1.0 vortex-file-compressed 123.16 MB 123.13 MB 26.18 KB -0.0%
hits_83.vortex 1.0 vortex-file-compressed 89.87 MB 89.85 MB 21.52 KB -0.0%
hits_60.vortex 1.0 vortex-file-compressed 103.46 MB 103.44 MB 26.38 KB -0.0%
hits_63.vortex 1.0 vortex-file-compressed 69.31 MB 69.29 MB 18.84 KB -0.0%
hits_15.vortex 1.0 vortex-file-compressed 89.29 MB 89.27 MB 26.31 KB -0.0%
hits_37.vortex 1.0 vortex-file-compressed 86.08 MB 86.05 MB 29.51 KB -0.0%
hits_54.vortex 1.0 vortex-file-compressed 221.40 MB 221.32 MB 78.35 KB -0.0%
hits_85.vortex 1.0 vortex-file-compressed 91.91 MB 91.88 MB 36.13 KB -0.0%
hits_24.vortex 1.0 vortex-file-compressed 77.49 MB 77.45 MB 31.56 KB -0.0%
hits_67.vortex 1.0 vortex-file-compressed 184.06 MB 183.98 MB 77.28 KB -0.0%
hits_61.vortex 1.0 vortex-file-compressed 101.32 MB 101.27 MB 42.70 KB -0.0%
hits_25.vortex 1.0 vortex-file-compressed 114.12 MB 114.06 MB 53.75 KB -0.0%
hits_95.vortex 1.0 vortex-file-compressed 96.61 MB 96.57 MB 46.96 KB -0.0%
hits_53.vortex 1.0 vortex-file-compressed 87.28 MB 87.23 MB 43.08 KB -0.0%
hits_11.vortex 1.0 vortex-file-compressed 80.02 MB 79.98 MB 42.06 KB -0.1%
hits_8.vortex 1.0 vortex-file-compressed 93.27 MB 93.22 MB 50.53 KB -0.1%
hits_20.vortex 1.0 vortex-file-compressed 63.01 MB 62.98 MB 36.05 KB -0.1%
hits_80.vortex 1.0 vortex-file-compressed 105.00 MB 104.94 MB 61.59 KB -0.1%
hits_70.vortex 1.0 vortex-file-compressed 93.70 MB 93.65 MB 56.52 KB -0.1%
hits_51.vortex 1.0 vortex-file-compressed 277.64 MB 277.47 MB 167.64 KB -0.1%
hits_34.vortex 1.0 vortex-file-compressed 97.91 MB 97.85 MB 60.35 KB -0.1%
hits_65.vortex 1.0 vortex-file-compressed 183.84 MB 183.72 MB 115.71 KB -0.1%
hits_9.vortex 1.0 vortex-file-compressed 99.27 MB 99.21 MB 66.26 KB -0.1%
hits_1.vortex 1.0 vortex-file-compressed 138.51 MB 138.42 MB 95.85 KB -0.1%
hits_74.vortex 1.0 vortex-file-compressed 120.07 MB 119.98 MB 97.55 KB -0.1%
hits_39.vortex 1.0 vortex-file-compressed 80.40 MB 80.33 MB 73.59 KB -0.1%
hits_28.vortex 1.0 vortex-file-compressed 119.96 MB 119.86 MB 109.88 KB -0.1%
hits_33.vortex 1.0 vortex-file-compressed 57.31 MB 57.26 MB 55.48 KB -0.1%
hits_77.vortex 1.0 vortex-file-compressed 168.74 MB 168.58 MB 167.05 KB -0.1%
hits_64.vortex 1.0 vortex-file-compressed 81.39 MB 81.31 MB 84.21 KB -0.1%
hits_94.vortex 1.0 vortex-file-compressed 138.85 MB 138.71 MB 144.03 KB -0.1%
hits_73.vortex 1.0 vortex-file-compressed 110.56 MB 110.45 MB 115.59 KB -0.1%
hits_31.vortex 1.0 vortex-file-compressed 90.19 MB 90.08 MB 114.65 KB -0.1%
hits_56.vortex 1.0 vortex-file-compressed 123.80 MB 123.64 MB 162.12 KB -0.1%
hits_40.vortex 1.0 vortex-file-compressed 117.97 MB 117.81 MB 158.32 KB -0.1%
hits_66.vortex 1.0 vortex-file-compressed 90.35 MB 90.23 MB 124.62 KB -0.1%
hits_82.vortex 1.0 vortex-compact 67.00 MB 66.79 MB 219.58 KB -0.3%
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%

Totals:

  • vortex-compact: 7.05 GB → 7.05 GB (-0.0%)
  • vortex-file-compressed: 11.02 GB → 11.02 GB (+0.0%)

@github-actions

github-actions Bot commented Jun 17, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -16.8%
Engines: DataFusion No clear signal (-29.4%, environment too noisy confidence) · DuckDB No clear signal (-2.0%, environment too noisy confidence)
Vortex (geomean): 0.932x ➖
Parquet (geomean): 1.120x ➖
Shifts: Parquet (control) +12.0% · Median polish -5.5%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.941x ➖, 2↑ 1↓)
name PR bb4f00f (ns) base d257d09 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 271473238 261970685 1.04
tpch_q02/datafusion:vortex-file-compressed 540740375 451181362 1.20
tpch_q03/datafusion:vortex-file-compressed 547400144 488862082 1.12
tpch_q04/datafusion:vortex-file-compressed 🚨 384326701 281812675 1.36
tpch_q05/datafusion:vortex-file-compressed 670647588 623928350 1.07
tpch_q06/datafusion:vortex-file-compressed 422251131 337791044 1.25
tpch_q07/datafusion:vortex-file-compressed 620824248 517659426 1.20
tpch_q08/datafusion:vortex-file-compressed 1001904245 812833730 1.23
tpch_q09/datafusion:vortex-file-compressed 409484553 489074191 0.84
tpch_q10/datafusion:vortex-file-compressed 577050204 699068558 0.83
tpch_q11/datafusion:vortex-file-compressed 319019797 366684241 0.87
tpch_q12/datafusion:vortex-file-compressed 506071682 444823502 1.14
tpch_q13/datafusion:vortex-file-compressed 🚀 190571515 301840321 0.63
tpch_q14/datafusion:vortex-file-compressed 298785922 426831329 0.70
tpch_q15/datafusion:vortex-file-compressed 🚀 538900514 772570590 0.70
tpch_q16/datafusion:vortex-file-compressed 305822396 429332020 0.71
tpch_q17/datafusion:vortex-file-compressed 398112468 536114760 0.74
tpch_q18/datafusion:vortex-file-compressed 384210294 527935244 0.73
tpch_q19/datafusion:vortex-file-compressed 604702088 722976330 0.84
tpch_q20/datafusion:vortex-file-compressed 539069762 540505757 1.00
tpch_q21/datafusion:vortex-file-compressed 702233929 817989668 0.86
tpch_q22/datafusion:vortex-file-compressed 278564168 231138325 1.21
datafusion / vortex-compact (0.977x ➖, 0↑ 2↓)
name PR bb4f00f (ns) base d257d09 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 354256945 293445508 1.21
tpch_q02/datafusion:vortex-compact 642920657 642280407 1.00
tpch_q03/datafusion:vortex-compact 🚨 700459564 469607101 1.49
tpch_q04/datafusion:vortex-compact 285306790 240886423 1.18
tpch_q05/datafusion:vortex-compact 634767422 657633945 0.97
tpch_q06/datafusion:vortex-compact 452747475 420519466 1.08
tpch_q07/datafusion:vortex-compact 704754409 762111591 0.92
tpch_q08/datafusion:vortex-compact 740159462 994838213 0.74
tpch_q09/datafusion:vortex-compact 476857465 677160014 0.70
tpch_q10/datafusion:vortex-compact 522953737 637274090 0.82
tpch_q11/datafusion:vortex-compact 403928098 416166297 0.97
tpch_q12/datafusion:vortex-compact 433292573 543374549 0.80
tpch_q13/datafusion:vortex-compact 199954797 206699902 0.97
tpch_q14/datafusion:vortex-compact 297096236 302180024 0.98
tpch_q15/datafusion:vortex-compact 480831727 617691997 0.78
tpch_q16/datafusion:vortex-compact 215870271 210947612 1.02
tpch_q17/datafusion:vortex-compact 474632211 532780995 0.89
tpch_q18/datafusion:vortex-compact 386096550 401562905 0.96
tpch_q19/datafusion:vortex-compact 741812951 768517938 0.97
tpch_q20/datafusion:vortex-compact 552775411 466867144 1.18
tpch_q21/datafusion:vortex-compact 618206034 787915589 0.78
tpch_q22/datafusion:vortex-compact 🚨 345916773 231715646 1.49
datafusion / parquet (1.357x ❌, 1↑ 13↓)
name PR bb4f00f (ns) base d257d09 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 267868484 219980533 1.22
tpch_q02/datafusion:parquet 464310699 402742492 1.15
tpch_q03/datafusion:parquet 🚨 501629210 317304035 1.58
tpch_q04/datafusion:parquet 🚨 294050527 167957677 1.75
tpch_q05/datafusion:parquet 🚨 656341135 432767856 1.52
tpch_q06/datafusion:parquet 🚨 452620830 129130124 3.51
tpch_q07/datafusion:parquet 🚨 628128054 467524151 1.34
tpch_q08/datafusion:parquet 🚨 750585654 538481819 1.39
tpch_q09/datafusion:parquet 🚨 596250207 443340600 1.34
tpch_q10/datafusion:parquet 656932584 547327442 1.20
tpch_q11/datafusion:parquet 386713981 423593664 0.91
tpch_q12/datafusion:parquet 🚨 336806621 240747530 1.40
tpch_q13/datafusion:parquet 🚨 671102916 456749986 1.47
tpch_q14/datafusion:parquet 320957822 264876293 1.21
tpch_q15/datafusion:parquet 🚨 548380056 393355582 1.39
tpch_q16/datafusion:parquet 244522942 229608922 1.06
tpch_q17/datafusion:parquet 🚨 752353531 396490882 1.90
tpch_q18/datafusion:parquet 🚨 891804745 453364590 1.97
tpch_q19/datafusion:parquet 665041350 593730839 1.12
tpch_q20/datafusion:parquet 🚀 429420482 759962866 0.57
tpch_q21/datafusion:parquet 667462656 603456538 1.11
tpch_q22/datafusion:parquet 🚨 241892077 161133174 1.50
duckdb / vortex-file-compressed (0.910x ➖, 0↑ 0↓)
name PR bb4f00f (ns) base d257d09 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 334819038 369430422 0.91
tpch_q02/duckdb:vortex-file-compressed 1052900816 1223683054 0.86
tpch_q03/duckdb:vortex-file-compressed 728845331 784979198 0.93
tpch_q04/duckdb:vortex-file-compressed 490855003 563327953 0.87
tpch_q05/duckdb:vortex-file-compressed 926529331 1084509120 0.85
tpch_q06/duckdb:vortex-file-compressed 346289842 390592412 0.89
tpch_q07/duckdb:vortex-file-compressed 1212010806 1241782976 0.98
tpch_q08/duckdb:vortex-file-compressed 1230040337 1290200028 0.95
tpch_q09/duckdb:vortex-file-compressed 1166854634 1260247295 0.93
tpch_q10/duckdb:vortex-file-compressed 856572033 934909596 0.92
tpch_q11/duckdb:vortex-file-compressed 541213500 641574942 0.84
tpch_q12/duckdb:vortex-file-compressed 767182837 842044670 0.91
tpch_q13/duckdb:vortex-file-compressed 564542325 585296362 0.96
tpch_q14/duckdb:vortex-file-compressed 545416287 493907297 1.10
tpch_q15/duckdb:vortex-file-compressed 325131435 387560979 0.84
tpch_q16/duckdb:vortex-file-compressed 386478881 438211425 0.88
tpch_q17/duckdb:vortex-file-compressed 913094268 977713513 0.93
tpch_q18/duckdb:vortex-file-compressed 624799369 805604868 0.78
tpch_q19/duckdb:vortex-file-compressed 602768287 609202059 0.99
tpch_q20/duckdb:vortex-file-compressed 920026038 1027056125 0.90
tpch_q21/duckdb:vortex-file-compressed 1256241701 1343261831 0.94
tpch_q22/duckdb:vortex-file-compressed 306010583 336316606 0.91
duckdb / vortex-compact (0.902x ➖, 0↑ 0↓)
name PR bb4f00f (ns) base d257d09 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 364073763 426685066 0.85
tpch_q02/duckdb:vortex-compact 1014636586 1155341839 0.88
tpch_q03/duckdb:vortex-compact 745940330 799621184 0.93
tpch_q04/duckdb:vortex-compact 426697321 598802576 0.71
tpch_q05/duckdb:vortex-compact 937495878 1036016860 0.90
tpch_q06/duckdb:vortex-compact 402170528 440341869 0.91
tpch_q07/duckdb:vortex-compact 1136876697 1152327150 0.99
tpch_q08/duckdb:vortex-compact 1036784946 1182044629 0.88
tpch_q09/duckdb:vortex-compact 941068932 1330516178 0.71
tpch_q10/duckdb:vortex-compact 812698287 888384389 0.91
tpch_q11/duckdb:vortex-compact 498209837 581901304 0.86
tpch_q12/duckdb:vortex-compact 792652242 738214532 1.07
tpch_q13/duckdb:vortex-compact 424521284 503685696 0.84
tpch_q14/duckdb:vortex-compact 531192669 439291004 1.21
tpch_q15/duckdb:vortex-compact 391236254 456791345 0.86
tpch_q16/duckdb:vortex-compact 418210099 401950179 1.04
tpch_q17/duckdb:vortex-compact 693362971 896931538 0.77
tpch_q18/duckdb:vortex-compact 587883842 649121491 0.91
tpch_q19/duckdb:vortex-compact 557429580 593425057 0.94
tpch_q20/duckdb:vortex-compact 897838838 960900346 0.93
tpch_q21/duckdb:vortex-compact 1130275026 1162103341 0.97
tpch_q22/duckdb:vortex-compact 312877674 344535530 0.91
duckdb / parquet (0.925x ➖, 0↑ 0↓)
name PR bb4f00f (ns) base d257d09 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 443146171 532044102 0.83
tpch_q02/duckdb:parquet 1316492873 1166493830 1.13
tpch_q03/duckdb:parquet 1154170197 1262363619 0.91
tpch_q04/duckdb:parquet 703466772 837372722 0.84
tpch_q05/duckdb:parquet 1353503850 1359362855 1.00
tpch_q06/duckdb:parquet 464748108 558083484 0.83
tpch_q07/duckdb:parquet 1317534873 1440092768 0.91
tpch_q08/duckdb:parquet 1762664411 1937408195 0.91
tpch_q09/duckdb:parquet 1782652260 1593269362 1.12
tpch_q10/duckdb:parquet 1368969216 1608109194 0.85
tpch_q11/duckdb:parquet 776510379 914814053 0.85
tpch_q12/duckdb:parquet 799984492 835057382 0.96
tpch_q13/duckdb:parquet 980884596 1073937368 0.91
tpch_q14/duckdb:parquet 792712914 854500655 0.93
tpch_q15/duckdb:parquet 583242195 546476708 1.07
tpch_q16/duckdb:parquet 694569715 785029418 0.88
tpch_q17/duckdb:parquet 903151839 980046104 0.92
tpch_q18/duckdb:parquet 1037635915 1209180809 0.86
tpch_q19/duckdb:parquet 999149766 1050787868 0.95
tpch_q20/duckdb:parquet 1249596650 1488455484 0.84
tpch_q21/duckdb:parquet 1290623944 1253892257 1.03
tpch_q22/duckdb:parquet 600692456 675093007 0.89

@github-actions

github-actions Bot commented Jun 17, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Compression

Vortex (geomean): 1.005x ➖
Parquet (geomean): 0.998x ➖

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
unknown / unknown (0.998x ➖, 0↑ 0↓)
name PR bb4f00f (ns) base d257d09 (ns) ratio (PR/base)
compress time/Arade 1078012334 1104156502 0.98
compress time/Bimbo 5539221922 5683613751 0.97
compress time/CMSprovider 2749694457 2762864202 1.00
compress time/Euro2016 473635444 473667677 1.00
compress time/Food 378779860 346401364 1.09
compress time/HashTags 832152773 871312085 0.96
compress time/TPC-H l_comment canonical 1201272642 1225532005 0.98
compress time/TPC-H l_comment chunked 1213155559 1228779606 0.99
compress time/taxi 664682750 676368988 0.98
compress time/wide table cols=100 chunks=1 rows=1000 11158993 11341335 0.98
compress time/wide table cols=100 chunks=50 rows=1000 12178145 12248903 0.99
compress time/wide table cols=1000 chunks=1 rows=1000 123906803 123914632 1.00
compress time/wide table cols=1000 chunks=50 rows=1000 124050767 124826809 0.99
compress time/wide table cols=10000 chunks=1 rows=1000 1469841772 1487779615 0.99
compress time/wide table cols=10000 chunks=50 rows=1000 1471624965 1473535211 1.00
decompress time/Arade 25624544 24990898 1.03
decompress time/Bimbo 76949963 76506659 1.01
decompress time/CMSprovider 78506025 76617965 1.02
decompress time/Euro2016 18769072 19300615 0.97
decompress time/Food 8218118 7682469 1.07
decompress time/HashTags 89536755 89144015 1.00
decompress time/TPC-H l_comment canonical 38583009 38833351 0.99
decompress time/TPC-H l_comment chunked 39927064 40592373 0.98
decompress time/taxi 14537522 14505057 1.00
decompress time/wide table cols=100 chunks=1 rows=1000 2268542 2425477 0.94
decompress time/wide table cols=100 chunks=50 rows=1000 2404629 2498789 0.96
decompress time/wide table cols=1000 chunks=1 rows=1000 21476047 21320908 1.01
decompress time/wide table cols=1000 chunks=50 rows=1000 22270868 21882554 1.02
decompress time/wide table cols=10000 chunks=1 rows=1000 241211121 242790809 0.99
decompress time/wide table cols=10000 chunks=50 rows=1000 222667820 231303406 0.96
parquet size/Arade 258014282 258014282 1.00
parquet size/Bimbo 384517292 384517292 1.00
parquet size/CMSprovider 376885545 376885545 1.00
parquet size/Euro2016 122975499 122975499 1.00
parquet size/Food 35699500 35699500 1.00
parquet size/HashTags 133510943 133510943 1.00
parquet size/TPC-H l_comment canonical 158358238 158358238 1.00
parquet size/TPC-H l_comment chunked 158358238 158358238 1.00
parquet size/taxi 55283635 55283635 1.00
parquet size/wide table cols=100 chunks=1 rows=1000 932404 932404 1.00
parquet size/wide table cols=100 chunks=50 rows=1000 932404 932404 1.00
parquet size/wide table cols=1000 chunks=1 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=1000 chunks=50 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=10000 chunks=1 rows=1000 93240004 93240004 1.00
parquet size/wide table cols=10000 chunks=50 rows=1000 93240004 93240004 1.00
parquet_rs-zstd compress time/Arade 2611535449 2622629745 1.00
parquet_rs-zstd compress time/Bimbo 12588970887 12753425329 0.99
parquet_rs-zstd compress time/CMSprovider 6794538610 7027973725 0.97
parquet_rs-zstd compress time/Euro2016 1299308620 1320193501 0.98
parquet_rs-zstd compress time/Food 799597123 803507460 1.00
parquet_rs-zstd compress time/HashTags 2144995441 2193560064 0.98
parquet_rs-zstd compress time/TPC-H l_comment canonical 3210327510 3196925413 1.00
parquet_rs-zstd compress time/TPC-H l_comment chunked 3173157689 3221094562 0.99
parquet_rs-zstd compress time/taxi 1191607601 1202083258 0.99
parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000 6011841 6303505 0.95
parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000 6113728 6013013 1.02
parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000 73403889 76269885 0.96
parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000 74141846 76412575 0.97
parquet_rs-zstd compress time/wide table cols=10000 chunks=1 rows=1000 800398798 800923956 1.00
parquet_rs-zstd compress time/wide table cols=10000 chunks=50 rows=1000 759774144 796923873 0.95
parquet_rs-zstd decompress time/Arade 621371317 627114013 0.99
parquet_rs-zstd decompress time/Bimbo 1693357089 1705033316 0.99
parquet_rs-zstd decompress time/CMSprovider 1685609374 1722949908 0.98
parquet_rs-zstd decompress time/Euro2016 374529936 375958317 1.00
parquet_rs-zstd decompress time/Food 196780399 198456663 0.99
parquet_rs-zstd decompress time/HashTags 629585938 658077413 0.96
parquet_rs-zstd decompress time/TPC-H l_comment canonical 591707335 594480794 1.00
parquet_rs-zstd decompress time/TPC-H l_comment chunked 588967443 594363659 0.99
parquet_rs-zstd decompress time/taxi 245550759 245159411 1.00
parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000 2777985 2842807 0.98
parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000 2872447 2790911 1.03
parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000 32078458 33248863 0.96
parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000 32632479 33476506 0.97
parquet_rs-zstd decompress time/wide table cols=10000 chunks=1 rows=1000 348986493 350321315 1.00
parquet_rs-zstd decompress time/wide table cols=10000 chunks=50 rows=1000 347119059 350096627 0.99
vortex-file-compressed size/Arade 145363860 145363860 1.00
vortex-file-compressed size/Bimbo 468763396 468763396 1.00
vortex-file-compressed size/CMSprovider 417906252 417904796 1.00
vortex-file-compressed size/Euro2016 158450084 158272060 1.00
vortex-file-compressed size/Food 41927000 41927000 1.00
vortex-file-compressed size/HashTags 185592412 185757012 1.00
vortex-file-compressed size/TPC-H l_comment canonical 178365920 178362216 1.00
vortex-file-compressed size/TPC-H l_comment chunked 178445352 178511176 1.00
vortex-file-compressed size/taxi 52364012 52364012 1.00
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000 930912 930912 1.00
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000 930912 930912 1.00
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000 9293712 9293712 1.00
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000 9293712 9293712 1.00
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000 92957712 92957712 1.00
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000 92957712 92957712 1.00
vortex:parquet-zstd ratio compress time/Arade 0 0 0.98
vortex:parquet-zstd ratio compress time/Bimbo 0 0 0.99
vortex:parquet-zstd ratio compress time/CMSprovider 0 0 1.03
vortex:parquet-zstd ratio compress time/Euro2016 0 0 1.02
vortex:parquet-zstd ratio compress time/Food 0 0 1.10
vortex:parquet-zstd ratio compress time/HashTags 0 0 0.98
vortex:parquet-zstd ratio compress time/TPC-H l_comment canonical 0 0 0.98
vortex:parquet-zstd ratio compress time/TPC-H l_comment chunked 0 0 1.00
vortex:parquet-zstd ratio compress time/taxi 0 0 0.99
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=1 rows=1000 1 1 1.03
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=50 rows=1000 1 2 0.98
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=1 rows=1000 1 1 1.04
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=50 rows=1000 1 1 1.02
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=1 rows=1000 1 1 0.99
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=50 rows=1000 1 1 1.05
vortex:parquet-zstd ratio decompress time/Arade 0 0 1.03
vortex:parquet-zstd ratio decompress time/Bimbo 0 0 1.01
vortex:parquet-zstd ratio decompress time/CMSprovider 0 0 1.05
vortex:parquet-zstd ratio decompress time/Euro2016 0 0 0.98
vortex:parquet-zstd ratio decompress time/Food 0 0 1.08
vortex:parquet-zstd ratio decompress time/HashTags 0 0 1.05
vortex:parquet-zstd ratio decompress time/TPC-H l_comment canonical 0 0 1.00
vortex:parquet-zstd ratio decompress time/TPC-H l_comment chunked 0 0 0.99
vortex:parquet-zstd ratio decompress time/taxi 0 0 1.00
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=1 rows=1000 0 0 0.96
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=50 rows=1000 0 0 0.94
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=1 rows=1000 0 0 1.04
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=50 rows=1000 0 0 1.04
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=50 rows=1000 0 0 0.97
vortex:parquet-zstd size/Arade 0 0 1.00
vortex:parquet-zstd size/Bimbo 1 1 1.00
vortex:parquet-zstd size/CMSprovider 1 1 1.00
vortex:parquet-zstd size/Euro2016 1 1 1.00
vortex:parquet-zstd size/Food 1 1 1.00
vortex:parquet-zstd size/HashTags 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment canonical 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment chunked 1 1 1.00
vortex:parquet-zstd size/taxi 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=50 rows=1000 0 0 1.00

@github-actions

github-actions Bot commented Jun 17, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Appian on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +2.4%
Engines: DataFusion No clear signal (+6.6%, low confidence) · DuckDB No clear signal (-0.7%, low confidence)
Vortex (geomean): 1.017x ➖
Parquet (geomean): 0.980x ➖
Shifts: Parquet (control) -2.0% · Median polish -0.7%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.024x ➖, 0↑ 0↓)
name PR bb4f00f (ns) base d257d09 (ns) ratio (PR/base)
appian_q01/datafusion:vortex-file-compressed 137667266 138276111 1.00
appian_q02/datafusion:vortex-file-compressed 626556971 621296564 1.01
appian_q03/datafusion:vortex-file-compressed 366296761 366780422 1.00
appian_q04/datafusion:vortex-file-compressed 44566286933 43929926013 1.01
appian_q05/datafusion:vortex-file-compressed 269806700 257369754 1.05
appian_q06/datafusion:vortex-file-compressed 354131104 340598784 1.04
appian_q07/datafusion:vortex-file-compressed 446795376 424355532 1.05
appian_q08/datafusion:vortex-file-compressed 2052893174 1986571760 1.03
datafusion / parquet (0.960x ➖, 0↑ 0↓)
name PR bb4f00f (ns) base d257d09 (ns) ratio (PR/base)
appian_q01/datafusion:parquet 133171710 143904142 0.93
appian_q02/datafusion:parquet 628995780 666117578 0.94
appian_q03/datafusion:parquet 347558943 380287838 0.91
appian_q04/datafusion:parquet 44691691733 45198566006 0.99
appian_q05/datafusion:parquet 289474651 294023725 0.98
appian_q06/datafusion:parquet 366219714 384124230 0.95
appian_q07/datafusion:parquet 468881880 465600322 1.01
appian_q08/datafusion:parquet 2011669339 2078276625 0.97
duckdb / vortex-file-compressed (1.011x ➖, 0↑ 0↓)
name PR bb4f00f (ns) base d257d09 (ns) ratio (PR/base)
appian_q01/duckdb:vortex-file-compressed 198454575 197134038 1.01
appian_q02/duckdb:vortex-file-compressed 635042702 628145802 1.01
appian_q03/duckdb:vortex-file-compressed 268510327 263838945 1.02
appian_q04/duckdb:vortex-file-compressed 1332893325 1343758096 0.99
appian_q05/duckdb:vortex-file-compressed 303542301 294359532 1.03
appian_q06/duckdb:vortex-file-compressed 809032852 812849231 1.00
appian_q07/duckdb:vortex-file-compressed 351988315 347740154 1.01
appian_q08/duckdb:vortex-file-compressed 1320650600 1288795654 1.02
duckdb / parquet (1.000x ➖, 0↑ 0↓)
name PR bb4f00f (ns) base d257d09 (ns) ratio (PR/base)
appian_q01/duckdb:parquet 212851768 212881424 1.00
appian_q02/duckdb:parquet 622051317 628322428 0.99
appian_q03/duckdb:parquet 296094002 302257755 0.98
appian_q04/duckdb:parquet 1357558424 1342207888 1.01
appian_q05/duckdb:parquet 324994258 324440714 1.00
appian_q06/duckdb:parquet 794105407 800082445 0.99
appian_q07/duckdb:parquet 374284891 366268792 1.02
appian_q08/duckdb:parquet 1302621591 1294379170 1.01
duckdb / duckdb (0.977x ➖, 0↑ 0↓)
name PR bb4f00f (ns) base d257d09 (ns) ratio (PR/base)
appian_q01/duckdb:duckdb 184280903 189560143 0.97
appian_q02/duckdb:duckdb 570319900 583487770 0.98
appian_q03/duckdb:duckdb 397758154 409159870 0.97
appian_q04/duckdb:duckdb 1320832432 1347108128 0.98
appian_q05/duckdb:duckdb 297898341 316604438 0.94
appian_q06/duckdb:duckdb 788461396 802726891 0.98
appian_q07/duckdb:duckdb 336631986 341015130 0.99
appian_q08/duckdb:duckdb 1275057776 1273521679 1.00
File Size Changes (4 files changed, -0.0% overall, 1↑ 3↓)
File Scale Format Base HEAD Change %
orderview.vortex 1.0 vortex-file-compressed 81.09 MB 81.09 MB +944 B +0.0%
addressview.vortex 1.0 vortex-file-compressed 34.62 MB 34.62 MB 24 B -0.0%
creditcardview.vortex 1.0 vortex-file-compressed 61.04 MB 60.97 MB 79.74 KB -0.1%
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%

Totals:

  • vortex-compact: 271.96 MB → 271.69 MB (-0.1%)
  • vortex-file-compressed: 513.76 MB → 513.69 MB (-0.0%)

@github-actions

github-actions Bot commented Jun 17, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -7.7%
Engines: DataFusion No clear signal (-10.2%, environment too noisy confidence) · DuckDB No clear signal (-5.2%, environment too noisy confidence)
Vortex (geomean): 0.932x ➖
Parquet (geomean): 1.010x ➖
Shifts: Parquet (control) +1.0% · Median polish -6.5%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.030x ➖, 0↑ 2↓)
name PR bb4f00f (ns) base d257d09 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 757098949 730381999 1.04
tpch_q02/datafusion:vortex-file-compressed 🚨 1111932447 803315666 1.38
tpch_q03/datafusion:vortex-file-compressed 920530683 986466978 0.93
tpch_q04/datafusion:vortex-file-compressed 633208651 606432319 1.04
tpch_q05/datafusion:vortex-file-compressed 1086616782 1102777697 0.99
tpch_q06/datafusion:vortex-file-compressed 655348900 629515072 1.04
tpch_q07/datafusion:vortex-file-compressed 1242718101 1235621923 1.01
tpch_q08/datafusion:vortex-file-compressed 1594119756 1269171574 1.26
tpch_q09/datafusion:vortex-file-compressed 1346685899 1307852324 1.03
tpch_q10/datafusion:vortex-file-compressed 1089404864 993486774 1.10
tpch_q11/datafusion:vortex-file-compressed 571336668 506167919 1.13
tpch_q12/datafusion:vortex-file-compressed 968801949 1044640493 0.93
tpch_q13/datafusion:vortex-file-compressed 489347688 493550003 0.99
tpch_q14/datafusion:vortex-file-compressed 610275489 592966294 1.03
tpch_q15/datafusion:vortex-file-compressed 1116948811 1007402482 1.11
tpch_q16/datafusion:vortex-file-compressed 🚨 672923341 446672330 1.51
tpch_q17/datafusion:vortex-file-compressed 1105365272 1195999981 0.92
tpch_q18/datafusion:vortex-file-compressed 1334257401 1309965431 1.02
tpch_q19/datafusion:vortex-file-compressed 939323957 1210890438 0.78
tpch_q20/datafusion:vortex-file-compressed 962437966 822100265 1.17
tpch_q21/datafusion:vortex-file-compressed 1613307368 1850042231 0.87
tpch_q22/datafusion:vortex-file-compressed 515219003 728082874 0.71
datafusion / vortex-compact (0.936x ➖, 0↑ 0↓)
name PR bb4f00f (ns) base d257d09 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 733196661 858601114 0.85
tpch_q02/datafusion:vortex-compact 867650640 1061329727 0.82
tpch_q03/datafusion:vortex-compact 870623055 939284802 0.93
tpch_q04/datafusion:vortex-compact 514279491 476710862 1.08
tpch_q05/datafusion:vortex-compact 1043053352 1109163551 0.94
tpch_q06/datafusion:vortex-compact 680207707 751540361 0.91
tpch_q07/datafusion:vortex-compact 1037443725 1163645740 0.89
tpch_q08/datafusion:vortex-compact 1394849149 1370590179 1.02
tpch_q09/datafusion:vortex-compact 1215064273 1178326463 1.03
tpch_q10/datafusion:vortex-compact 1080522127 986672340 1.10
tpch_q11/datafusion:vortex-compact 520515734 515242861 1.01
tpch_q12/datafusion:vortex-compact 808932067 941565481 0.86
tpch_q13/datafusion:vortex-compact 435548671 457932276 0.95
tpch_q14/datafusion:vortex-compact 569913641 649351435 0.88
tpch_q15/datafusion:vortex-compact 1062584109 1033864854 1.03
tpch_q16/datafusion:vortex-compact 480118648 503107977 0.95
tpch_q17/datafusion:vortex-compact 1109523725 1199769486 0.92
tpch_q18/datafusion:vortex-compact 1209768383 1214931922 1.00
tpch_q19/datafusion:vortex-compact 1152609943 1125976215 1.02
tpch_q20/datafusion:vortex-compact 910452791 1121058334 0.81
tpch_q21/datafusion:vortex-compact 1482313263 1759221808 0.84
tpch_q22/datafusion:vortex-compact 855462383 1017711678 0.84
datafusion / parquet (1.093x ➖, 0↑ 3↓)
name PR bb4f00f (ns) base d257d09 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 1171021532 913373335 1.28
tpch_q02/datafusion:parquet 🚨 1958053875 1115195800 1.76
tpch_q03/datafusion:parquet 1067926663 987348799 1.08
tpch_q04/datafusion:parquet 🚨 724494861 514533148 1.41
tpch_q05/datafusion:parquet 1380047811 1119329757 1.23
tpch_q06/datafusion:parquet 565264895 532282836 1.06
tpch_q07/datafusion:parquet 1331702352 1491301435 0.89
tpch_q08/datafusion:parquet 1745327866 1947353648 0.90
tpch_q09/datafusion:parquet 1894463452 2118122064 0.89
tpch_q10/datafusion:parquet 🚨 4151077085 2661942233 1.56
tpch_q11/datafusion:parquet 800482985 691174030 1.16
tpch_q12/datafusion:parquet 736590220 757594570 0.97
tpch_q13/datafusion:parquet 892152225 798007150 1.12
tpch_q14/datafusion:parquet 839973472 813199425 1.03
tpch_q15/datafusion:parquet 1424704010 1382020029 1.03
tpch_q16/datafusion:parquet 521109809 500315332 1.04
tpch_q17/datafusion:parquet 1619047831 1446301656 1.12
tpch_q18/datafusion:parquet 1839433703 1636935467 1.12
tpch_q19/datafusion:parquet 1102409161 1040822352 1.06
tpch_q20/datafusion:parquet 1361120408 1390366687 0.98
tpch_q21/datafusion:parquet 1917950470 1963374519 0.98
tpch_q22/datafusion:parquet 973220408 1215656562 0.80
duckdb / vortex-file-compressed (0.867x ➖, 0↑ 0↓)
name PR bb4f00f (ns) base d257d09 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 659046785 663663536 0.99
tpch_q02/duckdb:vortex-file-compressed 1368872574 1528410734 0.90
tpch_q03/duckdb:vortex-file-compressed 1083635535 1010450719 1.07
tpch_q04/duckdb:vortex-file-compressed 777105520 1007099151 0.77
tpch_q05/duckdb:vortex-file-compressed 1224598204 1496875990 0.82
tpch_q06/duckdb:vortex-file-compressed 573027209 598930552 0.96
tpch_q07/duckdb:vortex-file-compressed 1320838974 1496945306 0.88
tpch_q08/duckdb:vortex-file-compressed 1541557189 1678337447 0.92
tpch_q09/duckdb:vortex-file-compressed 1864642080 2071771372 0.90
tpch_q10/duckdb:vortex-file-compressed 1309787284 1708760170 0.77
tpch_q11/duckdb:vortex-file-compressed 676408809 801588299 0.84
tpch_q12/duckdb:vortex-file-compressed 1233139641 1461421113 0.84
tpch_q13/duckdb:vortex-file-compressed 880602439 1017102205 0.87
tpch_q14/duckdb:vortex-file-compressed 636792634 823859666 0.77
tpch_q15/duckdb:vortex-file-compressed 541608367 611070210 0.89
tpch_q16/duckdb:vortex-file-compressed 553022625 639064893 0.87
tpch_q17/duckdb:vortex-file-compressed 1003401954 1168643711 0.86
tpch_q18/duckdb:vortex-file-compressed 953405335 1163066076 0.82
tpch_q19/duckdb:vortex-file-compressed 888370368 925576967 0.96
tpch_q20/duckdb:vortex-file-compressed 1281161181 1545532946 0.83
tpch_q21/duckdb:vortex-file-compressed 2004158556 2246648657 0.89
tpch_q22/duckdb:vortex-file-compressed 382610572 517253863 0.74
duckdb / vortex-compact (0.902x ➖, 0↑ 0↓)
name PR bb4f00f (ns) base d257d09 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 593233656 617353615 0.96
tpch_q02/duckdb:vortex-compact 1180892069 1266681910 0.93
tpch_q03/duckdb:vortex-compact 860298179 912813151 0.94
tpch_q04/duckdb:vortex-compact 655282259 727929587 0.90
tpch_q05/duckdb:vortex-compact 1153968372 1350695977 0.85
tpch_q06/duckdb:vortex-compact 536075951 710317925 0.75
tpch_q07/duckdb:vortex-compact 1109913928 1347193118 0.82
tpch_q08/duckdb:vortex-compact 1407615634 1454740514 0.97
tpch_q09/duckdb:vortex-compact 1666953402 1700906746 0.98
tpch_q10/duckdb:vortex-compact 1092388515 1151465869 0.95
tpch_q11/duckdb:vortex-compact 742164412 734892996 1.01
tpch_q12/duckdb:vortex-compact 1180720264 1102579532 1.07
tpch_q13/duckdb:vortex-compact 864556132 1043781700 0.83
tpch_q14/duckdb:vortex-compact 666062421 736126581 0.90
tpch_q15/duckdb:vortex-compact 533471818 557787112 0.96
tpch_q16/duckdb:vortex-compact 384835203 541575441 0.71
tpch_q17/duckdb:vortex-compact 910402976 1035473344 0.88
tpch_q18/duckdb:vortex-compact 875620635 953621688 0.92
tpch_q19/duckdb:vortex-compact 749808638 889006393 0.84
tpch_q20/duckdb:vortex-compact 1180682602 1466945399 0.80
tpch_q21/duckdb:vortex-compact 1864549235 1900821777 0.98
tpch_q22/duckdb:vortex-compact 502987018 529141055 0.95
duckdb / parquet (0.932x ➖, 0↑ 1↓)
name PR bb4f00f (ns) base d257d09 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 946942584 1131773464 0.84
tpch_q02/duckdb:parquet 1619210182 1742945100 0.93
tpch_q03/duckdb:parquet 2195052674 2122527731 1.03
tpch_q04/duckdb:parquet 1217608553 1398879602 0.87
tpch_q05/duckdb:parquet 2457638380 2283301481 1.08
tpch_q06/duckdb:parquet 967935067 1305984856 0.74
tpch_q07/duckdb:parquet 🚨 2555126766 1961687094 1.30
tpch_q08/duckdb:parquet 2972330623 3282432452 0.91
tpch_q09/duckdb:parquet 2875661321 3202223088 0.90
tpch_q10/duckdb:parquet 3817375459 4276807305 0.89
tpch_q11/duckdb:parquet 1122029087 1250156720 0.90
tpch_q12/duckdb:parquet 1596041790 1490183156 1.07
tpch_q13/duckdb:parquet 1615689299 1751352774 0.92
tpch_q14/duckdb:parquet 1591312463 1528149273 1.04
tpch_q15/duckdb:parquet 1134208586 1238417544 0.92
tpch_q16/duckdb:parquet 1032819364 1114947740 0.93
tpch_q17/duckdb:parquet 1556090133 1741013187 0.89
tpch_q18/duckdb:parquet 1758927076 1868171597 0.94
tpch_q19/duckdb:parquet 1788805703 1978047543 0.90
tpch_q20/duckdb:parquet 2232526150 2444401797 0.91
tpch_q21/duckdb:parquet 1831568267 2205171836 0.83
tpch_q22/duckdb:parquet 1110884938 1239646745 0.90

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@robert3005 robert3005 robert3005 approved these changes

Assignees

No one assigned

Labels

changelog/performance A performance improvement

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@joseph-isaacs @robert3005