feat: teach FSSTArray to compress the offsets of its codes#952
Merged
Conversation
The codes of an FSSTArray are a vector of binary-strings of one byte codes or an escape code followed by a data. The offsets, unexpectedly, grow quite large, increasing the file size (for example, the TPC-H l_comment column with this PR is 78% the byte size of itself on `develop`). Delta encoding notably decreases the size but also inflates the compression time, seemingly proportional to the space savings (TPC-H l_comment compresses in 111% of the time on `develop`).
Contributor
There was a problem hiding this comment.
Vortex bytes_at
Details
| Benchmark suite | Current: e5191fe | Previous: 52478e6 | Ratio |
|---|---|---|---|
bytes_at/array_data |
588.2944950844585 ns (0.22959611495929266) |
621.9418507028607 ns (2.44126432144094) |
0.95 |
bytes_at/array_view |
865.1191022724676 ns (1.666318527399028) |
905.6464353728737 ns (1.9013790060506608) |
0.96 |
This comment was automatically generated by workflow using github-action-benchmark.
Contributor
There was a problem hiding this comment.
Random Access
Details
| Benchmark suite | Current: e5191fe | Previous: 52478e6 | Ratio |
|---|---|---|---|
random-access/vortex-tokio-local-disk |
1128669.9406547272 ns (10988.47563457) |
1175654.8494212877 ns (6598.379701895174) |
0.96 |
random-access/vortex-local-fs |
1284112.6363036358 ns (4239.39223065367) |
1303883.0879566106 ns (3922.5651344748912) |
0.98 |
random-access/parquet-tokio-local-disk |
184892223.48246032 ns (1206274.9886448383) |
189482193.93333334 ns (3414029.0191666633) |
0.98 |
This comment was automatically generated by workflow using github-action-benchmark.
Contributor
There was a problem hiding this comment.
DataFusion
Details
| Benchmark suite | Current: e5191fe | Previous: 52478e6 | Ratio |
|---|---|---|---|
arrow/planning |
803599.5193729075 ns (951.4559682028485) |
811039.0119660187 ns (821.7016929615056) |
0.99 |
arrow/exec |
1761526.3819850355 ns (6338.448264391394) |
1754477.4944444916 ns (838.4234371726634) |
1.00 |
vortex-pushdown-compressed/planning |
511170.9495589795 ns (692.5652763919206) |
504999.9065270491 ns (1056.0757173341117) |
1.01 |
vortex-pushdown-compressed/exec |
3038429.3735294114 ns (2137.7387941186316) |
3076754.5541176484 ns (1549.3690735299606) |
0.99 |
vortex-pushdown-uncompressed/planning |
510456.05609998637 ns (619.6313885714917) |
507371.8771848143 ns (2029.659159120638) |
1.01 |
vortex-pushdown-uncompressed/exec |
2946453.07235294 ns (2493.1657499996945) |
2921435.0316666667 ns (3251.707631944213) |
1.01 |
vortex-nopushdown-compressed/planning |
817255.5472156473 ns (784.8128899420844) |
821264.0768985472 ns (752.1470123177278) |
1.00 |
vortex-nopushdown-compressed/exec |
14392709.3175 ns (31599.25690624956) |
7532220.418571431 ns (13789.501285715029) |
1.91 |
vortex-nopushdown-uncompressed/planning |
810402.4808958786 ns (463.9701070567826) |
819798.0236872854 ns (2097.564586753433) |
0.99 |
vortex-nopushdown-uncompressed/exec |
1779707.2402901412 ns (1522.023482767865) |
1763489.0853406393 ns (1547.5547677829163) |
1.01 |
This comment was automatically generated by workflow using github-action-benchmark.
robert3005
approved these changes
Oct 1, 2024
robert3005
left a comment
Contributor
There was a problem hiding this comment.
We should give the compressor a better name but otherwise lgtm
Contributor
There was a problem hiding this comment.
Vortex Compression
Details
| Benchmark suite | Current: e5191fe | Previous: 52478e6 | Ratio |
|---|---|---|---|
Yellow Taxi Trip Data Compression Time/taxi compression |
2503634355.5 ns (4792130.52125001) |
2457828457.4 ns (5122084.863749981) |
1.02 |
Yellow Taxi Trip Data Compression Time/taxi compression throughput |
470808924 bytes |
470808924 bytes |
1 |
Yellow Taxi Trip Data Vortex-to-ParquetZstd Ratio/taxi |
1.1197166472932132 ratio |
1.1191356045352074 ratio |
1.00 |
Yellow Taxi Trip Data Vortex-to-ParquetUncompressed Ratio/taxi |
0.7187685953030962 ratio |
0.7183956122917313 ratio |
1.00 |
Yellow Taxi Trip Data Compression Ratio/taxi |
0.12690276236140333 ratio |
0.1268857363459831 ratio |
1.00 |
Yellow Taxi Trip Data Compression Size/taxi |
59746953 bytes |
59738937 bytes |
1.00 |
Public BI Compression Time/AirlineSentiment compression |
405471.637833157 ns (216.64641114196274) |
410258.70987970114 ns (178.92213011000422) |
0.99 |
Public BI Compression Time/AirlineSentiment compression throughput |
2020 bytes |
2020 bytes |
1 |
Public BI Vortex-to-ParquetZstd Ratio/AirlineSentiment |
6.4672897196261685 ratio |
6.4672897196261685 ratio |
1 |
Public BI Vortex-to-ParquetUncompressed Ratio/AirlineSentiment |
4.398305084745763 ratio |
4.398305084745763 ratio |
1 |
Public BI Compression Ratio/AirlineSentiment |
0.6207920792079208 ratio |
0.6207920792079208 ratio |
1 |
Public BI Compression Size/AirlineSentiment |
1254 bytes |
1254 bytes |
1 |
Public BI Compression Time/Arade compression |
3214368372.9 ns (2461156.0675001144) |
3263895775.6 ns (2495398) |
0.98 |
Public BI Compression Time/Arade compression throughput |
787023760 bytes |
787023760 bytes |
1 |
Public BI Vortex-to-ParquetZstd Ratio/Arade |
0.4756214220860639 ratio |
0.4758240782134243 ratio |
1.00 |
Public BI Vortex-to-ParquetUncompressed Ratio/Arade |
0.4245305888768376 ratio |
0.4247114758619328 ratio |
1.00 |
Public BI Compression Ratio/Arade |
0.179312374254114 ratio |
0.17931668543272442 ratio |
1.00 |
Public BI Compression Size/Arade |
141123099 bytes |
141126492 bytes |
1.00 |
Public BI Compression Time/Bimbo compression |
22399367672 ns (23191131.405000687) |
23422393668.1 ns (20375039.300001144) |
0.96 |
Public BI Compression Time/Bimbo compression throughput |
7121333608 bytes |
7121333608 bytes |
1 |
Public BI Vortex-to-ParquetZstd Ratio/Bimbo |
1.2765169885934455 ratio |
1.3421566950291128 ratio |
0.95 |
Public BI Vortex-to-ParquetUncompressed Ratio/Bimbo |
0.8655209607477977 ratio |
0.9100268641435699 ratio |
0.95 |
Public BI Compression Ratio/Bimbo |
0.06319829638291537 ratio |
0.06675800673990837 ratio |
0.95 |
Public BI Compression Size/Bimbo |
450056152 bytes |
475406037 bytes |
0.95 |
Public BI Compression Time/CMSprovider compression |
13334197322.4 ns (20886510.14999962) |
13014570392.2 ns (31995175.650000572) |
1.02 |
Public BI Compression Time/CMSprovider compression throughput |
5149123964 bytes |
5149123964 bytes |
1 |
Public BI Vortex-to-ParquetZstd Ratio/CMSprovider |
1.3069764708842067 ratio |
1.1690154410281313 ratio |
1.12 |
Public BI Vortex-to-ParquetUncompressed Ratio/CMSprovider |
0.8439054186527057 ratio |
0.754824962154752 ratio |
1.12 |
Public BI Compression Ratio/CMSprovider |
0.19148676549516452 ratio |
0.17052116265577638 ratio |
1.12 |
Public BI Compression Size/CMSprovider |
985989093 bytes |
878034605 bytes |
1.12 |
Public BI Compression Time/Euro2016 compression |
1993341633.7 ns (2944625.2000000477) |
1982416446.3 ns (3156051.100000024) |
1.01 |
Public BI Compression Time/Euro2016 compression throughput |
393253221 bytes |
393253221 bytes |
1 |
Public BI Vortex-to-ParquetZstd Ratio/Euro2016 |
1.4408584553885335 ratio |
1.4632212883085418 ratio |
0.98 |
Public BI Vortex-to-ParquetUncompressed Ratio/Euro2016 |
0.6113249907526904 ratio |
0.6208130557162552 ratio |
0.98 |
Public BI Compression Ratio/Euro2016 |
0.43112822971639436 ratio |
0.43239567006623447 ratio |
1.00 |
Public BI Compression Size/Euro2016 |
169542565 bytes |
170040990 bytes |
1.00 |
Public BI Compression Time/Food compression |
1142954416 ns (1802696.613749981) |
1144143244.4 ns (2554262.136250019) |
1.00 |
Public BI Compression Time/Food compression throughput |
332718229 bytes |
332718229 bytes |
1 |
Public BI Vortex-to-ParquetZstd Ratio/Food |
1.2681811382598833 ratio |
1.2682659359052912 ratio |
1.00 |
Public BI Vortex-to-ParquetUncompressed Ratio/Food |
0.7170605154521362 ratio |
0.7171084621069876 ratio |
1.00 |
Public BI Compression Ratio/Food |
0.13348678289580582 ratio |
0.13348677688471347 ratio |
1.00 |
Public BI Compression Size/Food |
44413486 bytes |
44413484 bytes |
1.00 |
Public BI Compression Time/HashTags compression |
2910232997.4 ns (6858632.700000048) |
2777276158.1 ns (3216719.9000000954) |
1.05 |
Public BI Compression Time/HashTags compression throughput |
804495592 bytes |
804495592 bytes |
1 |
Public BI Vortex-to-ParquetZstd Ratio/HashTags |
1.6279525516226578 ratio |
1.6545702471917225 ratio |
0.98 |
Public BI Vortex-to-ParquetUncompressed Ratio/HashTags |
0.46283012469115836 ratio |
0.4703975880959991 ratio |
0.98 |
Public BI Compression Ratio/HashTags |
0.26794521827535384 ratio |
0.26289046341971756 ratio |
1.02 |
Public BI Compression Size/HashTags |
215560747 bytes |
211494219 bytes |
1.02 |
TPC-H l_comment Compression Time/chunked-without-fsst compression |
185446543.7307738 ns (198969.35711307824) |
185908695.05460316 ns (410546.3197886795) |
1.00 |
TPC-H l_comment Compression Time/chunked-without-fsst compression throughput |
183010921 bytes |
183010921 bytes |
1 |
TPC-H l_comment Vortex-to-ParquetZstd Ratio/chunked-without-fsst |
3.215478020951991 ratio |
3.215510709878994 ratio |
1.00 |
TPC-H l_comment Vortex-to-ParquetUncompressed Ratio/chunked-without-fsst |
0.9983884961808818 ratio |
0.9984002796732011 ratio |
1.00 |
TPC-H l_comment Compression Ratio/chunked-without-fsst |
0.999965750677797 ratio |
0.999965750677797 ratio |
1 |
TPC-H l_comment Compression Size/chunked-without-fsst |
183004653 bytes |
183004653 bytes |
1 |
TPC-H l_comment Compression Time/chunked-with-fsst compression |
1180651205.75 ns (669420.875) |
1125767370.25 ns (2829435.2737499475) |
1.05 |
TPC-H l_comment Compression Time/chunked-with-fsst compression throughput |
183010921 bytes |
183010921 bytes |
1 |
TPC-H l_comment Vortex-to-ParquetZstd Ratio/chunked-with-fsst |
1.350086771879532 ratio |
1.5059692062294874 ratio |
0.90 |
TPC-H l_comment Vortex-to-ParquetUncompressed Ratio/chunked-with-fsst |
0.4191946245962638 ratio |
0.4675960406722859 ratio |
0.90 |
TPC-H l_comment Compression Ratio/chunked-with-fsst |
0.4180396753481176 ratio |
0.4431550289832157 ratio |
0.94 |
TPC-H l_comment Compression Size/chunked-with-fsst |
76505826 bytes |
81102210 bytes |
0.94 |
TPC-H l_comment Compression Time/canonical-with-fsst compression |
1181148141.4 ns (2436021.9493750334) |
1125124099.15 ns (1685746.7556251287) |
1.05 |
TPC-H l_comment Compression Time/canonical-with-fsst compression throughput |
183010937 bytes |
183010937 bytes |
1 |
TPC-H l_comment Vortex-to-ParquetZstd Ratio/canonical-with-fsst |
1.350110674570394 ratio |
1.505962699386529 ratio |
0.90 |
TPC-H l_comment Vortex-to-ParquetUncompressed Ratio/canonical-with-fsst |
0.4191963048532095 ratio |
0.4675961911245449 ratio |
0.90 |
TPC-H l_comment Compression Ratio/canonical-with-fsst |
0.41803168299171106 ratio |
0.44314703443106246 ratio |
0.94 |
TPC-H l_comment Compression Size/canonical-with-fsst |
76504370 bytes |
81100754 bytes |
0.94 |
This comment was automatically generated by workflow using github-action-benchmark.
Contributor
There was a problem hiding this comment.
TPC-H
Details
| Benchmark suite | Current: e5191fe | Previous: 52478e6 | Ratio |
|---|---|---|---|
tpch_q1/vortex-in-memory-no-pushdown |
462360430.1 ns (3029435.4462499917) |
473753831.9 ns (1342503.412499994) |
0.98 |
tpch_q1/vortex-in-memory-pushdown |
521428958.9 ns (1572059.65625) |
517159659.6 ns (1301444.8274999857) |
1.01 |
tpch_q1/arrow |
446010798.85 ns (1012450.125) |
455214607 ns (1338972.7381249964) |
0.98 |
tpch_q1/parquet |
656864056.5 ns (1027494.6237499714) |
667929726.6 ns (4424311.639999926) |
0.98 |
tpch_q1/vortex-file-compressed |
609346714 ns (2066517.6187500358) |
640063629.8 ns (1618093.3824999928) |
0.95 |
tpch_q1/vortex-file-uncompressed |
533365073 ns (1893214.548750013) |
550093548.4 ns (1360286.1200000048) |
0.97 |
tpch_q2/vortex-in-memory-no-pushdown |
120886293.60170634 ns (278493.8418288678) |
122033944.99527779 ns (350892.3524999991) |
0.99 |
tpch_q2/vortex-in-memory-pushdown |
121543841.58404763 ns (739303.4776190519) |
121570989.42678574 ns (140517.8623720333) |
1.00 |
tpch_q2/arrow |
118824930.18202381 ns (393646.29035715014) |
120344122.53662698 ns (148800.64494047314) |
0.99 |
tpch_q2/parquet |
151993205.18547618 ns (265188.4255654812) |
155130623.34285712 ns (404219.3774999827) |
0.98 |
tpch_q2/vortex-file-compressed |
153517477.60134923 ns (625584.8883333206) |
152733348.94226187 ns (559796.7192276716) |
1.01 |
tpch_q2/vortex-file-uncompressed |
149409788.91742063 ns (698289.2946662009) |
151549381.94575393 ns (1037287.9079166651) |
0.99 |
tpch_q3/vortex-in-memory-no-pushdown |
149979944.01111108 ns (579388.7284861058) |
153139058.5018254 ns (296629.0756587088) |
0.98 |
tpch_q3/vortex-in-memory-pushdown |
177241796.70246032 ns (638121.8088512123) |
183682846.7 ns (456237.96666666865) |
0.96 |
tpch_q3/arrow |
141752859.9761508 ns (804759.9020015001) |
147530863.7793254 ns (804980.7301587313) |
0.96 |
tpch_q3/parquet |
331438316.05 ns (912163.4500000179) |
338320127.35 ns (1435839.6212500036) |
0.98 |
tpch_q3/vortex-file-compressed |
324229937.15 ns (1187974.419999987) |
329897224.55 ns (1526051.03125) |
0.98 |
tpch_q3/vortex-file-uncompressed |
273395944.65 ns (886905.1393750012) |
279632379.6 ns (1456133.3931249976) |
0.98 |
tpch_q4/vortex-in-memory-no-pushdown |
108878209.41273808 ns (669244.130255945) |
110561275.09865081 ns (299400.7417063415) |
0.98 |
tpch_q4/vortex-in-memory-pushdown |
134765179.40420634 ns (466650.0851379037) |
138891181.11468253 ns (733456.3948621154) |
0.97 |
tpch_q4/arrow |
100051316.21257938 ns (274139.94185813516) |
102040907.45321429 ns (666899.6302976236) |
0.98 |
tpch_q4/parquet |
213762301.6 ns (531224.853333354) |
218784362.13333336 ns (1004894.0979166627) |
0.98 |
tpch_q4/vortex-file-compressed |
286289592.6 ns (683099.6481249928) |
292073583.3 ns (1629590.525000006) |
0.98 |
tpch_q4/vortex-file-uncompressed |
222284752.9333333 ns (636365.6666666716) |
229508152.66666666 ns (972704.1220833361) |
0.97 |
tpch_q5/vortex-in-memory-no-pushdown |
287829519.95 ns (1499818.3868750036) |
293640047.3 ns (1575127.6993749738) |
0.98 |
tpch_q5/vortex-in-memory-pushdown |
297042755.4 ns (1290426.4500000179) |
305548447.35 ns (1369747.2612499893) |
0.97 |
tpch_q5/arrow |
277525009.9 ns (1233431.8056249917) |
286896415.5 ns (1098573.178124994) |
0.97 |
tpch_q5/parquet |
437805218.6 ns (2133112.798124999) |
451179845.55 ns (2568424.400000006) |
0.97 |
tpch_q5/vortex-file-compressed |
339730433.3 ns (2420959.715624988) |
349063314.2 ns (1441001.0100000203) |
0.97 |
tpch_q5/vortex-file-uncompressed |
337945447.1 ns (1159278.1124999821) |
348406067.35 ns (3647175.9462500215) |
0.97 |
tpch_q6/vortex-in-memory-no-pushdown |
41180849.20321428 ns (244992.54736160487) |
44439520.119206354 ns (608999.9928125031) |
0.93 |
tpch_q6/vortex-in-memory-pushdown |
87995533.0620635 ns (155953.03034821898) |
92351866.1720238 ns (277177.66389434785) |
0.95 |
tpch_q6/arrow |
34659967.930952385 ns (148646.46220435947) |
35102121.459669314 ns (239346.04340608418) |
0.99 |
tpch_q6/parquet |
150021062.3222222 ns (390382.4030763954) |
152584258.44603175 ns (1612736.7628908753) |
0.98 |
tpch_q6/vortex-file-compressed |
66963275.914464295 ns (230280.5370104164) |
67726273.71017858 ns (195265.9840520844) |
0.99 |
tpch_q6/vortex-file-uncompressed |
175840249.0720238 ns (624502.2071874887) |
183773983.26666665 ns (1486436.5250000209) |
0.96 |
tpch_q7/vortex-in-memory-no-pushdown |
548037877.8 ns (3372983.880000055) |
549781747.7 ns (4418606.680000007) |
1.00 |
tpch_q7/vortex-in-memory-pushdown |
594690998.5 ns (2890391.2350000143) |
596800286.9 ns (4536096.267499983) |
1.00 |
tpch_q7/arrow |
529661579.8 ns (3767637.350000024) |
542336067.2 ns (1872604.550000012) |
0.98 |
tpch_q7/parquet |
685100922.6 ns (3289077.9575000405) |
690321443 ns (1334760.1462500095) |
0.99 |
tpch_q7/vortex-file-compressed |
708567899.6 ns (4635399.023750007) |
708629925.2 ns (3608811.3237499595) |
1.00 |
tpch_q7/vortex-file-uncompressed |
687797442.5 ns (5304445.379999995) |
691050414.5 ns (3556727.996249974) |
1.00 |
tpch_q8/vortex-in-memory-no-pushdown |
218666240.7 ns (1197224.2975000143) |
224198995.2 ns (456437.2650000006) |
0.98 |
tpch_q8/vortex-in-memory-pushdown |
230714586.06666666 ns (561957.75) |
234873629.46666664 ns (645110.5166666508) |
0.98 |
tpch_q8/arrow |
209186097.16666663 ns (393649.31708332896) |
211970127.46666664 ns (608555.5499999672) |
0.99 |
tpch_q8/parquet |
474481803.05 ns (826954.3356249928) |
478931255.7 ns (1253181.8618749976) |
0.99 |
tpch_q8/vortex-file-compressed |
285369168.75 ns (826275.1137500405) |
288001227.45 ns (1103182.2181250155) |
0.99 |
tpch_q8/vortex-file-uncompressed |
280929985.6 ns (1618112.0656249821) |
269322985.05 ns (1079727.1443750262) |
1.04 |
tpch_q9/vortex-in-memory-no-pushdown |
402151547.15 ns (3526305.5506249964) |
405742240.2 ns (2957116.5831249654) |
0.99 |
tpch_q9/vortex-in-memory-pushdown |
398894674.2 ns (1449215.9487499893) |
404655467.25 ns (935960.1756249964) |
0.99 |
tpch_q9/arrow |
380381273 ns (1578630.3462499976) |
389614418.75 ns (827487.974999994) |
0.98 |
tpch_q9/parquet |
676849287.9 ns (2077952.8174999952) |
691605875.2 ns (7120059.649999976) |
0.98 |
tpch_q9/vortex-file-compressed |
439829528.35 ns (6299674.875) |
439047441.15 ns (3066583.950000018) |
1.00 |
tpch_q9/vortex-file-uncompressed |
433927824.55 ns (5863697.449999988) |
426089511.95 ns (6036113.513749987) |
1.02 |
tpch_q10/vortex-in-memory-no-pushdown |
219490038.96666664 ns (616374.5049999952) |
232536346.90000004 ns (2661571.0274999887) |
0.94 |
tpch_q10/vortex-in-memory-pushdown |
250161825.9 ns (1108744.8900000006) |
255512972.5 ns (1568454.275000006) |
0.98 |
tpch_q10/arrow |
213700223.4 ns (532044.2500000149) |
215940202.16666666 ns (533478.8799999654) |
0.99 |
tpch_q10/parquet |
471149459.6 ns (1003167.0737500191) |
474610639.35 ns (3217533.025000006) |
0.99 |
tpch_q10/vortex-file-compressed |
445092305.2 ns (1373015.8956249952) |
453061021.15 ns (852169.8637499809) |
0.98 |
tpch_q10/vortex-file-uncompressed |
349496231.9 ns (577517.584374994) |
350580045.6 ns (1084275.9812500179) |
1.00 |
tpch_q11/vortex-in-memory-no-pushdown |
172130639.83507937 ns (699521.8056011796) |
173344918.21246034 ns (297433.2367876768) |
0.99 |
tpch_q11/vortex-in-memory-pushdown |
171695468.9413889 ns (1306371.3313888907) |
172768528.8143651 ns (149697.98953175545) |
0.99 |
tpch_q11/arrow |
169310748.9279762 ns (455457.35091517866) |
173791743.48642856 ns (787790.9656785727) |
0.97 |
tpch_q11/parquet |
179262956.5719841 ns (1032412.9061210454) |
184048438.23333332 ns (1159569.6104166508) |
0.97 |
tpch_q11/vortex-file-compressed |
220455286.13333336 ns (852413.9883333147) |
227209611.2666667 ns (697084.049583301) |
0.97 |
tpch_q11/vortex-file-uncompressed |
220290530.6 ns (872949.4383333623) |
224819134.03333336 ns (407946.77375000715) |
0.98 |
tpch_q12/vortex-in-memory-no-pushdown |
198319948.13333333 ns (306601.07666665316) |
198985868.26666665 ns (210551.38375000656) |
1.00 |
tpch_q12/vortex-in-memory-pushdown |
239684479.1666667 ns (400852.5324999988) |
249430533.19999996 ns (349903.1712499857) |
0.96 |
tpch_q12/arrow |
165387749.15023807 ns (224254.48583334684) |
168044356.2545238 ns (362398.2770714313) |
0.98 |
tpch_q12/parquet |
358438897.75 ns (504094.7475000024) |
355244833.2 ns (442124.46000000834) |
1.01 |
tpch_q12/vortex-file-compressed |
635738257.4 ns (1013007.1062499285) |
662436633.2 ns (1481965.75) |
0.96 |
tpch_q12/vortex-file-uncompressed |
346883090.3 ns (1102950.170625031) |
355624154.5 ns (1023949.428124994) |
0.98 |
tpch_q13/vortex-in-memory-no-pushdown |
162655577.84968254 ns (1016137.6269980222) |
163704395.13809526 ns (850006.4140743911) |
0.99 |
tpch_q13/vortex-in-memory-pushdown |
162675866.6993254 ns (1658962.753535226) |
164551489.72892857 ns (1573218.558296129) |
0.99 |
tpch_q13/arrow |
160699005.88972223 ns (2987377.559388876) |
173633862.4832143 ns (3509716.4917991012) |
0.93 |
tpch_q13/parquet |
311099814.65 ns (2660945.9243749976) |
321852767.35 ns (4025722.313749999) |
0.97 |
tpch_q13/vortex-file-compressed |
204789924.8333333 ns (1775148.114166677) |
217340587.6 ns (1937925.935833335) |
0.94 |
tpch_q13/vortex-file-uncompressed |
188495783.5333333 ns (1494667.7549999952) |
201651888.36666664 ns (3382724.3633333296) |
0.93 |
tpch_q14/vortex-in-memory-no-pushdown |
45992536.15321429 ns (364353.7470788695) |
49001342.209880956 ns (193822.29347172752) |
0.94 |
tpch_q14/vortex-in-memory-pushdown |
84438143.99418649 ns (246163.2052896768) |
88905180.42474206 ns (537143.4683752581) |
0.95 |
tpch_q14/arrow |
37210734.662301585 ns (565306.6043650806) |
37302585.13813492 ns (554758.2146230116) |
1.00 |
tpch_q14/parquet |
220940219.2 ns (1320176.5329166502) |
222629267.93333334 ns (1206959.8599999994) |
0.99 |
tpch_q14/vortex-file-compressed |
120554476.79234128 ns (458307.45552678406) |
125093078.25115077 ns (803384.9205788672) |
0.96 |
tpch_q14/vortex-file-uncompressed |
153900117.41265872 ns (712750.0532767773) |
156697935.9484524 ns (398491.1267410815) |
0.98 |
tpch_q15/vortex-in-memory-no-pushdown |
74989100.0722222 ns (330677.13837153465) |
73356067.1308135 ns (318505.22848213464) |
1.02 |
tpch_q15/vortex-in-memory-pushdown |
117771951.72496033 ns (474530.6310639903) |
124433371.27480158 ns (712576.6032366008) |
0.95 |
tpch_q15/arrow |
64507163.49857142 ns (849024.736773815) |
63139248.85662697 ns (144229.070848722) |
1.02 |
tpch_q15/parquet |
294261832.25 ns (1106682.1862500012) |
296222804.75 ns (726363.3037500083) |
0.99 |
tpch_q15/vortex-file-compressed |
219215148.33333334 ns (427738.665416643) |
224019507.9666667 ns (451628.2116666734) |
0.98 |
tpch_q15/vortex-file-uncompressed |
308235150 ns (1184285.1543750167) |
307287338.7 ns (556480.3762499988) |
1.00 |
tpch_q16/vortex-in-memory-no-pushdown |
105091205.46376982 ns (144428.06392460316) |
106287160.33583333 ns (128803.83991666138) |
0.99 |
tpch_q16/vortex-in-memory-pushdown |
124741787.79793651 ns (431224.47520635277) |
124820809.26746032 ns (259289.40926587582) |
1.00 |
tpch_q16/arrow |
104515952.46325396 ns (242803.55858828872) |
105693344.9281746 ns (105317.70376983285) |
0.99 |
tpch_q16/parquet |
121379142.57186508 ns (404845.2290198356) |
122965407.72301587 ns (373181.24492061883) |
0.99 |
tpch_q16/vortex-file-compressed |
135019173.19281748 ns (509782.7570967078) |
137334299.18075398 ns (323225.0115902871) |
0.98 |
tpch_q16/vortex-file-uncompressed |
129548152.52710316 ns (230250.9875714332) |
132474963.44238095 ns (201633.77310118824) |
0.98 |
tpch_q17/vortex-in-memory-no-pushdown |
553830725.8 ns (9068642.186249971) |
559769540.8 ns (4195303.199999988) |
0.99 |
tpch_q17/vortex-in-memory-pushdown |
630252518.2 ns (6895643.168749988) |
630560809.7 ns (8048044.304999948) |
1.00 |
tpch_q17/arrow |
551452674.3 ns (8112572.950000048) |
543795986.6 ns (3470160.050000012) |
1.01 |
tpch_q17/parquet |
580146523.2 ns (1788676.2000000477) |
589179399.9 ns (3200751.422500074) |
0.98 |
tpch_q17/vortex-file-compressed |
608349835.1 ns (1849197.3999999762) |
610919783.8 ns (2406357.4362499714) |
1.00 |
tpch_q17/vortex-file-uncompressed |
601075742.7 ns (3093057.8912499547) |
603617103.5 ns (2871242.0499999523) |
1.00 |
tpch_q18/vortex-in-memory-no-pushdown |
1008695058.9 ns (6285290.503749967) |
988066053.5 ns (3488608.5037499666) |
1.02 |
tpch_q18/vortex-in-memory-pushdown |
1002442895 ns (8026523.099999964) |
984659144.4 ns (3409353.1862499714) |
1.02 |
tpch_q18/arrow |
991603093.2 ns (5882918.5) |
976080218.9 ns (4170958.0750000477) |
1.02 |
tpch_q18/parquet |
1175940088 ns (5177479.573750019) |
1164048981.9 ns (4007732.8337500095) |
1.01 |
tpch_q18/vortex-file-compressed |
1057040647.5 ns (6728925.584999919) |
1035005497.1 ns (3515578.050000012) |
1.02 |
tpch_q18/vortex-file-uncompressed |
1044658883.5 ns (10549752.29250002) |
1003305212.1 ns (5451752.157499969) |
1.04 |
tpch_q19/vortex-in-memory-no-pushdown |
162188038.4645238 ns (477193.1475803405) |
161711108.29547623 ns (229360.0691666603) |
1.00 |
tpch_q19/vortex-in-memory-pushdown |
239578898.63333336 ns (563860.700000003) |
240539998.2333333 ns (534181.5945833474) |
1.00 |
tpch_q19/arrow |
149267560.84833333 ns (248734.57354167104) |
148811179.09051585 ns (287697.4494404942) |
1.00 |
tpch_q19/parquet |
471786777.85 ns (860942.9868749976) |
473587080.5 ns (874611.859375) |
1.00 |
tpch_q19/vortex-file-compressed |
610906538.5 ns (980197.4500000477) |
630583883.8 ns (1033234.5274999738) |
0.97 |
tpch_q19/vortex-file-uncompressed |
312886873.65 ns (563084.5618749857) |
320035096.55 ns (794519.5499999821) |
0.98 |
tpch_q20/vortex-in-memory-no-pushdown |
245388716.53333336 ns (3722431.9349999875) |
244462027.5 ns (543251.0320833325) |
1.00 |
tpch_q20/vortex-in-memory-pushdown |
267162391.25 ns (2006439.2243749797) |
271495915.85 ns (2377837.450000018) |
0.98 |
tpch_q20/arrow |
234717239.86666664 ns (931994.1958333105) |
244997016.99999994 ns (2750550.450000003) |
0.96 |
tpch_q20/parquet |
353892736.4 ns (1435847.3649999797) |
356502791.35 ns (1202214.8087500036) |
0.99 |
tpch_q20/vortex-file-compressed |
349918662.5 ns (1455726.875) |
359972498.05 ns (2659749.193750024) |
0.97 |
tpch_q20/vortex-file-uncompressed |
384304662.5 ns (1908997.949999988) |
401844881.75 ns (3552620.300000012) |
0.96 |
tpch_q21/vortex-in-memory-no-pushdown |
832735982.2 ns (3069893.414999962) |
840962449.6 ns (3961612.800000012) |
0.99 |
tpch_q21/vortex-in-memory-pushdown |
881493646.3 ns (7296335.946249962) |
895270082.6 ns (6769742.314999998) |
0.98 |
tpch_q21/arrow |
816381734.6 ns (3037926.7674999833) |
817174345.7 ns (4448524.399999976) |
1.00 |
tpch_q21/parquet |
972350929.4 ns (3150031.75) |
1013670720 ns (7141520.801249981) |
0.96 |
tpch_q21/vortex-file-compressed |
1229175135.3 ns (5086992.161249995) |
1253691534.8 ns (14309496.50124991) |
0.98 |
tpch_q21/vortex-file-uncompressed |
1086868396.6 ns (5800837.561250091) |
1154241571.1 ns (5996323.6100001335) |
0.94 |
tpch_q22/vortex-in-memory-no-pushdown |
68369727.76075396 ns (716791.1309851184) |
70304310.5931746 ns (220524.2977301553) |
0.97 |
tpch_q22/vortex-in-memory-pushdown |
67888701.55569445 ns (247293.1688836813) |
70275939.12329365 ns (356275.8601726219) |
0.97 |
tpch_q22/arrow |
66366191.4625 ns (203097.2987708375) |
68512666.70307541 ns (227047.13017857075) |
0.97 |
tpch_q22/parquet |
93076523.26988095 ns (127232.02485267818) |
99028763.0940476 ns (210049.30654761195) |
0.94 |
tpch_q22/vortex-file-compressed |
101098547.55666667 ns (574052.9855000004) |
107227186.31876983 ns (506291.36164830625) |
0.94 |
tpch_q22/vortex-file-uncompressed |
101151792.10591272 ns (600935.3884722218) |
106336999.61305556 ns (495845.9898125008) |
0.95 |
This comment was automatically generated by workflow using github-action-benchmark.
Co-authored-by: Robert Kruszewski <[email protected]>
robert3005
pushed a commit
that referenced
this pull request
Apr 20, 2026
This PR contains the following updates: | Package | Change | [Age](https://docs.renovatebot.com/merge-confidence/) | [Confidence](https://docs.renovatebot.com/merge-confidence/) | |---|---|---|---| | [org.apache.arrow:arrow-memory-netty](https://arrow.apache.org/) ([source](https://redirect.github.com/apache/arrow-java)) | `18.3.0` → `19.0.0` |  |  | | [org.apache.arrow:arrow-memory-core](https://arrow.apache.org/) ([source](https://redirect.github.com/apache/arrow-java)) | `18.3.0` → `19.0.0` |  |  | | [org.apache.arrow:arrow-c-data](https://arrow.apache.org/) ([source](https://redirect.github.com/apache/arrow-java)) | `18.3.0` → `19.0.0` |  |  | --- > [!WARNING] > Some dependencies could not be looked up. Check the [Dependency Dashboard](../issues/357) for more information. --- ### Release Notes <details> <summary>apache/arrow-java (org.apache.arrow:arrow-memory-netty)</summary> ### [`v19.0.0`](https://redirect.github.com/apache/arrow-java/releases/tag/v19.0.0): Apache Arrow Java 19.0.0 <!-- Release notes generated using configuration in .github/release.yml at v19.0.0 --> ##### What's Changed ##### Breaking Changes - [GH-774](https://redirect.github.com/apache/arrow-java/issues/774): Consoliate `BitVectorHelper.getValidityBufferSize` and `BaseValueVector.getValidityBufferSizeFromCount` by [@​rtadepalli](https://redirect.github.com/rtadepalli) in [#​775](https://redirect.github.com/apache/arrow-java/pull/775) - [GH-586](https://redirect.github.com/apache/arrow-java/issues/586): Override fixedSizeBinary method for UnionMapWriter by [@​axreldable](https://redirect.github.com/axreldable) in [#​885](https://redirect.github.com/apache/arrow-java/pull/885) - [GH-891](https://redirect.github.com/apache/arrow-java/issues/891): Add ExtensionTypeWriterFactory to TransferPair by [@​jhrotko](https://redirect.github.com/jhrotko) in [#​892](https://redirect.github.com/apache/arrow-java/pull/892) - [GH-948](https://redirect.github.com/apache/arrow-java/issues/948): Use buffer indexing for UUID vector by [@​jhrotko](https://redirect.github.com/jhrotko) in [#​949](https://redirect.github.com/apache/arrow-java/pull/949) - [GH-139](https://redirect.github.com/apache/arrow-java/issues/139): \[Flight] Stop return null from MetadataAdapter.getAll(String) and getAllByte(String) by [@​axreldable](https://redirect.github.com/axreldable) in [#​1016](https://redirect.github.com/apache/arrow-java/pull/1016) ##### New Features and Enhancements - [GH-52](https://redirect.github.com/apache/arrow-java/issues/52): Make RangeEqualsVisitor of RunEndEncodedVector more efficient by [@​ViggoC](https://redirect.github.com/ViggoC) in [#​761](https://redirect.github.com/apache/arrow-java/pull/761) - [GH-765](https://redirect.github.com/apache/arrow-java/issues/765): Do not close/free imported BaseStruct objects by [@​pepijnve](https://redirect.github.com/pepijnve) in [#​766](https://redirect.github.com/apache/arrow-java/pull/766) - [GH-79](https://redirect.github.com/apache/arrow-java/issues/79): Move `splitAndTransferValidityBuffer` to `BaseValueVector` by [@​rtadepalli](https://redirect.github.com/rtadepalli) in [#​777](https://redirect.github.com/apache/arrow-java/pull/777) - [GH-731](https://redirect.github.com/apache/arrow-java/issues/731): Avro adapter, output dictionary-encoded fields as enums by [@​martin-traverse](https://redirect.github.com/martin-traverse) in [#​779](https://redirect.github.com/apache/arrow-java/pull/779) - [GH-725](https://redirect.github.com/apache/arrow-java/issues/725): Added ExtensionReader by [@​xxlaykxx](https://redirect.github.com/xxlaykxx) in [#​726](https://redirect.github.com/apache/arrow-java/pull/726) - [GH-882](https://redirect.github.com/apache/arrow-java/issues/882): Add support for loading native library from a user specified location by [@​pepijnve](https://redirect.github.com/pepijnve) in [#​883](https://redirect.github.com/apache/arrow-java/pull/883) - [GH-109](https://redirect.github.com/apache/arrow-java/issues/109): Implement Vector Validators for StringView by [@​ViggoC](https://redirect.github.com/ViggoC) in [#​886](https://redirect.github.com/apache/arrow-java/pull/886) - [GH-900](https://redirect.github.com/apache/arrow-java/issues/900): Fix gandiva groupId in arrow-bom by [@​XN137](https://redirect.github.com/XN137) in [#​901](https://redirect.github.com/apache/arrow-java/pull/901) - [GH-762](https://redirect.github.com/apache/arrow-java/issues/762): Implement VectorAppender for RunEndEncodedVector by [@​ViggoC](https://redirect.github.com/ViggoC) in [#​884](https://redirect.github.com/apache/arrow-java/pull/884) - [GH-825](https://redirect.github.com/apache/arrow-java/issues/825): Add UUID canonical extension type by [@​jhrotko](https://redirect.github.com/jhrotko) in [#​903](https://redirect.github.com/apache/arrow-java/pull/903) - [GH-110](https://redirect.github.com/apache/arrow-java/issues/110): Flight SQL JDBC related StringView components implementation by [@​ViggoC](https://redirect.github.com/ViggoC) in [#​905](https://redirect.github.com/apache/arrow-java/pull/905) - [GH-863](https://redirect.github.com/apache/arrow-java/issues/863): \[JDBC] Suppress benign exceptions from gRPC layer on ArrowFlightSqlClientHandler#close by [@​ennuite](https://redirect.github.com/ennuite) in [#​910](https://redirect.github.com/apache/arrow-java/pull/910) - [GH-929](https://redirect.github.com/apache/arrow-java/issues/929): Add UUID support in JDBC driver by [@​xborder](https://redirect.github.com/xborder) in [#​930](https://redirect.github.com/apache/arrow-java/pull/930) - [GH-952](https://redirect.github.com/apache/arrow-java/issues/952): Add OAuth support by [@​xborder](https://redirect.github.com/xborder) in [#​953](https://redirect.github.com/apache/arrow-java/pull/953) - [GH-946](https://redirect.github.com/apache/arrow-java/issues/946): Add Variant extension type support by [@​tmater](https://redirect.github.com/tmater) in [#​947](https://redirect.github.com/apache/arrow-java/pull/947) - [GH-130](https://redirect.github.com/apache/arrow-java/issues/130): Fix AutoCloseables to work with [@​Nullable](https://redirect.github.com/Nullable) structures by [@​axreldable](https://redirect.github.com/axreldable) in [#​1017](https://redirect.github.com/apache/arrow-java/pull/1017) - [GH-1038](https://redirect.github.com/apache/arrow-java/issues/1038): Trim object memory for ArrowBuf by [@​lriggs](https://redirect.github.com/lriggs) in [#​1044](https://redirect.github.com/apache/arrow-java/pull/1044) - [GH-1061](https://redirect.github.com/apache/arrow-java/issues/1061): Add codegen classifier jar for arrow-vector. by [@​lriggs](https://redirect.github.com/lriggs) in [#​1062](https://redirect.github.com/apache/arrow-java/pull/1062) - [GH-301](https://redirect.github.com/apache/arrow-java/issues/301): \[Vector] Allow adding a vector at the end of VectorSchemaRoot by [@​axreldable](https://redirect.github.com/axreldable) in [#​1013](https://redirect.github.com/apache/arrow-java/pull/1013) - [GH-552](https://redirect.github.com/apache/arrow-java/issues/552): \[Vector] Add absent methods to the UnionFixedSizeListWriter by [@​axreldable](https://redirect.github.com/axreldable) in [#​1052](https://redirect.github.com/apache/arrow-java/pull/1052) ##### Bug Fixes - MINOR: add missing SOURCE\_DIR in dev/release/release.sh by [@​wgtmac](https://redirect.github.com/wgtmac) in [#​755](https://redirect.github.com/apache/arrow-java/pull/755) - MINOR: Empty stream double check by [@​adampolomski](https://redirect.github.com/adampolomski) in [#​742](https://redirect.github.com/apache/arrow-java/pull/742) - [GH-759](https://redirect.github.com/apache/arrow-java/issues/759): Get length of byte\[] in TryCopyLastError by [@​hnwyllmm](https://redirect.github.com/hnwyllmm) in [#​760](https://redirect.github.com/apache/arrow-java/pull/760) - [GH-899](https://redirect.github.com/apache/arrow-java/issues/899): \[Dataset] Initialize compute module by [@​lidavidm](https://redirect.github.com/lidavidm) in [#​893](https://redirect.github.com/apache/arrow-java/pull/893) - [GH-399](https://redirect.github.com/apache/arrow-java/issues/399): Check for null writers in DenseUnionWriter#setPosition by [@​Kaustav-Sarkar](https://redirect.github.com/Kaustav-Sarkar) in [#​938](https://redirect.github.com/apache/arrow-java/pull/938) - [GH-942](https://redirect.github.com/apache/arrow-java/issues/942): Fix JDBC Connection.setCatalog() by [@​eickler](https://redirect.github.com/eickler) in [#​943](https://redirect.github.com/apache/arrow-java/pull/943) - [GH-951](https://redirect.github.com/apache/arrow-java/issues/951): Fix CI completely, especially JNI on Windows 2022 and MacOS platforms by [@​jbonofre](https://redirect.github.com/jbonofre) in [#​925](https://redirect.github.com/apache/arrow-java/pull/925) - MINOR: Add private constructor to UuidType singleton by [@​tmater](https://redirect.github.com/tmater) in [#​945](https://redirect.github.com/apache/arrow-java/pull/945) - [GH-964](https://redirect.github.com/apache/arrow-java/issues/964): Fix IndexOutOfBoundsException in Array.getResultSet() for JDBC clients by [@​xborder](https://redirect.github.com/xborder) in [#​965](https://redirect.github.com/apache/arrow-java/pull/965) - [GH-932](https://redirect.github.com/apache/arrow-java/issues/932): \[JDBC] Fix memory leak on Connection#close due to unclosed Statement(s) by [@​ennuite](https://redirect.github.com/ennuite) in [#​933](https://redirect.github.com/apache/arrow-java/pull/933) - [GH-125](https://redirect.github.com/apache/arrow-java/issues/125): Allow null timestamp holder sans timezone by [@​Kaustav-Sarkar](https://redirect.github.com/Kaustav-Sarkar) in [#​941](https://redirect.github.com/apache/arrow-java/pull/941) - [GH-343](https://redirect.github.com/apache/arrow-java/issues/343): Fix ListVector offset buffer not properly serialized for nested empty arrays by [@​Yicong-Huang](https://redirect.github.com/Yicong-Huang) in [#​967](https://redirect.github.com/apache/arrow-java/pull/967) - [GH-990](https://redirect.github.com/apache/arrow-java/issues/990): \[JDBC] Fix memory leak on Connection#close due to unclosed ResultSet(s) by [@​ennuite](https://redirect.github.com/ennuite) in [#​991](https://redirect.github.com/apache/arrow-java/pull/991) - [GH-993](https://redirect.github.com/apache/arrow-java/issues/993): Fix missing pipe in milestone assignment script by [@​tmater](https://redirect.github.com/tmater) in [#​992](https://redirect.github.com/apache/arrow-java/pull/992) - [GH-470](https://redirect.github.com/apache/arrow-java/issues/470): \[Vector] Fix ListViewVector.getElementEndIndex(index) method by [@​axreldable](https://redirect.github.com/axreldable) in [#​1019](https://redirect.github.com/apache/arrow-java/pull/1019) - [GH-1007](https://redirect.github.com/apache/arrow-java/issues/1007): fix: does not break class loading if direct buffer allocator is not available by [@​torito](https://redirect.github.com/torito) in [#​1008](https://redirect.github.com/apache/arrow-java/pull/1008) - [GH-994](https://redirect.github.com/apache/arrow-java/issues/994): Fix DatabaseMetaData NPEs when SqlInfo is unavailable by [@​ennuite](https://redirect.github.com/ennuite) in [#​995](https://redirect.github.com/apache/arrow-java/pull/995) - [GH-1004](https://redirect.github.com/apache/arrow-java/issues/1004): \[JDBC] Fix NPE in ArrowFlightJdbcDriver#connect(final String url, final Properties info) by [@​ennuite](https://redirect.github.com/ennuite) in [#​1005](https://redirect.github.com/apache/arrow-java/pull/1005) - [GH-343](https://redirect.github.com/apache/arrow-java/issues/343): Fix BaseVariableWidthVector and BaseLargeVariableWidthVector offset buffer serialization by [@​Yicong-Huang](https://redirect.github.com/Yicong-Huang) in [#​989](https://redirect.github.com/apache/arrow-java/pull/989) ##### Other Changes - MINOR: Bump checker.framework.version from 3.49.2 to 3.49.3 by [@​dependabot](https://redirect.github.com/dependabot)\[bot] in [#​752](https://redirect.github.com/apache/arrow-java/pull/752) - MINOR: Bump com.google.api.grpc:proto-google-common-protos from 2.54.1 to 2.56.0 by [@​dependabot](https://redirect.github.com/dependabot)\[bot] in [#​750](https://redirect.github.com/apache/arrow-java/pull/750) - MINOR: Bump com.github.ben-manes.caffeine:caffeine from 3.1.8 to 3.2.0 by [@​dependabot](https://redirect.github.com/dependabot)\[bot] in [#​747](https://redirect.github.com/apache/arrow-java/pull/747) - MINOR: Bump version to 19.0.0-SNAPSHOT by [@​wgtmac](https://redirect.github.com/wgtmac) in [#​754](https://redirect.github.com/apache/arrow-java/pull/754) - [GH-768](https://redirect.github.com/apache/arrow-java/issues/768): Use apache/arrow-js for JS in integration test by [@​kou](https://redirect.github.com/kou) in [#​769](https://redirect.github.com/apache/arrow-java/pull/769) - [GH-770](https://redirect.github.com/apache/arrow-java/issues/770): Ensure updating Homebrew Python on macos-13 by [@​kou](https://redirect.github.com/kou) in [#​771](https://redirect.github.com/apache/arrow-java/pull/771) - [GH-70](https://redirect.github.com/apache/arrow-java/issues/70): Move from `hamcrest` to `assertj` in `flight-sql` by [@​rtadepalli](https://redirect.github.com/rtadepalli) in [#​772](https://redirect.github.com/apache/arrow-java/pull/772) - MINOR: Add missing permission to milestone assignment bot by [@​lidavidm](https://redirect.github.com/lidavidm) in [#​673](https://redirect.github.com/apache/arrow-java/pull/673) - MINOR: Bump com.gradle:common-custom-user-data-maven-extension from 2.0.1 to 2.0.3 by [@​dependabot](https://redirect.github.com/dependabot)\[bot] in [#​785](https://redirect.github.com/apache/arrow-java/pull/785) - MINOR: Bump io.grpc:grpc-bom from 1.71.0 to 1.73.0 by [@​dependabot](https://redirect.github.com/dependabot)\[bot] in [#​781](https://redirect.github.com/apache/arrow-java/pull/781) - MINOR: Fix format by [@​lidavidm](https://redirect.github.com/lidavidm) in [#​809](https://redirect.github.com/apache/arrow-java/pull/809) - [GH-804](https://redirect.github.com/apache/arrow-java/issues/804): Prepend JDBC FlightSQL version to user agent by [@​xborder](https://redirect.github.com/xborder) in [#​806](https://redirect.github.com/apache/arrow-java/pull/806) - MINOR: \[CI] Bump actions/cache from 4.2.3 to 4.2.4 by [@​dependabot](https://redirect.github.com/dependabot)\[bot] in [#​813](https://redirect.github.com/apache/arrow-java/pull/813) - MINOR: \[CI] Bump docker/login-action from 3.4.0 to 3.5.0 by [@​dependabot](https://redirect.github.com/dependabot)\[bot] in [#​814](https://redirect.github.com/apache/arrow-java/pull/814) - MINOR: \[CI] Bump actions/download-artifact from 4.3.0 to 5.0.0 by [@​dependabot](https://redirect.github.com/dependabot)\[bot] in [#​815](https://redirect.github.com/apache/arrow-java/pull/815) - [GH-816](https://redirect.github.com/apache/arrow-java/issues/816): Presize JsonStringArrayList vector results by [@​schlosna](https://redirect.github.com/schlosna) in [#​817](https://redirect.github.com/apache/arrow-java/pull/817) - [GH-797](https://redirect.github.com/apache/arrow-java/issues/797): \[JDBC] Fix PreparedStatement#execute for DML/DDL by [@​ennuite](https://redirect.github.com/ennuite) in [#​811](https://redirect.github.com/apache/arrow-java/pull/811) - [GH-841](https://redirect.github.com/apache/arrow-java/issues/841): Use apache/arrow-dotnet for integration test by [@​kou](https://redirect.github.com/kou) in [#​842](https://redirect.github.com/apache/arrow-java/pull/842) - MINOR: \[CI] Bump actions/setup-java from 4.6.0 to 5.0.0 by [@​dependabot](https://redirect.github.com/dependabot)\[bot] in [#​847](https://redirect.github.com/apache/arrow-java/pull/847) - MINOR: \[CI] Bump actions/setup-python from 5 to 6 by [@​dependabot](https://redirect.github.com/dependabot)\[bot] in [#​843](https://redirect.github.com/apache/arrow-java/pull/843) - MINOR: \[CI] Bump actions/github-script from 7.0.1 to 8.0.0 by [@​dependabot](https://redirect.github.com/dependabot)\[bot] in [#​844](https://redirect.github.com/apache/arrow-java/pull/844) - [GH-858](https://redirect.github.com/apache/arrow-java/issues/858): Fix error handling in CompositeJdbcConsumer by [@​aiguofer](https://redirect.github.com/aiguofer) in [#​857](https://redirect.github.com/apache/arrow-java/pull/857) - [GH-859](https://redirect.github.com/apache/arrow-java/issues/859): Fix ARROW\_STRUCT\_CONFLICT\_POLICY env var by [@​wForget](https://redirect.github.com/wForget) in [#​860](https://redirect.github.com/apache/arrow-java/pull/860) - [GH-836](https://redirect.github.com/apache/arrow-java/issues/836): Added support of ExtensionType for ComplexCopier by [@​xxlaykxx](https://redirect.github.com/xxlaykxx) in [#​837](https://redirect.github.com/apache/arrow-java/pull/837) - [GH-848](https://redirect.github.com/apache/arrow-java/issues/848): TypedValue should be treated as Nullable in bind function in AvaticaParameterBinder by [@​XenoAmess](https://redirect.github.com/XenoAmess) in [#​849](https://redirect.github.com/apache/arrow-java/pull/849) - fix: issue with class names in arrow-c jni calls by [@​milenkovicm](https://redirect.github.com/milenkovicm) in [#​867](https://redirect.github.com/apache/arrow-java/pull/867) - [GH-839](https://redirect.github.com/apache/arrow-java/issues/839): Fix support for ResultSet.getObject for TIMESTAMP\_WITH\_TIMEZONE by [@​aiguofer](https://redirect.github.com/aiguofer) in [#​840](https://redirect.github.com/apache/arrow-java/pull/840) - [GH-880](https://redirect.github.com/apache/arrow-java/issues/880): \[CI] Fix syntax error in `dev_pr.yml` by [@​kou](https://redirect.github.com/kou) in [#​881](https://redirect.github.com/apache/arrow-java/pull/881) - [GH-592](https://redirect.github.com/apache/arrow-java/issues/592): \[Release] Use relative path in .sha\* by [@​kou](https://redirect.github.com/kou) in [#​879](https://redirect.github.com/apache/arrow-java/pull/879) - MINOR: \[CI] Bump docker/login-action from 3.5.0 to 3.6.0 by [@​dependabot](https://redirect.github.com/dependabot)\[bot] in [#​870](https://redirect.github.com/apache/arrow-java/pull/870) - [GH-898](https://redirect.github.com/apache/arrow-java/issues/898): Upgrade to Apache POM 35 and identify fixes needed to have CI happy by [@​jbonofre](https://redirect.github.com/jbonofre) in [#​865](https://redirect.github.com/apache/arrow-java/pull/865) - MINOR: Bump io.netty:netty-bom from 4.1.119.Final to 4.1.127.Final by [@​SirOibaf](https://redirect.github.com/SirOibaf) in [#​855](https://redirect.github.com/apache/arrow-java/pull/855) - MINOR: Bump logback.version from 1.5.18 to 1.5.20 by [@​dependabot](https://redirect.github.com/dependabot)\[bot] in [#​897](https://redirect.github.com/apache/arrow-java/pull/897) - MINOR: Bump com.github.luben:zstd-jni from 1.5.7-2 to 1.5.7-6 by [@​dependabot](https://redirect.github.com/dependabot)\[bot] in [#​896](https://redirect.github.com/apache/arrow-java/pull/896) - MINOR: \[CI] Bump actions/download-artifact from 5.0.0 to 6.0.0 by [@​dependabot](https://redirect.github.com/dependabot)\[bot] in [#​895](https://redirect.github.com/apache/arrow-java/pull/895) - MINOR: Bump commons-codec:commons-codec from 1.18.0 to 1.19.0 by [@​dependabot](https://redirect.github.com/dependabot)\[bot] in [#​871](https://redirect.github.com/apache/arrow-java/pull/871) - MINOR: \[CI] Bump actions/checkout from 4 to 5 by [@​dependabot](https://redirect.github.com/dependabot)\[bot] in [#​820](https://redirect.github.com/apache/arrow-java/pull/820) - MINOR: \[CI] Bump actions/upload-artifact from 4.6.2 to 5.0.0 by [@​dependabot](https://redirect.github.com/dependabot)\[bot] in [#​894](https://redirect.github.com/apache/arrow-java/pull/894) - MINOR: Bump checker.framework.version from 3.49.3 to 3.49.5 by [@​dependabot](https://redirect.github.com/dependabot)\[bot] in [#​800](https://redirect.github.com/apache/arrow-java/pull/800) - MINOR: Bump error\_prone\_core.version from 2.37.0 to 2.42.0 by [@​dependabot](https://redirect.github.com/dependabot)\[bot] in [#​749](https://redirect.github.com/apache/arrow-java/pull/749) - MINOR: Bump org.apache.orc:orc-core from 2.1.1 to 2.2.1 by [@​dependabot](https://redirect.github.com/dependabot)\[bot] in [#​874](https://redirect.github.com/apache/arrow-java/pull/874) - MINOR: Bump com.google.protobuf:protobuf-bom from 4.30.2 to 4.33.0 by [@​dependabot](https://redirect.github.com/dependabot)\[bot] in [#​888](https://redirect.github.com/apache/arrow-java/pull/888) - MINOR: \[CI] Bump actions/checkout from 5 to 6 by [@​dependabot](https://redirect.github.com/dependabot)\[bot] in [#​911](https://redirect.github.com/apache/arrow-java/pull/911) - MINOR: Bump org.codehaus.mojo:versions-maven-plugin from 2.18.0 to 2.20.0 by [@​dependabot](https://redirect.github.com/dependabot)\[bot] in [#​912](https://redirect.github.com/apache/arrow-java/pull/912) - MINOR: Bump org.bouncycastle:bcpkix-jdk18on from 1.80 to 1.82 by [@​dependabot](https://redirect.github.com/dependabot)\[bot] in [#​919](https://redirect.github.com/apache/arrow-java/pull/919) - MINOR: Bump org.apache.drill.tools:drill-fmpp-maven-plugin from 1.21.2 to 1.22.0 by [@​dependabot](https://redirect.github.com/dependabot)\[bot] in [#​918](https://redirect.github.com/apache/arrow-java/pull/918) - MINOR: Bump dep.hadoop.version from 3.4.1 to 3.4.2 by [@​dependabot](https://redirect.github.com/dependabot)\[bot] in [#​915](https://redirect.github.com/apache/arrow-java/pull/915) - MINOR: \[CI] Bump actions/upload-artifact from 5.0.0 to 6.0.0 by [@​dependabot](https://redirect.github.com/dependabot)\[bot] in [#​934](https://redirect.github.com/apache/arrow-java/pull/934) - MINOR: \[CI] Bump actions/download-artifact from 6.0.0 to 7.0.0 by [@​dependabot](https://redirect.github.com/dependabot)\[bot] in [#​935](https://redirect.github.com/apache/arrow-java/pull/935) - MINOR: \[CI] Bump actions/cache from 4 to 5 by [@​dependabot](https://redirect.github.com/dependabot)\[bot] in [#​936](https://redirect.github.com/apache/arrow-java/pull/936) - MINOR: Update macos amd64 runner by [@​lidavidm](https://redirect.github.com/lidavidm) in [#​940](https://redirect.github.com/apache/arrow-java/pull/940) - MINOR: Bump checker.framework.version from 3.52.0 to 3.52.1 by [@​dependabot](https://redirect.github.com/dependabot)\[bot] in [#​927](https://redirect.github.com/apache/arrow-java/pull/927) - MINOR: Bump org.jacoco:jacoco-maven-plugin from 0.8.13 to 0.8.14 by [@​dependabot](https://redirect.github.com/dependabot)\[bot] in [#​924](https://redirect.github.com/apache/arrow-java/pull/924) - MINOR: Bump org.immutables:value from 2.10.1 to 2.11.7 by [@​dependabot](https://redirect.github.com/dependabot)\[bot] in [#​922](https://redirect.github.com/apache/arrow-java/pull/922) - MINOR: Bump com.google.api.grpc:proto-google-common-protos from 2.56.0 to 2.63.1 by [@​dependabot](https://redirect.github.com/dependabot)\[bot] in [#​920](https://redirect.github.com/apache/arrow-java/pull/920) - MINOR: Bump io.netty:netty-bom from 4.1.119.Final to 4.2.7.Final by [@​dependabot](https://redirect.github.com/dependabot)\[bot] in [#​887](https://redirect.github.com/apache/arrow-java/pull/887) - MINOR: Bump parquet.version from 1.15.2 to 1.16.0 by [@​dependabot](https://redirect.github.com/dependabot)\[bot] in [#​913](https://redirect.github.com/apache/arrow-java/pull/913) - MINOR: Bump org.immutables:value-annotations from 2.10.1 to 2.11.7 by [@​dependabot](https://redirect.github.com/dependabot)\[bot] in [#​917](https://redirect.github.com/apache/arrow-java/pull/917) - MINOR: Bump logback.version from 1.5.21 to 1.5.24 by [@​dependabot](https://redirect.github.com/dependabot)\[bot] in [#​962](https://redirect.github.com/apache/arrow-java/pull/962) - MINOR: Bump org.codehaus.mojo:exec-maven-plugin from 3.5.0 to 3.6.3 by [@​dependabot](https://redirect.github.com/dependabot)\[bot] in [#​959](https://redirect.github.com/apache/arrow-java/pull/959) - MINOR: Bump org.apache.commons:commons-text from 1.13.1 to 1.15.0 by [@​dependabot](https://redirect.github.com/dependabot)\[bot] in [#​956](https://redirect.github.com/apache/arrow-java/pull/956) - MINOR: Bump io.grpc:grpc-bom from 1.73.0 to 1.78.0 by [@​dependabot](https://redirect.github.com/dependabot)\[bot] in [#​958](https://redirect.github.com/apache/arrow-java/pull/958) - MINOR: Bump com.github.ben-manes.caffeine:caffeine from 3.2.0 to 3.2.3 by [@​dependabot](https://redirect.github.com/dependabot)\[bot] in [#​960](https://redirect.github.com/apache/arrow-java/pull/960) - MINOR: Bump org.apache.avro:avro from 1.12.0 to 1.12.1 by [@​dependabot](https://redirect.github.com/dependabot)\[bot] in [#​955](https://redirect.github.com/apache/arrow-java/pull/955) - MINOR: Bump org.bouncycastle:bcpkix-jdk18on from 1.82 to 1.83 by [@​dependabot](https://redirect.github.com/dependabot)\[bot] in [#​969](https://redirect.github.com/apache/arrow-java/pull/969) - MINOR: Bump logback.version from 1.5.24 to 1.5.25 by [@​dependabot](https://redirect.github.com/dependabot)\[bot] in [#​975](https://redirect.github.com/apache/arrow-java/pull/975) - MINOR: Bump com.fasterxml.jackson:jackson-bom from 2.18.3 to 2.21.0 by [@​dependabot](https://redirect.github.com/dependabot)\[bot] in [#​973](https://redirect.github.com/apache/arrow-java/pull/973) - MINOR: Bump parquet.version from 1.16.0 to 1.17.0 by [@​dependabot](https://redirect.github.com/dependabot)\[bot] in [#​968](https://redirect.github.com/apache/arrow-java/pull/968) - MINOR: Bump commons-io:commons-io from 2.19.0 to 2.21.0 by [@​dependabot](https://redirect.github.com/dependabot)\[bot] in [#​974](https://redirect.github.com/apache/arrow-java/pull/974) - MINOR: Bump com.gradle:develocity-maven-extension from 2.0 to 2.3.1 by [@​dependabot](https://redirect.github.com/dependabot)\[bot] in [#​976](https://redirect.github.com/apache/arrow-java/pull/976) - MINOR: Bump org.apache.orc:orc-core from 2.2.1 to 2.2.2 by [@​dependabot](https://redirect.github.com/dependabot)\[bot] in [#​971](https://redirect.github.com/apache/arrow-java/pull/971) - MINOR: Bump org.apache.commons:commons-dbcp2 from 2.13.0 to 2.14.0 by [@​dependabot](https://redirect.github.com/dependabot)\[bot] in [#​983](https://redirect.github.com/apache/arrow-java/pull/983) - MINOR: Bump org.apache.commons:commons-compress from 1.27.1 to 1.28.0 by [@​dependabot](https://redirect.github.com/dependabot)\[bot] in [#​985](https://redirect.github.com/apache/arrow-java/pull/985) - MINOR: Bump org.assertj:assertj-core from 3.27.3 to 3.27.7 by [@​dependabot](https://redirect.github.com/dependabot)\[bot] in [#​988](https://redirect.github.com/apache/arrow-java/pull/988) - MINOR: Bump org.apache.commons:commons-pool2 from 2.12.1 to 2.13.1 by [@​dependabot](https://redirect.github.com/dependabot)\[bot] in [#​987](https://redirect.github.com/apache/arrow-java/pull/987) - MINOR: Bump logback.version from 1.5.25 to 1.5.26 by [@​dependabot](https://redirect.github.com/dependabot)\[bot] in [#​981](https://redirect.github.com/apache/arrow-java/pull/981) - MINOR: Bump com.google.protobuf:protobuf-bom from 4.33.1 to 4.33.4 by [@​dependabot](https://redirect.github.com/dependabot)\[bot] in [#​984](https://redirect.github.com/apache/arrow-java/pull/984) - [GH-1011](https://redirect.github.com/apache/arrow-java/issues/1011): \[Docs] Fix broken Java API reference links in documentation by [@​axreldable](https://redirect.github.com/axreldable) in [#​1012](https://redirect.github.com/apache/arrow-java/pull/1012) - [GH-141](https://redirect.github.com/apache/arrow-java/issues/141): Correct capacity behavior in BufferAllocator.buffer docstrings by [@​axreldable](https://redirect.github.com/axreldable) in [#​1010](https://redirect.github.com/apache/arrow-java/pull/1010) - [GH-1014](https://redirect.github.com/apache/arrow-java/issues/1014): \[Docs] Fix broken and obsolete links in the README.md by [@​axreldable](https://redirect.github.com/axreldable) in [#​1015](https://redirect.github.com/apache/arrow-java/pull/1015) - MINOR: \[Docs] Remove extra line in README.md (fix pre-commit) by [@​axreldable](https://redirect.github.com/axreldable) in [#​1018](https://redirect.github.com/apache/arrow-java/pull/1018) - [GH-1021](https://redirect.github.com/apache/arrow-java/issues/1021): Use released apache/arrow instead of main by [@​kou](https://redirect.github.com/kou) in [#​1022](https://redirect.github.com/apache/arrow-java/pull/1022) - MINOR: Bump org.mockito:mockito-bom from 5.17.0 to 5.21.0 by [@​dependabot](https://redirect.github.com/dependabot)\[bot] in [#​1000](https://redirect.github.com/apache/arrow-java/pull/1000) - MINOR: Bump com.gradle:develocity-maven-extension from 2.3.1 to 2.3.3 by [@​dependabot](https://redirect.github.com/dependabot)\[bot] in [#​1001](https://redirect.github.com/apache/arrow-java/pull/1001) - MINOR: Bump logback.version from 1.5.26 to 1.5.27 by [@​dependabot](https://redirect.github.com/dependabot)\[bot] in [#​999](https://redirect.github.com/apache/arrow-java/pull/999) - MINOR: \[CI] Bump docker/login-action from 3.6.0 to 3.7.0 by [@​dependabot](https://redirect.github.com/dependabot)\[bot] in [#​996](https://redirect.github.com/apache/arrow-java/pull/996) - MINOR: Bump commons-codec:commons-codec from 1.20.0 to 1.21.0 by [@​dependabot](https://redirect.github.com/dependabot)\[bot] in [#​997](https://redirect.github.com/apache/arrow-java/pull/997) - MINOR: Fix minor issue with README by [@​paliwalashish](https://redirect.github.com/paliwalashish) in [#​1026](https://redirect.github.com/apache/arrow-java/pull/1026) - MINOR: Bump commons-cli:commons-cli from 1.9.0 to 1.11.0 by [@​dependabot](https://redirect.github.com/dependabot)\[bot] in [#​1028](https://redirect.github.com/apache/arrow-java/pull/1028) - MINOR: Bump org.codehaus.mojo:versions-maven-plugin from 2.20.0 to 2.21.0 by [@​dependabot](https://redirect.github.com/dependabot)\[bot] in [#​1029](https://redirect.github.com/apache/arrow-java/pull/1029) - MINOR: Bump com.google.api.grpc:proto-google-common-protos from 2.63.2 to 2.66.0 by [@​dependabot](https://redirect.github.com/dependabot)\[bot] in [#​1034](https://redirect.github.com/apache/arrow-java/pull/1034) - MINOR: \[CI] Bump actions/upload-artifact from 6.0.0 to 7.0.0 by [@​dependabot](https://redirect.github.com/dependabot)\[bot] in [#​1045](https://redirect.github.com/apache/arrow-java/pull/1045) - MINOR: Bump checker.framework.version from 3.53.0 to 3.53.1 by [@​dependabot](https://redirect.github.com/dependabot)\[bot] in [#​1046](https://redirect.github.com/apache/arrow-java/pull/1046) - MINOR: \[CI] Bump actions/download-artifact from 7.0.0 to 8.0.0 by [@​dependabot](https://redirect.github.com/dependabot)\[bot] in [#​1047](https://redirect.github.com/apache/arrow-java/pull/1047) - MINOR: Bump org.codehaus.mojo:build-helper-maven-plugin from 3.6.0 to 3.6.1 by [@​dependabot](https://redirect.github.com/dependabot)\[bot] in [#​1049](https://redirect.github.com/apache/arrow-java/pull/1049) - MINOR: Fix flaky TestBasicAuth memory leak by waiting for async buffer release by [@​jbonofre](https://redirect.github.com/jbonofre) in [#​1058](https://redirect.github.com/apache/arrow-java/pull/1058) - MINOR: Bump org.apache.orc:orc-core from 2.2.2 to 2.3.0 by [@​dependabot](https://redirect.github.com/dependabot)\[bot] in [#​1056](https://redirect.github.com/apache/arrow-java/pull/1056) - MINOR: \[CI] Increase JNI macOS job timeout from 45 to 60 minutes by [@​jbonofre](https://redirect.github.com/jbonofre) in [#​1060](https://redirect.github.com/apache/arrow-java/pull/1060) - MINOR: \[CI] Bump docker/login-action from 3.7.0 to 4.0.0 by [@​dependabot](https://redirect.github.com/dependabot)\[bot] in [#​1053](https://redirect.github.com/apache/arrow-java/pull/1053) - MINOR: Bump dep.hadoop.version from 3.4.2 to 3.4.3 by [@​dependabot](https://redirect.github.com/dependabot)\[bot] in [#​1055](https://redirect.github.com/apache/arrow-java/pull/1055) - MINOR: Bump io.grpc:grpc-bom from 1.78.0 to 1.79.0 by [@​dependabot](https://redirect.github.com/dependabot)\[bot] in [#​1048](https://redirect.github.com/apache/arrow-java/pull/1048) - MINOR: Bump com.gradle:common-custom-user-data-maven-extension from 2.0.3 to 2.1.0 by [@​dependabot](https://redirect.github.com/dependabot)\[bot] in [#​998](https://redirect.github.com/apache/arrow-java/pull/998) - MINOR: Bump version to 19.0.0 by [@​jbonofre](https://redirect.github.com/jbonofre) in [#​1066](https://redirect.github.com/apache/arrow-java/pull/1066) ##### New Contributors - [@​adampolomski](https://redirect.github.com/adampolomski) made their first contribution in [#​742](https://redirect.github.com/apache/arrow-java/pull/742) - [@​rtadepalli](https://redirect.github.com/rtadepalli) made their first contribution in [#​772](https://redirect.github.com/apache/arrow-java/pull/772) - [@​xborder](https://redirect.github.com/xborder) made their first contribution in [#​806](https://redirect.github.com/apache/arrow-java/pull/806) - [@​schlosna](https://redirect.github.com/schlosna) made their first contribution in [#​817](https://redirect.github.com/apache/arrow-java/pull/817) - [@​ennuite](https://redirect.github.com/ennuite) made their first contribution in [#​811](https://redirect.github.com/apache/arrow-java/pull/811) - [@​wForget](https://redirect.github.com/wForget) made their first contribution in [#​860](https://redirect.github.com/apache/arrow-java/pull/860) - [@​XenoAmess](https://redirect.github.com/XenoAmess) made their first contribution in [#​849](https://redirect.github.com/apache/arrow-java/pull/849) - [@​milenkovicm](https://redirect.github.com/milenkovicm) made their first contribution in [#​867](https://redirect.github.com/apache/arrow-java/pull/867) - [@​XN137](https://redirect.github.com/XN137) made their first contribution in [#​901](https://redirect.github.com/apache/arrow-java/pull/901) - [@​SirOibaf](https://redirect.github.com/SirOibaf) made their first contribution in [#​855](https://redirect.github.com/apache/arrow-java/pull/855) - [@​axreldable](https://redirect.github.com/axreldable) made their first contribution in [#​885](https://redirect.github.com/apache/arrow-java/pull/885) - [@​jhrotko](https://redirect.github.com/jhrotko) made their first contribution in [#​903](https://redirect.github.com/apache/arrow-java/pull/903) - [@​Kaustav-Sarkar](https://redirect.github.com/Kaustav-Sarkar) made their first contribution in [#​938](https://redirect.github.com/apache/arrow-java/pull/938) - [@​eickler](https://redirect.github.com/eickler) made their first contribution in [#​943](https://redirect.github.com/apache/arrow-java/pull/943) - [@​tmater](https://redirect.github.com/tmater) made their first contribution in [#​945](https://redirect.github.com/apache/arrow-java/pull/945) - [@​Yicong-Huang](https://redirect.github.com/Yicong-Huang) made their first contribution in [#​967](https://redirect.github.com/apache/arrow-java/pull/967) - [@​paliwalashish](https://redirect.github.com/paliwalashish) made their first contribution in [#​1026](https://redirect.github.com/apache/arrow-java/pull/1026) - [@​torito](https://redirect.github.com/torito) made their first contribution in [#​1008](https://redirect.github.com/apache/arrow-java/pull/1008) **Full Changelog**: <apache/arrow-java@v18.3.0...v19.0.0> </details> --- ### Configuration 📅 **Schedule**: (UTC) - Branch creation - Between 12:00 AM and 03:59 AM, only on Monday (`* 0-3 * * 1`) - Automerge - At any time (no schedule defined) 🚦 **Automerge**: Disabled by config. Please merge this manually once you are satisfied. ♻ **Rebasing**: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox. 🔕 **Ignore**: Close this PR and you won't be reminded about these updates again. --- - [ ] <!-- rebase-check -->If you want to rebase/retry this PR, check this box --- This PR was generated by [Mend Renovate](https://mend.io/renovate/). View the [repository job log](https://developer.mend.io/github/vortex-data/vortex). <!--renovate-debug:eyJjcmVhdGVkSW5WZXIiOiI0My4xMjMuOCIsInVwZGF0ZWRJblZlciI6IjQzLjEyMy44IiwidGFyZ2V0QnJhbmNoIjoiZGV2ZWxvcCIsImxhYmVscyI6WyJjaGFuZ2Vsb2cvY2hvcmUiXX0=--> Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
The codes of an FSSTArray are a vector of binary-strings of one byte codes or an escape code followed by a data. The offsets, unexpectedly, grow quite large, increasing the file size (for example, the TPC-H l_comment column with this PR is 78% the byte size of itself on
develop). Delta encoding notably decreases the size but also inflates the compression time, seemingly proportional to the space savings (TPC-H l_comment compresses in 111% of the time ondevelop).