Hello

Welcome to your VuePress site

Key Features

Performance

Supports most native operators/expressions and fine-grained failback.
Powered by Rust, 2x faster on TPC-DS benchmark.
Performs significantly better in production environments.

Production ready

Verified on production environments with exabytes of data.
Supports complex production scenarios like JSON parsing, UDF/UDTF, etc.
Resolved various stability and data consistency issues.

Easy to Use

Simple to build and install to Spark.
Easy to configuration.
Full-featured execution metrics.

Compatibility

Adapted to Spark mainline versions.
Supports different storage systems like HDFS, S3, etc.

Ecosystem

Supports data lake system like Hudi, Paimon.
Supports Remote Shuffle Service like Apache Celeborn.

Community

Some cooperators have applied Auron on production.
More are researching and evaluating Auron.

Benchmarks

Auron has passed all TPC-DS/TPC-H benchmark cases. Comparing to Spark-3.5, Auron is running ~2x faster and save ~50% cluster resources. See Benchmark Details.

Apache Auron is an effort undergoing incubation at The Apache Software Foundation (ASF), sponsored by the Apache Incubator. Incubation is required of all newly accepted projects until a further review indicates that the infrastructure, communications, and decision making process have stabilized in a manner consistent with other successful ASF projects. While incubation status is not necessarily a reflection of the completeness or stability of the code, it does indicate that the project has yet to be fully endorsed by the ASF.

Apache, the names of Apache projects, and the feather logo are either registered trademarks or trademarks of the Apache Software Foundation in the United States and/or other countries. All other marks mentioned may be trademarks or registered trademarks of their respective owners.