Uniffle is a high performance, general purpose Remote Shuffle Service.

Apache Fluss is a streaming storage built for real-time analytics.

Minimalist vLLM implementation in Rust

Gluten is a middle layer responsible for offloading JVM-based SQL engines' execution to native engines.

LLM Attentions for Rust

Minimalist ML framework for Rust

Rust async runtime based on io-uring.

High performance distributed cache system. Built by Rust.

Blazing-fast query execution engine speaks Apache Spark language and has Arrow-DataFusion at its core.

Apache Arrow DataFusion Comet Spark Accelerator

Repo for donation of distributed DataFusion prototype - repo name will change

A blazingly fast multi-language serialization framework powered by JIT and zero-copy.

Apache Fory Website

HDFS Native Client in Rust via HDFS C API libhdfs

A versatile and extensible logging implementation.

Serving any JSON/CSN/Parquet/Arrow files like Postgres tables with Datafusion

Apache Kafka® compatible broker with S3 or PostgreSQL storage

Apache DataFusion SQL Query Engine

Redis for LLMs

Convert jemalloc heap profiles to pprof to understand memory usage, fix memory leaks, and fix OOM Kills.

Mirror of Apache Hadoop

Apache Spark

Apache Paimon is a lake format that enables building a Realtime Lakehouse Architecture with Flink and Spark for both streaming and batch operations.

macOS Integrated Injection Framework (GUI version)

A tiny yet powerful LLM inference system tailored for researching purpose. vLLM-equivalent performance with only 2k lines of code (2% of vLLM).

A native gRPC client & server implementation with async/await support.

Umami is a simple, fast, privacy-focused alternative to Google Analytics.