Stars
Apache Spark - A unified analytics engine for large-scale data processing
The goal of this library is to provide a compatibility layer that makes it easier to adopt Spark Connect. The library is designed to be simply imported in your application and will then monkey-patc…
Matter (formerly Project CHIP) creates more connections between more objects, simplifying development for manufacturers and increasing compatibility for consumers, guided by the Connectivity Standa…
Nuitka is a Python compiler written in Python. It's fully compatible with Python 2.6, 2.7, 3.4-3.13. You feed it your Python app, it does a lot of clever things, and spits out an executable or exte…
Databricks’ Dolly, a large language model trained on the Databricks Machine Learning Platform
Py4J enables Python programs to dynamically access arbitrary Java objects
📖 HonKit is building beautiful books using Markdown - Fork of GitBook
An open protocol for secure data sharing
A directive for including a Plotly figure in a Sphinx document.
A library on top of either pex or conda-pack to make your Python code easily available on a cluster
✅ The missing status check utility for workflow_run action.
Spark RAPIDS plugin - accelerate Apache Spark with GPUs
A clean, three-column Sphinx theme with Bootstrap for the PyData community
All the things about TPC-DS in Apache Spark
Apache (Py)Spark type annotations (stub files).
An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs
Flexible and powerful data analysis / manipulation library for Python, providing labeled data structures similar to R data.frame objects, statistical functions, and much more
NumPy aware dynamic Python compiler using LLVM
A lightweight library to inject LLVM bitcode into JVMs
JVM Profiler Sending Metrics to Kafka, Console Output or Custom Reporter
Apache Livy is an open source REST interface for interacting with Apache Spark from anywhere.
Spark Gotchas. A subjective compilation of the Apache Spark tips and tricks
Production-Grade Container Scheduling and Management