Apache Spark - A unified analytics engine for large-scale data processing

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

A curated list of data engineering tools for software developers

A curated list of awesome Apache Spark packages and resources.

An opinionated list of awesome Python frameworks, libraries, software and resources.

A topic-centric list of HQ open datasets.

Guides and docs to help you get up and running with Apache Airflow.