An end-to-end real-time data engineering pipeline simulating a music streaming platform, built with Kafka, Spark Streaming, MinIO, ClickHouse, dbt, and Airflow
docker apache-spark data-engineering apache-kafka dbt real-time-processing music-events elt-pipeline eventsim
-
Updated
Jul 5, 2026 - Python