Data Forge — a modern data stack playground to practice flows and best practices, not just tools. Spark, Trino, Kafka, Iceberg, ClickHouse, Airflow, MinIO, Superset — all wired together locally with Docker Compose.
End-to-end Snowflake Data Engineering project demonstrating real-time ingestion, CDC with Streams, automated Tasks, data quality pipelines, and Gold layer analytics for enterprise-scale retail analytics.
A comprehensive data platform using modern architecture with orchestration, ingestion, transformation, and visualization.
🚀 Pipeline de datos completo usando Databricks y Azure Storage para analizar eventos de GitHub. Implementa Medallion Architecture (Bronze-Silver-Gold) desde cero con Python, PySpark y Azure Blob Storage. Proyecto educativo de Data Engineering de 0 a 100.
Modular PostgreSQL star schema for IIoT telemetry using the Bronze–Silver–Gold layers: RAW → normalized signals → metrics/KPIs + alerts.
Building a modern data warehouse with SQL Server, including ETL processes, data modeling, and analytics.
Windows-first PySpark batch pipeline: ingest raw → bronze Parquet, run DQ checks, publish curated silver. PowerShell wrapper adds Spark hygiene, parallelism controls, and step logs.
End-to-end SQL data warehousing project using Bronze-Silver-Gold architecture with ETL pipelines, dimensional modeling, and real-world CRM & ERP datasets in Microsoft SQL Server.
[data engineer assessment] End-to-end data pipeline for the ACS dataset featuring Python, PySpark, PostgreSQL, and Kubernetes (Bronze / Silver / Gold architecture).
Add a description, image, and links to the bronze-silver-gold topic page so that developers can more easily learn about it.
To associate your repository with the bronze-silver-gold topic, visit your repo's landing page and select "manage topics."