I am a Data Engineer focused on building and operating production-grade ETL/ELT pipelines using Python, SQL, and Airflow. My background includes enterprise-scale data systems and hands-on platform-level data engineering projects.
- π Current Focus: Designing data ingestion, transformation, and orchestration workflows with a strong emphasis on reliability, observability, and automation.
- π οΈ Core Stack: Python (Pandas, FastAPI), SQL (PostgreSQL, MySQL), Apache Airflow, and Docker.
- π Observability: Monitoring data pipelines using Grafana and Zabbix.
- π Education: Currently pursuing an M.Sc. in Entrepreneurship & Innovation Management at KTU.
Core Technical Skills:
Infrastructure & DevOps:
Designed and implemented a data platform simulating real-world event ingestion.
- Built a high-throughput ingestion API using FastAPI to collect raw event data into PostgreSQL.
- Developed Airflow-based ETL workflows to transform raw events into analytics-ready tables.
- Containerized all services using Docker Compose and implemented Grafana dashboards for pipeline health monitoring.
Real-time ETL workflow for exchange rate data.
- Extracted hourly exchange rate data from REST APIs using Python.
- Orchestrated extraction, transformation, and loading (ETL) processes with Airflow DAGs, including retry logic and alerting.
- Ensured high availability with robust error handling and automated retries.
πΉ Anime Data ETL
- Processing an anime dataset with an ETL pipeline to PostgreSQL.
- π M.Sc. Entrepreneurship & Innovation Management - Karadeniz Technical University (Current)
- π B.Sc. Management Information Systems - Karadeniz Technical University
- π IBM Data Engineering Professional (v2) - IBM
- π PostgreSQL for Everybody Specialization - University of Michigan
π§ Email: [email protected] π LinkedIn: Emre HacΔ±mustafaoΔlu