Airflow for end-to-end analytical pipeline for credit card transactions. Detects changes in a Snowflake Stream and triggers a dbt cloud job.

Pipeline de ELT com airflow, dbt e postgresql

To build ETL Weather Pipeline using AirFlow and Astro.

Chess Data Harmony is an ETL data engineering project using different tools like Python with pandas, AWS S3, Snowflake, all orchestrated by Airflow (Astronomer)

This project demonstrates how to use Terraform to provision data infrastructure on GCP to facilitate ETL pipeline.

The astroIncubator repository is designed as a workspace for developing Airflow DAGs, with a focus on integrating the Compass framework for orchestrating dbt modules.

Airflow DAGs project with DBT hosted by Astronomer.

playing around MLOps tools

WeatherFlow ETL is an automated pipeline that extracts weather data from public APIs, transforms it by cleaning and standardizing the information, and loads it into a PostgreSQL database for analysis.

Preparation for the Astronomer Airflow 3 Fundamentals Certification. Focused on core concepts like DAGs, scheduling, operators, Airflow architecture, debugging, and monitoring to master workflow orchestration and data pipeline management using Apache Airflow 3.+.

This repository contains an Apache Airflow pipeline for Credit Card Fraud Detection. The pipeline automates the end-to-end machine learning workflow, from data ingestion to model training, evaluation, and deployment to the cloud.

This project implements an ETL (Extract, Transform, Load) pipeline using Apache Airflow to fetch data from NASA's Astronomy Picture of the Day (APOD) API, transform it, and load it into a PostgreSQL database. The pipeline is orchestrated using Airflow, running in a Dockerized environment set up with Astronomer.

Orchestrated pipeline and tasks using DAG in airflow

Hello, Astronomer! - The Enterprise Framework for Apache Airflow

astro plugin for asdf version manager

Exploring how to surface dlt pipeline metadata via Airflow's OpenLineage integration.

Setting up the dev environment with the Docker compose , Astro and Airflow

This DBT (Data Build Tool) project leverages GCP (Google Cloud Platform) services, specifically Google BigQuery, and Metabase for data transformation, visualization, and Sales Dashboard creation, while also utilizing Soda (Streaming Data Build Tool) for real-time data processing

A project that extracts data from Open Meteo API and stores it in a PostgreSQL database for further analysis.

🏥 Analyze hospital readmissions with a data pipeline for insights on risk factors, improving patient outcomes using modern tools and predictive models.