Thanks to visit codestin.com
Credit goes to Github.com

Skip to content

Easily deploy airflow infrastructure on an AWS VPC using terraform.

Notifications You must be signed in to change notification settings

petedannemann/airflow-terraform

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

10 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Airflow Terraform

Goal

Easily provision resources on AWS for a highly scalable and secure airflow environment.

Overview

  • Terraform is used to provision resources in a VPC.
  • Airflow's services are deployed on an EC2 instance.
  • The Airflow metadata database is deployed on RDS (Postgres).
  • The Airflow message broker is deployed on Elastic Cache (Redis).
  • AWS Secrets Manager is used to securely feed environment variables such as airflow's fernet key into the EC2 instance.

Requirements

  • AWS Account
  • Terraform

Setup

Terraform Commands

First enter the Terraform directory cd terraform

  • See a plan of resources terraform plan
  • Provision resources terraform apply
  • Destroy resources terraform destroy

About

Easily deploy airflow infrastructure on an AWS VPC using terraform.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published