Solana ETL allows you to setup an ETL pipeline in Google Cloud Platform for ingesting Solana blockchain data into BigQuery. It comes with CLI tools for exporting Solana data into convenient formats like CSVs and relational databases.

1. Airflow DAGs export and load Solana data to BigQuery daily. Refer to Solana ETL Airflow for deployment instructions.

1. Follow the instructions in Solana ETL Airflow to deploy a Cloud Composer cluster for exporting and loading historical Solana data. It may take several days for the export DAG to catch up

Over time, we intend to format python files in this repo using isort and autopep8. At the moment, we are only formatting any changed or added files

We have not implemented any sort of automation (e.g. pre-commit), but a requirements_dev.txt is provided for contributors to use.

Various tests are implemented (airflow/tests, cli/tests and ./tests). As part of an effort towards consistency, they all source the same requirements_test.txt.