00:00 Intro
01:00 Preparing our local environment
04:00 Modifying the docker compose file
07:20 Creating a custom image
10:50 Running airflow-init
12:10 Starting Airflow
13:10 Creating a GCS Bucket
14:15 Creating a Service Account on GCP
16:30 Adding our DAG
17:25 Creating our connection in Airflow
20:50 Reviewing the DAG
24:45 Running our DAG
27:35 Outro
Github Repo:
https://github.com/MichaelShoemaker/airflow3.0-docker-compose
Also the reason my second python file wasn't showing up in the DAGS is because I didn't give it the code of a DAG. Insert Facepalm
Download
0 formats
No download links available.
Creating a Minimal Airflow 3.0 Docker Compose Setup | NatokHD