Getting Started with Airflow for Beginners.
At the end of this video, you will be able to:
✅ Identify the different ways of installing and running Airflow in local
✅ Create a local dev environment with Airflow following best practices
✅ Create data pipelines using Variables, XComs, and the Taskflow API
✅ Share data between tasks
✅ Trigger and monitor data pipelines
and more.
🏆 BECOME A PRO WITH AIRFLOW: https://www.udemy.com/course/the-complete-hands-on-course-to-master-apache-airflow/?couponCode=4677CF7EF58D6AAD9A0C
If you're entirely new to Apache Airflow, take a look at those videos first:
1️⃣ Why Airflow? The Top 5 reasons to use it: https://www.youtube.com/watch?v=vEApEfa8HXk&t=277s&pp=ygULd2h5IGFpcmZsb3c%3D
2️⃣ What is Apache Airflow?: https://youtu.be/CGxxVj13sOs?si=msF7u6wpqnZP2tQW
00:00 Introduction
00:28 Install and setup Airflow in local
00:38 Pip install
00:57 The docker-compose file
01:51 The Astro CLI
03:46 Airflowctl
04:17 Reminder of the basics
04:30 The DAG you will create
05:00 Create the DAG
07:08 Create the first task
08:55 Create the second task
09:24 Airflow variables
10:55 Create the last task
11:15 Define task dependencies
12:35 The final DAG
13:05 Run it!
13:33 Use the UI to monitor and manage your DAGs
With that, you have all the keys to getting started with Airflow!
