The ExternalPythonOperator: No more dependency conflicts in Apache Airflow
🏆 BECOME A PRO WITH AIRFLOW: https://www.udemy.com/course/the-complete-hands-on-course-to-master-apache-airflow/?couponCode=4677CF7EF58D6AAD9A0C
Airflow has many options to avoid dependency conflicts.
If you have a Kubernetes cluster, you can use the KubernetesPodOperator to run a task in a Kubernetes Pod.
If you have Docker, then the DockerOperator helps to run a task in a Docker Container.
An easier, though, is the ExternalPythonOperator which requires a pre-created Python virtual environment.
Download
0 formats
No download links available.
The ExternalPythonOperator: No more dependency conflicts in Apache Airflow | NatokHD