Introduction to Airflow in Python
Learn how to to implement and schedule data engineering workflows.
- 4 hours
- 16 Videos
- 55 Exercises
- 2,993 Participants
- 4,050 XP
Create Your Free Account
By pressing Continue you accept the Terms of Use and Privacy Policy. You also accept that you are aware that your data will be stored outside of the EU and that you are above the age of 16.
Loved by learners at thousands of top companies:
Course Description
Are you responsible for delivering data on a schedule? You may have written scripts, added complex cron tasks, and tried various ways to meet an ever-changing set of requirements. It's even trickier to work with your teammates on managing multiple sets of requirements. Airflow can do this while adding scheduling, error handling, and reporting. Introduction to Airflow in Python will guide you in the basic concepts of Airflow and help you implement data engineering workflows in production. You'll implement many different data engineering tasks in a sane, repeatable fashion, while losing as little sanity as possible.
-
1
Intro to Airflow
FreeAn introduction to the components of Apache Airflow and why to use them.
-
Maintaining and monitoring Airflow workflows
Learn more about Airflow components such as sensors and executors while monitoring and troubleshooting Airflow workflows.
-
Implementing Airflow DAGs
Learn the basics of implementing Airflow DAGs using operators, tasks, and scheduling.
-
Building production pipelines in Airflow
Use what you've learned to build a production quality workflow in Airflow.
-
1
Intro to Airflow
FreeAn introduction to the components of Apache Airflow and why to use them.
-
Implementing Airflow DAGs
Learn the basics of implementing Airflow DAGs using operators, tasks, and scheduling.
-
Maintaining and monitoring Airflow workflows
Learn more about Airflow components such as sensors and executors while monitoring and troubleshooting Airflow workflows.
-
Building production pipelines in Airflow
Use what you've learned to build a production quality workflow in Airflow.
What do other learners have to say?
“I've used other sites, but DataCamp's been the one that I've stuck with.”
Devon Edwards Joseph
Lloyd's Banking Group
“DataCamp is the top resource I recommend for learning data science.”
Louis Maiden
Harvard Business School
“DataCamp is by far my favorite website to learn from.”
Ronald Bowers
Decision Science Analytics @ USAA
Mike Metzger
Data Engineer Consultant @ Flexible Creations
Mike is a consultant focusing on data engineering and analysis using SQL, Python, and Apache Spark among other technologies. He has a 20+ year history of working with various technologies in the data, networking, and security space.
See MoreCollaborators
-
Hadrien Lacroix
-
Lis Sulmont