Skip to main content

Introduction to Airflow in Python

4.2+
17 reviews
Beginner

Learn how to implement and schedule data engineering workflows.

Start Course for Free
4 Hours16 Videos55 Exercises25,824 Learners4050 XP

Create Your Free Account

GoogleLinkedInFacebook

or

By continuing, you accept our Terms of Use, our Privacy Policy and that your data is stored in the USA.

Loved by learners at thousands of companies


Course Description

Delivering data on a schedule can be a manual process. You write scripts, add complex cron tasks, and try various ways to meet an ever-changing set of requirements—and it’s even trickier to manage everything when working with teammates. Airflow can remove this headache by adding scheduling, error handling, and reporting to your workflows. In this course, you’ll master the basics of Airflow and learn how to implement complex data engineering pipelines in production. You'll also learn how to use Directed Acyclic Graphs (DAGs), automate data engineering workflows, and implement data engineering tasks in an easy and repeatable fashion—helping you to maintain your sanity.
  1. 1

    Intro to Airflow

    Free

    In this chapter, you’ll gain a complete introduction to the components of Apache Airflow and learn how and why you should use them.

    Play Chapter Now
    Introduction to Airflow
    50 xp
    Running a task in Airflow
    50 xp
    Examining Airflow commands
    50 xp
    Airflow DAGs
    50 xp
    Defining a simple DAG
    100 xp
    Working with DAGs and the Airflow shell
    50 xp
    Troubleshooting DAG creation
    100 xp
    Airflow web interface
    50 xp
    Starting the Airflow webserver
    50 xp
    Navigating the Airflow UI
    50 xp
    Examining DAGs with the Airflow UI
    50 xp

Collaborators

Hadrien Lacroix
Lis Sulmont

Prerequisites

Intermediate PythonIntroduction to Shell
Mike Metzger Headshot

Mike Metzger

Data Engineer Consultant @ Flexible Creations

Mike is a consultant focusing on data engineering and analysis using SQL, Python, and Apache Spark among other technologies. He has a 20+ year history of working with various technologies in the data, networking, and security space.
See More

Don’t just take our word for it

*4.2
from 17 reviews
53%
24%
24%
0%
0%
Sort by
  • Weiqiang C.
    2 days

    Gd intro to Airflow

  • Edward F.
    about 1 month

    Very good and very clear course. The only caveat is that it uses Airflow 1.0 instead of 2.0, so a few of the commands listed in the course are no longer used in the current version, but I think the general concepts are well taught.

  • Christopher L.
    4 months

    Great course that covers a lot of the basics. Good balance of breadth and depth. Would be a good course for beginners or leaders looking to better understand the hands on aspect.

  • Martin G.
    5 months

    it's a good introductory course

  • Mauricio G.
    5 months

    In general, the course was great, but I would have liked to see sections about XCOM.

  • Loading ...

"Gd intro to Airflow"

Weiqiang C.

"Very good and very clear course. The only caveat is that it uses Airflow 1.0 instead of 2.0, so a few of the commands listed in the course are no longer used in the current version, but I think the general concepts are well taught."

Edward F.

"Great course that covers a lot of the basics. Good balance of breadth and depth. Would be a good course for beginners or leaders looking to better understand the hands on aspect."

Christopher L.

Join over 11 million learners and start Introduction to Airflow in Python today!

Create Your Free Account

GoogleLinkedInFacebook

or

By continuing, you accept our Terms of Use, our Privacy Policy and that your data is stored in the USA.