Apache Airflow is an essential tool for managing complex software workflows, ensuring data quality, and facilitating scalable data operations. Whether you're just starting out or aiming to refine your existing skills, this session will enhance your ability to orchestrate robust data pipelines efficiently.
Join Mike, an experienced data engineering consultant, as he guides you through the fundamentals of data pipelines with Airflow and Python. In this interactive session, you will learn how to design, execute, and monitor data pipelines that can handle both batch and real-time data processing. Mike will demonstrate practical examples, share best practices, and provide insights on optimizing your data workflows
Presenter Bio
Mike MetzgerData Engineer Consultant at Flexible Creations
Mike is a consultant focusing on data engineering and analysis using SQL, Python, and Apache Spark among other technologies. He has a 20+ year history of working with various technologies in the data, networking, and security space. Mike is the instructor of the DataCamp course, "Introduction to Airflow in Python".
