ETL in Python
Leverage your Python and SQL knowledge to create a pipeline ingesting, transforming and loading data into a database.
Start Course for Free4 Hours16 Videos48 Exercises6,893 Learners3850 XP
Create Your Free Account
or
By continuing, you accept our Terms of Use, our Privacy Policy and that your data is stored in the USA.Loved by learners at thousands of companies
Course Description
Want to grow your data engineering skills and more efficiently process big data? Well, it’s time to develop your ETL skills. In this course, you’ll learn the foundations of creating pipelines to efficiently extract, transform, and load data into the systems your company commonly uses. You’ll get hands-on experience by helping a fictional private equity firm process the sales data they need to make informed business decisions when buying real estate. Jump in, learn how to create ETL pipelines, and develop one of the most in-demand engineering skills needed in the market.
- 1
Explore the data and requirements
FreeIn this first chapter, you’ll be introduced to your role as a data engineer in a private equity fund. You'll be exposed to the whole ETL pipeline before deep-diving into its first phase: the extraction process.
- 2
Create the ETL foundations
In this chapter you're going to create some important foundations for our ETL pipeline. In particular, along with data transformation, you'll start setting up the components needed to communicate with the database.
Let's talk with the database50 xpSQLAlchemy core components50 xpEngines and sessions100 xpDatabase tables50 xpTable class definition100 xpColumns definition100 xpData cleaning50 xpLower string and date format100 xpPrice and description100 xpPut transform operations together50 xpSetup base script100 xpCreate tables100 xpTransform 'em all!100 xp - 3
From raw to clean data
This chapter is all about moving transformed data to a clean table, from which insights can be built. You'll explore how to create a unique key to perform insert and delete statements on SQLAlchemy. At the end of this chapter you'll complete the load process, the last step of the ETL pipeline.
- 4
From clean data to meaningful insights
This chapter will show you how the data the ETL pipeline processes every month is used to build insights, readable by the fund’s shareholders. You'll explore key SQL components to build more complex queries and create these insights. You'll also explore libraries that will translate raw SQL queries into more readable Excel files.
Operators50 xpSales for Dublin and Cork100 xpFirst month 2021 sales100 xpSqlalchemy func50 xpAggregate functions50 xpAverage, max and min functions100 xpCreate the insights50 xpCreating the insights view100 xpHow many counties?50 xpWorking with Excel files50 xpCreate a simple Excel file100 xpAdd a table into Excel file100 xpExport monthly insights100 xpWrap-up50 xp
Datasets
Property price register 2021Collaborators
Stefano Francavilla
Stefano is the CEO and co-founder of Geowox.
Stefano is the CEO and co-founder of Geowox, a company using AI and big data to value residential properties. In a previous life, he studied Computer Science at the polytechnic university of Milan while founding a software development company. He then worked as a product engineer at Intercom, advised portfolio startups at Growing Capital, a seed investment firm.
What do other learners have to say?
Join over 10 million learners and start ETL in Python today!
Create Your Free Account
or
By continuing, you accept our Terms of Use, our Privacy Policy and that your data is stored in the USA.