Skip to main content

Course

Streamlined Data Ingestion with pandas

Intermediate

4.7+

Updated 03/2025

Learn to acquire data from common file formats and systems such as CSV files, spreadsheets, JSON, SQL databases, and APIs.

Start Course for Free

Included withPremium or Teams

PythonData Preparation4 hours16 videos53 Exercises4,500 XP54,702Statement of Accomplishment

Create Your Free Account

or

By continuing, you accept our Terms of Use, our Privacy Policy and that your data is stored in the USA.

Training 2 or more people?

Try DataCamp for Business

Loved by learners at thousands of companies

Course Description

Before you can analyze data, you first have to acquire it. This course teaches you how to build pipelines to import data kept in common storage formats. You’ll use pandas, a major Python library for analytics, to get data from a variety of sources, from spreadsheets of survey responses, to a database of public service requests, to an API for a popular review site. Along the way, you’ll learn how to fine-tune imports to get only what you need and to address issues like incorrect data types. Finally, you’ll assemble a custom dataset from a mix of sources.

Prerequisites

Intermediate Python Intermediate SQL

1

Importing Data from Flat Files

Introduction to flat files

Get data from CSVs

Get data from other flat files

Modifying flat file imports

Import a subset of columns

Import a file in chunks

Handling errors and missing data

Specify data types

Set custom NA values

Skip bad data

2

Importing Data From Excel Files

Introduction to spreadsheets

Get data from a spreadsheet

Load a portion of a spreadsheet

Getting data from multiple worksheets

Select a single sheet

Select multiple sheets

Work with multiple spreadsheets

Modifying imports: true/false data

Set Boolean columns

Set custom true/false values

Modifying imports: parsing dates

Parse simple dates

Get datetimes from multiple columns

Parse non-standard date formats

3

Importing Data from Databases

Introduction to databases

Connect to a database

Load entire tables

Refining imports with SQL queries

Selecting columns with SQL

Selecting rows

Filtering on multiple conditions

More complex SQL queries

Getting distinct values

Counting in groups

Working with aggregate functions

Loading multiple tables with joins

Joining tables

Joining and filtering

Joining, filtering, and aggregating

4

Importing JSON Data and Working with APIs

Introduction to JSON

Load JSON data

Work with JSON orientations

Introduction to APIs

Get data from an API

Set API parameters

Set request headers

Working with nested JSONs

Flatten nested JSONs

Handle deeply nested data

Combining multiple datasets

Concatenate dataframes

Merge dataframes

Streamlined Data Ingestion with pandas

Course
Complete

Earn Statement of Accomplishment

Add this credential to your LinkedIn profile, resume, or CV
Share it on social media and in your performance review

Included withPremium or Teams

Don’t just take our word for it

*4.7

from 231 reviews

79%

19%

2%

0%

0%

Highest to Lowest
Lowest to Highest
Most recent
Top reviews

julien

about 13 hours

Sergio

about 24 hours

John

1 day

I really liked the review of data ingestion. Good touch to make sure one builds foundational skills.

supon

1 day

SUPON GRANROD

Tony Onkgopotse

about 17 hours

A bit difficult to grasp, the wording used in the exercises is almost like they were designed to trick you and test your comprehension of English rather than the main focus of the course.

Ahmed

about 19 hours

julien

Sergio

"I really liked the review of data ingestion. Good touch to make sure one builds foundational skills."

John

Join over 16 million learners and start Streamlined Data Ingestion with pandas today!

Create Your Free Account

or

By continuing, you accept our Terms of Use, our Privacy Policy and that your data is stored in the USA.