paid course

Python Data Science Toolbox (Part 2)

4 hours
12 Videos
46 Exercises
5,958 Participants
3700 XP

This course is part of these tracks:

Hugo Bowne-Anderson

Data Scientist at DataCamp

Hugo hearts all things Pythonic and is charged with building out DataCamp’s Python curriculum. He can be found at hackathons, meetups & code sprints, primarily in NYC. Before joining the ranks of DataCamp, he worked in applied mathematics (biology) research at Yale University.

Collaborator(s)

Francisco Castro
Yashas Roy

Course Description

In this second course in the Python Data Science Toolbox, you'll continue to build your Python Data Science skills. First you'll enter the wonderful world of iterators, objects that you have already encountered in the context of for loops without having necessarily known it. You'll then learn about list comprehensions, which are extremely handy tools that form a basic component in the toolbox of all modern Data Scientists working in Python. You'll end the course by working through a case study in which you'll apply all of the techniques you learned both in this course as well as the prequel. If you're looking to make it as a Pythonista Data Science ninja, you have come to the right place.

Prerequisites:

1
Using iterators in PythonLand
Free

Here, you'll learn all about iterators and iterables, which you have already worked with before when writing for loops! You'll learn about some very useful functions that will allow you to effectively work with iterators and finish the chapter with a use case that is pertinent to the world of Data Science - dealing with large amounts of data - in this case, data from Twitter that you will load in chunks using iterators!
View Chapter Details Play Chapter Now
List comprehensions and generators

In this chapter, you'll build on your knowledge of iterators and be introduced to list comprehensions, which allow you to create complicated lists and lists of lists in one line of code! List comprehensions can dramatically simplify your code and make it more efficient, and will become a vital part of your Python Data Science toolbox. You'll then learn about generators, which are extremely helpful when working with large sequences of data that you may not want to store in memory but instead generate on the fly.
View Chapter Details Play Chapter Now
Bringing it all together!

This chapter will allow you to apply your newly acquired skills towards wrangling and extracting meaningful information from a real-world dataset - the World Bank's World Development Indicators dataset! You'll have the chance to write your own functions and list comprehensions as you work with iterators and generators and solidify your Python Data Science chops. Enjoy!
View Chapter Details Play Chapter Now

Python Data Science Toolbox (Part 2)

Hugo Bowne-Anderson

Collaborator(s)

Course Description

Prerequisites:

Using iterators in PythonLand

Introduction to iterators

Iterators vs Iterables

Iterating over iterables (1)

Iterating over iterables (2)

Iterators as function arguments

Playing with iterators

Using enumerate

Using zip

Using * and zip to 'unzip'

Using iterators to load large files into memory

Processing large amounts of Twitter data

Extracting information for large amounts of Twitter data

Congratulations!!

List comprehensions and generators

List comprehensions

Write a basic list comprehension

List comprehension over iterables

Writing list comprehensions

Nested list comprehensions

Advanced comprehensions

Using conditionals in comprehensions (1)

Using conditionals in comprehensions (2)

Dict comprehensions

Introduction to generator expressions

List comprehensions vs generators

Write your own generator expressions

Changing the output in generator expressions

Build a generator

Wrapping up comprehensions and generators.

List comprehensions for time-stamped data

Conditional list comprehesions for time-stamped data

Bringing it all together!

Welcome to the case study!

Dictionaries for data science

Writing a function to help you

Using a list comprehension

Turning this all into a DataFrame

Using Python generators for streaming data

Processing data in chunks (1)

Writing a generator to load data in chunks (2)

Writing a generator to load data in chunks (3)

Using pandas` read_csv iterator for streaming data

Writing an iterator to load data in chunks (1)

Writing an iterator to load data in chunks (2)

Writing an iterator to load data in chunks (3)

Writing an iterator to load data in chunks (4)

Writing an iterator to load data in chunks (5)

Final thoughts