Skip to main content
HomePython

project

Word Frequency in Classic Novels

Beginner
Updated 12/2023
Use web scraping and NLP to find the most frequent words in one of two pieces of classic literature: Herman Melville's novel, Moby Dick, or Peter Pan by J. M. Barrie.
Start Project for Free

Included withPremium or Teams

Python45 minutes9 Tasks1,500 XP7,693

Create Your Free Account

or

By continuing, you accept our Terms of Use, our Privacy Policy and that your data is stored in the USA.
Group

Training 2 or more people?

Try DataCamp for Business

Loved by learners at thousands of companies

Project Description

Word Frequency in Classic Novels

In this Project, you'll scrape a novel from the website Project Gutenberg (which contains a large corpus of books) using the Python package `requests`. Then you'll extract words from this web data using `BeautifulSoup`. Finally, we'll dive into analyzing the distribution of words using the Natural Language ToolKit (`nltk`). The natural language processing tools used here apply to much of the data that data scientists encounter as a vast proportion of the world's data is unstructured data and includes a great deal of text. To complete this Project, you need to know how to import web data into Python and how to work with natural language text.

Word Frequency in Classic Novels

Use web scraping and NLP to find the most frequent words in one of two pieces of classic literature: Herman Melville's novel, Moby Dick, or Peter Pan by J. M. Barrie.
Start Project for Free
  • 1

    Tools for text processing

  • 2

    Request Moby Dick

  • 3

    Get the text from the HTML

  • 4

    Extract the words

  • 5

    Make the words lowercase

  • 6

    Load in stop words

  • 7

    Remove stop words in Moby Dick

  • 8

    We have the answer

  • 9

    The most common word

FAQs

Join over 16 million learners and start Word Frequency in Classic Novels today!

Create Your Free Account

or

By continuing, you accept our Terms of Use, our Privacy Policy and that your data is stored in the USA.