Word Frequency in Classic Novels

Principiante

Updated 12/2023

Use web scraping and NLP to find the most frequent words in one of two pieces of classic literature: Herman Melville's novel, Moby Dick, or Peter Pan by J. M. Barrie.

Crea Tu Cuenta Gratuita

Al continuar, acepta nuestros Términos de uso, nuestra Política de privacidad y que sus datos se almacenan en los EE. UU.

Project Description

In this Project, you'll scrape a novel from the website Project Gutenberg (which contains a large corpus of books) using the Python package requests. Then you'll extract words from this web data using BeautifulSoup. Finally, we'll dive into analyzing the distribution of words using the Natural Language ToolKit (nltk).

The natural language processing tools used here apply to much of the data that data scientists encounter as a vast proportion of the world's data is unstructured data and includes a great deal of text. To complete this Project, you need to know how to import web data into Python and how to work with natural language text.

Project Tasks

1
Tools for text processing

2
Request Moby Dick
3
Get the text from the HTML
4
Extract the words
5
Make the words lowercase
6
Load in stop words
7
Remove stop words in Moby Dick
8
We have the answer
9
The most common word

Technologies

Python

Prerrequisitos

Intermediate Importing Data in Python Introduction to Natural Language Processing in Python

Hugo Bowne-Anderson

Data Scientist

What do other learners have to say?