Premium project
Word Frequency in Moby Dick
Use web scraping and NLP to find the most frequent words in classic literature: Herman Melville's novel, Moby Dick.
Start Project1 Tasks1,500 XP
Loved by learners at thousands of companies
Project Description
In this project, you'll scrape a novel from an html
file taken from the website Project Gutenberg (which contains a large corpus of books) using the Python requests
package. Then you'll extract text from this web data using the BeautifulSoup
library. Finally, you'll analyze the distribution of words using the Natural Language ToolKit (nltk
), a very common NLP task used to gain insights on textual data and lay the groundwork for deeper analysis.
The natural language processing tools used here are required for many important data science tasks as a vast proportion of the world's data is unstructured and includes a great deal of text. To complete this project, you need to know how to import web data into Python and how to work with natural language text.
Project Tasks
- 1Find the most common words in a classic novel.
Technologies
Python
Jasmin Ludolf
See MoreData Science Content Developer, DataCamp
Jasmin is a Content Developer at DataCamp. After ten years as a global marketing manager in the music industry, she recently changed careers to follow her curiosity for data. Her passion is value exchange and making data science accessible to all.