Premium project

Mobile Games A/B Testing with Cookie Cats

Analyze an A/B test from the popular mobile puzzle game, Cookie Cats.

Start Project
11 Tasks1,500 XP

Loved by learners at thousands of companies


Project Description

[Cookie Cats](https://www.facebook.com/cookiecatsgame) is a hugely popular mobile puzzle game developed by [Tactile Entertainment](http://tactile.dk). It's a classic "connect three" style puzzle game where the player must connect tiles of the same color in order to clear the board and win the level. It also features singing cats. We're not kidding! As players progress through the game they will encounter gates that force them to wait some time before they can progress or make an in-app purchase. In this project, we will analyze the result of an A/B test where the first gate in Cookie Cats was moved from level 30 to level 40. In particular, we will analyze the impact on player _retention_. To complete this project, you should be comfortable working with pandas DataFrames and with using the pandas plot method. You should also have some understanding of hypothesis testing and bootstrap analysis.

Project Tasks

  1. 1
    Of cats and cookies
  2. 2
    The AB-test data
  3. 3
    The distribution of game rounds
  4. 4
    Overall 1-day retention
  5. 5
    1-day retention by AB-group
  6. 6
    Should we be confident in the difference?
  7. 7
    Zooming in on the difference
  8. 8
    The probability of a difference
  9. 9
    7-day retention by AB-group
  10. 10
    Bootstrapping the difference again
  11. 11
    The conclusion
Technologies
Python Python
Topics
Case Studies
Rasmus Bååth Headshot

Rasmus Bååth

Senior Data Scientist at King (Activision Blizzard)
Rasmus Bååth is a Senior Data Scientist at King. Previously, he was an instructor and Curriculum Lead for Projects at DataCamp. He has a PhD in Cognitive Science from Lund University in Sweden. Follow him at @rabaath on Twitter or on his blog, Publishable Stuff.
See More
Bret Romero Headshot

Bret Romero

Data Scientist at Tactile Entertainment
Brett Romero is a Data Scientist at Tactile Entertainment. He has previously worked for a range of organisations, including the United Nations Development Programme, Deloitte, and the Australian Taxation Office. You can follow him on Twitter at @mrbrettromero or read more about his work on his blog.
See More

What do other learners have to say?

I've used other sites—Coursera, Udacity, things like that—but DataCamp's been the one that I've stuck with.

Devon Edwards Joseph
Lloyds Banking Group

DataCamp is the top resource I recommend for learning data science.

Louis Maiden
Harvard Business School

DataCamp is by far my favorite website to learn from.

Ronald Bowers
Decision Science Analytics, USAA