DataCamp ranked 36th on Deloitte's 2019 Technology Fast 500™! Learn More
Premium Project

Mobile Games A/B Testing with Cookie Cats

Analyze an A/B test from the popular mobile puzzle game, Cookie Cats.

Start Project
  • 11 tasks
  • 2,227 participants
  • 1,500 XP

Project Description

Cookie Cats is a hugely popular mobile puzzle game developed by Tactile Entertainment. It's a classic "connect three" style puzzle game where the player must connect tiles of the same color in order to clear the board and win the level. It also features singing cats. We're not kidding! Check out this short demo:

As players progress through the game they will encounter gates that force them to wait some time before they can progress or make an in-app purchase. In this project, we will analyze the result of an A/B test where the first gate in Cookie Cats was moved from level 30 to level 40. In particular, we will analyze the impact on player retention.

To complete this project, you should be comfortable working with pandas DataFrames and with using the pandas plot method. You should also have some understanding of hypothesis testing and bootstrap analysis. We recommend that you comple the following courses before taking on this project:

Project Tasks

  • 1Of cats and cookies
  • 2The AB-test data
  • 3The distribution of game rounds
  • 4Overall 1-day retention
  • 51-day retention by AB-group
  • 6Should we be confident in the difference?
  • 7Zooming in on the difference
  • 8The probability of a difference
  • 97-day retention by AB-group
  • 10Bootstrapping the difference again
  • 11 The conclusion
Instructor Avatar
Rasmus Bååth

Senior Data Scientist at King (Activision Blizzard)

I'm a Data Scientist at King (Activision/Blizzard) and previously I've been an instructor at DataCamp. I once did a PhD in Cognitive Science at Lund University. I'm passionate about Bayesian statistics, good graphs and free coffee. Follow me @rabaath on Twitter or check out my blog, Publishable Stuff.

See More
Instructor Avatar
Bret Romero

Data Scientist at Tactile Entertainment

Brett Romero is a Data Scientist at Tactile Entertainment. He has previously worked for a range of organisations, including the United Nations Development Programme, Deloitte, and the Australian Taxation Office. You can follow him on Twitter at @mrbrettromero or read more about his work on his blog.

See More

Technology

  • Python LogoPython
  • Topics

    Case Studies