Premium project
Mobile Games A/B Testing with Cookie Cats
Analyze an A/B test from the popular mobile puzzle game, Cookie Cats.
Start Project11 Tasks1,500 XP
Loved by learners at thousands of companies
Project Description
Cookie Cats is a hugely popular mobile puzzle game developed by Tactile Entertainment. It's a classic "connect three" style puzzle game where the player must connect tiles of the same color in order to clear the board and win the level. It also features singing cats. We're not kidding!
As players progress through the game they will encounter gates that force them to wait some time before they can progress or make an in-app purchase. In this project, we will analyze the result of an A/B test where the first gate in Cookie Cats was moved from level 30 to level 40. In particular, we will analyze the impact on player retention.
To complete this project, you should be comfortable working with pandas DataFrames and with using the pandas plot method. You should also have some understanding of hypothesis testing and bootstrap analysis.
Project Tasks
- 1Of cats and cookies
- 2The AB-test data
- 3The distribution of game rounds
- 4Overall 1-day retention
- 51-day retention by AB-group
- 6Should we be confident in the difference?
- 7Zooming in on the difference
- 8The probability of a difference
- 97-day retention by AB-group
- 10Bootstrapping the difference again
- 11The conclusion
Technologies
Python
Rasmus Bååth
See More
Data Science Lead at castle.io
Rasmus Bååth is a Data Science Lead at castle.io. Previously, he was an instructor and Curriculum Lead for Projects at DataCamp. He has a PhD in Cognitive Science from Lund University in Sweden. Follow him at @rabaath on Twitter or on his blog, Publishable Stuff.