Ashley Stirrup

How do you A/B test something that has 300 million monthly players constantly clicking? The new edition of The Experimentation Edge newsletter rounds up my conversations with Shan Huang, data scientist on Supercell's central experimentation team, and Priya Singhee, VP of Enterprise Analytics and Data Science at Early Warning. Two very different businesses who share this one habit: The hard decisions get made before launch. Shan's team writes the hypothesis down first and tells players what's being tested before it runs. Priya asks four questions before any test starts and pre-registers the analysis plan so nobody can go hunting for a win afterward. Want to know what these questions and hypotheses are? Subscribe to my newsletter and find out!