Posts

58 original posts (reposts excluded)

Source:All Ashley StirrupGrowthBookGraham McNicoll
Sort:Most recentTop engagement
SourcePostFormatTopicPublishedImpr.LikesCommentsShares
Ashley StirrupAccuracy measures the test set. It doesn't measure trust. I had Mayank Agarwal (Director text_carousel—2026-06-16—1502
Ashley StirrupA two-point lift in close rate sounds like a rounding error. At Ford Credit, it's the numbtext_videopodcast2026-06-04394710
Ashley StirrupEveryone celebrates the winning test, but the losing ones are where the real money hides. text_videopodcast2026-06-02499840
Ashley StirrupDavid Massey, MFA just shared his secret success at UPS. Everyone thought his test was crtext_videopodcast2026-05-285891500
Ashley StirrupThe best experimentation teams celebrate the tests that fail. Why? Because a win confirmstext_videopodcast2026-05-268412231
Ashley StirrupDon’t confuse shipping with winning. Microsoft figured this out in 2014. For decades, thetext_imagethought_leadership_expert2026-05-266961101
Ashley StirrupThe GrowthBook team just got back from Hawaii! We're a team spread across the globe, and text_imagecompany_personal2026-05-217,55610656
Ashley StirrupKhan Academy was one of the first companies to develop with the OpenAI models. This NYT sttext_linkcustomer_story2026-05-181,0412230
Ashley StirrupAndrew Willingham's career advice for product managers: stop being right. Stop walking intext_videopodcast2026-05-134321001
Ashley StirrupMost teams kill a failed experiment and never look at it again. Kameron Tanseli at @fyxertext_videopodcast2026-05-13259610
Ashley StirrupDoorDash saved thousands of subscriptions per week. What was that experiment? Ilya Izraitext_videopodcast2026-05-127061911
Ashley StirrupHow does Fanatics generate hundreds of millions in growth from experimentation every year?text_videopodcast2026-05-119092730
Ashley StirrupUPS added a required email field to their shipping checkout. The outcome? Not good... Context_videopodcast2026-05-11516510
Ashley StirrupIs 1 year to choose an experimentation tool overkill? Khan Academy says no. Dr. Kelli Hiltext_videocustomer_story2026-05-07426720
Ashley StirrupMost companies run experiments in a silo. The growth team knows what's working. Nobody eltext_videopodcast2026-05-06332420
Ashley StirrupKhan Academy spent 3 years defining one metric. Because most AI teams have no idea what "gtext_videopodcast2026-05-05255420
Ashley StirrupIntuition is the most dangerous tool in gen AI. It could have cost Khan Academy their AI ttext_videopodcast2026-05-04300820
Ashley StirrupMost teams ship a feature and move on. Kameron Tanseli at @fyxerofficial does the opposittext_videopodcast2026-04-29450520
Ashley StirrupWe thought Chess.com users wanted to review their losses. 80% were reviewing their wins. text_videopodcast2026-04-242,55235131
Ashley StirrupNot every experiment that looks perfect on a whiteboard works in the real world. Kameron text_videopodcast2026-04-221,1571912
Ashley StirrupAt Ancestry, their goal is to make the past come to life. They used AI to do exactly that,text_videopodcast2026-04-171,2982520
Ashley StirrupKhan Academy gave their AI tutor a calculator to improve math accuracy. It worked, but it text_linkcustomer_story2026-04-091,2092730
Ashley StirrupAI just killed the two biggest excuses for not experimenting. "We don't have enough engintext_imagecustomer_story2026-04-076,7955853
Ashley StirrupA 5-pixel change almost cost LinkedIn $10M a year. A designer adjusted the padding on thetext_videopodcast2026-04-068961421
Ashley StirrupHow do you grow from $1M to $35M ARR in a year? Not by running the usual handful of tests text_videopodcast2026-04-021,8064432
Ashley StirrupYour metrics are green. Your customers are leaving. Ron Kohavi calls these "watermelon metext_imagethought_leadership_expert2026-03-194,75795144
Ashley StirrupCalling e-commerce experimentation companies! Get free expert guidance from Ron Kohavi, Ltext_imagethought_leadership_expert2026-03-171,3062015
Ashley StirrupFriends don't let their product managers use bad reality distortion. Steve Jobs had a famtext_imagethought_leadership2026-03-16762810
Ashley StirrupHigh activity doesn't mean high quality. Sometimes it means the opposite. A user who refrtext_videopodcast2026-03-12206630
Ashley Stirrup8+ out of 10 features your team ships will fail. That's not pessimism — it's data. The metext_videothought_leadership_expert2026-03-1195410
Ashley StirrupMost ideas fail. Data shows the median organization has a success rate of only 10-15%. If text_videothought_leadership_expert2026-03-1174200
Ashley StirrupAnyone can run an A/B test. Typeform decided that wasn't enough. On the latest Experimenttext_videopodcast2026-03-10145720
Ashley StirrupA simple UI change was worth $120 million to Bing. The problem is, it's impossible to knotext_videopodcast2026-03-091,1651912
Ashley StirrupRaj Mehta joined me on the Experimentation Edge Podcast this week. Its a great real-worldtext_onlypodcast2026-03-0776200
Ashley StirrupThis is an excellent case study on the power of experimentation! Kameron T. and team are text_onlycustomer_story2026-03-06103911
Ashley StirrupIt's Twyman's Law: any figure that looks interesting or surprising is usually wrong. Heretext_imagethought_leadership_expert2026-03-061,3931510
Ashley StirrupMost experimentation programs are confidently wrong - unless they have a plan. The webinatext_imagethought_leadership_expert2026-03-0447711
Ashley StirrupA slide made it all the way to a VP all-hands at Microsoft. It said: "New users who use otext_imagethought_leadership_expert2026-03-0328920
Ashley StirrupAmazon's team was confident in their data. Then someone noticed Oprah had called Kindle hetext_documentthought_leadership_expert2026-03-0232710
Ashley StirrupA Microsoft team once presented this finding internally about Office 365: "Users who use otext_imagethought_leadership_expert2026-02-27344410
Ashley StirrupLukas Vermeer 🃏 talked today at Experimentation Island about how simple stories can reshatext_imagethought_leadership_expert2026-02-26405840
Ashley StirrupThe most dangerous animal in your organization isn't a bad idea. It's a senior leader withtext_imagethought_leadership_expert2026-02-2611,1435962
Ashley StirrupGreat session on “How to scale your experimentation program” session at Experimentation Istext_imagethought_leadership_expert2026-02-25313820
Ashley StirrupI just watched a terrific presentation by Kelli H. at Khan Academy at Experimentation Islatext_imagecustomer_story2026-02-251643312
Ashley Stirrup92% of experiments at Airbnb failed to move the metrics they were designed to improve. Rotext_imagethought_leadership_expert2026-02-24892832
Ashley StirrupYou never know where your next home run idea will come from. That's not a platitude. It'stext_documentthought_leadership_expert2026-02-23243030
Ashley StirrupExperimentation unlocks learning you can't get any other way. These learnings often surfatext_onlythought_leadership2026-02-202451110
Ashley Stirrup4.3 includes some great new features, like Daily Average Usage tracking, which is key for text_onlyproduct_announcement2026-02-17633810
Ashley StirrupWe shipped GrowthBook 4.3 today. It includes a geeky feature called post-stratification wtext_onlyproduct_announcement2026-02-046281610
Ashley StirrupIt's not often that you can get world-class experimentation tools AND save 82% versus the text_onlyproduct_announcement2026-01-304591000
Ashley StirrupAI usage is making A/B testing even more important. In this GrowthBook Office Hours - We’text_onlyproduct_announcement2026-01-078031520
Ashley StirrupThis is kind of feedback makes working at GrowthBook really special. How many experimentstext_onlycustomer_story2025-11-249852410
Ashley StirrupUncovering new understandings of user behavior can unlock new sales or huge savings opporttext_onlyproduct_announcement2025-11-215891110
Ashley StirrupRudger de Groot and Mintminds have been working with Growthbook for 3 years. If you are gtext_onlycustomer_story2025-11-19392711
Ashley StirrupIf your product team has lots of data, but still can't see where the biggest opportunitiestext_onlyproduct_announcement2025-11-144261100
Ashley StirrupI had the opportunity to help out Andrew Yan and AthenaHQ as they worked on their GenAI Setext_onlyindustry_commentary2025-10-088622530
Ashley StirrupBuilding new features and not tracking the results?? It's time for an experimentation platext_onlyproduct_announcement2025-09-256991600
Ashley StirrupI’m happy to share that I’m starting a new position as Chief Marketing Officer at GrowthBotext_onlycompany_personal2025-09-0893240680