Posts

111 original posts (reposts excluded)

Source:All Ashley StirrupGrowthBookGraham McNicollAlyssa Nicoll
Sort:Most recentTop engagement
Channel:📰 Newsletter
SourcePostFormatTopicPublishedImpr.LikesCommentsShares
Ashley StirrupThis week’s edition brings together Dorothy Crepin at MilliporeSigma and Michal Lenik at Gtext_linkpodcast2026-10-15—401
Ashley StirrupThe one part of experimentation AI won't take over for a long time. Michael Mathews Jr (Fatext_videopodcast2026-10-13—910
Ashley StirrupFifteen research interviews said one thing. The concept test said another. Michal Lenik (Gtext_videopodcast2026-10-07258901
Ashley StirrupA small change to type ahead search drove double digit gains in add to cart. Dorothy Crepitext_videopodcast2026-10-06122430
Ashley Stirrup$180 million in one year. Half the story is what they did not ship. Gaurav Sethi (PayPal) text_videopodcast2026-09-30214911
Ashley StirrupThe AI worked. Users quit anyway. Ashraf Karim (ServiceNow) on the biggest learning from ltext_videopodcast2026-09-291,1313223
Ashley StirrupOne team runs roughly tests a month, the other ran 1,500 a year. Both stopped keeping scortext_linkpodcast2026-09-29271900
Ashley StirrupSometimes the p-value is never coming. Wanli Lau (Twilio) on experimentation when your custext_videopodcast2026-09-28139400
Ashley StirrupStop worrying about losing tests. Will Guyeskey (GoPro): do not fear a loser, do not fear text_videopodcast2026-09-255283361
Ashley StirrupFrom last week's podcast episodes I learned a common lesson: A result only makes sense onctext_linkpodcast2026-09-237641111
Ashley StirrupHow do you keep every one pointed at the same North Star? This week’s Experimentation Edgtext_linkpodcast2026-09-176621531
Ashley StirrupB2C testing is more mature and more rigorous. Anuradha Tempe, MBA, MS of Samsung on borrowtext_videopodcast2026-09-17180400
Ashley StirrupA 300% attach rate, and the test still lost money. Whitney Perez of Realtor.com breaks dowtext_videopodcast2026-09-10221410
Ashley StirrupEngineers as the champions of experimentation? Rich Liebling of Learneo on the culture at text_videopodcast2026-09-09221510
Ashley StirrupHow do you A/B test something that has 300 million monthly players constantly clicking? Ttext_linkpodcast2026-09-099421211
Ashley StirrupA test without a specific falsifiable hypothesis is just a fishing expedition. Priya Singhtext_videopodcast2026-09-03194620
Ashley StirrupJobLeads grew its testing velocity 10x in under 2 years. Clover has been well established text_linkpodcast2026-09-011,8471400
Ashley StirrupExperiment analysis used to be restricted to data analysts and product managers with expertext_videopodcast2026-09-01219200
Ashley StirrupNot everything deserves an experiment. Ben Schein of Clover on The Experimentation Edge: utext_videopodcast2026-08-31154300
Ashley StirrupThe research said it couldn't miss: 50% returning customers, the same order every week, ustext_videopodcast2026-08-28251700
Ashley StirrupWhy would Principal Financial Group A/B test on customers who don't exist? The new edititext_linkpodcast2026-08-27798300
Ashley StirrupA mistake where over 1,000,000 people could see is terrifying... So how do you avoid a catext_linkpodcast2026-08-187021001
Ashley StirrupOn the latest episode of The Experimentation Edge, Vijay L. made the case for how to improtext_imagepodcast2026-08-114471111
Ashley StirrupThe strongest experimentation cultures I've seen are built on ceremonies. Luis Trindade, text_videopodcast2026-08-06396500
Ashley Stirrup🚨 NEWSLETTER RELEASE 🚨 This edition breaks down how each team built a program where evtext_linkpodcast2026-08-051,2301710
Ashley StirrupMarketing, product, and the newsroom at the Philadelphia Inquirer all collaboratively run text_imagemarketing_event2026-08-05320720
Ashley StirrupWhat Fyxer, Ancestry, and Chess.com shows that all you need is 25%... Three companies at text_linkpodcast2026-07-302,0262220
Ashley StirrupThe whole team GrowthBook is so excited to see Khan Academy win this award. I really thintext_onlyother2026-07-286752150
Ashley StirrupB2C: "It's black, it fits my apartment, it makes hot water for my tea. I love it." B2B: "text_videopodcast2026-07-234721211
Ashley StirrupFanatics, UPS, and DoorDash all prove the same thing about testing. The new edition of Thtext_linkpodcast2026-07-222,0502910
Ashley StirrupYou can run a thousand experiments, but there's one big question your business has to undetext_videopodcast2026-07-211,6871320
Ashley StirrupGetting numbers is easy. Getting numbers you can trust is hard. We hosted Ron Kohavi (co-text_imagethought_leadership2026-07-173,6464681
Ashley StirrupCongratulations to all of the Experimentation Culture Awards finalists. Everyone had suchtext_imageother2026-07-161,2134141
Ashley StirrupI interviewed three experimentation leaders from three industries that could not be more dtext_linkpodcast2026-07-161,4761910
Ashley StirrupIt's almost showtime! Crossing my fingers for 3 of the finalists that are all using Growttext_onlyother2026-07-16—300
Ashley StirrupA C-suite exec walked in and said "we need video chat." Amazon Fire had just launched thetext_videopodcast2026-07-16448500
Ashley StirrupCongratulations to Khan Academy, Kelli H., Tushar Udeshi and the entire Khanmigo team. Khtext_imageother2026-07-15—1400
Ashley StirrupThe Home Depot does $150 billion a year as an enterprise. The online org alone just passetext_videopodcast2026-07-15451600
Ashley StirrupThere's a difference between a bad result and a bad experiment. James A. Falzone, Directotext_videopodcast2026-07-141,2081430
Ashley StirrupYour best feature might be hiding in the wrong place. Danielle Olean, Director of eCommertext_videopodcast2026-07-09243000
Ashley StirrupI interviewed five experimentation leaders in one week and compiled the most important fintext_linkpodcast2026-07-081,8742122
Ashley StirrupA billion dollars. That's JPMorganChase's estimated value from experimentation and innovatext_videopodcast2026-07-08351400
Ashley StirrupThere may be a goldmine of growth hidden in your last experiment. Most teams read a test text_documentdata_science2026-07-071,4481431
Ashley StirrupClaude Code turned weeks of data analysis into a few hours. Raunak Kumar at Fin (formerlytext_videopodcast2026-07-06650521
Ashley StirrupIf the idea sounds weak in plain English, don't run the experiment. Arun Bodapati at Twittext_videopodcast2026-07-03270200
Ashley StirrupUser research that once took three weeks now takes about two hours. Daniel Layfield at Diltext_videopodcast2026-07-03298410
Ashley StirrupThe biggest experiment wins usually aren't in the product at all. Nick Beyler from Stitchtext_videopodcast2026-07-021,1342401
Ashley StirrupI asked five experimentation leaders the same two questions. Their answers were almost idetext_linkpodcast2026-07-021,3822123
Ashley StirrupHow Disney goes from no idea what to test → 110 ranked ideas Crystal Ammari Iorio runs extext_videopodcast2026-06-305451413
Ashley Stirrup"If a test is safe enough to let AI run the whole thing, why run it at all?" That line frtext_videopodcast2026-06-29414240
Ashley StirrupPeople with smaller palms live longer. That's a real correlation. Statistically significatext_imagethought_leadership2026-06-291,5291510
Ashley StirrupMost people think A/B testing is for button colors and SaaS onboarding flows. TodayTix istext_carouselcustomer_story2026-06-264511450
Ashley StirrupAttention everyone! The Experimentation Edge newsletter is getting an upgrade, and it's mtext_onlypodcast2026-06-255821700
Ashley Stirrup15 value-driven experiments beat 40 button-color ones. That's the shift Craig Kistler madtext_carouselpodcast2026-06-186291942
Ashley StirrupAccuracy measures the test set. It doesn't measure trust. I had Mayank Agarwal (Director text_carouselpodcast2026-06-168072203
Ashley StirrupA two-point lift in close rate sounds like a rounding error. At Ford Credit, it's the numbtext_videopodcast2026-06-04573810
Ashley StirrupEveryone celebrates the winning test, but the losing ones are where the real money hides. text_videopodcast2026-06-02594940
Ashley StirrupDavid Massey, MFA just shared his secret success at UPS. Everyone thought his test was crtext_videopodcast2026-05-286691600
Ashley StirrupThe best experimentation teams celebrate the tests that fail. Why? Because a win confirmstext_videopodcast2026-05-269042231
Ashley StirrupDon’t confuse shipping with winning. Microsoft figured this out in 2014. For decades, thetext_imagethought_leadership2026-05-267761401
Ashley StirrupThe GrowthBook team just got back from Hawaii! We're a team spread across the globe, and text_imagesocial2026-05-218,13110856
Ashley StirrupKhan Academy was one of the first companies to develop with the OpenAI models. This NYT sttext_linkmarketing_event2026-05-181,1022230
Ashley StirrupAndrew Willingham's career advice for product managers: stop being right. Stop walking intext_videopodcast2026-05-134531001
Ashley StirrupMost teams kill a failed experiment and never look at it again. Kameron Tanseli at @fyxertext_videopodcast2026-05-13281610
Ashley StirrupDoorDash saved thousands of subscriptions per week. What was that experiment? Ilya Izraitext_videopodcast2026-05-127321911
Ashley StirrupHow does Fanatics generate hundreds of millions in growth from experimentation every year?text_videopodcast2026-05-119302730
Ashley StirrupUPS added a required email field to their shipping checkout. The outcome? Not good... Context_videopodcast2026-05-11530510
Ashley StirrupIs 1 year to choose an experimentation tool overkill? Khan Academy says no. Dr. Kelli Hiltext_videocustomer_story2026-05-07446720
Ashley StirrupMost companies run experiments in a silo. The growth team knows what's working. Nobody eltext_videopodcast2026-05-06348420
Ashley StirrupKhan Academy spent 3 years defining one metric. Because most AI teams have no idea what "gtext_videomarketing_event2026-05-05268420
Ashley StirrupIntuition is the most dangerous tool in gen AI. It could have cost Khan Academy their AI ttext_videomarketing_event2026-05-04317820
Ashley StirrupMost teams ship a feature and move on. Kameron Tanseli at @fyxerofficial does the opposittext_videopodcast2026-04-29466520
Ashley StirrupWe thought Chess.com users wanted to review their losses. 80% were reviewing their wins. text_videopodcast2026-04-242,57935131
Ashley StirrupNot every experiment that looks perfect on a whiteboard works in the real world. Kameron text_videopodcast2026-04-221,1781912
Ashley StirrupAt Ancestry, their goal is to make the past come to life. They used AI to do exactly that,text_videopodcast2026-04-171,3092520
Ashley StirrupKhan Academy gave their AI tutor a calculator to improve math accuracy. It worked, but it text_linkmarketing_event2026-04-091,2142730
Ashley StirrupAI just killed the two biggest excuses for not experimenting. "We don't have enough engintext_imagecustomer_story2026-04-076,9245853
Ashley StirrupA 5-pixel change almost cost LinkedIn $10M a year. A designer adjusted the padding on thetext_videopodcast2026-04-068961421
Ashley StirrupHow do you grow from $1M to $35M ARR in a year? Not by running the usual handful of tests text_videopodcast2026-04-021,8064432
Ashley StirrupYour metrics are green. Your customers are leaving. Ron Kohavi calls these "watermelon metext_imagethought_leadership2026-03-194,75796144
Ashley StirrupCalling e-commerce experimentation companies! Get free expert guidance from Ron Kohavi, Ltext_imagemarketing_event2026-03-171,3062015
Ashley StirrupFriends don't let their product managers use bad reality distortion. Steve Jobs had a famtext_imagethought_leadership2026-03-161,218810
Ashley StirrupHigh activity doesn't mean high quality. Sometimes it means the opposite. A user who refrtext_videopodcast2026-03-12206630
Ashley Stirrup8+ out of 10 features your team ships will fail. That's not pessimism — it's data. The metext_videomarketing_event2026-03-1195410
Ashley StirrupMost ideas fail. Data shows the median organization has a success rate of only 10-15%. If text_videothought_leadership2026-03-1174200
Ashley StirrupAnyone can run an A/B test. Typeform decided that wasn't enough. On the latest Experimenttext_videopodcast2026-03-10145720
Ashley StirrupA simple UI change was worth $120 million to Bing. The problem is, it's impossible to knotext_videomarketing_event2026-03-091,8381912
Ashley StirrupRaj Mehta joined me on the Experimentation Edge Podcast this week. Its a great real-worldtext_onlypodcast2026-03-0776200
Ashley StirrupThis is an excellent case study on the power of experimentation! Kameron T. and team are text_onlycustomer_story2026-03-06512911
Ashley StirrupIt's Twyman's Law: any figure that looks interesting or surprising is usually wrong. Heretext_imagethought_leadership2026-03-061,3931510
Ashley StirrupMost experimentation programs are confidently wrong - unless they have a plan. The webinatext_imagemarketing_event2026-03-04544711
Ashley StirrupA slide made it all the way to a VP all-hands at Microsoft. It said: "New users who use otext_imagethought_leadership2026-03-03565920
Ashley StirrupAmazon's team was confident in their data. Then someone noticed Oprah had called Kindle hetext_documentthought_leadership2026-03-02617710
Ashley StirrupA Microsoft team once presented this finding internally about Office 365: "Users who use otext_imagethought_leadership2026-02-272,9344410
Ashley StirrupLukas Vermeer 🃏 talked today at Experimentation Island about how simple stories can reshatext_imagethought_leadership2026-02-262,7145840
Ashley StirrupThe most dangerous animal in your organization isn't a bad idea. It's a senior leader withtext_imagethought_leadership2026-02-2622,3556262
Ashley StirrupGreat session on “How to scale your experimentation program” session at Experimentation Istext_imagemarketing_event2026-02-251,4563820
Ashley StirrupI just watched a terrific presentation by Kelli H. at Khan Academy at Experimentation Islatext_imagecustomer_story2026-02-251,1843312
Ashley Stirrup92% of experiments at Airbnb failed to move the metrics they were designed to improve. Rotext_imagethought_leadership2026-02-243,2652832
Ashley StirrupYou never know where your next home run idea will come from. That's not a platitude. It'stext_documentthought_leadership2026-02-233,5583030
Ashley StirrupExperimentation unlocks learning you can't get any other way. These learnings often surfatext_onlythought_leadership2026-02-202451110
Ashley Stirrup4.3 includes some great new features, like Daily Average Usage tracking, which is key for text_onlymarketing_event2026-02-17633810
Ashley StirrupWe shipped GrowthBook 4.3 today. It includes a geeky feature called post-stratification wtext_onlyproduct_functionality2026-02-046281510
Ashley StirrupIt's not often that you can get world-class experimentation tools AND save 82% versus the text_onlycustomer_story2026-01-30459900
Ashley StirrupAI usage is making A/B testing even more important. In this GrowthBook Office Hours - We’text_onlymarketing_event2026-01-078031420
Ashley StirrupThis is kind of feedback makes working at GrowthBook really special. How many experimentstext_onlycustomer_story2025-11-249852410
Ashley StirrupUncovering new understandings of user behavior can unlock new sales or huge savings opporttext_onlymarketing_event2025-11-215891110
Ashley StirrupRudger de Groot and Mintminds have been working with Growthbook for 3 years. If you are gtext_onlymarketing_event2025-11-19392711
Ashley StirrupIf your product team has lots of data, but still can't see where the biggest opportunitiestext_onlymarketing_event2025-11-144261100
Ashley StirrupBuilding new features and not tracking the results?? It's time for an experimentation platext_onlyother2025-09-256991600
Ashley StirrupI’m happy to share that I’m starting a new position as Chief Marketing Officer at GrowthBotext_onlysocial2025-09-087,817240680