Posts

120 original posts (reposts excluded), filtered

Source:All Ashley StirrupGrowthBookGraham McNicollAlyssa Nicoll
Sort:Most recentTop engagement
Channel:📰 Newsletter
Filters:Format: text_video ✕Clear all
SourcePostFormatTopicPublishedImpr.LikesCommentsShares
Graham McNicollNobody should bench press 300 pounds their first day in the gym. The reason is obvious. Ytext_videothought_leadership2026-10-14—1510
Ashley StirrupThe one part of experimentation AI won't take over for a long time. Michael Mathews Jr (Fatext_videopodcast2026-10-13—910
Alyssa NicollIs MCP the magic wand I’ve been waiting for? Because “please clean up my stale feature fltext_videoproduct_demo2026-10-092271624
Graham McNicollAll of AI right now is entirely reactive. You have to know what to ask before it can helptext_videothought_leadership2026-10-071951520
Ashley StirrupFifteen research interviews said one thing. The concept test said another. Michal Lenik (Gtext_videopodcast2026-10-07258901
Ashley StirrupA small change to type ahead search drove double digit gains in add to cart. Dorothy Crepitext_videopodcast2026-10-06122430
Graham McNicollArtificial intelligence helps you feel artificially intelligent. It is almost as if it watext_videothought_leadership2026-09-303422020
Ashley Stirrup$180 million in one year. Half the story is what they did not ship. Gaurav Sethi (PayPal) text_videopodcast2026-09-30214911
Ashley StirrupThe AI worked. Users quit anyway. Ashraf Karim (ServiceNow) on the biggest learning from ltext_videopodcast2026-09-291,1313223
Alyssa NicollOur GrowthBook 5.1 Office Hours recording is up, here is my recap version but check out thtext_videoproduct_functionality2026-09-292721201
Ashley StirrupSometimes the p-value is never coming. Wanli Lau (Twilio) on experimentation when your custext_videopodcast2026-09-28139400
Ashley StirrupStop worrying about losing tests. Will Guyeskey (GoPro): do not fear a loser, do not fear text_videopodcast2026-09-255283361
Graham McNicollBuilding a feature now costs almost nothing, which turns out to be the problem. When you text_videothought_leadership2026-09-232941000
Ashley StirrupB2C testing is more mature and more rigorous. Anuradha Tempe, MBA, MS of Samsung on borrowtext_videopodcast2026-09-17180400
Graham McNicollI cannot look at 100 experiments and tell you what they have in common. That is the probltext_videoproduct_functionality2026-09-15270920
Ashley StirrupA 300% attach rate, and the test still lost money. Whitney Perez of Realtor.com breaks dowtext_videopodcast2026-09-10221410
Ashley StirrupEngineers as the champions of experimentation? Rich Liebling of Learneo on the culture at text_videopodcast2026-09-09221510
Graham McNicollMost product teams use evals to figure out if their AI tools or products are working corretext_videothought_leadership2026-09-084681940
GrowthBookRunning hundreds of experiments at a time is the dream of many teams, but it makes patterntext_videoproduct_demo2026-09-033811120
Ashley StirrupA test without a specific falsifiable hypothesis is just a fishing expedition. Priya Singhtext_videopodcast2026-09-03194620
Graham McNicollThere's always been a tension between marketing teams and engineering teams. Engineeringtext_videoproduct_functionality2026-09-02267910
Ashley StirrupExperiment analysis used to be restricted to data analysts and product managers with expertext_videopodcast2026-09-01219200
Ashley StirrupNot everything deserves an experiment. Ben Schein of Clover on The Experimentation Edge: utext_videopodcast2026-08-31154300
Ashley StirrupThe research said it couldn't miss: 50% returning customers, the same order every week, ustext_videopodcast2026-08-28251700
Graham McNicollWhen was the last time you saw innovation from a public company? Honestly, from my experitext_videoindustry_commentary2026-08-275031621
Graham McNicollAI has made it ridiculously easy to build and ship features. The problem is that AI doesn'text_videothought_leadership2026-08-204681412
Graham McNicollA lot of engineering teams have feature flags to control the release of features and act atext_videothought_leadership2026-08-18310910
Graham McNicollIt's really hard when you really believed in feature, you managed to get it prioritized, ytext_videothought_leadership2026-08-133331530
Graham McNicollFrom my experience, experimentation programs don't get killed off in a meeting because peotext_videothought_leadership2026-08-112991020
Ashley StirrupThe strongest experimentation cultures I've seen are built on ceremonies. Luis Trindade, text_videopodcast2026-08-06396500
Graham McNicollWe make it stupidly easy to run experiments. Whether you're a back-end engineer, a front-etext_videoproduct_functionality2026-08-064471001
Graham McNicollToken costs are exploding across our industry. Here's how we approach it. I definitely betext_videothought_leadership2026-08-043231020
Graham McNicollOne of the things we tell a lot of our customers is that it's the number of at-bats that wtext_videothought_leadership2026-07-29342720
Alyssa NicollGovernance is important. (At least llama thinks so 😉) Governance is also a word that cantext_videoproduct_functionality2026-07-23438971
Ashley StirrupB2C: "It's black, it fits my apartment, it makes hot water for my tea. I love it." B2B: "text_videopodcast2026-07-234721211
Graham McNicollTeams have no shortage of ideas, but implementing them is where teams hit roadblocks. Stext_videoproduct_functionality2026-07-221,1802571
Ashley StirrupYou can run a thousand experiments, but there's one big question your business has to undetext_videopodcast2026-07-211,6871320
Ashley StirrupA C-suite exec walked in and said "we need video chat." Amazon Fire had just launched thetext_videopodcast2026-07-16448500
Graham McNicollMost companies ship the first version of the product they build. And the chance that's thetext_videothought_leadership2026-07-166541740
Ashley StirrupThe Home Depot does $150 billion a year as an enterprise. The online org alone just passetext_videopodcast2026-07-15451600
Graham McNicollThere's a level of excitement teams get when the product just works and they're not fightitext_videoproduct_functionality2026-07-15404820
Ashley StirrupThere's a difference between a bad result and a bad experiment. James A. Falzone, Directotext_videopodcast2026-07-141,2081430
Ashley StirrupYour best feature might be hiding in the wrong place. Danielle Olean, Director of eCommertext_videopodcast2026-07-09243000
Graham McNicollMost product teams build features the expensive way. Someone has the idea. The team spectext_videothought_leadership2026-07-09291520
Ashley StirrupA billion dollars. That's JPMorganChase's estimated value from experimentation and innovatext_videopodcast2026-07-08351400
Graham McNicollPMs ship experiment winners too early. A metric moves 3%, the test gets called, and the text_videothought_leadership2026-07-073511510
Ashley StirrupClaude Code turned weeks of data analysis into a few hours. Raunak Kumar at Fin (formerlytext_videopodcast2026-07-06650521
GrowthBookVibe experimentation is here. Testing a new hero or layout used to mean a design request,text_videoproduct_functionality2026-07-03299300
Ashley StirrupIf the idea sounds weak in plain English, don't run the experiment. Arun Bodapati at Twittext_videopodcast2026-07-03270200
Ashley StirrupUser research that once took three weeks now takes about two hours. Daniel Layfield at Diltext_videopodcast2026-07-03298410
Ashley StirrupThe biggest experiment wins usually aren't in the product at all. Nick Beyler from Stitchtext_videopodcast2026-07-021,1342401
Graham McNicollCS degree enrollment is dropping, and I do not blame the students. If I were eighteen ritext_videoindustry_commentary2026-07-027881040
GrowthBookYour agent can write the feature in 30 seconds. Shipping it safely is the part that keeps text_videomarketing_event2026-06-30255100
Ashley StirrupHow Disney goes from no idea what to test → 110 ranked ideas Crystal Ammari Iorio runs extext_videopodcast2026-06-305451413
Graham McNicollOne very large financial company, a name you would recognize, told me they were doing expetext_videothought_leadership2026-06-307131731
Ashley Stirrup"If a test is safe enough to let AI run the whole thing, why run it at all?" That line frtext_videopodcast2026-06-29414240
GrowthBookA team of four. 541 experiments in a year. A lot of them lost. Losing is expected. What text_videomarketing_event2026-06-269232222
Graham McNicollTeams routinely misunderstand averages in experimentation and what those averages are hiditext_videodata_science2026-06-256341321
Graham McNicollI see experimentation leads run two or three tests a month and feel like they have figuredtext_videothought_leadership2026-06-23406810
Graham McNicollI have been a software engineer long enough to have the grey hairs to show for it. Monoltext_videothought_leadership2026-06-189692130
Graham McNicollKilling a feature you spent months (or years) building is one of the hardest calls in prodtext_videothought_leadership2026-06-164751551
Graham McNicollEvery experimentation leader eventually runs into the result nobody expected. A counteritext_videothought_leadership2026-06-113671000
Graham McNicollMost engineering teams using feature flags treat them as circuit breakers. Something goes text_videothought_leadership2026-06-093331210
Ashley StirrupA two-point lift in close rate sounds like a rounding error. At Ford Credit, it's the numbtext_videopodcast2026-06-04573810
GrowthBookWhat if your AI coding tool could run your entire experiment workflow? Luke Sonnet (Head text_videoproduct_demo2026-06-032,5931101
Graham McNicollI spoke to an engineering manager last week whose team still tracks sprint progress in stotext_videothought_leadership2026-06-034691210
Ashley StirrupEveryone celebrates the winning test, but the losing ones are where the real money hides. text_videopodcast2026-06-02594940
Ashley StirrupDavid Massey, MFA just shared his secret success at UPS. Everyone thought his test was crtext_videopodcast2026-05-286691600
Ashley StirrupThe best experimentation teams celebrate the tests that fail. Why? Because a win confirmstext_videopodcast2026-05-269042231
Graham McNicollAmazon just held a mandatory meeting after vibe-coded changes caused multiple major outagetext_videoindustry_commentary2026-05-265972370
Graham McNicollMost product teams I talk to struggle to analyze the true impact of any feature they ship,text_videothought_leadership2026-05-20312900
GrowthBookFyxer retests experiments that failed last year. And they keep winning. This sounds countext_videopodcast2026-05-15476310
Ashley StirrupAndrew Willingham's career advice for product managers: stop being right. Stop walking intext_videopodcast2026-05-134531001
Ashley StirrupMost teams kill a failed experiment and never look at it again. Kameron Tanseli at @fyxertext_videopodcast2026-05-13281610
Graham McNicollMost engineering teams I talk to are still shipping every feature directly to production. text_videothought_leadership2026-05-131,3432021
Ashley StirrupDoorDash saved thousands of subscriptions per week. What was that experiment? Ilya Izraitext_videopodcast2026-05-127321911
Ashley StirrupHow does Fanatics generate hundreds of millions in growth from experimentation every year?text_videopodcast2026-05-119302730
Ashley StirrupUPS added a required email field to their shipping checkout. The outcome? Not good... Context_videopodcast2026-05-11530510
GrowthBookMost companies run experiments in a silo. The growth team knows what's working. The produtext_videocustomer_story2026-05-08277320
Ashley StirrupIs 1 year to choose an experimentation tool overkill? Khan Academy says no. Dr. Kelli Hiltext_videocustomer_story2026-05-07446720
Graham McNicollMost product teams spec out the entire feature before they've shipped a single line of codtext_videothought_leadership2026-05-062,2441820
Ashley StirrupMost companies run experiments in a silo. The growth team knows what's working. Nobody eltext_videopodcast2026-05-06348420
Ashley StirrupKhan Academy spent 3 years defining one metric. Because most AI teams have no idea what "gtext_videomarketing_event2026-05-05268420
Ashley StirrupIntuition is the most dangerous tool in gen AI. It could have cost Khan Academy their AI ttext_videomarketing_event2026-05-04317820
Graham McNicollA bug in our codebase accidentally set our paywall to zero. As a side effect, revenue jumptext_videopast_experience2026-05-011,0521000
GrowthBookYou spent weeks building the feature. Nobody used it. This happens more often than most text_videopodcast2026-05-01376210
Alyssa NicollWhat if your next #Angular app started with a single prompt? 🤯 In this demo, Alyssa Nitext_videoproduct_demo2026-04-30—1813
Ashley StirrupMost teams ship a feature and move on. Kameron Tanseli at @fyxerofficial does the opposittext_videopodcast2026-04-29466520
Graham McNicollAI coding tools are genuinely impressive. And this is literally the worst they will ever btext_videothought_leadership2026-04-296,3232210
Ashley StirrupWe thought Chess.com users wanted to review their losses. 80% were reviewing their wins. text_videopodcast2026-04-242,57935131
GrowthBookA growth loop that looked perfect on a whiteboard completely backfired. Fyxer has a schedtext_videopodcast2026-04-24333310
Graham McNicollWe spent three years building our own experimentation platform at education.com. Then we ftext_videopast_experience2026-04-231,7272502
Ashley StirrupNot every experiment that looks perfect on a whiteboard works in the real world. Kameron text_videopodcast2026-04-221,1781912
Graham McNicollIf you use 3rd party vendor, you are betting your infrastructure on someone else's board mtext_videoindustry_commentary2026-04-221,1231430
Ashley StirrupAt Ancestry, their goal is to make the past come to life. They used AI to do exactly that,text_videopodcast2026-04-171,3092520
Graham McNicollIt's entirely possible to run a test, see it win, ship the feature, and still damage your text_videothought_leadership2026-04-179521320
GrowthBookMost growth teams are waiting until they're "big enough" to experiment. They're falling ftext_videopodcast2026-04-17457410
Graham McNicollStartup life is mostly reactive. You're in the task, in the Slack thread, in the meeting. text_videosocial2026-04-159341930
Graham McNicollI see so many software teams launch massive features without actually defining what succestext_videothought_leadership2026-04-147411100
GrowthBookA simple UI change that sat in Bing’s backlog for months was worth over $120M in annual retext_videothought_leadership2026-04-13409400
Graham McNicollEngineer's who ship products without measuring them are making a big mistake. If you arentext_videothought_leadership2026-04-086321500
Ashley StirrupA 5-pixel change almost cost LinkedIn $10M a year. A designer adjusted the padding on thetext_videopodcast2026-04-068961421
Ashley StirrupHow do you grow from $1M to $35M ARR in a year? Not by running the usual handful of tests text_videopodcast2026-04-021,8064432
GrowthBookA designer at LinkedIn removed 5 pixels from an ad banner. No big deal, right? Revenue drtext_videopodcast2026-04-01595620
Graham McNicollI've watched design teams spend months on an interface that looked great, and was based ontext_videothought_leadership2026-04-016712221
GrowthBookBuilding a culture of experimentation is about creating a culture of humility, that learnstext_videoproduct_functionality2026-03-304771210
GrowthBookIf your team is shipping AI and algorithmic changes without an A/B test, you're flying blitext_videopodcast2026-03-27357510
GrowthBookUnit tests have one job: tell you if something is broken. AI apps just made that job impostext_videopodcast2026-03-26316310
Graham McNicollIn many companies, the projects we work on are the ones backed by the person who speaks thtext_videothought_leadership2026-03-261,3972841
Graham McNicollThe most important transition for a product team is learning how to be ruthless with ideastext_videothought_leadership2026-03-241,3332840
GrowthBookThe bottleneck used to be shipping. Now it's knowing what to keep. AI is putting more codtext_videopodcast2026-03-234421011
Graham McNicollJudging a product team solely on their ability to ship is a bad metric that rewards activitext_videothought_leadership2026-03-189243510
Alyssa NicollThis was such a fun episode I did with @edcharbeneau! I learned a lot about using planningtext_videoother2026-03-162500
Ashley StirrupHigh activity doesn't mean high quality. Sometimes it means the opposite. A user who refrtext_videopodcast2026-03-12206630
Graham McNicollI know it sounds controversial, but I advocate for burning your backlog at the end of evertext_videothought_leadership2026-03-121,7955670
Ashley Stirrup8+ out of 10 features your team ships will fail. That's not pessimism — it's data. The metext_videomarketing_event2026-03-1195410
Ashley StirrupMost ideas fail. Data shows the median organization has a success rate of only 10-15%. If text_videothought_leadership2026-03-1174200
Ashley StirrupAnyone can run an A/B test. Typeform decided that wasn't enough. On the latest Experimenttext_videopodcast2026-03-10145720
Graham McNicollIn baseball terms, the industry standard for any new product success is batting 200- and htext_videothought_leadership2026-03-101,4524910
Ashley StirrupA simple UI change was worth $120 million to Bing. The problem is, it's impossible to knotext_videomarketing_event2026-03-091,8381912