Posts

300 original posts (reposts excluded)

Source:All Ashley StirrupGrowthBookGraham McNicollAlyssa Nicoll
Sort:Most recentTop engagement
Channel:📰 Newsletter
SourcePostFormatTopicPublishedImpr.LikesCommentsShares
GrowthBookWe have a team at the Berlin Experimentation Meetup today, including Graham McNicoll, our text_carouselmarketing_event2026-10-15—2120
Ashley StirrupThis week’s edition brings together Dorothy Crepin at MilliporeSigma and Michal Lenik at Gtext_linkpodcast2026-10-15—401
GrowthBookWe’re at Snowflake World Tour NYC today! If you’re exploring how to measure the impact oftext_carouselmarketing_event2026-10-15—1401
Graham McNicollNobody should bench press 300 pounds their first day in the gym. The reason is obvious. Ytext_videothought_leadership2026-10-14—1510
Ashley StirrupThe one part of experimentation AI won't take over for a long time. Michael Mathews Jr (Fatext_videopodcast2026-10-13—910
Graham McNicollAverage tenure for product developers is about two years, which puts everything your team text_imagethought_leadership2026-10-12—700
Graham McNicollGave a talk on synthetic user A/B testing at MeasureCamp Berlin on Saturday. There was pletext_imagemarketing_event2026-10-11—4050
Graham McNicollThe return you report from experimentation is higher than the return you actually got. Thtext_imagedata_science2026-10-092181300
Alyssa NicollIs MCP the magic wand I’ve been waiting for? Because “please clean up my stale feature fltext_videoproduct_demo2026-10-092271624
GrowthBookWhat a lineup 🔥 Interleaving, agents, and a panel we’ve been looking forward to all monthtext_onlymarketing_event2026-10-09—700
GrowthBookOne week until Snowflake World Tour NYC. AI has made shipping new features easy. Today'stext_imagemarketing_event2026-10-0898100
Graham McNicollAll of AI right now is entirely reactive. You have to know what to ask before it can helptext_videothought_leadership2026-10-071951520
Ashley StirrupFifteen research interviews said one thing. The concept test said another. Michal Lenik (Gtext_videopodcast2026-10-07258901
GrowthBookClearing our calendars for this one 📅 Go see Hampus at Berlin Experimentation Meetup on text_onlymarketing_event2026-10-0747000
Ashley StirrupA small change to type ahead search drove double digit gains in add to cart. Dorothy Crepitext_videopodcast2026-10-06122430
GrowthBookMissed us at the The AI Conference? Here's the write-up behind the LLM traces handout we wtext_linkproduct_functionality2026-10-06287400
GrowthBook"We decided it was a better use of our time to get teams to run experiments, as opposed totext_imagecustomer_story2026-10-05227800
Graham McNicollWin rates across the industry sit around 20%, and I do not think AI is going to improve ontext_imagethought_leadership2026-10-053481330
Graham McNicollA year ago, most engineers wanted to see every line an AI wrote before it went near their text_imagethought_leadership2026-10-0213,83841133
GrowthBookReady for Day 2 of The AI Conference? We are! 🎉 We’re talking with teams shipping AI featext_carouselmarketing_event2026-10-013711512
GrowthBookDay 1 of The AI Conference starts today. Find us at booth 206 to see how teams ship AI featext_carouselmarketing_event2026-09-304131811
Graham McNicollArtificial intelligence helps you feel artificially intelligent. It is almost as if it watext_videothought_leadership2026-09-303422020
Ashley Stirrup$180 million in one year. Half the story is what they did not ship. Gaurav Sethi (PayPal) text_videopodcast2026-09-30214911
Ashley StirrupThe AI worked. Users quit anyway. Ashraf Karim (ServiceNow) on the biggest learning from ltext_videopodcast2026-09-291,1313223
Ashley StirrupOne team runs roughly tests a month, the other ran 1,500 a year. Both stopped keeping scortext_linkpodcast2026-09-29271900
Alyssa NicollOur GrowthBook 5.1 Office Hours recording is up, here is my recap version but check out thtext_videoproduct_functionality2026-09-292721201
Graham McNicollWhen an experiment fails, there should be a discussion about if the idea was bad or if it text_imagethought_leadership2026-09-28231910
Ashley StirrupSometimes the p-value is never coming. Wanli Lau (Twilio) on experimentation when your custext_videopodcast2026-09-28139400
Graham McNicollA couple of years ago, the first AI tool I used was Copilot. We saw 20 to 30 percent improtext_imagethought_leadership2026-09-254781620
Ashley StirrupStop worrying about losing tests. Will Guyeskey (GoPro): do not fear a loser, do not fear text_videopodcast2026-09-255283361
GrowthBookThat's a wrap on Product-Led Summit. Teams are shipping faster than ever with agents writtext_carouselmarketing_event2026-09-234221210
Ashley StirrupFrom last week's podcast episodes I learned a common lesson: A result only makes sense onctext_linkpodcast2026-09-237641111
Graham McNicollBuilding a feature now costs almost nothing, which turns out to be the problem. When you text_videothought_leadership2026-09-232941000
GrowthBookDay 1 of Product-Led Alliance Summit kicks off today in San Francisco. Just in time for ttext_imagemarketing_event2026-09-227333001
Alyssa NicollLove the updates we released, yesterday. If you are into experimentation (or would like totext_onlyproduct_functionality2026-09-2252200
GrowthBookOne week until The AI Conference! If you're going, come by booth 206. We'll be running litext_imagemarketing_event2026-09-21202200
Graham McNicollHiring has always been the most critical part of building a company, and it takes a thoughtext_imagethought_leadership2026-09-18526920
Ashley StirrupHow do you keep every one pointed at the same North Star? This week’s Experimentation Edgtext_linkpodcast2026-09-176621531
Graham McNicollToken costs are exploding across our industry. Every week there is another story about ctext_onlypast_experience2026-09-175241030
Ashley StirrupB2C testing is more mature and more rigorous. Anuradha Tempe, MBA, MS of Samsung on borrowtext_videopodcast2026-09-17180400
GrowthBookIf you have two ranking algorithms and not enough traffic to tell them apart, an A/B test text_onlymarketing_event2026-09-17242711
GrowthBookOne week out from Product-Led Summit, and we’re asking you to bring us your worst launch stext_imagemarketing_event2026-09-16215500
Graham McNicollI cannot look at 100 experiments and tell you what they have in common. That is the probltext_videoproduct_functionality2026-09-15270920
GrowthBookMost experimentation tools ask you to ship your data to them. If you already run Snowflaketext_imagemarketing_event2026-09-14196100
Graham McNicollThink about how many layers sit between you and an actual user. User research tells you text_onlythought_leadership2026-09-11346710
Ashley StirrupA 300% attach rate, and the test still lost money. Whitney Perez of Realtor.com breaks dowtext_videopodcast2026-09-10221410
Ashley StirrupEngineers as the champions of experimentation? Rich Liebling of Learneo on the culture at text_videopodcast2026-09-09221510
GrowthBookMeasureCamp Chicago is almost one week away! 🙌 The agenda doesn't exist yet. It gets butext_imagemarketing_event2026-09-09212000
Ashley StirrupHow do you A/B test something that has 300 million monthly players constantly clicking? Ttext_linkpodcast2026-09-099421211
Graham McNicollIf you work inside an experimentation program, you have probably noticed that leadership stext_imagethought_leadership2026-09-094112230
Graham McNicollMost product teams use evals to figure out if their AI tools or products are working corretext_videothought_leadership2026-09-084681940
GrowthBookFeature flags, experimentation, and product analytics usually live in three separate toolstext_imageproduct_demo2026-09-04239200
Graham McNicollDesigners and engineers get attached to their work. It makes sense; you spent real effort text_imagethought_leadership2026-09-04428900
GrowthBookRunning hundreds of experiments at a time is the dream of many teams, but it makes patterntext_videoproduct_demo2026-09-033811120
Ashley StirrupA test without a specific falsifiable hypothesis is just a fishing expedition. Priya Singhtext_videopodcast2026-09-03194620
Graham McNicollThere's always been a tension between marketing teams and engineering teams. Engineeringtext_videoproduct_functionality2026-09-02267910
GrowthBookEvery booth at The AI Conference is going to tell you to move at AI speed. None of them witext_imagemarketing_event2026-09-02206711
Graham McNicollEvery experiment you run produces a piece of knowledge about your users. Run a few hundrtext_onlythought_leadership2026-09-015081230
Ashley StirrupJobLeads grew its testing velocity 10x in under 2 years. Clover has been well established text_linkpodcast2026-09-011,8471400
Ashley StirrupExperiment analysis used to be restricted to data analysts and product managers with expertext_videopodcast2026-09-01219200
GrowthBookThank you to our Gold Sponsor, GrowthBook! GrowthBook is the leading warehouse-native extext_imagemarketing_event2026-09-01—702
Ashley StirrupNot everything deserves an experiment. Ben Schein of Clover on The Experimentation Edge: utext_videopodcast2026-08-31154300
Graham McNicollWhen I talk to product teams lately, a strange thing keeps coming up. A large share of ttext_imagethought_leadership2026-08-283991500
Ashley StirrupThe research said it couldn't miss: 50% returning customers, the same order every week, ustext_videopodcast2026-08-28251700
Ashley StirrupWhy would Principal Financial Group A/B test on customers who don't exist? The new edititext_linkpodcast2026-08-27798300
GrowthBookAfter hundreds of experiments, what does your team actually know? They probably don’t remtext_imageproduct_functionality2026-08-27317510
Graham McNicollWhen was the last time you saw innovation from a public company? Honestly, from my experitext_videoindustry_commentary2026-08-275031621
GrowthBookYour roadmap shows what will ship. It doesn’t show what will work. We're at booth 22 at text_imagemarketing_event2026-08-26223600
Graham McNicollI talk to a lot of teams who are proud of how much they experiment. A company you would text_onlythought_leadership2026-08-259401620
Graham McNicollAI has made it ridiculously easy to build and ship features. The problem is that AI doesn'text_videothought_leadership2026-08-204681412
GrowthBookMeasureCamp Chicago is a free unconference. Sessions are submitted the morning of, so the text_imagemarketing_event2026-08-19448403
Graham McNicollI do not love the word governance. It is boring. Nobody gets excited buying a governance stext_imageproduct_functionality2026-08-194021620
Ashley StirrupA mistake where over 1,000,000 people could see is terrifying... So how do you avoid a catext_linkpodcast2026-08-187021001
GrowthBookWhen teams like marketing and product test in separate silos, they miss the experiments thtext_imagemarketing_event2026-08-18540701
Alyssa NicollThere was a point in my career where I traveled roughly 75% of the year. All to speak and text_imagemarketing_event2026-08-181,46416120
Graham McNicollA lot of engineering teams have feature flags to control the release of features and act atext_videothought_leadership2026-08-18310910
Graham McNicollIt's really hard when you really believed in feature, you managed to get it prioritized, ytext_videothought_leadership2026-08-133331530
Graham McNicollI cannot look at a hundred experiments and tell you what they have in common. Nobody can. text_imageproduct_functionality2026-08-127251600
GrowthBookWe'll be at hanging out at booth 206, talking feature flags, experimentation, and product text_imagemarketing_event2026-08-11306410
Ashley StirrupOn the latest episode of The Experimentation Edge, Vijay L. made the case for how to improtext_imagepodcast2026-08-114471111
Graham McNicollFrom my experience, experimentation programs don't get killed off in a meeting because peotext_videothought_leadership2026-08-112991020
Ashley StirrupThe strongest experimentation cultures I've seen are built on ceremonies. Luis Trindade, text_videopodcast2026-08-06396500
Graham McNicollWe make it stupidly easy to run experiments. Whether you're a back-end engineer, a front-etext_videoproduct_functionality2026-08-064471001
Ashley Stirrup🚨 NEWSLETTER RELEASE 🚨 This edition breaks down how each team built a program where evtext_linkpodcast2026-08-051,2301710
Ashley StirrupMarketing, product, and the newsroom at the Philadelphia Inquirer all collaboratively run text_imagemarketing_event2026-08-05320720
Graham McNicollThe average engineer stays at a company about two years. I don't blame anyone for that. text_linkthought_leadership2026-08-051,1992000
Graham McNicollToken costs are exploding across our industry. Here's how we approach it. I definitely betext_videothought_leadership2026-08-043231020
Alyssa NicollCould not agree more! Sam was an incredible project manager. 🙌 Loved working with her at text_onlysocial2026-08-0496200
Alyssa NicollGrowthBook 5.0 was one of our biggest releases ever! Missed the launch? You can watch our text_linkproduct_functionality2026-08-04200500
Ashley StirrupWhat Fyxer, Ancestry, and Chess.com shows that all you need is 25%... Three companies at text_linkpodcast2026-07-302,0262220
Graham McNicollWhen we rebuilt product analytics for 5.0, we started with a question I could not shake. Wtext_imageproduct_functionality2026-07-302881711
Graham McNicollOne of the things we tell a lot of our customers is that it's the number of at-bats that wtext_videothought_leadership2026-07-29342720
Ashley StirrupThe whole team GrowthBook is so excited to see Khan Academy win this award. I really thintext_onlyother2026-07-286752150
Graham McNicollWe don't have product managers at GrowthBook. That is deliberate... One reason is ownerstext_imagethought_leadership2026-07-286891630
GrowthBookMost experimentation programs stay stuck with one team, which caps how far impact can go. text_imagemarketing_event2026-07-28410601
Graham McNicollFor years I chased my team for experiment write-ups after the fact. It never worked, and text_linkthought_leadership2026-07-241,4531610
GrowthBookHow many experiments did you not run this week because setup felt like too much work or cotext_imageproduct_functionality2026-07-241,0341321
Alyssa NicollGovernance is important. (At least llama thinks so 😉) Governance is also a word that cantext_videoproduct_functionality2026-07-23438971
GrowthBookFeature flag governance can sound like adding more rules, more approvals, and more chancestext_imageproduct_functionality2026-07-234751020
Graham McNicollWe ran an internal contest at GrowthBook a while back. The setup was simple. Anyone on thetext_imageproduct_functionality2026-07-237551700
Ashley StirrupB2C: "It's black, it fits my apartment, it makes hot water for my tea. I love it." B2B: "text_videopodcast2026-07-234721211
Ashley StirrupFanatics, UPS, and DoorDash all prove the same thing about testing. The new edition of Thtext_linkpodcast2026-07-222,0502910
Graham McNicollTeams have no shortage of ideas, but implementing them is where teams hit roadblocks. Stext_videoproduct_functionality2026-07-221,1802571
GrowthBook5.0 Launch Week Day 3️⃣: Product Analytics GA If you're already running experiments in Grtext_imageproduct_functionality2026-07-226961012
GrowthBookWe gave the GrowthBook team a simple challenge: Use the Visual Editor to redesign our hotext_carouselpast_experience2026-07-21423800
Ashley StirrupYou can run a thousand experiments, but there's one big question your business has to undetext_videopodcast2026-07-211,6871320
Graham McNicollIf you have ever seen a kid use an iPad, you have watched a perfect UX. A child seeing itext_imagethought_leadership2026-07-21974510
GrowthBook5.0 Launch Week Day 2️⃣: AI Visual Editor Growth and marketing teams run into the same prtext_imageproduct_functionality2026-07-214141001
GrowthBook5.0 Launch Week Day 2️⃣: AI Visual Editor Growth and marketing teams run into the same prtext_onlyproduct_functionality2026-07-21—400
GrowthBookGrowthBook 5.0 launch week: Today, agents 🙌 Companies don’t win with development speed text_imageproduct_functionality2026-07-209492124
Ashley StirrupGetting numbers is easy. Getting numbers you can trust is hard. We hosted Ron Kohavi (co-text_imagethought_leadership2026-07-173,6464681
GrowthBookHuge congratulations to everyone recognized in the Experimentation Culture Awards! 🎉 It'text_onlyother2026-07-16441800
Ashley StirrupCongratulations to all of the Experimentation Culture Awards finalists. Everyone had suchtext_imageother2026-07-161,2134141
Ashley StirrupI interviewed three experimentation leaders from three industries that could not be more dtext_linkpodcast2026-07-161,4761910
Ashley StirrupIt's almost showtime! Crossing my fingers for 3 of the finalists that are all using Growttext_onlyother2026-07-16—300
Ashley StirrupA C-suite exec walked in and said "we need video chat." Amazon Fire had just launched thetext_videopodcast2026-07-16448500
Graham McNicollMost companies ship the first version of the product they build. And the chance that's thetext_videothought_leadership2026-07-166541740
Alyssa NicollBeyond the Front End Field Notes — Day 6 Today’s field note is about CUPED. "Which leavetext_imagedata_science2026-07-16136410
Ashley StirrupCongratulations to Khan Academy, Kelli H., Tushar Udeshi and the entire Khanmigo team. Khtext_imageother2026-07-15—1400
Ashley StirrupThe Home Depot does $150 billion a year as an enterprise. The online org alone just passetext_videopodcast2026-07-15451600
Graham McNicollThere's a level of excitement teams get when the product just works and they're not fightitext_videoproduct_functionality2026-07-15404820
Ashley StirrupThere's a difference between a bad result and a bad experiment. James A. Falzone, Directotext_videopodcast2026-07-141,2081430
GrowthBookA prompt is a suggestion. A skill is a procedure. When you type "create a feature flag" itext_imageproduct_functionality2026-07-14346400
Alyssa NicollBeyond the Front End Field Notes — Day 5 "I think what I’m trying to say is: it feels reatext_imagesocial2026-07-142471500
Graham McNicollAsk any product manager what they hate most about their job, and the answer is rarely the text_onlythought_leadership2026-07-149882110
GrowthBookCongrats to three GrowthBook customers nominated for this year’s Experimentation Culture Atext_linkother2026-07-138101402
Alyssa NicollI love when my dev tools start talking to each other. Not in a scary “the toaster has opitext_imageproduct_functionality2026-07-13186500
Alyssa NicollBeyond the Front End Field Notes — Day 3 Yesterday I learned about ramp schedules. A ramtext_imageproduct_functionality2026-07-10174610
Ashley StirrupYour best feature might be hiding in the wrong place. Danielle Olean, Director of eCommertext_videopodcast2026-07-09243000
Graham McNicollMost product teams build features the expensive way. Someone has the idea. The team spectext_videothought_leadership2026-07-09291520
Graham McNicollIf your finance team is currently drafting a memo about capping engineering AI spend, I amtext_imagethought_leadership2026-07-08371420
Ashley StirrupI interviewed five experimentation leaders in one week and compiled the most important fintext_linkpodcast2026-07-081,8742122
Ashley StirrupA billion dollars. That's JPMorganChase's estimated value from experimentation and innovatext_videopodcast2026-07-08351400
Alyssa NicollBeyond the Front End Field Notes — Day 2 Yesterday I learned that a bandit is not a variatext_imagedata_science2026-07-08188700
GrowthBookA "winning" test can still be wrong. If your team runs experiments at any scale, you’ll wtext_imagemarketing_event2026-07-08355601
Ashley StirrupThere may be a goldmine of growth hidden in your last experiment. Most teams read a test text_documentdata_science2026-07-071,4481431
Graham McNicollPMs ship experiment winners too early. A metric moves 3%, the test gets called, and the text_videothought_leadership2026-07-073511510
GrowthBookYour A/B test won, but is it actually trustworthy? 🤔 Ron Kohavi has audited thousands otext_onlymarketing_event2026-07-078761507
Ashley StirrupClaude Code turned weeks of data analysis into a few hours. Raunak Kumar at Fin (formerlytext_videopodcast2026-07-06650521
GrowthBookVibe experimentation is here. Testing a new hero or layout used to mean a design request,text_videoproduct_functionality2026-07-03299300
Ashley StirrupIf the idea sounds weak in plain English, don't run the experiment. Arun Bodapati at Twittext_videopodcast2026-07-03270200
Ashley StirrupUser research that once took three weeks now takes about two hours. Daniel Layfield at Diltext_videopodcast2026-07-03298410
Ashley StirrupThe biggest experiment wins usually aren't in the product at all. Nick Beyler from Stitchtext_videopodcast2026-07-021,1342401
Ashley StirrupI asked five experimentation leaders the same two questions. Their answers were almost idetext_linkpodcast2026-07-021,3822123
GrowthBookLast day at AI Engineer World's Fair, and the socks are going fast. If we haven't met yettext_imagemarketing_event2026-07-02242100
Graham McNicollCS degree enrollment is dropping, and I do not blame the students. If I were eighteen ritext_videoindustry_commentary2026-07-027881040
Graham McNicollIf your team already has feature flags wired into production, you can run painted door testext_imagethought_leadership2026-07-016951110
GrowthBookYour agent can write the feature in 30 seconds. Shipping it safely is the part that keeps text_videomarketing_event2026-06-30255100
Ashley StirrupHow Disney goes from no idea what to test → 110 ranked ideas Crystal Ammari Iorio runs extext_videopodcast2026-06-305451413
Graham McNicollOne very large financial company, a name you would recognize, told me they were doing expetext_videothought_leadership2026-06-307131731
GrowthBookWe made it to AI Engineer World's Fair, we’re here at booth S26. Here's what we're showintext_imagemarketing_event2026-06-292481400
Ashley Stirrup"If a test is safe enough to let AI run the whole thing, why run it at all?" That line frtext_videopodcast2026-06-29414240
Ashley StirrupPeople with smaller palms live longer. That's a real correlation. Statistically significatext_imagethought_leadership2026-06-291,5291510
Ashley StirrupMost people think A/B testing is for button colors and SaaS onboarding flows. TodayTix istext_carouselcustomer_story2026-06-264511450
GrowthBookA team of four. 541 experiments in a year. A lot of them lost. Losing is expected. What text_videomarketing_event2026-06-269232222
Ashley StirrupAttention everyone! The Experimentation Edge newsletter is getting an upgrade, and it's mtext_onlypodcast2026-06-255821700
GrowthBookMany "winning" A/B tests aren't actually wins. They're results that cross a threshold withtext_imagemarketing_event2026-06-259332815
Graham McNicollTeams routinely misunderstand averages in experimentation and what those averages are hiditext_videodata_science2026-06-256341321
GrowthBookMost teams say they experiment. Few make it a daily habit. Oda did it by ditching their htext_carouselcustomer_story2026-06-24325410
Graham McNicollA Hacker News thread a while ago argued that A/B testing is unethical. I believe their fratext_imagethought_leadership2026-06-24567620
Graham McNicollI see experimentation leads run two or three tests a month and feel like they have figuredtext_videothought_leadership2026-06-23406810
GrowthBookOne week until AI Engineer World's Fair. We'll be at booth S26 all four days, June 29 to text_imagemarketing_event2026-06-22330600
GrowthBookEarly access to GrowthBook's ✨NEW AI Visual Editor✨ launches Monday, June 22. Cloud accoutext_imageproduct_functionality2026-06-184251000
Ashley Stirrup15 value-driven experiments beat 40 button-color ones. That's the shift Craig Kistler madtext_carouselpodcast2026-06-186291942
Graham McNicollI have been a software engineer long enough to have the grey hairs to show for it. Monoltext_videothought_leadership2026-06-189692130
Alyssa NicollI’m very excited to share that I’ve joined GrowthBook as a Developer Advocate! This next text_onlysocial2026-06-178014752
GrowthBookAre you shipping AI features safely? Most teams can ship fast now. Fewer can tell you whatext_imagemarketing_event2026-06-17335401
Graham McNicollIf you are an engineering leader at a growth-stage company currently maintaining your own text_imagecustomer_story2026-06-175221420
Ashley StirrupAccuracy measures the test set. It doesn't measure trust. I had Mayank Agarwal (Director text_carouselpodcast2026-06-168072203
GrowthBookLast year, Fyxer ran 541 experiments and grew from $1M to $35M in ARR. 🤯 They treated etext_linkmarketing_event2026-06-16399600
Graham McNicollKilling a feature you spent months (or years) building is one of the hardest calls in prodtext_videothought_leadership2026-06-164751551
Graham McNicollIf your experimentation stack is Statsig, the last few months have probably been confusingtext_onlyindustry_commentary2026-06-123,4034833
Graham McNicollEvery experimentation leader eventually runs into the result nobody expected. A counteritext_videothought_leadership2026-06-113671000
Graham McNicollI spoke to an engineering lead last week whose team still tracks progress in story points.text_imagethought_leadership2026-06-10474710
GrowthBookAI coding tools have made shipping features the easy part. The hard part is releasing safetext_imagemarketing_event2026-06-09518701
Graham McNicollMost engineering teams using feature flags treat them as circuit breakers. Something goes text_videothought_leadership2026-06-093331210
Graham McNicollProduct development is forever changed, and the pace of the change is incredible. We've setext_onlyproduct_functionality2026-06-086992730
Graham McNicollThree years into building our own experimentation platform at my last company, we found a text_imagepast_experience2026-06-053,6655351
Ashley StirrupA two-point lift in close rate sounds like a rounding error. At Ford Credit, it's the numbtext_videopodcast2026-06-04573810
GrowthBookMany teams aspire to scale their experimentation program to learn fast and iterate constantext_onlymarketing_event2026-06-043,2371802
GrowthBookWhat if your AI coding tool could run your entire experiment workflow? Luke Sonnet (Head text_videoproduct_demo2026-06-032,5931101
Graham McNicollI spoke to an engineering manager last week whose team still tracks sprint progress in stotext_videothought_leadership2026-06-034691210
Ashley StirrupEveryone celebrates the winning test, but the losing ones are where the real money hides. text_videopodcast2026-06-02594940
Graham McNicollMy head of Experimentation named our product development framework after Jon Hamm. I chosetext_imagethought_leadership2026-06-029673150
Graham McNicollWe had a dashboard for every metric at my last company. What we did not have was a way to text_imagepast_experience2026-05-29620940
Ashley StirrupDavid Massey, MFA just shared his secret success at UPS. Everyone thought his test was crtext_videopodcast2026-05-286691600
GrowthBook🚀After 426 pull requests and 351,114 lines of code, GrowthBook 4.4 is here! This is our text_imageproduct_functionality2026-05-276,38636213
Ashley StirrupThe best experimentation teams celebrate the tests that fail. Why? Because a win confirmstext_videopodcast2026-05-269042231
Ashley StirrupDon’t confuse shipping with winning. Microsoft figured this out in 2014. For decades, thetext_imagethought_leadership2026-05-267761401
Graham McNicollAmazon just held a mandatory meeting after vibe-coded changes caused multiple major outagetext_videoindustry_commentary2026-05-265972370
Graham McNicollI have watched a deploy take down products complete because there was no flag in place to text_imagethought_leadership2026-05-22478901
Ashley StirrupThe GrowthBook team just got back from Hawaii! We're a team spread across the globe, and text_imagesocial2026-05-218,13110856
Graham McNicollMost product teams I talk to struggle to analyze the true impact of any feature they ship,text_videothought_leadership2026-05-20312900
GrowthBook4 engineers. 360 experiments. One year. That's Fyxer's growth engineering team, which heltext_linkpodcast2026-05-193,6951402
Graham McNicollAt education.com, we ran thousands of experiments. Roughly a third won. The ones that losttext_imagepast_experience2026-05-193511410
Ashley StirrupKhan Academy was one of the first companies to develop with the OpenAI models. This NYT sttext_linkmarketing_event2026-05-181,1022230
GrowthBookNew edition of The Experimentation Edge: Chess.com runs 400 experiments a year for a user text_linkpodcast2026-05-182,273801
GrowthBookExperimentation drives ~8% of annual growth at Fanatics. On a $3B business, that's hundretext_linkpodcast2026-05-15539500
GrowthBookFyxer retests experiments that failed last year. And they keep winning. This sounds countext_videopodcast2026-05-15476310
Graham McNicollA bug in our code accidentally set our paywall to zero. Revenue jumped 30%. Usually whetext_imagepast_experience2026-05-151,4461510
Graham McNicollI saw the Amazon report. Four major outages in one week from AI-assisted code changes. Thetext_imageindustry_commentary2026-05-141,6881500
GrowthBookHow to shift your PM mindset to think more like an executive. That's the latest edition otext_linkpodcast2026-05-13968720
Ashley StirrupAndrew Willingham's career advice for product managers: stop being right. Stop walking intext_videopodcast2026-05-134531001
Ashley StirrupMost teams kill a failed experiment and never look at it again. Kameron Tanseli at @fyxertext_videopodcast2026-05-13281610
Graham McNicollMost engineering teams I talk to are still shipping every feature directly to production. text_videothought_leadership2026-05-131,3432021
GrowthBookRunning 300 million feature flag evaluations per second sounds like an engineering flex. text_linkpodcast2026-05-12434810
Ashley StirrupDoorDash saved thousands of subscriptions per week. What was that experiment? Ilya Izraitext_videopodcast2026-05-127321911
Graham McNicollMost product teams I talk to know how to run an experiment. They have the tooling, a primatext_imagethought_leadership2026-05-129871200
Ashley StirrupHow does Fanatics generate hundreds of millions in growth from experimentation every year?text_videopodcast2026-05-119302730
GrowthBookUPS's Journey Experience and Design Innovation (nicknamed J.E.D.I.) team generated $500M+ text_linkpodcast2026-05-11339710
Ashley StirrupUPS added a required email field to their shipping checkout. The outcome? Not good... Context_videopodcast2026-05-11530510
Graham McNicollI have sat in spec reviews where the Jira tickets were written, the designs were finished,text_imagethought_leadership2026-05-081,0251010
GrowthBookMost companies run experiments in a silo. The growth team knows what's working. The produtext_videocustomer_story2026-05-08277320
Ashley StirrupIs 1 year to choose an experimentation tool overkill? Khan Academy says no. Dr. Kelli Hiltext_videocustomer_story2026-05-07446720
Graham McNicollAmazon got a mandatory meeting. Most engineering orgs will get a quieter version of the satext_imageindustry_commentary2026-05-071,005810
Graham McNicollMost product teams spec out the entire feature before they've shipped a single line of codtext_videothought_leadership2026-05-062,2441820
Ashley StirrupMost companies run experiments in a silo. The growth team knows what's working. Nobody eltext_videopodcast2026-05-06348420
Ashley StirrupKhan Academy spent 3 years defining one metric. Because most AI teams have no idea what "gtext_videomarketing_event2026-05-05268420
Graham McNicollMost Engineers I know are supervising agents now, not writing the code. Features that tootext_imagethought_leadership2026-05-055,3392731
Ashley StirrupIntuition is the most dangerous tool in gen AI. It could have cost Khan Academy their AI ttext_videomarketing_event2026-05-04317820
Graham McNicollA bug in our codebase accidentally set our paywall to zero. As a side effect, revenue jumptext_videopast_experience2026-05-011,0521000
GrowthBookYou spent weeks building the feature. Nobody used it. This happens more often than most text_videopodcast2026-05-01376210
Alyssa NicollWhat if your next #Angular app started with a single prompt? 🤯 In this demo, Alyssa Nitext_videoproduct_demo2026-04-30—1813
Graham McNicollI spent years seeing product decisions based on gut feel. At education.com, we would spetext_onlypast_experience2026-04-301,8732640
Ashley StirrupMost teams ship a feature and move on. Kameron Tanseli at @fyxerofficial does the opposittext_videopodcast2026-04-29466520
Graham McNicollAI coding tools are genuinely impressive. And this is literally the worst they will ever btext_videothought_leadership2026-04-296,3232210
Graham McNicollI once sat in a meeting that ran for an hour debating which shade of green to use for a butext_imagepast_experience2026-04-281,6161250
Ashley StirrupWe thought Chess.com users wanted to review their losses. 80% were reviewing their wins. text_videopodcast2026-04-242,57935131
Graham McNicollIf you could onlypick one for your experimentation program, which would you rather have? text_onlythought_leadership2026-04-241,676450
GrowthBookA growth loop that looked perfect on a whiteboard completely backfired. Fyxer has a schedtext_videopodcast2026-04-24333310
Graham McNicollWe spent three years building our own experimentation platform at education.com. Then we ftext_videopast_experience2026-04-231,7272502
Ashley StirrupNot every experiment that looks perfect on a whiteboard works in the real world. Kameron text_videopodcast2026-04-221,1781912
Graham McNicollIf you use 3rd party vendor, you are betting your infrastructure on someone else's board mtext_videoindustry_commentary2026-04-221,1231430
Graham McNicollSoftware teams get measured on delivery speed. It's an easy thing to track, it fits neatlytext_imagethought_leadership2026-04-216571110
Ashley StirrupAt Ancestry, their goal is to make the past come to life. They used AI to do exactly that,text_videopodcast2026-04-171,3092520
Alyssa NicollLIVE NOW 🔴 Talking agentic UIs in Angular with @ManfredSteyer — where AI starts driving text_linkother2026-04-177300
Graham McNicollIt's entirely possible to run a test, see it win, ship the feature, and still damage your text_videothought_leadership2026-04-179521320
GrowthBookMost growth teams are waiting until they're "big enough" to experiment. They're falling ftext_videopodcast2026-04-17457410
Graham McNicollMany "data-driven" companies are practicing sophisticated guessing. They have the dashbotext_onlythought_leadership2026-04-169681430
Graham McNicollStartup life is mostly reactive. You're in the task, in the Slack thread, in the meeting. text_videosocial2026-04-159341930
Graham McNicollI see so many software teams launch massive features without actually defining what succestext_videothought_leadership2026-04-147411100
GrowthBookHave you seen how Khan Academy created an AI tutor? This edtech innovator is once again attext_imagemarketing_event2026-04-132,53746110
GrowthBookA simple UI change that sat in Bing’s backlog for months was worth over $120M in annual retext_videothought_leadership2026-04-13409400
Alyssa NicollThis week on Angular Air 👀 Manfred Steyer joins us to explore agentic UIs in Angular — atext_linkother2026-04-137801
Ashley StirrupKhan Academy gave their AI tutor a calculator to improve math accuracy. It worked, but it text_linkmarketing_event2026-04-091,2142730
Graham McNicollBuilding your own experimentation stack is a fun engineering challenge until the day it istext_imagepast_experience2026-04-091,4052201
Graham McNicollEngineer's who ship products without measuring them are making a big mistake. If you arentext_videothought_leadership2026-04-086321500
Graham McNicollProduct teams obsess over whether they shipped on time. It's a reasonable thing to track. text_imagethought_leadership2026-04-07—810
Ashley StirrupAI just killed the two biggest excuses for not experimenting. "We don't have enough engintext_imagecustomer_story2026-04-076,9245853
Ashley StirrupA 5-pixel change almost cost LinkedIn $10M a year. A designer adjusted the padding on thetext_videopodcast2026-04-068961421
Ashley StirrupHow do you grow from $1M to $35M ARR in a year? Not by running the usual handful of tests text_videopodcast2026-04-021,8064432
Alyssa NicollAI didn’t just change how we write code – it changed how we build products. 👷 Join Alysstext_imagemarketing_event2026-04-02—511
Graham McNicollMost companies think choosing an experimentation vendor comes down to feature lists and UItext_imagethought_leadership2026-04-022,2672520
GrowthBookA designer at LinkedIn removed 5 pixels from an ad banner. No big deal, right? Revenue drtext_videopodcast2026-04-01595620
Graham McNicollI've watched design teams spend months on an interface that looked great, and was based ontext_videothought_leadership2026-04-016712221
GrowthBookExperimentation at scale is hard. TOOM made it systematic. By replacing manual analysis wtext_carouselcustomer_story2026-03-31398110
Graham McNicollEven the best product people on Earth have a surprisingly low batting average. In basebaltext_imagethought_leadership2026-03-319641910
Alyssa NicollI used the angular MCP server to validate that I was using their suggested best practices text_linkother2026-03-3121011
GrowthBookBuilding a culture of experimentation is about creating a culture of humility, that learnstext_videoproduct_functionality2026-03-304771210
GrowthBookIf your team is shipping AI and algorithmic changes without an A/B test, you're flying blitext_videopodcast2026-03-27357510
GrowthBookKhan Academy built one of the most thoughtful experimentation programs in education. Privatext_carouselmarketing_event2026-03-27437611
Alyssa Nicoll🔴 LIVE NOW — Back to the Basics continues! We’re diving into AI-assisted i18n workflows text_imagemarketing_event2026-03-27—100
GrowthBookUnit tests have one job: tell you if something is broken. AI apps just made that job impostext_videopodcast2026-03-26316310
Graham McNicollIn many companies, the projects we work on are the ones backed by the person who speaks thtext_videothought_leadership2026-03-261,3972841
GrowthBookKhan Academy gave their AI tutor a calculator to improve math accuracy. It worked, but it text_linkmarketing_event2026-03-241,0411010
Graham McNicollThe most important transition for a product team is learning how to be ruthless with ideastext_videothought_leadership2026-03-241,3332840
GrowthBookThe bottleneck used to be shipping. Now it's knowing what to keep. AI is putting more codtext_videopodcast2026-03-234421011
Graham McNicollWe once had a design team spend months redoing our onboarding flow. They did everything rtext_imagepast_experience2026-03-2083,977161238
Ashley StirrupYour metrics are green. Your customers are leaving. Ron Kohavi calls these "watermelon metext_imagethought_leadership2026-03-194,75796144
GrowthBookWe are thrilled to have Kelli H., senior director of data insights from Khan Academy, on otext_onlymarketing_event2026-03-18151200
GrowthBookMost experimentation programs start the same way. A few A/B tests. Some promising resultstext_onlymarketing_event2026-03-18580712
Graham McNicollJudging a product team solely on their ability to ship is a bad metric that rewards activitext_videothought_leadership2026-03-189243510
Alyssa NicollAngular has had Template Forms and Reactive Forms for years. Both work well… but neither text_linkother2026-03-171410
GrowthBookThis is a great way for any e-commerce experimenter to learn and work with industry leadertext_onlymarketing_event2026-03-17699410
Ashley StirrupCalling e-commerce experimentation companies! Get free expert guidance from Ron Kohavi, Ltext_imagemarketing_event2026-03-171,3062015
Graham McNicollOpenAI bought Statsig for $1.1B in stock. Before that, Datadog swallowed Eppo. For a CTO,text_imageindustry_commentary2026-03-162,4764321
Alyssa NicollThis was such a fun episode I did with @edcharbeneau! I learned a lot about using planningtext_videoother2026-03-162500
Ashley StirrupFriends don't let their product managers use bad reality distortion. Steve Jobs had a famtext_imagethought_leadership2026-03-161,218810
Alyssa NicollPart two, round one of the Mad CSS bracket tournament just dropped this morning. Who says text_linkother2026-03-132220
Ashley StirrupHigh activity doesn't mean high quality. Sometimes it means the opposite. A user who refrtext_videopodcast2026-03-12206630
Graham McNicollI know it sounds controversial, but I advocate for burning your backlog at the end of evertext_videothought_leadership2026-03-121,7955670
Ashley Stirrup8+ out of 10 features your team ships will fail. That's not pessimism — it's data. The metext_videomarketing_event2026-03-1195410
Ashley StirrupMost ideas fail. Data shows the median organization has a success rate of only 10-15%. If text_videothought_leadership2026-03-1174200
GrowthBookIt’s one thing to run an experiment. It’s another to operationalize experimentation at sctext_carouselcustomer_story2026-03-10454711
Alyssa NicollInternational Women’s Day always makes me pause and reflect on the women who have shaped mtext_onlysocial2026-03-101200
Ashley StirrupAnyone can run an A/B test. Typeform decided that wasn't enough. On the latest Experimenttext_videopodcast2026-03-10145720
Graham McNicollIn baseball terms, the industry standard for any new product success is batting 200- and htext_videothought_leadership2026-03-101,4524910
GrowthBookSmall changes to a user interface can have a huge impact on conversion rates and revenue. text_onlymarketing_event2026-03-09406800
Ashley StirrupA simple UI change was worth $120 million to Bing. The problem is, it's impossible to knotext_videomarketing_event2026-03-091,8381912
Ashley StirrupRaj Mehta joined me on the Experimentation Edge Podcast this week. Its a great real-worldtext_onlypodcast2026-03-0776200
Ashley StirrupThis is an excellent case study on the power of experimentation! Kameron T. and team are text_onlycustomer_story2026-03-06512911
Alyssa NicollThe web has always had this pendulum swing between client-side and server-side rendering. text_linkpodcast2026-03-06—100
Alyssa Nicoll🔴 LIVE NOW — Back to the Basics continues! We’re diving into SSR, hydration, and partialtext_linkmarketing_event2026-03-061000
Ashley StirrupIt's Twyman's Law: any figure that looks interesting or surprising is usually wrong. Heretext_imagethought_leadership2026-03-061,3931510
GrowthBookWhen you deliver flowers and gifts across 9 countries, not everyone behaves the same way. text_carouselcustomer_story2026-03-05504610
GrowthBookShipping on flat can be so tempting! "The project is strategic!" or "It's important to thtext_onlythought_leadership2026-03-047871410
Ashley StirrupMost experimentation programs are confidently wrong - unless they have a plan. The webinatext_imagemarketing_event2026-03-04544711
Ashley StirrupA slide made it all the way to a VP all-hands at Microsoft. It said: "New users who use otext_imagethought_leadership2026-03-03565920
Graham McNicollRon Kohavi and Luke Sonnet are hosting a discussion tomorrow about how to decide what to dtext_onlymarketing_event2026-03-028951610
Ashley StirrupAmazon's team was confident in their data. Then someone noticed Oprah had called Kindle hetext_documentthought_leadership2026-03-02617710