Posts

75 original posts (reposts excluded), filtered

Source:All Ashley StirrupGrowthBookGraham McNicoll
Sort:Most recentTop engagement
Channel:đź“° Newsletter
Filters:Topic: thought_leadership âś•Clear all
SourcePostFormatTopicPublishedImpr.LikesCommentsShares
Graham McNicollIt's really hard when you really believed in feature, you managed to get it prioritized, ytext_videothought_leadership2026-08-13—920
Graham McNicollI cannot look at a hundred experiments and tell you what they have in common. Nobody can. text_imagethought_leadership2026-08-12—1400
Graham McNicollFrom my experience, experimentation programs don't get killed off in a meeting because peotext_videothought_leadership2026-08-11—810
Graham McNicollThe average engineer stays at a company about two years. I don't blame anyone for that. text_linkthought_leadership2026-08-05—1900
Graham McNicollToken costs are exploding across our industry. Here's how we approach it. I definitely betext_videothought_leadership2026-08-04—920
Graham McNicollOne of the things we tell a lot of our customers is that it's the number of at-bats that wtext_videothought_leadership2026-07-29—720
Graham McNicollWe don't have product managers at GrowthBook. That is deliberate... One reason is ownerstext_imagethought_leadership2026-07-28—1530
Graham McNicollFor years I chased my team for experiment write-ups after the fact. It never worked, and text_linkthought_leadership2026-07-24—1610
Graham McNicollIf you have ever seen a kid use an iPad, you have watched a perfect UX. A child seeing itext_imagethought_leadership2026-07-21—510
Graham McNicollMost companies ship the first version of the product they build. And the chance that's thetext_videothought_leadership2026-07-16—1740
Graham McNicollThere's a level of excitement teams get when the product just works and they're not fightitext_videothought_leadership2026-07-15—820
Graham McNicollAsk any product manager what they hate most about their job, and the answer is rarely the text_onlythought_leadership2026-07-14—2110
Graham McNicollMost product teams build features the expensive way. Someone has the idea. The team spectext_videothought_leadership2026-07-09—520
Graham McNicollIf your finance team is currently drafting a memo about capping engineering AI spend, I amtext_imagethought_leadership2026-07-08—420
Ashley StirrupI interviewed five experimentation leaders in one week and compiled the most important fintext_linkthought_leadership2026-07-081,7932022
Ashley StirrupThere may be a goldmine of growth hidden in your last experiment. Most teams read a test text_documentthought_leadership2026-07-071,4431431
Graham McNicollPMs ship experiment winners too early. A metric moves 3%, the test gets called, and the text_videothought_leadership2026-07-07—1510
Graham McNicollCS degree enrollment is dropping, and I do not blame the students. If I were eighteen ritext_videothought_leadership2026-07-025311040
Graham McNicollIf your team already has feature flags wired into production, you can run painted door testext_imagethought_leadership2026-07-016401110
Graham McNicollOne very large financial company, a name you would recognize, told me they were doing expetext_videothought_leadership2026-06-305591731
Graham McNicollTeams routinely misunderstand averages in experimentation and what those averages are hiditext_videothought_leadership2026-06-255971321
Graham McNicollA Hacker News thread a while ago argued that A/B testing is unethical. I believe their fratext_imagethought_leadership2026-06-24523620
Graham McNicollI see experimentation leads run two or three tests a month and feel like they have figuredtext_videothought_leadership2026-06-23389810
Graham McNicollI have been a software engineer long enough to have the grey hairs to show for it. Monoltext_videothought_leadership2026-06-189182130
Graham McNicollKilling a feature you spent months (or years) building is one of the hardest calls in prodtext_videothought_leadership2026-06-163361551
Graham McNicollEvery experimentation leader eventually runs into the result nobody expected. A counteritext_videothought_leadership2026-06-113571000
Graham McNicollI spoke to an engineering lead last week whose team still tracks progress in story points.text_imagethought_leadership2026-06-10465710
Graham McNicollMost engineering teams using feature flags treat them as circuit breakers. Something goes text_videothought_leadership2026-06-093271210
Graham McNicollThree years into building our own experimentation platform at my last company, we found a text_imagethought_leadership2026-06-053,6585351
Graham McNicollI spoke to an engineering manager last week whose team still tracks sprint progress in stotext_videothought_leadership2026-06-034641210
Graham McNicollMy head of Experimentation named our product development framework after Jon Hamm. I chosetext_imagethought_leadership2026-06-029593150
Graham McNicollWe had a dashboard for every metric at my last company. What we did not have was a way to text_imagethought_leadership2026-05-29615940
Graham McNicollI have watched a deploy take down products complete because there was no flag in place to text_imagethought_leadership2026-05-22470901
Graham McNicollMost product teams I talk to struggle to analyze the true impact of any feature they ship,text_videothought_leadership2026-05-20309900
Graham McNicollAt education.com, we ran thousands of experiments. Roughly a third won. The ones that losttext_imagethought_leadership2026-05-193511410
Graham McNicollA bug in our code accidentally set our paywall to zero. Revenue jumped 30%. Usually whetext_imagethought_leadership2026-05-151,4461510
Graham McNicollI saw the Amazon report. Four major outages in one week from AI-assisted code changes. Thetext_imagethought_leadership2026-05-141,6881500
Graham McNicollMost engineering teams I talk to are still shipping every feature directly to production. text_videothought_leadership2026-05-131,3432021
Graham McNicollMost product teams I talk to know how to run an experiment. They have the tooling, a primatext_imagethought_leadership2026-05-129871200
Graham McNicollI have sat in spec reviews where the Jira tickets were written, the designs were finished,text_imagethought_leadership2026-05-081,0251010
Graham McNicollMost product teams spec out the entire feature before they've shipped a single line of codtext_videothought_leadership2026-05-062,2441820
Graham McNicollA bug in our codebase accidentally set our paywall to zero. As a side effect, revenue jumptext_videothought_leadership2026-05-011,0521000
Graham McNicollAI coding tools are genuinely impressive. And this is literally the worst they will ever btext_videothought_leadership2026-04-296,3232210
Graham McNicollI once sat in a meeting that ran for an hour debating which shade of green to use for a butext_imagethought_leadership2026-04-281,6161250
Graham McNicollIf you could onlypick one for your experimentation program, which would you rather have? text_onlythought_leadership2026-04-241,676450
Graham McNicollWe spent three years building our own experimentation platform at education.com. Then we ftext_videothought_leadership2026-04-231,7272502
Graham McNicollIf you use 3rd party vendor, you are betting your infrastructure on someone else's board mtext_videothought_leadership2026-04-221,1231430
Graham McNicollSoftware teams get measured on delivery speed. It's an easy thing to track, it fits neatlytext_imagethought_leadership2026-04-216571110
Graham McNicollIt's entirely possible to run a test, see it win, ship the feature, and still damage your text_videothought_leadership2026-04-179521320
Graham McNicollMany "data-driven" companies are practicing sophisticated guessing. They have the dashbotext_onlythought_leadership2026-04-169681430
Graham McNicollI see so many software teams launch massive features without actually defining what succestext_videothought_leadership2026-04-147411100
Graham McNicollBuilding your own experimentation stack is a fun engineering challenge until the day it istext_imagethought_leadership2026-04-091,4052201
Graham McNicollEngineer's who ship products without measuring them are making a big mistake. If you arentext_videothought_leadership2026-04-082881500
Graham McNicollProduct teams obsess over whether they shipped on time. It's a reasonable thing to track. text_imagethought_leadership2026-04-07—810
Graham McNicollMost companies think choosing an experimentation vendor comes down to feature lists and UItext_imagethought_leadership2026-04-021,6552520
Graham McNicollI've watched design teams spend months on an interface that looked great, and was based ontext_videothought_leadership2026-04-011692221
Graham McNicollEven the best product people on Earth have a surprisingly low batting average. In basebaltext_imagethought_leadership2026-03-319641910
GrowthBookBuilding a culture of experimentation is about creating a culture of humility, that learnstext_videothought_leadership2026-03-304771210
Graham McNicollIn many companies, the projects we work on are the ones backed by the person who speaks thtext_videothought_leadership2026-03-263122841
Graham McNicollThe most important transition for a product team is learning how to be ruthless with ideastext_videothought_leadership2026-03-241,3332840
Graham McNicollWe once had a design team spend months redoing our onboarding flow. They did everything rtext_imagethought_leadership2026-03-204,033156228
Graham McNicollJudging a product team solely on their ability to ship is a bad metric that rewards activitext_videothought_leadership2026-03-189243510
Ashley StirrupFriends don't let their product managers use bad reality distortion. Steve Jobs had a famtext_imagethought_leadership2026-03-1627810
Graham McNicollI know it sounds controversial, but I advocate for burning your backlog at the end of evertext_videothought_leadership2026-03-121,7955670
Graham McNicollIn baseball terms, the industry standard for any new product success is batting 200- and htext_videothought_leadership2026-03-101,4524910
GrowthBookShipping on flat can be so tempting! "The project is strategic!" or "It's important to thtext_onlythought_leadership2026-03-047871410
Ashley StirrupExperimentation unlocks learning you can't get any other way. These learnings often surfatext_onlythought_leadership2026-02-202451110
GrowthBookAI Evals tell you if the model works. A/B tests tell you if users care. These answer difftext_linkthought_leadership2026-01-27540601
GrowthBookMany organizations are optimizing perfectly—for the wrong thing. Dark patterns rarely startext_onlythought_leadership2026-01-204481000
Graham McNicollOptimization to Enshitification: Dark Patterns in A/B Testing A post allegedly written bytext_imagethought_leadership2026-01-193585652
GrowthBookWe fed 80+ experiments into AI. We learned what users actually want—then built and tested text_imagethought_leadership2025-10-13806811
GrowthBookYesterday's comic was, of course, in reference to Twyman's Law. Applicable not only to etext_carouselthought_leadership2025-09-17322400
GrowthBookThis fantastic comic (xkcd 2899) is about which law?text_imagethought_leadership2025-09-16403601
GrowthBookAs a company, we do things companies do: • Run A/B tests (obviously) • SEO • And notext_linkthought_leadership2025-09-15487700
GrowthBookMost holdouts measure only shipped features. Ours measure everything—including failed expetext_linkthought_leadership2025-09-04369100