Posts

42 original posts (reposts excluded), filtered

Filters:Format: text_image ✕Clear all
SourcePostFormatTopicPublishedImpr.LikesCommentsShares
Graham McNicollAverage tenure for product developers is about two years, which puts everything your team text_imagethought_leadership2026-10-12—700
Graham McNicollGave a talk on synthetic user A/B testing at MeasureCamp Berlin on Saturday. There was pletext_imagemarketing_event2026-10-11—4050
Graham McNicollThe return you report from experimentation is higher than the return you actually got. Thtext_imagedata_science2026-10-092181300
Graham McNicollWin rates across the industry sit around 20%, and I do not think AI is going to improve ontext_imagethought_leadership2026-10-053481330
Graham McNicollA year ago, most engineers wanted to see every line an AI wrote before it went near their text_imagethought_leadership2026-10-0213,83841133
Graham McNicollWhen an experiment fails, there should be a discussion about if the idea was bad or if it text_imagethought_leadership2026-09-28231910
Graham McNicollA couple of years ago, the first AI tool I used was Copilot. We saw 20 to 30 percent improtext_imagethought_leadership2026-09-254781620
Graham McNicollHiring has always been the most critical part of building a company, and it takes a thoughtext_imagethought_leadership2026-09-18526920
Graham McNicollIf you work inside an experimentation program, you have probably noticed that leadership stext_imagethought_leadership2026-09-094112230
Graham McNicollDesigners and engineers get attached to their work. It makes sense; you spent real effort text_imagethought_leadership2026-09-04428900
Graham McNicollWhen I talk to product teams lately, a strange thing keeps coming up. A large share of ttext_imagethought_leadership2026-08-283991500
Graham McNicollI do not love the word governance. It is boring. Nobody gets excited buying a governance stext_imageproduct_functionality2026-08-194021620
Graham McNicollI cannot look at a hundred experiments and tell you what they have in common. Nobody can. text_imageproduct_functionality2026-08-127251600
Graham McNicollWhen we rebuilt product analytics for 5.0, we started with a question I could not shake. Wtext_imageproduct_functionality2026-07-302881711
Graham McNicollWe don't have product managers at GrowthBook. That is deliberate... One reason is ownerstext_imagethought_leadership2026-07-286891630
Graham McNicollWe ran an internal contest at GrowthBook a while back. The setup was simple. Anyone on thetext_imageproduct_functionality2026-07-237551700
Graham McNicollIf you have ever seen a kid use an iPad, you have watched a perfect UX. A child seeing itext_imagethought_leadership2026-07-21974510
Graham McNicollIf your finance team is currently drafting a memo about capping engineering AI spend, I amtext_imagethought_leadership2026-07-08371420
Graham McNicollIf your team already has feature flags wired into production, you can run painted door testext_imagethought_leadership2026-07-016951110
Graham McNicollA Hacker News thread a while ago argued that A/B testing is unethical. I believe their fratext_imagethought_leadership2026-06-24567620
Graham McNicollIf you are an engineering leader at a growth-stage company currently maintaining your own text_imagecustomer_story2026-06-175221420
Graham McNicollI spoke to an engineering lead last week whose team still tracks progress in story points.text_imagethought_leadership2026-06-10474710
Graham McNicollThree years into building our own experimentation platform at my last company, we found a text_imagepast_experience2026-06-053,6655351
Graham McNicollMy head of Experimentation named our product development framework after Jon Hamm. I chosetext_imagethought_leadership2026-06-029673150
Graham McNicollWe had a dashboard for every metric at my last company. What we did not have was a way to text_imagepast_experience2026-05-29620940
Graham McNicollI have watched a deploy take down products complete because there was no flag in place to text_imagethought_leadership2026-05-22478901
Graham McNicollAt education.com, we ran thousands of experiments. Roughly a third won. The ones that losttext_imagepast_experience2026-05-193511410
Graham McNicollA bug in our code accidentally set our paywall to zero. Revenue jumped 30%. Usually whetext_imagepast_experience2026-05-151,4461510
Graham McNicollI saw the Amazon report. Four major outages in one week from AI-assisted code changes. Thetext_imageindustry_commentary2026-05-141,6881500
Graham McNicollMost product teams I talk to know how to run an experiment. They have the tooling, a primatext_imagethought_leadership2026-05-129871200
Graham McNicollI have sat in spec reviews where the Jira tickets were written, the designs were finished,text_imagethought_leadership2026-05-081,0251010
Graham McNicollAmazon got a mandatory meeting. Most engineering orgs will get a quieter version of the satext_imageindustry_commentary2026-05-071,005810
Graham McNicollMost Engineers I know are supervising agents now, not writing the code. Features that tootext_imagethought_leadership2026-05-055,3392731
Graham McNicollI once sat in a meeting that ran for an hour debating which shade of green to use for a butext_imagepast_experience2026-04-281,6161250
Graham McNicollSoftware teams get measured on delivery speed. It's an easy thing to track, it fits neatlytext_imagethought_leadership2026-04-216571110
Graham McNicollBuilding your own experimentation stack is a fun engineering challenge until the day it istext_imagepast_experience2026-04-091,4052201
Graham McNicollProduct teams obsess over whether they shipped on time. It's a reasonable thing to track. text_imagethought_leadership2026-04-07—810
Graham McNicollMost companies think choosing an experimentation vendor comes down to feature lists and UItext_imagethought_leadership2026-04-022,2672520
Graham McNicollEven the best product people on Earth have a surprisingly low batting average. In basebaltext_imagethought_leadership2026-03-319641910
Graham McNicollWe once had a design team spend months redoing our onboarding flow. They did everything rtext_imagepast_experience2026-03-2083,977161238
Graham McNicollOpenAI bought Statsig for $1.1B in stock. Before that, Datadog swallowed Eppo. For a CTO,text_imageindustry_commentary2026-03-162,4764321
Graham McNicollOptimization to Enshitification: Dark Patterns in A/B Testing A post allegedly written bytext_imagethought_leadership2026-01-1917,6115652