Ashley Stirrup

Congratulations to Khan Academy, Kelli H., Tushar Udeshi and the entire Khanmigo team. Khan Academy was named a Learning Organization Finalist for this year's Experimentation Culture Awards! Their case study covers how they built an experimentation culture around their genAI tutor, Khanmigo, at a scale where every optimization compounds across 200M users. The hardest part: measuring "cognitive engagement," since a tutor that just hands out answers doesn't create real learning. They built a rubric grounded in learning science, manually scored conversations as ground truth, then trained a model to apply it at scale. The result: 10% better next-item correctness, 3 seconds faster response times, and Khanmigo was 50% less likely to give away direct answers. Experimentation provided a way to distinguish real improvement and went from being a speed bump to safety net. Read the full case study: https://lnkd.in/eSswqCDJ Tune into tomorrow's free live broadcast to hear from the finalists, keynotes, and insights from across the experimentation community. https://lnkd.in/egZmr3X8