Ashley Stirrup

Accuracy measures the test set. It doesn't measure trust. I had Mayank Agarwal (Director of AI Products at RingCentral) on The Experimentation Edge this week. The metric he said most teams skip is acceptance rate (ie. how much of the AI's output users keep without editing). In order to earn people's trust, you can't simply rewrite everything the AI hands you. What a great conversation we had, I learned a lot from Mayank and I'm so grateful he came on the podcast. How does your team measure trust? (answer in comments)