Incident: Bad training data, found through revenue
15 min read·
Module 11 · Incident file · About 35 minutes · Needs: Lesson 1 (label shift, segments, mature labels), Module 10 lesson 3 (validation before training)
Two published cases. The facts about Unity come from its own results release filed with the US Securities and Exchange Commission; the words of its chief executive on the earnings call are quoted as they appear in a blog post by Arize AI, a company that sells model monitoring. The Instacart facts come from a Fortune article and Instacart's own blog.