Method
Shadow mode
Running a new model in production without acting on its output.
17 cases from 12 companies apply Shadow mode. 13 report results in production.
Typical tasks: Catch fraud and abuse, Evaluate models, Moderate content at scale, Build a data platform and 5 more. Companies: DoorDash, Ramp, Gusto, Avito, Affirm, Grab and 6 more. Often combined with: Feature store, Human in the loop, LLM classification / extraction, Knowledge distillation, Threshold selection and 41 more.


