Method

LLM cascade

Try a cheap model first, escalate on low confidence.

9 cases from 8 companies apply LLM cascade. 4 report results in production.

Typical tasks: Reduce ML cost, Evaluate models, Catch fraud and abuse, Moderate content at scale and 3 more. Companies: DoorDash, Netflix, Zomato, VTB, Instacart, Walmart and 2 more. Often combined with: Few-shot prompting, LLM-as-a-judge, Threshold selection, Text classification, Hallucination detection and 32 more.