Method
Agent evaluation
Evaluating agents on traces, multi-turn scenarios, stubbed tools and behavioral evals.
13 cases from 10 companies apply Agent evaluation. 4 report results in production.
Typical tasks: Evaluate models, Answer questions over data, Build a data platform, Optimize decisions. Companies: DoorDash, Ramp, Pinterest, Airbnb, Grab, Avito and 4 more. Often combined with: LLM-as-a-judge, Golden set / benchmark, Human in the loop, Evaluation regression gate, LLM observability and 19 more.
| How Pinterest Improved Analytics Agent Compliance with Loop Engineering | social | 2026-11 | |
| Eval-driven development: Lessons from evaluating GenAI at scale | travel | 2026-08 | |
| Building Jarvis Pro: Route first, answer later | food-delivery | 2026-08 | |
| Building Ask DoorDash (Part 3): Evaluation | food-delivery | 2026-06 | |
| Agentic Risk Operations | fintech | 2026-06 | |
| Inside DoorDash’s one-click simulation and evaluation platform for support chatbots | food-delivery | 2026-06 | |
| From an LLM Portal to a Factory of Internal Agents | classifieds | 2026-05 | |
AutoJudge: Dynamic Generation of LLM-as-Judge for Validating Agentic Pipelines![]() | ![]() | general | 2026-05 |
Real Automation: In Which Processes AI Agents Deliver Value![]() | ![]() | general | 2026-05 |
| How Asana built a custom LLM evaluation framework for AI Teammates | saas-b2b | 2026-04 | |
| Financial Benchmarks | fintech | 2026-03 | |
| Creating AI agent solutions for warehouse data access and security | social | 2025-08 | |
| How Asana tests frontier LLMs: our analysis of Claude 3.5 Sonnet | saas-b2b | 2024-07 |

