Method

Backtesting

Evaluate forecasts on rolling historical origins.

12 cases from 12 companies apply Backtesting. 1 was checked in an online A/B test; 3 report results in production.

Typical tasks: Forecast demand and load, Evaluate models, Catch fraud and abuse, Decide who gets an offer and 6 more. Companies: Netflix, Databricks, Expedia Group, Gusto, Walmart, Instacart and 6 more. Often combined with: Gradient boosting, Change-point detection, Human in the loop, Rule-based heuristics, Time-series forecasting and 23 more.