Method
Holdout / global control group
Persistent control group kept out of treatments to measure cumulative effect.
18 cases from 15 companies apply Holdout / global control group. 8 were checked in an online A/B test; 2 report results in production.
Typical tasks: Decide who gets an offer, Measure impact without an A/B test, Optimize decisions, Evaluate models and 8 more. Companies: Instacart, Spotify, Avito, LinkedIn, Target, Grab and 9 more. Often combined with: A/B test, Gradient boosting, Stratified sampling / assignment, Time-series cross-validation, Probability calibration and 36 more.
