Method

CUPED / regression adjustment

Variance reduction using pre-experiment covariates (CUPED, CUPAC, ANCOVA).

15 cases from 9 companies apply CUPED / regression adjustment. 3 were checked in an online A/B test; 9 report results in production. Includes variants: Regression adjustment.

Typical tasks: Get experiment results faster, Avoid false wins in A/B tests, Experiment when users affect each other, Measure impact without an A/B test and 2 more. Companies: DoorDash, Instacart, Lyft, X5 Tech, Etsy, CFT and 3 more. Often combined with: Regression adjustment, Power analysis / MDE, Switchback test, A/B test, Linear regression and 23 more.