Method

Covariate balance check

Balance tests and standardized mean differences between groups.

10 cases from 10 companies apply Covariate balance check. 2 were checked in an online A/B test; 9 report results in production.

Typical tasks: Measure impact without an A/B test, Experiment when users affect each other, Get experiment results faster, Avoid false wins in A/B tests and 3 more. Companies: OLX, Netflix, Lyft, Avito, DoorDash, Etsy and 4 more. Often combined with: Doubly robust estimation, Nearest-neighbor matching, Propensity score matching, A/B test, Inverse propensity weighting and 31 more.