Method

Propensity score matching

Matching treated and control units by propensity or covariates (PSM, CEM, nearest neighbor).

11 cases from 10 companies apply Propensity score matching. 1 was checked in an online A/B test; 8 report results in production. Includes variants: Nearest-neighbor matching.

Typical tasks: Measure impact without an A/B test, Experiment when users affect each other, Get experiment results faster, Predict long-term effect from short tests and 1 more. Companies: Walmart, OLX, Avito, Yelp, LinkedIn, Instacart and 4 more. Often combined with: Nearest-neighbor matching, A/A test, Difference-in-differences, A/B test, Covariate balance check and 28 more.