Method

Inverse propensity weighting

Reweighting units by inverse treatment probability to remove selection bias.

20 cases from 15 companies apply Inverse propensity weighting. 10 were checked in an online A/B test; 3 report results in production. Includes variants: Inverse propensity scoring.

Typical tasks: Measure impact without an A/B test, Optimize decisions, Rank search results, Evaluate models and 7 more. Companies: Netflix, Lyft, Pinterest, The New York Times, Instacart, Avito and 9 more. Often combined with: Inverse propensity scoring, Doubly robust estimation, Bootstrap, Instrumental variables, A/B test and 50 more.

MAPS: Netflix’s Multimodal Asset Personalization at Scalemedia-streaming2026-08
Double Machine Learning vs Propensity Score Matching: How to Evaluate Non-Randomized Experiments Faster and More Reliablymarketplace2026-05
Models in Monetizationclassifieds2026-05
AI for Pricing: What to Entrust to an Agent and Where Causal Analysis Is Unavoidableretail2026-05
The New Policy Hasn't Run Yet: Comparing It to the Old One Before an A/B Testbanking2026-05
Trusting the Untestable: Validation and Diagnostics for the Doubly Robust Modelsmobility2026-02
Adapting the Facebook Reels RecSys AI Model Based on User Feedbacksocial2026-01
How Pinterest Built a Real‑Time Radar for Violative Content using AIsocial2025-12
Scaling Subscriptions at The New York Times with Real-Time Causal Machine Learningmedia-streaming2025-10
Bandits for Marketing Optimizationfood-delivery2024-06
Lyft’s Reinforcement Learning Platformmobility2024-03
Using Contextual Bandit models in large action spaces at Instacarte-commerce2023-06
Position Bias in Recommender Systemse-commerce2023-05
Improving the customer’s experience via ML-driven payment routingfintech2023-01
Evolution of Search Ranking at Thumbtackmarketplace2022-12
Inverse Propensity Score based offline estimator for deterministic ranking lists using position biasfood-delivery2022-08
How The New York Times Uses Machine Learning To Make Its Paywall Smartermedia-streaming2022-08
Causal Inference. Advanced modeling methodsgeneral2022-06
Experimentation is a major focus of Data Science across Netflixmedia-streaming2022-01
Experiment without the wait: Speeding up the iteration cycle with Offline Replay Experimentationsocial2022-01