Method
Placebo test
Falsification checks with fake treatments or periods to validate causal estimates.
7 cases from 5 companies apply Placebo test. 1 was checked in an online A/B test; 3 report results in production.
Typical tasks: Measure impact without an A/B test, Get experiment results faster, Experiment when users affect each other, Evaluate models and 2 more. Companies: Netflix, Instacart, Databricks, Khan Academy, Walmart. Often combined with: Causal inference (general), Switchback test, Gradient boosting, Doubly robust estimation, Covariate balance check and 19 more.
| Variance Reduction Below the Randomization Grain | food-delivery | 2026-07 | |
| A Human-Augmenting Agentic Workflow for Causal Inference | media-streaming | 2026-06 | |
| Evolution of the Databricks Commercial Motion: Building Scalable Intelligence on Databricks | saas-b2b | 2026-06 | |
| Khan Academy Improves State Test Scores: Results from New 3-Year Efficacy Study | edtech | 2025-08 | |
| Part 2: A Survey of Analytics Engineering Work at Netflix | media-streaming | 2025-01 | |
| Fundamentals of Causal Discovery and Causal Impact Analysis | retail | 2024-03 | |
| ML for Brain Physiology | — | healthtech | 2023-10 |