Task

How to measure impact without an A/B test

Estimate the effect of a launch, campaign or policy when you could not randomize: diff-in-diff, synthetic control, matching, instrumental variables, double ML.

Measuring the Impact of Personalized Recommendationsmedia-streaming2026-10
Correlation Lied to Us: Rethinking Product Impact with Causal Inferenceclassifieds2026-08
Leveraging PyFixest for High-Cardinality Marketplace Modeling at Instacartmarketplace2026-06
A Human-Augmenting Agentic Workflow for Causal Inferencemedia-streaming2026-06
Evolution of the Databricks Commercial Motion: Building Scalable Intelligence on Databrickssaas-b2b2026-06
Double Machine Learning vs Propensity Score Matching: How to Evaluate Non-Randomized Experiments Faster and More Reliablymarketplace2026-05
Getting the Most Out of ML Models When There Is Too Little Datageneral2026-05
Using Matching at Cianclassifieds2026-05
How Developer Productivity Changed with AI4SDLC Toolsbanking2026-05
Problems and Prospects of Causal AIgeneral2026-05
Causal Discovery on Real Data: Combining Causal Graphs, Uplift and LLMsbanking2026-05
AI for Pricing: What to Entrust to an Agent and Where Causal Analysis Is Unavoidableretail2026-05
The New Policy Hasn't Run Yet: Comparing It to the Old One Before an A/B Testbanking2026-05
Beyond A/B Testing: Using Surrogacy and Region-Splits to Measure Long-Term Effects in Marketplacesmobility2026-03
Trusting the Untestable: Validation and Diagnostics for the Doubly Robust Modelsmobility2026-02
My Starter Project on the Lyft Rider Data Science Teammobility2025-10
Khan Academy Improves State Test Scores: Results from New 3-Year Efficacy Studyedtech2025-08
Automating Ad Generations with LLMsmarketplace2025-07
Validating Propensity Score Matching: Metrics and Testsmobility2025-05
Marketing Mix Modeling: The State of the Art in 2025fintech2025-05
Pros and Cons of Double Machine Learning vs. Standard Linear Regression Approaches to Estimating Treatment Effects and Structural Parametersgeneral2025-05
Estimating Incremental Lift in Customer Value (Delta CV) using Synthetic Controlfintech2025-02
Decoding Causal Incrementality in E-Commerce: Leveraging Bayesian Structural Time Series Model with a Real-World Examplee-commerce2025-01
Buyer Journey Insights with Data-Driven Attributionsocial2025-01
Part 2: A Survey of Analytics Engineering Work at Netflixmedia-streaming2025-01
Measuring Product Impact Without A/B Testing: How Discord Used the Synthetic Control Method for Voice Messagessocial2024-11
Make Better Decisions by Embracing Uncertaintyfintech2024-06
Modern Methods for Estimating Causal Relationships with Big Datageneral2024-05
Mosaica: Measuring Marketing Effect Piece by Piece with MLtelecom2024-05
How We Launched a New Promotion Model: Matching and Regional Testsclassifieds2024-05
Profit Prophet: Fortune-Telling on Cushions, or How to Evaluate the Effectiveness of a New Search Systeme-commerce2024-05
Data Science That Is Useful for Businessgeneral2024-05
Measuring Marketing Success: The Power of Incrementality and Geo Testingtravel2024-05
Measuring Marketing Effectiveness in a Cookie-Less Worldsaas-b2b2024-04
How to Determine Causal Effects when A/B Tests are Infeasible through Adopter Analysise-commerce2024-04
Optimizing at the Edge: Using Regression Discontinuity Designs to Power Decision-Makinge-commerce2024-04
Fundamentals of Causal Discovery and Causal Impact Analysisretail2024-03
How to Accurately Test Significance with Difference in Difference Modelsmedia-streaming2023-09
Encouragement Designs and Instrumental Variables for A/B Testingmedia-streaming2023-08
Leveraging Switchbacks: Enhancing Market-Based Testing at Thumbtackmarketplace2023-07
Correlation Does Not Imply Causation. So What Does?general2023-05
Bayes in the Wildgeneral2023-05
Marketing Attributiontravel2023-04
Causal Machine Learning for Creative Insightsmedia-streaming2023-01
Catching Anomalies Early in Mobile App Releasessocial2023-01
Ocelot: Scaling observational causal inference at LinkedInsocial2022-12
Adapted Switch-back Testing to Quantify Incrementality for App Marketplace Search Adsfood-delivery2022-11
Inverse Propensity Score based offline estimator for deterministic ranking lists using position biasfood-delivery2022-08
Measuring marketing incremental impacts beyond last click attributionsocial2022-07
Leveraging Causal Inference to Generate Accurate Forecastsfood-delivery2022-06