Task

How to get experiment results faster

Reach a confident A/B readout with less traffic or time: variance reduction (CUPED), sequential testing, interleaving, power and MDE planning.

Why Spotify Is Not Using Bayesian A/B Testingmedia-streaming2026-09
When Can LLMs Replace Humans in A/B Tests?media-streaming2026-08
Variance Reduction Below the Randomization Grainfood-delivery2026-07
Leveraging PyFixest for High-Cardinality Marketplace Modeling at Instacartmarketplace2026-06
Double Machine Learning vs Propensity Score Matching: How to Evaluate Non-Randomized Experiments Faster and More Reliablymarketplace2026-05
Using Matching at Cianclassifieds2026-05
ABsalute: A/B Testing Automationretail2026-05
Why Reports Mislead, or How to Measure the Effect of an LLM Featuregeneral2026-05
Interleaving for Accelerated Testingtravel2026-02
LLM-Powered Relevance Assessment for Pinterest Searchsocial2025-12
Reducing experiment duration with predicted control variatese-commerce2025-11
How DoorDash Ads keep consumers first with budget A/B experimentationadtech2025-09
Speed with Rigor: testing smarter with group sequential designclassifieds2025-08
Introducing the new A/B testing estimatorgeneral2025-01
Using Marketplace Marginal Values to Address Interference Biasmobility2025-01
How we built it: Payment method A/B testingfintech2024-11
How DoorDash is pushing experimentation boundaries with interleaving designsfood-delivery2024-08
Safeguarding app health and consumer experience with metric-aware rolloutsfood-delivery2024-07
Unlocking 66% Faster Experiments with Covariate Adjustment: Power Analysis for Clustered Data, Ratio Metrics, and OLS Regressionmarketplace2024-06
Deep Learning Clinical Decision Support Systems Reduce Time and Improve Radiologists' Accuracy in Routine CT Interpretationhealthtech2024-05
So A/B Tests Are Just OLS Regression?general2024-05
Sharpening the Blur: Removing dilution to maximize experiment powerfood-delivery2024-05
Fixed-Power Designs: It’s Not IF You Peek, It’s WHAT You Peek atmedia-streaming2024-05
WISE: Skyscanner’s Bayesian AB experimentation library and decision enginetravel2024-04
Grab Experiment Decision Engine - a Unified Toolkit for Experimentationmarketplace2024-04
Milestones on our Journey to Standardize Experimentation at The New York Timesgeneral2024-03
Sequential A/B Testing Keeps the World Streaming Netflix. Part 1: Continuous Datamedia-streaming2024-03
Sequential A/B Testing Keeps the World Streaming Netflix Part 2: Counting Processesmedia-streaming2024-03
Experiment Faster and with Less Effortfood-delivery2024-02
How Walmart Leverages CUPED and Reduces Experimentation Lifecycleretail2023-12
Privacy Sandbox Market Testing: a statistical model for measuring performance impactsadtech2023-12
How to Accurately Test Significance with Difference in Difference Modelsmedia-streaming2023-09
Experimentation at Spotify: Three Lessons for Maximizing Impact in Innovationmedia-streaming2023-08
Accelerating Ranking Experimentation at Thumbtack with Interleavingmarketplace2023-07
Leveraging Switchbacks: Enhancing Market-Based Testing at Thumbtackmarketplace2023-07
Bringing Sequential Testing to Experiments with Longitudinal Data (Part 1): The Peeking Problem 2.0media-streaming2023-07
Bringing Sequential Testing to Experiments with Longitudinal Data (Part 2): Sequential Testingmedia-streaming2023-07
Bayes in the Wildgeneral2023-05
A/B tests in KIONmedia-streaming2023-05
A Bayesian Approach to A/B Tests: A Conversion Test Examplegeneral2023-05
Using Metrics Layer to Standardize and Scale Experimentation at DoorDashfood-delivery2023-04
How to Size For Online Experiments With Ratio Metricstravel2023-03
Choosing a Sequential Testing Framework — Comparisons and Discussionsmedia-streaming2023-03
Deep Dive Into Variance Reductiongeneral2022-11
Balancing Velocity and Confidence in Experimentationfood-delivery2022-11
Increase A/B Testing Power by Combining Experimentse-commerce2022-10
Beyond A/B test : Speeding up Airbnb Search Ranking Experimentation through Interleavingtravel2022-10
Faster ML Experimentation at Etsy with Interleavinge-commerce2022-08
How Bandit Testing Improves A/B Tests at Wealthfrontfintech2022-06
Using Back-Door Adjustment Causal Analysis to Measure Pre-Post Effectsfood-delivery2022-06