Task

How to predict long-term effect from short tests

Judge the long-term impact (retention, LTV, revenue) of a change from a short experiment: surrogate and proxy metrics, holdouts.

When Can LLMs Replace Humans in A/B Tests?media-streaming2026-08
From Eight Hours to Eight Minutes: Automating A/B Test Analysis on Databricksgaming2026-06
Better Experiments with LLM Evals — A funnel, not a forkmedia-streaming2026-05
Beyond A/B Testing: Using Surrogacy and Region-Splits to Measure Long-Term Effects in Marketplacesmobility2026-03
How Yelp Built a Back-Testing Engine for Safer, Smarter Ad Budget Allocationadtech2026-02
Why we use separate tech stacks for personalization and experimentationmedia-streaming2026-01
My Starter Project on the Lyft Rider Data Science Teammobility2025-10
How We Build Avito's Main Product Metricclassifieds2025-05
How Airbnb measures Listing Lifetime Valuetravel2025-03
Estimating Incremental Lift in Customer Value (Delta CV) using Synthetic Controlfintech2025-02
Using Surrogate Indices to Estimate Long-Run Heterogeneous Treatment Effects of Membership Incentivesfood-delivery2024-08
Improve Your Next Experiment by Learning Better Proxy Metrics From Past Experimentsmedia-streaming2024-08
Behind the metric: how we developed “Time Spent Learning Well”edtech2024-06
WISE: Skyscanner’s Bayesian AB experimentation library and decision enginetravel2024-04
The Field Guide to Non-Engagement Signalssocial2024-03
Why Khan Academy will be using \"skills to proficient\" to measure learning outcomes (and you should too!)edtech2023-09
How we used machine learning to fight fraud at BlaBlaCar — Part 1mobility2023-06
Multi-Armed Bandits in Yandex Lavkafood-delivery2023-05
Ecosystem Success Metricsfintech2023-04
Understanding the collective impact of experimentse-commerce2022-12
Image Quality Assessment for Magnetic Resonance Imaginghealthtech2022-06
Balancing Network Effects, Learning Effects, and Power in Experimentsfood-delivery2022-02
How we built Asana's Marketing Measurement Capabilities to power global customer growthsaas-b2b2022-01