Method
Sequential testing
Always-valid inference allowing continuous monitoring and early stopping (mSPRT, SPRT).
14 cases from 6 companies apply Sequential testing. 2 were checked in an online A/B test; 1 report results in production.
Typical tasks: Get experiment results faster, Avoid false wins in A/B tests, Detect anomalies, Measure impact without an A/B test and 2 more. Companies: Spotify, DoorDash, Netflix, OLX and 2 more. Often combined with: Bayesian A/B test, Power analysis / MDE, Multiple-testing correction, Monte Carlo / what-if simulation, Canary rollout and 16 more.