Method

FDR correction

Benjamini-Hochberg control of the false discovery rate.

7 cases from 7 companies apply FDR correction. 1 was checked in an online A/B test; 1 report results in production.

Typical tasks: Avoid false wins in A/B tests, Get experiment results faster, Predict long-term effect from short tests, Evaluate models and 2 more. Companies: Spotify, Pinterest, Zillow, Lyft, Etsy and 2 more. Often combined with: Bayesian A/B test, Power analysis / MDE, A/B test, t-test, LTV prediction and 20 more.