Method
Statistical hypothesis tests
t-test, Mann-Whitney, chi-square, z-test, KS and permutation tests.
35 cases from 27 companies apply Statistical hypothesis tests. 6 were checked in an online A/B test; 10 report results in production. Includes variants: t-test.
Typical tasks: Get experiment results faster, Avoid false wins in A/B tests, Measure impact without an A/B test, Experiment when users affect each other and 11 more. Companies: DoorDash, Grab, Expedia Group, Spotify, Sber, Yandex and 21 more. Often combined with: t-test, Bootstrap, Power analysis / MDE, A/B test, Interleaving and 67 more.




