Company
Spotify
28 cases from Spotify (Media streaming, Adtech, Fintech), each digested from a public talk or engineering post and linked to the original. 4 were checked in an online A/B test; 6 report results in production.
Tasks: Get experiment results faster, Avoid false wins in A/B tests, Predict long-term effect from short tests, Evaluate models, Analyze user behavior and 12 more. Methods: A/B test, Power analysis / MDE, Rule-based heuristics, Sequential testing, Supervised fine-tuning, Gradient boosting and 52 more. Tools: vLLM, Qwen, Slack, Gemini, PostgreSQL, UMAP and 14 more.
Tech blog: labs.spotify.com