Company
Netflix
30 cases from Netflix (Media streaming, Fintech, Gaming), each digested from a public talk or engineering post and linked to the original. 7 were checked in an online A/B test; 10 report results in production.
Tasks: Evaluate models, Measure impact without an A/B test, Recommend from what the user just did, Avoid false wins in A/B tests, Build a data platform and 19 more. Methods: Sequential recommendation, LLM-as-a-judge, A/B test, Embedding similarity matching, Supervised fine-tuning, Reward model and 73 more. Tools: Elasticsearch, XGBoost, CLIP, vLLM, EconML, Claude and 7 more.
Tech blog: netflixtechblog.com