Tool
vLLM
21 cases from 16 companies use vLLM in their stack. 5 were checked in an online A/B test; 5 report results in production. Tasks: Evaluate models, Build an assistant over internal docs, Retrieve and rank from millions of items, Reduce ML cost and 9 more. Methods: LLM-as-a-judge, Synthetic data generation (LLM), Knowledge distillation, Supervised fine-tuning, LoRA fine-tuning and 72 more. Companies: Avito, Sber, Pinterest, Spotify, Netflix, LinkedIn and 10 more.





