Tool

vLLM

21 cases from 16 companies use vLLM in their stack. 5 were checked in an online A/B test; 5 report results in production. Tasks: Evaluate models, Build an assistant over internal docs, Retrieve and rank from millions of items, Reduce ML cost and 9 more. Methods: LLM-as-a-judge, Synthetic data generation (LLM), Knowledge distillation, Supervised fine-tuning, LoRA fine-tuning and 72 more. Companies: Avito, Sber, Pinterest, Spotify, Netflix, LinkedIn and 10 more.

From Activity to Intent: Generating User Journeys with LLMssocial2026-10
Advancing Generative Recommendation Inference: our collaboration with NVIDIA on TensorRT LLMmedia-streaming2026-10
GenRec: Towards LLM-Native Recommendation at Netflixmedia-streaming2026-07
Semantic Search for AI Agents at Scale: Retrieval and Ranking for LinkedIn’s Hiring Assistantsocial2026-06
How We Do RL for Our LLM at Avitoclassifieds2026-05
From Zero to Agents: Growing a Multi-Agent LLM Platform Inside a Companygeneral2026-05
Deploying LLMs in Moderation: From PoC to the Target Solutionclassifieds2026-05
Analyzing Public Pedagogical Benchmarks for AI Tutors and Building Synthetic Students for Testingedtech2026-05
A Corporate AI Agent at Nornickelgeneral2026-05
When Models Should Stay Silentgeneral2026-05
How Etsy Uses LLMs to Improve Search Relevancemarketplace2026-01
Cold-Starting Sales of Complementary Products with LLMsfood-delivery2025-05
Internships on the LLM Team: Several LLM Deployments at Avitoclassifieds2025-05
Graphs and Agents in Action: Building a CoPilot for All Sber Branchesbanking2025-05
High-Speed Multimodal Moderation: LLMs and VLMs in Real Productionmarketplace2025-05
Retrieval-Augmented Fill-in-the-Middle: An Architecture for Generating Structured Documents with LLMsgeneral2025-05
Function Calling 101: One Agent Instead of a Zoo of Bots—general2025-05
Improving a Modular Chatbot with LLMs: Practical Experiencebanking2025-05
5 Stops on the Way to LLM in Your Productiongeneral2025-05
Auto-Generating Product Descriptions in Fashionclassifieds2024-05
Review and Adaptation of RAG Evaluation Tools for the Russian Languageinsurance2024-05