Method

Knowledge distillation

Training a smaller model to imitate a larger one or LLM labels.

53 cases from 27 companies apply Knowledge distillation. 17 were checked in an online A/B test; 21 report results in production.

Typical tasks: Rank search results, Reduce ML cost, Retrieve and rank from millions of items, Evaluate models and 11 more. Companies: Yandex, Pinterest, Meta, DoorDash, LinkedIn, Avito and 21 more. Often combined with: Supervised fine-tuning, LLM-as-a-judge, Multi-task learning, Two-tower model, LLM labeling and 125 more.

From Activity to Intent: Generating User Journeys with LLMssocial2026-10
Meta’s Generative Ads Model (GEM): Scaling the Central Model and Compute Engine for Frontier Ads AIadtech2026-10
Building Gavel: AI evaluation infrastructure across Eternalfood-delivery2026-10
GenRec: Towards LLM-Native Recommendation at Netflixmedia-streaming2026-07
Exploring Hierarchical Interest Representation For Meta Ads Deep Funnel Optimizationadtech2026-07
Building Food Metadata with LLM Juries, Context Optimization & Multimodal AIfood-delivery2026-07
Fox One: Video Content Personalization Powered by GenAImedia-streaming2026-06
From Prompt to Classifier: A Production Case Studysaas-b2b2026-06
Semantic Search for AI Agents at Scale: Retrieval and Ranking for LinkedIn’s Hiring Assistantsocial2026-06
AI Blender in Search: How We Stopped Worshipping Clicks and Moved Block Placement to LLMssearch-engine2026-05
LLMs for Arbitrage in New-Build Real Estateclassifieds2026-05
How We Do RL for Our LLM at Avitoclassifieds2026-05
The Search of the Futuregeneral2026-05
X-split ARGUS: An Autoregressive Encoder-Decoder for Ad Rankingadtech2026-05
How to Speed Up Multimodal Labeling Fourfold Without Losing Quality: Training a Compact VLM on Complex Data and Domain Projectsgeneral2026-05
Inside the Archive: The Tech Behind Your 2025 Wrapped Highlightsmedia-streaming2026-03
How Etsy Uses LLMs to Improve Search Relevancemarketplace2026-01
Adapting the Facebook Reels RecSys AI Model Based on User Feedbacksocial2026-01
Building The Intent Engine: How Instacart is Revamping Query Understanding with LLMse-commerce2025-11
Meta’s Generative Ads Model (GEM): The Central Brain Accelerating Ads Recommendation AI Innovationadtech2025-11
Reducing Irrelevant Impressions of the Thematic Block in Geo Search for Navigation Scenariossearch-engine2025-11
SafeChat: DoorDash's AI-powered safety featurefood-delivery2025-10
Identify User Journeys at Pinterestsocial2025-10
Causal concept-based explanationsfintech2025-10
Modernizing Home Feed Pre-Ranking Stagesocial2025-05
Building the next generation of job search at LinkedInmarketplace2025-05
How Large Language Models Help Users Formulate Queries in Yandex Mapssearch-engine2025-05
Distilling Qwen for Meeting Minutesbanking2025-05
On the Deep Value of Useless Email Campaignsgeneral2025-05
Voice Personalization in Alicemedia-streaming2025-05
Virtual Sensors in Industrymanufacturing2025-05
ML-Readability: How Yandex Browser Extracts Web Page Content for Summarizationsearch-engine2025-05
5 Stops on the Way to LLM in Your Productiongeneral2025-05
JUDE: LLM-based representation learning for LinkedIn job recommendationsmarketplace2025-05
Multi-gate-Mixture-of-Experts (MMoE) model architecture and knowledge distillation in Ads Engagement modeling developmentadtech2025-04
Improving Pinterest Search Relevance Using Large Language Modelssocial2025-04
Search Query Understanding with LLMs: From Ideation to Productionmarketplace2025-02
Unleashing the power of large language models at DoorDash for a seamless shopping adventurefood-delivery2024-10
Neural Filter with YaGPT: Helping Users Sort Out Their Mailboxgeneral2024-05
How We Got RAG Running in Productiongeneral2024-05
How to Build Multilingual Product Matching Without Dataretail2024-05
SOTA Entity Recognition via LLM Distillationgeneral2023-10
Training Foundation Improvements for Closeup Recommendation Rankersocial2023-09
Scaling the Instagram Explore recommendations systemsocial2023-08
Deep Multi-task Learning and Real-time Personalization for Closeup Recommendationssocial2023-06
Improving Item Recommendation Accuracy Using Collaborative Filtering and Vector Search Enginemarketplace2023-06
Semantic Search for Organizationssearch-engine2023-05
NLP at Alfa-Bank, Part 3: Modelingbanking2023-05
Accelerating Large Generative Models in NLP—general2023-05
How eBay Created a Language Model With Three Billion Item Titlesmarketplace2023-01