Method

Approximate nearest neighbors

HNSW, IVF, product quantization and LSH indexes for fast embedding search.

58 cases from 35 companies apply Approximate nearest neighbors. 25 were checked in an online A/B test; 20 report results in production. Includes variants: HNSW.

Typical tasks: Retrieve and rank from millions of items, Rank search results, Match entities, Learn user and item embeddings and 11 more. Companies: Pinterest, Mercari, LinkedIn, Instacart, Yandex, eBay and 29 more. Often combined with: Two-tower model, HNSW, Contrastive learning, In-batch negatives, Embedding fine-tuning and 105 more.

Building the AI Retrieval Infrastructure Behind 20 Billion+ Vectors at HubSpotsaas-b2b2026-06
Building an AI Database for Agentic GTM Operationssaas-b2b2026-06
Semantic Search for AI Agents at Scale: Retrieval and Ranking for LinkedIn’s Hiring Assistantsocial2026-06
SilverTorch: Index as Model — A New Retrieval Paradigm for Recommendation Systemssocial2026-05
From Zero to Agents: Growing a Multi-Agent LLM Platform Inside a Companygeneral2026-05
Synchronizing the Senses: Powering Multimodal Intelligence for Video Searchmedia-streaming2026-04
From print to digital: Making weekly flyers shoppable at Instacart through computer vision and LLMsretail2026-02
Ads Candidate Generation using Behavioral Sequence Modelingsocial2026-01
Dense Retrievalmarketplace2025-11
Finding the Right Organization in a Photo, or Removing Kul Sharif from the Kazan Cat Gallerygeneral2025-11
Milvus: Building a large-scale vector DB for LINE VOOM's real-time recommendation systemsocial2025-07
Unlocking Efficient Ad Retrieval: Offline Approximate Nearest Neighbors in Pinterest Adsadtech2025-06
How Instacart Built a Modern Search Infrastructure on Postgrese-commerce2025-05
Experience with Transformer-Based Personalization at Avitoclassifieds2025-05
How Large Language Models Help Users Formulate Queries in Yandex Mapssearch-engine2025-05
Embedding-based retrieval for Airbnb searchtravel2025-03
Advancements in Embedding-Based Retrieval at Pinterest Homefeedsocial2025-02
Establishing a Large Scale Learned Retrieval System at Pinterestsocial2025-01
How DoorDash leverages LLMs for better search retrievalfood-delivery2024-11
Fine-tuned SigLIP Image Embeddings for Similar Looks Recommendation in a Japanese C2C Marketplacemarketplace2024-11
Learning From Structure: Discord’s Entity-Relationship Embeddingssocial2024-09
Candidate Generation in a Large Scale Graph Recommendation System: People You May Knowsocial2024-06
LLM-based Approach to Large-scale Item Category Classificationmarketplace2024-05
How we improved the 'Unfamiliar' setting recommendation algorithm in Yandex Musicmedia-streaming2024-05
Shazam for Full Names: Finding a Match When a Name Can Be Written 20 Different Waysfintech2024-05
How We Launched a New Promotion Model: Matching and Regional Testsclassifieds2024-05
Optimizing Marketplace Operations with Language Modelsmarketplace2024-05
From Platonic Dialogues to Strong AI, or a Few Words on Multimodal RAG for LLMsgeneral2024-05
Building DoorDash's product knowledge graph with large language modelsfood-delivery2024-04
Fine-Tuned CLIP: Better Listing Experience and 80% More Budget-Friendlymarketplace2023-12
Candidate Generation Using a Two Tower Approach With Expedia Group Traveler Datatravel2023-12
Adopting the Vespa search engine for serving personalized second-hand fashion recommendations at Vintedmarketplace2023-10
How LinkedIn Is Using Embeddings to Up Its Match Game for Job Seekerssocial2023-10
From Pre-trained to Fine-tuned: Nextdoor’s Path to Effective Embedding Applicationssocial2023-09
Scaling the Instagram Explore recommendations systemsocial2023-08
Improving Item Recommendation Accuracy Using Collaborative Filtering and Vector Search Enginemarketplace2023-06
Embedding-based Retrieval with Two-Tower Models in Spotlightsocial2023-06
How We Relaunched Recommendations at Auto.ruclassifieds2023-05
Deploying Transformers in Yandex Musicmedia-streaming2023-05
Semantic Search for Organizationssearch-engine2023-05
NER for Marketplace Search Queriesmarketplace2023-05
Automating New Product Onboarding in a Marketplace with MLmarketplace2023-05
Text Deduplication: A Review—banking2023-05
From Image Classification to Multitask Modeling: Building Etsy's Search by Image Featuremarketplace2023-05
Representation online matters: practical end-to-end diversification in search and recommender systemssocial2023-05
eBay’s Blazingly Fast Billion-Scale Vector Similarity Enginemarketplace2023-05
How eBay's New Search Feature Was Inspired By Window Shoppinge-commerce2023-03
Personalized snippet suggestions without storing user text (Grammarly)saas-b2b2023-01
Personalized 'Complete the Look' modelretail2023-01
When a picture is worth more than wordstravel2022-12