Method

Multimodal embeddings

Joint image-text or audio-text embeddings such as CLIP and SigLIP.

25 cases from 15 companies apply Multimodal embeddings. 5 were checked in an online A/B test; 7 report results in production.

Typical tasks: Retrieve and rank from millions of items, Learn user and item embeddings, Rank search results, Evaluate models and 9 more. Companies: Meta, Avito, Yandex, Netflix, Sber, eBay and 9 more. Often combined with: Embedding similarity matching, Contrastive learning, Two-tower model, Approximate nearest neighbors, Self-supervised learning and 60 more.

GenRecs Tokenization: Transforming Ads Recommendation at Meta with Stable Model Vocabularyadtech2026-10
MAPS: Netflix’s Multimodal Asset Personalization at Scalemedia-streaming2026-08
Exploring Hierarchical Interest Representation For Meta Ads Deep Funnel Optimizationadtech2026-07
Evolution of Multi-Objective Optimization at Pinterest Home feedsocial2026-04
DashCLIP: Leveraging multimodal models for generating semantic embeddingsfood-delivery2026-02
Dense Retrievalmarketplace2025-11
Evaluating AI-generated images (The basics)general2025-06
Experience with Transformer-Based Personalization at Avitoclassifieds2025-05
Moderation Platformizationclassifieds2025-05
AI-Generated Music: Quality Evaluation Methodologies and Generation Optimizationmedia-streaming2025-05
Cycle Paths, Shashlik and Sakura: How Yandex Maps Built Seasonal Leisure Recommendationsgeneral2025-05
Snap Ads Understanding: From Pixels to Wordsadtech2025-04
Sequence learning: A paradigm shift for personalized ads recommendationsadtech2024-11
Multimodality and RAG, or How to Sit on Two Chairsgeneral2024-11
From Platonic Dialogues to Strong AI, or a Few Words on Multimodal RAG for LLMsgeneral2024-05
Multimodal Geo Embeddings: Methods, Results and Deploymentbanking2024-05
Launching Automated Video Moderationclassifieds2024-05
Product ML: Expectations vs. Reality. How to Describe the Organization in Briefgeneral2024-05
Fine-Tuned CLIP: Better Listing Experience and 80% More Budget-Friendlymarketplace2023-12
Building In-Video Searchmedia-streaming2023-11
Beyond Words: How Multimodal Embeddings Elevate eBay's Product Recommendationsmarketplace2023-09
Yelp Content As Embeddingsmarketplace2023-04
How eBay's New Search Feature Was Inspired By Window Shoppinge-commerce2023-03
Personalized 'Complete the Look' modelretail2023-01
Building a Relevance Model for Text and Video Informationmedia-streaming2022-06