Tool

Apache Airflow

50 cases from 36 companies use Apache Airflow in their stack. 11 were checked in an online A/B test; 24 report results in production. Tasks: Build a data platform, Retrieve and rank from millions of items, Catch fraud and abuse, Learn user and item embeddings and 19 more. Methods: Data quality checks, Gradient boosting, Semantic layer, A/B test, Probability calibration and 111 more. Companies: Pinterest, Lyft, Etsy, DoorDash, Rabota.ru, Avito and 30 more.

Metrics Board: Building an Agent-ready Metrics Layersocial2026-10
Refreshing the Travel-Time Map Behind Lyft’s Marketplace: Rebuilding Neighborhood Reachability Signalsmobility2026-09
Near Real-Time Media Analytics with Lakeflow Spark Declarative Pipelinesmedia-streaming2026-06
Beyond Tables: How Musinsa Built a Self-Optimizing Semantic Layer on Databrickse-commerce2026-06
Metric Semantic Layer: How Lyft Governs and Scales Key Data Definitionsmobility2026-06
ABsalute: A/B Testing Automationretail2026-05
ML Scoring of 3DS Authentications in a Payment Systemfintech2026-05
Unified Context-Intent Embeddings for Scalable Text-to-SQLsocial2026-03
Reducing experiment duration with predicted control variatese-commerce2025-11
Building the incremental and online training platform at LinkedInsocial2025-10
Building an anomaly detection platform at DoorDash to catch fraud trends earlyfood-delivery2025-09
Building Etsy Buyer Profiles with LLMsmarketplace2025-09
Milvus: Building a large-scale vector DB for LINE VOOM's real-time recommendation systemsocial2025-07
Increment vs Experiment: How to Reduce Uncertainty When Developing ML Modelse-commerce2025-05
How Pinterest Accelerates ML Feature Iterations via Effective Backfillsocial2025-05
500X Scalability of Experiment Metric Computing with Unified Dynamic Frameworksocial2025-05
Real-Time Spatial Temporal Forecasting @ Lyftmobility2025-05
Solving Data Discovery at Scale: How Wix Uses RAG and Multi-Agent Systems to Find the Right Data Fastsaas-b2b2025-05
HRBert2.0: Improving Vectorization of Vacancies and Resumesclassifieds2024-11
Leveraging RAG-powered LLMs for analytical tasksmobility2024-10
How We Personalized Recommendations for Professionals on Thumbtackmarketplace2024-06
Ranking or Calibration? How to Measure the Quality of Advertising CTR Modelsclassifieds2024-05
Scoring on Non-Bank Data—fintech2024-05
Experience Building a Data Quality Tool at MTStelecom2024-05
Predicting a Listing Category from Its Description and Photoclassifieds2024-05
Feature Script: Speeding Up Development Without Losing Reliabilitybanking2024-05
End-to-End Data Infrastructure and Processes for DE/DA/DSfintech2024-05
Data Quality as part of the Data Catalog at SIBUR. Experience implementing the practice in a large organizationgeneral2024-05
Shepherd: How Stripe adapted Chronon to scale ML feature developmentfintech2024-04
Empowering Deeper A/B Test Insights at Walmart through Self-Serve Custom Metrics for Experimentatione-commerce2024-01
Product Features: The Key to Increasing Model Efficiency for Account Propensitysaas-b2b2023-10
Evolving Recommendations: A Personalized User-Based Ranking Modele-commerce2023-10
Training Foundation Improvements for Closeup Recommendation Rankersocial2023-09
Expedia Group's Customer Lifetime Value Prediction Modeltravel2023-09
From Pre-trained to Fine-tuned: Nextdoor’s Path to Effective Embedding Applicationssocial2023-09
A Job Posting Summary Generation Service Based on an LM Fine-Tuned with RLHFclassifieds2023-05
History of the Unified Classifier Developmentbanking2023-05
How to Build Real-Time ML at a Crypto Exchangefintech2023-05
Modeling the Behavior of an Oil Spillmanufacturing2023-05
ML System Design Doc Challenge – Finalbanking2023-05
Machine Learning for Delivery Time Estimationclassifieds2023-05
How eBay's New Search Feature Was Inspired By Window Shoppinge-commerce2023-03
When a picture is worth more than wordstravel2022-12
2022 DoorDash Summer Intern Projects Article #2food-delivery2022-10
Attempt to improve item recommendation accuracy using Item2vecmarketplace2022-10
Recommend API: one shared pipeline for many recommendation features at Slacksaas-b2b2022-09
Scaling Product Recommendations using Basket Analysis- Part 1e-commerce2022-08
DL in finance: key results, production and new challengesbanking2022-06
From JSONs to a Data Platformhealthtech2022-06
Geo-based AB Testing and Difference-in-Difference Analysis in Instacart Catalogfood-delivery2022-06