Method

Probability calibration

Platt, isotonic and temperature scaling of scores.

30 cases from 20 companies apply Probability calibration. 11 were checked in an online A/B test; 8 report results in production. Includes variants: Platt scaling.

Typical tasks: Evaluate models, Optimize decisions, Rank search results, Decide who gets an offer and 11 more. Companies: Avito, LinkedIn, Pinterest, Spotify, Etsy, Affirm and 14 more. Often combined with: Platt scaling, Multi-task learning, Gradient boosting, A/B test, SHAP and 71 more.

The Model Is Not the Modelingfintech2026-09
Roonomics: How Economics Helped Us to Build a Churn Prediction Modelfood-delivery2026-09
When Can LLMs Replace Humans in A/B Tests?media-streaming2026-08
How Ad Ranking Works at Avitoclassifieds2026-05
ML Scoring of 3DS Authentications in a Payment Systemfintech2026-05
Attribution of Long-Range Actions in Conversion Modelsclassifieds2026-05
When Models Should Stay Silentgeneral2026-05
Making Ads Count: Using MMoE and Auxiliary Tasks to Better Connect Buyers & Sellersmarketplace2026-03
Unifying Ads Engagement Modeling Across Pinterest Surfacesadtech2026-03
Universal Document Processing at Gusto: From One-Off Parsers to a Self-Service Platformsaas-b2b2026-02
Criteo Boosts Ad Performance with Latest AI Advancementsadtech2025-11
Normalized Entropy or Apply Rate? Evaluation Metrics for Online Modeling Experimentsmarketplace2025-11
Building the incremental and online training platform at LinkedInsocial2025-10
Optimizing Relevance When Sorting by Price in Marketmarketplace2025-05
ML in AdTech. The Battle for the Click: How We Beat Historical CTR in Advertisingadtech2025-05
Module Relevance on Home Feedsocial2025-03
Building Confidence: A Case Study in How to Create Confidence Scores for GenAI Applicationsfintech2024-12
Candidate Generation in a Large Scale Graph Recommendation System: People You May Knowsocial2024-06
Ranking or Calibration? How to Measure the Quality of Advertising CTR Modelsclassifieds2024-05
Building a Large-Scale Recommendation System: People You May Knowsocial2024-02
Product Features: The Key to Increasing Model Efficiency for Account Propensitysaas-b2b2023-10
Training Foundation Improvements for Closeup Recommendation Rankersocial2023-09
Leveraging Real-Time User Actions to Personalize Etsy Adsmarketplace2023-07
NLP at Alfa-Bank, Part 3: Modelingbanking2023-05
ML System Design Doc Challenge – Finalbanking2023-05
Calibrating CTR Prediction with Transfer Learning in Instacart Adsadtech2022-09
Challenges and practical lessons from building a deep-learning-based ads CTR prediction modeladtech2022-08
From look-alike to uplift in customer lifecycle modelsbanking2022-06
Calibration of the Prediction Scores: How does it help?adtech2022-05
Machine Learning for Snapchat Ad Rankingadtech2022-02