Method

Threshold selection

Choosing decision thresholds by cost, profit or fixed error rates.

48 cases from 32 companies apply Threshold selection. 8 were checked in an online A/B test; 16 report results in production.

Typical tasks: Catch fraud and abuse, Moderate content at scale, Optimize decisions, Detect anomalies and 13 more. Companies: Gusto, VTB, DoorDash, Airbnb, Yelp, LY Corporation and 26 more. Often combined with: Gradient boosting, Human in the loop, Embedding similarity matching, Rule-based heuristics, Text classification and 110 more.

Composing Fraud Rules at the Speed of the Attackfintech2026-11
Developing a model to detect harmful content from OpenChat titles and descriptionssocial2026-08
From Prompt to Classifier: A Production Case Studysaas-b2b2026-06
Uplift Models in Promotional Offersbanking2026-05
An Automated Request Handling Service for SMBsbanking2026-05
Financial Benchmarksfintech2026-03
How Rovo solves search challenges through entity linkingsaas-b2b2026-01
SafeChat: DoorDash's AI-powered safety featurefood-delivery2025-10
Building Slack’s Anomaly Event Responsesaas-b2b2025-09
Comment ranker - An ML-based classifier to improve LLM code review quality using Atlassian's proprietary datasaas-b2b2025-08
ML in AdTech. The Battle for the Click: How We Beat Historical CTR in Advertisingadtech2025-05
Estimating Generative Model Confidence in Data Labelinggeneral2025-05
A Data-Driven Approach to Subscriber Scoring in Telecomtelecom2025-05
Moderation Platformizationclassifieds2025-05
A Short-Term Anomaly Forecasting Model for Univariate Time Series and Its Use in the Sfera.IAS Productgeneral2025-05
Developing a multi-label classification model for OpenChat hashtag predictionsocial2025-05
Tackling AI Hallucinations in LLM Appssaas-b2b2025-02
Improving search ranking for Mapstravel2024-12
The ML flywheel: How we continually improve our models to reduce card testingfintech2024-12
Tackling the Human Cost of R&D Tax Credit Qualification with AI-Powered Modelssaas-b2b2024-09
NEP: Notification System and Relevancesocial2024-08
Using Predictive and Gen AI to Improve Product Categorization at Walmarte-commerce2024-07
ETA (Estimated Time of Arrival) Reliability at Lyftmobility2024-06
Traffic Filtering in Programmatic Adsadtech2024-05
Real-Time Pre-Authorization for Taxi Orders: From Rules to Machine Learningmobility2024-05
Marketplace Product Matching in Detail: Models, Approaches and Tips for Building an Effective Matcher for Tens of Millions of Productsmarketplace2024-05
Predictive Analysis of Infrastructure Risks on Railway Tracksmanufacturing2024-05
Anomaly Detection: Anomaly Scoring for Preventive Detection of Information System Failuresbanking2024-05
How We Fought Spam in Reviewsmarketplace2024-05
Moderating Inappropriate Video Content at Yelpmarketplace2024-03
Yelp’s AI pipeline for inappropriate language detection in reviewsmarketplace2024-03
Navigating Fair Housing Guardrails in LLMsmarketplace2024-01
Augmenting our content moderation efforts through machine learning and dynamic content prioritizationsocial2023-11
Risk Entity Watch - Using Anomaly Detection to Fight Fraudmobility2023-09
How Instacart's item availability evolved over the pandemicmarketplace2023-07
Please Don't Shout. ML vs Operators: 1-0general2023-05
ML System Design Doc Challenge – Finalbanking2023-05
An ML based approach to proactive advertiser churn preventionadtech2023-05
Yelp Content As Embeddingsmarketplace2023-04
Building Airbnb Categories with ML & Human in the Looptravel2023-03
Automated profile picture moderation at BlaBlaCar using Deep Learningmobility2023-03
How BlaBlaCar leverages machine learning to match passengers and driversmobility2023-03
How DoorDash Upgraded a Heuristic with ML to Save Thousands of Canceled Ordersfood-delivery2023-01
Building Airbnb Categories with ML and human-in-the-looptravel2022-11
Incorporating Listing Descriptions into the Zestimateclassifieds2022-11
Using mobile sensor data to encourage safer drivingmobility2022-10
Augmenting Fuzzy Matching with Human Review to Maximize Precision and Recalladtech2022-10
In-house monitoring of Payments success ratee-commerce2022-02