Method

Label noise detection

Auditing and cleaning noisy labels (confident learning, blind audits).

10 cases from 8 companies apply Label noise detection. 1 was checked in an online A/B test; 4 report results in production.

Typical tasks: Catch fraud and abuse, Moderate content at scale, Detect anomalies, Recommend to new users and new items and 2 more. Companies: Alfa-Bank, Celsus, LY Corporation, DoorDash, Avito, Gusto and 2 more. Often combined with: Threshold selection, LoRA fine-tuning, LLM-as-a-judge, Gradient boosting, Constrained decoding and 33 more.