Method

Uncertainty quantification

Prediction intervals, confidence of model outputs, conformal methods.

10 cases from 9 companies apply Uncertainty quantification. 2 were checked in an online A/B test; 3 report results in production.

Typical tasks: Evaluate models, Forecast demand and load, Label data with LLMs, Detect anomalies and 3 more. Companies: DoorDash, Indeed, HSE University, LinkedIn, Avito, Yandex and 3 more. Often combined with: Tabular deep learning, Multi-task learning, LLM labeling, Self-consistency / best-of-N, A/B test and 18 more.