Method

Overlap annotation

Several annotators label the same item to measure and aggregate.

16 cases from 10 companies apply Overlap annotation. 1 was checked in an online A/B test; 9 report results in production.

Typical tasks: Label data with LLMs, Evaluate models, Moderate content at scale, Predict long-term effect from short tests and 1 more. Companies: Alfa-Bank, Yandex, Avito, SberDevices, Airbnb, Celsus and 4 more. Often combined with: TF-IDF, Text classification, Clustering, LSTM, Multi-label classification and 38 more.