Method
Overlap annotation
Several annotators label the same item to measure and aggregate.
16 cases from 10 companies apply Overlap annotation. 1 was checked in an online A/B test; 9 report results in production.
Typical tasks: Label data with LLMs, Evaluate models, Moderate content at scale, Predict long-term effect from short tests and 1 more. Companies: Alfa-Bank, Yandex, Avito, SberDevices, Airbnb, Celsus and 4 more. Often combined with: TF-IDF, Text classification, Clustering, LSTM, Multi-label classification and 38 more.




