Method
Quantization
Lower-precision weights or activations for faster, smaller models.
26 cases from 12 companies apply Quantization. 7 were checked in an online A/B test; 10 report results in production.
Typical tasks: Reduce ML cost, Recommend from what the user just did, Retrieve and rank from millions of items, Evaluate models and 7 more. Companies: Yandex, Meta, Pinterest, Instacart, VTB, Mercari and 6 more. Often combined with: Knowledge distillation, Two-tower model, Multi-task learning, CTR / feedback prediction, RAG and 70 more.




