Method

Constrained decoding

Force LLM output to a grammar or schema via logit masking.

6 cases from 6 companies apply Constrained decoding. 2 were checked in an online A/B test; 2 report results in production.

Typical tasks: Recommend to new users and new items, Balance relevance and diversity, Recommend from what the user just did, Rank search results and 2 more. Companies: Netflix, VTB, Instacart, Raiffeisenbank, Alfa-Bank and 1 more. Often combined with: LLM-as-a-judge, Gradient boosting, Embedding similarity matching, LLM labeling, Label noise detection and 29 more.