Method
Canary rollout
Gradual release of a model or change to a traffic share.
17 cases from 16 companies apply Canary rollout. 6 were checked in an online A/B test; 8 report results in production.
Typical tasks: Build a data platform, Avoid false wins in A/B tests, Evaluate models, Reduce ML cost and 10 more. Companies: Netflix, Yelp, Thumbtack, Airbnb, Raiffeisenbank, Meta and 10 more. Often combined with: A/B test, Time-based validation, Data drift monitoring, Sequential testing, Holdout / global control group and 31 more.
