Warming up a Cold User

Valeria Mozharova25 May 2024

Problem

Dzen, a content feed, treats a user as cold during the first three days on the platform. In that window the person decides whether to come back. The team has no history for such users, yet the feed must find what hooks them and adapt fast to every like, dislike and scroll-past. One liked cat video must not turn the whole feed into cats. The goal was to raise retention, positive interactions and time spent.

Example from the article: a hidden user loves Korean cinema and K-pop. After cars and cooking (scroll-past), history (dislike) and movies (positive), seven items narrow the guess to Korean youth culture, movies and music.

Solution in brief

Split the core audience into 70 segments, then treat the new user as an unknown segment, as in the Akinator guessing game. Each item shown is a question, and the reaction is the answer. At each step pick the item whose possible reactions minimize the weighted entropy of the user's distribution over segments. In an A/B test on new users this gave +10% positive interactions and +4% time spent.

Questions this case answers
  • How to recommend items to a user with no interaction history by choosing the next item that most quickly reduces uncertainty about the user's segment, under a strict latency budget
  • How to adapt a feed quickly to likes, dislikes and skips so that one reaction does not dominate the whole recommendation list
  • How to recommend content to a new user with no interaction history
  • How to pick the first items for a cold user so the feed learns their interests fastest

Tools and methods

  • ALS decomposition and clustering — build 70 audience segments from the interaction matrix.
  • Bayes' formula with conditional independence — estimates the user's distribution over segments from their reaction history.
  • Entropy minimization — chooses the next item to show.
  • Explore/exploit quotas — keep part of the feed for exploration.
Continue reading — it's free

Google or a one-time email code. No password.