Increasing Travelers' Engagement Through Price Alerts

Dammy Arinde, Henok Yemam14 Oct 2023

Problem

Expedia lets travelers subscribe to a flight search and get push notifications when the price changes. Every notification has a cost, and one nobody opens means the content is irrelevant to that traveler. The team started with a static business rule for deciding when to send, which cannot adapt to individual preferences or limit user fatigue. The goal was to raise opt-in, the share of subscribers who get notifications, and the open rate, and to lower opt-out.

Example from the article: a traveler tracks SEA to LAX and SEA to DSM, and every 24 hours the system decides whether to push each price change.

Solution in brief

Train a binary classifier that predicts whether a subscriber will directly open a notification, and send only when the predicted open likelihood is high, scoring every subscription every 24 hours. Safeguard rules then override the model so that subscribers without notifications and subscriptions with large price moves still receive a message.

Questions this case answers
  • How to choose which of many scheduled push messages to send to each subscriber when every message has a cost and over-sending causes fatigue
  • How to keep a propensity model from excluding users whose past behavior gives it no reason to contact them
  • How to decide which price-alert push notifications to send so that users open them without getting notification fatigue?
  • How to replace a static business rule for push notifications with a model that predicts opens?

Tools and methods

  • Random forest classifier — predicts whether a notification will be opened.
  • Safeguard rules — time-since-subscription and price-change thresholds that override the model.
  • Automated Model Tuning (AMT) — Expedia's in-house wrapper over Hyperopt and MLflow for hyperparameter search and experiment tracking.
  • scikit-learn RandomizedSearchCV — the earlier hyperparameter search, replaced by AMT.
Continue reading — it's free

Google or a one-time email code. No password.