aiqbench analysis
The paper applies a transformer encoder to multitask recommendation ranking, with a lightweight causal debiasing step and an inference stack for serving at scale. Its most useful finding for ML practitioners is that simpler designs repeatedly beat more complex alternatives, both offline and in production. The reported gains (over 1% in a key engagement metric, 0.5% in daily active users) come from a single company's deployment, so the transferable value lies in the data-engineering and debiasing lessons rather than in the specific model.
DRanker: A Transformer-Based Multi-Task Ranking Model for the Disney+ Homepage
arXiv:2610.15696v1 Announce Type: new Abstract: We present DRanker (Disney+ Ranker), a transformer-based multitask ranking model serving personalized recommendations on the Disney+ homepage. We describe the encoder-only architecture over enriched engagement-history sequences paired with a lightweight causal debiasing mechanism, and the inference stack that enables transformer-based ranking at scale. Through iterative development, we systematically evaluated more complex alternatives and found that simpler designs consistently outperformed them on offline metrics, qualitative behavioral evaluation, and in production. Deployed globally, DRanker drives over 1% lift in our key engagement metric and 0.5% lift in daily active users across all experiences powered by the ranker. We share practical lessons on data engineering, debiasing, and architectural choices that shaped our ranking system at scale.
Abstract:We present DRanker (Disney+ Ranker), a transformer-based multitask ranking model serving personalized recommendations on the Disney+ homepage. We describe the encoder-only architecture over enriched engagement-history sequences paired with a lightweight causal debiasing mechanism, and the inference stack that enables transformer-based ranking at scale. Through iterative development, we systematically evaluated more complex alternatives and found that simpler designs consistently outperformed them on offline metrics, qualitative behavioral evaluation, and in production. Deployed globally, DRanker drives over 1% lift in our key engagement metric and 0.5% lift in daily active users across all experiences powered by the ranker. We share practical lessons on data engineering, debiasing, and architectural choices that shaped our ranking system at scale.
Machine Learning (cs.LG)
arXiv:2610.15696 [cs.LG]
(or arXiv:2610.15696v1 [cs.LG] for this version)
https://doi.org/10.48550/arXiv.2610.15696 Focus to learn more arXiv-issued DOI via DataCite (pending registration)
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.
Full text under the publisher's open licence · 207 words
