Lower-Left Partial AUC: An Effective and Efficient Optimization Metric for Recommendation
WWW 2024(2024)
摘要
Optimization metrics are crucial for building recommendation systems at
scale. However, an effective and efficient metric for practical use remains
elusive. While Top-K ranking metrics are the gold standard for optimization,
they suffer from significant computational overhead. Alternatively, the more
efficient accuracy and AUC metrics often fall short of capturing the true
targets of recommendation tasks, leading to suboptimal performance. To overcome
this dilemma, we propose a new optimization metric, Lower-Left Partial AUC
(LLPAUC), which is computationally efficient like AUC but strongly correlates
with Top-K ranking metrics. Compared to AUC, LLPAUC considers only the partial
area under the ROC curve in the Lower-Left corner to push the optimization
focus on Top-K. We provide theoretical validation of the correlation between
LLPAUC and Top-K ranking metrics and demonstrate its robustness to noisy user
feedback. We further design an efficient point-wise recommendation loss to
maximize LLPAUC and evaluate it on three datasets, validating its effectiveness
and robustness.
更多查看译文
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络
Chat Paper
正在生成论文摘要