Discrete Semantic Tokenization for Deep CTR Prediction
Companion Proceedings of the ACM on Web Conference 2024(2024)
Abstract
Incorporating item content information into click-through rate (CTR)
prediction models remains a challenge, especially with the time and space
constraints of industrial scenarios. The content-encoding paradigm, which
integrates user and item encoders directly into CTR models, prioritizes space
over time. In contrast, the embedding-based paradigm transforms item and user
semantics into latent embeddings and then caches them, prioritizes space over
time. In this paper, we introduce a new semantic-token paradigm and propose a
discrete semantic tokenization approach, namely UIST, for user and item
representation. UIST facilitates swift training and inference while maintaining
a conservative memory footprint. Specifically, UIST quantizes dense embedding
vectors into discrete tokens with shorter lengths and employs a hierarchical
mixture inference module to weigh the contribution of each user–item token
pair. Our experimental results on news recommendation showcase the
effectiveness and efficiency (about 200-fold space compression) of UIST for CTR
prediction.
MoreTranslated text
AI Read Science
Must-Reading Tree
Example
![](https://originalfileserver.aminer.cn/sys/aminer/pubs/mrt_preview.jpeg)
Generate MRT to find the research sequence of this paper
Chat Paper
Summary is being generated by the instructions you defined