Multimodal Query Suggestion with Multi-Agent Reinforcement Learning from Human Feedback
WWW '24 Proceedings of the ACM on Web Conference 2024(2024)
Abstract
In the rapidly evolving landscape of information retrieval, search enginesstrive to provide more personalized and relevant results to users. Querysuggestion systems play a crucial role in achieving this goal by assistingusers in formulating effective queries. However, existing query suggestionsystems mainly rely on textual inputs, potentially limiting user searchexperiences for querying images. In this paper, we introduce a novel MultimodalQuery Suggestion (MMQS) task, which aims to generate query suggestions based onuser query images to improve the intentionality and diversity of searchresults. We present the RL4Sugg framework, leveraging the power of LargeLanguage Models (LLMs) with Multi-Agent Reinforcement Learning from HumanFeedback to optimize the generation process. Through comprehensive experiments,we validate the effectiveness of RL4Sugg, demonstrating a 18compared to the best existing approach. Moreover, the MMQS has been transferredinto real-world search engine products, which yield enhanced user engagement.Our research advances query suggestion systems and provides a new perspectiveon multimodal information retrieval.
MoreTranslated text
AI Read Science
Must-Reading Tree
Example
![](https://originalfileserver.aminer.cn/sys/aminer/pubs/mrt_preview.jpeg)
Generate MRT to find the research sequence of this paper
Chat Paper
Summary is being generated by the instructions you defined