AQuA: Automated Question-Answering in Software Tutorial Videos with Visual Anchors
arxiv(2024)
摘要
Tutorial videos are a popular help source for learning feature-rich software.
However, getting quick answers to questions about tutorial videos is difficult.
We present an automated approach for responding to tutorial questions. By
analyzing 633 questions found in 5,944 video comments, we identified different
question types and observed that users frequently described parts of the video
in questions. We then asked participants (N=24) to watch tutorial videos and
ask questions while annotating the video with relevant visual anchors. Most
visual anchors referred to UI elements and the application workspace. Based on
these insights, we built AQuA, a pipeline that generates useful answers to
questions with visual anchors. We demonstrate this for Fusion 360, showing that
we can recognize UI elements in visual anchors and generate answers using GPT-4
augmented with that visual information and software documentation. An
evaluation study (N=16) demonstrates that our approach provides better answers
than baseline methods.
更多查看译文
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络
Chat Paper
正在生成论文摘要