ViTextVQA: A Large-Scale Visual Question Answering Dataset for Evaluating Vietnamese Text Comprehension in Images
CoRR(2024)
摘要
Visual Question Answering (VQA) is a complicated task that requires the
capability of simultaneously processing natural language and images. Initially,
this task was researched, focusing on methods to help machines understand
objects and scene contexts in images. However, some text appearing in the image
that carries explicit information about the full content of the image is not
mentioned. Along with the continuous development of the AI era, there have been
many studies on the reading comprehension ability of VQA models in the world.
As a developing country, conditions are still limited, and this task is still
open in Vietnam. Therefore, we introduce the first large-scale dataset in
Vietnamese specializing in the ability to understand text appearing in images,
we call it ViTextVQA (\textbf{Vi}etnamese \textbf{Text}-based \textbf{V}isual
\textbf{Q}uestion \textbf{A}nswering dataset) which contains \textbf{over
16,000} images and \textbf{over 50,000} questions with answers. Through
meticulous experiments with various state-of-the-art models, we uncover the
significance of the order in which tokens in OCR text are processed and
selected to formulate answers. This finding helped us significantly improve the
performance of the baseline models on the ViTextVQA dataset. Our dataset is
available at this
\href{https://github.com/minhquan6203/ViTextVQA-Dataset}{link} for research
purposes.
更多查看译文
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络
Chat Paper
正在生成论文摘要