TabSQLify: Enhancing Reasoning Capabilities of LLMs Through Table Decomposition
CoRR(2024)
Abstract
Table reasoning is a challenging task that requires understanding both
natural language questions and structured tabular data. Large language models
(LLMs) have shown impressive capabilities in natural language understanding and
generation, but they often struggle with large tables due to their limited
input length. In this paper, we propose TabSQLify, a novel method that
leverages text-to-SQL generation to decompose tables into smaller and relevant
sub-tables, containing only essential information for answering questions or
verifying statements, before performing the reasoning task. In our
comprehensive evaluation on four challenging datasets, our approach
demonstrates comparable or superior performance compared to prevailing methods
reliant on full tables as input. Moreover, our method can reduce the input
context length significantly, making it more scalable and efficient for
large-scale table reasoning applications. Our method performs remarkably well
on the WikiTQ benchmark, achieving an accuracy of 64.7
TabFact benchmark, it achieves a high accuracy of 79.5
other LLM-based baseline models on gpt-3.5-turbo (chatgpt). TabSQLify can
reduce the table size significantly alleviating the computational load on LLMs
when handling large tables without compromising performance.
MoreTranslated text
AI Read Science
Must-Reading Tree
Example
![](https://originalfileserver.aminer.cn/sys/aminer/pubs/mrt_preview.jpeg)
Generate MRT to find the research sequence of this paper
Chat Paper
Summary is being generated by the instructions you defined