SciTaT is a 953-question benchmark requiring joint reasoning over scientific tables and text across four reasoning types, on which the proposed CAR pipeline outperforms standard prompting baselines.
A Survey on Table-and-Text HybridQA: Concepts, Methods, Challenges and Future Directions
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
abstract
Table-and-text hybrid question answering (HybridQA) is a widely used and challenging NLP task commonly applied in the financial and scientific domain. The early research focuses on migrating other QA task methods to HybridQA, while with further research, more and more HybridQA-specific methods have been present. With the rapid development of HybridQA, the systematic survey is still under-explored to summarize the main techniques and advance further research. So we present this work to summarize the current HybridQA benchmarks and methods, then analyze the challenges and future directions of this task. The contributions of this paper can be summarized in three folds: (1) first survey, to our best knowledge, including benchmarks, methods and challenges for HybridQA; (2) systematic investigation with the reasonable comparison of the existing systems to articulate their advantages and shortcomings; (3) detailed analysis of challenges in four important dimensions to shed light on future directions.
fields
cs.CL 1years
2024 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
SCITAT: A Question Answering Benchmark for Scientific Tables and Text Covering Diverse Reasoning Types
SciTaT is a 953-question benchmark requiring joint reasoning over scientific tables and text across four reasoning types, on which the proposed CAR pipeline outperforms standard prompting baselines.