Pith. sign in

REVIEW 31 cited by

TAT-QA: A Question Answering Benchmark on a Hybrid of Tabular and Textual Content in Finance

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2105.07624 v2 pith:YU4ATALK submitted 2021-05-17 cs.CL cs.AI

TAT-QA: A Question Answering Benchmark on a Hybrid of Tabular and Textual Content in Finance

classification cs.CL cs.AI
keywords datahybridtat-qareasoningtabulartextualansweranswering
verification ladder T0 review T1 audit T2 compute T3 formal T4 reserved
0 comments
Share X Bluesky LinkedIn Reddit HN
read the original abstract

Hybrid data combining both tabular and textual content (e.g., financial reports) are quite pervasive in the real world. However, Question Answering (QA) over such hybrid data is largely neglected in existing research. In this work, we extract samples from real financial reports to build a new large-scale QA dataset containing both Tabular And Textual data, named TAT-QA, where numerical reasoning is usually required to infer the answer, such as addition, subtraction, multiplication, division, counting, comparison/sorting, and the compositions. We further propose a novel QA model termed TAGOP, which is capable of reasoning over both tables and text. It adopts sequence tagging to extract relevant cells from the table along with relevant spans from the text to infer their semantics, and then applies symbolic reasoning over them with a set of aggregation operators to arrive at the final answer. TAGOPachieves 58.0% inF1, which is an 11.1% absolute increase over the previous best baseline model, according to our experiments on TAT-QA. But this result still lags far behind performance of expert human, i.e.90.8% in F1. It is demonstrated that our TAT-QA is very challenging and can serve as a benchmark for training and testing powerful QA models that address hybrid form data.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 31 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. FIND: Toward Multimodal Financial Reasoning and Question Answering for Indic Languages

    cs.CL 2026-05 unverdicted novelty 7.0

    FinVQA is a new multilingual benchmark for Indic financial VQA with three difficulty levels and four formats, paired with the FIND framework for faithful numerical reasoning via fine-tuning and constrained decoding.

  2. Fin-Bias: Comprehensive Evaluation for LLM Decision-Making under human bias in Finance Domain

    cs.CL 2026-05 unverdicted novelty 7.0

    LLMs copy biased analyst ratings in investment decisions but a new detection method encourages independent reasoning and can improve stock return predictions beyond human levels.

  3. VT-Bench: A Unified Benchmark for Visual-Tabular Multi-Modal Learning

    cs.CV 2026-05 unverdicted novelty 7.0

    VT-Bench is the first unified benchmark aggregating 14 visual-tabular datasets with over 756K samples and evaluating 23 models to expose challenges in this multi-modal area.

  4. VT-Bench: A Unified Benchmark for Visual-Tabular Multi-Modal Learning

    cs.CV 2026-05 unverdicted novelty 7.0

    VT-Bench aggregates 14 datasets totaling over 756K samples across 9 domains and evaluates 23 models to establish a unified testbed for visual-tabular multi-modal discriminative and generative tasks.

  5. VT-Bench: A Unified Benchmark for Visual-Tabular Multi-Modal Learning

    cs.CV 2026-05 unverdicted novelty 7.0

    VT-Bench aggregates 14 datasets from 9 domains and evaluates 23 models to standardize visual-tabular discriminative and generative tasks.

  6. The Power of Order: Fooling LLMs with Adversarial Table Permutations

    cs.LG 2026-05 unverdicted novelty 7.0

    Semantically invariant row and column permutations can fool LLMs on tabular tasks, and a new gradient-based attack called ATP finds such permutations to significantly degrade performance across models.

  7. INDOTABVQA: A Benchmark for Cross-Lingual Table Understanding in Bahasa Indonesia Documents

    cs.CV 2026-04 conditional novelty 7.0

    INDOTABVQA is a new benchmark dataset for cross-lingual table visual question answering on Bahasa Indonesia documents that exposes VLM weaknesses on complex tables and low-resource languages while showing gains from f...

  8. FinAuditing: A Financial Taxonomy-Structured Multi-Document Benchmark for Evaluating LLMs

    cs.CL 2025-10 unverdicted novelty 7.0

    FinAuditing is a taxonomy-structured multi-document benchmark with 1,102 instances averaging over 33k tokens from XBRL filings, defining three tasks to evaluate LLMs on financial auditing capabilities.

  9. Rethinking Information Synthesis in Multimodal Question Answering A Multi-Agent Perspective

    cs.CL 2025-05 unverdicted novelty 7.0

    MAMMQA is a multi-agent framework that decomposes multimodal queries, retrieves modality-specific answers, performs cross-modal synthesis with VLMs, and integrates results via an LLM to outperform single-model baselin...

  10. FinTagging: Benchmarking LLMs for Extracting and Structuring Financial Information

    cs.CL 2025-05 unverdicted novelty 7.0

    FinTagging decomposes XBRL tagging into FinNI extraction and FinCL full-taxonomy linking, showing LLMs handle extraction but struggle with fine-grained concept alignment in zero-shot settings.

  11. FLARE: Fully Integration of Vision-Language Representations for Deep Cross-Modal Understanding

    cs.CV 2025-04 unverdicted novelty 7.0

    FLARE is a vision-language model family using text-guided vision encoding, context-aware alignment decoding, dual-semantic mapping loss, and text-driven VQA synthesis to achieve deep cross-modal integration, outperfor...

  12. CLExEval: A Human-in-the-Loop Framework for Qualitative Evaluation of LLM Clinical Reasoning

    cs.CL 2026-06 unverdicted novelty 6.0

    CLExEval introduces a human-annotated evaluation framework on 40 rare cases that identifies verbosity bias, hidden knowledge paradox, and 68.6% reasoning-to-output mismatch in LLMs while showing LLM-as-a-Judge overest...

  13. BlueFin: Benchmarking LLM Agents on Financial Spreadsheets

    cs.SE 2026-05 unverdicted novelty 6.0

    BlueFin is a new benchmark for LLM agents on financial spreadsheets showing frontier models score below 50% with weaknesses in dynamic correctness.

  14. Design and Report Benchmarks for Knowledge Work

    cs.AI 2026-05 unverdicted novelty 6.0

    Proposes a three-step benchmark design method (define work activity, specify tested setting, score work product) derived from work studies and O*NET, demonstrated via three case analyses.

  15. FINESSE-Bench: A Hierarchical Benchmark Suite for Financial Domain Knowledge and Technical Analysis in Large Language Models

    cs.CL 2026-05 unverdicted novelty 6.0

    FINESSE-Bench is a hierarchical benchmark suite of eight datasets with 3,993 questions for evaluating LLMs on financial domain knowledge, technical analysis, and professional competencies.

  16. FINESSE-Bench: A Hierarchical Benchmark Suite for Financial Domain Knowledge and Technical Analysis in Large Language Models

    cs.CL 2026-05 unverdicted novelty 6.0

    FINESSE-Bench is a new hierarchical benchmark suite combining certification-style exams, trading tasks, and a Russian olympiad set to evaluate LLMs on financial competencies at multiple difficulty levels.

  17. The Power of Order: Fooling LLMs with Adversarial Table Permutations

    cs.LG 2026-05 unverdicted novelty 6.0

    Semantically invariant row and column permutations in tables can cause LLMs to output incorrect answers, and a gradient-based attack called ATP efficiently finds such permutations that degrade performance across many models.

  18. Generalizing Numerical Reasoning in Table Data through Operation Sketches and Self-Supervised Learning

    cs.LG 2026-04 unverdicted novelty 6.0

    TaNOS improves cross-domain numerical reasoning over tables by combining header anonymization, operation sketches, and self-supervised pretraining, achieving 80.13% accuracy on FinQA with 10% of training data.

  19. FinToolBench: Evaluating LLM Agents for Real-World Financial Tool Use

    cs.AI 2026-03 conditional novelty 6.0

    FinToolBench couples 760 executable financial APIs with 295 tool-required queries and scores agents on execution success plus timeliness, intent, and domain compliance, with a finance-aware retrieval baseline (FATR).

  20. AlphaForgeBench: Benchmarking End-to-End Trading Strategy Design with Large Language Models

    q-fin.TR 2026-02 conditional novelty 6.0

    LLMs are unreliable when asked to emit buy/sell/hold actions, so this paper benchmarks them as code-writing quantitative researchers whose generated strategies are backtested deterministically.

  21. CLBench-V: Evaluating Multimodal Context Learning from Grounding to Knowledge Acquisition

    cs.CV 2026-07 conditional novelty 5.0

    Multimodal context-learning benchmark CLBench-V separates grounding, information application, and knowledge acquisition; the best evaluated model scores 0.2847.

  22. Generalizing Numerical Reasoning in Table Data through Operation Sketches and Self-Supervised Learning

    cs.LG 2026-04 unverdicted novelty 5.0

    TaNOS decouples table semantics from numerical structure via anonymization, sketches, and program-first self-supervision, yielding 80.13% FinQA accuracy with 10% data and near-zero cross-domain gap versus over 10pp fo...

  23. Empirical Evaluation of PDF Parsing and Chunking for Financial Question Answering with RAG

    cs.CL 2026-04 unverdicted novelty 5.0

    Systematic tests show that specific PDF parsers combined with overlapping chunking strategies better preserve structure and improve RAG answer correctness on financial QA benchmarks including the new TableQuest dataset.

  24. When Tables Go Crazy: Evaluating Multimodal Models on French Financial Documents

    cs.CL 2026-02 conditional novelty 5.0

    A new French financial document benchmark shows vision-language models are strong at text/table extraction but brittle on charts and multi-turn dialogue, with accuracy converging near 50% in conversational settings.

  25. Attention Grounded Enhancement for Visual Document Retrieval

    cs.IR 2025-11 unverdicted novelty 5.0

    AGREE boosts visual document retrieval by adding local relevance signals from MLLM attention maps to global document labels during retriever training.

  26. RELOOP: Recursive Retrieval with Multi-Hop Reasoner and Planners for Heterogeneous QA

    cs.CL 2025-10 unverdicted novelty 5.0

    RELOOP unifies retrieval across text, tables, and KGs via hierarchical sequences and dual-agent guided iteration, reporting EM/F1 gains over baselines on HotpotQA, HybridQA/TAT-QA, and MetaQA.

  27. Hierarchical Reranking for Scalable Financial RAG System

    cs.IR 2026-07 reject novelty 4.0

    A finance-specific RAG pipeline combining table-to-JSON conversion, two-stage reranking, and long-context split-fusion reports NDCG@20=0.7918 and second place in the ICAIF '24 FinanceRAG challenge.

  28. LLM-Guided Planning for Multi-hop Reasoning over Multimodal Nuclear Regulatory Documents

    cs.AI 2026-06 unverdicted novelty 4.0

    LLM planning agent with dynamic KG state achieves 81.5% accuracy on 200 multi-hop questions from NuScale FSAR documents, outperforming non-planning RAG baselines by up to 38pp.

  29. PHLoRA: data-free Post-hoc Low-Rank Adapter extraction from full-rank checkpoint

    cs.LG 2025-09 conditional novelty 3.0

    PHLoRA extracts LoRA-compatible adapters from full-rank fine-tuned models via truncated SVD of the weight delta, matching full-rank performance on several benchmarks with no gradients or training data.

  30. A Primer in Post-Training Reasoning Data: What We Know About How It Works

    cs.CL 2026-06 unverdicted novelty 2.0

    A literature synthesis that organizes post-training reasoning data research around data objects, usefulness factors, construction methods, and scaling behaviors to create an attribution framework.

  31. Bridging Language Models and Financial Analysis

    q-fin.ST 2025-03 unverdicted novelty 2.0

    A survey synthesizing recent LLM research and assessing its applicability to financial data analysis.