REVIEW 4 cited by
GraPPa: Grammar-Augmented Pre-Training for Table Semantic Parsing
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
We present GraPPa, an effective pre-training approach for table semantic parsing that learns a compositional inductive bias in the joint representations of textual and tabular data. We construct synthetic question-SQL pairs over high-quality tables via a synchronous context-free grammar (SCFG) induced from existing text-to-SQL datasets. We pre-train our model on the synthetic data using a novel text-schema linking objective that predicts the syntactic role of a table field in the SQL for each question-SQL pair. To maintain the model's ability to represent real-world data, we also include masked language modeling (MLM) over several existing table-and-language datasets to regularize the pre-training process. On four popular fully supervised and weakly supervised table semantic parsing benchmarks, GraPPa significantly outperforms RoBERTa-large as the feature representation layers and establishes new state-of-the-art results on all of them.
Forward citations
Cited by 4 Pith papers
-
The Nuts and Bolts of Natural Language to SQL Translation: A Systematic Analysis of Model Pipeline Optimisation Approaches and their Interactions
Ablation and Shapley analysis of NatSQL, GAZP synthetic fine-tuning, token preprocessing, and a novel beam reranker on SmBoP and RASAT show that component interactions—not full stacking—drive the best lightweight NL2S...
-
Interactive Text-to-SQL via Expected Information Gain for Disambiguation
An interactive text-to-SQL framework selects clarification questions by expected information gain over a distribution of candidate SQL queries.
-
StreamLink: Large-Language-Model Driven Distributed Data Engineering System
A locally deployed LLM-based distributed data system converts natural language to SQL, and its fine-tuned Llama-3.1-8B model reaches 86.9% exact match and 89.7% execution accuracy on the Spider dev set.
-
Meta-aware Learning in text-to-SQL Large Language Model
Combining schema, chain-of-thought, metadata knowledge, and tokenized prompt structures during fine-tuning improves text-to-SQL execution accuracy on private business databases compared to schema-only fine-tuning.
Discussion (0). Continue with ORCID to comment.