REVIEW 7 cited by
A Comprehensive Exploration on WikiSQL with Table-Aware Word Contextualization
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
We present SQLova, the first Natural-language-to-SQL (NL2SQL) model to achieve human performance in WikiSQL dataset. We revisit and discuss diverse popular methods in NL2SQL literature, take a full advantage of BERT {Devlin et al., 2018) through an effective table contextualization method, and coherently combine them, outperforming the previous state of the art by 8.2% and 2.5% in logical form and execution accuracy, respectively. We particularly note that BERT with a seq2seq decoder leads to a poor performance in the task, indicating the importance of a careful design when using such large pretrained models. We also provide a comprehensive analysis on the dataset and our model, which can be helpful for designing future NL2SQL datsets and models. We especially show that our model's performance is near the upper bound in WikiSQL, where we observe that a large portion of the evaluation errors are due to wrong annotations, and our model is already exceeding human performance by 1.3% in execution accuracy.
Forward citations
Cited by 7 Pith papers
-
The Nuts and Bolts of Natural Language to SQL Translation: A Systematic Analysis of Model Pipeline Optimisation Approaches and their Interactions
Ablation and Shapley analysis of NatSQL, GAZP synthetic fine-tuning, token preprocessing, and a novel beam reranker on SmBoP and RASAT show that component interactions—not full stacking—drive the best lightweight NL2S...
-
SDE-SQL: Enhancing Text-to-SQL Generation in Large Language Models via Self-Driven Exploration with SQL Probes
SDE-SQL improves text-to-SQL accuracy by having the model generate and execute exploratory SQL probes to learn database contents before and while writing the final query.
-
CHS-SQL: A Text-to-SQL approach based on Confidence-Guided Heuristic Search Schema Linking process
CHS-SQL combines beam search with model-internal-confidence filtering in schema linking to improve small-model text-to-SQL accuracy on Spider and BIRD.
-
MRT at IberLEF-2025 PRESTA Task: Maximizing Recovery from Tables with Multiple Steps
MRT, an LLM code-generation pipeline for Spanish table QA, achieves 85% accuracy on the IberLEF 2025 PRESTA test set.
-
Interactive Text-to-SQL via Expected Information Gain for Disambiguation
An interactive text-to-SQL framework selects clarification questions by expected information gain over a distribution of candidate SQL queries.
-
On the Comprehensibility of Multi-structured Financial Documents using LLMs and Pre-processing Tools
Preprocessing financial PDFs into text, tables, and chart data with existing tools improves LLM question-answering accuracy over direct GPT-4o image input in a small private evaluation.
-
MRT at SemEval-2025 Task 8: Maximizing Recovery from Tables with Multiple Steps
A code-generation pipeline with step-by-step instructions and error recovery scores 70.50% on the SemEval-2025 table question-answering task.
Discussion (0). Sign in to comment.