REVIEW 12 cited by
RAT-SQL: Relation-Aware Schema Encoding and Linking for Text-to-SQL Parsers
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
When translating natural language questions into SQL queries to answer questions from a database, contemporary semantic parsing models struggle to generalize to unseen database schemas. The generalization challenge lies in (a) encoding the database relations in an accessible way for the semantic parser, and (b) modeling alignment between database columns and their mentions in a given query. We present a unified framework, based on the relation-aware self-attention mechanism, to address schema encoding, schema linking, and feature representation within a text-to-SQL encoder. On the challenging Spider dataset this framework boosts the exact match accuracy to 57.2%, surpassing its best counterparts by 8.7% absolute improvement. Further augmented with BERT, it achieves the new state-of-the-art performance of 65.6% on the Spider leaderboard. In addition, we observe qualitative improvements in the model's understanding of schema linking and alignment. Our implementation will be open-sourced at https://github.com/Microsoft/rat-sql.
Forward citations
Cited by 12 Pith papers
-
Metadata Reconstruction from Values Alone: Recovering Column Semantics in Undocumented Warehouses
A verification-harness LLM system recovers column semantics from values alone, but its measured advantage over a direct LLM is selective abstention, not better prose, and a code-enforced gate makes that abstention bac...
-
TailorSQL: An NL2SQL System Tailored to Your Query Workload
Adding workload-derived hints and tailored retrieval from past SQL queries improves NL2SQL execution accuracy and reduces prompt size on three benchmarks.
-
ODIN: A NL2SQL Recommender to Handle Schema Ambiguity
ODIN uses schema masking, conformal-prediction filtering, and user-preference hints to return a small set of SQL queries that includes the correct one more often than baseline sampling on ambiguous-schema benchmarks.
-
LEAP: LLM-powered End-to-end Automatic Library for Processing Social Science Queries on Unstructured Data
LEAP, an LLM-based library, automatically selects ML functions and writes SQL-like code to answer 92% of 120 social science queries over unstructured data on the first attempt, and 100% within three attempts.
-
PaVeRL-SQL: Text-to-SQL via Partial-Match Rewards and Verbal Reinforcement Learning
PaVeRL-SQL reports SOTA execution accuracy on Spider2.0-SQLite using partial-match rewards and verbal RL, but overclaims SOTA on Spider and BIRD.
-
ReFoRCE: A Text-to-SQL Agent with Self-Refinement, Consensus Enforcement, and Column Exploration
An agentic Text-to-SQL pipeline using schema compression, self-refinement, majority voting, and selective column exploration reports state-of-the-art execution accuracy on Spider 2.0: 35.83 on Snow and 36.56 on Lite.
-
EICopilot: Search and Explore Enterprise Information over Large-scale Knowledge Graphs with LLM-driven Agents
EICopilot uses LLM agents with in-context learning and entity masking to generate Gremlin queries for enterprise knowledge graph search, reporting better accuracy than zero-shot baselines on 150 internal queries.
-
A Plug-and-Play Natural Language Rewriter for Natural Language to SQL
A multi-agent LLM module that checks, reflects on, and rewrites flawed questions yields small average execution-accuracy gains (1.6% Spider, 2.0% BIRD) on NL2SQL dev sets.
-
Confidence Estimation for Text-to-SQL in Large Language Models
Consistency-based methods are the most reliable confidence signal for text-to-SQL in black-box LLMs, and executing queries against a database adds a useful correctness signal.
-
Interactive Text-to-SQL via Expected Information Gain for Disambiguation
An interactive text-to-SQL framework selects clarification questions by expected information gain over a distribution of candidate SQL queries.
-
eSapiens: A Real-World NLP Framework for Multimodal Document Understanding and Enterprise Knowledge Processing
eSapiens combines text-to-SQL and hybrid retrieval-augmented generation with citation verification, and its evaluation on RAGTruth shows better contextual relevance than a FAISS baseline across most LLMs, at the cost ...
-
A Survey of Large Language Model-Based Generative AI for Text-to-SQL: Benchmarks, Applications, Use Cases, and Challenges
A high-level review of benchmarks, models, applications, and challenges in LLM-based text-to-SQL, with no new experiments or methods.
Discussion (0). Continue with ORCID to comment.