NL-EDIT: Correcting semantic parse errors through natural language interaction

Adam Fourney; Ahmed Elgohary; Ahmed Hassan Awadallah; Christopher Meek; Gonzalo Ramos; Matthew Richardson

NL-EDIT: Correcting semantic parse errors through natural language interaction

Not yet reviewed by Pith; the record is open.

Re-run · record.json Download PDF Read on arXiv ↗

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2103.14540 v1 pith:OY6IW3J2 submitted 2021-03-26 cs.CL

Ahmed Elgohary , Christopher Meek , Matthew Richardson , Adam Fourney , Gonzalo Ramos , Ahmed Hassan Awadallah This is my paper · ORCID

classification cs.CL

keywords errorslanguagenaturalnl-editcorrectfeedbackinteractionmodel

verification ladder T0 review T1 audit T2 compute T3 formal

0 comments

read the original abstract

We study semantic parsing in an interactive setting in which users correct errors with natural language feedback. We present NL-EDIT, a model for interpreting natural language feedback in the interaction context to generate a sequence of edits that can be applied to the initial parse to correct its errors. We show that NL-EDIT can boost the accuracy of existing text-to-SQL parsers by up to 20% with only one turn of correction. We analyze the limitations of the model and discuss directions for improvement and evaluation. The code and datasets used in this paper are publicly available at http://aka.ms/NLEdit.

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

Recursive Decomposition of Logical Thoughts: Framework for Superior Reasoning and Knowledge Propagation in Large Language Models
cs.CL 2025-01 reject novelty 4.0 of 10

A prompting framework that recursively decomposes reasoning tasks and self-scores candidate thoughts is reported to improve LLM accuracy on math and letter-concatenation benchmarks, though the headline improvement is ...

Pith tools