Paper Citation Record · LEDGER

Agent-Agnostic Evaluation of SQL Accuracy in Production Text-to-SQL Systems

As of 5 August 2026, this Paper Citation Record lists 16 of 16 outbound references and 0 inbound Pith citation observations for arXiv:2604.28049.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2604.28049 v1

Coverage vector

measured 16 of 16 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-05-07T07:05:57.220730Z

measured 16 of 16 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-04T06:34:03.388597+00:00

measured 0 of 0 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

16 of 16 outbound references displayed

verified exact8
verified fuzzy7
unresolved0
parse uncertain1
malformed identifier0
metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 1cd96126-d428-44d1-a3cd-7faaeb2cda40 · outbound

This paper cites Spider: A Large-Scale Human-Labeled Dataset for Complex and Cross-Domain Semantic Parsing and Text-to-SQL Task.

Agent-Agnostic Evaluation of SQL Accuracy in Production Text-to-SQL Systems Spider: A Large-Scale Human-Labeled Dataset for Complex and Cross-Domain Semantic Parsing and Text-to-SQL Task

Reference 1

Resolution: verified fuzzy; raw_fallback, observed 2026-05-27T09:43:55.294678Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

Observation 20877514-92cd-477a-8e27-cef38c724075 · outbound

This paper cites an unresolved cited work.

Agent-Agnostic Evaluation of SQL Accuracy in Production Text-to-SQL Systems Unresolved cited work

Reference 2

Resolution: parse uncertain; raw_fallback, observed 2026-05-27T09:43:55.298986Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

Observation 557662ba-51b1-4d45-b30f-188509eac7fc · outbound

This paper cites A Big Bench for Large-Scale Database Grounded Text-to-SQLs BIRD.

Agent-Agnostic Evaluation of SQL Accuracy in Production Text-to-SQL Systems A Big Bench for Large-Scale Database Grounded Text-to-SQLs BIRD

Reference 3

Resolution: verified fuzzy; raw_fallback, observed 2026-05-27T09:43:55.286384Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

Observation 7a325656-f81e-4724-b2e4-eb116cf3d238 · outbound

This paper cites FeTaQA: Free-form Table Question Answering.TACL.

Agent-Agnostic Evaluation of SQL Accuracy in Production Text-to-SQL Systems FeTaQA: Free-form Table Question Answering.TACL

Reference 4

Resolution: verified fuzzy; raw_fallback, observed 2026-05-27T09:43:55.314619Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

Observation 62c603fc-85b5-4331-98a0-03e4ed44d688 · outbound

This paper cites Semantic Evaluation for Text-to-SQL with Distilled Test Suites.

Agent-Agnostic Evaluation of SQL Accuracy in Production Text-to-SQL Systems Semantic Evaluation for Text-to-SQL with Distilled Test Suites

Reference 5

Resolution: verified exact; arxiv_id, observed 2026-05-12T10:11:28.706079Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

Observation 39540dbb-e7d1-41a0-9d77-0517a2f151ab · outbound

This paper cites Cortex Analyst: Production Text-to-SQL Evaluation.

Agent-Agnostic Evaluation of SQL Accuracy in Production Text-to-SQL Systems Cortex Analyst: Production Text-to-SQL Evaluation

Reference 6

Resolution: verified fuzzy; raw_fallback, observed 2026-05-27T09:43:55.290436Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

Observation 0996c050-5683-4cbe-ae69-45d9073c01a0 · outbound

This paper cites Production SQL Evaluation Framework.

Agent-Agnostic Evaluation of SQL Accuracy in Production Text-to-SQL Systems Production SQL Evaluation Framework

Reference 7

Resolution: verified fuzzy; raw_fallback, observed 2026-05-27T09:43:55.302960Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

Observation 9cd1bd5d-26a0-4f85-855b-3f32937eb5cd · outbound

This paper cites Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena.

Agent-Agnostic Evaluation of SQL Accuracy in Production Text-to-SQL Systems Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena

Reference 8

Resolution: verified exact; local_arxiv, observed 2026-05-12T10:11:28.684839Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

Observation edc79d4a-3554-4f35-9bf1-b448fc0e914a · outbound

This paper cites Cortex Analyst: Evaluating text-to-SQL accuracy for real- world BI.

Agent-Agnostic Evaluation of SQL Accuracy in Production Text-to-SQL Systems Cortex Analyst: Evaluating text-to-SQL accuracy for real- world BI

Reference 9

Resolution: verified fuzzy; raw_fallback, observed 2026-05-27T09:43:55.307157Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

Observation d728d771-d245-4618-9dd6-4afa0914fe41 · outbound

This paper cites FLEX: Expert-level False-Less EXecution Metric for Reliable Text-to-SQL Benchmark.

Agent-Agnostic Evaluation of SQL Accuracy in Production Text-to-SQL Systems FLEX: Expert-level False-Less EXecution Metric for Reliable Text-to-SQL Benchmark

Reference 10

Resolution: verified exact; arxiv_id, observed 2026-05-12T10:11:28.713740Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

Observation f748ba2e-674c-4e8a-a1f4-000cbd47f000 · outbound

This paper cites Towards Complex Text-to-SQL in Cross-Domain Database with Intermediate Representation.

Agent-Agnostic Evaluation of SQL Accuracy in Production Text-to-SQL Systems Towards Complex Text-to-SQL in Cross-Domain Database with Intermediate Representation

Reference 11

Resolution: verified exact; arxiv_id, observed 2026-05-12T10:11:28.697588Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

Observation c85a7ea0-8267-4d18-bd9f-26de31e93131 · outbound

This paper cites RAT-SQL: Relation-Aware Schema Encoding and Linking for Text-to-SQL Parsers.

Agent-Agnostic Evaluation of SQL Accuracy in Production Text-to-SQL Systems RAT-SQL: Relation-Aware Schema Encoding and Linking for Text-to-SQL Parsers

Reference 12

Resolution: verified exact; arxiv_id, observed 2026-05-12T10:11:28.710123Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

Observation 6f800ae1-491e-4b3d-b652-1576cc15a9d2 · outbound

This paper cites SParC: Cross-Domain Semantic Parsing in Context.

Agent-Agnostic Evaluation of SQL Accuracy in Production Text-to-SQL Systems SParC: Cross-Domain Semantic Parsing in Context

Reference 13

Resolution: verified exact; arxiv_id, observed 2026-05-12T10:11:28.701822Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

Observation 4deb8966-0520-4c1a-802f-444ec335bf9f · outbound

This paper cites CoSQL: A Conversational Text-to-SQL Challenge Towards Cross-Domain Natural Language Interfaces to Databases.

Agent-Agnostic Evaluation of SQL Accuracy in Production Text-to-SQL Systems CoSQL: A Conversational Text-to-SQL Challenge Towards Cross-Domain Natural Language Interfaces to Databases

Reference 14

Resolution: verified exact; arxiv_id, observed 2026-05-12T10:11:28.688987Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

Observation 1852c7c6-a82c-4588-971c-8b94274622cf · outbound

This paper cites Can Large Language Models Be an Alternative to Human Evaluations?.

Agent-Agnostic Evaluation of SQL Accuracy in Production Text-to-SQL Systems Can Large Language Models Be an Alternative to Human Evaluations?

Reference 15

Resolution: verified exact; arxiv_id, observed 2026-05-12T10:11:28.693906Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

Observation b001dc32-f8b7-4314-96e5-441f18e09b9a · outbound

This paper cites Elgohary, D.

Agent-Agnostic Evaluation of SQL Accuracy in Production Text-to-SQL Systems Elgohary, D

Reference 16

Resolution: verified fuzzy; raw_fallback, observed 2026-05-27T09:43:55.310833Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

Pith citing papers

No inbound Pith citation observations are available.