Pith. sign in

Paper Citation Record · LEDGER

The Consistency Dilemma in LLMs: Generator-Evaluator Agreement and Vulnerability to Mistakes

As of 8 August 2026, this Paper Citation Record lists 14 of 14 outbound references and 0 inbound Pith citation observations for arXiv:2606.30653.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2606.30653 v1

Coverage vector

measured 14 of 14 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-07-01T07:30:49.286792Z

measured 14 of 14 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-07T06:34:17.273281+00:00

measured 0 of 0 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

14 of 14 outbound references displayed

  • verified exact1
  • verified fuzzy9
  • unresolved3
  • parse uncertain0
  • malformed identifier1
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 9bf3ce35-50ca-43f4-86a1-c15134938e65 · outbound

This paper cites An Empirical Study on Large Language Models in Accuracy and Robustness under Chinese Industrial Scenarios.

The Consistency Dilemma in LLMs: Generator-Evaluator Agreement and Vulnerability to Mistakes An Empirical Study on Large Language Models in Accuracy and Robustness under Chinese Industrial Scenarios

Reference 1

Resolution
verified exact
arxiv_id, observed 2026-07-01T07:35:28.926367Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-07-01T07:30:49.286792Z digest=sha256:81fd4d82a7989935b94825240a57d1dd1376ad4451b0c77066407a4e0a796a54

Observation 75b71be9-b953-42e5-8326-2ccd642d8782 · outbound

This paper cites an unresolved cited work.

The Consistency Dilemma in LLMs: Generator-Evaluator Agreement and Vulnerability to Mistakes Unresolved cited work

Reference 3

Resolution
unresolved
raw_fallback, observed 2026-07-06T15:12:38.904660Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-07-01T07:30:49.286792Z digest=sha256:46fcadc064e744582b27b853f498208751b89b8baa6edda64fbc810349ce3610

Observation 332e1141-81e7-4606-af81-04ccf961a40f · outbound

This paper cites Multiplication.

The Consistency Dilemma in LLMs: Generator-Evaluator Agreement and Vulnerability to Mistakes Multiplication

Reference 4

Resolution
verified fuzzy
raw_fallback, observed 2026-07-06T15:12:38.895508Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-07-01T07:30:49.286792Z digest=sha256:0225cb15adb708fc76ec436dfdff2064db8cbc4341995168804c601bb417f168

Observation 53b0df96-4499-4e01-b499-3ae4eac599c1 · outbound

This paper cites {concept}.

The Consistency Dilemma in LLMs: Generator-Evaluator Agreement and Vulnerability to Mistakes {concept}

Reference 5

Resolution
verified fuzzy
raw_fallback, observed 2026-07-06T15:12:38.891572Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-07-01T07:30:49.286792Z digest=sha256:3f07bca5b9cbbcbdd2fad80b177c2534419cc31622bfb95db5d9c110b9033a0a

Observation 8913bf32-0cc8-4941-9262-445214a313f0 · outbound

This paper cites an unresolved cited work.

The Consistency Dilemma in LLMs: Generator-Evaluator Agreement and Vulnerability to Mistakes Unresolved cited work

Reference 6

Resolution
unresolved
raw_fallback, observed 2026-07-06T15:12:38.893550Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-07-01T07:30:49.286792Z digest=sha256:10f67e275dcf75fa53bf627b7d23a4a3f5e93df9aca50c9782defcbe9ba0e70d

Observation e343f86b-51e2-4144-9830-c5404524756f · outbound

This paper cites an unresolved cited work.

The Consistency Dilemma in LLMs: Generator-Evaluator Agreement and Vulnerability to Mistakes Unresolved cited work

Reference 7

Resolution
unresolved
raw_fallback, observed 2026-07-06T15:12:38.887906Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-07-01T07:30:49.286792Z digest=sha256:09f003f782089039c0d365789875b89d4415c785bcd5c41e71cfa9fdca964281

Observation 5c49140b-4fc5-40ab-923a-cdc2feef7b02 · outbound

This paper cites Multiplication.

The Consistency Dilemma in LLMs: Generator-Evaluator Agreement and Vulnerability to Mistakes Multiplication

Reference 8

Resolution
verified fuzzy
raw_fallback, observed 2026-07-06T15:12:38.897223Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-07-01T07:30:49.286792Z digest=sha256:7ee1e1c098f2e1bca5c25ba5782a2aa386c5cb14e8bae49692137112d78697c5

Observation abea9cf6-0927-4777-872b-13063c73eb23 · outbound

This paper cites None of the Above.

The Consistency Dilemma in LLMs: Generator-Evaluator Agreement and Vulnerability to Mistakes None of the Above

Reference 9

Resolution
verified fuzzy
raw_fallback, observed 2026-07-06T15:12:38.885883Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-07-01T07:30:49.286792Z digest=sha256:ff9dc8ec10bba56f245b7e22a1a07f13884a1ad186e97751661bcb81447fbf33

Observation 018da19a-3f7e-4ed7-b008-701bfff4af87 · outbound

This paper cites case_id":.

The Consistency Dilemma in LLMs: Generator-Evaluator Agreement and Vulnerability to Mistakes case_id":

Reference 10

Resolution
verified fuzzy
raw_fallback, observed 2026-07-06T15:12:38.902804Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-07-01T07:30:49.286792Z digest=sha256:72d6917c472f46cc9d3b20c0f8458ea11a567627ad472fde1a7af83f8d458b3b

Observation de4af097-d230-4f22-bc5c-597e83d610dc · outbound

This paper cites In the dataset curation process described by Proniakin et.

The Consistency Dilemma in LLMs: Generator-Evaluator Agreement and Vulnerability to Mistakes In the dataset curation process described by Proniakin et

Reference 11

Resolution
verified fuzzy
raw_fallback, observed 2026-07-06T15:12:38.898984Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-07-01T07:30:49.286792Z digest=sha256:051052bc2331540efba76df0d025f4bd278fcf56657ae41ef8040260cb4f139d

Observation 8e943b96-d091-47a1-b468-226db22bf594 · outbound

This paper cites For few word tags, they should be through - like ’medication-management’.

The Consistency Dilemma in LLMs: Generator-Evaluator Agreement and Vulnerability to Mistakes For few word tags, they should be through - like ’medication-management’

Reference 12

Resolution
verified fuzzy
raw_fallback, observed 2026-07-06T15:12:38.901038Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-07-01T07:30:49.286792Z digest=sha256:7cb133936e196a1a6ed3de745ad0aaddc0e0b018971a3cb2a65521a619c8fa15

Observation 5f9871d5-ea58-4f2e-84ec-cc331088da57 · outbound

This paper cites Operationally, this is recorded as a Boolean mistake replicated field in the judgment output.

The Consistency Dilemma in LLMs: Generator-Evaluator Agreement and Vulnerability to Mistakes Operationally, this is recorded as a Boolean mistake replicated field in the judgment output

Reference 13

Resolution
verified fuzzy
raw_fallback, observed 2026-07-06T15:12:38.880467Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-07-01T07:30:49.286792Z digest=sha256:bc3c5022d3bc138f55ea9f9b7f32e9c3283f58debac5e0b1eab03432360139ac

Observation 51f59c64-4300-4ecf-a34d-808829a268ac · outbound

This paper cites Because each case may be tagged with multiple concepts, we split each case evenly across its tags so that each underlying mistake contributes total weight one across concepts.

The Consistency Dilemma in LLMs: Generator-Evaluator Agreement and Vulnerability to Mistakes Because each case may be tagged with multiple concepts, we split each case evenly across its tags so that each underlying mistake contributes total weight one across concepts

Reference 14

Resolution
verified fuzzy
raw_fallback, observed 2026-07-06T15:12:38.883947Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-07-01T07:30:49.286792Z digest=sha256:73bbba48e24c95ca84b8c77423e091d8b16bae0171838e8edbd0b4dae85193de

Observation 1ce83203-0bd2-4dcc-94ad-bb7692fff3bb · outbound

This paper cites Yes” (i.e., the model judges its own reasoning as incomplete) is scored as consistent (Z= 1), while “No.

The Consistency Dilemma in LLMs: Generator-Evaluator Agreement and Vulnerability to Mistakes Yes” (i.e., the model judges its own reasoning as incomplete) is scored as consistent (Z= 1), while “No

Reference 15

Resolution
malformed identifier
raw_fallback, observed 2026-07-06T15:12:38.878712Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-07-01T07:30:49.286792Z digest=sha256:f92b35aa42c1c7019f49b180dc5299e3fcaa2f8790104c485f08cdb554c4974c

Pith citing papers

No inbound Pith citation observations are available.