Pith. sign in

Paper Citation Record · LEDGER

ConsistencyChecker: Tree-based Evaluation of LLM Generalization Capabilities

As of 7 August 2026, this Paper Citation Record lists 35 of 35 outbound references and 0 inbound Pith citation observations for arXiv:2506.12376.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2506.12376 v2

Coverage vector

measured 35 of 35 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-07T00:57:10.932988Z

measured 35 of 35 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-07T06:34:17.273281+00:00

measured 0 of 0 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

35 of 35 outbound references displayed

  • verified exact2
  • verified fuzzy0
  • unresolved32
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch1

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 4d050e6a-69c9-40f2-929a-0363616f7a0b · outbound

This paper cites Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone.

ConsistencyChecker: Tree-based Evaluation of LLM Generalization Capabilities Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone

Reference 1

Resolution
unresolved
no resolver link, observed 2026-08-07T00:57:10.821107Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T00:57:10.821107Z digest=sha256:3f180646ffc2175aa28bc6813fb013c7acd7f61bf1bf2e9c989848f5dc2813b1

Observation ad1334f8-3b07-44fe-ba21-7ea852ba5ddf · outbound

This paper cites an unresolved cited work.

ConsistencyChecker: Tree-based Evaluation of LLM Generalization Capabilities Unresolved cited work

Reference 2

Resolution
unresolved
raw_fallback, observed 2026-08-07T00:57:11.385892Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=arxiv_source observed=2026-08-07T00:57:10.825536Z digest=sha256:0afb0dbb178b872994c14b97ca1dfe24e1a02c456fc574fb6ea68deee838cc08

Observation 2f840291-5fd4-41d5-aefd-257aa267c3cd · outbound

This paper cites an unresolved cited work.

ConsistencyChecker: Tree-based Evaluation of LLM Generalization Capabilities Unresolved cited work

Reference 3

Resolution
unresolved
no resolver link, observed 2026-08-07T00:57:10.830526Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T00:57:10.830526Z digest=sha256:83bcf2f21acb70c18f57946670f881abde105c8b312d40f9638b776bcf041eff

Observation 3bd6c51b-ed0b-4e60-8830-8115d7f6ea1a · outbound

This paper cites an unresolved cited work.

ConsistencyChecker: Tree-based Evaluation of LLM Generalization Capabilities Unresolved cited work

Reference 4

Resolution
unresolved
raw_fallback, observed 2026-08-07T00:57:11.375353Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=arxiv_source observed=2026-08-07T00:57:10.834151Z digest=sha256:1900cd597d2870442bcec9f777cf93c54d222cb4674de15a5904b6813b9df722

Observation 8778659d-18f0-4202-a4ae-92c2799d5c1f · outbound

This paper cites Language Models are Few-Shot Learners.

ConsistencyChecker: Tree-based Evaluation of LLM Generalization Capabilities Language Models are Few-Shot Learners

Reference 5

Resolution
unresolved
no resolver link, observed 2026-08-07T00:57:10.837613Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T00:57:10.837613Z digest=sha256:27127e07d9cffb110cdc1b232b1de8c28e071a67baa41cfa0d355ac057d06cc5

Observation 7cfb0def-27cc-495f-a134-7dd54ae0430a · outbound

This paper cites Evaluating Large Language Models Trained on Code.

ConsistencyChecker: Tree-based Evaluation of LLM Generalization Capabilities Evaluating Large Language Models Trained on Code

Reference 6

Resolution
unresolved
no resolver link, observed 2026-08-07T00:57:10.840876Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T00:57:10.840876Z digest=sha256:9591e835f0c3b449987badb204baf97d331fea37efbf2ee2018e90ac5ba10164

Observation cb38e085-ba45-4357-baa4-dc0d0c94f7a4 · outbound

This paper cites an unresolved cited work.

ConsistencyChecker: Tree-based Evaluation of LLM Generalization Capabilities Unresolved cited work

Reference 7

Resolution
unresolved
raw_fallback, observed 2026-08-07T00:57:11.366029Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=arxiv_source observed=2026-08-07T00:57:10.844622Z digest=sha256:7e6a5af1c00d8d9cafc3d21faef3b98fa9772202495878aa6864b52ae7c97628

Observation 08eb1bc9-ba21-4081-938e-685779d06d5d · outbound

This paper cites an unresolved cited work.

ConsistencyChecker: Tree-based Evaluation of LLM Generalization Capabilities Unresolved cited work

Reference 8

Resolution
unresolved
raw_fallback, observed 2026-08-07T00:57:11.356190Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=arxiv_source observed=2026-08-07T00:57:10.847412Z digest=sha256:57339cc7a72527d9551530c4bbff2d0382f621928a1d665856becf1266cb3095

Observation 0433ecc0-9904-4509-9613-f476493d1bda · outbound

This paper cites Malin, Sricharan Kumar, and Jiaxin Zhang.

ConsistencyChecker: Tree-based Evaluation of LLM Generalization Capabilities Malin, Sricharan Kumar, and Jiaxin Zhang

Reference 9

Resolution
unresolved
no resolver link, observed 2026-08-07T00:57:10.850485Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T00:57:10.850485Z digest=sha256:74181500b0f76d3cc7a499e5c7696755a1938fd53799c5f14c86240e4464d4db

Observation f19a296a-b8c6-4db2-a841-9e573f80affb · outbound

This paper cites The Llama 3 Herd of Models.

ConsistencyChecker: Tree-based Evaluation of LLM Generalization Capabilities The Llama 3 Herd of Models

Reference 10

Resolution
unresolved
no resolver link, observed 2026-08-07T00:57:10.853445Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T00:57:10.853445Z digest=sha256:10a6191b498c3f83aa069d6ea2a666e57dce79832358e314fb36724f53be986a

Observation bf334976-5606-46ea-920e-c8115ebb92d4 · outbound

This paper cites an unresolved cited work.

ConsistencyChecker: Tree-based Evaluation of LLM Generalization Capabilities Unresolved cited work

Reference 11

Resolution
unresolved
raw_fallback, observed 2026-08-07T00:57:11.346614Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=arxiv_source observed=2026-08-07T00:57:10.856654Z digest=sha256:f9c1c71a678841e68f3aa5558b7de467cbc75f7916622922429c168655f005b6

Observation 7fb5c1bc-f0a8-4ee5-adf9-03af834ef47a · outbound

This paper cites Mistral 7B.

ConsistencyChecker: Tree-based Evaluation of LLM Generalization Capabilities Mistral 7B

Reference 12

Resolution
unresolved
no resolver link, observed 2026-08-07T00:57:10.859209Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T00:57:10.859209Z digest=sha256:4dc9ad73a6b07f49c2f148ba1add0477ed1da885f1567d811bc85e4426b62cd7

Observation 3c540a06-3b16-476f-90cb-032bd58883f7 · outbound

This paper cites Mixtral of Experts.

ConsistencyChecker: Tree-based Evaluation of LLM Generalization Capabilities Mixtral of Experts

Reference 13

Resolution
unresolved
no resolver link, observed 2026-08-07T00:57:10.862036Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T00:57:10.862036Z digest=sha256:912bc218f90b21c35f04dad4708861a73dd9a4a59ea7c7569cf9bc967d02d6f7

Observation 766c3ef3-49ac-4d5a-b56d-6f7560111c2d · outbound

This paper cites A Survey on Large Language Models for Code Generation.

ConsistencyChecker: Tree-based Evaluation of LLM Generalization Capabilities A Survey on Large Language Models for Code Generation

Reference 14

Resolution
unresolved
no resolver link, observed 2026-08-07T00:57:10.864820Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T00:57:10.864820Z digest=sha256:52a5c0a76435eec82301d1aefac0ed98542c5008a52be0a30d9cd64b079b1806

Observation 42595550-5a18-4443-a1df-1435d5ba8007 · outbound

This paper cites MetricX-24: The Google Submission to the WMT 2024 Metrics Shared Task.

ConsistencyChecker: Tree-based Evaluation of LLM Generalization Capabilities MetricX-24: The Google Submission to the WMT 2024 Metrics Shared Task

Reference 15

Resolution
verified exact
local_arxiv, observed 2026-08-07T00:57:11.208030Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=arxiv_source observed=2026-08-07T00:57:10.867801Z digest=sha256:02b65f0bc5c97c4eec7e1961232ad1b584ba8ad83d3c19aa6125bd5be0898305

Observation bd23c936-8285-4087-8950-e6fb2c9d78ed · outbound

This paper cites Preliminary WMT24 Ranking of General MT Systems and LLMs.

ConsistencyChecker: Tree-based Evaluation of LLM Generalization Capabilities Preliminary WMT24 Ranking of General MT Systems and LLMs

Reference 16

Resolution
unresolved
no resolver link, observed 2026-08-07T00:57:10.870910Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T00:57:10.870910Z digest=sha256:43bd8995799141416f76c78a17555f1a9e2f2ef6f991e0d847be589fd8f080da

Observation 6371c8b8-2223-47bb-ae69-5fa74cfed51e · outbound

This paper cites MT-Eval: A Multi-Turn Capabilities Evaluation Benchmark for Large Language Models.

ConsistencyChecker: Tree-based Evaluation of LLM Generalization Capabilities MT-Eval: A Multi-Turn Capabilities Evaluation Benchmark for Large Language Models

Reference 17

Resolution
unresolved
no resolver link, observed 2026-08-07T00:57:10.874023Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T00:57:10.874023Z digest=sha256:1720db4d4e4d1454d9b1bebfb1105d743cf72b3cda25b83032e4455c37f99274

Observation 6edf4539-aaf9-4890-85f6-e98b888a3944 · outbound

This paper cites an unresolved cited work.

ConsistencyChecker: Tree-based Evaluation of LLM Generalization Capabilities Unresolved cited work

Reference 18

Resolution
unresolved
no resolver link, observed 2026-08-07T00:57:10.877303Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T00:57:10.877303Z digest=sha256:a98a976112047165434948bb07d185a350cd9e80ab11008b3d5d70b8e9227b41

Observation f35e663f-0bc7-4a89-8eb9-efd88d9bc290 · outbound

This paper cites an unresolved cited work.

ConsistencyChecker: Tree-based Evaluation of LLM Generalization Capabilities Unresolved cited work

Reference 19

Resolution
unresolved
raw_fallback, observed 2026-08-07T00:57:11.330094Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=arxiv_source observed=2026-08-07T00:57:10.880538Z digest=sha256:d93af24dcb2fb70341407206cd2d1ffe27e1ec1cb66006314c09a08f2db66770

Observation bdd275b8-91d1-4a23-960b-b60932644982 · outbound

This paper cites Beyond Accuracy: Evaluating Self-Consistency of Code Large Language Models with IdentityChain.

ConsistencyChecker: Tree-based Evaluation of LLM Generalization Capabilities Beyond Accuracy: Evaluating Self-Consistency of Code Large Language Models with IdentityChain

Reference 20

Resolution
unresolved
no resolver link, observed 2026-08-07T00:57:10.885298Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T00:57:10.885298Z digest=sha256:05ca81c1b382869b54cdeaa1f6326ee1500b058ed540ed76683f6a17efd487fc

Observation 1acbad04-91ff-47d4-9a66-16e92ff28842 · outbound

This paper cites Large Language Models: A Survey.

ConsistencyChecker: Tree-based Evaluation of LLM Generalization Capabilities Large Language Models: A Survey

Reference 21

Resolution
unresolved
no resolver link, observed 2026-08-07T00:57:10.888528Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T00:57:10.888528Z digest=sha256:157568755b211c7fc133b0a5b460c28134ac54fc73e1f30b1f22e5f9cf89259b

Observation d6f0a735-8925-4de6-9463-b6d053771fc0 · outbound

This paper cites an unresolved cited work.

ConsistencyChecker: Tree-based Evaluation of LLM Generalization Capabilities Unresolved cited work

Reference 22

Resolution
unresolved
raw_fallback, observed 2026-08-07T00:57:11.320159Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=arxiv_source observed=2026-08-07T00:57:10.891954Z digest=sha256:a2ac10c828f173b47681f2784ed8b2dc4201bdc416c27b9c770572d1f9f4a8f4

Observation 15b82ac5-ab48-4da9-9588-337a88546413 · outbound

This paper cites GPT-4o System Card.

ConsistencyChecker: Tree-based Evaluation of LLM Generalization Capabilities GPT-4o System Card

Reference 23

Resolution
unresolved
no resolver link, observed 2026-08-07T00:57:10.895294Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T00:57:10.895294Z digest=sha256:48ded764cb9969e7219457b72f3fe97ab2e00a435a231fb8933c0d13de9ba5ad

Observation 0617a9c6-65c8-4ca7-ab18-677fab056174 · outbound

This paper cites an unresolved cited work.

ConsistencyChecker: Tree-based Evaluation of LLM Generalization Capabilities Unresolved cited work

Reference 24

Resolution
unresolved
no resolver link, observed 2026-08-07T00:57:10.898912Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T00:57:10.898912Z digest=sha256:af8587c0741e4995ed2ddee9ad5c84988510f1c7e673577aebf2cf19f16d42ef

Observation ca15a532-652c-452d-a539-bbda996e90c4 · outbound

This paper cites Scaling up COMETKIWI: Unbabel-IST 2023 Submission for the Quality Estimation Shared Task.

ConsistencyChecker: Tree-based Evaluation of LLM Generalization Capabilities Scaling up COMETKIWI: Unbabel-IST 2023 Submission for the Quality Estimation Shared Task

Reference 25

Resolution
metadata mismatch
local_arxiv, observed 2026-08-07T00:57:11.055345Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=arxiv_source observed=2026-08-07T00:57:10.901731Z digest=sha256:942d3e7b75bbb3f2df0d9c0e57a29ae5df5823cf974fdd777e37a929d82fe428

Observation b78b934b-c0c5-48e4-a050-5cde0f8bda71 · outbound

This paper cites an unresolved cited work.

ConsistencyChecker: Tree-based Evaluation of LLM Generalization Capabilities Unresolved cited work

Reference 26

Resolution
unresolved
no resolver link, observed 2026-08-07T00:57:10.905184Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T00:57:10.905184Z digest=sha256:66560f692d1f5b9c925b299693bb6a8298f2ee0da7c84048fdc93a00ca79f0fb

Observation 75ecb9cb-f076-4b2a-86fe-a714d4b318db · outbound

This paper cites Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context.

ConsistencyChecker: Tree-based Evaluation of LLM Generalization Capabilities Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context

Reference 27

Resolution
unresolved
no resolver link, observed 2026-08-07T00:57:10.908249Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T00:57:10.908249Z digest=sha256:44d1fa3a7d1f827e129afb3dca6c81beab424f1d1f23b9797116ad969bbe995b

Observation 9426f444-e2dd-4eeb-9a11-66b08b1675ca · outbound

This paper cites an unresolved cited work.

ConsistencyChecker: Tree-based Evaluation of LLM Generalization Capabilities Unresolved cited work

Reference 28

Resolution
verified exact
doi, observed 2026-08-07T00:57:10.963083Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=arxiv_source observed=2026-08-07T00:57:10.912099Z digest=sha256:4667bb6776117780dc2a9ee689459579afd100710281912064791dfa842d8660

Observation 0ebd2b94-b99e-498f-8f9c-f19c1620819a · outbound

This paper cites Gomez, ukasz Kaiser, and Illia Polosukhin.

ConsistencyChecker: Tree-based Evaluation of LLM Generalization Capabilities Gomez, ukasz Kaiser, and Illia Polosukhin

Reference 29

Resolution
unresolved
no resolver link, observed 2026-08-07T00:57:10.915097Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T00:57:10.915097Z digest=sha256:7918ecd965590e35dd87d19594a2e99f5aa0c26cc923f90582b8a01ea177574b

Observation b2db46cb-b472-4c53-a9af-9c12381f108c · outbound

This paper cites Self-Consistency Improves Chain of Thought Reasoning in Language Models.

ConsistencyChecker: Tree-based Evaluation of LLM Generalization Capabilities Self-Consistency Improves Chain of Thought Reasoning in Language Models

Reference 30

Resolution
unresolved
no resolver link, observed 2026-08-07T00:57:10.917840Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T00:57:10.917840Z digest=sha256:9b89c7f1f1449e825a2d89f026df4b647244ba803374e804b4ab291fadf9cecc

Observation e9a8494b-d2f9-47f1-aa87-7a6f86346bc7 · outbound

This paper cites Latent Space Chain-of-Embedding Enables Output-free LLM Self-Evaluation.

ConsistencyChecker: Tree-based Evaluation of LLM Generalization Capabilities Latent Space Chain-of-Embedding Enables Output-free LLM Self-Evaluation

Reference 31

Resolution
unresolved
no resolver link, observed 2026-08-07T00:57:10.920765Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T00:57:10.920765Z digest=sha256:cd9eb3ec93faae7855764c021f39eefa8c3ab1fa8edcd40f72587bd9a4417833

Observation 0a388d33-2556-4b29-bc0e-f8fd39ff955e · outbound

This paper cites an unresolved cited work.

ConsistencyChecker: Tree-based Evaluation of LLM Generalization Capabilities Unresolved cited work

Reference 32

Resolution
unresolved
raw_fallback, observed 2026-08-07T00:57:11.295020Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=arxiv_source observed=2026-08-07T00:57:10.923723Z digest=sha256:3e3927f98003e612f258f6ea215a506008557c51afb270ff6d7897b6aa31782f

Observation 7262afd5-a0b6-4607-a037-09c8a69a14d0 · outbound

This paper cites A Paradigm Shift in Machine Translation: Boosting Translation Performance of Large Language Models.

ConsistencyChecker: Tree-based Evaluation of LLM Generalization Capabilities A Paradigm Shift in Machine Translation: Boosting Translation Performance of Large Language Models

Reference 33

Resolution
unresolved
no resolver link, observed 2026-08-07T00:57:10.926390Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T00:57:10.926390Z digest=sha256:57d198ab0cff017cd8971eb6ab327b67df817085bcc855e8e435fc6f46b4e08e

Observation 5349fefa-a554-421c-82ef-0da9cf739b54 · outbound

This paper cites Benchmarking Benchmark Leakage in Large Language Models.

ConsistencyChecker: Tree-based Evaluation of LLM Generalization Capabilities Benchmarking Benchmark Leakage in Large Language Models

Reference 34

Resolution
unresolved
no resolver link, observed 2026-08-07T00:57:10.929888Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T00:57:10.929888Z digest=sha256:10f74e8a364ab8051c4d8f7e48239021c2d7d47e20aa8d9f535d23b27f00752e

Observation 8c4f554b-11c9-4c03-88a8-301010ae9143 · outbound

This paper cites LessLeak-Bench: A First Investigation of Data Leakage in LLMs Across 83 Software Engineering Benchmarks.

ConsistencyChecker: Tree-based Evaluation of LLM Generalization Capabilities LessLeak-Bench: A First Investigation of Data Leakage in LLMs Across 83 Software Engineering Benchmarks

Reference 35

Resolution
unresolved
no resolver link, observed 2026-08-07T00:57:10.932988Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T00:57:10.932988Z digest=sha256:706a172e0000bffce61c353ab44eb800141bd2bb58d3b7c17f49257e7b7caa1a

Pith citing papers

No inbound Pith citation observations are available.