Pith. sign in

Paper Citation Record · LEDGER

The Gold Medals in an Empty Room: Diagnosing Metalinguistic Reasoning in LLMs with Camlang

As of 9 August 2026, this Paper Citation Record lists 37 of 37 outbound references and 1 inbound Pith citation observation for arXiv:2509.00425.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2509.00425 v1

Coverage vector

measured 37 of 37 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-05T13:42:13.828658Z

measured 38 of 38 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-09T06:31:02.800959+00:00

measured 1 of 1 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-05-10T00:24:09.265532Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-05-10T00:24:46.779944Z

Reference resolution

37 of 37 outbound references displayed

  • verified exact9
  • verified fuzzy13
  • unresolved13
  • parse uncertain0
  • malformed identifier1
  • metadata mismatch1

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 21ea0f6a-756e-4c38-b115-b614985d0e69 · outbound

This paper cites doi: 10.18653/v1/2024.findings-emnlp.916.

The Gold Medals in an Empty Room: Diagnosing Metalinguistic Reasoning in LLMs with Camlang doi: 10.18653/v1/2024.findings-emnlp.916

Reference 4

Resolution
unresolved
no resolver link, observed 2026-08-05T13:42:11.418931Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-05T13:42:11.418931Z digest=sha256:b179c04e35fbd8fb0343c931873f840b99fe56d4007671b653d9385401130c01

Observation cd7b256f-081c-48b2-8277-e032635d3548 · outbound

This paper cites modeLing: A Novel Dataset for Testing Linguistic Reasoning in Language Models.

The Gold Medals in an Empty Room: Diagnosing Metalinguistic Reasoning in LLMs with Camlang modeLing: A Novel Dataset for Testing Linguistic Reasoning in Language Models

Reference 8

Resolution
unresolved
no resolver link, observed 2026-08-05T13:42:11.654171Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-05T13:42:11.654171Z digest=sha256:f7352d0ab209924a761ad7546722cdcc0d1cadd7ccdf133772361c68adce68c9

Observation 9cbd957b-e1f7-4980-8c53-fd6739ee5341 · outbound

This paper cites Herbert H Clark.

The Gold Medals in an Empty Room: Diagnosing Metalinguistic Reasoning in LLMs with Camlang Herbert H Clark

Reference 9

Resolution
verified fuzzy
raw_fallback, observed 2026-08-05T13:42:18.550156Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-05T13:42:11.737193Z digest=sha256:6c8d7740c79a33af9fc54ab55f3c17e70f6d93e233a55b742b4be2ddf14fd330

Observation 6f8ea39e-7b6f-4307-a682-603212b93fab · outbound

This paper cites The independence of phonology and morphology: The celtic mutations.

The Gold Medals in an Empty Room: Diagnosing Metalinguistic Reasoning in LLMs with Camlang The independence of phonology and morphology: The celtic mutations

Reference 14

Resolution
verified fuzzy
raw_fallback, observed 2026-08-05T13:42:17.955066Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-05T13:42:12.128305Z digest=sha256:772560e3e77684b24f7effaf12e61d6c0ae7d2f9fd50e65b5a1e0cebfc869f83

Observation 163cc09f-6dd2-4279-8069-af04f617464f · outbound

This paper cites Interview on ai and human-like understanding (nobel prize, dec 2024).

The Gold Medals in an Empty Room: Diagnosing Metalinguistic Reasoning in LLMs with Camlang Interview on ai and human-like understanding (nobel prize, dec 2024)

Reference 18

Resolution
verified fuzzy
raw_fallback, observed 2026-08-05T13:42:17.459433Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-05T13:42:12.337075Z digest=sha256:b01896e9b521931d0371cee0ed6d093c7db53696b40f34101013fddabaf91da2

Observation 466b1e09-dcc8-455a-96de-2dbb80a9516d · outbound

This paper cites Charles F Hockett and Charles D Hockett.

The Gold Medals in an Empty Room: Diagnosing Metalinguistic Reasoning in LLMs with Camlang Charles F Hockett and Charles D Hockett

Reference 19

Resolution
verified fuzzy
raw_fallback, observed 2026-08-05T13:42:17.333915Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-05T13:42:12.442505Z digest=sha256:5bd2a32110cba5f90aaf139b95afdb7fc23a02ed3e1d731204fcbdaf93a1827f

Observation c76ad488-8a96-46f0-ae2e-a4d3a73fe4a5 · outbound

This paper cites Back to School: Translation Using Grammar Books.

The Gold Medals in an Empty Room: Diagnosing Metalinguistic Reasoning in LLMs with Camlang Back to School: Translation Using Grammar Books

Reference 21

Resolution
verified exact
local_arxiv, observed 2026-08-05T13:42:15.742176Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-05T13:42:12.638719Z digest=sha256:e64c48380c880e9e37d91644be789f5c7364d30b2f8311915f1102249fd66020

Observation 967a1d85-f9ae-451d-a4e7-e4f65028a4f4 · outbound

This paper cites doi: 10.18653/v1/2024.acl-long.787.

The Gold Medals in an Empty Room: Diagnosing Metalinguistic Reasoning in LLMs with Camlang doi: 10.18653/v1/2024.acl-long.787

Reference 22

Resolution
unresolved
no resolver link, observed 2026-08-05T13:42:12.706331Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-05T13:42:12.706331Z digest=sha256:de30670a1461b686b6d7cf4696308c996b7314251d0454bc7f7d5f60fd613694

Observation 5d0a684f-959b-4cd3-aa91-b75c45e6e83d · outbound

This paper cites Introducing O3 and O4-mini.

The Gold Medals in an Empty Room: Diagnosing Metalinguistic Reasoning in LLMs with Camlang Introducing O3 and O4-mini

Reference 27

Resolution
verified fuzzy
raw_fallback, observed 2026-08-05T13:42:17.061943Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-05T13:42:13.088233Z digest=sha256:c55b0b7eb3bbf1aec60a5407d30a76ac192c099d797c32f6fd981401250cf833

Observation 4ad138b7-0293-4294-b09f-740d7613f756 · outbound

This paper cites Introducing GPT-5.

The Gold Medals in an Empty Room: Diagnosing Metalinguistic Reasoning in LLMs with Camlang Introducing GPT-5

Reference 28

Resolution
verified fuzzy
raw_fallback, observed 2026-08-05T13:42:16.897465Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-05T13:42:13.171995Z digest=sha256:1c5f51f867c0fb395402da067266beeb4a58465c61df6847ae5604ae9f4de4d5

Observation a21fbcc1-911e-4cb6-a797-0247b640a2ed · outbound

This paper cites Multi-LogiEval: Towards evaluating multi-step logical reasoning ability of large language models.

The Gold Medals in an Empty Room: Diagnosing Metalinguistic Reasoning in LLMs with Camlang Multi-LogiEval: Towards evaluating multi-step logical reasoning ability of large language models

Reference 29

Resolution
verified fuzzy
raw_fallback, observed 2026-08-05T13:42:16.749794Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-05T13:42:13.253122Z digest=sha256:3bbe0c6ef4d9e03d70a878592af5e96c41f24f910f7459706fe9a9b8e60a6507

Observation 687e32da-5ff8-4288-817a-0dc6fbb5779f · outbound

This paper cites doi: 10.18653/v1/2024.emnlp-main.1160.

The Gold Medals in an Empty Room: Diagnosing Metalinguistic Reasoning in LLMs with Camlang doi: 10.18653/v1/2024.emnlp-main.1160

Reference 30

Resolution
unresolved
no resolver link, observed 2026-08-05T13:42:13.360155Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-05T13:42:13.360155Z digest=sha256:1bf2c56e004886af0ba2f78464958080f52d391d1dfbca092b2d44dbe33b35c2

Observation 6b419f85-3d41-4cf9-9e80-9045d043acfa · outbound

This paper cites ISBN 979-8-89176-251-0.

The Gold Medals in an Empty Room: Diagnosing Metalinguistic Reasoning in LLMs with Camlang ISBN 979-8-89176-251-0

Reference 31

Resolution
unresolved
no resolver link, observed 2026-08-05T13:42:13.397353Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-05T13:42:13.397353Z digest=sha256:a8fcbafda3f63e58c9cb50b7b314a41e9479e8b37d9256da93fd7d97219dbd4a

Observation 56142902-ad6b-4679-8e12-2d5cbe572848 · outbound

This paper cites URL http://www.jstor.org/stable/44164110.

The Gold Medals in an Empty Room: Diagnosing Metalinguistic Reasoning in LLMs with Camlang URL http://www.jstor.org/stable/44164110

Reference 32

Resolution
verified exact
raw_fallback, observed 2026-08-05T13:42:15.368209Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-05T13:42:13.450389Z digest=sha256:037dca74c91f8ec11cdaccff980810c9c67920d796e495f90b581c0d28799701

Observation 35305181-de2c-4254-af1c-62df62ea4099 · outbound

This paper cites Explain-then-Process: Using Grammar Prompting to Enhance Grammatical Acceptability Judgments.

The Gold Medals in an Empty Room: Diagnosing Metalinguistic Reasoning in LLMs with Camlang Explain-then-Process: Using Grammar Prompting to Enhance Grammatical Acceptability Judgments

Reference 33

Resolution
verified exact
local_arxiv, observed 2026-08-05T13:42:15.108252Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-05T13:42:13.504881Z digest=sha256:830a2713ca4534c6f6062251543a7ffb5591f05d210975634d08087aaca10a0f

Observation 202bbafa-ae8c-4391-8329-7984107ba2cc · outbound

This paper cites Commonsenseqa: A question answering challenge targeting commonsense knowledge.

The Gold Medals in an Empty Room: Diagnosing Metalinguistic Reasoning in LLMs with Camlang Commonsenseqa: A question answering challenge targeting commonsense knowledge

Reference 34

Resolution
verified fuzzy
raw_fallback, observed 2026-08-05T13:42:16.520228Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-05T13:42:13.569486Z digest=sha256:9c7f60dc9612a37953871452c617bd76565f86f7594ad8a02e78a2c117f91542

Observation a1dc0bd7-7ab9-44ee-bffc-23c8fd4f6a2c · outbound

This paper cites Teaching Large Language Models an Unseen Language on the Fly.

The Gold Medals in an Empty Room: Diagnosing Metalinguistic Reasoning in LLMs with Camlang Teaching Large Language Models an Unseen Language on the Fly

Reference 36

Resolution
unresolved
no resolver link, observed 2026-08-05T13:42:13.694325Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-05T13:42:13.694325Z digest=sha256:392785fb00ff771fc7f1c19005944075d26b6d03dcf76d11139eee632385b07f

Observation c194eade-265f-41f6-bd67-479e779fcc1c · outbound

This paper cites ISBN 979-8-89176-251-0.

The Gold Medals in an Empty Room: Diagnosing Metalinguistic Reasoning in LLMs with Camlang ISBN 979-8-89176-251-0

Reference 37

Resolution
unresolved
no resolver link, observed 2026-08-05T13:42:13.828658Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-05T13:42:13.828658Z digest=sha256:cb165cec3fc9a17a00640e4795b34caa7f50f205f03dd832605fefaefd70cb01

Observation 5fc27501-adf6-457f-b713-408c8813558f · outbound

This paper cites doi: doi:10.1515/9783110833751-005.

The Gold Medals in an Empty Room: Diagnosing Metalinguistic Reasoning in LLMs with Camlang doi: doi:10.1515/9783110833751-005

Reference 1905

Resolution
verified exact
doi, observed 2026-08-05T13:42:14.024590Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-05T13:42:12.560573Z digest=sha256:29e60d4ff2f5f71cb4ade5a08bdb9229d9b4acc25ba738d5228abd653458ae01

Observation 15f85b5e-8490-4c73-b1fb-c68c92764499 · outbound

This paper cites The FLORES evaluation datasets for low- resource machine translation: Nepali–English and Sinhala–English.

The Gold Medals in an Empty Room: Diagnosing Metalinguistic Reasoning in LLMs with Camlang The FLORES evaluation datasets for low- resource machine translation: Nepali–English and Sinhala–English

Reference 1963

Resolution
verified fuzzy
raw_fallback, observed 2026-08-05T13:42:17.596868Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-05T13:42:12.178471Z digest=sha256:f020c08134b7cc04ae47e41aaadf39429e1d5ca21bde7ddfe1a51cc5c4516f28

Observation 40f7f7a2-1c2c-440a-b0a9-84b476b15f9b · outbound

This paper cites A corpus and cloze evaluation for deeper understanding of commonsense stories.

The Gold Medals in an Empty Room: Diagnosing Metalinguistic Reasoning in LLMs with Camlang A corpus and cloze evaluation for deeper understanding of commonsense stories

Reference 1978

Resolution
verified fuzzy
raw_fallback, observed 2026-08-05T13:42:17.204537Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-05T13:42:12.947155Z digest=sha256:71d55be83d58df3bbfa85a97fc643839076f85ce2b1fe9a8d4e24b469b7b6a03

Observation 08e83f55-b435-4f1a-a579-30f93f2cc358 · outbound

This paper cites Reduplication: a typological overview.

The Gold Medals in an Empty Room: Diagnosing Metalinguistic Reasoning in LLMs with Camlang Reduplication: a typological overview

Reference 1992

Resolution
unresolved
no resolver link, observed 2026-08-05T13:42:12.070191Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-05T13:42:12.070191Z digest=sha256:b678fb32b987bbc8a63adc66681588664c4e22c944854adc4ad1cc17c093b5e1

Observation 61c04759-ed17-4397-ba83-6a317820ec77 · outbound

This paper cites URL https://www.science.org/doi/abs/10.1126/science.298.55 98.1569.

The Gold Medals in an Empty Room: Diagnosing Metalinguistic Reasoning in LLMs with Camlang URL https://www.science.org/doi/abs/10.1126/science.298.55 98.1569

Reference 2002

Resolution
malformed identifier
no resolver link, observed 2026-08-05T13:42:12.294329Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-05T13:42:12.294329Z digest=sha256:9b582b013b4ba81ee0df52e11298a08a6adb10796b9e5308497f5ff4f0ab5ace

Observation 65818bf8-9304-45a3-8811-5a2c4ccd5556 · outbound

This paper cites Bilingualism in development: Language, literacy, and cognition.

The Gold Medals in an Empty Room: Diagnosing Metalinguistic Reasoning in LLMs with Camlang Bilingualism in development: Language, literacy, and cognition

Reference 2004

Resolution
verified fuzzy
raw_fallback, observed 2026-08-05T13:42:18.855827Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-05T13:42:11.489601Z digest=sha256:949098457995c2220e69e08a60cf9b793394eac90e4ad169dbd7bf84457c61c9

Observation 09919786-05f5-4785-9978-4a35114a9dd1 · outbound

This paper cites doi: https://doi.org/10.1016/j.system.2004.12.006.

The Gold Medals in an Empty Room: Diagnosing Metalinguistic Reasoning in LLMs with Camlang doi: https://doi.org/10.1016/j.system.2004.12.006

Reference 2005

Resolution
verified exact
doi, observed 2026-08-05T13:42:14.457610Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-05T13:42:11.899233Z digest=sha256:97dc595198ff5ea5d39e7e386b095dcdbdf7683251a0f74b82cafada220f0817

Observation d5e5b8c9-5dc8-4b7f-8580-9e0d1f8ce715 · outbound

This paper cites URL http://www.jstor.org/stable/27653511.

The Gold Medals in an Empty Room: Diagnosing Metalinguistic Reasoning in LLMs with Camlang URL http://www.jstor.org/stable/27653511

Reference 2007

Resolution
verified exact
raw_fallback, observed 2026-08-05T13:42:14.861570Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-05T13:42:13.605995Z digest=sha256:17bfafdbe6712087fcadccd72783e96113715876c4eb88ce4f22dac9ec4dea7c

Observation 951698cc-a0ba-4a99-870c-e285dc0cfbb1 · outbound

This paper cites URL https: //aclanthology.org/C10-1044/.

The Gold Medals in an Empty Room: Diagnosing Metalinguistic Reasoning in LLMs with Camlang URL https: //aclanthology.org/C10-1044/

Reference 2010

Resolution
verified fuzzy
raw_fallback, observed 2026-08-05T13:42:18.268269Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-05T13:42:12.011485Z digest=sha256:96b1345baff7ceed044eee3166ccd241f334723e3b16cd0d2bfb5545b9aa22e3

Observation 0599928c-0f8b-4542-8abc-ce6a8630cae5 · outbound

This paper cites doi: 10.18653/v1/N16-1098.

The Gold Medals in an Empty Room: Diagnosing Metalinguistic Reasoning in LLMs with Camlang doi: 10.18653/v1/N16-1098

Reference 2016

Resolution
unresolved
no resolver link, observed 2026-08-05T13:42:13.003876Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-05T13:42:13.003876Z digest=sha256:aee97ed5006ed85a97ac7c77397e3948c18fc7cc9e7a9fad080368532701936c

Observation 3ff47d86-1441-478b-b939-6534a658e271 · outbound

This paper cites To ask LLMs about English grammaticality, prompt them in a different language.

The Gold Medals in an Empty Room: Diagnosing Metalinguistic Reasoning in LLMs with Camlang To ask LLMs about English grammaticality, prompt them in a different language

Reference 2017

Resolution
verified fuzzy
raw_fallback, observed 2026-08-05T13:42:19.022772Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-05T13:42:11.370457Z digest=sha256:fb6919c4276ec0869d2490114c64557c7fc49146a02624608fdfc11b0ea8ea08

Observation 2766096c-1dc6-4de5-8344-2ecc4677d15e · outbound

This paper cites A neural interlingua for multilingual machine translation.

The Gold Medals in an Empty Room: Diagnosing Metalinguistic Reasoning in LLMs with Camlang A neural interlingua for multilingual machine translation

Reference 2018

Resolution
unresolved
no resolver link, observed 2026-08-05T13:42:12.857109Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-05T13:42:12.857109Z digest=sha256:23caa385dba40c1fee2325244e86c207e17848b4430b7ded1c0a3408e1cfcb11

Observation 7a14b848-2328-4c94-97cb-d52d8d67043a · outbound

This paper cites doi: 10.18653/v1/D19-1632.

The Gold Medals in an Empty Room: Diagnosing Metalinguistic Reasoning in LLMs with Camlang doi: 10.18653/v1/D19-1632

Reference 2019

Resolution
verified exact
doi, observed 2026-08-05T13:42:14.175926Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-05T13:42:12.231794Z digest=sha256:a80e3d89434cbdbbca759a6e4dc9604cee1ffaa34984689909380e19742ea221

Observation 9e96b691-dd5f-4664-905f-13664e214a08 · outbound

This paper cites doi: 10.18653/v1/2020.acl-main.421.

The Gold Medals in an Empty Room: Diagnosing Metalinguistic Reasoning in LLMs with Camlang doi: 10.18653/v1/2020.acl-main.421

Reference 2020

Resolution
unresolved
no resolver link, observed 2026-08-05T13:42:11.219196Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-05T13:42:11.219196Z digest=sha256:8eb66ee9b92f0e7caf9a2649efeb90f18c3f4694be952fffd3dcf98c5d430eea

Observation ef370fd2-ff3b-4828-95fe-2ac4be9e2e8b · outbound

This paper cites See What LLMs Cannot Answer: A Self-Challenge Framework for Uncovering LLM Weaknesses.

The Gold Medals in an Empty Room: Diagnosing Metalinguistic Reasoning in LLMs with Camlang See What LLMs Cannot Answer: A Self-Challenge Framework for Uncovering LLM Weaknesses

Reference 2021

Resolution
metadata mismatch
local_arxiv, observed 2026-08-05T13:42:16.075693Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-05T13:42:11.600674Z digest=sha256:6963bf5a61aba63b8b38c77cda42284fe37c99e58be74fbb0455772b76b8f40f

Observation c82f09e7-0227-4a1b-98c8-d85258e422a2 · outbound

This paper cites LingBench++: A Linguistically-Informed Benchmark and Reasoning Framework for Multi-Step and Cross-Cultural Inference with LLMs.

The Gold Medals in an Empty Room: Diagnosing Metalinguistic Reasoning in LLMs with Camlang LingBench++: A Linguistically-Informed Benchmark and Reasoning Framework for Multi-Step and Cross-Cultural Inference with LLMs

Reference 2022

Resolution
verified exact
local_arxiv, observed 2026-08-05T13:42:15.523386Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-05T13:42:12.755296Z digest=sha256:814576348a9057678bf61e605cbbc81ba37e63761c505f30d3da2ae66e291b03

Observation 78b47366-34a5-4b27-91c0-1575e892b85b · outbound

This paper cites Evaluating Large Language Models Trained on Code.

The Gold Medals in an Empty Room: Diagnosing Metalinguistic Reasoning in LLMs with Camlang Evaluating Large Language Models Trained on Code

Reference 2023

Resolution
unresolved
no resolver link, observed 2026-08-05T13:42:11.547587Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-05T13:42:11.547587Z digest=sha256:8a3da76e98387d7e66ce8d407244eded11b44360fcbe8d3f27b709a7937c391e

Observation f20d9e69-fea5-43c1-abdc-a9ba23fe0176 · outbound

This paper cites Jump to better conclusions: SCAN both left and right.

The Gold Medals in an Empty Room: Diagnosing Metalinguistic Reasoning in LLMs with Camlang Jump to better conclusions: SCAN both left and right

Reference 2024

Resolution
verified exact
local_arxiv, observed 2026-08-05T13:42:16.292083Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-05T13:42:11.299910Z digest=sha256:5175830709669580b3930af19ea6c995a111ea0db84667c4043eac27ee78d178

Observation 5d1f6ab6-471e-4570-92e2-b9d1286b8dca · outbound

This paper cites How Abilities in Large Language Models are Affected by Supervised Fine-tuning Data Composition.

The Gold Medals in an Empty Room: Diagnosing Metalinguistic Reasoning in LLMs with Camlang How Abilities in Large Language Models are Affected by Supervised Fine-tuning Data Composition

Reference 2025

Resolution
unresolved
no resolver link, observed 2026-08-05T13:42:11.831627Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-05T13:42:11.831627Z digest=sha256:bd2b269b3f39be4b7dea00e1840e76a3ff9819a51e6cec9549020e1856a12ed2

Pith citing papers

Observation 6881e55e-5572-4e98-b322-71b69fb45a23 · inbound

Diagnosing CFG Interpretation in LLMs cites this paper.

Diagnosing CFG Interpretation in LLMs The Gold Medals in an Empty Room: Diagnosing Metalinguistic Reasoning in LLMs with Camlang

Reference 1

Resolution
verified exact
arxiv_id, observed 2026-05-10T00:24:46.781288Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=arxiv_source observed=2026-05-10T00:24:09.265532Z digest=sha256:4ad4b5d611a893db5f0b68f6078e6166a3762535655637f2c2add6a4ab0ced51