Paper Citation Record · LEDGER

UQ: Assessing Language Models on Unsolved Questions

As of 18 August 2026, this Paper Citation Record lists 70 of 70 outbound references and 1 inbound Pith citation observation for arXiv:2508.17580.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2508.17580 v1

Coverage vector

measured 70 of 70 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-15T17:07:19.897165Z

measured 71 of 71 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-18T06:34:40.430872+00:00

measured 1 of 1 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-05-10T04:09:46.616019Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-05-11T12:06:04.092759Z

Reference resolution

70 of 70 outbound references displayed

verified exact1
verified fuzzy23
unresolved46
parse uncertain0
malformed identifier0
metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 1f01bbf6-b12f-46b1-b9ae-2e3b1a5845af · outbound

This paper cites Piqa: Reasoning about physical commonsense in natural language.

UQ: Assessing Language Models on Unsolved Questions Piqa: Reasoning about physical commonsense in natural language

Reference 1

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T17:07:20.844600Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation 5a54b432-f1ee-46b1-bbef-b1f27ff77a20 · outbound

This paper cites Evaluating Large Language Models Trained on Code.

UQ: Assessing Language Models on Unsolved Questions Evaluating Large Language Models Trained on Code

Reference 2

Resolution: unresolved; no resolver link, observed 2026-08-15T17:07:19.617165Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 7c1e60d2-ce2f-4c88-b390-652795b68d92 · outbound

This paper cites Chatbot arena: An open platform for evaluating llms by human preference.

UQ: Assessing Language Models on Unsolved Questions Chatbot arena: An open platform for evaluating llms by human preference

Reference 3

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T17:07:20.832642Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation e4e6170e-de5a-4d34-b437-6df8349d1a78 · outbound

This paper cites ARC Prize 2024: Technical Report.

UQ: Assessing Language Models on Unsolved Questions ARC Prize 2024: Technical Report

Reference 4

Resolution: unresolved; no resolver link, observed 2026-08-15T17:07:19.625583Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 2176fa22-ebda-4452-93cd-285dcdc6d287 · outbound

This paper cites Training Verifiers to Solve Math Word Problems.

UQ: Assessing Language Models on Unsolved Questions Training Verifiers to Solve Math Word Problems

Reference 5

Resolution: unresolved; no resolver link, observed 2026-08-15T17:07:19.629700Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 5b463a90-bfec-45d1-b90e-d542c6e823f5 · outbound

This paper cites Chain-of-Verification Reduces Hallucination in Large Language Models.

UQ: Assessing Language Models on Unsolved Questions Chain-of-Verification Reduces Hallucination in Large Language Models

Reference 6

Resolution: unresolved; no resolver link, observed 2026-08-15T17:07:19.634145Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation b0069902-9909-4c98-8a27-57bfafb52b46 · outbound

This paper cites AlpacaFarm: A Simulation Framework for Methods that Learn from Human Feedback.

UQ: Assessing Language Models on Unsolved Questions AlpacaFarm: A Simulation Framework for Methods that Learn from Human Feedback

Reference 7

Resolution: unresolved; no resolver link, observed 2026-08-15T17:07:19.638212Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 7f96f91e-c4d8-41ae-a264-112d60ea3305 · outbound

This paper cites Are We Done with MMLU?.

UQ: Assessing Language Models on Unsolved Questions Are We Done with MMLU?

Reference 8

Resolution: unresolved; no resolver link, observed 2026-08-15T17:07:19.642257Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f1ab611a-d399-4435-a64c-f27784877ef4 · outbound

This paper cites Frontiermath: A benchmark for evaluating advanced mathematical reasoning in ai, 2024.

UQ: Assessing Language Models on Unsolved Questions Frontiermath: A benchmark for evaluating advanced mathematical reasoning in ai, 2024

Reference 9

Resolution: unresolved; no resolver link, observed 2026-08-15T17:07:19.646336Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 593bde5f-a009-44e0-89ef-0bb417085f93 · outbound

This paper cites Great Models Think Alike and this Undermines AI Oversight.

UQ: Assessing Language Models on Unsolved Questions Great Models Think Alike and this Undermines AI Oversight

Reference 10

Resolution: unresolved; no resolver link, observed 2026-08-15T17:07:19.653111Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation cd69e84c-1409-4aa7-8517-78fe5e4d119c · outbound

This paper cites Measuring Coding Challenge Competence With APPS.

UQ: Assessing Language Models on Unsolved Questions Measuring Coding Challenge Competence With APPS

Reference 11

Resolution: unresolved; no resolver link, observed 2026-08-15T17:07:19.657157Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation a09cdff2-45c3-4aa9-bf4b-68c6d2d6426a · outbound

This paper cites Measuring Massive Multitask Language Understanding.

UQ: Assessing Language Models on Unsolved Questions Measuring Massive Multitask Language Understanding

Reference 12

Resolution: unresolved; no resolver link, observed 2026-08-15T17:07:19.661079Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation fcbcf013-b427-4ecb-95de-df825ee3cb95 · outbound

This paper cites Measuring Mathematical Problem Solving With the MATH Dataset.

UQ: Assessing Language Models on Unsolved Questions Measuring Mathematical Problem Solving With the MATH Dataset

Reference 13

Resolution: unresolved; no resolver link, observed 2026-08-15T17:07:19.664976Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 79c6791a-03b7-4619-aa14-76667eb6461e · outbound

This paper cites MATH-Perturb: Benchmarking LLMs' Math Reasoning Abilities against Hard Perturbations.

UQ: Assessing Language Models on Unsolved Questions MATH-Perturb: Benchmarking LLMs' Math Reasoning Abilities against Hard Perturbations

Reference 14

Resolution: unresolved; no resolver link, observed 2026-08-15T17:07:19.669042Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 7cfd3e5b-372f-4122-b6cc-97d91e78eacc · outbound

This paper cites Exploring and Mitigating Adversarial Manipulation of Voting-Based Leaderboards.

UQ: Assessing Language Models on Unsolved Questions Exploring and Mitigating Adversarial Manipulation of Voting-Based Leaderboards

Reference 15

Resolution: verified exact; local_arxiv, observed 2026-08-15T17:07:20.365810Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation 9effe6b5-3a3f-4cf8-b0bf-7c9cf841f69b · outbound

This paper cites GPT-4o System Card.

UQ: Assessing Language Models on Unsolved Questions GPT-4o System Card

Reference 16

Resolution: unresolved; no resolver link, observed 2026-08-15T17:07:19.677086Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 1d031044-a077-4dd3-af42-2e333a3d4d62 · outbound

This paper cites LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code.

UQ: Assessing Language Models on Unsolved Questions LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code

Reference 17

Resolution: unresolved; no resolver link, observed 2026-08-15T17:07:19.681246Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 971742a0-244e-4bb1-ac3d-08e9653d5389 · outbound

This paper cites When Not to Trust Language Models: Investigating Effectiveness of Parametric and Non-Parametric Memories.

UQ: Assessing Language Models on Unsolved Questions When Not to Trust Language Models: Investigating Effectiveness of Parametric and Non-Parametric Memories

Reference 18

Resolution: unresolved; no resolver link, observed 2026-08-15T17:07:19.685883Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation aa30218c-fcfd-4868-90e8-1ec7d03d2667 · outbound

This paper cites Jimenez, John Yang, Alexander Wettig, Shunyu Yao, Kexin Pei, Ofir Press, and Karthik Narasimhan.

UQ: Assessing Language Models on Unsolved Questions Jimenez, John Yang, Alexander Wettig, Shunyu Yao, Kexin Pei, Ofir Press, and Karthik Narasimhan

Reference 19

Resolution: unresolved; no resolver link, observed 2026-08-15T17:07:19.690864Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e32cb678-272d-4129-852e-ff4739ee86ff · outbound

This paper cites Verdict: A library for scaling judge-time compute.

UQ: Assessing Language Models on Unsolved Questions Verdict: A library for scaling judge-time compute

Reference 20

Resolution: unresolved; no resolver link, observed 2026-08-15T17:07:19.695712Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 190333ed-45ec-463e-9577-a67c0a8fdb35 · outbound

This paper cites Llm-as-an-interviewer: Beyond static testing through dynamic llm evaluation, 2025.

UQ: Assessing Language Models on Unsolved Questions Llm-as-an-interviewer: Beyond static testing through dynamic llm evaluation, 2025

Reference 21

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T17:07:20.805990Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation 158af6cb-3842-49c6-a647-0dd64f7d1c0d · outbound

This paper cites Prometheus: Inducing fine-grained evaluation capability in language models, 2024.

UQ: Assessing Language Models on Unsolved Questions Prometheus: Inducing fine-grained evaluation capability in language models, 2024

Reference 22

Resolution: unresolved; no resolver link, observed 2026-08-15T17:07:19.703854Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 519f40fe-6840-4a3d-98a5-c3c18e81dd31 · outbound

This paper cites Prometheus 2: An open source language model specialized in evaluating other language models, 2024.

UQ: Assessing Language Models on Unsolved Questions Prometheus 2: An open source language model specialized in evaluating other language models, 2024

Reference 23

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T17:07:20.785977Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation b93b5b2a-5278-4db2-b564-4f15cb79e6ef · outbound

This paper cites Scaling evaluation-time compute with reasoning models as process evaluators, 2025.

UQ: Assessing Language Models on Unsolved Questions Scaling evaluation-time compute with reasoning models as process evaluators, 2025

Reference 24

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T17:07:20.773770Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation b77f1e55-ca6b-4450-ac93-948aef2b3bbc · outbound

This paper cites Toutanova, Llion Jones, Ming-Wei Chang, Andrew Dai, Jakob Uszkoreit, Quoc Le, and Slav Petrov.

UQ: Assessing Language Models on Unsolved Questions Toutanova, Llion Jones, Ming-Wei Chang, Andrew Dai, Jakob Uszkoreit, Quoc Le, and Slav Petrov

Reference 25

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T17:07:20.761723Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation b75cb40a-367c-4ecf-9060-cdf0a7d783da · outbound

This paper cites The measurement of observer agreement for categorical data.

UQ: Assessing Language Models on Unsolved Questions The measurement of observer agreement for categorical data

Reference 26

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T17:07:20.749131Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation ddd119d8-450b-4eb6-b495-24bfb2c8b879 · outbound

This paper cites FLASK: Fine-grained Language Model Evaluation based on Alignment Skill Sets.

UQ: Assessing Language Models on Unsolved Questions FLASK: Fine-grained Language Model Evaluation based on Alignment Skill Sets

Reference 27

Resolution: unresolved; no resolver link, observed 2026-08-15T17:07:19.722330Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c5edad0b-6467-463f-8ec4-68fefa0054bc · outbound

This paper cites Holistic Evaluation of Language Models.

UQ: Assessing Language Models on Unsolved Questions Holistic Evaluation of Language Models

Reference 28

Resolution: unresolved; no resolver link, observed 2026-08-15T17:07:19.726851Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 374897c1-dee4-4c24-be9c-51e809777187 · outbound

This paper cites Let's Verify Step by Step.

UQ: Assessing Language Models on Unsolved Questions Let's Verify Step by Step

Reference 29

Resolution: unresolved; no resolver link, observed 2026-08-15T17:07:19.730930Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 8cfc8a7c-e9e9-4a2e-a6f8-b88c3c7ca7da · outbound

This paper cites WildBench: Benchmarking LLMs with Challenging Tasks from Real Users in the Wild.

UQ: Assessing Language Models on Unsolved Questions WildBench: Benchmarking LLMs with Challenging Tasks from Real Users in the Wild

Reference 30

Resolution: unresolved; no resolver link, observed 2026-08-15T17:07:19.734688Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 3f5e8e7a-8fe5-4d40-98c1-2638cc7c8139 · outbound

This paper cites Evaluating Verifiability in Generative Search Engines.

UQ: Assessing Language Models on Unsolved Questions Evaluating Verifiability in Generative Search Engines

Reference 31

Resolution: unresolved; no resolver link, observed 2026-08-15T17:07:19.738927Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 5ef7b271-c72c-4a61-8ea2-4d5fe30ccce6 · outbound

This paper cites The lean 4 theorem prover and programming language.

UQ: Assessing Language Models on Unsolved Questions The lean 4 theorem prover and programming language

Reference 32

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T17:07:20.736175Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation b9ea21ba-ee35-4da9-a8cb-eb220e3c4895 · outbound

This paper cites 2024 aime i.

UQ: Assessing Language Models on Unsolved Questions 2024 aime i

Reference 33

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T17:07:20.723466Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation c95d7ef9-422e-45a1-99ef-461c49e60bd0 · outbound

This paper cites List of open problems in sublinear algorithms.

UQ: Assessing Language Models on Unsolved Questions List of open problems in sublinear algorithms

Reference 34

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T17:07:20.705112Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation 4a628fec-1c3f-4286-8a62-7c19ff390b07 · outbound

This paper cites Introducing deep research.

UQ: Assessing Language Models on Unsolved Questions Introducing deep research

Reference 35

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T17:07:20.687109Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation 6c25daa6-4998-412a-aae5-bf9e5fbdf080 · outbound

This paper cites Introducing OpenAI o1.

UQ: Assessing Language Models on Unsolved Questions Introducing OpenAI o1

Reference 36

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T17:07:20.671042Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation e3eceb3f-2fb3-406b-a739-7e4813bb1314 · outbound

This paper cites Introducing OpenAI o3 and o4‑mini.

UQ: Assessing Language Models on Unsolved Questions Introducing OpenAI o3 and o4‑mini

Reference 37

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T17:07:20.658233Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation deceb3d9-7c72-4a20-9e7f-d229cbc500aa · outbound

This paper cites Llm evaluators recognize and favor their own generations.

UQ: Assessing Language Models on Unsolved Questions Llm evaluators recognize and favor their own generations

Reference 38

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T17:07:20.646999Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation 56d7c659-603b-4be9-bd3b-05300528dfcf · outbound

This paper cites For better or worse, benchmarks shape a field.

UQ: Assessing Language Models on Unsolved Questions For better or worse, benchmarks shape a field

Reference 39

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T17:07:20.635111Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation 5c2371bb-a85c-4f62-af4c-210971e40705 · outbound

This paper cites KILT: a Benchmark for Knowledge Intensive Language Tasks.

UQ: Assessing Language Models on Unsolved Questions KILT: a Benchmark for Knowledge Intensive Language Tasks

Reference 40

Resolution: unresolved; no resolver link, observed 2026-08-15T17:07:19.774679Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 2197aa18-381d-4f4b-8320-10369cff45bd · outbound

This paper cites Humanity's last exam, 2025.

UQ: Assessing Language Models on Unsolved Questions Humanity's last exam, 2025

Reference 41

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T17:07:20.622441Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation fd37a82f-a72d-47b4-bf2a-36bb7c1ad53f · outbound

This paper cites SQuAD: 100,000+ Questions for Machine Comprehension of Text.

UQ: Assessing Language Models on Unsolved Questions SQuAD: 100,000+ Questions for Machine Comprehension of Text

Reference 42

Resolution: unresolved; no resolver link, observed 2026-08-15T17:07:19.783306Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 6218fdfb-c2e4-45b0-9ea3-dc64640d69ae · outbound

This paper cites Gpqa: A graduate-level google-proof q&a benchmark.

UQ: Assessing Language Models on Unsolved Questions Gpqa: A graduate-level google-proof q&a benchmark

Reference 43

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T17:07:20.609957Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation 326f22e5-6d1b-4715-85f1-3cc44efa40da · outbound

This paper cites Measurement to Meaning: A Validity-Centered Framework for AI Evaluation.

UQ: Assessing Language Models on Unsolved Questions Measurement to Meaning: A Validity-Centered Framework for AI Evaluation

Reference 44

Resolution: unresolved; no resolver link, observed 2026-08-15T17:07:19.792055Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation fb828bae-2d44-495f-8143-88060708b8ea · outbound

This paper cites The Leaderboard Illusion.

UQ: Assessing Language Models on Unsolved Questions The Leaderboard Illusion

Reference 45

Resolution: unresolved; no resolver link, observed 2026-08-15T17:07:19.796329Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 1608eedb-7ee9-4894-8458-1124658ba64f · outbound

This paper cites Stack Exchange.

UQ: Assessing Language Models on Unsolved Questions Stack Exchange

Reference 46

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T17:07:20.598457Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation 0410b2a1-1b7c-4dad-9a8f-d2539af0772e · outbound

This paper cites Terminal‑Bench : A benchmark for ai agents in terminal environments.

UQ: Assessing Language Models on Unsolved Questions Terminal‑Bench : A benchmark for ai agents in terminal environments

Reference 47

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T17:07:20.586555Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation 0f163747-562a-4de4-97a2-59c4637bf9e5 · outbound

This paper cites Position: Stop Evaluating AI with Human Tests, Develop Principled, AI-specific Tests instead.

UQ: Assessing Language Models on Unsolved Questions Position: Stop Evaluating AI with Human Tests, Develop Principled, AI-specific Tests instead

Reference 48

Resolution: unresolved; no resolver link, observed 2026-08-15T17:07:19.808716Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 61312f11-fa5f-47f3-b869-c30b2ab19004 · outbound

This paper cites Supergpqa: Scaling llm evaluation across 285 graduate disciplines, 2025.

UQ: Assessing Language Models on Unsolved Questions Supergpqa: Scaling llm evaluation across 285 graduate disciplines, 2025

Reference 49

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T17:07:20.572183Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation 5716fd16-daec-44b3-8206-cc4a9af77846 · outbound

This paper cites SuperGLUE: A Stickier Benchmark for General-Purpose Language Understanding Systems.

UQ: Assessing Language Models on Unsolved Questions SuperGLUE: A Stickier Benchmark for General-Purpose Language Understanding Systems

Reference 50

Resolution: unresolved; no resolver link, observed 2026-08-15T17:07:19.816806Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation d5a02e5a-b954-4fb5-99a2-6e485959b2f8 · outbound

This paper cites GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding.

UQ: Assessing Language Models on Unsolved Questions GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding

Reference 51

Resolution: unresolved; no resolver link, observed 2026-08-15T17:07:19.820943Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation af631803-152b-46b6-9303-cd34c843b03e · outbound

This paper cites an unresolved cited work.

UQ: Assessing Language Models on Unsolved Questions Unresolved cited work

Reference 52

Resolution: unresolved; no resolver link, observed 2026-08-15T17:07:19.824905Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 24f5b672-60a7-49ca-80f8-3ab96fef1669 · outbound

This paper cites PandaLM: An Automatic Evaluation Benchmark for LLM Instruction Tuning Optimization.

UQ: Assessing Language Models on Unsolved Questions PandaLM: An Automatic Evaluation Benchmark for LLM Instruction Tuning Optimization

Reference 53

Resolution: unresolved; no resolver link, observed 2026-08-15T17:07:19.828751Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 77f7bc9b-f90c-4732-aa86-290f9a53859c · outbound

This paper cites Mmlu-pro: A more robust and challenging multi-task language understanding benchmark.

UQ: Assessing Language Models on Unsolved Questions Mmlu-pro: A more robust and challenging multi-task language understanding benchmark

Reference 54

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T17:07:20.548388Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation bbab3f8d-f82d-429a-85a0-c1756cd4f1b6 · outbound

This paper cites Self-Preference Bias in LLM-as-a-Judge.

UQ: Assessing Language Models on Unsolved Questions Self-Preference Bias in LLM-as-a-Judge

Reference 55

Resolution: unresolved; no resolver link, observed 2026-08-15T17:07:19.836673Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c9f21bba-2b91-4da7-a383-e50b111deb34 · outbound

This paper cites Measuring short-form factuality in large language models.

UQ: Assessing Language Models on Unsolved Questions Measuring short-form factuality in large language models

Reference 56

Resolution: unresolved; no resolver link, observed 2026-08-15T17:07:19.840580Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 18a23df0-5f8f-4c0a-9cbf-4f3bcb23d3b6 · outbound

This paper cites BrowseComp: A Simple Yet Challenging Benchmark for Browsing Agents.

UQ: Assessing Language Models on Unsolved Questions BrowseComp: A Simple Yet Challenging Benchmark for Browsing Agents

Reference 57

Resolution: unresolved; no resolver link, observed 2026-08-15T17:07:19.844366Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation b7d7cb80-05cc-4274-92e7-bc59da4121d1 · outbound

This paper cites LiveBench: A Challenging, Contamination-Limited LLM Benchmark.

UQ: Assessing Language Models on Unsolved Questions LiveBench: A Challenging, Contamination-Limited LLM Benchmark

Reference 58

Resolution: unresolved; no resolver link, observed 2026-08-15T17:07:19.848296Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 7ecb45b0-6194-47f7-924f-ae0483dd783e · outbound

This paper cites Pride and Prejudice: LLM Amplifies Self-Bias in Self-Refinement.

UQ: Assessing Language Models on Unsolved Questions Pride and Prejudice: LLM Amplifies Self-Bias in Self-Refinement

Reference 59

Resolution: unresolved; no resolver link, observed 2026-08-15T17:07:19.852288Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 922a6fd3-f114-4d7b-bcbc-f62e11b2bddc · outbound

This paper cites Jimenez, Alex L.

UQ: Assessing Language Models on Unsolved Questions Jimenez, Alex L

Reference 60

Resolution: unresolved; no resolver link, observed 2026-08-15T17:07:19.856397Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation ce5b0cba-cc9a-4e86-bbe2-5c0fc907b01e · outbound

This paper cites $\tau$-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains.

UQ: Assessing Language Models on Unsolved Questions $\tau$-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains

Reference 61

Resolution: unresolved; no resolver link, observed 2026-08-15T17:07:19.859994Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 4f237b55-1857-4f1e-adad-db3377df5413 · outbound

This paper cites Justice or Prejudice? Quantifying Biases in LLM-as-a-Judge.

UQ: Assessing Language Models on Unsolved Questions Justice or Prejudice? Quantifying Biases in LLM-as-a-Judge

Reference 62

Resolution: unresolved; no resolver link, observed 2026-08-15T17:07:19.863897Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 66825604-8add-46ae-9958-6f17510d1834 · outbound

This paper cites HellaSwag: Can a Machine Really Finish Your Sentence?.

UQ: Assessing Language Models on Unsolved Questions HellaSwag: Can a Machine Really Finish Your Sentence?

Reference 63

Resolution: unresolved; no resolver link, observed 2026-08-15T17:07:19.868052Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation fd6385f5-84a6-49e2-88ce-eee3f128ed90 · outbound

This paper cites A careful examination of large language model performance on grade school arithmetic.

UQ: Assessing Language Models on Unsolved Questions A careful examination of large language model performance on grade school arithmetic

Reference 64

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T17:07:20.529186Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation 7adaf2fb-c55c-4003-be7f-b533fa00d918 · outbound

This paper cites Challenges in Trustworthy Human Evaluation of Chatbots.

UQ: Assessing Language Models on Unsolved Questions Challenges in Trustworthy Human Evaluation of Chatbots

Reference 65

Resolution: unresolved; no resolver link, observed 2026-08-15T17:07:19.876480Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 2fe1d022-d3b2-45cf-8ff6-2d05aac7e3ba · outbound

This paper cites Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena.

UQ: Assessing Language Models on Unsolved Questions Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena

Reference 66

Resolution: unresolved; no resolver link, observed 2026-08-15T17:07:19.880787Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 5dde716a-4b75-4d50-b822-de3b1a0e9cca · outbound

This paper cites AGIEval: A Human-Centric Benchmark for Evaluating Foundation Models.

UQ: Assessing Language Models on Unsolved Questions AGIEval: A Human-Centric Benchmark for Evaluating Foundation Models

Reference 67

Resolution: unresolved; no resolver link, observed 2026-08-15T17:07:19.885288Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 73bd8a55-7730-41ab-a739-ca47bfd026d9 · outbound

This paper cites LIMA: Less Is More for Alignment.

UQ: Assessing Language Models on Unsolved Questions LIMA: Less Is More for Alignment

Reference 68

Resolution: unresolved; no resolver link, observed 2026-08-15T17:07:19.889330Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c801d62d-bb02-4a36-ab60-326a1d65e71a · outbound

This paper cites Reinforcing General Reasoning without Verifiers.

UQ: Assessing Language Models on Unsolved Questions Reinforcing General Reasoning without Verifiers

Reference 69

Resolution: unresolved; no resolver link, observed 2026-08-15T17:07:19.893401Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 1adc20b5-9a0a-4593-926a-6c1846e92381 · outbound

This paper cites Bigcodebench: Benchmarking code generation with diverse function calls and complex instructions, 2025.

UQ: Assessing Language Models on Unsolved Questions Bigcodebench: Benchmarking code generation with diverse function calls and complex instructions, 2025

Reference 70

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T17:07:20.516012Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Pith citing papers

Observation 51e8effd-fb12-4824-8bf6-19061be8cfac · inbound

MathNet: a Global Multimodal Benchmark for Mathematical Reasoning and Retrieval cites this paper.

MathNet: a Global Multimodal Benchmark for Mathematical Reasoning and Retrieval UQ: Assessing Language Models on Unsolved Questions

Reference 55

Resolution: verified exact; arxiv_id, observed 2026-05-11T12:06:04.097499Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.