Paper Citation Record · LEDGER

CollabEval: Statistically Efficient Collaborative Model Evaluation via Matrix Completion

As of 14 August 2026, this Paper Citation Record lists 37 of 37 outbound references and 2 inbound Pith citation observations for arXiv:2607.05046.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2607.05046 v1

Coverage vector

measured 37 of 37 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-07-11T09:38:44.568685Z

measured 39 of 39 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-13T06:32:02.005865+00:00

measured 2 of 2 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-01T18:08:21.473999Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

37 of 37 outbound references displayed

verified exact0
verified fuzzy0
unresolved36
parse uncertain0
malformed identifier1
metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation ee6e8239-a555-4645-a335-e290ca5af5fd · outbound

This paper cites Prediction-powered inference.Science, 382(6671):669–674, 2023.

CollabEval: Statistically Efficient Collaborative Model Evaluation via Matrix Completion Prediction-powered inference.Science, 382(6671):669–674, 2023

Reference 1

Resolution: unresolved; no resolver link, observed 2026-07-11T09:38:44.568685Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 9b4f31b6-3762-481e-a4b7-fad3765f6c9f · outbound

This paper cites PPI++: Efficient Prediction-Powered Inference.

CollabEval: Statistically Efficient Collaborative Model Evaluation via Matrix Completion PPI++: Efficient Prediction-Powered Inference

Reference 2

Resolution: unresolved; no resolver link, observed 2026-07-11T09:38:44.568685Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation be2e3506-c2fc-4221-8876-210ce47a74a4 · outbound

This paper cites Cost-Optimal Active AI Model Evaluation.

CollabEval: Statistically Efficient Collaborative Model Evaluation via Matrix Completion Cost-Optimal Active AI Model Evaluation

Reference 3

Resolution: unresolved; no resolver link, observed 2026-07-11T09:38:44.568685Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation d371683d-e1a6-4b45-bb45-8b4857c73394 · outbound

This paper cites Pythia: A suite for analyzing large language models across training and scaling.

CollabEval: Statistically Efficient Collaborative Model Evaluation via Matrix Completion Pythia: A suite for analyzing large language models across training and scaling

Reference 4

Resolution: unresolved; no resolver link, observed 2026-07-11T09:38:44.568685Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 8199bf4f-c6f3-4619-a026-83f5c73abe93 · outbound

This paper cites Attributed Question Answering: Evaluation and Modeling for Attributed Large Language Models.

CollabEval: Statistically Efficient Collaborative Model Evaluation via Matrix Completion Attributed Question Answering: Evaluation and Modeling for Attributed Large Language Models

Reference 5

Resolution: unresolved; no resolver link, observed 2026-07-11T09:38:44.568685Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 0afdce97-1a9b-4ac9-a09c-ac810dbd5070 · outbound

This paper cites AutoEval Done Right: Using Synthetic Data for Model Evaluation.

CollabEval: Statistically Efficient Collaborative Model Evaluation via Matrix Completion AutoEval Done Right: Using Synthetic Data for Model Evaluation

Reference 6

Resolution: unresolved; no resolver link, observed 2026-07-11T09:38:44.568685Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 76512655-8e38-49eb-a3af-f1b69383252b · outbound

This paper cites Prediction- powered ranking of large language models.

CollabEval: Statistically Efficient Collaborative Model Evaluation via Matrix Completion Prediction- powered ranking of large language models

Reference 7

Resolution: unresolved; no resolver link, observed 2026-07-11T09:38:44.568685Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 7503b542-aac3-458a-80bf-a91ebbf0811c · outbound

This paper cites an unresolved cited work.

CollabEval: Statistically Efficient Collaborative Model Evaluation via Matrix Completion Unresolved cited work

Reference 8

Resolution: unresolved; no resolver link, observed 2026-07-11T09:38:44.568685Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 55fa8252-edae-4ca2-a148-8c31a00822a5 · outbound

This paper cites WMT24++: Expanding the language coverage of WMT24 to 55 languages & dialects.

CollabEval: Statistically Efficient Collaborative Model Evaluation via Matrix Completion WMT24++: Expanding the language coverage of WMT24 to 55 languages & dialects

Reference 9

Resolution: unresolved; no resolver link, observed 2026-07-11T09:38:44.568685Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 9aba35cc-b374-47e7-a9e3-23f33ef68b6d · outbound

This paper cites ISBN 979-8-89176-256-5.

CollabEval: Statistically Efficient Collaborative Model Evaluation via Matrix Completion ISBN 979-8-89176-256-5

Reference 10

Resolution: malformed identifier; no resolver link, observed 2026-07-11T09:38:44.568685Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 6bd22a3e-36df-4bbc-8a8a-b8c582db8871 · outbound

This paper cites Alex Hofer, Bhuwan Dhingra, Amir Globerson, and William W.

CollabEval: Statistically Efficient Collaborative Model Evaluation via Matrix Completion Alex Hofer, Bhuwan Dhingra, Amir Globerson, and William W

Reference 11

Resolution: unresolved; no resolver link, observed 2026-07-11T09:38:44.568685Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 6a243a6d-20e9-42fc-8827-2761071f6ab1 · outbound

This paper cites Can Unconfident LLM Annotations Be Used for Confident Conclusions?.

CollabEval: Statistically Efficient Collaborative Model Evaluation via Matrix Completion Can Unconfident LLM Annotations Be Used for Confident Conclusions?

Reference 12

Resolution: unresolved; no resolver link, observed 2026-07-11T09:38:44.568685Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 0370cbdf-98d8-4cfc-bfe3-cb9bc0f1b549 · outbound

This paper cites Olmo: Accelerating the science of language models.

CollabEval: Statistically Efficient Collaborative Model Evaluation via Matrix Completion Olmo: Accelerating the science of language models

Reference 13

Resolution: unresolved; no resolver link, observed 2026-07-11T09:38:44.568685Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 6e3e85ee-9fed-4849-bc68-bd8eeb72f474 · outbound

This paper cites Measuring Massive Multitask Language Understanding.

CollabEval: Statistically Efficient Collaborative Model Evaluation via Matrix Completion Measuring Massive Multitask Language Understanding

Reference 14

Resolution: unresolved; no resolver link, observed 2026-07-11T09:38:44.568685Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation b3334b36-6038-4fdd-a87c-9ab1cd4c38c4 · outbound

This paper cites an unresolved cited work.

CollabEval: Statistically Efficient Collaborative Model Evaluation via Matrix Completion Unresolved cited work

Reference 15

Resolution: unresolved; no resolver link, observed 2026-07-11T09:38:44.568685Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 110d7b0f-8dc6-4174-940f-fd21bd54dda9 · outbound

This paper cites SWE-bench: Can language models resolve real-world github issues? InThe Twelfth International Conference on Learning Representations, 2024.

CollabEval: Statistically Efficient Collaborative Model Evaluation via Matrix Completion SWE-bench: Can language models resolve real-world github issues? InThe Twelfth International Conference on Learning Representations, 2024

Reference 16

Resolution: unresolved; no resolver link, observed 2026-07-11T09:38:44.568685Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 5099a01d-3c86-4a8a-98b6-df9c475090cb · outbound

This paper cites MetricX-24: The Google submission to the WMT 2024 metrics shared task.

CollabEval: Statistically Efficient Collaborative Model Evaluation via Matrix Completion MetricX-24: The Google submission to the WMT 2024 metrics shared task

Reference 17

Resolution: unresolved; no resolver link, observed 2026-07-11T09:38:44.568685Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 85524a48-99f5-4ebc-9471-bba80e90b4ff · outbound

This paper cites Schulze Buschoff, and Eric Schulz.

CollabEval: Statistically Efficient Collaborative Model Evaluation via Matrix Completion Schulze Buschoff, and Eric Schulz

Reference 18

Resolution: unresolved; no resolver link, observed 2026-07-11T09:38:44.568685Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 14f2a2f7-6923-4fb8-af7c-457cd7089a34 · outbound

This paper cites Hashimoto.

CollabEval: Statistically Efficient Collaborative Model Evaluation via Matrix Completion Hashimoto

Reference 19

Resolution: unresolved; no resolver link, observed 2026-07-11T09:38:44.568685Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 1cbae9d5-e679-4250-af8f-a74275fc6ec4 · outbound

This paper cites LLM360: Towards Fully Transparent Open-Source LLMs.

CollabEval: Statistically Efficient Collaborative Model Evaluation via Matrix Completion LLM360: Towards Fully Transparent Open-Source LLMs

Reference 20

Resolution: unresolved; no resolver link, observed 2026-07-11T09:38:44.568685Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 37d2254b-2d91-4067-b330-26975a3278ec · outbound

This paper cites LLM360 K2: Building a 65B 360-Open-Source Large Language Model from Scratch.

CollabEval: Statistically Efficient Collaborative Model Evaluation via Matrix Completion LLM360 K2: Building a 65B 360-Open-Source Large Language Model from Scratch

Reference 21

Resolution: unresolved; no resolver link, observed 2026-07-11T09:38:44.568685Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 718b6d60-243e-498b-b22f-7feb346fa610 · outbound

This paper cites tinyBenchmarks: evaluating LLMs with fewer examples.

CollabEval: Statistically Efficient Collaborative Model Evaluation via Matrix Completion tinyBenchmarks: evaluating LLMs with fewer examples

Reference 22

Resolution: unresolved; no resolver link, observed 2026-07-11T09:38:44.568685Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 20693ff7-817a-4148-a283-415ad68ad40e · outbound

This paper cites an unresolved cited work.

CollabEval: Statistically Efficient Collaborative Model Evaluation via Matrix Completion Unresolved cited work

Reference 23

Resolution: unresolved; no resolver link, observed 2026-07-11T09:38:44.568685Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 4f83792d-34d7-4869-abcd-ec99aa264564 · outbound

This paper cites Rich insights from cheap signals: Efficient evaluations via tensor factorization.arXiv preprint arXiv:2603.02029, 2026.

CollabEval: Statistically Efficient Collaborative Model Evaluation via Matrix Completion Rich insights from cheap signals: Efficient evaluations via tensor factorization.arXiv preprint arXiv:2603.02029, 2026

Reference 24

Resolution: unresolved; no resolver link, observed 2026-07-11T09:38:44.568685Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 0f7e8fb6-3f15-4d90-b702-972713cba68a · outbound

This paper cites Item response theory in ai: Analysing machine learning classifiers at the instance level.

CollabEval: Statistically Efficient Collaborative Model Evaluation via Matrix Completion Item response theory in ai: Analysing machine learning classifiers at the instance level

Reference 25

Resolution: unresolved; no resolver link, observed 2026-07-11T09:38:44.568685Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation fa2248b8-1ae9-40c8-919f-a0c1375a434f · outbound

This paper cites Spectral regularization algorithms for learning large incomplete matrices.Journal of Machine Learning Research, 11(80):2287–2322, 2010.

CollabEval: Statistically Efficient Collaborative Model Evaluation via Matrix Completion Spectral regularization algorithms for learning large incomplete matrices.Journal of Machine Learning Research, 11(80):2287–2322, 2010

Reference 26

Resolution: unresolved; no resolver link, observed 2026-07-11T09:38:44.568685Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 5dc8a9fd-4260-400c-81a5-bb59980b421b · outbound

This paper cites 2 OLMo 2 Furious.

CollabEval: Statistically Efficient Collaborative Model Evaluation via Matrix Completion 2 OLMo 2 Furious

Reference 27

Resolution: unresolved; no resolver link, observed 2026-07-11T09:38:44.568685Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 2de3510d-d014-4691-a03b-bc3fd55706e3 · outbound

This paper cites You don’t need to run every eval, 2026.

CollabEval: Statistically Efficient Collaborative Model Evaluation via Matrix Completion You don’t need to run every eval, 2026

Reference 28

Resolution: unresolved; no resolver link, observed 2026-07-11T09:38:44.568685Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation d8ecda5b-3b5d-416e-8d88-4fed4a6ba198 · outbound

This paper cites an unresolved cited work.

CollabEval: Statistically Efficient Collaborative Model Evaluation via Matrix Completion Unresolved cited work

Reference 29

Resolution: unresolved; no resolver link, observed 2026-07-11T09:38:44.568685Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 17ccc8fc-b4a2-4191-9cab-a4f68ef7ff72 · outbound

This paper cites Lalor, Robin Jia, and Jordan Boyd-Graber.

CollabEval: Statistically Efficient Collaborative Model Evaluation via Matrix Completion Lalor, Robin Jia, and Jordan Boyd-Graber

Reference 30

Resolution: unresolved; no resolver link, observed 2026-07-11T09:38:44.568685Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 0ce38cd9-04ca-4238-b050-991533acf57c · outbound

This paper cites Missing value estimation methods for dna microarrays.

CollabEval: Statistically Efficient Collaborative Model Evaluation via Matrix Completion Missing value estimation methods for dna microarrays

Reference 31

Resolution: unresolved; no resolver link, observed 2026-07-11T09:38:44.568685Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f15d79b8-bac1-42c5-afd2-29ccf8a163b6 · outbound

This paper cites Anchor points: Benchmark- ing models with much fewer examples.

CollabEval: Statistically Efficient Collaborative Model Evaluation via Matrix Completion Anchor points: Benchmark- ing models with much fewer examples

Reference 32

Resolution: unresolved; no resolver link, observed 2026-07-11T09:38:44.568685Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 0c347fb9-8008-487b-9d6b-fa8c8ae999a6 · outbound

This paper cites doi: 10.18653/v1/2024.eacl-long.95.

CollabEval: Statistically Efficient Collaborative Model Evaluation via Matrix Completion doi: 10.18653/v1/2024.eacl-long.95

Reference 33

Resolution: unresolved; no resolver link, observed 2026-07-11T09:38:44.568685Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 83723642-977d-46eb-a9fc-e0ba118d374a · outbound

This paper cites How predictable are large language model capabilities? a case study on BIG-bench.

CollabEval: Statistically Efficient Collaborative Model Evaluation via Matrix Completion How predictable are large language model capabilities? a case study on BIG-bench

Reference 34

Resolution: unresolved; no resolver link, observed 2026-07-11T09:38:44.568685Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 039ad392-d0be-4578-af57-d52281d244d8 · outbound

This paper cites Collaborative performance prediction for large language models.

CollabEval: Statistically Efficient Collaborative Model Evaluation via Matrix Completion Collaborative performance prediction for large language models

Reference 35

Resolution: unresolved; no resolver link, observed 2026-07-11T09:38:44.568685Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 753df974-f078-4927-8ddb-57e31fd8d0a3 · outbound

This paper cites On speeding up language model evaluation.

CollabEval: Statistically Efficient Collaborative Model Evaluation via Matrix Completion On speeding up language model evaluation

Reference 36

Resolution: unresolved; no resolver link, observed 2026-07-11T09:38:44.568685Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 206bc132-e769-43c5-a55e-49631af956fa · outbound

This paper cites power tuning.

CollabEval: Statistically Efficient Collaborative Model Evaluation via Matrix Completion power tuning

Reference 37

Resolution: unresolved; no resolver link, observed 2026-07-11T09:38:44.568685Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Pith citing papers

Observation ce0c4fc5-f706-427d-809b-790d6c5acc41 · inbound

Efficient Sequential Evaluation of Large Language Models cites this paper.

Efficient Sequential Evaluation of Large Language Models CollabEval: Statistically Efficient Collaborative Model Evaluation via Matrix Completion

Reference 24

Resolution: unresolved; no resolver link, observed 2026-08-01T18:08:21.473999Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f1075e93-4eab-403b-bb71-6bb7527ea992 · inbound

BayesAME: Bayesian Active Model Evaluation cites this paper.

BayesAME: Bayesian Active Model Evaluation CollabEval: Statistically Efficient Collaborative Model Evaluation via Matrix Completion

Reference 2018

Resolution: unresolved; no resolver link, observed 2026-07-30T13:33:12.987656Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.