Typed states for the displayed outbound observations.
Source: paper_references, paper_reference_links, observed 2026-05-16T11:26:38.634540Z
Paper Citation Record · LEDGER
Results-Actionability Gap: Understanding How Practitioners Evaluate LLM Products in the Wild
As of 6 August 2026, this Paper Citation Record lists 76 of 76 outbound references and 0 inbound Pith citation observations for arXiv:2604.16304.
A citation records a reference. It does not transfer a finding from one paper to another.
Coverage vector
One-hop event checks from named stored sources.
Source: scholarly_work_events, retraction_status_cache, observed 2026-08-05T06:32:48.257954+00:00
Pith citing papers itemized under the disclosed page cap.
Source: paper_references, paper_reference_links
A source-named dated measurement, never combined with another source.
Source: cited_works
Reference resolution
76 of 76 outbound references displayed
- verified exact31
- verified fuzzy6
- unresolved23
- parse uncertain0
- malformed identifier8
- metadata mismatch8
External citation measurements
No source-named external measurement is stored.
Outbound references
Observation 80e341ab-260a-428b-9938-e79d6df64d11 · outbound
This paper cites 2001.Introduction to measurement theory.
Results-Actionability Gap: Understanding How Practitioners Evaluate LLM Products in the Wild 2001.Introduction to measurement theory
Reference 1
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-05-16T11:27:48.496686Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.
Observation 8933a2d6-0df9-4728-9308-db5098a0cf22 · outbound
This paper cites an unresolved cited work.
Results-Actionability Gap: Understanding How Practitioners Evaluate LLM Products in the Wild Unresolved cited work
Reference 2
- Resolution
- unresolved
- raw_fallback, observed 2026-05-16T11:27:48.453775Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.
Observation 851e59cc-2593-4d09-8730-60a0d96bab1e · outbound
This paper cites an unresolved cited work.
Results-Actionability Gap: Understanding How Practitioners Evaluate LLM Products in the Wild Unresolved cited work
Reference 4
- Resolution
- unresolved
- raw_fallback, observed 2026-05-16T11:27:48.509630Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.
Observation cd535416-a21e-41e0-9f10-63735a5f3287 · outbound
This paper cites LLMs instead of human judges? a large scale empirical study across 20 NLP evaluation tasks.
Results-Actionability Gap: Understanding How Practitioners Evaluate LLM Products in the Wild LLMs instead of human judges? a large scale empirical study across 20 NLP evaluation tasks
Reference 5
- Resolution
- verified exact
- doi, observed 2026-05-16T11:27:47.904536Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.
Observation b33a07bc-e042-402b-bafd-39b36c57c02b · outbound
This paper cites an unresolved cited work.
Results-Actionability Gap: Understanding How Practitioners Evaluate LLM Products in the Wild Unresolved cited work
Reference 6
- Resolution
- unresolved
- raw_fallback, observed 2026-05-16T11:27:48.507918Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.
Observation 077db636-8303-496c-aea2-f7cc50494ea7 · outbound
This paper cites Lessons from the Trenches on Reproducible Evaluation of Language Models.
Results-Actionability Gap: Understanding How Practitioners Evaluate LLM Products in the Wild Lessons from the Trenches on Reproducible Evaluation of Language Models
Reference 7
- Resolution
- verified exact
- arxiv_id, observed 2026-05-16T18:44:50.211576Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.
Observation 9372f1ff-ce68-4137-a29b-9dc82731c75a · outbound
This paper cites 2022.Thematic Analysis: A Practical Guide.
Results-Actionability Gap: Understanding How Practitioners Evaluate LLM Products in the Wild 2022.Thematic Analysis: A Practical Guide
Reference 8
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-05-16T11:27:48.483982Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.
Observation 8b667205-3b4a-43b0-958a-96527d2cab0c · outbound
This paper cites Yu, Qiang Yang, and Xing Xie.
Results-Actionability Gap: Understanding How Practitioners Evaluate LLM Products in the Wild Yu, Qiang Yang, and Xing Xie
Reference 9
- Resolution
- verified exact
- doi, observed 2026-05-16T11:27:47.878496Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.
Observation f065e130-ba71-43de-8fa9-6c8a0cfac72e · outbound
This paper cites All That's 'Human' Is Not Gold: Evaluating Human Evaluation of Generated Text.
Results-Actionability Gap: Understanding How Practitioners Evaluate LLM Products in the Wild All That's 'Human' Is Not Gold: Evaluating Human Evaluation of Generated Text
Reference 10
- Resolution
- verified exact
- arxiv_id, observed 2026-05-16T11:27:48.159299Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.
Observation b84cc13c-78a3-4706-a23b-b4c6dfb83173 · outbound
This paper cites Collins, Albert Q.
Results-Actionability Gap: Understanding How Practitioners Evaluate LLM Products in the Wild Collins, Albert Q
Reference 11
- Resolution
- verified exact
- doi, observed 2026-05-16T11:27:47.834809Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.
Observation ba750c34-295a-404a-831f-a388cd25c403 · outbound
This paper cites Bennett, Gary Hsieh, and Sean A.
Results-Actionability Gap: Understanding How Practitioners Evaluate LLM Products in the Wild Bennett, Gary Hsieh, and Sean A
Reference 12
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-05-16T11:27:48.488384Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.
Observation 8b1fa7d3-34e7-4c4f-a915-3acf674e0c35 · outbound
This paper cites The WyCash portfolio management system.Proceedings of the Conference on Object-Oriented Programming Systems, Languages, and Applications, OOPSLA.1992;Part F1296(October):29–30.
Results-Actionability Gap: Understanding How Practitioners Evaluate LLM Products in the Wild The WyCash portfolio management system.Proceedings of the Conference on Object-Oriented Programming Systems, Languages, and Applications, OOPSLA.1992;Part F1296(October):29–30
Reference 13
- Resolution
- verified exact
- arxiv_id, observed 2026-05-16T11:27:47.864303Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.
Observation f5df0b8b-740b-4758-b416-7d3930930720 · outbound
This paper cites an unresolved cited work.
Results-Actionability Gap: Understanding How Practitioners Evaluate LLM Products in the Wild Unresolved cited work
Reference 14
- Resolution
- unresolved
- raw_fallback, observed 2026-05-16T11:27:48.490381Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.
Observation c1c6f0f1-d791-4621-a60a-03844a4c333a · outbound
This paper cites an unresolved cited work.
Results-Actionability Gap: Understanding How Practitioners Evaluate LLM Products in the Wild Unresolved cited work
Reference 15
- Resolution
- unresolved
- raw_fallback, observed 2026-05-16T11:27:48.492227Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.
Observation 1800c2d2-f378-4ad2-83b4-64e245562f74 · outbound
This paper cites Towards A Rigorous Science of Interpretable Machine Learning.
Results-Actionability Gap: Understanding How Practitioners Evaluate LLM Products in the Wild Towards A Rigorous Science of Interpretable Machine Learning
Reference 16
- Resolution
- verified exact
- local_arxiv, observed 2026-05-16T11:27:48.162805Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.
Observation 867b3613-c244-4fde-8aea-314055d7f3ef · outbound
This paper cites Xu, Huazuo Gao, Deli Chen, Jiashi Li, Wangding Zeng, Xingkai Yu, Y.
Results-Actionability Gap: Understanding How Practitioners Evaluate LLM Products in the Wild Xu, Huazuo Gao, Deli Chen, Jiashi Li, Wangding Zeng, Xingkai Yu, Y
Reference 17
- Resolution
- malformed identifier
- doi_truncated, observed 2026-05-16T11:27:47.845342Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.
Observation 642437ac-0201-4472-a60f-bdd951fd3cf2 · outbound
This paper cites An extension of HybridSynchAADL and its application to collaborating au- tonomous UA Vs.
Results-Actionability Gap: Understanding How Practitioners Evaluate LLM Products in the Wild An extension of HybridSynchAADL and its application to collaborating au- tonomous UA Vs
Reference 18
- Resolution
- malformed identifier
- doi_truncated, observed 2026-05-16T11:27:47.874813Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.
Observation 68611810-516a-47da-a2b2-e4c4faf8dfdb · outbound
This paper cites an unresolved cited work.
Results-Actionability Gap: Understanding How Practitioners Evaluate LLM Products in the Wild Unresolved cited work
Reference 19
- Resolution
- unresolved
- raw_fallback, observed 2026-05-16T11:27:48.504268Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.
Observation 8e8082fe-c8f1-41f5-a457-ba29a69b883d · outbound
This paper cites Gallagher, Jasmine Ratchford, Tyler Brooks, Bryan P.
Results-Actionability Gap: Understanding How Practitioners Evaluate LLM Products in the Wild Gallagher, Jasmine Ratchford, Tyler Brooks, Bryan P
Reference 20
- Resolution
- verified exact
- arxiv_id, observed 2026-05-16T11:27:47.893352Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.
Observation 5ea49024-9aa2-41c8-929e-ea11e617409d · outbound
This paper cites Repairing the cracked foundation: A survey of obstacles in evaluation practices for generated text.
Results-Actionability Gap: Understanding How Practitioners Evaluate LLM Products in the Wild Repairing the cracked foundation: A survey of obstacles in evaluation practices for generated text
Reference 21
- Resolution
- verified exact
- doi, observed 2026-05-16T11:27:47.867364Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.
Observation f31a23bd-c6bd-43b0-889f-6b740966aec8 · outbound
This paper cites an unresolved cited work.
Results-Actionability Gap: Understanding How Practitioners Evaluate LLM Products in the Wild Unresolved cited work
Reference 23
- Resolution
- unresolved
- raw_fallback, observed 2026-05-16T11:27:48.482170Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.
Observation dc70fb52-17e8-4e3c-a259-cdd0d716fc8c · outbound
This paper cites Measuring Massive Multitask Language Understanding.
Results-Actionability Gap: Understanding How Practitioners Evaluate LLM Products in the Wild Measuring Massive Multitask Language Understanding
Reference 24
- Resolution
- verified exact
- local_arxiv, observed 2026-05-16T11:27:47.852132Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.
Observation 2d582065-7ce6-4686-9177-cc608f00d943 · outbound
This paper cites an unresolved cited work.
Results-Actionability Gap: Understanding How Practitioners Evaluate LLM Products in the Wild Unresolved cited work
Reference 25
- Resolution
- malformed identifier
- arxiv_id, observed 2026-05-16T11:27:48.169940Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.
Observation 634a7496-4a61-4b54-9ae7-01197c2b8530 · outbound
This paper cites Towards interactive evaluations for interaction harms in human-AI systems.
Results-Actionability Gap: Understanding How Practitioners Evaluate LLM Products in the Wild Towards interactive evaluations for interaction harms in human-AI systems
Reference 26
- Resolution
- verified exact
- arxiv_id, observed 2026-05-16T11:27:47.886634Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.
Observation e9667621-0abd-45e1-929f-6d6bbfea9c65 · outbound
This paper cites Jacobs and Hanna Wallach.
Results-Actionability Gap: Understanding How Practitioners Evaluate LLM Products in the Wild Jacobs and Hanna Wallach
Reference 27
- Resolution
- verified exact
- arxiv_id, observed 2026-05-16T11:27:47.814181Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.
Observation 7677e608-811f-490f-8044-63846081f68f · outbound
This paper cites Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing.
Results-Actionability Gap: Understanding How Practitioners Evaluate LLM Products in the Wild Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing
Reference 28
- Resolution
- verified exact
- doi, observed 2026-05-16T11:27:47.896651Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.
Observation 2c83638c-126d-43d7-bff1-6d1e563fee52 · outbound
This paper cites Evaluating Human-Language Model Interaction.
Results-Actionability Gap: Understanding How Practitioners Evaluate LLM Products in the Wild Evaluating Human-Language Model Interaction
Reference 29
- Resolution
- metadata mismatch
- arxiv_id, observed 2026-05-16T11:27:48.177470Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.
Observation b3859dfb-7c22-4824-8991-0fcfd778ef64 · outbound
This paper cites an unresolved cited work.
Results-Actionability Gap: Understanding How Practitioners Evaluate LLM Products in the Wild Unresolved cited work
Reference 30
- Resolution
- unresolved
- raw_fallback, observed 2026-05-16T11:27:48.478434Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.
Observation bfd5ece7-7118-4f4a-8ab9-41bfc0c926ad · outbound
This paper cites Holistic Evaluation of Language Models.
Results-Actionability Gap: Understanding How Practitioners Evaluate LLM Products in the Wild Holistic Evaluation of Language Models
Reference 31
- Resolution
- metadata mismatch
- local_arxiv, observed 2026-05-16T11:27:47.839549Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.
Observation fe8eb688-3b1f-421d-afc1-47a3f38d2548 · outbound
This paper cites Rethinking Model Evaluation as Narrowing the Socio-Technical Gap.
Results-Actionability Gap: Understanding How Practitioners Evaluate LLM Products in the Wild Rethinking Model Evaluation as Narrowing the Socio-Technical Gap
Reference 32
- Resolution
- metadata mismatch
- arxiv_id, observed 2026-05-16T11:27:48.140243Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.
Observation 853f6ce4-547b-4940-ae04-1c5c627994a4 · outbound
This paper cites an unresolved cited work.
Results-Actionability Gap: Understanding How Practitioners Evaluate LLM Products in the Wild Unresolved cited work
Reference 33
- Resolution
- unresolved
- raw_fallback, observed 2026-05-16T11:27:48.494327Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.
Observation 001f13f0-6994-424d-9679-3127905ec226 · outbound
This paper cites an unresolved cited work.
Results-Actionability Gap: Understanding How Practitioners Evaluate LLM Products in the Wild Unresolved cited work
Reference 34
- Resolution
- verified exact
- doi, observed 2026-05-16T11:27:47.899203Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.
Observation e6bcc486-f2a1-49ba-9502-266cba625410 · outbound
This paper cites In: Zong, C., Xia, F., Li, W., Navigli, R.
Results-Actionability Gap: Understanding How Practitioners Evaluate LLM Products in the Wild In: Zong, C., Xia, F., Li, W., Navigli, R
Reference 35
- Resolution
- malformed identifier
- doi_truncated, observed 2026-05-16T11:27:47.848306Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.
Observation 333773b1-c3c1-434b-95d2-a90fbc04dafe · outbound
This paper cites Aligning with Human Judgement: The Role of Pairwise Preference in Large Language Model Evaluators.
Results-Actionability Gap: Understanding How Practitioners Evaluate LLM Products in the Wild Aligning with Human Judgement: The Role of Pairwise Preference in Large Language Model Evaluators
Reference 36
- Resolution
- verified exact
- arxiv_id, observed 2026-05-16T11:27:48.133595Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.
Observation 57d23f4c-4081-458d-8ae2-068ccde76639 · outbound
This paper cites Vera Liao, Alexandra Olteanu, and Ziang Xiao.
Results-Actionability Gap: Understanding How Practitioners Evaluate LLM Products in the Wild Vera Liao, Alexandra Olteanu, and Ziang Xiao
Reference 37
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-05-16T11:27:48.474495Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.
Observation 27cc4289-3688-47fe-a0f3-1557c1baa35e · outbound
This paper cites Welcome your new AI teammate: On safety analysis by leashing large language mod- els.
Results-Actionability Gap: Understanding How Practitioners Evaluate LLM Products in the Wild Welcome your new AI teammate: On safety analysis by leashing large language mod- els
Reference 38
- Resolution
- verified exact
- arxiv_id, observed 2026-05-16T11:27:47.871460Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.
Observation ac8613c3-61c6-4564-9e12-62af4a5afc04 · outbound
This paper cites Insightai: Root cause analysis in large log files with private data using large language model.
Results-Actionability Gap: Understanding How Practitioners Evaluate LLM Products in the Wild Insightai: Root cause analysis in large log files with private data using large language model
Reference 39
- Resolution
- verified exact
- arxiv_id, observed 2026-05-16T11:27:47.787309Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.
Observation 93cfc402-2e07-4269-8275-7d3c666342eb · outbound
This paper cites an unresolved cited work.
Results-Actionability Gap: Understanding How Practitioners Evaluate LLM Products in the Wild Unresolved cited work
Reference 40
- Resolution
- unresolved
- raw_fallback, observed 2026-05-16T11:27:48.476622Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.
Observation 7fb0825c-fd3e-4972-8f08-05234f5e7fa3 · outbound
This paper cites McIntosh and Teo Susnjak and Nalin A.
Results-Actionability Gap: Understanding How Practitioners Evaluate LLM Products in the Wild McIntosh and Teo Susnjak and Nalin A
Reference 41
- Resolution
- verified exact
- arxiv_id, observed 2026-05-16T11:27:47.826375Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.
Observation 27063029-dd91-45fb-8585-cf3d24a224c8 · outbound
This paper cites an unresolved cited work.
Results-Actionability Gap: Understanding How Practitioners Evaluate LLM Products in the Wild Unresolved cited work
Reference 42
- Resolution
- unresolved
- raw_fallback, observed 2026-05-16T11:27:48.470277Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.
Observation fbddf141-cf64-494d-948c-6e7632a1ba2f · outbound
This paper cites an unresolved cited work.
Results-Actionability Gap: Understanding How Practitioners Evaluate LLM Products in the Wild Unresolved cited work
Reference 43
- Resolution
- malformed identifier
- raw_fallback, observed 2026-05-16T11:27:48.472442Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.
Observation f0848d9d-3205-4797-bc79-af2aa97ef347 · outbound
This paper cites In2025 IEEE/ACM 47th International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP).
Results-Actionability Gap: Understanding How Practitioners Evaluate LLM Products in the Wild In2025 IEEE/ACM 47th International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP)
Reference 44
- Resolution
- metadata mismatch
- arxiv_id, observed 2026-05-16T11:27:47.856810Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.
Observation 566e65d9-87a1-48b9-901d-a80e896c55e6 · outbound
This paper cites an unresolved cited work.
Results-Actionability Gap: Understanding How Practitioners Evaluate LLM Products in the Wild Unresolved cited work
Reference 45
- Resolution
- unresolved
- raw_fallback, observed 2026-05-16T11:27:48.511279Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.
Observation 218778fb-06fb-4b8a-941c-aa30ea9dfed1 · outbound
This paper cites an unresolved cited work.
Results-Actionability Gap: Understanding How Practitioners Evaluate LLM Products in the Wild Unresolved cited work
Reference 46
- Resolution
- unresolved
- raw_fallback, observed 2026-05-16T11:27:48.451590Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.
Observation 75230a94-7698-4b96-a6b1-4f25dd1cc06a · outbound
This paper cites Human-Centered Design Recommendations for LLM-as-a-Judge.
Results-Actionability Gap: Understanding How Practitioners Evaluate LLM Products in the Wild Human-Centered Design Recommendations for LLM-as-a-Judge
Reference 47
- Resolution
- verified exact
- arxiv_id, observed 2026-05-16T11:27:48.184935Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.
Observation 297542bf-2184-4d8a-8a04-f51344b29ff3 · outbound
This paper cites Jianming Chang, Songqiang Chen, Chao Peng, Hao Yu, Zhiming Li, Pengfei Gao, and Tao Xie.
Results-Actionability Gap: Understanding How Practitioners Evaluate LLM Products in the Wild Jianming Chang, Songqiang Chen, Chao Peng, Hao Yu, Zhiming Li, Pengfei Gao, and Tao Xie
Reference 48
- Resolution
- malformed identifier
- arxiv_id, observed 2026-05-16T11:27:48.155468Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.
Observation 13c8994e-228b-4a65-826a-a2d2d8fdaf64 · outbound
This paper cites White, Margaret Mitchell, Timnit Gebru, Ben Hutchinson, Jamila Smith-Loud, Daniel Theron, and Parker Barnes.
Results-Actionability Gap: Understanding How Practitioners Evaluate LLM Products in the Wild White, Margaret Mitchell, Timnit Gebru, Ben Hutchinson, Jamila Smith-Loud, Daniel Theron, and Parker Barnes
Reference 49
- Resolution
- metadata mismatch
- arxiv_id, observed 2026-05-16T11:27:48.137236Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.
Observation d346d19b-b601-4c32-abc0-d40d1b223dcc · outbound
This paper cites Roedl and Erik Stolterman.
Results-Actionability Gap: Understanding How Practitioners Evaluate LLM Products in the Wild Roedl and Erik Stolterman
Reference 50
- Resolution
- verified exact
- arxiv_id, observed 2026-05-16T11:27:47.809588Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.
Observation 6aecd7c5-8c64-474c-aa7e-3604f74b1899 · outbound
This paper cites The user experience of ChatGPT: Findings from a questionnaire study of early users, in: Proc.
Results-Actionability Gap: Understanding How Practitioners Evaluate LLM Products in the Wild The user experience of ChatGPT: Findings from a questionnaire study of early users, in: Proc
Reference 51
- Resolution
- verified exact
- arxiv_id, observed 2026-05-16T11:27:47.821769Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.
Observation f2e49c1e-2fa3-4470-baae-0463ec1a19ff · outbound
This paper cites Emerging roles and relationships among humans and interactive ai systems.International Journal of Human–Computer Interaction, 41(17):10595–10617.
Results-Actionability Gap: Understanding How Practitioners Evaluate LLM Products in the Wild Emerging roles and relationships among humans and interactive ai systems.International Journal of Human–Computer Interaction, 41(17):10595–10617
Reference 52
- Resolution
- malformed identifier
- arxiv_id, observed 2026-05-16T11:27:48.166766Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.
Observation f4010a13-58e0-44f0-8430-e0057f263945 · outbound
This paper cites Who Validates the Validators? Aligning LLM-Assisted Evaluation of LLM Outputs with Human Preferences.
Results-Actionability Gap: Understanding How Practitioners Evaluate LLM Products in the Wild Who Validates the Validators? Aligning LLM-Assisted Evaluation of LLM Outputs with Human Preferences
Reference 53
- Resolution
- verified exact
- arxiv_id, observed 2026-05-16T11:27:48.147823Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.
Observation 0871d58b-932b-4134-ae2e-06c0b6dbb904 · outbound
This paper cites Shergadwala, Himabindu Lakkaraju, and Krishnaram Kenthapadi.
Results-Actionability Gap: Understanding How Practitioners Evaluate LLM Products in the Wild Shergadwala, Himabindu Lakkaraju, and Krishnaram Kenthapadi
Reference 54
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-05-16T11:27:48.465991Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.
Observation dd7e5557-0e1f-4db9-87ef-50de955665f5 · outbound
This paper cites an unresolved cited work.
Results-Actionability Gap: Understanding How Practitioners Evaluate LLM Products in the Wild Unresolved cited work
Reference 55
- Resolution
- unresolved
- raw_fallback, observed 2026-05-16T11:27:48.467993Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.
Observation 810bb39f-09bc-441f-9959-2707bf7a9c9a · outbound
This paper cites What factors might be causing the significant deviations in my circadian rhythm patterns over the past 30 days?.
Results-Actionability Gap: Understanding How Practitioners Evaluate LLM Products in the Wild What factors might be causing the significant deviations in my circadian rhythm patterns over the past 30 days?
Reference 56
- Resolution
- verified exact
- doi, observed 2026-05-16T11:27:47.816958Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.
Observation 09f64f09-602a-467d-b4fc-b9500cd8316f · outbound
This paper cites Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models.
Results-Actionability Gap: Understanding How Practitioners Evaluate LLM Products in the Wild Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models
Reference 57
- Resolution
- malformed identifier
- local_arxiv, observed 2026-05-16T11:27:47.797554Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.
Observation 4d4c71f7-8d3b-4242-9ea4-84eec71e99a0 · outbound
This paper cites Stolyar, Katelyn Polanska, Karleigh R.
Results-Actionability Gap: Understanding How Practitioners Evaluate LLM Products in the Wild Stolyar, Katelyn Polanska, Karleigh R
Reference 58
- Resolution
- verified exact
- doi, observed 2026-05-16T11:27:47.881004Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.
Observation deb2eb5c-4aa6-4b73-a29f-4af409cb3453 · outbound
This paper cites an unresolved cited work.
Results-Actionability Gap: Understanding How Practitioners Evaluate LLM Products in the Wild Unresolved cited work
Reference 59
- Resolution
- unresolved
- raw_fallback, observed 2026-05-16T11:27:48.455510Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.
Observation 992133ee-f6b2-402f-8aec-2bc377c8635b · outbound
This paper cites an unresolved cited work.
Results-Actionability Gap: Understanding How Practitioners Evaluate LLM Products in the Wild Unresolved cited work
Reference 60
- Resolution
- unresolved
- raw_fallback, observed 2026-05-16T11:27:48.461524Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.
Observation ca2c015b-5ab0-4fed-9b85-141c840b6543 · outbound
This paper cites an unresolved cited work.
Results-Actionability Gap: Understanding How Practitioners Evaluate LLM Products in the Wild Unresolved cited work
Reference 61
- Resolution
- verified exact
- doi, observed 2026-05-16T11:27:47.883237Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.
Observation 25e632c4-0b85-4311-a715-4bc877246762 · outbound
This paper cites an unresolved cited work.
Results-Actionability Gap: Understanding How Practitioners Evaluate LLM Products in the Wild Unresolved cited work
Reference 62
- Resolution
- unresolved
- raw_fallback, observed 2026-05-16T11:27:48.459656Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.
Observation 09bc4aa2-72d8-479d-853b-731026a23d6b · outbound
This paper cites Proceedings of the 2018.
Results-Actionability Gap: Understanding How Practitioners Evaluate LLM Products in the Wild Proceedings of the 2018
Reference 63
- Resolution
- verified exact
- doi, observed 2026-05-16T11:27:47.802686Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.
Observation 74507c95-25d9-4b6a-a01b-f6e7661780b6 · outbound
This paper cites Industry Practitioners Perspectives on AI Model Quality: Perceptions, Challenges, and Solutions.
Results-Actionability Gap: Understanding How Practitioners Evaluate LLM Products in the Wild Industry Practitioners Perspectives on AI Model Quality: Perceptions, Challenges, and Solutions
Reference 64
- Resolution
- metadata mismatch
- local_arxiv, observed 2026-05-16T11:27:48.181459Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.
Observation 167c89ad-4491-4e22-b6a5-37350ef5bc41 · outbound
This paper cites an unresolved cited work.
Results-Actionability Gap: Understanding How Practitioners Evaluate LLM Products in the Wild Unresolved cited work
Reference 65
- Resolution
- unresolved
- raw_fallback, observed 2026-05-16T11:27:48.506150Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.
Observation f5951944-213e-44ba-bd14-2857391ddc4b · outbound
This paper cites MacLellan.
Results-Actionability Gap: Understanding How Practitioners Evaluate LLM Products in the Wild MacLellan
Reference 66
- Resolution
- metadata mismatch
- arxiv_id, observed 2026-05-16T11:27:47.832098Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.
Observation ca0a90b5-20ac-4025-ac26-bc4addbb0079 · outbound
This paper cites A User-Centric Multi-Intent Benchmark for Evaluating Large Language Models.
Results-Actionability Gap: Understanding How Practitioners Evaluate LLM Products in the Wild A User-Centric Multi-Intent Benchmark for Evaluating Large Language Models
Reference 67
- Resolution
- verified exact
- arxiv_id, observed 2026-05-16T11:27:48.173597Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.
Observation 74fcc166-da4b-4d85-933d-994eb24b6569 · outbound
This paper cites an unresolved cited work.
Results-Actionability Gap: Understanding How Practitioners Evaluate LLM Products in the Wild Unresolved cited work
Reference 68
- Resolution
- unresolved
- raw_fallback, observed 2026-05-16T11:27:48.457454Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.
Observation d78b3bbd-e1c3-46ce-aaf5-4b5b5e18a3dd · outbound
This paper cites an unresolved cited work.
Results-Actionability Gap: Understanding How Practitioners Evaluate LLM Products in the Wild Unresolved cited work
Reference 69
- Resolution
- unresolved
- raw_fallback, observed 2026-05-16T11:27:48.480383Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.
Observation f0167c0e-0463-44fa-a1b8-6bf56655e503 · outbound
This paper cites Sociotechnical Safety Evaluation of Generative AI Systems.
Results-Actionability Gap: Understanding How Practitioners Evaluate LLM Products in the Wild Sociotechnical Safety Evaluation of Generative AI Systems
Reference 70
- Resolution
- verified exact
- arxiv_id, observed 2026-05-16T11:27:48.144345Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.
Observation e7312317-cefb-4177-bf4e-91e5db0b9a18 · outbound
This paper cites an unresolved cited work.
Results-Actionability Gap: Understanding How Practitioners Evaluate LLM Products in the Wild Unresolved cited work
Reference 71
- Resolution
- unresolved
- raw_fallback, observed 2026-05-16T11:27:48.498973Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.
Observation fa00ad77-93ce-4e73-b336-d056a3b35f51 · outbound
This paper cites Vera Liao.
Results-Actionability Gap: Understanding How Practitioners Evaluate LLM Products in the Wild Vera Liao
Reference 72
- Resolution
- verified exact
- doi, observed 2026-05-16T11:27:47.901787Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.
Observation 0510db8b-0d87-476b-8657-23546a52059e · outbound
This paper cites Hashimoto.
Results-Actionability Gap: Understanding How Practitioners Evaluate LLM Products in the Wild Hashimoto
Reference 73
- Resolution
- verified exact
- doi, observed 2026-05-16T11:27:47.889515Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.
Observation 5eac3c4a-458e-4c6f-a953-2af68497b5d0 · outbound
This paper cites an unresolved cited work.
Results-Actionability Gap: Understanding How Practitioners Evaluate LLM Products in the Wild Unresolved cited work
Reference 74
- Resolution
- unresolved
- raw_fallback, observed 2026-05-16T11:27:48.463651Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.
Observation 4bac9148-1a9f-4b4c-83a0-f9f3c95bc09c · outbound
This paper cites Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena.
Results-Actionability Gap: Understanding How Practitioners Evaluate LLM Products in the Wild Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena
Reference 75
- Resolution
- metadata mismatch
- local_arxiv, observed 2026-05-16T11:27:47.860553Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.
Observation 4a5f1225-deb4-4932-81c5-da2e02e5226a · outbound
This paper cites Deconstructing NLG Evaluation: Evaluation Practices, Assumptions, and Their Implications.
Results-Actionability Gap: Understanding How Practitioners Evaluate LLM Products in the Wild Deconstructing NLG Evaluation: Evaluation Practices, Assumptions, and Their Implications
Reference 76
- Resolution
- verified exact
- doi, observed 2026-05-16T11:27:47.842619Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.
Observation 274674f2-c35f-45b2-b5b7-fc26280b0466 · outbound
This paper cites an unresolved cited work.
Results-Actionability Gap: Understanding How Practitioners Evaluate LLM Products in the Wild Unresolved cited work
Reference 77
- Resolution
- unresolved
- raw_fallback, observed 2026-05-16T11:27:48.486248Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.
Observation b2324964-4818-47e1-ad9b-514c271ced54 · outbound
This paper cites InProceedings of the Thirteenth International Conference on Learning Representations.
Results-Actionability Gap: Understanding How Practitioners Evaluate LLM Products in the Wild InProceedings of the Thirteenth International Conference on Learning Representations
Reference 78
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-05-16T11:27:48.501760Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.
Pith citing papers
No inbound Pith citation observations are available.