A Conceptual Framework for AI Capability Evaluations | Paper Citation Record

Observation 56a46f12-71ee-4976-a6fb-c9092c2692c2 · outbound

This paper cites Early insights from developing question-answer evaluations for frontier AI , 2024.

A Conceptual Framework for AI Capability Evaluations Early insights from developing question-answer evaluations for frontier AI , 2024

Reference 1

Resolution: unresolved; no resolver link, observed 2026-08-06T23:25:45.551846Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 0ac43f7a-de55-441e-8b8a-f3db4df5f146 · outbound

This paper cites Benchmarking foundation models with language-model-as-an-examiner.

A Conceptual Framework for AI Capability Evaluations Benchmarking foundation models with language-model-as-an-examiner

Reference 2

Resolution: unresolved; no resolver link, observed 2026-08-06T23:25:45.636681Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 2aec37df-5ee1-4c78-bc3d-08e2ba2adcac · outbound

This paper cites Declare and Justify: Explicit assumptions in AI evaluations are necessary for effective regulation.

A Conceptual Framework for AI Capability Evaluations Declare and Justify: Explicit assumptions in AI evaluations are necessary for effective regulation

Reference 3

Resolution: verified exact; local_arxiv, observed 2026-08-06T23:25:55.126842Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation a571063c-b4e5-48bf-9264-cd696e6d2955 · outbound

This paper cites A quantitative study of nlp approaches to question difficulty estimation.

A Conceptual Framework for AI Capability Evaluations A quantitative study of nlp approaches to question difficulty estimation

Reference 4

Resolution: unresolved; no resolver link, observed 2026-08-06T23:25:45.801503Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation b9b95a89-88bd-4c01-9327-54fbe29ccf2a · outbound

This paper cites Evaluating AI for Law: Bridging the Gap with Open-Source Solutions.

A Conceptual Framework for AI Capability Evaluations Evaluating AI for Law: Bridging the Gap with Open-Source Solutions

Reference 5

Resolution: unresolved; no resolver link, observed 2026-08-06T23:25:45.871791Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 82e98749-5e33-43ee-bfb2-f52008d9eecf · outbound

This paper cites F., Ammanamanchi, P.

A Conceptual Framework for AI Capability Evaluations F., Ammanamanchi, P

Reference 6

Resolution: unresolved; no resolver link, observed 2026-08-06T23:25:45.907864Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 5ac09d81-d2ad-44df-b2e6-9c2291cff01f · outbound

This paper cites R., Steunebrink, B.

A Conceptual Framework for AI Capability Evaluations R., Steunebrink, B

Reference 7

Resolution: unresolved; no resolver link, observed 2026-08-06T23:25:45.928285Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 5a6b3a82-9480-45a9-a5f2-8775b2a04c42 · outbound

This paper cites T., Li, Y., Lundberg, S., et al.

A Conceptual Framework for AI Capability Evaluations T., Li, Y., Lundberg, S., et al

Reference 8

Resolution: unresolved; no resolver link, observed 2026-08-06T23:25:46.009313Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 33e05663-89b0-4d63-afd2-e5be8e5a1bde · outbound

This paper cites Evaluating AI Evaluation: Perils and Prospects.

A Conceptual Framework for AI Capability Evaluations Evaluating AI Evaluation: Perils and Prospects

Reference 9

Resolution: verified exact; local_arxiv, observed 2026-08-06T23:25:54.924747Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation e55a7c09-46e6-4749-9b66-984a37501275 · outbound

This paper cites Paradigms of AI Evaluation: Mapping Goals, Methodologies and Culture.

A Conceptual Framework for AI Capability Evaluations Paradigms of AI Evaluation: Mapping Goals, Methodologies and Culture

Reference 10

Resolution: unresolved; no resolver link, observed 2026-08-06T23:25:46.193957Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 3973a4fa-89d9-446d-a73e-f298d673980b · outbound

This paper cites Code Benchmarks Should Prioritize Rigor, Reliability, and Reproducibility.

A Conceptual Framework for AI Capability Evaluations Code Benchmarks Should Prioritize Rigor, Reliability, and Reproducibility

Reference 11

Resolution: unresolved; no resolver link, observed 2026-08-06T23:25:46.325101Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 59c604f2-32fe-4fd8-8786-6a2409fa4af1 · outbound

This paper cites L., Bucknall, B., Haupt, A., Wei, K., Scheurer, J., Hobbhahn, M., et al.

A Conceptual Framework for AI Capability Evaluations L., Bucknall, B., Haupt, A., Wei, K., Scheurer, J., Hobbhahn, M., et al

Reference 12

Resolution: unresolved; no resolver link, observed 2026-08-06T23:25:46.408648Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 072e7f91-91c7-413b-861d-bd6feb78d302 · outbound

This paper cites Leveraging the Context through Multi-Round Interactions for Jailbreaking Attacks.

A Conceptual Framework for AI Capability Evaluations Leveraging the Context through Multi-Round Interactions for Jailbreaking Attacks

Reference 13

Resolution: unresolved; no resolver link, observed 2026-08-06T23:25:46.504076Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation b18bfa59-ee0d-4948-a88e-14d35f42f66e · outbound

This paper cites N., Li, T., Li, D., Zhu, B., Zhang, H., Jordan, M., Gonzalez, J.

A Conceptual Framework for AI Capability Evaluations N., Li, T., Li, D., Zhu, B., Zhang, H., Jordan, M., Gonzalez, J

Reference 14

Resolution: unresolved; no resolver link, observed 2026-08-06T23:25:46.548943Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 3807f2cd-3c9a-450e-8c1c-5b7852b3bea5 · outbound

This paper cites On the limitations of reference-free evaluations of generated text.

A Conceptual Framework for AI Capability Evaluations On the limitations of reference-free evaluations of generated text

Reference 15

Resolution: unresolved; no resolver link, observed 2026-08-06T23:25:46.659204Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation adc3836f-5c87-4296-a62b-0f2741beb6ce · outbound

This paper cites R., Guo, S., Valko, M., Lillicrap, T., Jimenez Rezende, D., Bengio, Y., Mozer, M.

A Conceptual Framework for AI Capability Evaluations R., Guo, S., Valko, M., Lillicrap, T., Jimenez Rezende, D., Bengio, Y., Mozer, M

Reference 16

Resolution: unresolved; no resolver link, observed 2026-08-06T23:25:46.709874Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 75646943-5fa9-44f0-8e46-1ff23591c1a8 · outbound

This paper cites Generalization or memorization: Data contamination and trustworthy evaluation for large language models.

A Conceptual Framework for AI Capability Evaluations Generalization or memorization: Data contamination and trustworthy evaluation for large language models

Reference 17

Resolution: unresolved; no resolver link, observed 2026-08-06T23:25:46.762683Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation eadbae44-69dc-4b5f-9fd4-33b86c0d57c3 · outbound

This paper cites W., Barocas, S., Atalla, C., Chouldechova, A., and Wallach, H.

A Conceptual Framework for AI Capability Evaluations W., Barocas, S., Atalla, C., Chouldechova, A., and Wallach, H

Reference 18

Resolution: unresolved; no resolver link, observed 2026-08-06T23:25:46.873694Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation bd68057e-87f1-4259-aafc-0a5e2ca81e00 · outbound

This paper cites Can We Trust AI Benchmarks? An Interdisciplinary Review of Current Issues in AI Evaluation.

A Conceptual Framework for AI Capability Evaluations Can We Trust AI Benchmarks? An Interdisciplinary Review of Current Issues in AI Evaluation

Reference 19

Resolution: unresolved; no resolver link, observed 2026-08-06T23:25:46.923418Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 34127b5f-062a-4d44-87b3-254d0096ec13 · outbound

This paper cites Second draft of the general purpose AI code of practice, April 2024.

A Conceptual Framework for AI Capability Evaluations Second draft of the general purpose AI code of practice, April 2024

Reference 20

Resolution: unresolved; no resolver link, observed 2026-08-06T23:25:47.040113Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation b1fe028a-aa7d-46f4-9a9f-035d54b4ab7a · outbound

This paper cites Issue brief: Early best practices for frontier AI safety evaluations, 2024.

A Conceptual Framework for AI Capability Evaluations Issue brief: Early best practices for frontier AI safety evaluations, 2024

Reference 21

Resolution: unresolved; no resolver link, observed 2026-08-06T23:25:47.131398Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 3b78b36f-b168-48c2-8ac5-c73310969e8d · outbound

This paper cites Llm-based nlg evaluation: Current status and challenges.

A Conceptual Framework for AI Capability Evaluations Llm-based nlg evaluation: Current status and challenges

Reference 22

Resolution: unresolved; no resolver link, observed 2026-08-06T23:25:47.228222Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 16e1fce5-805f-480c-b180-0b148e7989ba · outbound

This paper cites A case for better evaluation standards in nlg.

A Conceptual Framework for AI Capability Evaluations A case for better evaluation standards in nlg

Reference 23

Resolution: unresolved; no resolver link, observed 2026-08-06T23:25:47.276468Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c13ba138-d762-47b2-a3a6-d8d958f6c77b · outbound

This paper cites Repairing the cracked foundation: A survey of obstacles in evaluation practices for generated text.

A Conceptual Framework for AI Capability Evaluations Repairing the cracked foundation: A survey of obstacles in evaluation practices for generated text

Reference 24

Resolution: unresolved; no resolver link, observed 2026-08-06T23:25:47.313523Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c51e64f6-6ba2-4066-945f-a0fbdd1330c7 · outbound

This paper cites Legalbench: A collaboratively built benchmark for measuring legal reasoning in large language models.

A Conceptual Framework for AI Capability Evaluations Legalbench: A collaboratively built benchmark for measuring legal reasoning in large language models

Reference 25

Resolution: unresolved; no resolver link, observed 2026-08-06T23:25:47.379142Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation fe5c778a-c3f4-4eef-b481-74e220bd9707 · outbound

This paper cites R., Hullman, J., and Subramonyam, H.

A Conceptual Framework for AI Capability Evaluations R., Hullman, J., and Subramonyam, H

Reference 26

Resolution: unresolved; no resolver link, observed 2026-08-06T23:25:47.435980Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 9d66b178-9203-416a-b59f-cba00e3474cb · outbound

This paper cites Deception abilities emerged in large language models.

A Conceptual Framework for AI Capability Evaluations Deception abilities emerged in large language models

Reference 27

Resolution: unresolved; no resolver link, observed 2026-08-06T23:25:47.478675Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 4ab00757-dd10-479e-bb7c-d091c9ea6e6e · outbound

This paper cites Machine Psychology.

A Conceptual Framework for AI Capability Evaluations Machine Psychology

Reference 28

Resolution: unresolved; no resolver link, observed 2026-08-06T23:25:47.543373Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation a97ec3b4-39a2-481f-b43a-458a2123d40c · outbound

This paper cites a m \"a l \.

A Conceptual Framework for AI Capability Evaluations a m \"a l \

Reference 29

Resolution: unresolved; no resolver link, observed 2026-08-06T23:25:47.585201Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 9e54ed9c-31cb-4272-984b-aa9ada6b3ea8 · outbound

This paper cites and Sharadin, N.

A Conceptual Framework for AI Capability Evaluations and Sharadin, N

Reference 30

Resolution: verified exact; doi, observed 2026-08-06T23:25:53.659452Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation ee802a70-7bb5-4a23-ba11-2a5ebf8ea74f · outbound

This paper cites an unresolved cited work.

A Conceptual Framework for AI Capability Evaluations Unresolved cited work

Reference 31

Resolution: unresolved; no resolver link, observed 2026-08-06T23:25:47.677631Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 710eef11-3f7c-4be0-82b0-5082899058cc · outbound

This paper cites R., Srivastava, A., and Agrawal, P.

A Conceptual Framework for AI Capability Evaluations R., Srivastava, A., and Agrawal, P

Reference 32

Resolution: unresolved; no resolver link, observed 2026-08-06T23:25:47.733085Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 6dba6565-0142-4763-9a95-b2de90f8aebd · outbound

This paper cites Unveiling LLM Evaluation Focused on Metrics: Challenges and Solutions.

A Conceptual Framework for AI Capability Evaluations Unveiling LLM Evaluation Focused on Metrics: Challenges and Solutions

Reference 33

Resolution: unresolved; no resolver link, observed 2026-08-06T23:25:47.781422Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 35245c9b-6ac1-4d25-abec-e0eb5ed53118 · outbound

This paper cites An Empirical Study of LLM-as-a-Judge for LLM Evaluation: Fine-tuned Judge Model is not a General Substitute for GPT-4.

A Conceptual Framework for AI Capability Evaluations An Empirical Study of LLM-as-a-Judge for LLM Evaluation: Fine-tuned Judge Model is not a General Substitute for GPT-4

Reference 34

Resolution: unresolved; no resolver link, observed 2026-08-06T23:25:47.829032Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation aa3b399a-3ee0-4ed2-a902-c0981b5311d0 · outbound

This paper cites M ath P rompter: Mathematical reasoning using large language models.

A Conceptual Framework for AI Capability Evaluations M ath P rompter: Mathematical reasoning using large language models

Reference 35

Resolution: unresolved; no resolver link, observed 2026-08-06T23:25:47.914166Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c1da4d38-4607-4083-9419-d342f740bf94 · outbound

This paper cites Reference-free Evaluation Metrics for Text Generation: A Survey.

A Conceptual Framework for AI Capability Evaluations Reference-free Evaluation Metrics for Text Generation: A Survey

Reference 36

Resolution: verified exact; local_arxiv, observed 2026-08-06T23:25:54.728552Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 54925f13-7666-4392-99fa-5193e14fba91 · outbound

This paper cites Toward best research practices in AI Psychology.

A Conceptual Framework for AI Capability Evaluations Toward best research practices in AI Psychology

Reference 37

Resolution: verified exact; local_arxiv, observed 2026-08-06T23:25:54.582700Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 55acc792-899f-4c18-8a8f-b133f93409ff · outbound

This paper cites Stop uploading test data in plain text: Practical strategies for mitigating data contamination by evaluation benchmarks.

A Conceptual Framework for AI Capability Evaluations Stop uploading test data in plain text: Practical strategies for mitigating data contamination by evaluation benchmarks

Reference 38

Resolution: unresolved; no resolver link, observed 2026-08-06T23:25:48.087777Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation d45f20b3-e3e9-4e0c-ab3f-ce0a28917286 · outbound

This paper cites Cladder: assessing causal reasoning in language models.

A Conceptual Framework for AI Capability Evaluations Cladder: assessing causal reasoning in language models

Reference 39

Resolution: unresolved; no resolver link, observed 2026-08-06T23:25:48.125765Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 00a9df19-b712-4d06-904b-49ee352b09af · outbound

This paper cites T., and Sch \"o lkopf, B.

A Conceptual Framework for AI Capability Evaluations T., and Sch \"o lkopf, B

Reference 40

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T23:26:01.298570Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation d01022a7-f799-4646-a912-8e1f3a2d13f0 · outbound

This paper cites R., Rockt \"a schel, T., and Perez, E.

A Conceptual Framework for AI Capability Evaluations R., Rockt \"a schel, T., and Perez, E

Reference 41

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T23:26:01.127649Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation a592d7bd-4f17-45c0-9458-f5c56aa4505e · outbound

This paper cites Causal reasoning and large language models: Opening a new frontier for causality.

A Conceptual Framework for AI Capability Evaluations Causal reasoning and large language models: Opening a new frontier for causality

Reference 42

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T23:26:00.994216Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 51d4cdcb-d43d-4b85-81ac-bf4ae402e3d6 · outbound

This paper cites AI Agent Governance: A Field Guide.

A Conceptual Framework for AI Capability Evaluations AI Agent Governance: A Field Guide

Reference 43

Resolution: unresolved; no resolver link, observed 2026-08-06T23:25:48.401240Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation bc670b74-da28-4b39-a8df-8559da724f6f · outbound

This paper cites Semantic uncertainty: Linguistic invariances for uncertainty estimation in natural language generation.

A Conceptual Framework for AI Capability Evaluations Semantic uncertainty: Linguistic invariances for uncertainty estimation in natural language generation

Reference 44

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T23:26:00.883960Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation b0d73691-b2dd-42cd-820a-3f58668ca67f · outbound

This paper cites P., Wu, H., and Yu, H.

A Conceptual Framework for AI Capability Evaluations P., Wu, H., and Yu, H

Reference 45

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T23:26:00.734787Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 5e4129ac-86c3-4faf-9444-68359e50e825 · outbound

This paper cites an unresolved cited work.

A Conceptual Framework for AI Capability Evaluations Unresolved cited work

Reference 46

Resolution: unresolved; raw_fallback, observed 2026-08-06T23:26:00.584030Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation ce71553f-637a-4f2d-ae50-a049c57634e1 · outbound

This paper cites J., Kawaguchi, K., Gidel, G., Bengio, Y., Malkin, N., and Jain, M.

A Conceptual Framework for AI Capability Evaluations J., Kawaguchi, K., Gidel, G., Bengio, Y., Malkin, N., and Jain, M

Reference 47

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T23:26:00.401461Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 004986a1-1769-4978-b256-faebbe908244 · outbound

This paper cites Leveraging large language models for nlg evaluation: Advances and challenges.

A Conceptual Framework for AI Capability Evaluations Leveraging large language models for nlg evaluation: Advances and challenges

Reference 48

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T23:26:00.186452Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation d6baae05-f4e8-4bc5-a9e8-b8c3293035cf · outbound

This paper cites D., Re, C., Acosta-Navas, D., Hudson, D.

A Conceptual Framework for AI Capability Evaluations D., Re, C., Acosta-Navas, D., Hudson, D

Reference 49

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T23:25:59.995800Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 8cb3e554-1745-4e84-98c6-229d9424ab14 · outbound

This paper cites Rethinking Model Evaluation as Narrowing the Socio-Technical Gap.

A Conceptual Framework for AI Capability Evaluations Rethinking Model Evaluation as Narrowing the Socio-Technical Gap

Reference 50

Resolution: unresolved; no resolver link, observed 2026-08-06T23:25:48.867513Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation b0b0b00a-9c26-45e8-8fab-8f335df450b4 · outbound

This paper cites D., and Schmidt, L.

A Conceptual Framework for AI Capability Evaluations D., and Schmidt, L

Reference 51

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T23:25:59.828688Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 4a9429d4-ee19-4328-b541-4fb2a90973ca · outbound

This paper cites Against the achilles' heel: A survey on red teaming for generative models.

A Conceptual Framework for AI Capability Evaluations Against the achilles' heel: A survey on red teaming for generative models

Reference 52

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T23:25:59.680442Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 77577b03-da1b-45f3-806a-ebeccf02e3a6 · outbound

This paper cites Datasets for Large Language Models: A Comprehensive Survey.

A Conceptual Framework for AI Capability Evaluations Datasets for Large Language Models: A Comprehensive Survey

Reference 53

Resolution: unresolved; no resolver link, observed 2026-08-06T23:25:49.043762Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation ac7fea2d-36bc-4c4a-96dd-4c3d6f2e3949 · outbound

This paper cites Inadequacies of Large Language Model Benchmarks in the Era of Generative Artificial Intelligence.

A Conceptual Framework for AI Capability Evaluations Inadequacies of Large Language Model Benchmarks in the Era of Generative Artificial Intelligence

Reference 54

Resolution: unresolved; no resolver link, observed 2026-08-06T23:25:49.091271Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 963f8f01-a4d8-433f-b4dc-94a9d4fe8b73 · outbound

This paper cites Ablation Studies in Artificial Neural Networks.

A Conceptual Framework for AI Capability Evaluations Ablation Studies in Artificial Neural Networks

Reference 55

Resolution: unresolved; no resolver link, observed 2026-08-06T23:25:49.152147Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 6998e5e9-1914-483d-ae1e-92ed1e729faf · outbound

This paper cites Adding Error Bars to Evals: A Statistical Approach to Language Model Evaluations.

A Conceptual Framework for AI Capability Evaluations Adding Error Bars to Evals: A Statistical Approach to Language Model Evaluations

Reference 56

Resolution: unresolved; no resolver link, observed 2026-08-06T23:25:49.236771Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 4a602db4-2242-48e2-95bc-a683cd0dcb7b · outbound

This paper cites Auditing large language models: a three-layered approach.

A Conceptual Framework for AI Capability Evaluations Auditing large language models: a three-layered approach

Reference 57

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T23:25:59.470894Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation a4c72738-21da-4f60-9f61-36aa311caba7 · outbound

This paper cites Evaluating the performance of large language models via debates.

A Conceptual Framework for AI Capability Evaluations Evaluating the performance of large language models via debates

Reference 58

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T23:25:59.307346Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 4fd25a23-0496-49c1-83f2-fb582686609a · outbound

This paper cites and Kapoor, S.

A Conceptual Framework for AI Capability Evaluations and Kapoor, S

Reference 59

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T23:25:59.162486Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation e9c72da9-038e-43af-a136-36975fa07e9d · outbound

This paper cites Oecd framework for the classification of ai systems.

A Conceptual Framework for AI Capability Evaluations Oecd framework for the classification of ai systems

Reference 60

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T23:25:59.068464Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation c5ec3c96-8051-49f4-8dac-5ee39d976327 · outbound

This paper cites and Kang, E.

A Conceptual Framework for AI Capability Evaluations and Kang, E

Reference 61

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T23:25:58.945843Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation adcbe876-acc1-4905-90ce-ce33c6e81ce5 · outbound

This paper cites Llm evaluators recognize and favor their own generations.

A Conceptual Framework for AI Capability Evaluations Llm evaluators recognize and favor their own generations

Reference 62

Resolution: unresolved; no resolver link, observed 2026-08-06T23:25:49.679281Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation fd39a5de-c451-41cb-81e9-2af393f33d57 · outbound

This paper cites T., and Soder, L.

A Conceptual Framework for AI Capability Evaluations T., and Soder, L

Reference 63

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T23:25:58.796939Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 506118b0-2baf-4524-9b19-e0dbac91c2dd · outbound

This paper cites Preliminary suggestions for rigorous gpai model evaluations.

A Conceptual Framework for AI Capability Evaluations Preliminary suggestions for rigorous gpai model evaluations

Reference 64

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T23:25:58.632455Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation c4123736-a938-4812-b18a-d77283e1e050 · outbound

This paper cites Discovering language model behaviors with model-written evaluations.

A Conceptual Framework for AI Capability Evaluations Discovering language model behaviors with model-written evaluations

Reference 65

Resolution: unresolved; no resolver link, observed 2026-08-06T23:25:49.881801Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e4697ef7-3a5d-4011-8d66-007b206b5763 · outbound

This paper cites Understanding and Benchmarking Artificial Intelligence: OpenAI's o3 Is Not AGI.

A Conceptual Framework for AI Capability Evaluations Understanding and Benchmarking Artificial Intelligence: OpenAI's o3 Is Not AGI

Reference 66

Resolution: verified exact; local_arxiv, observed 2026-08-06T23:25:54.385746Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 84ad029e-504d-43b8-b4b9-5782528e75fe · outbound

This paper cites The roots search tool: Data transparency for llms.

A Conceptual Framework for AI Capability Evaluations The roots search tool: Data transparency for llms

Reference 67

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T23:25:58.501486Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation bc042dc2-0ba5-4fe6-ae32-322039ba04fb · outbound

This paper cites D., Denton, E., Bender, E.

A Conceptual Framework for AI Capability Evaluations D., Denton, E., Bender, E

Reference 68

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T23:25:58.364595Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 26bacb55-2e61-4dc4-80f4-3ccf8a124bcc · outbound

This paper cites Large language model evaluation via multi ai agents: Preliminary results.

A Conceptual Framework for AI Capability Evaluations Large language model evaluation via multi ai agents: Preliminary results

Reference 69

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T23:25:58.238597Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation a6a02373-3a9c-496b-941d-1f75ed53b553 · outbound

This paper cites A., Comanescu, R., Akbulut, C., Stepleton, T., Mateos-Garcia, J., Bergman, S., Kay, J., et al.

A Conceptual Framework for AI Capability Evaluations A., Comanescu, R., Akbulut, C., Stepleton, T., Mateos-Garcia, J., Bergman, S., Kay, J., et al

Reference 70

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T23:25:58.105856Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation e4c626e1-592a-4ede-a8c0-b2d74d041af9 · outbound

This paper cites Betterbench: Assessing AI benchmarks, uncovering issues, and establishing best practices.

A Conceptual Framework for AI Capability Evaluations Betterbench: Assessing AI benchmarks, uncovering issues, and establishing best practices

Reference 71

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T23:25:57.941298Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 8911e041-adc9-4f40-ae33-939659ae9531 · outbound

This paper cites an unresolved cited work.

A Conceptual Framework for AI Capability Evaluations Unresolved cited work

Reference 72

Resolution: unresolved; raw_fallback, observed 2026-08-06T23:25:57.803711Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation be10e650-3bda-45c4-81d5-af80f392c598 · outbound

This paper cites Open Problems in Technical AI Governance.

A Conceptual Framework for AI Capability Evaluations Open Problems in Technical AI Governance

Reference 73

Resolution: unresolved; no resolver link, observed 2026-08-06T23:25:50.774056Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 67ffcbf6-190b-4473-9af9-39fdcc71e123 · outbound

This paper cites Better than random: reliable nlg human evaluation with constrained active sampling.

A Conceptual Framework for AI Capability Evaluations Better than random: reliable nlg human evaluation with constrained active sampling

Reference 74

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T23:25:57.636905Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 285b97cd-d038-4788-a98a-28ad185ed40d · outbound

This paper cites A Systematic Survey of Prompt Engineering in Large Language Models: Techniques and Applications.

A Conceptual Framework for AI Capability Evaluations A Systematic Survey of Prompt Engineering in Large Language Models: Techniques and Applications

Reference 75

Resolution: unresolved; no resolver link, observed 2026-08-06T23:25:50.970160Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 06f09258-be5a-4152-94b6-e678c1758d10 · outbound

This paper cites L., and Agirre, E.

A Conceptual Framework for AI Capability Evaluations L., and Agirre, E

Reference 76

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T23:25:57.523765Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 15611d99-e4c8-47f7-9a13-65f0a6cd6eec · outbound

This paper cites Targeting the benchmark: On methodology in current natural language processing research.

A Conceptual Framework for AI Capability Evaluations Targeting the benchmark: On methodology in current natural language processing research

Reference 77

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T23:25:57.394177Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation ab2b176f-b0c1-4383-8f99-317bb1790866 · outbound

This paper cites The Prompt Report: A Systematic Survey of Prompt Engineering Techniques.

A Conceptual Framework for AI Capability Evaluations The Prompt Report: A Systematic Survey of Prompt Engineering Techniques

Reference 78

Resolution: unresolved; no resolver link, observed 2026-08-06T23:25:51.375160Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 8a29cb56-42af-44b9-bbe1-b5960eeb87d5 · outbound

This paper cites Quantifying language models' sensitivity to spurious features in prompt design or: How i learned to start worrying about prompt formatting.

A Conceptual Framework for AI Capability Evaluations Quantifying language models' sensitivity to spurious features in prompt design or: How i learned to start worrying about prompt formatting

Reference 79

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T23:25:57.223251Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation f7fa0bd3-765b-4d2d-828e-b39219f73bbf · outbound

This paper cites Model evaluation for extreme risks.

A Conceptual Framework for AI Capability Evaluations Model evaluation for extreme risks

Reference 80

Resolution: unresolved; no resolver link, observed 2026-08-06T23:25:51.618603Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 118d65c2-2e53-4ad1-b92e-aa2243f528a4 · outbound

This paper cites CHOPS : CH at with customer profile systems for customer service with LLM s.

A Conceptual Framework for AI Capability Evaluations CHOPS : CH at with customer profile systems for customer service with LLM s

Reference 81

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T23:25:57.126694Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation c76d5d24-86a7-48e5-a1ca-4b014cc39af5 · outbound

This paper cites MultiChallenge: A Realistic Multi-Turn Conversation Evaluation Benchmark Challenging to Frontier LLMs.

A Conceptual Framework for AI Capability Evaluations MultiChallenge: A Realistic Multi-Turn Conversation Evaluation Benchmark Challenging to Frontier LLMs

Reference 82

Resolution: unresolved; no resolver link, observed 2026-08-06T23:25:51.856959Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c1b18374-ce72-4fed-aaac-82f17e8759ca · outbound

This paper cites K., Grundy, E.

A Conceptual Framework for AI Capability Evaluations K., Grundy, E

Reference 83

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T23:25:56.971466Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 185e5305-7c7c-41c5-ace3-3f8266739e57 · outbound

This paper cites A study of translation edit rate with targeted human annotation.

A Conceptual Framework for AI Capability Evaluations A study of translation edit rate with targeted human annotation

Reference 84

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T23:25:56.857437Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 2a49e061-705b-4e26-8d90-dee0a0afa5df · outbound

This paper cites Audit Cards: Contextualizing AI Evaluations.

A Conceptual Framework for AI Capability Evaluations Audit Cards: Contextualizing AI Evaluations

Reference 85

Resolution: unresolved; no resolver link, observed 2026-08-06T23:25:51.963205Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 2ae1515b-33ea-46ea-ab73-2c5b181161eb · outbound

This paper cites Comprehensive Reassessment of Large-Scale Evaluation Outcomes in LLMs: A Multifaceted Statistical Approach.

A Conceptual Framework for AI Capability Evaluations Comprehensive Reassessment of Large-Scale Evaluation Outcomes in LLMs: A Multifaceted Statistical Approach

Reference 86

Resolution: verified exact; local_arxiv, observed 2026-08-06T23:25:53.477142Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 14000850-7019-4bca-9691-1f96adcad220 · outbound

This paper cites Measuring data science automation: A survey of evaluation tools for ai assistants and agents.

A Conceptual Framework for AI Capability Evaluations Measuring data science automation: A survey of evaluation tools for ai assistants and agents

Reference 87

Resolution: verified exact; raw_fallback, observed 2026-08-06T23:25:54.212966Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation be7fc519-6150-4e21-8327-ac6ee73cc049 · outbound

This paper cites an unresolved cited work.

A Conceptual Framework for AI Capability Evaluations Unresolved cited work

Reference 88

Resolution: unresolved; raw_fallback, observed 2026-08-06T23:25:56.699837Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 0fd337e5-aac8-4913-a99d-2c9805687893 · outbound

This paper cites Best practices for the human evaluation of automatically generated text.

A Conceptual Framework for AI Capability Evaluations Best practices for the human evaluation of automatically generated text

Reference 89

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T23:25:56.585602Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation d86eae37-7fc0-4006-979d-4bc464c7168d · outbound

This paper cites M., Huang, W., Mungra, D., Yuanzhe Pang, R., Phang, J., Liu, H., Cho, K., and Bowman, S.

A Conceptual Framework for AI Capability Evaluations M., Huang, W., Mungra, D., Yuanzhe Pang, R., Phang, J., Liu, H., Cho, K., and Bowman, S

Reference 90

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T23:25:56.435860Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation c09b3736-65ef-49aa-8733-d6afc68e0bef · outbound

This paper cites Mint: Evaluating llms in multi-turn interaction with tools and language feedback.

A Conceptual Framework for AI Capability Evaluations Mint: Evaluating llms in multi-turn interaction with tools and language feedback

Reference 91

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T23:25:56.273371Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 89be56e1-8322-4bbc-b116-dbb0f5f3bae1 · outbound

This paper cites Sociotechnical Safety Evaluation of Generative AI Systems.

A Conceptual Framework for AI Capability Evaluations Sociotechnical Safety Evaluation of Generative AI Systems

Reference 92

Resolution: unresolved; no resolver link, observed 2026-08-06T23:25:52.408995Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 7ea0c3d7-609e-468a-b979-7bd66ba0adf6 · outbound

This paper cites Toward an Evaluation Science for Generative AI Systems.

A Conceptual Framework for AI Capability Evaluations Toward an Evaluation Science for Generative AI Systems

Reference 93

Resolution: unresolved; no resolver link, observed 2026-08-06T23:25:52.454150Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 2f2f12fe-501e-44e3-9f2d-6f33a124818d · outbound

This paper cites An ai system evaluation framework for advancing ai safety: Terminology, taxonomy, lifecycle mapping.

A Conceptual Framework for AI Capability Evaluations An ai system evaluation framework for advancing ai safety: Terminology, taxonomy, lifecycle mapping

Reference 94

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T23:25:56.134856Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 36c38833-b24c-4681-8198-f3d3749122ce · outbound

This paper cites A critical review of causal inference benchmarks for large language models.

A Conceptual Framework for AI Capability Evaluations A critical review of causal inference benchmarks for large language models

Reference 95

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T23:25:55.938837Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 1360cb66-5ad5-4bb0-8ac5-32e483f7ece0 · outbound

This paper cites Evaluatology: The science and engineering of evaluation.

A Conceptual Framework for AI Capability Evaluations Evaluatology: The science and engineering of evaluation

Reference 96

Resolution: unresolved; no resolver link, observed 2026-08-06T23:25:52.632974Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation b7d1310d-4790-46ef-997a-f330a0adec6a · outbound

This paper cites Language model developers should report train-test overlap.

A Conceptual Framework for AI Capability Evaluations Language model developers should report train-test overlap

Reference 97

Resolution: metadata mismatch; local_arxiv, observed 2026-08-06T23:25:53.854157Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 00149752-744b-4812-a5f1-e70f9edab429 · outbound

This paper cites Q., Shaw, R., Anthis, J.

A Conceptual Framework for AI Capability Evaluations Q., Shaw, R., Anthis, J

Reference 98

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T23:25:55.777337Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation ec954761-76ee-44a6-a158-ef68b503ea85 · outbound

This paper cites Pacost: Paired confidence significance testing for benchmark contamination detection in large language models.

A Conceptual Framework for AI Capability Evaluations Pacost: Paired confidence significance testing for benchmark contamination detection in large language models

Reference 99

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T23:25:55.639990Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 739097ec-7486-4a77-88f7-9f66a3f77e30 · outbound

This paper cites and Kanayet, F.

A Conceptual Framework for AI Capability Evaluations and Kanayet, F

Reference 100

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T23:25:55.470953Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Coverage vector

Reference resolution

Outbound references

Pith citing papers