Toward best research practices in AI Psychology

Anna A. Ivanova

Toward best research practices in AI Psychology

Not yet reviewed by Pith; the record is open.

Re-run · record.json Download PDF Read on arXiv ↗

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2312.01276 v2 pith:OSCM3HBA submitted 2023-12-03 cs.AI cs.CL

Anna A. Ivanova This is my paper

classification cs.AIcs.CL

keywords psychologystudiesabilitiesaccuratelybecomebestburgeoningcognitive

verification ladder T0 review T1 audit T2 compute T3 formal

0 comments

read the original abstract

Language models have become an essential part of the burgeoning field of AI Psychology. I discuss 14 methodological considerations that can help design more robust, generalizable studies evaluating the cognitive abilities of language-based AI systems, as well as to accurately interpret the results of these studies.

Discussion (0). Sign in to comment.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

A Conceptual Framework for AI Capability Evaluations
cs.AI 2025-06 conditional novelty 5.0 of 10

A descriptive conceptual framework with seven elements (target, task, subject, inputs, instance, measurement, result analysis) for systematizing analysis of AI capability evaluations.

Pith tools