Pith. sign in

REVIEW

How Humans and LLMs Organize Conceptual Knowledge: Exploring Subordinate Categories in Italian

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2505.21301 v1 pith:3LUKBHO2 submitted 2025-05-27 cs.CL cs.AI

How Humans and LLMs Organize Conceptual Knowledge: Exploring Subordinate Categories in Italian

classification cs.CL cs.AI
keywords exemplarscategoriesllmssubordinateacrossbearcategoryhumans
verification ladder T0 review T1 audit T2 compute T3 formal T4 reserved
0 comments
read the original abstract

People can categorize the same entity at multiple taxonomic levels, such as basic (bear), superordinate (animal), and subordinate (grizzly bear). While prior research has focused on basic-level categories, this study is the first attempt to examine the organization of categories by analyzing exemplars produced at the subordinate level. We present a new Italian psycholinguistic dataset of human-generated exemplars for 187 concrete words. We then use these data to evaluate whether textual and vision LLMs produce meaningful exemplars that align with human category organization across three key tasks: exemplar generation, category induction, and typicality judgment. Our findings show a low alignment between humans and LLMs, consistent with previous studies. However, their performance varies notably across different semantic domains. Ultimately, this study highlights both the promises and the constraints of using AI-generated exemplars to support psychological and linguistic research.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.