REVIEW 2 cited by
Can Peanuts Fall in Love with Distributional Semantics?
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
Context changes expectations about upcoming words - following a story involving an anthropomorphic peanut, comprehenders expect the sentence the peanut was in love more than the peanut was salted, as indexed by N400 amplitude (Nieuwland & van Berkum, 2006). This updating of expectations has been explained using Situation Models - mental representations of a described event. However, recent work showing that N400 amplitude is predictable from distributional information alone raises the question whether situation models are necessary for these contextual effects. We model the results of Nieuwland and van Berkum (2006) using six computational language models and three sets of word vectors, none of which have explicit situation models or semantic grounding. We find that a subset of these can fully model the effect found by Nieuwland and van Berkum (2006). Thus, at least some processing effects normally explained through situation models may not in fact require explicit situation models.
Forward citations
Cited by 2 Pith papers
-
Failures and Successes to Learn a Core Conceptual Distinction from the Statistics of Language
Transformer LMs track property prevalence, but only GPT-4 recovers the principled-vs-statistical generic distinction after controlling for prevalence.
-
Trick or Neat: Adversarial Ambiguity and Language Model Evaluation
Language models answer prompts about sentence ambiguity poorly, but linear probes on their hidden states classify ambiguous versus unambiguous sentences with high accuracy on the new AmbAdv dataset.
Discussion (0). Continue with ORCID to comment.