Evidence for systematic semantic structure in individual phonemes

Gexin Zhao

REVIEW 4 major objections 4 minor 1 cited by

Each English phoneme carries a structured semantic profile recoverable from text, shared across languages, and grounded in how the mouth shapes the sound.

Reviewed by Pith at T0; open to challenge. T0 means a machine referee read the full paper against a public rubric. the ladder, T0–T4 →

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗

T0 review · grok-4.5

2026-07-13 23:15 UTC pith:JZPGJFDU

load-bearing objection Ambitious multi-method claim that individual phonemes carry systematic semantic profiles; coherent on its face, but the letter-vs-phoneme proxy is the load-bearing premise and we only have the abstract. the 4 major comments →

arxiv 2603.17306 v3 pith:JZPGJFDU submitted 2026-03-18 cs.CL q-bio.NC

Evidence for systematic semantic structure in individual phonemes

Gexin Zhao This is my paper

classification cs.CL q-bio.NC

keywords phoneme iconicitysound symbolismsemantic structurearticulatory groundingcross-linguistic perceptionlarge language modelsphonology

verification ladder T0 review T1 audit T2 compute T3 formal T4 reserved

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The paper challenges the long-standing linguistic assumption that sound and meaning are mostly arbitrary by arguing that this breaks down at the level of single phonemes. It claims each English phoneme has a consistent, multidimensional semantic profile that large language models can recover from text, that English speakers and listeners of other languages can hear, and that tracks the physical act of producing the sound. Three models independently found the same structure across nine dimensions in 220 letter contrasts; preregistered human tests matched those predictions at high rates, and articulatory features predicted the structure with substantial cross-validated accuracy. If correct, the result reframes phoneme-level iconicity as a pervasive, embodied property of the sound system rather than a marginal curiosity. A sympathetic reader cares because the claim would mean everyday speech is already saturated with systematic sound-meaning mappings that speakers exploit without noticing.

Core claim

Each English phoneme carries a structured, multidimensional semantic profile that is recoverable from text, perceived across languages, and grounded in articulation. Three large language models detected consistent structure across nine perceptual dimensions in 220 pairwise letter contrasts; native English speakers agreed with model predictions at 85.3 percent in a preregistered task, cross-linguistic listeners reached 73.2 to 81.9 percent under audio presentation, and articulatory features predicted the structure with cross-validated R-squared of 0.56 to 0.98.

What carries the argument

The 220 pairwise letter contrasts used as a proxy for phoneme-level meaning, scored by three large language models on nine perceptual dimensions, then validated by forced-choice human judgments and by regression from articulatory features. The contrasts carry the claim that systematic semantic structure is present, shared, and body-grounded.

Load-bearing premise

That pairwise letter contrasts and language-model scores over written text are a valid stand-in for real phoneme-level meaning rather than spelling habits, letter-name associations, or corpus artifacts.

What would settle it

A preregistered replication that replaces letter contrasts with pure audio phoneme tokens, or that holds articulatory features fixed while scrambling orthography, and finds that model-human agreement and articulatory prediction collapse below chance or near-zero R-squared.

Watch this falsifier — get emailed when new claim-graph text bears on it.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, simulated authors' rebuttal, and a circularity audit.

Desk Editor's Note

Ambitious multi-method claim that individual phonemes carry systematic semantic profiles; coherent on its face, but the letter-vs-phoneme proxy is the load-bearing premise and we only have the abstract.

read the letter

The one thing to know: this abstract says Saussurean arbitrariness fails at the phoneme grain, and it backs that with a multi-method package—three LLMs, a preregistered human forced-choice task, cross-linguistic audio, and articulatory prediction—that would matter if the methods hold. We only have the abstract, so this is provisional.

What is actually new is not sound symbolism itself (bouba–kiki, phonesthemes, and cross-linguistic iconicity are established). It is the claim of structured, multidimensional semantic profiles for individual English phonemes, recovered consistently across 220 pairwise letter contrasts by three independent LLMs, then confirmed by native speakers at 85.3% in a preregistered task, replicated under audio by listeners of five typologically diverse languages at 73–82%, and predicted from articulatory features with cross-validated R² of 0.56–0.98. If those numbers survive full inspection, that is a real empirical package. Preregistration and the cross-linguistic audio arm are the right design choices; they push against the usual English-orthography and model-artifact worries.

The soft spot is proportionate and real: the abstract itself operationalizes the core result as “220 pairwise letter contrasts.” Letters are not phonemes. LLM embeddings over text can recycle spelling regularities, letter-name associations, and collocational patterns. Without the item list, contrast construction rules, and controls that isolate phonology from orthography, we cannot yet tell whether the LLM consistency, the human agreement, or the articulatory R² attach to phonemes or to letters. The audio arm helps, but it still inherits the model-derived dimensions. That is the load-bearing premise, not a minor quibble. Circularity with training data is secondary to that. I am not manufacturing a flaw; I am naming the premise we cannot verify from the abstract alone.

This is for psycholinguists, iconicity researchers, and people working on grounded language models. It deserves a serious referee, not a desk reject. Send it out; the methods section will either secure or sink the letter-to-phoneme step. I would bring it to reading group once the full text and materials are available, not before.

Referee Report

4 major / 4 minor

Summary. The manuscript argues that the classical arbitrariness assumption fails at the phoneme level: each English phoneme carries a structured, multidimensional semantic profile that is recoverable from text, perceived by humans across languages, and grounded in articulation. Three LLMs are reported to detect consistent structure across nine perceptual dimensions in 220 pairwise letter contrasts; native English speakers (N=93) match model predictions at 85.3% in a preregistered forced-choice task; listeners of five typologically diverse languages (N=155) reach 73.2%–81.9% under audio presentation; and articulatory features predict the structure with cross-validated R² of 0.56–0.98. The authors conclude that phoneme-level iconicity is a pervasive, embodied property of the phonological system.

Significance. If the central claim holds under rigorous controls, the result would meaningfully revise a foundational assumption in linguistics and phonology and would matter for theories of iconicity, language acquisition, and sound-symbolic effects in NLP. The multi-method framing—independent LLMs, a preregistered human forced-choice task, cross-linguistic audio presentation, and articulatory prediction—is a genuine strength on its face and goes beyond typical single-method iconicity studies. Parameter-free or strongly constrained articulatory prediction, if cleanly executed, would be especially valuable. These strengths, however, all inherit the validity of the letter-to-phoneme operationalization.

major comments (4)

[Abstract (method statement: 220 pairwise letter contrasts)] The abstract’s core method statement operationalizes phoneme-level structure via “220 pairwise letter contrasts.” This is load-bearing for every subsequent claim (LLM consistency, 85.3% English agreement, cross-linguistic audio accuracy, and articulatory R²). Letter contrasts can reflect orthographic regularities, letter-name associations, spelling–meaning co-occurrence in training text, or grapheme inventory effects rather than phoneme semantics. English has more phonemes than letters; digraphs, allophony, and many-to-one mappings are not addressed in the abstract. Without explicit contrast-construction rules, an item list, and controls that isolate phonemes from orthography (e.g., IPA-only or audio-only model probes; contrasts holding spelling constant while varying phonemes; letter-name and frequency baselines), it is not established that the reported structure attaches to phonemes ra
[Abstract (LLM detection results)] LLM “detection” of semantic structure in letter contrasts is not fully independent of the orthographic corpora that define English spelling–meaning co-occurrence. Agreement among three models does not by itself rule out shared training-data artifacts. The abstract does not report controls for letter frequency, orthographic neighborhood, letter-name semantics, or collocational regularities. These controls are necessary for the claim that models recover phoneme-level semantic profiles rather than recycling text statistics.
[Abstract (articulatory prediction: R² 0.56–0.98)] Cross-validated articulatory R² of 0.56–0.98 is extremely high for nine perceptual dimensions. The abstract does not specify the articulatory feature inventory, whether features were preregistered or selected post hoc, the exact CV scheme, or the number of free parameters relative to observations. Without those details, the range is compatible with overfitting or with circular feature engineering, and cannot yet be taken as strong evidence that “the bodily act of producing a sound systematically shapes the meaning it conveys.”
[Abstract (cross-linguistic audio task)] The cross-linguistic audio results (73.2%–81.9%) are presented as evidence that the structure is perceived across languages and is therefore not English-orthography-bound. That interpretation only holds if the audio stimuli cleanly implement the same phoneme contrasts used in the letter/LLM analyses and if language-specific phonotactics, loanword knowledge, and residual orthographic mediation are controlled. The abstract does not state stimulus construction, language sample, or exclusion rules, so the bridge from letter contrasts to cross-linguistic phoneme perception remains unverified.

minor comments (4)

[Abstract] The nine perceptual dimensions are never named in the abstract; listing them would allow readers to assess construct validity and overlap with known sound-symbolic dimensions (e.g., size, shape, valence, arousal).
[Abstract] Clarify the letter-to-phoneme mapping policy (treatment of digraphs, silent letters, vowels with multiple values, and consonants that collapse phonemic contrasts) even in the abstract’s methods sentence.
[Abstract] Report the five languages and basic design parameters (trials per participant, chance baseline, multiple-comparison handling) so the 73.2%–81.9% range can be interpreted.
[Abstract] The phrase “pairwise letter contrasts” should be reconciled terminologically with the claim about “individual phonemes” to avoid equating graphemes and phonemes by assertion.

Circularity Check

0 steps flagged

No significant circularity; multi-method chain (LLM detection, preregistered human forced-choice, cross-linguistic audio, articulatory CV prediction) is independent of its inputs.

full rationale

Abstract-only review yields no equations, fitted parameters renamed as predictions, self-definitional loops, or load-bearing self-citations. The claimed structure is first recovered from three LLMs on 220 letter contrasts, then independently confirmed by preregistered English forced-choice (85.3 %), cross-linguistic audio listeners (73.2–81.9 %), and cross-validated articulatory regression (R² 0.56–0.98). None of these steps reduces by construction to the others: human and articulatory results are external benchmarks, not re-expressions of the LLM embeddings or of any author-fitted uniqueness theorem. Letter-vs-phoneme proxy validity is a methodological concern outside the circularity criteria; it does not make any reported quantity equivalent to its input by definition. Score 0 is therefore required.

Axiom & Free-Parameter Ledger

0 free parameters · 4 axioms · 1 invented entities

Abstract-only audit. No free parameters or invented particles are numerically specified. The claim rests on domain assumptions that letter contrasts proxy phonemes, that LLM embedding geometry tracks human semantic dimensions, that forced-choice agreement measures genuine phoneme semantics, and that articulatory feature sets are the right causal basis. No new physical entities are introduced; the “semantic profile” is an empirical construct, not an invented mediator.

axioms (4)

ad hoc to paper Pairwise orthographic letter contrasts are a valid operationalization of phoneme-level contrasts for semantic profiling.
Abstract centers “220 pairwise letter contrasts” while claiming results about phonemes; English orthography is not one-to-one with phonemes.
domain assumption LLM-derived associations along nine perceptual dimensions reflect recoverable semantic structure rather than training-corpus orthographic artifacts.
Core recovery path is “recoverable from text” via three LLMs; independence from corpus spelling regularities is assumed, not shown in the abstract.
domain assumption Forced-choice agreement with model predictions indexes true phoneme–meaning structure rather than task demand or letter-name associations.
Human confirmation (85.3%) and cross-linguistic audio accuracy are treated as validation of the same structure.
domain assumption Articulatory feature sets are sufficient predictors of the reported semantic dimensions (cross-validated R² 0.56–0.98).
Embodiment claim depends on articulatory features systematically shaping meaning; feature inventory and dimensionality are not given in the abstract.

invented entities (1)

Multidimensional phoneme semantic profile (nine perceptual dimensions) no independent evidence
purpose: Organize the claimed systematic meaning structure of each phoneme and serve as the target of LLM, human, and articulatory analyses.
Construct introduced as the object of recovery and prediction; independent evidence would be the human and articulatory results, which are only summarized here.

pith-pipeline@v1.1.0-grok45 · 6060 in / 3078 out tokens · 35865 ms · 2026-07-13T23:15:34.455486+00:00 · methodology

0 comments

read the original abstract

A foundational assumption in linguistics holds that sound-meaning relations are largely arbitrary. Here we show that this assumption fails at the level of individual phonemes: each English phoneme carries a structured, multidimensional semantic profile that is recoverable from text, perceived across languages, and grounded in articulation. Three large language models independently detected consistent semantic structure across nine perceptual dimensions in 220 pairwise letter contrasts. Native English speakers (N = 93) confirmed these associations in a preregistered forced-choice task (85.3% agreement with model predictions), and listeners of five typologically diverse languages (N = 155) replicated the effect under audio presentation (73.2%-81.9% accuracy). Articulatory features predicted the structure with cross-validated R^2 of 0.56-0.98, indicating that the bodily act of producing a sound systematically shapes the meaning it conveys. These findings reframe phoneme-level iconicity as a pervasive, embodied property of the phonological system.

discussion (0)

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

Hearing Like Humans? Sound Symbolism and Perceptual Alignment in Speech Language Models
eess.AS 2026-07 conditional novelty 6.5

Open-weight speech language models align poorly with human bouba/kiki judgments on real speech and fail crossmodal sound-to-shape matching, while their visual shape ratings remain near human ceiling.