pith:4TCLOVFF
Can LLMs Reason About Attention? Towards Zero-Shot Analysis of Multimodal Classroom Behavior
LLMs can perform zero-shot analysis of student attention using only pose and gaze coordinates from classroom videos.
arxiv:2604.03401 v4 · 2026-04-03 · cs.HC · cs.AI · cs.CV
Add to your LaTeX paper
\usepackage{pith}
\pithnumber{4TCLOVFF7ZH4ZYBVR2UNA6WQEU}
Prints a linked badge after your title and injects PDF metadata. Compiles on arXiv. Learn more · Embed verified badge
Record completeness
Claims
Our preliminary findings suggest that LLMs may show promise for multimodal behavior understanding, although they still struggle with spatial reasoning about classroom layouts.
That geometric pose and gaze coordinates extracted by pre-trained models are sufficient for an LLM to perform accurate zero-shot inference of student attention levels without domain-specific fine-tuning or spatial context.
A pipeline uses OpenPose and Gaze-LLE to extract pose and gaze data from classroom videos, deletes the raw footage, and applies an LLM for zero-shot behavioral analysis of student attention.
Receipt and verification
| First computed | 2026-06-29T01:14:30.929083Z |
|---|---|
| Builder | pith-number-builder-2026-05-17-v1 |
| Signature | Pith Ed25519
(pith-v1-2026-05) · public key |
| Schema | pith-number/v1.0 |
Canonical hash
e4c4b754a5fe4fcce0358ea8d07ad0250916bcf9c31c0239e54a91c789da84b7
Aliases
· · · · ·Agent API
Verify this Pith Number yourself
curl -sH 'Accept: application/ld+json' https://pith.science/pith/4TCLOVFF7ZH4ZYBVR2UNA6WQEU \
| jq -c '.canonical_record' \
| python3 -c "import sys,json,hashlib; b=json.dumps(json.loads(sys.stdin.read()), sort_keys=True, separators=(',',':'), ensure_ascii=False).encode(); print(hashlib.sha256(b).hexdigest())"
# expect: e4c4b754a5fe4fcce0358ea8d07ad0250916bcf9c31c0239e54a91c789da84b7
Canonical record JSON
{
"metadata": {
"abstract_canon_sha256": "4c55e4c2f4c1129c94108b5d75ce211b9cc3dc2f10601e27dfb70f244b002956",
"cross_cats_sorted": [
"cs.AI",
"cs.CV"
],
"license": "http://creativecommons.org/licenses/by/4.0/",
"primary_cat": "cs.HC",
"submitted_at": "2026-04-03T19:04:31Z",
"title_canon_sha256": "c5fcbec534f2f0a4cbf37a8fa76039eabc6725cd29fe6442580883bb737acddc"
},
"schema_version": "1.0",
"source": {
"id": "2604.03401",
"kind": "arxiv",
"version": 4
}
}