{"record_type":"pith_number_record","schema_url":"https://pith.science/schemas/pith-number/v1.json","pith_number":"pith:2026:CQEI36IJNBHHZC2CHBUTGJ2QMZ","short_pith_number":"pith:CQEI36IJ","schema_version":"1.0","canonical_sha256":"14088df909684e7c8b4238693327506666bc4de6bf1c46cbd714cf846ebb3700","source":{"kind":"arxiv","id":"2605.14704","version":1},"attestation_state":"computed","paper":{"title":"SceneFunRI: Reasoning the Invisible for Task-Driven Functional Object Localization","license":"http://creativecommons.org/licenses/by/4.0/","headline":"Vision-language models cannot reliably locate invisible functional objects from task instructions and commonsense.","cross_cats":["cs.AI","cs.RO"],"primary_cat":"cs.CV","authors_text":"Gueter Josmy Faure, Hung-Ting Su, Posheng Chen, Powen Cheng, Winston H. Hsu","submitted_at":"2026-05-14T11:21:41Z","abstract_excerpt":"In real-world scenes, target objects may reside in regions that are not visible. While humans can often infer the locations of occluded objects from context and commonsense knowledge, this capability remains a major challenge for vision-language models (VLMs). To address this gap, we introduce SceneFunRI, a benchmark for Reasoning the Invisible. Based on the SceneFun3D dataset, SceneFunRI formulates the task as a 2D spatial reasoning problem via a semi-automatic pipeline and comprises 855 instances. It requires models to infer the locations of invisible functional objects from task instruction"},"verification_status":{"content_addressed":true,"pith_receipt":true,"author_attested":false,"weak_author_claims":0,"strong_author_claims":0,"externally_anchored":false,"storage_verified":false,"citation_signatures":0,"replication_records":0,"graph_snapshot":true,"references_resolved":true,"formal_links_present":false},"canonical_record":{"source":{"id":"2605.14704","kind":"arxiv","version":1},"metadata":{"license":"http://creativecommons.org/licenses/by/4.0/","primary_cat":"cs.CV","submitted_at":"2026-05-14T11:21:41Z","cross_cats_sorted":["cs.AI","cs.RO"],"title_canon_sha256":"fb13c269bda0be01455a9e6ad02abdb673621e71c92e40ae576b22d11b96e459","abstract_canon_sha256":"54637346a93f1dc6c32674dbf6a01de1093a6119253cb8b203a427902373360a"},"schema_version":"1.0"},"receipt":{"kind":"pith_receipt","key_id":"pith-v1-2026-05","algorithm":"ed25519","signed_at":"2026-05-17T23:38:59.291047Z","signature_b64":"gUM/+qaJRu9pWmN7gICd4x8zJ5PjCXrRoOyda3IksvK03ZMMywKg9cahFhEDjprGKtU3lD7f0VvouZ7qgWFGCA==","signed_message":"canonical_sha256_bytes","builder_version":"pith-number-builder-2026-05-17-v1","receipt_version":"0.3","canonical_sha256":"14088df909684e7c8b4238693327506666bc4de6bf1c46cbd714cf846ebb3700","last_reissued_at":"2026-05-17T23:38:59.290291Z","signature_status":"signed_v1","first_computed_at":"2026-05-17T23:38:59.290291Z","public_key_fingerprint":"8d4b5ee74e4693bcd1df2446408b0d54"},"graph_snapshot":{"paper":{"title":"SceneFunRI: Reasoning the Invisible for Task-Driven Functional Object Localization","license":"http://creativecommons.org/licenses/by/4.0/","headline":"Vision-language models cannot reliably locate invisible functional objects from task instructions and commonsense.","cross_cats":["cs.AI","cs.RO"],"primary_cat":"cs.CV","authors_text":"Gueter Josmy Faure, Hung-Ting Su, Posheng Chen, Powen Cheng, Winston H. Hsu","submitted_at":"2026-05-14T11:21:41Z","abstract_excerpt":"In real-world scenes, target objects may reside in regions that are not visible. While humans can often infer the locations of occluded objects from context and commonsense knowledge, this capability remains a major challenge for vision-language models (VLMs). To address this gap, we introduce SceneFunRI, a benchmark for Reasoning the Invisible. Based on the SceneFun3D dataset, SceneFunRI formulates the task as a 2D spatial reasoning problem via a semi-automatic pipeline and comprises 855 instances. It requires models to infer the locations of invisible functional objects from task instruction"},"claims":{"count":4,"items":[{"kind":"strongest_claim","text":"The strongest baseline model (Gemini 3 Flash) only achieves an CAcc@75 of 15.20, an mIoU of 0.74, and a Dist of 28.65. These findings indicate that invisible-region reasoning remains an unstable capability in current VLMs.","source":"verdict.strongest_claim","status":"machine_extracted","claim_id":"C1","attestation":"unclaimed"},{"kind":"weakest_assumption","text":"The semi-automatic pipeline accurately creates 855 instances that genuinely require commonsense and spatial reasoning beyond superficial visual cues, rather than introducing artifacts that explain the low model performance.","source":"verdict.weakest_assumption","status":"machine_extracted","claim_id":"C2","attestation":"unclaimed"},{"kind":"one_line_summary","text":"SceneFunRI benchmark shows current VLMs struggle severely with inferring locations of invisible functional objects, with the strongest model (Gemini 3 Flash) reaching only 15.20 CAcc@75.","source":"verdict.one_line_summary","status":"machine_extracted","claim_id":"C3","attestation":"unclaimed"},{"kind":"headline","text":"Vision-language models cannot reliably locate invisible functional objects from task instructions and commonsense.","source":"verdict.pith_extraction.headline","status":"machine_extracted","claim_id":"C4","attestation":"unclaimed"}],"snapshot_sha256":"350d4c16af96344b115a740becd405acb297eb7087801705eee37fe15c38c56e"},"source":{"id":"2605.14704","kind":"arxiv","version":1},"verdict":{"id":"cc070207-2f90-435d-958a-98bbded92077","model_set":{"reader":"grok-4.3"},"created_at":"2026-05-15T05:00:12.913741Z","strongest_claim":"The strongest baseline model (Gemini 3 Flash) only achieves an CAcc@75 of 15.20, an mIoU of 0.74, and a Dist of 28.65. These findings indicate that invisible-region reasoning remains an unstable capability in current VLMs.","one_line_summary":"SceneFunRI benchmark shows current VLMs struggle severely with inferring locations of invisible functional objects, with the strongest model (Gemini 3 Flash) reaching only 15.20 CAcc@75.","pipeline_version":"pith-pipeline@v0.9.0","weakest_assumption":"The semi-automatic pipeline accurately creates 855 instances that genuinely require commonsense and spatial reasoning beyond superficial visual cues, rather than introducing artifacts that explain the low model performance.","pith_extraction_headline":"Vision-language models cannot reliably locate invisible functional objects from task instructions and commonsense."},"references":{"count":38,"sample":[{"doi":"","year":2023,"title":"Image amodal completion: A survey.Computer Vision and Image Understanding, 229:103661, 2023","work_id":"5d8af2fe-47c5-4081-9bec-1f7dacd64cb0","ref_index":1,"cited_arxiv_id":"","is_internal_anchor":false},{"doi":"","year":2025,"title":"Open-world amodal appearance completion","work_id":"9543665c-f2f4-42eb-b51f-11d38d50848d","ref_index":2,"cited_arxiv_id":"","is_internal_anchor":false},{"doi":"","year":2024,"title":"It’s not easy being wrong: Large language models struggle with process of elimination reasoning","work_id":"a031f5c6-c8f8-4b2a-b1dd-5578f2641958","ref_index":3,"cited_arxiv_id":"","is_internal_anchor":false},{"doi":"","year":null,"title":"Scaling spatial intelligence with multimodal foundation models","work_id":"ceb84861-8bdb-4822-864c-8e2d0ae4d322","ref_index":4,"cited_arxiv_id":"","is_internal_anchor":false},{"doi":"","year":2024,"title":"SceneFun3D: Fine-Grained Functionality and Affordance Understanding in 3D Scenes","work_id":"53329c45-0a4d-4522-8b6a-451a787fa9e7","ref_index":5,"cited_arxiv_id":"","is_internal_anchor":false}],"resolved_work":38,"snapshot_sha256":"fa2f7fb6a2787cb6480867914701f164a310afa2322f804f54cb0933e767fcbc","internal_anchors":4},"formal_canon":{"evidence_count":0,"snapshot_sha256":"258153158e38e3291e3d48162225fcdb2d5a3ed65a07baac614ab91432fd4f57"},"author_claims":{"count":0,"strong_count":0,"snapshot_sha256":"258153158e38e3291e3d48162225fcdb2d5a3ed65a07baac614ab91432fd4f57"},"builder_version":"pith-number-builder-2026-05-17-v1"},"aliases":[{"alias_kind":"arxiv","alias_value":"2605.14704","created_at":"2026-05-17T23:38:59.290422+00:00"},{"alias_kind":"arxiv_version","alias_value":"2605.14704v1","created_at":"2026-05-17T23:38:59.290422+00:00"},{"alias_kind":"doi","alias_value":"10.48550/arxiv.2605.14704","created_at":"2026-05-17T23:38:59.290422+00:00"},{"alias_kind":"pith_short_12","alias_value":"CQEI36IJNBHH","created_at":"2026-05-18T12:33:37.589309+00:00"},{"alias_kind":"pith_short_16","alias_value":"CQEI36IJNBHHZC2C","created_at":"2026-05-18T12:33:37.589309+00:00"},{"alias_kind":"pith_short_8","alias_value":"CQEI36IJ","created_at":"2026-05-18T12:33:37.589309+00:00"}],"events":[],"event_summary":{},"paper_claims":[],"inbound_citations":{"count":0,"internal_anchor_count":0,"sample":[]},"formal_canon":{"evidence_count":0,"sample":[],"anchors":[]},"links":{"html":"https://pith.science/pith/CQEI36IJNBHHZC2CHBUTGJ2QMZ","json":"https://pith.science/pith/CQEI36IJNBHHZC2CHBUTGJ2QMZ.json","graph_json":"https://pith.science/api/pith-number/CQEI36IJNBHHZC2CHBUTGJ2QMZ/graph.json","events_json":"https://pith.science/api/pith-number/CQEI36IJNBHHZC2CHBUTGJ2QMZ/events.json","paper":"https://pith.science/paper/CQEI36IJ"},"agent_actions":{"view_html":"https://pith.science/pith/CQEI36IJNBHHZC2CHBUTGJ2QMZ","download_json":"https://pith.science/pith/CQEI36IJNBHHZC2CHBUTGJ2QMZ.json","view_paper":"https://pith.science/paper/CQEI36IJ","resolve_alias":"https://pith.science/api/pith-number/resolve?arxiv=2605.14704&json=true","fetch_graph":"https://pith.science/api/pith-number/CQEI36IJNBHHZC2CHBUTGJ2QMZ/graph.json","fetch_events":"https://pith.science/api/pith-number/CQEI36IJNBHHZC2CHBUTGJ2QMZ/events.json","actions":{"anchor_timestamp":"https://pith.science/pith/CQEI36IJNBHHZC2CHBUTGJ2QMZ/action/timestamp_anchor","attest_storage":"https://pith.science/pith/CQEI36IJNBHHZC2CHBUTGJ2QMZ/action/storage_attestation","attest_author":"https://pith.science/pith/CQEI36IJNBHHZC2CHBUTGJ2QMZ/action/author_attestation","sign_citation":"https://pith.science/pith/CQEI36IJNBHHZC2CHBUTGJ2QMZ/action/citation_signature","submit_replication":"https://pith.science/pith/CQEI36IJNBHHZC2CHBUTGJ2QMZ/action/replication_record"}},"created_at":"2026-05-17T23:38:59.290422+00:00","updated_at":"2026-05-17T23:38:59.290422+00:00"}