Pith. sign in

AlloSpatial: Agentic Harness Framework for Spatial Reasoning in Foundation Models

1 Pith paper cite this work. Polarity classification is still indexing.

1 Pith paper citing it
abstract

Multimodal Foundation Models (MFMs) have made substantial progress, yet remain fragile in spatial reasoning over the physical world. A key bottleneck lies in their inability to transform local egocentric observations into a global allocentric spatial representation. To address this, we propose AlloSpatial, an agentic framework for allocentric spatial cognition in foundation models. AlloSpatial introduces World2Mind, a plug-and-play cognitive mapping sandbox that converts egocentric observations into structured allocentric priors, including Allocentric-Spatial Trees and route maps that support querying object topology, geometric relations, passability, and trajectories. To utilize these priors reliably under noisy reconstruction and ambiguous visual evidence, AlloSpatial introduces a Spatial Reasoning Harness for tool-use judgment, modality-decoupled cue collection, and geometry-semantic arbitration. We further internalize this process in Qwen3-VL through cold-start reinforcement learning with a harness-gated trajectory-level reward. Experiments on VSI-Bench and MindCube show that AlloSpatial improves proprietary models by 5%-18% in a training-free setting, while ASTs alone support strong spatial reasoning even when visual inputs are removed. The trained AlloSpatial agents further outperform larger general-purpose models and competitive spatial baselines, suggesting that structured allocentric representations, active tool use, and verifiable reasoning offer a promising route toward spatially capable foundation models.

fields

cs.AI 1

years

2026 1

verdicts

CONDITIONAL 1

representative citing papers

SpatialCLI: Learning to Reason With Spatial Tools, Then Without Them

cs.AI · 2026-07-30 · conditional · novelty 6.0

SpatialCLI shows that a VLM can learn to use localization, segmentation, depth, and pose tools and then internalize the tool outputs into direct reasoning, improving both tool-enabled and tool-free spatial task performance.

citing papers explorer

Showing 1 of 1 citing paper.

  • SpatialCLI: Learning to Reason With Spatial Tools, Then Without Them cs.AI · 2026-07-30 · conditional · none · ref 37 · internal anchor

    SpatialCLI shows that a VLM can learn to use localization, segmentation, depth, and pose tools and then internalize the tool outputs into direct reasoning, improving both tool-enabled and tool-free spatial task performance.