{"arxiv_id":"2610.23098","title":"InstAgent: A Recursively Self-Improving Agent Operating System for Heterogeneous Robot Collaboration","abstract":"Heterogeneous robot teams enable complex, long-horizon tasks by combining complementary sensing, mobility, and manipulation capabilities across multiple embodiments. Yet existing systems struggle to retain execution-time corrections as reusable experience, maintain task-relevant context memory across space and time for reliable handoffs, and explicitly represent the inter-robot dependencies required for structured collaboration. In order to address these challenges, we present InstAgent, a recursively self-improving (RSI) Agent Operating System for heterogeneous robot collaboration. InstAgent organizes team behaviors as agentic behavior trees (BTs) that explicitly model capability assignment, inter-robot dependencies and handoff checks. The RSI mechanism updates these collaboration programs from execution feedback and preserves successful revisions for reuse in future tasks, while shared multimodal spatio-temporal memory provides context for planning and handoff validation. Experiments on 20 real-world multi-robot tasks with three high-level models show consistent gains in task success, first-attempt completion, and execution efficiency.","primary_cat":"cs.RO","cross_cats":[],"submitted_at":"2026-10-16T08:10:51+00:00","latest_version":1,"source":"arxiv","source_label":"arXiv","source_url":null,"has_pdf":true,"has_source":false,"verdict":"CONDITIONAL","confidence":"MODERATE","one_line_summary":"InstAgent organizes heterogeneous robot teams as behavior trees with recursive self-improvement, preserving execution feedback as reusable programs and achieving consistent task success gains across three LLM backbones.","novelty_score":6.0,"correctness_risk":"medium","formal_verification":"none","upvotes":0,"downvotes":0,"pith_score":0,"inbound_count":1,"_links":{"html":"https://pith.science/paper/2610.23098","verdict":"/api/v1/verdicts/2610.23098"}}