pith. sign in

arxiv: 2605.24481 · v3 · pith:OHDTGF5Inew · submitted 2026-05-23 · 💻 cs.CV

OmniEgo-R²: A Routed Reasoning Framework for the 1st Cross-Domain EgoCross Challenge at CVPR 2026

classification 💻 cs.CV
keywords reasoningcross-domainegocrossomniego-rroutedcapabilitychallengecvpr
0
0 comments X
read the original abstract

The 1st Cross-Domain EgoCross Challenge at EgoVis, CVPR 2026 evaluates whether multimodal large language models can reason over egocentric videos across surgery, industry, extreme sports, and animal perspective. We achieved second place in both the Source-Limited and Open-Source tracks. In this report, we formulate EgoCross as a robust cross-domain embodied video reasoning problem rather than a simple multiple-choice visual question answering task. We identify three key challenges: (C1) temporal boundary ambiguity, where critical state transitions are sparsely sampled and often occur between frames; (C2) cross-domain semantic granularity mismatch, where the same capability requires different domain-specific visual grammar; and (C3) decision instability under close options, where long multimodal reasoning can select unsupported distractors or produce malformed outputs. To address them, we propose OmniEgo-R$^2$ (Omnidomain Egocentric Routed Reasoning), a unified routed reasoning pipeline consisting of temporal-evidence normalization, domain-agnostic capability routing, structured perception--dynamics--decision reasoning, boundary-aware option verification, and defensive answer calibration. OmniEgo-R$^2$ uses the Qwen3-VL-4B-SFT checkpoints on each EgoCross domain as the visual-language backbone, and wraps them with lightweight test-time reasoning and parsing programs. Our final submissions obtain 66.35% overall accuracy in the Source-Limited track and 66.77% in the Open-Source track, ranking second in both leaderboards. The codes are available on https://github.com/Lee-zixu/OmniEgo-R2

This paper has not been read by Pith yet.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 4 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. COMBINER: Composed Image Retrieval Guided by Attribute-based Neighbor Relations

    cs.CV 2026-06 unverdicted novelty 6.0

    COMBINER proposes a new architecture for composed image retrieval using adaptive semantic disentanglement, unified prototype-based composition, and dual attribute-based relation modeling to address visually similar bu...

  2. R^3: Composed Video Retrieval via Reasoning-Guided Recalling and Re-ranking

    cs.CV 2026-05 unverdicted novelty 5.0

    R^3 is a zero-shot pipeline that generates reasoning traces to augment composed video queries, fuses scores via agreement-gated residual, and re-ranks candidates for the CoVR-R challenge.

  3. RankVR: Low-Rank Structure Perception and Value Recalibration for Robust Composed Image Retrieval

    cs.CV 2026-06 unverdicted novelty 4.0

    RankVR introduces GSCP and ASVC modules to improve CIR robustness by decoupling clean samples via low-rank structure and dynamically scoring triplet value in noisy datasets.

  4. IMAGINE: Adaptive Schema-Imagery Enhanced Composition for Composed Video Retrieval

    cs.CV 2026-06 unverdicted novelty 4.0

    IMAGINE uses adaptive schema-imagery via dynamic multimodal prototypes to incorporate implicit semantics into composed video retrieval, claiming SOTA results on CVR and CIR benchmarks.