FiboSB is a new 6D pose dataset for blocks in group work; all four state-of-the-art 6D pose methods failed on it, while a fine-tuned YOLO11-x detector achieved 0.898 mAP50.
TRACE: Real-Time Multimodal Common Ground Tracking in Situated Collaborative Dialogues
1 Pith paper cite this work. Polarity classification is still indexing.
abstract
We present TRACE, a novel system for live *common ground* tracking in situated collaborative tasks. With a focus on fast, real-time performance, TRACE tracks the speech, actions, gestures, and visual attention of participants, uses these multimodal inputs to determine the set of task-relevant propositions that have been raised as the dialogue progresses, and tracks the group's epistemic position and beliefs toward them as the task unfolds. Amid increased interest in AI systems that can mediate collaborations, TRACE represents an important step forward for agents that can engage with multiparty, multimodal discourse.
fields
cs.CV 1years
2025 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
Computer Vision for Objects used in Group Work: Challenges and Opportunities
FiboSB is a new 6D pose dataset for blocks in group work; all four state-of-the-art 6D pose methods failed on it, while a fine-tuned YOLO11-x detector achieved 0.898 mAP50.