ContextHOI adds a separately supervised context-learning branch to a transformer HOI detector, reporting state-of-the-art HICO-DET scores and large gains on a new occluded-scene benchmark.
Relational Context Learning for Human-Object Interaction Detection
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
abstract
Recent state-of-the-art methods for HOI detection typically build on transformer architectures with two decoder branches, one for human-object pair detection and the other for interaction classification. Such disentangled transformers, however, may suffer from insufficient context exchange between the branches and lead to a lack of context information for relational reasoning, which is critical in discovering HOI instances. In this work, we propose the multiplex relation network (MUREN) that performs rich context exchange between three decoder branches using unary, pairwise, and ternary relations of human, object, and interaction tokens. The proposed method learns comprehensive relational contexts for discovering HOI instances, achieving state-of-the-art performance on two standard benchmarks for HOI detection, HICO-DET and V-COCO.
fields
cs.CV 1years
2024 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
ContextHOI: Spatial Context Learning for Human-Object Interaction Detection
ContextHOI adds a separately supervised context-learning branch to a transformer HOI detector, reporting state-of-the-art HICO-DET scores and large gains on a new occluded-scene benchmark.