SceneLLM encodes video objects as learned discrete tokens, lets a LoRA-fine-tuned LLaMA reason over them, and decodes the hidden features into dynamic scene graph triplets, reporting state-of-the-art Recall@K on Action Genome.
Title resolution pending
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.CV 1years
2024 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
SceneLLM: Implicit Language Reasoning in LLM for Dynamic Scene Graph Generation
SceneLLM encodes video objects as learned discrete tokens, lets a LoRA-fine-tuned LLaMA reason over them, and decodes the hidden features into dynamic scene graph triplets, reporting state-of-the-art Recall@K on Action Genome.