A chain-of-thought fine-tuned vision-language model can infer audio descriptions from silent videos, and using those descriptions as prompts improves video-to-audio generation.
Multisensory- guided associative learning enhances multisensory representation in primary auditory cortex,
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
citation-role summary
background 1
citation-polarity summary
fields
cs.MM 1years
2025 1verdicts
CONDITIONAL 1roles
background 1polarities
support 1representative citing papers
citing papers explorer
-
Hearing from Silence: Reasoning Audio Descriptions from Silent Videos via Vision-Language Model
A chain-of-thought fine-tuned vision-language model can infer audio descriptions from silent videos, and using those descriptions as prompts improves video-to-audio generation.