Adding spontaneous speech transcripts to sketches significantly improves multimodal LLMs' ability to generate design images aligned with designers' intent across form, function, experience, and overall.
2010.Sketching user experiences: getting the design right and the right design
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.HC 1years
2026 1verdicts
UNVERDICTED 1representative citing papers
citing papers explorer
-
When Drawing Is Not Enough: Exploring Spontaneous Speech with Sketch for Intent Alignment in Multimodal LLMs
Adding spontaneous speech transcripts to sketches significantly improves multimodal LLMs' ability to generate design images aligned with designers' intent across form, function, experience, and overall.