SMILE applies LIME-style prompt perturbation with image-embedding distances to create word-level heatmaps for instruction-based image editing models.
Diffusion Explainer: Visual Explanation for Text-to-image Stable Diffusion
1 Pith paper cite this work. Polarity classification is still indexing.
abstract
Diffusion-based generative models' impressive ability to create convincing images has garnered global attention. However, their complex structures and operations often pose challenges for non-experts to grasp. We present Diffusion Explainer, the first interactive visualization tool that explains how Stable Diffusion transforms text prompts into images. Diffusion Explainer tightly integrates a visual overview of Stable Diffusion's complex structure with explanations of the underlying operations. By comparing image generation of prompt variants, users can discover the impact of keyword changes on image generation. A 56-participant user study demonstrates that Diffusion Explainer offers substantial learning benefits to non-experts. Our tool has been used by over 10,300 users from 124 countries at https://poloclub.github.io/diffusion-explainer/.
citation-role summary
citation-polarity summary
fields
cs.AI 1years
2024 1verdicts
REJECT 1roles
background 1polarities
background 1representative citing papers
citing papers explorer
-
Mapping the Mind of an Instruction-based Image Editing using SMILE
SMILE applies LIME-style prompt perturbation with image-embedding distances to create word-level heatmaps for instruction-based image editing models.