The reviewed record of science sign in
Pith

arxiv: 2503.18627 · v1 · pith:GUYQVK4T · submitted 2025-03-24 · cs.CV · cs.AI

Dig2DIG: Dig into Diffusion Information Gains for Image Fusion

Reviewed by Pith T0 review T1 audit T2 compute T3 formal T4 kernel pith:GUYQVK4Trecord.jsonopen to challenge →

classification cs.CV cs.AI
keywords fusiondiffusionimageinformationgainsdenoisingdynamicapproaches
0
0 comments X
read the original abstract

Image fusion integrates complementary information from multi-source images to generate more informative results. Recently, the diffusion model, which demonstrates unprecedented generative potential, has been explored in image fusion. However, these approaches typically incorporate predefined multimodal guidance into diffusion, failing to capture the dynamically changing significance of each modality, while lacking theoretical guarantees. To address this issue, we reveal a significant spatio-temporal imbalance in image denoising; specifically, the diffusion model produces dynamic information gains in different image regions with denoising steps. Based on this observation, we Dig into the Diffusion Information Gains (Dig2DIG) and theoretically derive a diffusion-based dynamic image fusion framework that provably reduces the upper bound of the generalization error. Accordingly, we introduce diffusion information gains (DIG) to quantify the information contribution of each modality at different denoising steps, thereby providing dynamic guidance during the fusion process. Extensive experiments on multiple fusion scenarios confirm that our method outperforms existing diffusion-based approaches in terms of both fusion quality and inference efficiency.

This paper has not been read by Pith yet.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.