REVIEW 4 major objections 4 minor 61 references
BudgetFusion: Perceptually-Guided Adaptive Diffusion Models
T0 review · 4 major / 4 minor · reviewed 2026-08-11 · deepseek-v4-flash
Pith's one-line read Prompt-aware step selection can cut diffusion image generation cost by up to five seconds per image.
desk verdict Worth reading for the prompt-adaptive plateau idea, but Eq 7 as printed cannot produce the reported step counts; the method needs a corrected formula and fuller evaluation before citing. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The load-bearing object is the per-prompt metric time series predictor: a two-layer BiLSTM (hidden size 512) followed by an MLP and sigmoid, trained with L2 loss on 882,432 Stable Diffusion images generated from 18,384 CLIP-diverse COCO prompts at twelve sampled timesteps. The predictor outputs three curves, one per perceptual scale; the plateau rule (Equation 7) takes the maximum of the three per-metric plateau points, defined by the median plus a metric-specific weight times the standard deviation of the predicted curve. The weights ($\omega_{L\text{-}SNR}=0.3$, $\omega_{D\text{-}SIM}=0.2$, $\omega_{I\text{-}CLIP}=0.5$) are tuned to maximise the same quality-per-TFLOP efficiency metric used in evaluation.
What would settle it
Run BudgetFusion on prompts deliberately outside COCO's distribution (for instance, abstract art, dense text, or unusual object compositions) and have users compare its output against a 65-step reference in a two-alternative forced-choice test; if the selection rate exceeds the one-JND bound, the plateau prediction does not transfer.
Extended reading notes
Core claim
The central claim is that perceptual quality gain per denoising step is not uniform across prompts: each prompt has its own saturation point beyond which extra denoising steps produce only marginal, imperceptible improvement. BudgetFusion operationalises this by training a bidirectional LSTM that takes a CLIP-embedded prompt and a position-encoded timestep and predicts three metric time series — L-SNR for pixel-level sharpness, DreamSim distance for mid-level layout, and CLIP cosine similarity for semantic alignment. The suggested timestep is the maximum over the three metrics of the first time each metric crosses a median-plus-weighted-standard-deviation threshold. With this rule the model selects timesteps that are on average far lower than the common 65-step reference, matching the reference within one just-noticeable-difference in a crowd-sourced user study while using roughly one third of the compute.
Load-bearing premise
The saving rests on assuming that perceptual quality genuinely saturates at a prompt-dependent step count, and that the plateau weights tuned on COCO with Stable Diffusion 2 transfer to other prompts and base models.
Editorial extensions
If this is right
- Deployed text-to-image services can run the 0.004-second predictor per prompt and skip roughly two-thirds of denoising steps without users noticing a difference.
- The same three-metric plateau rule can be applied to other latent diffusion models, with retraining on that model's generated images.
- The method turns inference cost from a fixed hyperparameter into a prompt-dependent decision, so compute is spent where it produces perceivable quality gain.
- The quality-per-TFLOP efficiency metric introduced here gives a common yardstick for comparing diffusion acceleration methods.
Reading between the lines
- The plateau weights are fitted to the same efficiency benchmark used for evaluation, so the reported gains are upper bounds unless those weights generalise to unseen prompt distributions; a sensitivity analysis across prompt categories would bound this.
- BudgetFusion's predicted curves could be used to allocate a total latency budget across multiple prompts in a batch rather than stopping each independently, which better matches real serving constraints.
- If the perceptual curves are reliable, they could also guide scheduler choice or early-exit criteria in distilled few-step models, where a fixed step count is still the norm.
Signed reviews
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper proposes BudgetFusion, a method that predicts, from a text prompt, a minimal number of denoising steps for a text-to-image diffusion model such that additional steps yield only marginal perceptual improvement. The system trains a BiLSTM to map CLIP-encoded text and timestep embeddings to three perceptual metrics (L-SNR, D-SIM, I-CLIP) as functions of the number of inference steps, and then selects a 'plateau' timestep via a threshold rule based on the median and standard deviation of each predicted metric curve. Experiments on Stable Diffusion 2 with COCO captions report improved quality-per-TFLOP efficiency relative to fixed-step baselines and reduced seconds-per-image, supported by a crowdsourced user study comparing BudgetFusion against uniform and reference schedules.
Significance. The paper identifies a promising direction: making diffusion inference compute-adaptive to prompt difficulty based on human perception, rather than using a fixed step count. The construction of a large dataset (882k images), the LSTM-based metric predictor, and the plateau-stopping idea are concrete contributions that could make diffusion deployment more efficient. If the algorithm is correctly specified and the evaluation is made non-circular, the method could be useful in practice. However, the current manuscript has critical issues in the algorithm description and in the interpretation of the user-study data that must be resolved before the central claims are supported.
major comments (4)
- [Section 3.4, Eq. (7)] Under the paper's own monotonicity assumption ('perceptual metrics typically exhibit a monotonic relationship with regard to number of denoising timesteps'), the plateau rule as printed is internally inconsistent. For an increasing metric such as I-CLIP (denoted ↑ in Section 3.2), the set {t : m_t(p) ≥ μ + ωσ} is an upper tail, so taking the maximum over t yields the largest sampled timestep, t_N = 129, for every prompt. This contradicts the reported suggestions t* = 27, 33, 42 in Figures 5–6 and the OURS time savings in Section 4.2. For decreasing metrics, the same inequality defines a lower tail, so the rule has opposite meanings across metrics. The authors must correct the stopping rule (e.g., use min_t for increasing metrics or invert the inequality) and demonstrate that the reported timesteps are actually produced by the stated formula.
- [Section 3.4 and Section 4.2] The plateau weights ω_m (ω_L-SNR=0.3, ω_D-SIM=0.2, ω_I-CLIP=0.5) are 'determined using the efficiency measurement as detailed in Section 4.2.' This means they are tuned to maximize the same quality-per-TFLOP metric that Section 4.2 uses as the headline evaluation. The evaluation is therefore circular: the reported efficiency advantage of OURS over UNIFORM and REFERENCE may be largely a consequence of fitting the stopping rule to the benchmark. The authors should specify a separate validation split for weight selection, report the sensitivity of the efficiency results to the ω values, or provide an independent criterion for choosing them.
- [Section 4.4, user study] The sentence 'participants selected OURS 35.2 ± 8.4% of the time, lower than 25% selection which is commonly used to define the 1 Just-Noticeable-Difference (1 JND) threshold' contains a numerical error: 35.2% is higher than 25%, not lower. If the intended threshold is that 25% selection of OURS corresponds to 75% correct detection of the reference (the standard JND level), then the observed 35.2% actually supports the claim of perceptual similarity, but the text must be corrected and a significance test against the threshold should be reported. As written, the statement is self-contradictory and undermines the 'without compromising perceptual similarity' conclusion.
- [Section 4.2, Eq. (9)] The relative quality gain of OURS over UNIFORM is computed on the same evaluation set used to determine the plateau weights and the average UNIFORM step count. Because the weights are fitted to maximize efficiency on this set, the reported 6.6–8.7% relative gains are likely optimistic. A cross-validation scheme for weight selection and UNIFORM step averaging would make the comparison trustworthy. The authors should also report the variance of these gains across held-out prompt splits.
minor comments (4)
- [Table 1] The header 'OURSw/o t-encodingt' appears to be a typo; it likely should read 'OURS w/o text-encoding' or 'OURS w/o t-encoding' with a space and correct spelling.
- [Section 4.4] The phrase 'The results are visualized in Section 4.4' should refer to the actual figure number (Figure 9) rather than the section number.
- [Section 4.4] The phrase 'with respect toREFERENCE' is missing a space; it should read 'with respect to REFERENCE'.
- [Section 3.4] The text states that μ and σ denote the 'median and standard deviation', but Eq. (7) writes them as μ and σ without clarifying that μ is the median; this should be stated explicitly to avoid confusion with the mean.
Circularity Check
Partial circularity: the plateau-rule weights are tuned to the same efficiency metric used for the headline evaluation, while the user study and LSTM prediction keep the core claim partly independent.
-
fitted input called prediction
[Section 3.4, Eq. (7), and Section 4.2, Eq. (8)]
"Similar to Engbert and Mergenthaler [8], we determine the weights ωm (ωL-SNR = 0.3, ωD-SIM = 0.2, ωI-CLIP = 0.5) of the three metrics using the efficiency measurement as detailed in Section 4.2."
The plateau-rule weights are selected using the same quality-per-TFLOP objective m_t(p)/η that Section 4.2 then uses to report OURS's headline efficiency advantage in Table 2. The step suggestions t* are therefore produced by a stopping rule whose free parameters were optimized against the evaluation metric, so the reported efficiency gain is partly forced by the fit rather than being an independent prediction of the method. This makes the numerical efficiency comparison partially self-fulfilling. The circularity is only partial because the LSTM predicts held-out metric curves and the 2AFC user study is an external criterion, but the central 'saves five seconds' efficiency claim is not fully independent of the fitted weights.
full rationale
The paper is largely self-contained: it constructs its own 882,432-image dataset, trains an LSTM to predict three perceptual metric curves, and evaluates on held-out prompts with both objective metrics and 2AFC user studies. I found no load-bearing self-citations or imported uniqueness arguments. The one substantial circular element is Eq. 7's weights: the paper explicitly states they were determined using the efficiency measurement detailed in Section 4.2, i.e., the same m_t/η objective used to report the headline speedup. This makes the Table 2 efficiency comparison partly a fitted result. I do not count the LSTM being trained on the same three metrics as circular, because the metrics are external perceptual measures and evaluation is on held-out generated images. The skeptic's Eq. 7 sign/monotonicity concern (max_t with ≥ over monotone metrics would select t=129) is a reproducibility or correctness defect rather than a reduction of the result to its inputs, so it is not scored as circularity here; it should be treated as a separate correctness risk. Since the user study and the adaptive-vs-uniform quality comparison retain independent content, a moderate partial-circularity score of 4 is appropriate.
Assumptions & free parameters
free parameters (3)
- Plateau weights omega_m =
omega_L-SNR=0.3, omega_D-SIM=0.2, omega_I-CLIP=0.5
- CLIP similarity threshold S_hat =
0.75
- Reference timestep t_N =
129
assumptions (5)
- domain assumption Stable Diffusion 2 and CLIP pretrained models provide reliable text-to-image generation and text-image embeddings.
- domain assumption The three perceptual metrics (L-SNR, D-SIM, I-CLIP) are valid proxies for human perception of generation quality.
- domain assumption Perceptual metrics are monotonic in the number of denoising steps.
- domain assumption Linear interpolation between sampled steps yields accurate pseudo-ground-truth metric values for all intermediate steps.
- domain assumption The denoising process is locally dependent, justifying the LSTM sequence model.
Cite this review
Pith. "Pith review of BudgetFusion: Perceptually-Guided Adaptive Diffusion Models." pith.science (2026). https://pith.science/paper/N3YTEDTO
@misc{pith2026241205780,
author = {Pith},
title = {Pith review of: BudgetFusion: Perceptually-Guided Adaptive Diffusion Models},
year = {2026},
howpublished = {\url{https://pith.science/paper/N3YTEDTO}},
note = {Machine review of arXiv:2412.05780}
}
read the original abstract
Diffusion models have shown unprecedented success in the task of text-to-image generation. While these models are capable of generating high-quality and realistic images, the complexity of sequential denoising has raised societal concerns regarding high computational demands and energy consumption. In response, various efforts have been made to improve inference efficiency. However, most of the existing efforts have taken a fixed approach with neural network simplification or text prompt optimization. Are the quality improvements from all denoising computations equally perceivable to humans? We observed that images from different text prompts may require different computational efforts given the desired content. The observation motivates us to present BudgetFusion, a novel model that suggests the most perceptually efficient number of diffusion steps before a diffusion model starts to generate an image. This is achieved by predicting multi-level perceptual metrics relative to diffusion steps. With the popular Stable Diffusion as an example, we conduct both numerical analyses and user studies. Our experiments show that BudgetFusion saves up to five seconds per prompt without compromising perceptual similarity. We hope this work can initiate efforts toward answering a core question: how much do humans perceptually gain from images created by a generative model, per watt of energy?
Figures
Figures from the paper (8 more)
Reference graph
Works this paper leans on
-
[1]
The unreasonable ef- fectiveness of clip features for image captioning: an experi- mental analysis
Manuele Barraco, Marcella Cornia, Silvia Cascianelli, Lorenzo Baraldi, and Rita Cucchiara. The unreasonable ef- fectiveness of clip features for image captioning: an experi- mental analysis. In proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages 4662– 4670, 2022. 4
work page 2022
-
[2]
Yu-Hui Chen, Raman Sarokin, Juhyun Lee, Jiuqiang Tang, Chuo-Ling Chang, Andrei Kulik, and Matthias Grundmann. Speed is all you need: On-device acceleration of large diffu- sion models via gpu-aware optimizations. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 4650–4654, 2023. 2
work page 2023
-
[3]
Exploring bert models for part-of-speech tagging in the algerian dialect: A comprehensive study
Mohamed Amine Cheragui, Abdelhalim Hafedh Dahou, and Amin Abdedaiem. Exploring bert models for part-of-speech tagging in the algerian dialect: A comprehensive study. In Proceedings of the 6th International Conference on Natu- ral Language and Speech Processing (ICNLSP 2023), pages 140–150, 2023. 5
work page 2023
-
[4]
Objective video quality assessment meth- ods: A classification, review, and performance comparison
Shyamprasad Chikkerur, Vijay Sundaram, Martin Reisslein, and Lina J Karam. Objective video quality assessment meth- ods: A classification, review, and performance comparison. IEEE transactions on broadcasting, 57(2):165–182, 2011. 8
work page 2011
-
[5]
Diffusion models in vision: A survey
Florinel-Alin Croitoru, Vlad Hondru, Radu Tudor Ionescu, and Mubarak Shah. Diffusion models in vision: A survey. IEEE Transactions on Pattern Analysis and Machine Intelli- gence, 2023. 8
work page 2023
-
[6]
A loss function for generative neural networks based on watson’s perceptual model
Steffen Czolbe, Oswin Krause, Ingemar Cox, and Christian Igel. A loss function for generative neural networks based on watson’s perceptual model. Advances in Neural Information Processing Systems, 33:2051–2061, 2020. 3
work page 2020
-
[7]
Visible differences predictor: an algorithm for the assessment of image fidelity
Scott J Daly. Visible differences predictor: an algorithm for the assessment of image fidelity. In Human Vision, Visual Processing, and Digital Display III, pages 2–15. SPIE, 1992. 2
work page 1992
-
[8]
Microsaccades are triggered by low retinal image slip
Ralf Engbert and Konstantin Mergenthaler. Microsaccades are triggered by low retinal image slip. Proceedings of the National Academy of Sciences, 103(18):7192–7197, 2006. 5
work page 2006
Show all 61 references
-
[9]
Dream- sim: Learning new dimensions of human visual similarity using synthetic data
Stephanie Fu, Netanel Tamir, Shobhita Sundaram, Lucy Chai, Richard Zhang, Tali Dekel, and Phillip Isola. Dream- sim: Learning new dimensions of human visual similarity using synthetic data. Advances in Neural Information Pro- cessing Systems, 36, 2024. 2, 4, 8
2024
-
[10]
Framewise phoneme classification with bidirectional lstm and other neural net- work architectures
Alex Graves and J ¨urgen Schmidhuber. Framewise phoneme classification with bidirectional lstm and other neural net- work architectures. Neural networks , 18(5-6):602–610,
-
[11]
Speech recognition with deep recurrent neural networks
Alex Graves, Abdel-rahman Mohamed, and Geoffrey Hin- ton. Speech recognition with deep recurrent neural networks. In 2013 IEEE international conference on acoustics, speech and signal processing, pages 6645–6649. Ieee, 2013. 2
2013
-
[12]
Animatediff: Animate your personalized text-to-image diffusion models without specific tuning
Yuwei Guo, Ceyuan Yang, Anyi Rao, Yaohui Wang, Yu Qiao, Dahua Lin, and Bo Dai. Animatediff: Animate your personalized text-to-image diffusion models without specific tuning. arXiv preprint arXiv:2307.04725, 2023. 8
2023 arXiv
-
[13]
Improving neural networks by preventing co-adaptation of feature detectors
Geoffrey E Hinton, Nitish Srivastava, Alex Krizhevsky, Ilya Sutskever, and Ruslan R Salakhutdinov. Improving neural networks by preventing co-adaptation of feature detectors. arXiv preprint arXiv:1207.0580, 2012. 5
2012 arXiv
-
[14]
Denoising dif- fusion probabilistic models
Jonathan Ho, Ajay Jain, and Pieter Abbeel. Denoising dif- fusion probabilistic models. Advances in neural information processing systems, 33:6840–6851, 2020. 1, 2
2020
-
[15]
Video dif- fusion models
Jonathan Ho, Tim Salimans, Alexey Gritsenko, William Chan, Mohammad Norouzi, and David J Fleet. Video dif- fusion models. Advances in Neural Information Processing Systems, 35:8633–8646, 2022. 8
2022
-
[16]
Perceptual model for adaptive local shad- ing and refresh rate
Akshay Jindal, Krzysztof Wolski, Karol Myszkowski, and Rafał K Mantiuk. Perceptual model for adaptive local shad- ing and refresh rate. ACM Transactions on Graphics (TOG), 40(6):1–18, 2021. 3
2021
-
[17]
Percep- tual losses for real-time style transfer and super-resolution
Justin Johnson, Alexandre Alahi, and Li Fei-Fei. Percep- tual losses for real-time style transfer and super-resolution. In Computer Vision–ECCV 2016: 14th European Confer- ence, Amsterdam, The Netherlands, October 11-14, 2016, Proceedings, Part II 14, pages 694–711. Springer, 2016. 3
2016
-
[18]
Aligning ar- tificial intelligence with climate change mitigation
Lynn H Kaack, Priya L Donti, Emma Strubell, George Kamiya, Felix Creutzig, and David Rolnick. Aligning ar- tificial intelligence with climate change mitigation. Nature Climate Change, 12(6):518–527, 2022. 1
2022
-
[19]
Elucidating the design space of diffusion-based generative models
Tero Karras, Miika Aittala, Timo Aila, and Samuli Laine. Elucidating the design space of diffusion-based generative models. Advances in Neural Information Processing Sys- tems, 35:26565–26577, 2022. 2, 3
2022
-
[20]
Generative ai’s environmental costs are soar- ing — and mostly secret
Kate Crawford. Generative ai’s environmental costs are soar- ing — and mostly secret. Nature World View, 2024. 1
2024
-
[21]
Image reconstruction in snr units: a general method for snr measurement
Peter Kellman and Elliot R McVeigh. Image reconstruction in snr units: a general method for snr measurement. Mag- netic resonance in medicine, 54(6):1439–1447, 2005. 4
2005
-
[22]
Bert: Pre-training of deep bidirectional trans- formers for language understanding
Jacob Devlin Ming-Wei Chang Kenton and Lee Kristina Toutanova. Bert: Pre-training of deep bidirectional trans- formers for language understanding. In Proceedings of NAACL-HLT, pages 4171–4186, 2019. 5
2019
-
[23]
Autodiffusion: Training-free optimization of time steps and architectures for automated diffusion model acceleration
Lijiang Li, Huixia Li, Xiawu Zheng, Jie Wu, Xuefeng Xiao, Rui Wang, Min Zheng, Xin Pan, Fei Chao, and Rongrong Ji. Autodiffusion: Training-free optimization of time steps and architectures for automated diffusion model acceleration. In Proceedings of the IEEE/CVF International...
2023
-
[24]
Distri- fusion: Distributed parallel inference for high-resolution dif- fusion models
Muyang Li, Tianle Cai, Jiaxin Cao, Qinsheng Zhang, Han Cai, Junjie Bai, Yangqing Jia, Kai Li, and Song Han. Distri- fusion: Distributed parallel inference for high-resolution dif- fusion models. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recogniti...
2024
-
[25]
Snap- fusion: Text-to-image diffusion model on mobile devices within two seconds
Yanyu Li, Huan Wang, Qing Jin, Ju Hu, Pavlo Chemerys, Yun Fu, Yanzhi Wang, Sergey Tulyakov, and Jian Ren. Snap- fusion: Text-to-image diffusion model on mobile devices within two seconds. Advances in Neural Information Pro- cessing Systems, 36, 2024. 1, 2
2024
-
[26]
Microsoft coco: Common objects in context
Tsung-Yi Lin, Michael Maire, Serge Belongie, James Hays, Pietro Perona, Deva Ramanan, Piotr Doll´ar, and C Lawrence Zitnick. Microsoft coco: Common objects in context. In Computer Vision–ECCV 2014: 13th European Conference, Zurich, Switzerland, September 6-12, 2014, Proceeding...
2014
-
[27]
Pseudo numerical methods for diffusion models on manifolds.arXiv preprint arXiv:2202.09778, 2022
Luping Liu, Yi Ren, Zhijie Lin, and Zhou Zhao. Pseudo numerical methods for diffusion models on manifolds.arXiv preprint arXiv:2202.09778, 2022. 2
2022 arXiv
-
[28]
Instaflow: One step is enough for high-quality diffusion- based text-to-image generation
Xingchao Liu, Xiwen Zhang, Jianzhu Ma, Jian Peng, et al. Instaflow: One step is enough for high-quality diffusion- based text-to-image generation. In The Twelfth International Conference on Learning Representations, 2023. 1, 2
2023
-
[29]
Dpm-solver: A fast ode solver for diffusion probabilistic model sampling in around 10 steps
Cheng Lu, Yuhao Zhou, Fan Bao, Jianfei Chen, Chongxuan Li, and Jun Zhu. Dpm-solver: A fast ode solver for diffusion probabilistic model sampling in around 10 steps. Advances in Neural Information Processing Systems , 35:5775–5787,
-
[30]
Latent consistency models: Synthesizing high- resolution images with few-step inference
Simian Luo, Yiqin Tan, Longbo Huang, Jian Li, and Hang Zhao. Latent consistency models: Synthesizing high- resolution images with few-step inference. arXiv preprint arXiv:2310.04378, 2023. 2
2023 arXiv
-
[31]
Deepcache: Accelerating diffusion models for free
Xinyin Ma, Gongfan Fang, and Xinchao Wang. Deepcache: Accelerating diffusion models for free. In The IEEE/CVF Conference on Computer Vision and Pattern Recognition ,
-
[32]
Sentiment analysis us- ing bidirectional lstm network
UB Mahadevaswamy and P Swathi. Sentiment analysis us- ing bidirectional lstm network. Procedia Computer Science, 218:45–56, 2023. 5
2023
-
[33]
Hdr-vdp-2: A calibrated visual metric for visibility and quality predictions in all luminance conditions
Rafał Mantiuk, Kil Joong Kim, Allan G Rempel, and Wolf- gang Heidrich. Hdr-vdp-2: A calibrated visual metric for visibility and quality predictions in all luminance conditions. ACM Transactions on graphics (TOG), 30(4):1–14, 2011. 2
2011
-
[34]
Comparison of four subjective methods for image qual- ity assessment
Rafał K Mantiuk, Anna Tomaszewska, and Radosław Man- tiuk. Comparison of four subjective methods for image qual- ity assessment. In Computer graphics forum , pages 2478–
-
[35]
Fovvideovdp: A visible difference predictor for wide field-of-view video.ACM Transactions on Graphics (TOG), 40(4):1–19, 2021
Rafał K Mantiuk, Gyorgy Denes, Alexandre Chapiro, Anton Kaplanyan, Gizem Rufo, Romain Bachy, Trisha Lian, and Anjul Patney. Fovvideovdp: A visible difference predictor for wide field-of-view video.ACM Transactions on Graphics (TOG), 40(4):1–19, 2021. 2, 8
2021
-
[36]
Making an image with generative ai uses as much energy as charging your phone
Melissa Heikkil ¨a. Making an image with generative ai uses as much energy as charging your phone. MIT Technology Review, 2023. 8
2023
-
[37]
On distillation of guided diffusion models
Chenlin Meng, Robin Rombach, Ruiqi Gao, Diederik Kingma, Stefano Ermon, Jonathan Ho, and Tim Salimans. On distillation of guided diffusion models. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pat- tern Recognition, pages 14297–14306, 2023. 1, 2
2023
-
[38]
Clip-mesh: Generating textured meshes from text using pretrained image-text models
Nasir Mohammad Khalid, Tianhao Xie, Eugene Belilovsky, and Tiberiu Popa. Clip-mesh: Generating textured meshes from text using pretrained image-text models. InSIGGRAPH Asia 2022 conference papers, pages 1–8, 2022. 4
2022
-
[39]
On inference stability for diffusion models
Viet Nguyen, Giang Vu, Tung Nguyen Thanh, Khoat Than, and Toan Tran. On inference stability for diffusion models. In Proceedings of the AAAI Conference on Artificial Intelli- gence, pages 14449–14456, 2024. 3
2024
-
[40]
Improved denoising diffusion probabilistic models
Alexander Quinn Nichol and Prafulla Dhariwal. Improved denoising diffusion probabilistic models. In International conference on machine learning, pages 8162–8171. PMLR,
-
[41]
Optic: A deep neural network approach for entity linking using word and knowledge em- beddings
Italo Lopes Oliveira, Diego Moussallem, Lu ´ıs Paulo Faina Garcia, and Renato Fileto. Optic: A deep neural network approach for entity linking using word and knowledge em- beddings. In ICEIS (1), pages 315–326, 2020. 5
2020
-
[42]
Local laplacian filters: Edge-aware image processing with a lapla- cian pyramid
Sylvain Paris, Samuel W Hasinoff, and Jan Kautz. Local laplacian filters: Edge-aware image processing with a lapla- cian pyramid. ACM Trans. Graph., 30(4):68, 2011. 4
2011
-
[43]
Towards foveated rendering for gaze-tracked virtual reality
Anjul Patney, Marco Salvi, Joohwan Kim, Anton Kaplanyan, Chris Wyman, Nir Benty, David Luebke, and Aaron Lefohn. Towards foveated rendering for gaze-tracked virtual reality. ACM Transactions on Graphics (TOG), 35(6):1–12, 2016. 3
2016
-
[44]
Diffusion autoen- coders: Toward a meaningful and decodable representation
Konpat Preechakul, Nattanat Chatthee, Suttisak Wizad- wongsa, and Supasorn Suwajanakorn. Diffusion autoen- coders: Toward a meaningful and decodable representation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 10619–10629, 2022. 2
2022
-
[45]
Learning transferable visual models from natural language supervi- sion
Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agarwal, Girish Sastry, Amanda Askell, Pamela Mishkin, Jack Clark, et al. Learning transferable visual models from natural language supervi- sion. In International conference on machine learning, ...
2021
-
[46]
Zero-shot text-to-image generation
Aditya Ramesh, Mikhail Pavlov, Gabriel Goh, Scott Gray, Chelsea V oss, Alec Radford, Mark Chen, and Ilya Sutskever. Zero-shot text-to-image generation. In International confer- ence on machine learning, pages 8821–8831. Pmlr, 2021. 2
2021
-
[47]
High-resolution image synthesis with latent diffusion models
Robin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser, and Bj ¨orn Ommer. High-resolution image synthesis with latent diffusion models. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 10684–10695, 2022. 1, 2, 3, 4
2022
-
[48]
Progressive distillation for fast sampling of diffusion models
Tim Salimans and Jonathan Ho. Progressive distillation for fast sampling of diffusion models. arXiv preprint arXiv:2202.00512, 2022. 1, 2
2022 arXiv
-
[49]
Generative ai’s energy problem today is foun- dational
Sarah Wells. Generative ai’s energy problem today is foun- dational. IEEE Spectrum, 2023. 1
2023
-
[50]
Fast high- resolution image synthesis with latent adversarial diffusion distillation
Axel Sauer, Frederic Boesel, Tim Dockhorn, Andreas Blattmann, Patrick Esser, and Robin Rombach. Fast high- resolution image synthesis with latent adversarial diffusion distillation. arXiv preprint arXiv:2403.12015, 2024. 1, 2
2024 arXiv
-
[51]
The performance of lstm and bilstm in forecasting time series
Sima Siami-Namini, Neda Tavakoli, and Akbar Siami Namin. The performance of lstm and bilstm in forecasting time series. In 2019 IEEE International conference on big data (Big Data), pages 3285–3292. IEEE, 2019. 5
2019
-
[52]
Denoising diffusion implicit models
Jiaming Song, Chenlin Meng, and Stefano Ermon. Denoising diffusion implicit models. arXiv preprint arXiv:2010.02502, 2020. 2, 7
2010 arXiv
-
[53]
Consistency models
Yang Song, Prafulla Dhariwal, Mark Chen, and Ilya Sutskever. Consistency models. arXiv preprint arXiv:2303.01469, 2023. 2
2023 arXiv
-
[54]
Bert for sentiment analysis: pre-trained and fine- tuned alternatives
Frederico Dias Souza and Jo ˜ao Baptista de Oliveira e Souza Filho. Bert for sentiment analysis: pre-trained and fine- tuned alternatives. In International Conference on Compu- tational Processing of the Portuguese Language, pages 209–
-
[55]
Spatio-temporal prompt- ing network for robust video feature extraction
Guanxiong Sun, Chi Wang, Zhaoyu Zhang, Jiankang Deng, Stefanos Zafeiriou, and Yang Hua. Spatio-temporal prompt- ing network for robust video feature extraction. In Proceed- ings of the IEEE/CVF International Conference on Com- puter Vision, pages 13587–13597, 2023. 8
2023
-
[56]
Image quality assessment: from error visibility to structural similarity
Zhou Wang, Alan C Bovik, Hamid R Sheikh, and Eero P Si- moncelli. Image quality assessment: from error visibility to structural similarity. IEEE transactions on image processing, 13(4):600–612, 2004. 2
2004
-
[57]
Clip-gen: Language-free training of a text-to-image genera- tor with clip
Zihao Wang, Wei Liu, Qian He, Xinglong Wu, and Zili Yi. Clip-gen: Language-free training of a text-to-image genera- tor with clip. arXiv preprint arXiv:2203.00386, 2022. 4
2022 arXiv
-
[58]
Diffusion in diffusion: Cyclic one-way diffu- sion for text-vision-conditioned generation
Yongqi Yang, Ruoyu Wang, Zhihao Qian, Ye Zhu, and Yu Wu. Diffusion in diffusion: Cyclic one-way diffu- sion for text-vision-conditioned generation. arXiv preprint arXiv:2306.08247, 2023. 4
2023 arXiv
-
[59]
Signal-to-noise ratio: A robust dis- tance metric for deep metric learning
Tongtong Yuan, Weihong Deng, Jian Tang, Yinan Tang, and Binghui Chen. Signal-to-noise ratio: A robust dis- tance metric for deep metric learning. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 4815–4824, 2019. 4
2019
-
[60]
A full perspective of a restroom view with a few things
Richard Zhang, Phillip Isola, Alexei A Efros, Eli Shecht- man, and Oliver Wang. The unreasonable effectiveness of deep features as a perceptual metric. In Proceedings of the IEEE conference on computer vision and pattern recogni- tion, pages 586–595, 2018. 2 BudgetFusion: Perc...
2018
-
[2491]
Wiley Online Library, 2012. 7
2012
Reviewed August 11, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.