RECORD
DiffNAS: Bootstrapping Diffusion Models by Prompting for Better Architectures
Artificial Intelligence · Submitted 7 Oct 2023
abstract compiled · 2026-09-23 · no language-model review
The authors' main claim Rigorous experimentation corroborates that our algorithm can augment the search efficiency by 2 times under GPT-based scenarios, while also attaining a performance of 2.82 with 0.37 improvement in FID on CIFAR10 relative to the benchmark IDDPM algorithm.
The compiled record
The paper's own sentences, arranged. Each label is drawn from a closed vocabulary; the number beside it is the probability the classifier gave that label. Numbers in the tables are the authors', checked by code. No sentence in this record was written by a model.
Open the compiled record
The abstract, sentence by sentence
Diffusion models have recently exhibited remarkable performance on synthetic data. After a diffusion path is selected, a base model, such as UNet, operates as a denoising autoencoder, primarily predicting noises that need to be eliminated step by step. Consequently, it is crucial to employ a model that aligns with the expected budgets to facilitate superior synthetic performance. In this paper, we meticulously analyze the diffusion model and engineer a base model search approach, denoted "DiffNAS". Specifically, we leverage GPT-4 as a supernet to expedite the search, supplemented with a search memory to enhance the results. Moreover, we employ RFID as a proxy to promptly rank the experimental outcomes produced by GPT-4. We also adopt a rapid-convergence training strategy to boost search efficiency. Rigorous experimentation corroborates that our algorithm can augment the search efficiency by 2 times under GPT-based scenarios, while also attaining a performance of 2.82 with 0.37 improvement in FID on CIFAR10 relative to the benchmark IDDPM algorithm.
background contribution method result interpretation main claim
| # | sentence | role | the authors' own work | states the main conclusion | strength |
|---|---|---|---|---|---|
| s0 | Diffusion models have recently exhibited remarkable performance on synthetic data. | background 1.00 | 0.04 | 0.02 | asserted 0.99 |
| s1 | After a diffusion path is selected, a base model, such as UNet, operates as a denoising autoencoder, primarily predicting noises that need to be eliminated step by step. | background 0.98 | 0.06 | 0.02 | asserted 1.00 |
| s2 | Consequently, it is crucial to employ a model that aligns with the expected budgets to facilitate superior synthetic performance. | background 0.85 | 0.07 | 0.04 | asserted 0.98 |
| s3 | In this paper, we meticulously analyze the diffusion model and engineer a base model search approach, denoted "DiffNAS". | contribution 0.99 | 0.95 | 0.05 | asserted 1.00 |
| s4 | Specifically, we leverage GPT-4 as a supernet to expedite the search, supplemented with a search memory to enhance the results. | method 0.97 | 0.93 | 0.04 | asserted 1.00 |
| s5 | Moreover, we employ RFID as a proxy to promptly rank the experimental outcomes produced by GPT-4. | method 0.98 | 0.93 | 0.03 | asserted 0.99 |
| s6 | We also adopt a rapid-convergence training strategy to boost search efficiency. | method 0.96 | 0.91 | 0.03 | asserted 0.97 |
| s7 | Rigorous experimentation corroborates that our algorithm can augment the search efficiency by 2 times under GPT-based scenarios, while also attaining a performance of 2.82 with 0.37 improvement in FID on CIFAR10 relative to the benchmark IDDPM algorithm. | result 1.00 | 0.96 | 0.83 | asserted 1.00 |
What was examined, and what was not
- arXiv listing abstract v2
- full text
- figures and tables
- references and citing sentences
- relations to other papers
- P abstract
- S sections
- T body sentences
- C citations
- R cross-paper relations
The paper
Original abstract
Diffusion models have recently exhibited remarkable performance on synthetic data. After a diffusion path is selected, a base model, such as UNet, operates as a denoising autoencoder, primarily predicting noises that need to be eliminated step by step. Consequently, it is crucial to employ a model that aligns with the expected budgets to facilitate superior synthetic performance. In this paper, we meticulously analyze the diffusion model and engineer a base model search approach, denoted "DiffNAS". Specifically, we leverage GPT-4 as a supernet to expedite the search, supplemented with a search memory to enhance the results. Moreover, we employ RFID as a proxy to promptly rank the experimental outcomes produced by GPT-4. We also adopt a rapid-convergence training strategy to boost search efficiency. Rigorous experimentation corroborates that our algorithm can augment the search efficiency by 2 times under GPT-based scenarios, while also attaining a performance of 2.82 with 0.37 improvement in FID on CIFAR10 relative to the benchmark IDDPM algorithm.
Human review
How the literature uses it
2 arXiv papers cite this in 3 sentences
Papers citing it · 1 sentence without a confident label
Cites it as background 2 papers
-
Other works include GENIUS [ref] that utilized LLMs in NAS to improve the accuracy of convolution-based DNNs, GPT4GNAS [ref] that explores the potential of LLMs in improving the accuracy of graph neural networks, and DIFFNAS [ref] that uses LLMs to search for DNNs that are more compatible with Denoising Diffusion Probabilistic Models (DDPM).
FL-NAS: Towards Fairness of NAS for Resource Constrained Devices via Large Language Models · NAS via Large Language Models · 0.99
-
Similar proposals include LightGrad [ref] , DiffNAS [ref] , and SnapFusion [ref] .
Intelligent Mobile AI-Generated Content Services via Interactive Prompt Engineering and Dynamic Service Provisioning · Mobile AIGC and Its Applications · 0.82
What it cites · 1 sentence without a confident label
Cites as background 2 papers
-
Currently, almost all mainstream diffusion models such as Guided Diffusion [ref] and Imagen [ref] leverage Unet as their foundation model to carry out denoising in the reverse process.
Classifier-Free Diffusion Guidance · DiffNAS · 0.85
-
Diffusion models, which are extensively used in a variety of generative tasks including image generation [ref] , editing [ref] , and video generation [ref] , hinge on two processes: forward diffusion and reverse denoising.
Imagen Video: High Definition Video Generation with Diffusion Models · Introduction · 0.96
Discussion
Know something about this paper? Leave a comment, or highlight any passage above to comment on it.