REVIEW 15 cited by
Erasing Undesirable Influence in Diffusion Models
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Signed reviews
read the original abstract
Diffusion models are highly effective at generating high-quality images but pose risks, such as the unintentional generation of NSFW (not safe for work) content. Although various techniques have been proposed to mitigate unwanted influences in diffusion models while preserving overall performance, achieving a balance between these goals remains challenging. In this work, we introduce EraseDiff, an algorithm designed to preserve the utility of the diffusion model on retained data while removing the unwanted information associated with the data to be forgotten. Our approach formulates this task as a constrained optimization problem using the value function, resulting in a natural first-order algorithm for solving the optimization problem. By altering the generative process to deviate away from the ground-truth denoising trajectory, we update parameters for preservation while controlling constraint reduction to ensure effective erasure, striking an optimal trade-off. Extensive experiments and thorough comparisons with state-of-the-art algorithms demonstrate that EraseDiff effectively preserves the model's utility, efficacy, and efficiency.
Forward citations
Cited by 15 Pith papers
-
MOON: Multi-Objective OrthoNormalized Updates for Multitask Learning
MOON applies spectral-nuclear-norm geometry to multi-objective gradient manipulation and uses polar-factor updates, with O(T^-1/2) deterministic and O(T^-1/4) stochastic convergence to Pareto stationarity.
-
UnHype: CLIP-Guided Hypernetworks for Dynamic LoRA Unlearning
UnHype generates concept-specific LoRA unlearning weights on the fly from CLIP text embeddings by training a hypernetwork to follow the gradient of an unlearning loss, enabling single- and multi-concept erasure in dif...
-
SAEmnesia: Erasing Concepts in Diffusion Models with Supervised Sparse Autoencoders
A supervised sparse autoencoder binds each concept to a single neuron, letting Stable Diffusion erase a concept by steering one latent.
-
LoRAShield: Data-Free Editing Alignment for Secure Personalized LoRA Sharing
A data-free editing framework that realigns LoRA weight subspaces via adversarial optimization and semantic augmentation to suppress malicious generations.
-
Fantastic Targets for Concept Erasure in Diffusion Models and Where To Find Them
A diffusion model unlearning method that automatically chooses a closely related, non-synonym target concept for each erased concept, reducing side effects on other concepts while keeping erasure effective.
-
SAeUron: Interpretable Concept Unlearning in Diffusion Models with Sparse Autoencoders
SAeUron removes concepts from text-to-image diffusion models by ablating concept-specific sparse autoencoder features during inference, achieving state-of-the-art unlearning on UnlearnCanvas and I2P without weight updates.
-
SafeCFG: Controlling Harmful Features with Dynamic Safe Guidance for Safe Generation
SafeCFG adapts classifier-free guidance with a learned feature controller so that clean prompts generate normally while harmful prompts are pushed away from unsafe content.
-
Efficient Fine-Tuning and Concept Suppression for Pruned Diffusion Models
A bilevel training procedure that simultaneously restores a pruned diffusion model's quality and suppresses targeted concepts beats sequential fine-tuning followed by unlearning.
-
Moderating the Generalization of Score-based Generative Model
MSGM is a score-adjustment unlearning method for score-based generative models that suppresses targeted content generation without full retraining.
-
Precise, Fast, and Low-cost Concept Erasure in Value Space: Orthogonal Complement Matters
AdaVD removes target concepts from diffusion models by soft-projecting value vectors away from the target token direction, with a sigmoid threshold that preserves unrelated prompts.
-
Memories of Forgotten Concepts
Erased concepts in text-to-image diffusion models can still be generated from high-likelihood latent seeds recovered by diffusion inversion, across nine ablation methods and six concepts.
-
ContrastiveCFG: Guiding Diffusion Sampling by Contrasting Positive and Negative Concepts
A new guidance reweighting, derived from a contrastive loss, makes negative prompting in diffusion models remove unwanted concepts with less quality loss than standard negated CFG.
-
Multimodal Unlearning Across Vision, Language, Video, and Audio: Survey of Methods, Datasets, and Benchmarks
A system-first taxonomy and literature synthesis of multimodal unlearning across vision, language, video, and audio, with datasets, benchmarks, metrics, applications, and open challenges.
-
Few-Shot Concept Unlearning with Low Rank Adaptation
The authors combine few-shot unlearning with low-rank adaptation on the CLIP text encoder to erase concepts from Stable Diffusion v2 in under a minute, reporting low forget-CLIP scores and detection rates on three concepts.
-
Jailbreak Attacks and Defenses against Multimodal Generative Models: A Survey
A survey that taxonomizes multimodal jailbreak attacks and defenses into four lifecycle levels (input, encoder, generator, output) across Any-to-Text, Any-to-Vision, and Any-to-Any generative models.
Discussion (0). Continue with ORCID to comment.