REVIEW 12 cited by
Fair Diffusion: Instructing Text-to-Image Generation Models on Fairness
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
Generative AI models have recently achieved astonishing results in quality and are consequently employed in a fast-growing number of applications. However, since they are highly data-driven, relying on billion-sized datasets randomly scraped from the internet, they also suffer from degenerated and biased human behavior, as we demonstrate. In fact, they may even reinforce such biases. To not only uncover but also combat these undesired effects, we present a novel strategy, called Fair Diffusion, to attenuate biases after the deployment of generative text-to-image models. Specifically, we demonstrate shifting a bias, based on human instructions, in any direction yielding arbitrarily new proportions for, e.g., identity groups. As our empirical evaluation demonstrates, this introduced control enables instructing generative image models on fairness, with no data filtering and additional training required.
Forward citations
Cited by 12 Pith papers
-
Efficient bias mitigation in T2I diffusion models using Concept Graphs
Joint concept-graph alignment of Stable Diffusion’s text encoder and denoiser cuts fairness discrepancy ~30%, incoherent outputs 88%, and improves adversarial unlearning robustness.
-
FairFlow: Demystifying and Mitigating Stereotype Bias in Text-to-Image Diffusion Transformers
Bias in MM-DiTs is mediated by sparse stage-wise semantic binding hubs, and sparse inference-time steering at those hubs mitigates gender, race, and intersectional stereotypes with low overhead.
-
COVAriance-Induced Fairness Gap Penalty for Subgroup-Fair Clustering
A covariance quantity is proven exactly equal to a subgroup-fairness gap for clustering, yielding COVA-FC, a scalable algorithm that can also enforce marginal fairness.
-
Calibrating Generative Models to Distributional Constraints
CGM-relax and CGM-reward fine-tune generative models to meet distributional constraints by minimizing a miscalibration penalty or a KL divergence to an estimated maximum-entropy tilt.
-
Discovering Divergent Representations between Text-to-Image Models
An evolutionary algorithm discovers visual attributes that appear in one text-to-image model's outputs but not another's, and identifies the prompt concepts that trigger them.
-
Understanding and evaluating computer vision models through the lens of counterfactuals
Counterfactual-based methods for concept attribution in classifiers and for dynamic bias evaluation and mitigation in text-to-image models.
-
FAROS: Fair Graph Generation via Attribute Switching Mechanisms
FAROS switches sensitive attributes on an optimal fraction of nodes at an optimal diffusion step to produce fairer generated graphs with little accuracy loss.
-
Multi-Group Proportional Representation for Text-to-Image Models
The authors apply the MPR metric (an integral probability metric) to text-to-image generation, derive tractable forms for linear and decision-tree function classes, and use it as a fine-tuning objective that reduces i...
-
Mitigate One, Skew Another? Tackling Intersectional Biases in Text-to-Image Models
BiasConnect predicts how mitigating bias on one axis shifts bias on another axis in text-to-image models, and InterMit uses that to guide efficient multi-axis bias mitigation.
-
Multi-Axis Max@K Reinforcement Learning for Representative Diversity in Text-to-Image Generation
A per-category best-of-K RL reward, multi-axis max@K, shifts SD3.5-M perceived-appearance distributions toward uniform coverage (Fairness Score +0.23 to +0.36) without quality loss.
-
BioPro: Towards Difference-Aware Gender Fairness for Vision-Language Models
BioPro uses orthogonal projection on a gender-variation subspace to selectively debias vision-language models, reducing gender bias in neutral contexts while preserving explicit gender cues.
-
FairJudge: Abstention-Aware Multimodal Judges for Fairness and Alignment Evaluation in Text-to-Image Models
An abstention-aware, label-constrained MLLM protocol plus two synthetic benchmarks improves social-attribute and alignment evaluation of text-to-image models on most tested attributes over CLIP/DeepFace.
Discussion (0). Sign in to comment.