Pith. sign in

REVIEW 9 cited by

KNN-Diffusion: Image Generation via Large-Scale Retrieval

Not yet reviewed by Pith; the record is open.

Re-run · record.json Download PDF Read on arXiv ↗

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2204.02849 v2 pith:OQI4E6SG submitted 2022-04-06 cs.CV cs.AIcs.CLcs.GRcs.LG

KNN-Diffusion: Image Generation via Large-Scale Retrieval

Shelly Sheynin , Oron Ashual , Adam Polyak , Uriel Singer , Oran Gafni , Eliya Nachmani , Yaniv Taigman This is my paper
classification cs.CV cs.AIcs.CLcs.GRcs.LG
keywords large-scaleresultsretrievaltext-to-imagedatadatasetsdiffusionefficient
verification ladder T0 review T1 audit T2 compute T3 formal T4 reserved
0 comments
Share X Bluesky LinkedIn Reddit HN
read the original abstract

Recent text-to-image models have achieved impressive results. However, since they require large-scale datasets of text-image pairs, it is impractical to train them on new domains where data is scarce or not labeled. In this work, we propose using large-scale retrieval methods, in particular, efficient k-Nearest-Neighbors (kNN), which offers novel capabilities: (1) training a substantially small and efficient text-to-image diffusion model without any text, (2) generating out-of-distribution images by simply swapping the retrieval database at inference time, and (3) performing text-driven local semantic manipulations while preserving object identity. To demonstrate the robustness of our method, we apply our kNN approach on two state-of-the-art diffusion backbones, and show results on several different datasets. As evaluated by human studies and automatic metrics, our method achieves state-of-the-art results compared to existing approaches that train text-to-image generation models using images only (without paired text data)

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 9 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. MemoGen: Can Past Experience Improve Future Text-to-Image Generation?

    cs.CV 2026-06 unverdicted novelty 7.0

    MemoGen is a training-free agentic framework that stores task understanding, references, visual feedback, and lessons from past generations as reusable memory to improve text-to-image output over evolution rounds.

  2. ASTRA: Enhancing Multi-Subject Generation with Retrieval-Augmented Pose Guidance and Disentangled Position Embedding

    cs.CV 2026-04 unverdicted novelty 7.0

    ASTRA disentangles subject identity from pose structure in diffusion transformers via retrieval-augmented pose guidance, asymmetric EURoPE embeddings, and a DSM adapter to improve multi-subject generation.

  3. SegRAG: Training-Free Retrieval-Augmented Semantic Segmentation

    cs.CV 2026-05 unverdicted novelty 6.0

    SegRAG is a training-free retrieval-augmented framework that extracts class-specific point prompts from a filtered DINOv3 feature bank to boost SAM3 semantic segmentation performance on standard and agricultural benchmarks.

  4. SegRAG: Training-Free Retrieval-Augmented Semantic Segmentation

    cs.CV 2026-05 unverdicted novelty 6.0

    SegRAG augments SAM3 with class-specific point prompts retrieved via DINOv3 features and filtered by ICCD, using TSG at inference to improve open-vocabulary segmentation.

  5. Align & Invert: Solving Inverse Problems with Diffusion and Flow-based Models via Representation Alignment

    cs.CV 2025-11 conditional novelty 6.0

    Adding DINOv2 representation alignment to diffusion/flow inverse-problem solvers, using corrupted measurements as proxies, improves LPIPS/FID and cuts required sampling steps.

  6. Retrievals Can Be Detrimental: Unveiling the Backdoor Vulnerability of Retrieval-Augmented Diffusion Models

    cs.CV 2025-01 conditional novelty 6.0

    BadRDM is a backdoor attack on retrieval-augmented diffusion models that poisons the retrieval database with toxicity surrogates and uses multimodal contrastive learning to force toxic generations from text triggers w...

  7. TokenFlow: Consistent Diffusion Features for Consistent Video Editing

    cs.CV 2023-07 conditional novelty 6.0

    TokenFlow produces consistent text-driven video edits by propagating diffusion features according to inter-frame correspondences extracted from the source video.

  8. eDiff-I: Text-to-Image Diffusion Models with an Ensemble of Expert Denoisers

    cs.CV 2022-11 unverdicted novelty 6.0

    An ensemble of stage-specialized text-to-image diffusion models improves prompt alignment over single shared-parameter models while preserving visual quality and inference speed.

  9. RAVA: Retrieval-Augmented Viewpoint Alignment for Subject-Driven Image Generation

    cs.CV 2026-06 unverdicted novelty 4.0

    RAVA retrieves view-consistent target-subject images via a learned cross-instance embedding and LogDet subset selection, then uses them in a multi-reference generator to improve cross-subject viewpoint alignment.