Pith. sign in

REVIEW 7 cited by

From Pixels to Prose: A Large Dataset of Dense Image Captions

Not yet reviewed by Pith; the record is open.

Re-run · record.json Download PDF Read on arXiv ↗

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2406.10328 v1 pith:3GPPIJ3Q submitted 2024-06-14 cs.CV cs.CLcs.LG

Vasu Singla , Kaiyu Yue , Sukriti Paul , Reza Shirkavand , Mayuka Jayawardhana , Alireza Ganjdanesh , Heng Huang , Abhinav Bhatele
show 2 more authors
Gowthami Somepalli Tom Goldstein
This is my paper
classification cs.CVcs.CLcs.LG
keywords datasetpixelprosevision-languagecaptionsdatasetsdescriptionsdetailedimage
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

Training large vision-language models requires extensive, high-quality image-text pairs. Existing web-scraped datasets, however, are noisy and lack detailed image descriptions. To bridge this gap, we introduce PixelProse, a comprehensive dataset of over 16M (million) synthetically generated captions, leveraging cutting-edge vision-language models for detailed and accurate descriptions. To ensure data integrity, we rigorously analyze our dataset for problematic content, including child sexual abuse material (CSAM), personally identifiable information (PII), and toxicity. We also provide valuable metadata such as watermark presence and aesthetic scores, aiding in further dataset filtering. We hope PixelProse will be a valuable resource for future vision-language research. PixelProse is available at https://huggingface.co/datasets/tomg-group-umd/pixelprose

Discussion (0). Sign in to comment.

Forward citations

Cited by 7 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. FLUX-Reason-6M & PRISM-Bench: A Million-Scale Text-to-Image Reasoning Dataset and Comprehensive Benchmark

    cs.CV 2025-09 conditional novelty 7.0 of 10

    The authors build a 6M-image, 20M-caption reasoning dataset with generation chain-of-thought and a 7-track VLM-judged benchmark, then rank 19 text-to-image models.

  2. MIDAL: A Dataset of Math Image Descriptions for Accessible Learning

    cs.CV 2026-08 unverdicted novelty 6.0 of 10

    MIDAL provides 2,020 described math images to train vision-language models for accessible math image descriptions and improved math reasoning.

  3. Transition Models: Rethinking the Generative Learning Objective

    cs.LG 2025-09 conditional novelty 6.0 of 10

    TiM trains a single diffusion-type model on arbitrary time-interval transitions, achieving strong one-step and multi-step text-to-image generation with 865M parameters.

  4. ROVI: A VLM-LLM Re-Captioned Dataset for Open-Vocabulary Instance-Grounded Text-to-Image Generation

    cs.CV 2025-08 conditional novelty 6.0 of 10

    ROVI's pre-detection VLM-LLM re-captioning yields richer open-vocabulary box labels on 1M curated images, and a GLIGEN model trained on ROVI improves instance grounding, prompt fidelity, and aesthetic quality in the p...

  5. MS-DPPs: Multi-Source Determinantal Point Processes for Contextual Diversity Refinement of Composite Attributes in Text to Image Retrieval

    cs.CV 2025-07 conditional novelty 6.0 of 10

    MS-DPP unifies several per-attribute DPPs into one re-ranking model via a Log-Euclidean mean of similarity matrices, and Tangent Normalization steers diversity toward user-chosen attribute weights.

  6. MoCa: Modality-aware Continual Pre-training Makes Better Bidirectional Multimodal Embeddings

    cs.CV 2025-06 conditional novelty 6.0 of 10

    A two-stage training recipe that converts causal VLMs into bidirectional multimodal embedding models, achieving SOTA on MMEB.

  7. Boogu-Image-0.1: Boosting Open Agentic Multimodal Generation via Understanding under a Minimal Budget

    cs.CV 2026-07 conditional novelty 4.0 of 10

    An open-source image-generation family shows that agentic prompt rewriting and a stronger text encoder can lift quality to near closed-source levels with only 208.62M images and about $400K of training compute.

Pith tools