Pith. sign in

REVIEW 5 cited by

Glyph-ByT5-v2: A Strong Aesthetic Baseline for Accurate Multilingual Visual Text Rendering

Not yet reviewed by Pith; the record is open.

Re-run · record.json Download PDF Read on arXiv ↗

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2406.10208 v2 pith:EVHWQXUF submitted 2024-06-14 cs.CV

Zeyu Liu , Weicong Liang , Yiming Zhao , Bohan Chen , Lin Liang , Lijuan Wang , Ji Li , Yuhui Yuan This is my paper
classification cs.CV
keywords visualmultilingualtextaccurateaestheticgraphicrenderingdesign
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

Recently, Glyph-ByT5 has achieved highly accurate visual text rendering performance in graphic design images. However, it still focuses solely on English and performs relatively poorly in terms of visual appeal. In this work, we address these two fundamental limitations by presenting Glyph-ByT5-v2 and Glyph-SDXL-v2, which not only support accurate visual text rendering for 10 different languages but also achieve much better aesthetic quality. To achieve this, we make the following contributions: (i) creating a high-quality multilingual glyph-text and graphic design dataset consisting of more than 1 million glyph-text pairs and 10 million graphic design image-text pairs covering nine other languages, (ii) building a multilingual visual paragraph benchmark consisting of 1,000 prompts, with 100 for each language, to assess multilingual visual spelling accuracy, and (iii) leveraging the latest step-aware preference learning approach to enhance the visual aesthetic quality. With the combination of these techniques, we deliver a powerful customized multilingual text encoder, Glyph-ByT5-v2, and a strong aesthetic graphic generation model, Glyph-SDXL-v2, that can support accurate spelling in 10 different languages. We perceive our work as a significant advancement, considering that the latest DALL-E3 and Ideogram 1.0 still struggle with the multilingual visual text rendering task.

Discussion (0). Sign in to comment.

Forward citations

Cited by 5 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. WeEdit: A Dataset, Benchmark and Glyph-Guided Framework for Text-centric Image Editing

    cs.CV 2026-03 conditional novelty 7.0 of 10

    WeEdit trains a glyph-guided, RL-optimized image editor on a 330K-pair synthetic multilingual dataset and reports open-source SOTA on its own bilingual and multilingual text-editing benchmarks.

  2. Rethinking Layered Graphic Design Generation with a Top-Down Approach

    cs.CV 2025-07 conditional novelty 6.0 of 10

    Accordion decomposes AI-generated raster designs into editable background, object, and vectorized text layers using a VLM-driven top-down planning pipeline.

  3. UniGlyph: Unified Segmentation-Conditioned Diffusion for Precise Visual Text Synthesis

    cs.CV 2025-07 conditional novelty 6.0 of 10

    UniGlyph replaces pre-rendered glyph conditions with segmentation-derived masks in a ControlNet diffusion model, reporting gains on visual text rendering benchmarks.

  4. WordCon: Word-level Typography Control in Scene Text Rendering

    cs.CV 2025-06 conditional novelty 5.0 of 10

    WordCon uses grounding-model masks and two extra losses to fine-tune Flux so that typography can be controlled word by word.

  5. PosterCraft: Rethinking High-Quality Aesthetic Poster Generation in a Unified Framework

    cs.CV 2025-06 conditional novelty 5.0 of 10

    PosterCraft improves text-to-poster generation by cascading four stages of training (text rendering, region-weighted fine-tuning, preference optimization, and vision-language feedback), outperforming open-source basel...

Pith tools