REVIEW 8 cited by
Empowering LLMs to Understand and Generate Complex Vector Graphics
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
The unprecedented advancements in Large Language Models (LLMs) have profoundly impacted natural language processing but have yet to fully embrace the realm of scalable vector graphics (SVG) generation. While LLMs encode partial knowledge of SVG data from web pages during training, recent findings suggest that semantically ambiguous and tokenized representations within LLMs may result in hallucinations in vector primitive predictions. Additionally, LLM training typically lacks modeling and understanding of the rendering sequence of vector paths, which can lead to occlusion between output vector primitives. In this paper, we present LLM4SVG, an initial yet substantial step toward bridging this gap by enabling LLMs to better understand and generate vector graphics. LLM4SVG facilitates a deeper understanding of SVG components through learnable semantic tokens, which precisely encode these tokens and their corresponding properties to generate semantically aligned SVG outputs. Using a series of learnable semantic tokens, a structured dataset for instruction following is developed to support comprehension and generation across two primary tasks. Our method introduces a modular architecture to existing large language models, integrating semantic tags, vector instruction encoders, fine-tuned commands, and powerful LLMs to tightly combine geometric, appearance, and language information. To overcome the scarcity of SVG-text instruction data, we developed an automated data generation pipeline that collected our SVGX-SFT Dataset, consisting of high-quality human-designed SVGs and 580k SVG instruction following data specifically crafted for LLM training, which facilitated the adoption of the supervised fine-tuning strategy popular in LLM development.
Forward citations
Cited by 8 Pith papers
-
SVGEval: A Vision-Grounded Framework for Perceptual-Quality Benchmarking and Evaluation in Text-to-SVG Generation
SVGEval benchmarks and trains an explainable multimodal scorer for perceptual quality of text-to-SVG generation, showing a consistent gap on spatial and structural judgments.
-
GVR-Coder: A Visual-Feedback Framework for Structured SVG Generation in Complex Document and Meeting Scenarios
A curriculum-plus-RL-plus-repair SVG agent, trained on a new 100K office-diagram dataset, beats strong LLM baselines on layout-correct logical diagrams from long professional text.
-
Vector-Bench: Can Models Surgically Edit SVG Code?
Only 2.35% of 1,360 model outputs pass Vector-Bench's three-gate SVG repair-and-preserve reward, and the best endpoint passes 15.0% despite 43.7% mean repair progress.
-
SVGen: Interpretable Vector Graphics Generation with Large Language Models
SVGen fine-tunes 3B to 7B LLMs with curriculum learning, chain-of-thought, and GRPO reinforcement to generate SVG icons from text, reporting better in-distribution quality than larger models.
-
SVGenius: Benchmarking LLMs in SVG Understanding, Editing and Generation
SVGenius benchmarks 22 LLMs on 2,377 SVG tasks across understanding, editing, and generation, finding universal degradation with complexity.
-
ViewCraft3D: High-Fidelity and View-Consistent 3D Vector Graphics Synthesis
A two-stage method that fits 3D Bézier curves to a reconstructed mesh and refines them with a 3D diffusion prior, producing view-consistent 3D vector graphics from a single image in about 30 minutes.
-
LayerTracer: Cognitive-Aligned Layered SVG Synthesis via Diffusion Transformer
A diffusion transformer trained on SVG construction sequences generates and vectorizes layered SVG graphics, breaking creation into editable steps.
-
SlideCoder: Layout-aware RAG-enhanced Hierarchical Slide Generation from Design
SlideCoder converts slide design images to editable python-pptx code and reports large gains over prior baselines on a new difficulty-tiered benchmark.
Discussion (0). Continue with ORCID to comment.