Pith. sign in

REVIEW 6 cited by

WebCode2M: A Real-World Dataset for Code Generation from Webpage Designs

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2404.06369 v2 pith:F73WK2TR submitted 2024-04-09 cs.CV cs.AIcs.SE

WebCode2M: A Real-World Dataset for Code Generation from Webpage Designs

classification cs.CV cs.AIcs.SE
keywords codedatasetwebpagewebcode2mdesignsgenerationmllmsreal-world
verification ladder T0 review T1 audit T2 compute T3 formal T4 reserved
0 comments
Share X Bluesky LinkedIn Reddit HN
read the original abstract

Automatically generating webpage code from webpage designs can significantly reduce the workload of front-end developers, and recent Multimodal Large Language Models (MLLMs) have shown promising potential in this area. However, our investigation reveals that most existing MLLMs are constrained by the absence of high-quality, large-scale, real-world datasets, resulting in inadequate performance in automated webpage code generation. To fill this gap, this paper introduces WebCode2M, a new dataset comprising 2.56 million instances, each containing a design image along with the corresponding webpage code and layout details. Sourced from real-world web resources, WebCode2M offers a rich and valuable dataset for webpage code generation across a variety of applications. The dataset quality is ensured by a scoring model that filters out instances with aesthetic deficiencies or other incomplete elements. To validate the effectiveness of WebCode2M, we introduce a baseline model based on the Vision Transformer (ViT), named WebCoder, and establish a benchmark for fair comparison. Additionally, we introduce a new metric, TreeBLEU, to measure the structural hierarchy recall. The benchmarking results demonstrate that our dataset significantly improves the ability of MLLMs to generate code from webpage designs, confirming its effectiveness and usability for future applications in front-end design tools. Finally, we highlight several practical challenges introduced by our dataset, calling for further research. The code and dataset are publicly available at our project homepage: https://webcode2m.github.io.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 6 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. Pattern over Pixels: Measuring Pattern Completion Bias in Multimodal Code Generation

    cs.SE 2026-08 conditional novelty 6.0

    On a new 1,440-screenshot fill-in-the-blank benchmark, five frontier multimodal models default to repeated UI patterns instead of visual deviations, with mean bias rates from 69.8% on card widths to 80.2% on font sizes.

  2. Video2Code: Generating Interactive Webpages from UI Videos via Action-Aware Revisit

    cs.CV 2026-06 unverdicted novelty 6.0

    Video2Code adds action-aware temporal clipping to video-language models to better recover executable state transitions when turning UI videos into HTML/CSS/JS code.

  3. Self-Distillation Policy Optimization via Visual Feedback: Bridging Code and Visual Artifacts

    cs.AI 2026-06 unverdicted novelty 6.0

    Visual-SDPO distills visual feedback from rendered code outputs into a student policy via grounded credit weighting and GRPO, yielding over 10-point gains on chart/UI/slide benchmarks.

  4. Porting Declarative UI to HarmonyOS: A Heuristic-guided LLM Approach

    cs.SE 2026-06 unverdicted novelty 6.0

    ArkTrans achieves up to 90.67% compilable ArkUI translations from KJC/SwiftUI using heuristic LLM guidance and empirical post-fixing rules, versus 0% for direct or one-shot prompting on a 100-sample benchmark.

  5. WebCoderBench: Benchmarking Web Application Generation with Comprehensive and Interpretable Evaluation Metrics

    cs.SE 2026-01 conditional novelty 6.0

    A benchmark of 1,572 real user web-app requests with 24 rule-based and LLM-judge metrics shows no single model currently dominates web app generation.

  6. Reverse Browser: Vector-Image-to-Code Generator

    cs.SE 2025-09 conditional novelty 5.0

    An open-weights system that turns vector images of web designs into HTML/CSS, with new datasets and a multi-scale pixel metric, though accuracy remains below production quality.