pith. machine review for the scientific record. sign in

arxiv: 1705.07962 · v2 · submitted 2017-05-22 · 💻 cs.LG · cs.AI· cs.CL· cs.CV· cs.NE

Recognition: unknown

pix2code: Generating Code from a Graphical User Interface Screenshot

Tony Beltramelli
Authors on Pith no claims yet
classification 💻 cs.LG cs.AIcs.CLcs.CVcs.NE
keywords codegraphicalinterfacescreenshotuseraccuracyandroidapplications
0
0 comments X
read the original abstract

Transforming a graphical user interface screenshot created by a designer into computer code is a typical task conducted by a developer in order to build customized software, websites, and mobile applications. In this paper, we show that deep learning methods can be leveraged to train a model end-to-end to automatically generate code from a single input image with over 77% of accuracy for three different platforms (i.e. iOS, Android and web-based technologies).

This paper has not been read by Pith yet.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 2 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. PlayCoder: Making LLM-Generated GUI Code Playable

    cs.SE 2026-04 conditional novelty 7.0

    PlayCoder raises the rate of LLM-generated GUI apps that can be played end-to-end without logic errors from near zero to 20.3% Play@3 by adding repository-aware generation, agent-driven testing, and iterative repair.

  2. ShapeCodeBench: A Renewable Benchmark for Perception-to-Program Reconstruction of Synthetic Shape Scenes

    cs.CV 2026-05 accept novelty 6.0

    ShapeCodeBench introduces a renewable benchmark for perception-to-program reconstruction of synthetic shapes, with evaluations showing low exact-match performance from current models and heuristics.