HyperAIHyperAI

Command Palette

Search for a command to run...

5 months ago

pix2code: Generating Code from a Graphical User Interface Screenshot

Tony Beltramelli

pix2code: Generating Code from a Graphical User Interface Screenshot

Abstract

Transforming a graphical user interface screenshot created by a designer into computer code is a typical task conducted by a developer in order to build customized software, websites, and mobile applications. In this paper, we show that deep learning methods can be leveraged to train a model end-to-end to automatically generate code from a single input image with over 77% of accuracy for three different platforms (i.e. iOS, Android and web-based technologies).

Code Repositories

ZvezdocheTag/variable-ui
Mentioned in GitHub
pranayanand123/Design2Code
Mentioned in GitHub
tonybeltramelli/pix2code
Official
Mentioned in GitHub
badaro48/documents
Mentioned in GitHub
RAHUL-KESHERVANI/my_pix2code
Mentioned in GitHub
kevinleewy/pytorch_pix2code
pytorch
Mentioned in GitHub
sruthisripathi/ui2c
Mentioned in GitHub
dashweta/MachineLearningPython
tf
Mentioned in GitHub

Benchmarks

BenchmarkMethodologyMetrics
class-level-code-generation-on-reside-testset-
F1 (Hidden Test Set): 159.84

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
pix2code: Generating Code from a Graphical User Interface Screenshot | Papers | HyperAI