HyperAIHyperAI

Command Palette

Search for a command to run...

4 months ago

TRANX: A Transition-based Neural Abstract Syntax Parser for Semantic Parsing and Code Generation

Pengcheng Yin; Graham Neubig

TRANX: A Transition-based Neural Abstract Syntax Parser for Semantic Parsing and Code Generation

Abstract

We present TRANX, a transition-based neural semantic parser that maps natural language (NL) utterances into formal meaning representations (MRs). TRANX uses a transition system based on the abstract syntax description language for the target MR, which gives it two major advantages: (1) it is highly accurate, using information from the syntax of the target MR to constrain the output space and model the information flow, and (2) it is highly generalizable, and can easily be applied to new types of MR by just writing a new abstract syntax description corresponding to the allowable structures in the MR. Experiments on four different semantic parsing and code generation tasks show that our system is generalizable, extensible, and effective, registering strong results compared to existing neural semantic parsers.

Code Repositories

DeepLearnXMU/CG-RL
pytorch
Mentioned in GitHub
Pro-v-7/code-generation
pytorch
Mentioned in GitHub
yuxiang2/CoNaLa
pytorch
Mentioned in GitHub
pcyin/tranX
Official
pytorch
Mentioned in GitHub

Benchmarks

BenchmarkMethodologyMetrics
code-generation-on-conalaTranX
BLEU: 24.30
code-generation-on-conala-extTranX
BLEU: 18.85
code-generation-on-djangoTranx
Accuracy: 73.7
code-generation-on-wikisqlTranx
Exact Match Accuracy: 68.6
Execution Accuracy: 78.6
semantic-parsing-on-atisTranx
Accuracy: 86.2
semantic-parsing-on-geoTranx
Accuracy: 87.7

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
TRANX: A Transition-based Neural Abstract Syntax Parser for Semantic Parsing and Code Generation | Papers | HyperAI