HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

Content Enhanced BERT-based Text-to-SQL Generation

Tong Guo Huilin Gao

Content Enhanced BERT-based Text-to-SQL Generation

Abstract

We present a simple methods to leverage the table content for the BERT-based model to solve the text-to-SQL problem. Based on the observation that some of the table content match some words in question string and some of the table header also match some words in question string, we encode two addition feature vector for the deep model. Our methods also benefit the model inference in testing time as the tables are almost the same in training and testing time. We test our model on the WikiSQL dataset and outperform the BERT-based baseline by 3.7% in logic form and 3.7% in execution accuracy and achieve state-of-the-art.

Code Repositories

realsonalkumar/Mish-Mash-Hackathon
pytorch
Mentioned in GitHub
shivam017arora/Conversational-BI
pytorch
Mentioned in GitHub
guotong1988/NL2SQL-RULE
Official
pytorch
Mentioned in GitHub
guotong1988/NL2SQL-BERT
Official
pytorch
Mentioned in GitHub

Benchmarks

BenchmarkMethodologyMetrics
code-generation-on-wikisqlNL2SQL-RULE
Exact Match Accuracy: 83.7
Execution Accuracy: 89.2
semantic-parsing-on-wikisql-1NL2SQL-BERT
Accuracy: 89

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
Content Enhanced BERT-based Text-to-SQL Generation | Papers | HyperAI