HyperAIHyperAI

Command Palette

Search for a command to run...

4 months ago

Adversarial Ranking for Language Generation

Kevin Lin; Dianqi Li; Xiaodong He; Zhengyou Zhang; Ming-Ting Sun

Adversarial Ranking for Language Generation

Abstract

Generative adversarial networks (GANs) have great successes on synthesizing data. However, the existing GANs restrict the discriminator to be a binary classifier, and thus limit their learning capacity for tasks that need to synthesize output with rich structures such as natural language descriptions. In this paper, we propose a novel generative adversarial network, RankGAN, for generating high-quality language descriptions. Rather than training the discriminator to learn and assign absolute binary predicate for individual data sample, the proposed RankGAN is able to analyze and rank a collection of human-written and machine-written sentences by giving a reference group. By viewing a set of data samples collectively and evaluating their quality through relative ranking scores, the discriminator is able to make better assessment which in turn helps to learn a better generator. The proposed RankGAN is optimized through the policy gradient technique. Experimental results on multiple public datasets clearly demonstrate the effectiveness of the proposed approach.

Code Repositories

Benchmarks

BenchmarkMethodologyMetrics
text-generation-on-chinese-poemsRankGAN
BLEU-2: 0.812
text-generation-on-coco-captionsRankGAN
BLEU-2: 0.850
BLEU-3: 0.672
BLEU-4: 0.557
BLEU-5: 0.544
text-generation-on-emnlp2017-wmtRankGAN
BLEU-2: 0.778
BLEU-3: 0.478
BLEU-4: 0.411
BLEU-5: 0.463

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp