HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

Optimizing Statistical Machine Translation for Text Simplification

{Chris Callison-Burch Wei Xu Quanze Chen Ellie Pavlick Courtney Napoles}

Optimizing Statistical Machine Translation for Text Simplification

Abstract

Most recent sentence simplification systems use basic machine translation models to learn lexical and syntactic paraphrases from a manually simplified parallel corpus. These methods are limited by the quality and quantity of manually simplified corpora, which are expensive to build. In this paper, we conduct an in-depth adaptation of statistical machine translation to perform text simplification, taking advantage of large-scale paraphrases learned from bilingual texts and a small amount of manual simplifications with multiple references. Our work is the first to design automatic metrics that are effective for tuning and evaluating simplification systems, which will facilitate iterative development for this task.

Benchmarks

BenchmarkMethodologyMetrics
text-simplification-on-turkcorpusSBMT-SARI
BLEU: 73.08*
SARI (EASSEu003e=0.2.1): 39.56

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
Optimizing Statistical Machine Translation for Text Simplification | Papers | HyperAI