HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

Frustratingly Easy System Combination for Grammatical Error Correction

{Hwee Tou Ng Seung-Hoon Na Muhammad Qorib}

Frustratingly Easy System Combination for Grammatical Error Correction

Abstract

In this paper, we formulate system combination for grammatical error correction (GEC) as a simple machine learning task: binary classification. We demonstrate that with the right problem formulation, a simple logistic regression algorithm can be highly effective for combining GEC models. Our method successfully increases the F0.5 score from the highest base GEC system by 4.2 points on the CoNLL-2014 test set and 7.2 points on the BEA-2019 test set. Furthermore, our method outperforms the state of the art by 4.0 points on the BEA-2019 test set, 1.2 points on the CoNLL-2014 test set with original annotation, and 3.4 points on the CoNLL-2014 test set with alternative annotation. We also show that our system combination generates better corrections with higher F0.5 scores than the conventional ensemble.

Benchmarks

BenchmarkMethodologyMetrics
grammatical-error-correction-on-bea-2019-testESC
F0.5: 79.90
grammatical-error-correction-on-conll-2014ESC
F0.5: 69.51
Precision: 81.48
Recall: 43.78

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
Frustratingly Easy System Combination for Grammatical Error Correction | Papers | HyperAI