HyperAIHyperAI

Command Palette

Search for a command to run...

5 months ago

Fact-based Text Editing

Hayate Iso; Chao Qiao; Hang Li

Fact-based Text Editing

Abstract

We propose a novel text editing task, referred to as \textit{fact-based text editing}, in which the goal is to revise a given document to better describe the facts in a knowledge base (e.g., several triples). The task is important in practice because reflecting the truth is a common requirement in text editing. First, we propose a method for automatically generating a dataset for research on fact-based text editing, where each instance consists of a draft text, a revised text, and several facts represented in triples. We apply the method into two public table-to-text datasets, obtaining two new datasets consisting of 233k and 37k instances, respectively. Next, we propose a new neural network architecture for fact-based text editing, called \textsc{FactEditor}, which edits a draft text by referring to given facts using a buffer, a stream, and a memory. A straightforward approach to address the problem would be to employ an encoder-decoder model. Our experimental results on the two datasets show that \textsc{FactEditor} outperforms the encoder-decoder approach in terms of fidelity and fluency. The results also show that \textsc{FactEditor} conducts inference faster than the encoder-decoder approach.

Code Repositories

isomap/factedit
Official
pytorch

Benchmarks

BenchmarkMethodologyMetrics
fact-based-text-editing-on-rotoeditFactEditor
ADD: 41.5
BLEU: 84.43
DELETE: 84.24
Exact Match: 2.65
F1: 63.39
KEEP: 98.41
Precision: 78.84
Recall: 52.3
SARI: 74.72
fact-based-text-editing-on-webeditTable-to-Text
ADD: 27.86
BLEU: 33.75
DELETE: 0.5219
Exact Match: 5.78
F1: 90.4
KEEP: 0.5144
Precision: 98.23
Recall: 83.72
SARI: 43.83
fact-based-text-editing-on-webeditNo-Editing
ADD: 3.91
BLEU: 66.67
DELETE: 0.1202
Exact Match: 0
F1: 80.21
KEEP: 0.7862
Precision: 84.49
Recall: 76.34
SARI: 31.51
fact-based-text-editing-on-webeditText-to-Text
ADD: 25.77
BLEU: 63.61
DELETE: 0.678
Exact Match: 6.22
F1: 79.48
KEEP: 0.8262
Precision: 81.93
Recall: 77.16
SARI: 58.73
fact-based-text-editing-on-webeditFactEditor
ADD: 47.69
BLEU: 75.68
DELETE: 0.7707
Exact Match: 24.8
F1: 93.17
KEEP: 0.9184
Precision: 96.88
Recall: 89.74
SARI: 72.2
fact-based-text-editing-on-webeditEncDecEditor
ADD: 43.82
BLEU: 71.03
DELETE: 0.7548
Exact Match: 20.96
F1: 92.51
KEEP: 0.8949
Precision: 98.06
Recall: 87.56
SARI: 69.59

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
Fact-based Text Editing | Papers | HyperAI