HyperAIHyperAI

Command Palette

Search for a command to run...

4 months ago

Entity-Relation Extraction as Multi-Turn Question Answering

Xiaoya Li; Fan Yin; Zijun Sun; Xiayu Li; Arianna Yuan; Duo Chai; Mingxin Zhou; Jiwei Li

Entity-Relation Extraction as Multi-Turn Question Answering

Abstract

In this paper, we propose a new paradigm for the task of entity-relation extraction. We cast the task as a multi-turn question answering problem, i.e., the extraction of entities and relations is transformed to the task of identifying answer spans from the context. This multi-turn QA formalization comes with several key advantages: firstly, the question query encodes important information for the entity/relation class we want to identify; secondly, QA provides a natural way of jointly modeling entity and relation; and thirdly, it allows us to exploit the well developed machine reading comprehension (MRC) models. Experiments on the ACE and the CoNLL04 corpora demonstrate that the proposed paradigm significantly outperforms previous best models. We are able to obtain the state-of-the-art results on all of the ACE04, ACE05 and CoNLL04 datasets, increasing the SOTA results on the three datasets to 49.4 (+1.0), 60.2 (+0.6) and 68.9 (+2.1), respectively. Additionally, we construct a newly developed dataset RESUME in Chinese, which requires multi-step reasoning to construct entity dependencies, as opposed to the single-step dependency extraction in the triplet exaction in previous datasets. The proposed multi-turn QA model also achieves the best performance on the RESUME dataset.

Code Repositories

Benchmarks

BenchmarkMethodologyMetrics
relation-extraction-on-ace-2004Multi-turn QA
Cross Sentence: No
NER Micro F1: 83.6
RE+ Micro F1: 49.4
relation-extraction-on-ace-2005Multi-turn QA
Cross Sentence: No
NER Micro F1: 84.8
RE+ Micro F1: 60.2
Sentence Encoder: BERT base
relation-extraction-on-conll04Multi-turn QA
NER Micro F1: 87.8
RE+ Micro F1: 68.9

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
Entity-Relation Extraction as Multi-Turn Question Answering | Papers | HyperAI