HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

REBEL: Relation Extraction By End-to-end Language generation

{Roberto Navigli Pere-Lluis Huguet Cabot}

Abstract

Extracting relation triplets from raw text is a crucial task in Information Extraction, enabling multiple applications such as populating or validating knowledge bases, factchecking, and other downstream tasks. However, it usually involves multiple-step pipelines that propagate errors or are limited to a small number of relation types. To overcome these issues, we propose the use of autoregressive seq2seq models. Such models have previously been shown to perform well not only in language generation, but also in NLU tasks such as Entity Linking, thanks to their framing as seq2seq tasks.In this paper, we show how Relation Extraction can be simplified by expressing triplets as a sequence of text and we present REBEL, a seq2seq model based on BART that performs end-to-end relation extraction for more than 200 different relation types. We show our model's flexibility by fine-tuning it on an array of Relation Extraction and Relation Classification benchmarks, with it attaining state-of-the-art performance in most of them.

Benchmarks

BenchmarkMethodologyMetrics
joint-entity-and-relation-extraction-on-3REBEL
Relation F1: 41.8
joint-entity-and-relation-extraction-on-3REBEL+pretraining
Relation F1: 47.1
relation-extraction-on-ade-corpusREBEL (including overlapping entities)
RE+ Macro F1: 82.2
relation-extraction-on-conll04REBEL
RE+ Macro F1 : 76.65
RE+ Micro F1: 75.4
relation-extraction-on-nytREBEL (no pre-training)
F1: 93.1
relation-extraction-on-re-tacredREBEL (no entity type marker)
F1: 90.4

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp