HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

DREEAM: Guiding Attention with Evidence for Improving Document-Level Relation Extraction

Youmi Ma An Wang Naoaki Okazaki

DREEAM: Guiding Attention with Evidence for Improving Document-Level Relation Extraction

Abstract

Document-level relation extraction (DocRE) is the task of identifying all relations between each entity pair in a document. Evidence, defined as sentences containing clues for the relationship between an entity pair, has been shown to help DocRE systems focus on relevant texts, thus improving relation extraction. However, evidence retrieval (ER) in DocRE faces two major issues: high memory consumption and limited availability of annotations. This work aims at addressing these issues to improve the usage of ER in DocRE. First, we propose DREEAM, a memory-efficient approach that adopts evidence information as the supervisory signal, thereby guiding the attention modules of the DocRE system to assign high weights to evidence. Second, we propose a self-training strategy for DREEAM to learn ER from automatically-generated evidence on massive data without evidence annotations. Experimental results reveal that our approach exhibits state-of-the-art performance on the DocRED benchmark for both DocRE and ER. To the best of our knowledge, DREEAM is the first approach to employ ER self-training.

Code Repositories

youmima/dreeam
Official
pytorch

Benchmarks

BenchmarkMethodologyMetrics
relation-extraction-on-docredDREEAM
F1: 67.53
Ign F1: 65.47
relation-extraction-on-redocredDREEAM
F1: 80.73
Ign F1: 79.66

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
DREEAM: Guiding Attention with Evidence for Improving Document-Level Relation Extraction | Papers | HyperAI