HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

Summarization as Indirect Supervision for Relation Extraction

Keming Lu I-Hung Hsu Wenxuan Zhou Mingyu Derek Ma Muhao Chen

Summarization as Indirect Supervision for Relation Extraction

Abstract

Relation extraction (RE) models have been challenged by their reliance on training data with expensive annotations. Considering that summarization tasks aim at acquiring concise expressions of synoptical information from the longer context, these tasks naturally align with the objective of RE, i.e., extracting a kind of synoptical information that describes the relation of entity mentions. We present SuRE, which converts RE into a summarization formulation. SuRE leads to more precise and resource-efficient RE based on indirect supervision from summarization tasks. To achieve this goal, we develop sentence and relation conversion techniques that essentially bridge the formulation of summarization and RE tasks. We also incorporate constraint decoding techniques with Trie scoring to further enhance summarization-based RE with robust inference. Experiments on three RE datasets demonstrate the effectiveness of SuRE in both full-dataset and low-resource settings, showing that summarization is a promising source of indirect supervision to improve RE models.

Code Repositories

luka-group/sure
Official
pytorch
Mentioned in GitHub

Benchmarks

BenchmarkMethodologyMetrics
relation-extraction-on-tacredSuRE (PEGASUS-large)
F1: 75.1
F1 (1% Few-Shot): 52
F1 (10% Few-Shot): 70.7
F1 (5% Few-Shot): 64.9
F1 (Zero-Shot): 20.6

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
Summarization as Indirect Supervision for Relation Extraction | Papers | HyperAI