HyperAIHyperAI

Command Palette

Search for a command to run...

5 months ago

CopyMTL: Copy Mechanism for Joint Extraction of Entities and Relations with Multi-Task Learning

Daojian Zeng; Ranran Haoran Zhang; Qianying Liu

CopyMTL: Copy Mechanism for Joint Extraction of Entities and Relations with Multi-Task Learning

Abstract

Joint extraction of entities and relations has received significant attention due to its potential of providing higher performance for both tasks. Among existing methods, CopyRE is effective and novel, which uses a sequence-to-sequence framework and copy mechanism to directly generate the relation triplets. However, it suffers from two fatal problems. The model is extremely weak at differing the head and tail entity, resulting in inaccurate entity extraction. It also cannot predict multi-token entities (e.g. \textit{Steven Jobs}). To address these problems, we give a detailed analysis of the reasons behind the inaccurate entity extraction problem, and then propose a simple but extremely effective model structure to solve this problem. In addition, we propose a multi-task learning framework equipped with copy mechanism, called CopyMTL, to allow the model to predict multi-token entities. Experiments reveal the problems of CopyRE and show that our model achieves significant improvement over the current state-of-the-art method by 9% in NYT and 16% in WebNLG (F1 score). Our code is available at https://github.com/WindChimeRan/CopyMTL

Code Repositories

WindChimeRan/CopyMTL
Official
pytorch
Mentioned in GitHub
WindChimeRan/OpenJERE
pytorch
Mentioned in GitHub

Benchmarks

BenchmarkMethodologyMetrics
relation-extraction-on-webnlgCopyRE' OneDecoder
F1: 60.5

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
CopyMTL: Copy Mechanism for Joint Extraction of Entities and Relations with Multi-Task Learning | Papers | HyperAI