HyperAIHyperAI

Command Palette

Search for a command to run...

5 months ago

ReFinED: An Efficient Zero-shot-capable Approach to End-to-End Entity Linking

Tom Ayoola; Shubhi Tyagi; Joseph Fisher; Christos Christodoulopoulos; Andrea Pierleoni

ReFinED: An Efficient Zero-shot-capable Approach to End-to-End Entity Linking

Abstract

We introduce ReFinED, an efficient end-to-end entity linking model which uses fine-grained entity types and entity descriptions to perform linking. The model performs mention detection, fine-grained entity typing, and entity disambiguation for all mentions within a document in a single forward pass, making it more than 60 times faster than competitive existing approaches. ReFinED also surpasses state-of-the-art performance on standard entity linking datasets by an average of 3.7 F1. The model is capable of generalising to large-scale knowledge bases such as Wikidata (which has 15 times more entities than Wikipedia) and of zero-shot entity linking. The combination of speed, accuracy and scale makes ReFinED an effective and cost-efficient system for extracting entities from web-scale datasets, for which the model has been successfully deployed. Our code and pre-trained models are available at https://github.com/alexa/ReFinED

Code Repositories

amazon-science/ReFinED
pytorch
Mentioned in GitHub
alexa/refined
Official
pytorch
Mentioned in GitHub
amazon-research/ReFinED
Official
pytorch
Mentioned in GitHub

Benchmarks

BenchmarkMethodologyMetrics
entity-disambiguation-on-ace2004ReFinED
Micro-F1: 91.6
entity-disambiguation-on-aida-conllReFinED
In-KB Accuracy: 93.9
entity-disambiguation-on-aquaintReFinED
Micro-F1: 91.8
entity-disambiguation-on-msnbcReFinED
Micro-F1: 94.4
entity-disambiguation-on-wned-cwebReFinED
Micro-F1: 79.4
entity-disambiguation-on-wned-wikiReFinED
Micro-F1: 88.7
entity-linking-on-aida-conllReFinED
Micro-F1 strong: 84.0
entity-linking-on-derczynski-1ReFinED
Micro-F1: 50.7
Micro-F1 strong: 50.7
entity-linking-on-kore50ReFinED
Micro-F1: 65.9
Micro-F1 strong: 64.7
entity-linking-on-msnbc-1ReFinED
Micro-F1: 71.8
Micro-F1 strong: 71.8
entity-linking-on-n3-reuters-128-1ReFinED
Micro-F1: 58.1
Micro-F1 strong: 58.1
entity-linking-on-oke-2015-1ReFinED
Micro-F1: 65.0
Micro-F1 strong: 64.4
entity-linking-on-oke-2016-1ReFinED
Micro-F1: 59.5
Micro-F1 strong: 59.1
entity-linking-on-webqsp-wdReFinED
F1: 89.1
entity-typing-on-aida-conllReFinED
Micro-F1: 84.0

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
ReFinED: An Efficient Zero-shot-capable Approach to End-to-End Entity Linking | Papers | HyperAI