HyperAIHyperAI

Command Palette

Search for a command to run...

4 months ago

Complex Embeddings for Simple Link Prediction

Théo Trouillon; Johannes Welbl; Sebastian Riedel; Éric Gaussier; Guillaume Bouchard

Complex Embeddings for Simple Link Prediction

Abstract

In statistical relational learning, the link prediction problem is key to automatically understand the structure of large knowledge bases. As in previous studies, we propose to solve this problem through latent factorization. However, here we make use of complex valued embeddings. The composition of complex embeddings can handle a large variety of binary relations, among them symmetric and antisymmetric relations. Compared to state-of-the-art models such as Neural Tensor Network and Holographic Embeddings, our approach based on complex embeddings is arguably simpler, as it only uses the Hermitian dot product, the complex counterpart of the standard dot product between real vectors. Our approach is scalable to large datasets as it remains linear in both space and time, while consistently outperforming alternative approaches on standard link prediction benchmarks.

Benchmarks

BenchmarkMethodologyMetrics
link-prediction-on-fb122ComplEx
HITS@3: 67.3
Hits@10: 71.9
Hits@5: 69.5
MRR: 64.1
link-prediction-on-fb15k-237ComplEx
Hits@10: 0.428
link-prediction-on-umlsComplEx
Hits@10: 0.967
MR: 2.59
link-prediction-on-wn18ComplEx
Hits@1: 0.936
Hits@10: 0.947
Hits@3: 0.936
MRR: 0.941
link-prediction-on-wn18rrComplEx
Hits@1: 0.410
Hits@10: 0.510
MRR: 0.440
link-property-prediction-on-ogbl-biokgComplEx
Ext. data: No
Number of params: 187648000
Test MRR: 0.8095 ± 0.0007
Validation MRR: 0.8105 ± 0.0001
link-property-prediction-on-ogbl-wikikg2ComplEx (50dim)
Ext. data: No
Number of params: 250113900
Test MRR: 0.3804 ± 0.0022
Validation MRR: 0.3534 ± 0.0052
link-property-prediction-on-ogbl-wikikg2ComplEx (250dim)
Ext. data: No
Number of params: 1250569500
Test MRR: 0.4027 ± 0.0027
Validation MRR: 0.3759 ± 0.0016

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
Complex Embeddings for Simple Link Prediction | Papers | HyperAI