HyperAIHyperAI

Command Palette

Search for a command to run...

4 months ago

RotatE: Knowledge Graph Embedding by Relational Rotation in Complex Space

Zhiqing Sun; Zhi-Hong Deng; Jian-Yun Nie; Jian Tang

RotatE: Knowledge Graph Embedding by Relational Rotation in Complex Space

Abstract

We study the problem of learning representations of entities and relations in knowledge graphs for predicting missing links. The success of such a task heavily relies on the ability of modeling and inferring the patterns of (or between) the relations. In this paper, we present a new approach for knowledge graph embedding called RotatE, which is able to model and infer various relation patterns including: symmetry/antisymmetry, inversion, and composition. Specifically, the RotatE model defines each relation as a rotation from the source entity to the target entity in the complex vector space. In addition, we propose a novel self-adversarial negative sampling technique for efficiently and effectively training the RotatE model. Experimental results on multiple benchmark knowledge graphs show that the proposed RotatE model is not only scalable, but also able to infer and model various relation patterns and significantly outperform existing state-of-the-art models for link prediction.

Benchmarks

BenchmarkMethodologyMetrics
link-prediction-on-fb122RotatE
HITS@3: 70.8
Hits@10: 77.0
Hits@5: 73.57
MRR: 67.8
link-prediction-on-fb15kpRotatE
Hits@1: 0.750
Hits@10: 0.884
Hits@3: 0.829
MR: 43
MRR: 0.799
link-prediction-on-fb15kRotatE
Hits@1: 0.746
Hits@10: 0.884
Hits@3: 0.830
MR: 40
MRR: 0.797
link-prediction-on-fb15k-237pRotatE
Hits@1: 0.23
Hits@10: 0.524
Hits@3: 0.365
MR: 178
MRR: 0.328
link-prediction-on-fb15k-237RotatE
Hits@1: 0.241
Hits@10: 0.533
Hits@3: 0.375
MR: 177
MRR: 0.338
link-prediction-on-wn18pRotatE
Hits@1: 0.942
Hits@10: 0.957
Hits@3: 0.950
MR: 254
MRR: 0.947
link-prediction-on-wn18RotatE
Hits@1: 0.944
Hits@10: 0.959
Hits@3: 0.952
MR: 309
MRR: 0.949
link-prediction-on-wn18rrRotatE
Hits@1: 0.428
Hits@10: 0.571
Hits@3: 0.492
MR: 3340
MRR: 0.476
link-prediction-on-wn18rrpRotatE
Hits@1: 0.417
Hits@10: 0.552
Hits@3: 0.479
MR: 2923
MRR: 0.462
link-property-prediction-on-ogbl-biokgRotatE
Ext. data: No
Number of params: 187597000
Test MRR: 0.7989 ± 0.0004
Validation MRR: 0.7997 ± 0.0002
link-property-prediction-on-ogbl-wikikg2RotatE (50dim)
Ext. data: No
Number of params: 250087150
Test MRR: 0.2530 ± 0.0034
Validation MRR: 0.2250 ± 0.0035
link-property-prediction-on-ogbl-wikikg2RotatE (250dim)
Ext. data: No
Number of params: 1250435750
Test MRR: 0.4332 ± 0.0025
Validation MRR: 0.4353 ± 0.0028

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
RotatE: Knowledge Graph Embedding by Relational Rotation in Complex Space | Papers | HyperAI