HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

Rot-Pro: Modeling Transitivity by Projection in Knowledge Graph Embedding

Tengwei Song Jie Luo Lei Huang

Rot-Pro: Modeling Transitivity by Projection in Knowledge Graph Embedding

Abstract

Knowledge graph embedding models learn the representations of entities and relations in the knowledge graphs for predicting missing links (relations) between entities. Their effectiveness are deeply affected by the ability of modeling and inferring different relation patterns such as symmetry, asymmetry, inversion, composition and transitivity. Although existing models are already able to model many of these relations patterns, transitivity, a very common relation pattern, is still not been fully supported. In this paper, we first theoretically show that the transitive relations can be modeled with projections. We then propose the Rot-Pro model which combines the projection and relational rotation together. We prove that Rot-Pro can infer all the above relation patterns. Experimental results show that the proposed Rot-Pro model effectively learns the transitivity pattern and achieves the state-of-the-art results on the link prediction task in the datasets containing transitive relations.

Code Repositories

Tigter/ogblwikikg2-RotPro
pytorch
Mentioned in GitHub
tewiSong/Rot-Pro
Official
pytorch
Mentioned in GitHub

Benchmarks

BenchmarkMethodologyMetrics
link-prediction-on-fb15k-237Rot-Pro
Hits@1: 0.246
Hits@10: 0.540
Hits@3: 0.383
MRR: 0.344
link-prediction-on-wn18rrRot-Pro
Hits@1: 0.397
Hits@10: 0.577
Hits@3: 0.482
MRR: 0.457
link-prediction-on-yago3-10Rot-Pro
Hits@1: 0.443
Hits@10: 0.699
Hits@3: 0.596
MRR: 0.542
link-property-prediction-on-ogbl-wikikg2Rot-Pro
Ext. data: No
Number of params: 1000669602
Test MRR: 0.5602 ± 0.0016
Validation MRR: 0.5740 ± 0.0008
link-property-prediction-on-ogbl-wikikg2RotPro
Ext. data: No
Number of params: 1000669602
Test MRR: 0.4277 ± 0.0008
Validation MRR: 0.4174 ± 0.0058

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
Rot-Pro: Modeling Transitivity by Projection in Knowledge Graph Embedding | Papers | HyperAI