HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

PairRE: Knowledge Graph Embeddings via Paired Relation Vectors

Linlin Chao Jianshan He Taifeng Wang Wei Chu

PairRE: Knowledge Graph Embeddings via Paired Relation Vectors

Abstract

Distance based knowledge graph embedding methods show promising results on link prediction task, on which two topics have been widely studied: one is the ability to handle complex relations, such as N-to-1, 1-to-N and N-to-N, the other is to encode various relation patterns, such as symmetry/antisymmetry. However, the existing methods fail to solve these two problems at the same time, which leads to unsatisfactory results. To mitigate this problem, we propose PairRE, a model with paired vectors for each relation representation. The paired vectors enable an adaptive adjustment of the margin in loss function to fit for complex relations. Besides, PairRE is capable of encoding three important relation patterns, symmetry/antisymmetry, inverse and composition. Given simple constraints on relation representations, PairRE can encode subrelation further. Experiments on link prediction benchmarks demonstrate the proposed key capabilities of PairRE. Moreover, We set a new state-of-the-art on two knowledge graph datasets of the challenging Open Graph Benchmark.

Benchmarks

BenchmarkMethodologyMetrics
link-property-prediction-on-ogbl-biokgPairRE
Ext. data: No
Number of params: 187750000
Test MRR: 0.8164 ± 0.0005
Validation MRR: 0.8172 ± 0.0005
link-property-prediction-on-ogbl-wikikg2PairRE (200dim)
Ext. data: No
Number of params: 500334800
Test MRR: 0.5208 ± 0.0027
Validation MRR: 0.5423 ± 0.0020

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
PairRE: Knowledge Graph Embeddings via Paired Relation Vectors | Papers | HyperAI