HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

Duality-Induced Regularizer for Tensor Factorization Based Knowledge Graph Completion

Zhanqiu Zhang Jianyu Cai Jie Wang

Duality-Induced Regularizer for Tensor Factorization Based Knowledge Graph Completion

Abstract

Tensor factorization based models have shown great power in knowledge graph completion (KGC). However, their performance usually suffers from the overfitting problem seriously. This motivates various regularizers -- such as the squared Frobenius norm and tensor nuclear norm regularizers -- while the limited applicability significantly limits their practical usage. To address this challenge, we propose a novel regularizer -- namely, DUality-induced RegulArizer (DURA) -- which is not only effective in improving the performance of existing models but widely applicable to various methods. The major novelty of DURA is based on the observation that, for an existing tensor factorization based KGC model (primal), there is often another distance based KGC model (dual) closely associated with it. Experiments show that DURA yields consistent and significant improvements on benchmarks.

Code Repositories

MIRALab-USTC/KGE-DURA
Official
pytorch
Mentioned in GitHub
miralab-ustc/qe-cone
pytorch
Mentioned in GitHub
MIRALab-USTC/KGE-HAKE
pytorch
Mentioned in GitHub

Benchmarks

BenchmarkMethodologyMetrics
link-prediction-on-fb15k-237ComplEx-DURA
Hits@1: 0.276
Hits@10: 0.560
MRR: 0.371
link-prediction-on-wn18rrCP-DURA
Hits@1: 0.441
Hits@10: 0.552
MRR: 0.478
link-prediction-on-wn18rrRESCAL-DURA
Hits@1: 0.455
Hits@10: 0.577
MRR: 0.498
link-prediction-on-wn18rrComplEx-DURA
Hits@1: 0.449
MRR: 0.491
link-prediction-on-yago3-10CP-DURA (large model)
Hits@1: 0.506
Hits@10: 0.709
MRR: 0.579
link-prediction-on-yago3-10ComplEx-DURA (large model)
Hits@1: 0.511
Hits@10: 0.713
MRR: 0.584

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
Duality-Induced Regularizer for Tensor Factorization Based Knowledge Graph Completion | Papers | HyperAI