HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

Multi-Partition Embedding Interaction with Block Term Format for Knowledge Graph Completion

Hung Nghiep Tran Atsuhiro Takasu

Multi-Partition Embedding Interaction with Block Term Format for Knowledge Graph Completion

Abstract

Knowledge graph completion is an important task that aims to predict the missing relational link between entities. Knowledge graph embedding methods perform this task by representing entities and relations as embedding vectors and modeling their interactions to compute the matching score of each triple. Previous work has usually treated each embedding as a whole and has modeled the interactions between these whole embeddings, potentially making the model excessively expensive or requiring specially designed interaction mechanisms. In this work, we propose the multi-partition embedding interaction (MEI) model with block term format to systematically address this problem. MEI divides each embedding into a multi-partition vector to efficiently restrict the interactions. Each local interaction is modeled with the Tucker tensor format and the full interaction is modeled with the block term tensor format, enabling MEI to control the trade-off between expressiveness and computational cost, learn the interaction mechanisms from data automatically, and achieve state-of-the-art performance on the link prediction task. In addition, we theoretically study the parameter efficiency problem and derive a simple empirically verified criterion for optimal parameter trade-off. We also apply the framework of MEI to provide a new generalized explanation for several specially designed interaction mechanisms in previous models. The source code is released at https://github.com/tranhungnghiep/MEI-KGE.

Code Repositories

tranhungnghiep/MEI-KGE
Official
pytorch
Mentioned in GitHub
tranhungnghiep/AnalyzeKGE
tf
Mentioned in GitHub

Benchmarks

BenchmarkMethodologyMetrics
link-prediction-on-fb15kMEI-BTD
Hits@1: 0.754
Hits@10: 0.893
Hits@3: 0.843
MRR: 0.806
link-prediction-on-fb15k-1MEI (small)
Hits@1: 0.757
Hits@10: 0.878
Hits@3: 0.823
MRR: 0.800
link-prediction-on-fb15k-237MEI
Hits@1: 0.271
Hits@10: 0.552
Hits@3: 0.402
MRR: 0.365
link-prediction-on-kg20cMEI (small)
Hits@1: 0.157
Hits@10: 0.368
Hits@3: 0.258
MRR: 0.230
link-prediction-on-wn18MEI-BTD
Hits@1: 0.946
Hits@10: 0.957
Hits@3: 0.952
MRR: 0.950
link-prediction-on-wn18MEI (small)
Hits@1: 0.946
Hits@10: 0.960
Hits@3: 0.953
MRR: 0.951
link-prediction-on-wn18rrMEI
Hits@1: 0.444
Hits@10: 0.551
Hits@3: 0.496
MRR: 0.481
link-prediction-on-yago3-10MEI
Hits@1: 0.505
Hits@10: 0.709
Hits@3: 0.622
MR: 756
MRR: 0.578

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
Multi-Partition Embedding Interaction with Block Term Format for Knowledge Graph Completion | Papers | HyperAI