HyperAIHyperAI

Command Palette

Search for a command to run...

5 months ago

Complex Query Answering with Neural Link Predictors

Erik Arakelyan; Daniel Daza; Pasquale Minervini; Michael Cochez

Complex Query Answering with Neural Link Predictors

Abstract

Neural link predictors are immensely useful for identifying missing edges in large scale Knowledge Graphs. However, it is still not clear how to use these models for answering more complex queries that arise in a number of domains, such as queries using logical conjunctions ($\land$), disjunctions ($\lor$) and existential quantifiers ($\exists$), while accounting for missing edges. In this work, we propose a framework for efficiently answering complex queries on incomplete Knowledge Graphs. We translate each query into an end-to-end differentiable objective, where the truth value of each atom is computed by a pre-trained neural link predictor. We then analyse two solutions to the optimisation problem, including gradient-based and combinatorial search. In our experiments, the proposed approach produces more accurate results than state-of-the-art methods -- black-box neural models trained on millions of generated queries -- without the need of training on a large and diverse set of complex queries. Using orders of magnitude less training data, we obtain relative improvements ranging from 8% up to 40% in Hits@3 across different knowledge graphs containing factual information. Finally, we demonstrate that it is possible to explain the outcome of our model in terms of the intermediate solutions identified for each of the complex query atoms. All our source code and datasets are available online, at https://github.com/uclnlp/cqd.

Code Repositories

dice-group/dice-embeddings
pytorch
Mentioned in GitHub
Blidge/KGReasoning
pytorch
Mentioned in GitHub
pminervini/kgreasoning
pytorch
Mentioned in GitHub
LHY-24/KG-Compilation
pytorch
Mentioned in GitHub
uclnlp/cqd
Official
pytorch

Benchmarks

BenchmarkMethodologyMetrics
complex-query-answering-on-fb15kCQD-CO
Hits@3 1p: 0.918
Hits@3 2i: 0.796
Hits@3 2p: 0.454
Hits@3 2u: 0.816
Hits@3 3i: 0.837
Hits@3 3p: 0.191
Hits@3 ip: 0.336
Hits@3 pi: 0.513
Hits@3 up: 0.319
complex-query-answering-on-fb15kCQD
MRR 1p: 0.892
MRR 2i: 0.771
MRR 2p: 0.653
MRR 2u: 0.723
MRR 3i: 0.806
MRR ip: 0.716
complex-query-answering-on-fb15kCQD-Beam
Hits@3 1p: 0.918
Hits@3 2i: 0.796
Hits@3 2p: 0.779
Hits@3 2u: 0.839
Hits@3 3i: 0.837
Hits@3 3p: 0.577
Hits@3 ip: 0.375
Hits@3 pi: 0.658
Hits@3 up: 0.345
complex-query-answering-on-fb15k-237CQD
MRR 3i: 0.486
complex-query-answering-on-fb15k-237CQD-CO
Hits@3 1p: 0.512
Hits@3 2i: 35.2
Hits@3 2p: 0.213
Hits@3 2u: 0.281
Hits@3 3i: 0.457
Hits@3 3p: 0.131
Hits@3 ip: 0.146
Hits@3 pi: 0.222
Hits@3 up: 0.132
complex-query-answering-on-fb15k-237CQD-Beam
Hits@3 1p: 0.512
Hits@3 2i: 0.352
Hits@3 2p: 0.288
Hits@3 2u: 0.284
Hits@3 3i: 0.457
Hits@3 3p: 0.221
Hits@3 ip: 0.129
Hits@3 pi: 0.249
Hits@3 up: 0.121
complex-query-answering-on-nell-995CQD
MRR 1p: 0.604
MRR 2i: 0.436
MRR ip: 0.256
complex-query-answering-on-nell995CQD-CO
Hits@3 1p: 0.667
Hits@3 2i: 0.410
Hits@3 2p: 0.265
Hits@3 2u: 0.531
Hits@3 3i: 0.529
Hits@3 3p: 0.220
Hits@3 ip: 0.196
Hits@3 pi: 0.302
Hits@3 up: 0.194
complex-query-answering-on-nell995CQD-Beam
Hits@3 2p: 0.350
Hits@3 3p: 0.288
Hits@3 ip: 0.171
Hits@3 pi: 0.277
Hits@3 up: 0.156

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
Complex Query Answering with Neural Link Predictors | Papers | HyperAI