HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

Rethinking Kernel Methods for Node Representation Learning on Graphs

Yu Tian Long Zhao Xi Peng Dimitris N. Metaxas

Rethinking Kernel Methods for Node Representation Learning on Graphs

Abstract

Graph kernels are kernel methods measuring graph similarity and serve as a standard tool for graph classification. However, the use of kernel methods for node classification, which is a related problem to graph representation learning, is still ill-posed and the state-of-the-art methods are heavily based on heuristics. Here, we present a novel theoretical kernel-based framework for node classification that can bridge the gap between these two representation learning problems on graphs. Our approach is motivated by graph kernel methodology but extended to learn the node representations capturing the structural information in a graph. We theoretically show that our formulation is as powerful as any positive semidefinite kernels. To efficiently learn the kernel, we propose a novel mechanism for node feature aggregation and a data-driven similarity metric employed during the training phase. More importantly, our framework is flexible and complementary to other graph-based deep learning models, e.g., Graph Convolutional Networks (GCNs). We empirically evaluate our approach on a number of standard node classification benchmarks, and demonstrate that our model sets the new state of the art.

Code Repositories

bluer555/KernelGCN
Official
pytorch
Mentioned in GitHub

Benchmarks

BenchmarkMethodologyMetrics
link-prediction-on-citeseerNode Feature Agg + Similarity Metric
AP: 91.8%
AUC: 90.9%
link-prediction-on-coraBANE
AP: 93.2%
AUC: 93.50%
link-prediction-on-pubmedNode Feature Agg + Similarity Metric
AP: 94.2%
AUC: 94.5%

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
Rethinking Kernel Methods for Node Representation Learning on Graphs | Papers | HyperAI