HyperAIHyperAI

Command Palette

Search for a command to run...

4 months ago

Mutual Information Maximization in Graph Neural Networks

Xinhan Di; Pengqian Yu; Rui Bu; Mingchao Sun

Mutual Information Maximization in Graph Neural Networks

Abstract

A variety of graph neural networks (GNNs) frameworks for representation learning on graphs have been recently developed. These frameworks rely on aggregation and iteration scheme to learn the representation of nodes. However, information between nodes is inevitably lost in the scheme during learning. In order to reduce the loss, we extend the GNNs frameworks by exploring the aggregation and iteration scheme in the methodology of mutual information. We propose a new approach of enlarging the normal neighborhood in the aggregation of GNNs, which aims at maximizing mutual information. Based on a series of experiments conducted on several benchmark datasets, we show that the proposed approach improves the state-of-the-art performance for four types of graph tasks, including supervised and semi-supervised graph classification, graph link prediction and graph edge generation and classification.

Benchmarks

BenchmarkMethodologyMetrics
graph-classification-on-20newssKNN-LDS
Accuracy: 47.9
graph-classification-on-cancersKNN-LDS
Accuracy: 95.7
graph-classification-on-citeseersKNN-LDS
Accuracy: 73.7
graph-classification-on-collabsGIN
Accuracy: 80.71%
graph-classification-on-corasKNN-LDS
Accuracy: 72.3
graph-classification-on-digitssKNN-LDS
Accuracy: 92.5
graph-classification-on-imdb-bsGIN
Accuracy: 77.94%
graph-classification-on-imdb-msGIN
Accuracy: 54.52%
graph-classification-on-mutagsGIN
Accuracy: 94.14%
graph-classification-on-nci1sGIN
Accuracy: 83.85%
graph-classification-on-proteinssGIN
Accuracy: 78.97%
graph-classification-on-ptcsGIN
Accuracy: 73.56%
graph-classification-on-winesKNN-LDS
Accuracy: 98
link-prediction-on-pubmedsGraphite-VAE
AP: 96.3%
AUC: 94.8%

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
Mutual Information Maximization in Graph Neural Networks | Papers | HyperAI