HyperAIHyperAI

Command Palette

Search for a command to run...

5 months ago

Predict then Propagate: Graph Neural Networks meet Personalized PageRank

Johannes Gasteiger; Aleksandar Bojchevski; Stephan Günnemann

Predict then Propagate: Graph Neural Networks meet Personalized PageRank

Abstract

Neural message passing algorithms for semi-supervised classification on graphs have recently achieved great success. However, for classifying a node these methods only consider nodes that are a few propagation steps away and the size of this utilized neighborhood is hard to extend. In this paper, we use the relationship between graph convolutional networks (GCN) and PageRank to derive an improved propagation scheme based on personalized PageRank. We utilize this propagation procedure to construct a simple model, personalized propagation of neural predictions (PPNP), and its fast approximation, APPNP. Our model's training time is on par or faster and its number of parameters on par or lower than previous models. It leverages a large, adjustable neighborhood for classification and can be easily combined with any neural network. We show that this model outperforms several recently proposed methods for semi-supervised classification in the most thorough study done so far for GCN-like models. Our implementation is available online.

Benchmarks

BenchmarkMethodologyMetrics
node-classification-on-chameleon-60-20-20APPNP
1:1 Accuracy: 51.91 ± 0.56
node-classification-on-citeseerPPNP
Accuracy: 75.83%
Validation: YES
node-classification-on-citeseerAPPNP
Accuracy: 75.73%
node-classification-on-citeseer-60-20-20APPNP
1:1 Accuracy: 68.59 ± 0.30
node-classification-on-coraPPNP
Accuracy: 85.29% ± 0.25%
Validation: YES
node-classification-on-coraAPPNP
Accuracy: 85.09% ± 0.25%
Validation: YES
node-classification-on-cora-60-20-20-randomAPPNP
1:1 Accuracy: 79.41 ± 0.38
node-classification-on-cornell-60-20-20APPNP
1:1 Accuracy: 91.80 ± 0.63
node-classification-on-film-60-20-20-randomAPPNP
1:1 Accuracy: 38.86 ± 0.24
node-classification-on-geniusAPPNP
Accuracy: 85.36 ± 0.62
node-classification-on-ms-academicAPPNP
Accuracy: 93.27 ± 0.08
node-classification-on-non-homophilicAPPNP
1:1 Accuracy: 91.80 ± 0.63
node-classification-on-non-homophilic-1APPNP
1:1 Accuracy: 92.00 ± 3.59
node-classification-on-non-homophilic-13APPNP
1:1 Accuracy: 74.33 ± 0.38
node-classification-on-non-homophilic-14APPNP
1:1 Accuracy: 85.36 ± 0.62
node-classification-on-non-homophilic-15APPNP
1:1 Accuracy: 60.97 ± 0.10
node-classification-on-non-homophilic-2APPNP
1:1 Accuracy: 91.18 ± 0.70
node-classification-on-non-homophilic-4APPNP
1:1 Accuracy: 51.91 ± 0.56
node-classification-on-non-homophilic-6APPNP
1:1 Accuracy: 67.21±0.56
node-classification-on-penn94APPNP
Accuracy: 74.33 ± 0.38
node-classification-on-pubmedAPPNP
Accuracy: 79.73 ± 0.31
Validation: YES
node-classification-on-pubmed-60-20-20-randomAPPNP
1:1 Accuracy: 85.02 ± 0.09
node-classification-on-squirrel-60-20-20APPNP
1:1 Accuracy: 34.77 ± 0.34
node-classification-on-texas-60-20-20-randomAPPNP
1:1 Accuracy: 91.18 ± 0.70
node-classification-on-wisconsin-60-20-20APPNP
1:1 Accuracy: 92.00 ± 3.59

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
Predict then Propagate: Graph Neural Networks meet Personalized PageRank | Papers | HyperAI