HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

Pre-train and Learn: Preserve Global Information for Graph Neural Networks

Danhao Zhu Xin-yu Dai Jiajun Chen

Pre-train and Learn: Preserve Global Information for Graph Neural Networks

Abstract

Graph neural networks (GNNs) have shown great power in learning on attributed graphs. However, it is still a challenge for GNNs to utilize information faraway from the source node. Moreover, general GNNs require graph attributes as input, so they cannot be appled to plain graphs. In the paper, we propose new models named G-GNNs (Global information for GNNs) to address the above limitations. First, the global structure and attribute features for each node are obtained via unsupervised pre-training, which preserve the global information associated to the node. Then, using the global features and the raw network attributes, we propose a parallel framework of GNNs to learn different aspects from these features. The proposed learning methods can be applied to both plain graphs and attributed graphs. Extensive experiments have shown that G-GNNs can outperform other state-of-the-art models on three standard evaluation graphs. Specially, our methods establish new benchmark records on Cora (84.31\%) and Pubmed (80.95\%) when learning on attributed graphs.

Code Repositories

zhudanhao/g-gnn
Official
pytorch

Benchmarks

BenchmarkMethodologyMetrics
node-classification-on-citeseer-with-publicG-APPNP
Accuracy: 72%
node-classification-on-cora-with-public-splitG-APPNP
Accuracy: 84.31%
node-classification-on-pubmed-with-publicG-APPNP
Accuracy: 80.95%

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
Pre-train and Learn: Preserve Global Information for Graph Neural Networks | Papers | HyperAI