HyperAIHyperAI

Command Palette

Search for a command to run...

4 months ago

Hierarchical Graph Representation Learning with Differentiable Pooling

Rex Ying; Jiaxuan You; Christopher Morris; Xiang Ren; William L. Hamilton; Jure Leskovec

Hierarchical Graph Representation Learning with Differentiable Pooling

Abstract

Recently, graph neural networks (GNNs) have revolutionized the field of graph representation learning through effectively learned node embeddings, and achieved state-of-the-art results in tasks such as node classification and link prediction. However, current GNN methods are inherently flat and do not learn hierarchical representations of graphs---a limitation that is especially problematic for the task of graph classification, where the goal is to predict the label associated with an entire graph. Here we propose DiffPool, a differentiable graph pooling module that can generate hierarchical representations of graphs and can be combined with various graph neural network architectures in an end-to-end fashion. DiffPool learns a differentiable soft cluster assignment for nodes at each layer of a deep GNN, mapping nodes to a set of clusters, which then form the coarsened input for the next GNN layer. Our experimental results show that combining existing GNN methods with DiffPool yields an average improvement of 5-10% accuracy on graph classification benchmarks, compared to all existing pooling approaches, achieving a new state-of-the-art on four out of five benchmark data sets.

Code Repositories

Tioz90/GCN
tf
Mentioned in GitHub
RexYing/graph-pooling
pytorch
Mentioned in GitHub
gospodima/extended-simgnn
pytorch
Mentioned in GitHub
Tioz90/DiffPool
tf
Mentioned in GitHub
basiralab/reproduciblefedgnn
pytorch
Mentioned in GitHub
VoVAllen/diffpool
pytorch
Mentioned in GitHub
PasqualeAuriemma/GCN-DIFFPOOL
tf
Mentioned in GitHub
RexYing/diffpool
pytorch
Mentioned in GitHub
basiralab/RG-Select
pytorch
Mentioned in GitHub
chappers/graph-differential-pooling
pytorch
Mentioned in GitHub
AaltoPML/Rethinking-pooling-in-GNNs
pytorch
Mentioned in GitHub

Benchmarks

BenchmarkMethodologyMetrics
graph-classification-on-collabGNN (DiffPool)
Accuracy: 75.48%
graph-classification-on-ddS2V (with 2 DiffPool)
Accuracy: 82.07%
graph-classification-on-ddGNN (DiffPool)
Accuracy: 80.64%
graph-classification-on-enzymesS2V (with 2 DiffPool)
Accuracy: 63.33%
graph-classification-on-enzymesGNN (DiffPool)
Accuracy: 62.53%
graph-classification-on-proteinsGNN (DiffPool)
Accuracy: 76.25%
graph-classification-on-reddit-multi-12kGNN (DiffPool)
Accuracy: 47.08
graph-property-prediction-on-ogbg-code2DiffPool w/ graphSAGE
Ext. data: No
Number of params: 10095826
Test F1 score: 0.1401 ± 0.0012
Validation F1 score: 0.1405 ± 0.0012

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
Hierarchical Graph Representation Learning with Differentiable Pooling | Papers | HyperAI