HyperAIHyperAI

Command Palette

Search for a command to run...

4 months ago

Convolutional Neural Networks on Graphs with Fast Localized Spectral Filtering

Michaël Defferrard; Xavier Bresson; Pierre Vandergheynst

Convolutional Neural Networks on Graphs with Fast Localized Spectral Filtering

Abstract

In this work, we are interested in generalizing convolutional neural networks (CNNs) from low-dimensional regular grids, where image, video and speech are represented, to high-dimensional irregular domains, such as social networks, brain connectomes or words' embedding, represented by graphs. We present a formulation of CNNs in the context of spectral graph theory, which provides the necessary mathematical background and efficient numerical schemes to design fast localized convolutional filters on graphs. Importantly, the proposed technique offers the same linear computational complexity and constant learning complexity as classical CNNs, while being universal to any graph structure. Experiments on MNIST and 20NEWS demonstrate the ability of this novel deep learning system to learn local, stationary, and compositional features on graphs.

Code Repositories

mdeff/cnn_graph
Official
tf
Mentioned in GitHub
hazdzz/ChebyNet
pytorch
Mentioned in GitHub
ajbisberg/gcn
tf
Mentioned in GitHub
selmiss/gp-tlstgcn
pytorch
Mentioned in GitHub

Benchmarks

BenchmarkMethodologyMetrics
graph-property-prediction-on-ogbg-molpcbaChebNet
Ext. data: No
Number of params: 1475003
Test AP: 0.2306 ± 0.0016
Validation AP: 0.2372 ± 0.0018
node-classification-on-citeseerChebNet
Accuracy: 69.8%
node-classification-on-citeseer-05ChebyNet
Accuracy: 45.3%
node-classification-on-citeseer-1ChebyNet
Accuracy: 59.4%
node-classification-on-citeseer-with-publicChebyNet
Accuracy: 70.1%
node-classification-on-coraChebNet
Accuracy: 81.2%
node-classification-on-cora-05ChebyNet
Accuracy: 33.9%
node-classification-on-cora-1ChebyNet
Accuracy: 44.2%
node-classification-on-cora-3ChebyNet
Accuracy: 62.1%
node-classification-on-cora-with-public-splitChebyNet
Accuracy: 78.0%
node-classification-on-pubmedChebNet
Accuracy: 74.4%
node-classification-on-pubmed-003ChebyNet
Accuracy: 45.3%
node-classification-on-pubmed-005ChebyNet
Accuracy: 48.2%
node-classification-on-pubmed-01ChebyNet
Accuracy: 55.2%
node-classification-on-pubmed-with-publicChebyNet
Accuracy: 69.8%
skeleton-based-action-recognition-on-sbuChebyNet
Accuracy: 96.00%

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
Convolutional Neural Networks on Graphs with Fast Localized Spectral Filtering | Papers | HyperAI