HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

Bridging the Gap Between Spectral and Spatial Domains in Graph Neural Networks

Muhammet Balcilar Guillaume Renton Pierre Heroux Benoit Gauzere Sebastien Adam Paul Honeine

Bridging the Gap Between Spectral and Spatial Domains in Graph Neural Networks

Abstract

This paper aims at revisiting Graph Convolutional Neural Networks by bridging the gap between spectral and spatial design of graph convolutions. We theoretically demonstrate some equivalence of the graph convolution process regardless it is designed in the spatial or the spectral domain. The obtained general framework allows to lead a spectral analysis of the most popular ConvGNNs, explaining their performance and showing their limits. Moreover, the proposed framework is used to design new convolutions in spectral domain with a custom frequency profile while applying them in the spatial domain. We also propose a generalization of the depthwise separable convolution framework for graph convolutional networks, what allows to decrease the total number of trainable parameters by keeping the capacity of the model. To the best of our knowledge, such a framework has never been used in the GNNs literature. Our proposals are evaluated on both transductive and inductive graph learning problems. Obtained results show the relevance of the proposed method and provide one of the first experimental evidence of transferability of spectral filter coefficients from one graph to another. Our source codes are publicly available at: https://github.com/balcilar/Spectral-Designed-Graph-Convolutions

Code Repositories

Benchmarks

BenchmarkMethodologyMetrics
graph-classification-on-enzymesDSGCN-allfeat
Accuracy: 78.39
graph-classification-on-enzymesDSGCN-nodelabel
Accuracy: 65.13
node-classification-on-citeseer-with-publicDSGCN
Accuracy: 73.3
node-classification-on-cora-fixed-20-node-perDSGCN
Accuracy: 84.2
node-classification-on-cora-with-public-splitDSGCN
Accuracy: 84.2%
node-classification-on-ppiDSGCN
F1: 99.09 ± 0.03
node-classification-on-pubmed-with-publicDSGCN
Accuracy: 81.9%

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
Bridging the Gap Between Spectral and Spatial Domains in Graph Neural Networks | Papers | HyperAI