HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

SIGN: Scalable Inception Graph Neural Networks

Fabrizio Frasca Emanuele Rossi Davide Eynard Ben Chamberlain Michael Bronstein Federico Monti

SIGN: Scalable Inception Graph Neural Networks

Abstract

Graph representation learning has recently been applied to a broad spectrum of problems ranging from computer graphics and chemistry to high energy physics and social media. The popularity of graph neural networks has sparked interest, both in academia and in industry, in developing methods that scale to very large graphs such as Facebook or Twitter social networks. In most of these approaches, the computational cost is alleviated by a sampling strategy retaining a subset of node neighbors or subgraphs at training time. In this paper we propose a new, efficient and scalable graph deep learning architecture which sidesteps the need for graph sampling by using graph convolutional filters of different size that are amenable to efficient precomputation, allowing extremely fast training and inference. Our architecture allows using different local graph operators (e.g. motif-induced adjacency matrices or Personalized Page Rank diffusion matrix) to best suit the task at hand. We conduct extensive experimental evaluation on various open benchmarks and show that our approach is competitive with other state-of-the-art architectures, while requiring a fraction of the training and inference time. Moreover, we obtain state-of-the-art results on ogbn-papers100M, the largest public graph dataset, with over 110 million nodes and 1.5 billion edges.

Code Repositories

Benchmarks

BenchmarkMethodologyMetrics
node-classification-on-amz-compSIGN
Accuracy: 85.93 ± 1.21
node-classification-on-amz-photoSIGN
Accuracy: 91.72 ± 1.20
node-classification-on-coauthor-csSIGN
Accuracy: 91.98 ± 0.50
node-classification-on-ppiSIGN
F1: 96.50
node-classification-on-redditSIGN
Accuracy: 96.60%

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
SIGN: Scalable Inception Graph Neural Networks | Papers | HyperAI