HyperAIHyperAI

Command Palette

Search for a command to run...

4 months ago

Self-Attention Graph Pooling

Junhyun Lee; Inyeop Lee; Jaewoo Kang

Self-Attention Graph Pooling

Abstract

Advanced methods of applying deep learning to structured data such as graphs have been proposed in recent years. In particular, studies have focused on generalizing convolutional neural networks to graph data, which includes redefining the convolution and the downsampling (pooling) operations for graphs. The method of generalizing the convolution operation to graphs has been proven to improve performance and is widely used. However, the method of applying downsampling to graphs is still difficult to perform and has room for improvement. In this paper, we propose a graph pooling method based on self-attention. Self-attention using graph convolution allows our pooling method to consider both node features and graph topology. To ensure a fair comparison, the same training procedures and model architectures were used for the existing pooling methods and our method. The experimental results demonstrate that our method achieves superior graph classification performance on the benchmark datasets using a reasonable number of parameters.

Code Repositories

Benchmarks

BenchmarkMethodologyMetrics
graph-classification-on-ddSAGPool_h
Accuracy: 76.45%
graph-classification-on-ddSAGPool_g
Accuracy: 76.19%
graph-classification-on-frankensteinSAGPool_g
Accuracy: 62.57
graph-classification-on-frankensteinSAGPool_h
Accuracy: 61.73
graph-classification-on-nci1SAGPool_g
Accuracy: 74.06%
graph-classification-on-nci1SAGPool_h
Accuracy: 67.45%
graph-classification-on-nci109SAGPool_h
Accuracy: 67.86
graph-classification-on-nci109SAGPool_g
Accuracy: 74.06
graph-classification-on-proteinsSAGPool_g
Accuracy: 70.04%
graph-classification-on-proteinsSAGPool_h
Accuracy: 71.86%

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
Self-Attention Graph Pooling | Papers | HyperAI