HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

Multi-Mask Aggregators for Graph Neural Networks

{Ahmet Sureyya Rifaioglu Ahmet Sarıgün}

Multi-Mask Aggregators for Graph Neural Networks

Abstract

One of the most critical operations in graph neural networks (GNNs) is the aggregation operation, which aims to extract information from neighbors of the target node. Several convolution methods have been proposed such as standard graph convolution (GCN), graph attention (GAT), and message passing (MPNN). In this study, we propose an aggregation method called Multi-Mask Aggregators (MMA), where the model learns a weighted mask for each aggregator before collecting neighboring messages. MMA draws similarities with the GAT and MPNN but has some theoretical and practical advantages. Intuitively, our framework is not limited by the number of heads from GAT and has more discriminative than an MPNN. The performance of MMA was compared with the well-known baseline methods in both node classification and graph regression tasks on widely-used benchmarking datasets, and it has shown improved performance. Dataset and codes are available at https://github.com/asarigun/mma.

Benchmarks

BenchmarkMethodologyMetrics
graph-regression-on-zincMMA
MAE: 0.156
node-classification-on-citeseerMMA
Accuracy: 76.30%
node-classification-on-coraMMA
Accuracy: 85.80%
node-classification-on-pubmedMMA
Accuracy: 86.00%

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
Multi-Mask Aggregators for Graph Neural Networks | Papers | HyperAI