HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

Sign is Not a Remedy: Multiset-to-Multiset Message Passing for Learning on Heterophilic Graphs

Langzhang Liang Sunwoo Kim Kijung Shin Zenglin Xu Shirui Pan Yuan Qi

Sign is Not a Remedy: Multiset-to-Multiset Message Passing for Learning on Heterophilic Graphs

Abstract

Graph Neural Networks (GNNs) have gained significant attention as a powerful modeling and inference method, especially for homophilic graph-structured data. To empower GNNs in heterophilic graphs, where adjacent nodes exhibit dissimilar labels or features, Signed Message Passing (SMP) has been widely adopted. However, there is a lack of theoretical and empirical analysis regarding the limitations of SMP. In this work, we unveil some potential pitfalls of SMP and their remedies. We first identify two limitations of SMP: undesirable representation update for multi-hop neighbors and vulnerability against oversmoothing issues. To overcome these challenges, we propose a novel message passing function called Multiset to Multiset GNN(M2M-GNN). Our theoretical analyses and extensive experiments demonstrate that M2M-GNN effectively alleviates the aforementioned limitations of SMP, yielding superior performance in comparison

Code Repositories

Jinx-byebye/m2mgnn
Official
pytorch

Benchmarks

BenchmarkMethodologyMetrics
node-classification-on-actorM2M-GNN
Accuracy: 36.72 ± 1.6
node-classification-on-chameleonM2M-GNN
Accuracy: 75.20 ± 2.3
node-classification-on-cornellM2M-GNN
Accuracy: 86.48 ± 6.1
node-classification-on-squirrelM2M-GNN
Accuracy: 63.60 ± 1.7
node-classification-on-texasM2M-GNN
Accuracy: 89.19 ± 4.5
node-classification-on-wisconsinM2M-GNN
Accuracy: 89.01 ± 4.1

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
Sign is Not a Remedy: Multiset-to-Multiset Message Passing for Learning on Heterophilic Graphs | Papers | HyperAI