HyperAIHyperAI

Command Palette

Search for a command to run...

5 months ago

BernNet: Learning Arbitrary Graph Spectral Filters via Bernstein Approximation

Mingguo He; Zhewei Wei; Zengfeng Huang; Hongteng Xu

BernNet: Learning Arbitrary Graph Spectral Filters via Bernstein Approximation

Abstract

Many representative graph neural networks, e.g., GPR-GNN and ChebNet, approximate graph convolutions with graph spectral filters. However, existing work either applies predefined filter weights or learns them without necessary constraints, which may lead to oversimplified or ill-posed filters. To overcome these issues, we propose BernNet, a novel graph neural network with theoretical support that provides a simple but effective scheme for designing and learning arbitrary graph spectral filters. In particular, for any filter over the normalized Laplacian spectrum of a graph, our BernNet estimates it by an order-$K$ Bernstein polynomial approximation and designs its spectral property by setting the coefficients of the Bernstein basis. Moreover, we can learn the coefficients (and the corresponding filter weights) based on observed graphs and their associated signals and thus achieve the BernNet specialized for the data. Our experiments demonstrate that BernNet can learn arbitrary spectral filters, including complicated band-rejection and comb filters, and it achieves superior performance in real-world graph modeling tasks. Code is available at https://github.com/ivam-he/BernNet.

Code Repositories

ivam-he/BernNet
Official
pytorch
Mentioned in GitHub

Benchmarks

BenchmarkMethodologyMetrics
node-classification-on-chameleon-60-20-20BernNet
1:1 Accuracy: 68.29 ± 1.58
node-classification-on-citeseer-60-20-20BernNet
1:1 Accuracy: 80.09 ± 0.79
node-classification-on-cora-60-20-20-randomBernNet
1:1 Accuracy: 88.52 ± 0.95
node-classification-on-cornell-60-20-20BernNet
1:1 Accuracy: 92.13 ± 1.64
node-classification-on-film-60-20-20-randomBernNet
1:1 Accuracy: 41.79 ± 1.01
node-classification-on-non-homophilicBernNet
1:1 Accuracy: 92.13 ± 1.64
node-classification-on-non-homophilic-2BernNet
1:1 Accuracy: 93.12 ± 0.65
node-classification-on-non-homophilic-4BernNet
1:1 Accuracy: 68.29 ± 1.58
node-classification-on-pubmed-60-20-20-randomBernNet
1:1 Accuracy: 88.48 ± 0.41
node-classification-on-squirrel-60-20-20BernNet
1:1 Accuracy: 51.35 ± 0.73
node-classification-on-texas-60-20-20-randomBernNet
1:1 Accuracy: 93.12 ± 0.65

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
BernNet: Learning Arbitrary Graph Spectral Filters via Bernstein Approximation | Papers | HyperAI