HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

Towards Better Graph Representation Learning with Parameterized Decomposition & Filtering

Mingqi Yang Wenjie Feng Yanming Shen Bryan Hooi

Towards Better Graph Representation Learning with Parameterized Decomposition & Filtering

Abstract

Proposing an effective and flexible matrix to represent a graph is a fundamental challenge that has been explored from multiple perspectives, e.g., filtering in Graph Fourier Transforms. In this work, we develop a novel and general framework which unifies many existing GNN models from the view of parameterized decomposition and filtering, and show how it helps to enhance the flexibility of GNNs while alleviating the smoothness and amplification issues of existing models. Essentially, we show that the extensively studied spectral graph convolutions with learnable polynomial filters are constrained variants of this formulation, and releasing these constraints enables our model to express the desired decomposition and filtering simultaneously. Based on this generalized framework, we develop models that are simple in implementation but achieve significant improvements and computational efficiency on a variety of graph learning tasks. Code is available at https://github.com/qslim/PDF.

Code Repositories

qslim/PDF
pytorch
Mentioned in GitHub
qslim/pdf
Official
pytorch
Mentioned in GitHub

Benchmarks

BenchmarkMethodologyMetrics
graph-property-prediction-on-ogbg-molpcbaPDF
Ext. data: No
Number of params: 3842048
Test AP: 0.3031 ± 0.0026
Validation AP: 0.3115 ± 0.0020
graph-regression-on-zincPDF
MAE: 0.066 ± 0.002
graph-regression-on-zinc-500kPDF
MAE: 0.066

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
Towards Better Graph Representation Learning with Parameterized Decomposition & Filtering | Papers | HyperAI