HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

Simplifying Subgraph Representation Learning for Scalable Link Prediction

Paul Louis Shweta Ann Jacob Amirali Salehi-Abari

Simplifying Subgraph Representation Learning for Scalable Link Prediction

Abstract

Link prediction on graphs is a fundamental problem. Subgraph representation learning approaches (SGRLs), by transforming link prediction to graph classification on the subgraphs around the links, have achieved state-of-the-art performance in link prediction. However, SGRLs are computationally expensive, and not scalable to large-scale graphs due to expensive subgraph-level operations. To unlock the scalability of SGRLs, we propose a new class of SGRLs, that we call Scalable Simplified SGRL (S3GRL). Aimed at faster training and inference, S3GRL simplifies the message passing and aggregation operations in each link's subgraph. S3GRL, as a scalability framework, accommodates various subgraph sampling strategies and diffusion operators to emulate computationally-expensive SGRLs. We propose multiple instances of S3GRL and empirically study them on small to large-scale graphs. Our extensive experiments demonstrate that the proposed S3GRL models scale up SGRLs without significant performance compromise (even with considerable gains in some cases), while offering substantially lower computational footprints (e.g., multi-fold inference and training speedup).

Code Repositories

venomouscyanide/S3GRL_OGB
pytorch
Mentioned in GitHub
venomouscyanide/s3grl
Official
pytorch
Mentioned in GitHub
venomouscyanide/s3grl_ogb
Official
pytorch
Mentioned in GitHub

Benchmarks

BenchmarkMethodologyMetrics
link-property-prediction-on-ogbl-citation2S3GRL (PoS Plus)
Ext. data: No
Number of params: 142275001
Test MRR: 0.8814 ± 0.0008
Validation MRR: 0.8809 ± 0.0074
link-property-prediction-on-ogbl-collabS3GRL (PoS Plus)
Ext. data: No
Number of params: 5913025
Test Hits@50: 0.6683 ± 0.0030
Validation Hits@50: 0.9861 ± 0.0006
link-property-prediction-on-ogbl-ppaS3GRL (PoS Plus)
Ext. data: No
Number of params: 32270001
Test Hits@100: 0.4242 ± 0.0180
Validation Hits@100: 0.6512 ± 0.0109

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
Simplifying Subgraph Representation Learning for Scalable Link Prediction | Papers | HyperAI