HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

Deep Graph Contrastive Representation Learning

Yanqiao Zhu Yichen Xu Feng Yu Qiang Liu Shu Wu Liang Wang

Deep Graph Contrastive Representation Learning

Abstract

Graph representation learning nowadays becomes fundamental in analyzing graph-structured data. Inspired by recent success of contrastive methods, in this paper, we propose a novel framework for unsupervised graph representation learning by leveraging a contrastive objective at the node level. Specifically, we generate two graph views by corruption and learn node representations by maximizing the agreement of node representations in these two views. To provide diverse node contexts for the contrastive objective, we propose a hybrid scheme for generating graph views on both structure and attribute levels. Besides, we provide theoretical justification behind our motivation from two perspectives, mutual information and the classical triplet loss. We perform empirical experiments on both transductive and inductive learning tasks using a variety of real-world datasets. Experimental experiments demonstrate that despite its simplicity, our proposed method consistently outperforms existing state-of-the-art methods by large margins. Moreover, our unsupervised method even surpasses its supervised counterparts on transductive tasks, demonstrating its great potential in real-world applications.

Code Repositories

CRIPAC-DIG/GRACE
Official
pytorch
Mentioned in GitHub
ycremar/DIG-SSL
pytorch
Mentioned in GitHub

Benchmarks

BenchmarkMethodologyMetrics
node-classification-on-citeseerGRACE
Accuracy: 72.1 ± 0.5
node-classification-on-coraGRACE
Accuracy: 83.3% ± 0.4%
node-classification-on-dblpGRACE
Accuracy: 84.2 ± 0.1
node-classification-on-ppiGRACE
F1: 66.2
Micro-F1: 66.2
node-classification-on-pubmedGRACE
Accuracy: 86.7 ± 0.1
node-classification-on-redditGRACE
Micro-F1: 94.2 ± 0.0

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
Deep Graph Contrastive Representation Learning | Papers | HyperAI