HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

Circle Feature Graphormer: Can Circle Features Stimulate Graph Transformer?

Jingsong Lv Hongyang Chen Yao Qi Lei Yu

Circle Feature Graphormer: Can Circle Features Stimulate Graph Transformer?

Abstract

In this paper, we introduce two local graph features for missing link prediction tasks on ogbl-citation2. We define the features as Circle Features, which are borrowed from the concept of circle of friends. We propose the detailed computing formulas for the above features. Firstly, we define the first circle feature as modified swing for common graph, which comes from bipartite graph. Secondly, we define the second circle feature as bridge, which indicates the importance of two nodes for different circle of friends. In addition, we firstly propose the above features as bias to enhance graph transformer neural network, such that graph self-attention mechanism can be improved. We implement a Circled Feature aware Graph transformer (CFG) model based on SIEG network, which utilizes a double tower structure to capture both global and local structure features. Experimental results show that CFG achieves the state-of-the-art performance on dataset ogbl-citation2.

Code Repositories

jingsonglv/CFG
pytorch
Mentioned in GitHub

Benchmarks

BenchmarkMethodologyMetrics
link-property-prediction-on-ogbl-citation2CFG
Ext. data: No
Number of params: 686253
Test MRR: 0.8997 ± 0.0015
Validation MRR: 0.8987 ± 0.0011

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
Circle Feature Graphormer: Can Circle Features Stimulate Graph Transformer? | Papers | HyperAI