HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

CLASS: Enhancing Cross-Modal Text-Molecule Retrieval Performance and Training Efficiency

Hongyan Wu Peijian Zeng Weixiong Zheng Lianxi Wang Nankai Lin Shengyi Jiang Aimin Yang

CLASS: Enhancing Cross-Modal Text-Molecule Retrieval Performance and Training Efficiency

Abstract

Cross-modal text-molecule retrieval task bridges molecule structures and natural language descriptions. Existing methods predominantly focus on aligning text modality and molecule modality, yet they overlook adaptively adjusting the learning states at different training stages and enhancing training efficiency. To tackle these challenges, this paper proposes a Curriculum Learning-bAsed croSS-modal text-molecule training framework (CLASS), which can be integrated with any backbone to yield promising performance improvement. Specifically, we quantify the sample difficulty considering both text modality and molecule modality, and design a sample scheduler to introduce training samples via an easy-to-difficult paradigm as the training advances, remarkably reducing the scale of training samples at the early stage of training and improving training efficiency. Moreover, we introduce adaptive intensity learning to increase the training intensity as the training progresses, which adaptively controls the learning intensity across all curriculum stages. Experimental results on the ChEBI-20 dataset demonstrate that our proposed method gains superior performance, simultaneously achieving prominent time savings.

Benchmarks

BenchmarkMethodologyMetrics
cross-modal-retrieval-on-chebi-20CLASS (ORMA)
Hits@1: 67.4
Hits@10: 93.4
Mean Rank: 17.82
Test MRR: 77.4
cross-modal-retrieval-on-chebi-20CLASS (AMAN)
Hits@1: 51.1
Hits@10: 92.6
Mean Rank: 16.80
Test MRR: 66.0

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
CLASS: Enhancing Cross-Modal Text-Molecule Retrieval Performance and Training Efficiency | Papers | HyperAI