HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

Automatic Annotation Augmentation Boosts Translation between Molecules and Natural Language

Zhiqiang Zhong Simon Sataa-Yu Larsen Haoyu Guo Tao Tang Kuangyu Zhou Davide Mottin

Automatic Annotation Augmentation Boosts Translation between Molecules and Natural Language

Abstract

Recent advancements in AI for biological research focus on integrating molecular data with natural language to accelerate drug discovery. However, the scarcity of high-quality annotations limits progress in this area. This paper introduces LA$^3$, a Language-based Automatic Annotation Augmentation framework that leverages large language models to augment existing datasets, thereby improving AI training. We demonstrate the effectiveness of LA$^3$ by creating an enhanced dataset, LaChEBI-20, where we systematically rewrite the annotations of molecules from an established dataset. These rewritten annotations preserve essential molecular information while providing more varied sentence structures and vocabulary. Using LaChEBI-20, we train LaMolT5 based on a benchmark architecture to learn the mapping between molecular representations and augmented annotations. Experimental results on text-based de novo molecule generation and molecule captioning demonstrate that LaMolT5 outperforms state-of-the-art models. Notably, incorporating LA$^3$ leads to improvements of up to 301% over the benchmark architecture. Furthermore, we validate the effectiveness of LA$^3$ notable applications in image, text and graph tasks, affirming its versatility and utility.

Code Repositories

Benchmarks

BenchmarkMethodologyMetrics
molecule-captioning-on-chebi-20LaMolT5-Large
BLEU-2: 60.2
BLEU-4: 52.1
METEOR: 63.4
ROUGE-1: 65.5
ROUGE-2: 51.2
ROUGE-L: 59.8
Text2Mol: 59.7
molecule-captioning-on-chebi-20LaMolT5-Base
BLEU-2: 57.4
BLEU-4: 48.5
METEOR: 59.6
ROUGE-1: 63.4
ROUGE-2: 47.8
ROUGE-L: 56.4
Text2Mol: 59.9
molecule-captioning-on-chebi-20LaMolT5-Small
BLEU-2: 53.9
BLEU-4: 44.6
METEOR: 56.6
ROUGE-1: 62.0
ROUGE-2: 46.9
ROUGE-L: 56.3
Text2Mol: 58.8

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
Automatic Annotation Augmentation Boosts Translation between Molecules and Natural Language | Papers | HyperAI