Command Palette
Search for a command to run...
Integrating convolutional layers and biformer network with forward-forward and backpropagation training
{Zahra Asgari Parvin Razzaghi Ali Kianfar}

Abstract
Accurate molecular property prediction is crucial for drug discovery and computational chemistry, facilitating the identification of promising compounds and accelerating therapeutic development. Traditional machine learning falters with high-dimensional data and manual feature engineering, while existing deep learning approaches may not capture complex molecular structures, leaving a research gap. We introduce Deep-CBN, a novel framework designed to enhance molecular property prediction by capturing intricate molecular representations directly from raw data, thus improving accuracy and efficiency. Our methodology combines convolutional neural networks (CNNs) with a BiFormer attention mechanism, employing both the forward-forward algorithm and backpropagation. The model operates in three stages: (1) feature learning, extracting local features from SMILES strings using CNNs; (2) attention refinement, capturing global context with a BiFormer module enhanced by the forward-forward algorithm; and (3) prediction subnetwork tuning, fine-tuning via backpropagation. Evaluations on benchmark datasets—including Tox21, BBBP, SIDER, ClinTox, BACE, HIV, and MUV—show that Deep-CBN achieves near-perfect ROC-AUC scores, significantly outperforming state-of-the-art methods. These findings demonstrate its effectiveness in capturing complex molecular patterns, offering a robust tool to accelerate drug discovery processes.
Benchmarks
| Benchmark | Methodology | Metrics |
|---|---|---|
| molecular-property-prediction-on-bace-1 | Deep-CBN | ROC-AUC: 83.6 |
| molecular-property-prediction-on-bbbp-1 | Deep-CBN | ROC-AUC: 75.8 |
| molecular-property-prediction-on-clintox-1 | Deep-CBN | ROC-AUC: 99.2 |
| molecular-property-prediction-on-hiv-1 | Deep-CBN | ROC-AUC: 97.3 |
| molecular-property-prediction-on-muv-1 | Deep-CBN | ROC-AUC: 99.8 |
| molecular-property-prediction-on-sider-1 | Deep-CBN | ROC-AUC: 78.2 |
| molecular-property-prediction-on-tox21-1 | Deep-CBN | ROC-AUC: 92.4 |
Build AI with AI
From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.