HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

VL-Cogito: Progressive Curriculum Reinforcement Learning for Advanced Multimodal Reasoning

VL-Cogito: Progressive Curriculum Reinforcement Learning for Advanced
  Multimodal Reasoning

Abstract

Reinforcement learning has proven its effectiveness in enhancing thereasoning capabilities of large language models. Recent research efforts haveprogressively extended this paradigm to multimodal reasoning tasks. Due to theinherent complexity and diversity of multimodal tasks, especially in semanticcontent and problem formulations, existing models often exhibit unstableperformance across various domains and difficulty levels. To address theselimitations, we propose VL-Cogito, an advanced multimodal reasoning modeltrained via a novel multi-stage Progressive Curriculum Reinforcement Learning(PCuRL) framework. PCuRL systematically guides the model through tasks ofgradually increasing difficulty, substantially improving its reasoningabilities across diverse multimodal contexts. The framework introduces two keyinnovations: (1) an online difficulty soft weighting mechanism, dynamicallyadjusting training difficulty across successive RL training stages; and (2) adynamic length reward mechanism, which encourages the model to adaptivelyregulate its reasoning path length according to task complexity, thus balancingreasoning efficiency with correctness. Experimental evaluations demonstratethat VL-Cogito consistently matches or surpasses existing reasoning-orientedmodels across mainstream multimodal benchmarks spanning mathematics, science,logic, and general understanding, validating the effectiveness of our approach.

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
VL-Cogito: Progressive Curriculum Reinforcement Learning for Advanced Multimodal Reasoning | Papers | HyperAI