VCBench is a benchmark dataset for evaluating multimodal mathematical reasoning with explicit visual dependencies, released by Alibaba and Zhejiang University in 2025. The dataset contains 1,720 question-answer pairs and a total of 6,697 images. The questions mainly include the following 6 areas:

• Time and Calendar: Tests temporal reasoning questions across two subcategories (Calendar and Clock), requiring an understanding of time intervals and calendar-based calculations.
• Space and Position: Challenges focus on spatial reasoning in three subcategories (direction, position, and place) to assess understanding of relative position, direction, and spatial relationships.
• Geometry and Shapes: Questions covering five subcategories (angles, quadrilaterals, rectangles, shapes, and triangles) test basic geometric understanding from basic shape recognition to more complex property analysis.
• Objects and Motion: Tasks in two subcategories (Cube and Move) that assess understanding of three-dimensional objects and motion transformations.
• Reasoning and Observation: Questions in both subcategories (Inference and Observation) are designed to test logical reasoning and careful visual observation skills.
• Organization and Patterns: Challenges across three subcategories (Organization, Pattern, and Weight), assessing pattern recognition, sequencing, and organizational logic.

  

Citation

@misc{wong2025vcbench
author    = {Zhikai Wang and Jiashuo Sun and Wenqi Zhang and Zhiqiang Hu and Xin Li and Fan Wang and Deli Zhao},
title     = {Benchmarking Multimodal Mathematical Reasoning with Explicit Visual Dependency},
year      = {2025},
eprint    = {2504.18589},
archivePrefix = {arxiv},
primaryClass  = {cs.CV},
url       = {https://arxiv.org/abs/2504.18589}
}