LiveCodeBench-CPP

LiveCodeBench-CPP is a C++ code generation evaluation dataset released by NVIDIA in 2025, designed to provide a benchmark for evaluating large language models' code generation and debugging capabilities based on the latest programming problems.

The dataset contains 454 programming problems, primarily sourced from AtCoder (287 problems) and LeetCode (167 problems), covering competitions and problems from October 2024 to May 2025. The data includes problem descriptions, platform sources, difficulty levels, test cases, and related metadata, primarily used to evaluate models' code generation and problem-solving abilities in real programming tasks.

Dataset Composition

• question_title: Title of the programming problem.
• question_content: Problem description.
• platform: Source platform of the problem, including AtCoder and LeetCode.
• question_id: Unique identifier of the problem.
• contest_id: Unique identifier of the contest.
• contest_date: Date of the contest.
• starter_code: Code template or function signature.
• difficulty: Difficulty level of the problem.
• public_test_cases: Public test cases.
• private_test_cases: Private test cases.
• metadata: Metadata related to the problem.