The NaturalReasoning dataset is a large-scale, high-quality reasoning dataset released by Facebook in 2025.NaturalReasoning: Reasoning in the Wild with 2.8M Challenging Questions". It contains 2.8 million challenging questions covering multiple fields such as STEM fields (e.g., physics, computer science), economics, social sciences, etc. The dataset aims to generate diverse and challenging reasoning questions and their reference answers by leveraging pre-trained corpora and large language models (LLMs) without the need for additional human annotations.

Citation

@misc{yuan2025naturalreasoningreasoningwild28m,
title={NaturalReasoning: Reasoning in the Wild with 2.8M Challenging Questions},
author={Weizhe Yuan and Jane Yu and Song Jiang and Karthik Padthe and Yang Li and Dong Wang and Ilia Kulikov and Kyunghyun Cho and Yuandong Tian and Jason E Weston and Xian Li},
year={2025},
eprint={2502.13124},
archivePrefix={arXiv},
primaryClass={cs.CL},
url={https://arxiv.org/abs/2502.13124},
}