LCC_python is a Python code dataset released by Microsoft in 2023, originating from the Large Code Corpus (LCC) project, designed to provide high-quality code corpora for tasks such as code generation, code completion, and code understanding.

The dataset is approximately 2 GB and contains 120,000 Python code samples, sourced from large-scale open-source code repositories, and is divided into training, validation, and test sets. Each sample mainly contains contextual code and the corresponding target code snippet, which can be used for supervised learning and pretraining of code-related models.

Dataset Composition

The dataset consists of the following three parts:

• Training set (train): 100,000 samples, approximately 1.76 GB.
• Validation set (validation): 10,000 samples, approximately 146 MB.
• Test set (test): 10,000 samples, approximately 149 MB.

Each sample mainly contains the following fields:

• context: Code context information.
• gt: Ground Truth, i.e., the target code or label.