DiagSet is a dataset for prostate cancer histopathology image classification. The dataset includes more than 2.6 million tissue patches extracted from 430 fully annotated scans, 4675 scans with dual diagnosis assigned, and 46 scans with independent diagnosis given by histopathologists.