Command Palette
Search for a command to run...
Roto-Translation Equivariant Convolutional Networks: Application to Histopathology Image Analysis
Maxime W. Lafarge; Erik J. Bekkers; Josien P.W. Pluim; Remco Duits; Mitko Veta

Abstract
Rotation-invariance is a desired property of machine-learning models for medical image analysis and in particular for computational pathology applications. We propose a framework to encode the geometric structure of the special Euclidean motion group SE(2) in convolutional networks to yield translation and rotation equivariance via the introduction of SE(2)-group convolution layers. This structure enables models to learn feature representations with a discretized orientation dimension that guarantees that their outputs are invariant under a discrete set of rotations. Conventional approaches for rotation invariance rely mostly on data augmentation, but this does not guarantee the robustness of the output when the input is rotated. At that, trained conventional CNNs may require test-time rotation augmentation to reach their full capability. This study is focused on histopathology image analysis applications for which it is desirable that the arbitrary global orientation information of the imaged tissues is not captured by the machine learning models. The proposed framework is evaluated on three different histopathology image analysis tasks (mitosis detection, nuclei segmentation and tumor classification). We present a comparative analysis for each problem and show that consistent increase of performances can be achieved when using the proposed framework.
Code Repositories
Benchmarks
| Benchmark | Methodology | Metrics |
|---|---|---|
| breast-tumour-classification-on-pcam | G-CNN (C8) | AUC: 0.968 |
| breast-tumour-classification-on-pcam | G-CNN (C12) | AUC: 0.962 |
| colorectal-gland-segmentation-on-crag | G-CNN (C8) | Dice: 0.866 F1-score: 0.837 Hausdorff Distance (mm): 157.4 |
| colorectal-gland-segmentation-on-crag | G-CNN (C12) | Dice: 0.834 F1-score: 0.818 Hausdorff Distance (mm): 192.2 |
| multi-tissue-nucleus-segmentation-on-kumar | G-CNN (C12) | Dice: 0.814 Hausdorff Distance (mm): 53.4 |
| multi-tissue-nucleus-segmentation-on-kumar | G-CNN (C12) | Dice: 0.811 Hausdorff Distance (mm): 51.9 |
Build AI with AI
From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.