HyperAIHyperAI

Command Palette

Search for a command to run...

5 months ago

Roto-Translation Equivariant Convolutional Networks: Application to Histopathology Image Analysis

Maxime W. Lafarge; Erik J. Bekkers; Josien P.W. Pluim; Remco Duits; Mitko Veta

Roto-Translation Equivariant Convolutional Networks: Application to Histopathology Image Analysis

Abstract

Rotation-invariance is a desired property of machine-learning models for medical image analysis and in particular for computational pathology applications. We propose a framework to encode the geometric structure of the special Euclidean motion group SE(2) in convolutional networks to yield translation and rotation equivariance via the introduction of SE(2)-group convolution layers. This structure enables models to learn feature representations with a discretized orientation dimension that guarantees that their outputs are invariant under a discrete set of rotations. Conventional approaches for rotation invariance rely mostly on data augmentation, but this does not guarantee the robustness of the output when the input is rotated. At that, trained conventional CNNs may require test-time rotation augmentation to reach their full capability. This study is focused on histopathology image analysis applications for which it is desirable that the arbitrary global orientation information of the imaged tissues is not captured by the machine learning models. The proposed framework is evaluated on three different histopathology image analysis tasks (mitosis detection, nuclei segmentation and tumor classification). We present a comparative analysis for each problem and show that consistent increase of performances can be achieved when using the proposed framework.

Code Repositories

tueimage/se2cnn
Official
tf

Benchmarks

BenchmarkMethodologyMetrics
breast-tumour-classification-on-pcamG-CNN (C8)
AUC: 0.968
breast-tumour-classification-on-pcamG-CNN (C12)
AUC: 0.962
colorectal-gland-segmentation-on-cragG-CNN (C8)
Dice: 0.866
F1-score: 0.837
Hausdorff Distance (mm): 157.4
colorectal-gland-segmentation-on-cragG-CNN (C12)
Dice: 0.834
F1-score: 0.818
Hausdorff Distance (mm): 192.2
multi-tissue-nucleus-segmentation-on-kumarG-CNN (C12)
Dice: 0.814
Hausdorff Distance (mm): 53.4
multi-tissue-nucleus-segmentation-on-kumarG-CNN (C12)
Dice: 0.811
Hausdorff Distance (mm): 51.9

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
Roto-Translation Equivariant Convolutional Networks: Application to Histopathology Image Analysis | Papers | HyperAI