Command Palette
Search for a command to run...
A Comprehensive Study on Colorectal Polyp Segmentation with ResUNet++, Conditional Random Field and Test-Time Augmentation
Debesh Jha Pia H. Smedsrud Dag Johansen Thomas de Lange Håvard D. Johansen Pål Halvorsen Michael A. Riegler

Abstract
Colonoscopy is considered the gold standard for detection of colorectal cancer and its precursors. Existing examination methods are, however, hampered by high overall miss-rate, and many abnormalities are left undetected. Computer-Aided Diagnosis systems based on advanced machine learning algorithms are touted as a game-changer that can identify regions in the colon overlooked by the physicians during endoscopic examinations, and help detect and characterize lesions. In previous work, we have proposed the ResUNet++ architecture and demonstrated that it produces more efficient results compared with its counterparts U-Net and ResUNet. In this paper, we demonstrate that further improvements to the overall prediction performance of the ResUNet++ architecture can be achieved by using conditional random field and test-time augmentation. We have performed extensive evaluations and validated the improvements using six publicly available datasets: Kvasir-SEG, CVC-ClinicDB, CVC-ColonDB, ETIS-Larib Polyp DB, ASU-Mayo Clinic Colonoscopy Video Database, and CVC-VideoClinicDB. Moreover, we compare our proposed architecture and resulting model with other State-of-the-art methods. To explore the generalization capability of ResUNet++ on different publicly available polyp datasets, so that it could be used in a real-world setting, we performed an extensive cross-dataset evaluation. The experimental results show that applying CRF and TTA improves the performance on various polyp segmentation datasets both on the same dataset and cross-dataset.
Code Repositories
Benchmarks
| Benchmark | Methodology | Metrics |
|---|---|---|
| medical-image-segmentation-on-cvc | ResUNet++ + TTA + CRF | Dice: 0.8130 Recall: 0.6875 mIoU: 0.8477 precision: 0.6276 |
| medical-image-segmentation-on-cvc | ResUNet++ + TTA | Dice: 0.8125 Recall: 0.6896 mIoU: 0.8467 precision: 0.6421 |
| medical-image-segmentation-on-cvc | ResUNet++ + CRF | Dice: 0.8811 Recall: 0.7743 mIoU: 0.8739 precision: 0.6706 |
| medical-image-segmentation-on-cvc-clinicdb | ResUNet++ + TTA | mean Dice: 0.9020 |
| medical-image-segmentation-on-cvc-clinicdb | ResUNet++ + CRF+ TTA | mean Dice: 0.9017 |
| medical-image-segmentation-on-cvc-colondb | ResUNet++ + TTA | mIoU: 0.8466 mean Dice: 0.8474 |
| medical-image-segmentation-on-etis | ResUNet++ + TTA | mIoU: 0.7458 mean Dice: 0.6136 |
| medical-image-segmentation-on-kvasir-seg | ResUNet++ + TTA + CRF | FPS: 69.59 mIoU: 0.7800 mean Dice: 0.8508 |
Build AI with AI
From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.