HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

EndoDepth: A Benchmark for Assessing Robustness in Endoscopic Depth Prediction

Ivan Reyes-Amezcua Ricardo Espinosa Christian Daul Gilberto Ochoa-Ruiz Andres Mendez-Vazquez

EndoDepth: A Benchmark for Assessing Robustness in Endoscopic Depth Prediction

Abstract

Accurate depth estimation in endoscopy is vital for successfully implementing computer vision pipelines for various medical procedures and CAD tools. In this paper, we present the EndoDepth benchmark, an evaluation framework designed to assess the robustness of monocular depth prediction models in endoscopic scenarios. Unlike traditional datasets, the EndoDepth benchmark incorporates common challenges encountered during endoscopic procedures. We present an evaluation approach that is consistent and specifically designed to evaluate the robustness performance of the model in endoscopic scenarios. Among these is a novel composite metric called the mean Depth Estimation Robustness Score (mDERS), which offers an in-depth evaluation of a model's accuracy against errors brought on by endoscopic image corruptions. Moreover, we present SCARED-C, a new dataset designed specifically to assess endoscopy robustness. Through extensive experimentation, we evaluate state-of-the-art depth prediction architectures on the EndoDepth benchmark, revealing their strengths and weaknesses in handling endoscopic challenging imaging artifacts. Our results demonstrate the importance of specialized techniques for accurate depth estimation in endoscopy and provide valuable insights for future research directions.

Code Repositories

Ivanrs297/endoscopycorruptions
Official
Mentioned in GitHub

Benchmarks

BenchmarkMethodologyMetrics
monocular-depth-estimation-on-scared-cMonodepth2
mDERS: 0.2608
monocular-depth-estimation-on-scared-cMonoViT
mDERS: 0.2759
monocular-depth-estimation-on-scared-cAF-SfMLearner
mDERS: 0.3134
monocular-depth-estimation-on-scared-cEndoSfMLearner
mDERS: 0.2332

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
EndoDepth: A Benchmark for Assessing Robustness in Endoscopic Depth Prediction | Papers | HyperAI