HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

CARLANE: A Lane Detection Benchmark for Unsupervised Domain Adaptation from Simulation to multiple Real-World Domains

Julian Gebele Bonifaz Stuhr Johann Haselberger

CARLANE: A Lane Detection Benchmark for Unsupervised Domain Adaptation from Simulation to multiple Real-World Domains

Abstract

Unsupervised Domain Adaptation demonstrates great potential to mitigate domain shifts by transferring models from labeled source domains to unlabeled target domains. While Unsupervised Domain Adaptation has been applied to a wide variety of complex vision tasks, only few works focus on lane detection for autonomous driving. This can be attributed to the lack of publicly available datasets. To facilitate research in these directions, we propose CARLANE, a 3-way sim-to-real domain adaptation benchmark for 2D lane detection. CARLANE encompasses the single-target datasets MoLane and TuLane and the multi-target dataset MuLane. These datasets are built from three different domains, which cover diverse scenes and contain a total of 163K unique images, 118K of which are annotated. In addition we evaluate and report systematic baselines, including our own method, which builds upon Prototypical Cross-domain Self-supervised Learning. We find that false positive and false negative rates of the evaluated domain adaptation methods are high compared to those of fully supervised baselines. This affirms the need for benchmarks such as CARLANE to further strengthen research in Unsupervised Domain Adaptation for lane detection. CARLANE, all evaluated models and the corresponding implementations are publicly available at https://carlanebenchmark.github.io.

Code Repositories

juliangebele/CARLANE
Official
pytorch

Benchmarks

BenchmarkMethodologyMetrics
domain-adaptation-on-molaneUFLD-DANN-ResNet32
Lane Accuracy (LA): 90.91
domain-adaptation-on-molaneUFLD-ADDA-ResNet18
Lane Accuracy (LA): 92.85
domain-adaptation-on-molaneUFLD-ADDA-ResNet32
Lane Accuracy (LA): 92.39
domain-adaptation-on-molaneUFLD-DANN-ResNet18
Lane Accuracy (LA): 87.65
domain-adaptation-on-molaneUFLD-SGADA-ResNet32
Lane Accuracy (LA): 93.31
domain-adaptation-on-molaneUFLD-SGPCS-ResNet32
Lane Accuracy (LA): 93.53
domain-adaptation-on-molaneUFLD-SGADA-ResNet18
Lane Accuracy (LA): 93.82
domain-adaptation-on-molaneUFLD-SGPCS-ResNet18
Lane Accuracy (LA): 93.94
domain-adaptation-on-mulaneUFLD-SGADA-ResNet18
Lane Accuracy (LA): 90.71
domain-adaptation-on-mulaneUFLD-DANN-ResNet32
Lane Accuracy (LA): 88.76
domain-adaptation-on-mulaneUFLD-DANN-ResNet18
Lane Accuracy (LA): 86.01
domain-adaptation-on-mulaneUFLD-ADDA-ResNet32
Lane Accuracy (LA): 90.22
domain-adaptation-on-mulaneUFLD-ADDA-ResNet18
Lane Accuracy (LA): 89.83
domain-adaptation-on-mulaneUFLD-SGADA-ResNet32
Lane Accuracy (LA): 91.63
domain-adaptation-on-mulaneUFLD-SGPCS-ResNet32
Lane Accuracy (LA): 91.55
domain-adaptation-on-mulaneUFLD-SGPCS-ResNet18
Lane Accuracy (LA): 91.57
domain-adaptation-on-tulaneUFLD-SGADA-ResNet32
Lane Accuracy (LA): 92.04
domain-adaptation-on-tulaneUFLD-DANN-ResNet18
Lane Accuracy (LA): 88.74
domain-adaptation-on-tulaneUFLD-SGADA-ResNet18
Lane Accuracy (LA): 91.70
domain-adaptation-on-tulaneUFLD-SGPCS-ResNet32
Lane Accuracy (LA): 93.29
domain-adaptation-on-tulaneUFLD-ADDA-ResNet18
Lane Accuracy (LA): 90.72
domain-adaptation-on-tulaneUFLD-SGPCS-ResNet18
Lane Accuracy (LA): 91.55
domain-adaptation-on-tulaneUFLD-ADDA-ResNet32
Lane Accuracy (LA): 91.39
domain-adaptation-on-tulaneUFLD-DANN-ResNet32
Lane Accuracy (LA): 91.06

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp