HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

TwinLiteNetPlus: A Real-Time Multi-Task Segmentation Model for Autonomous Driving

Quang-Huy Che Duc-Tri Le Minh-Quan Pham Vinh-Tiep Nguyen Duc-Khai Lam

TwinLiteNetPlus: A Real-Time Multi-Task Segmentation Model for Autonomous Driving

Abstract

Semantic segmentation is crucial for autonomous driving, particularly for the tasks of Drivable Area and Lane Segmentation, ensuring safety and navigation. To address the high computational costs of current state-of-the-art (SOTA) models, this paper introduces TwinLiteNetPlus, a model capable of balancing efficiency and accuracy. TwinLiteNetPlus incorporates standard and depth-wise separable dilated convolutions, reducing complexity while maintaining high accuracy. It is available in four configurations, from the robust 1.94 million-parameter TwinLiteNetPlus_{Large} to the ultra-lightweight 34K-parameter TwinLiteNetPlus_{Nano}. Notably, TwinLiteNetPlus_{Large} attains a 92.9% mIoU (mean Intersection over Union) for Drivable Area Segmentation and a 34.2% IoU (Intersection over Union) for Lane Segmentation. These results achieve remarkable performance, surpassing current state-of-the-art models while only requiring 11 times fewer Floating Point Operations (FLOPs) for computation. Rigorously evaluated on various embedded devices, TwinLiteNetPlus demonstrates promising latency and power efficiency, underscoring its potential for real-world autonomous vehicle applications. The code is available on https://github.com/chequanghuy/TwinLiteNetPlus.

Code Repositories

chequanghuy/TwinLiteNetPlus
Official
pytorch
Mentioned in GitHub
chequanghuy/TwinLiteNet
pytorch
Mentioned in GitHub

Benchmarks

BenchmarkMethodologyMetrics
drivable-area-detection-on-bdd100k-valTwinLiteNetPlus-Nano
Params (M): 0.03
mIoU: 87.3
drivable-area-detection-on-bdd100k-valTwinLiteNetPlus-Large
Params (M): 1.94
mIoU: 92.9
drivable-area-detection-on-bdd100k-valTwinLiteNetPlus-Medium
Params (M): 0.48
mIoU: 92.0
drivable-area-detection-on-bdd100k-valTwinLiteNetPlus-Small
Params (M): 0.12
mIoU: 90.6
lane-detection-on-bdd100k-valTwinLiteNetPlus-Small
Accuracy (%): 75.8
IoU (%): 29.3
Params (M): 0.12
lane-detection-on-bdd100k-valTwinLiteNetPlus-Nano
Accuracy (%): 70.2
IoU (%): 23.3
Params (M): 0.03
lane-detection-on-bdd100k-valTwinLiteNetPlus-Large
Accuracy (%): 81.9
IoU (%): 34.2
Params (M): 1.94
lane-detection-on-bdd100k-valTwinLiteNetPlus-Medium
Accuracy (%): 79.1
IoU (%): 32.3
Params (M): 0.48

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
TwinLiteNetPlus: A Real-Time Multi-Task Segmentation Model for Autonomous Driving | Papers | HyperAI