Command Palette
Search for a command to run...
TwinLiteNetPlus: A Real-Time Multi-Task Segmentation Model for Autonomous Driving
Quang-Huy Che Duc-Tri Le Minh-Quan Pham Vinh-Tiep Nguyen Duc-Khai Lam

Abstract
Semantic segmentation is crucial for autonomous driving, particularly for the tasks of Drivable Area and Lane Segmentation, ensuring safety and navigation. To address the high computational costs of current state-of-the-art (SOTA) models, this paper introduces TwinLiteNetPlus, a model capable of balancing efficiency and accuracy. TwinLiteNetPlus incorporates standard and depth-wise separable dilated convolutions, reducing complexity while maintaining high accuracy. It is available in four configurations, from the robust 1.94 million-parameter TwinLiteNetPlus_{Large} to the ultra-lightweight 34K-parameter TwinLiteNetPlus_{Nano}. Notably, TwinLiteNetPlus_{Large} attains a 92.9% mIoU (mean Intersection over Union) for Drivable Area Segmentation and a 34.2% IoU (Intersection over Union) for Lane Segmentation. These results achieve remarkable performance, surpassing current state-of-the-art models while only requiring 11 times fewer Floating Point Operations (FLOPs) for computation. Rigorously evaluated on various embedded devices, TwinLiteNetPlus demonstrates promising latency and power efficiency, underscoring its potential for real-world autonomous vehicle applications. The code is available on https://github.com/chequanghuy/TwinLiteNetPlus.
Code Repositories
Benchmarks
| Benchmark | Methodology | Metrics |
|---|---|---|
| drivable-area-detection-on-bdd100k-val | TwinLiteNetPlus-Nano | Params (M): 0.03 mIoU: 87.3 |
| drivable-area-detection-on-bdd100k-val | TwinLiteNetPlus-Large | Params (M): 1.94 mIoU: 92.9 |
| drivable-area-detection-on-bdd100k-val | TwinLiteNetPlus-Medium | Params (M): 0.48 mIoU: 92.0 |
| drivable-area-detection-on-bdd100k-val | TwinLiteNetPlus-Small | Params (M): 0.12 mIoU: 90.6 |
| lane-detection-on-bdd100k-val | TwinLiteNetPlus-Small | Accuracy (%): 75.8 IoU (%): 29.3 Params (M): 0.12 |
| lane-detection-on-bdd100k-val | TwinLiteNetPlus-Nano | Accuracy (%): 70.2 IoU (%): 23.3 Params (M): 0.03 |
| lane-detection-on-bdd100k-val | TwinLiteNetPlus-Large | Accuracy (%): 81.9 IoU (%): 34.2 Params (M): 1.94 |
| lane-detection-on-bdd100k-val | TwinLiteNetPlus-Medium | Accuracy (%): 79.1 IoU (%): 32.3 Params (M): 0.48 |
Build AI with AI
From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.