Command Palette
Search for a command to run...
Zhao Hengshuang Qi Xiaojuan Shen Xiaoyong Shi Jianping Jia Jiaya

Abstract
We focus on the challenging task of real-time semantic segmentation in thispaper. It finds many practical applications and yet is with fundamentaldifficulty of reducing a large portion of computation for pixel-wise labelinference. We propose an image cascade network (ICNet) that incorporatesmulti-resolution branches under proper label guidance to address thischallenge. We provide in-depth analysis of our framework and introduce thecascade feature fusion unit to quickly achieve high-quality segmentation. Oursystem yields real-time inference on a single GPU card with decent qualityresults evaluated on challenging datasets like Cityscapes, CamVid andCOCO-Stuff.
Code Repositories
Benchmarks
| Benchmark | Methodology | Metrics |
|---|---|---|
| dichotomous-image-segmentation-on-dis-te1 | ICNet | E-measure: 0.784 HCE: 234 MAE: 0.095 S-Measure: 0.716 max F-Measure: 0.631 weighted F-measure: 0.535 |
| dichotomous-image-segmentation-on-dis-te2 | ICNet | E-measure: 0.826 HCE: 512 MAE: 0.095 S-Measure: 0.759 max F-Measure: 0.716 weighted F-measure: 0.627 |
| dichotomous-image-segmentation-on-dis-te3 | ICNet | E-measure: 0.852 HCE: 1001 MAE: 0.091 S-Measure: 0.780 max F-Measure: 0.752 weighted F-measure: 0.664 |
| dichotomous-image-segmentation-on-dis-te4 | ICNet | E-measure: 0.837 HCE: 3690 MAE: 0.099 S-Measure: 0.776 max F-Measure: 0.749 weighted F-measure: 0.663 |
| dichotomous-image-segmentation-on-dis-vd | ICNet | E-measure: 0.811 HCE: 1503 MAE: 0.102 S-Measure: 0.747 max F-Measure: 0.697 weighted F-measure: 0.609 |
| real-time-semantic-segmentation-on-camvid | ICNet | Frame (fps): 27.8 Time (ms): 36 mIoU: 67.1% |
| real-time-semantic-segmentation-on-cityscapes | ICNet | Frame (fps): 30.3 Time (ms): 33 mIoU: 70.6% |
| semantic-segmentation-on-bdd100k-val | ICNet | mIoU: 52.4(39.5fps) |
| semantic-segmentation-on-cityscapes | ICNet | Mean IoU (class): 70.6% |
| semantic-segmentation-on-trans10k | ICNet | GFLOPs: 10.64 mIoU: 23.39% |
Build AI with AI
From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.