Command Palette
Search for a command to run...
Video Object Segmentation with Adaptive Feature Bank and Uncertain-Region Refinement
Yongqing Liang Xin Li Navid Jafari Qin Chen

Abstract
We propose a new matching-based framework for semi-supervised video object segmentation (VOS). Recently, state-of-the-art VOS performance has been achieved by matching-based algorithms, in which feature banks are created to store features for region matching and classification. However, how to effectively organize information in the continuously growing feature bank remains under-explored, and this leads to inefficient design of the bank. We introduce an adaptive feature bank update scheme to dynamically absorb new features and discard obsolete features. We also design a new confidence loss and a fine-grained segmentation module to enhance the segmentation accuracy in uncertain regions. On public benchmarks, our algorithm outperforms existing state-of-the-arts.
Code Repositories
Benchmarks
| Benchmark | Methodology | Metrics |
|---|---|---|
| semi-supervised-video-object-segmentation-on-13 | AFB-URR | F: 84.5 J: 82.9 Ju0026F: 83.7 |
| semi-supervised-video-object-segmentation-on-14 | AFB-URR | F: 84.6 J: 82.9 Ju0026F: 83.8 |
| semi-supervised-video-object-segmentation-on-20 | AFB-URR | D17 val (F): 76.1 D17 val (G): 74.6 D17 val (J): 73.0 FPS: 4.00 |
| video-object-segmentation-on-youtube-vos | AFB-URR | F-Measure (Seen): 83.1 F-Measure (Unseen): 82.6 Jaccard (Seen): 78.8 Jaccard (Unseen): 74.1 Overall: 79.6 |
| visual-object-tracking-on-davis-2017 | AFB-URR | F-measure (Decay): 15.5 F-measure (Mean): 76.1 F-measure (Recall): 87.0 Ju0026F: 74.6 Jaccard (Decay): 13.8 Jaccard (Mean): 73.0 Jaccard (Recall): 85.3 |
Build AI with AI
From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.