HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

The GIST and RIST of Iterative Self-Training for Semi-Supervised Segmentation

Eu Wern Teh Terrance DeVries Brendan Duke Ruowei Jiang Parham Aarabi Graham W. Taylor

The GIST and RIST of Iterative Self-Training for Semi-Supervised Segmentation

Abstract

We consider the task of semi-supervised semantic segmentation, where we aim to produce pixel-wise semantic object masks given only a small number of human-labeled training examples. We focus on iterative self-training methods in which we explore the behavior of self-training over multiple refinement stages. We show that iterative self-training leads to performance degradation if done naïvely with a fixed ratio of human-labeled to pseudo-labeled training examples. We propose Greedy Iterative Self-Training (GIST) and Random Iterative Self-Training (RIST) strategies that alternate between training on either human-labeled data or pseudo-labeled data at each refinement stage, resulting in a performance boost rather than degradation. We further show that GIST and RIST can be combined with existing semi-supervised learning methods to boost performance.

Benchmarks

BenchmarkMethodologyMetrics
semi-supervised-semantic-segmentation-on-1GIST and RIST (DeepLabv2 with ResNet101, MSCOCO pre-trained)
Validation mIoU: 65.14%
semi-supervised-semantic-segmentation-on-18GIST and RIST (DeepLabv2 with ResNet101, MSCOCO pre-trained)
Validation mIoU: 53.51%
semi-supervised-semantic-segmentation-on-19GIST and RIST (DeepLabv2 with ResNet101, MSCOCO pre-trained)
Validation mIoU: 59.98%
semi-supervised-semantic-segmentation-on-2GIST and RIST (DeepLabv2 with ResNet101, MSCOCO pre-trained)
Validation mIoU: 62.57%
semi-supervised-semantic-segmentation-on-3GIST and RIST (DeepLabv2 with ResNet101, MSCOCO pre-trained)
Validation mIoU: 58.70%
semi-supervised-semantic-segmentation-on-4GIST and RIST
Validation mIoU: 70.76%
semi-supervised-semantic-segmentation-on-5GIST and RIST (DeepLabv2 with ResNet101, MSCOCO pre-trained)
Validation mIoU: 69.40%
semi-supervised-semantic-segmentation-on-6GIST and RIST (DeepLabv2 with ResNet101, MSCOCO pre-trained)
Validation mIoU: 67.21%

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
The GIST and RIST of Iterative Self-Training for Semi-Supervised Segmentation | Papers | HyperAI