HyperAIHyperAI

Command Palette

Search for a command to run...

5 months ago

Unsupervised Multi-object Segmentation Using Attention and Soft-argmax

Bruno Sauvalle; Arnaud de La Fortelle

Unsupervised Multi-object Segmentation Using Attention and Soft-argmax

Abstract

We introduce a new architecture for unsupervised object-centric representation learning and multi-object detection and segmentation, which uses a translation-equivariant attention mechanism to predict the coordinates of the objects present in the scene and to associate a feature vector to each object. A transformer encoder handles occlusions and redundant detections, and a convolutional autoencoder is in charge of background reconstruction. We show that this architecture significantly outperforms the state of the art on complex synthetic benchmarks.

Code Repositories

BrunoSauvalle/AST
Official
pytorch

Benchmarks

BenchmarkMethodologyMetrics
unsupervised-object-segmentation-onAST
ARI-FG: 0.82
unsupervised-object-segmentation-on-1AST
ARI-FG: 0.87
unsupervised-object-segmentation-on-clevrtexAST
MSE: 167± 1
mIoU: 66.62± 0.80
unsupervised-object-segmentation-on-clevrtexAST-Seg-B3-CT
MSE: 139±7
mIoU: 79.58±0.54

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
Unsupervised Multi-object Segmentation Using Attention and Soft-argmax | Papers | HyperAI