HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

Recursively Refined R-CNN: Instance Segmentation with Self-RoI Rebalancing

Leonardo Rossi Akbar Karimi Andrea Prati

Recursively Refined R-CNN: Instance Segmentation with Self-RoI Rebalancing

Abstract

Within the field of instance segmentation, most of the state-of-the-art deep learning networks rely nowadays on cascade architectures, where multiple object detectors are trained sequentially, re-sampling the ground truth at each step. This offers a solution to the problem of exponentially vanishing positive samples. However, it also translates into an increase in network complexity in terms of the number of parameters. To address this issue, we propose Recursively Refined R-CNN (R^3-CNN) which avoids duplicates by introducing a loop mechanism instead. At the same time, it achieves a quality boost using a recursive re-sampling technique, where a specific IoU quality is utilized in each recursion to eventually equally cover the positive spectrum. Our experiments highlight the specific encoding of the loop mechanism in the weights, requiring its usage at inference time. The R^3-CNN architecture is able to surpass the recently proposed HTC model, while reducing the number of parameters significantly. Experiments on COCO minival 2017 dataset show performance boost independently from the utilized baseline model. The code is available online at https://github.com/IMPLabUniPr/mmdetection/tree/r3_cnn.

Code Repositories

Benchmarks

BenchmarkMethodologyMetrics
instance-segmentation-on-coco-minivalR3-CNN (ResNet-50-FPN, GC-Net)
AP50: 61.1
AP75: 43.5
APM: 42.8
APS: 22.6
mask AP: 40.2
instance-segmentation-on-coco-minivalR3-CNN (ResNet-50-FPN)
AP50: 58
AP75: 41.4
APL: 52.8
APM: 41
APS: 20.4
mask AP: 38.2
instance-segmentation-on-coco-minivalR3-CNN (ResNet-50-FPN, DCN)
AP50: 61.3
AP75: 44
APL: 56.1
APM: 43.6
APS: 22.3
mask AP: 40.4
instance-segmentation-on-coco-minivalR3-CNN (ResNet-50-FPN, GRoIE)
AP50: 58.8
AP75: 42.3
APL: 54.3
APM: 42.1
APS: 20.7
mask AP: 39.1
instance-segmentation-on-coco-minvalR3-CNN (ResNet-50-FPN, GC-Net)
APL: 56
object-detection-on-coco-minivalR3-CNN (ResNet-50-FPN, GC-Net)
AP50: 64.1
AP75: 48.4
APL: 58.9
APM: 47.1
APS: 27
box AP: 44.3
object-detection-on-coco-minivalR3-CNN (ResNet-50-FPN)
AP50: 61
AP75: 46.3
APL: 55.7
APM: 45.2
APS: 24.5
box AP: 42
object-detection-on-coco-minivalR3-CNN (ResNet-50-FPN, DCN)
AP50: 64.3
AP75: 48.9
APL: 59.6
APM: 48.3
APS: 26.6
box AP: 44.8
object-detection-on-coco-minivalR3-CNN (ResNet-50-FPN, GRoIE)
AP50: 61.2
AP75: 45.6
APS: 24.4

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
Recursively Refined R-CNN: Instance Segmentation with Self-RoI Rebalancing | Papers | HyperAI