HyperAIHyperAI

Command Palette

Search for a command to run...

a month ago

Mask R-CNN

He Kaiming Gkioxari Georgia Doll&#xe1 r Piotr Girshick Ross

Mask R-CNN

Abstract

We present a conceptually simple, flexible, and general framework for objectinstance segmentation. Our approach efficiently detects objects in an imagewhile simultaneously generating a high-quality segmentation mask for eachinstance. The method, called Mask R-CNN, extends Faster R-CNN by adding abranch for predicting an object mask in parallel with the existing branch forbounding box recognition. Mask R-CNN is simple to train and adds only a smalloverhead to Faster R-CNN, running at 5 fps. Moreover, Mask R-CNN is easy togeneralize to other tasks, e.g., allowing us to estimate human poses in thesame framework. We show top results in all three tracks of the COCO suite ofchallenges, including instance segmentation, bounding-box object detection, andperson keypoint detection. Without bells and whistles, Mask R-CNN outperformsall existing, single-model entries on every task, including the COCO 2016challenge winners. We hope our simple and effective approach will serve as asolid baseline and help ease future research in instance-level recognition.Code has been made available at: https://github.com/facebookresearch/Detectron

Code Repositories

kbardool/mrcnn3
tf
Mentioned in GitHub
mic-dkfz/medicaldetectiontoolkit
pytorch
Mentioned in GitHub
ColdNoodler/py-faster-rcnn-cuda10
caffe2
Mentioned in GitHub
rickyHong/py-faster-rcnn-repl
caffe2
Mentioned in GitHub
pj1920/mask-r-cnn
tf
Mentioned in GitHub
cwbabel/faster-cnn
caffe2
Mentioned in GitHub
DeNA/Chainer_Mask_R-CNN
caffe2
Mentioned in GitHub
dvl-tum/motsynth-baselines
pytorch
Mentioned in GitHub
Biantian/MscProject
pytorch
Mentioned in GitHub
bethgelab/siamese-mask-rcnn
tf
Mentioned in GitHub
Krupal09/MaskRCNN-Demo
tf
Mentioned in GitHub
ErikGDev/instance-segmentation
pytorch
Mentioned in GitHub
alililia/gpu_maskrcnn_mobilenetv1
mindspore
Mentioned in GitHub
Alexander-Whelan/Zeus
tf
Mentioned in GitHub
devsoft123/fast-cnn
caffe2
Mentioned in GitHub
longcw/roialign.pytorch
pytorch
Mentioned in GitHub
pvdhove/owl-mask-rcnn
Mentioned in GitHub
leonardhan1979/fasterRCNN
caffe2
Mentioned in GitHub
yj-littlesky/py-faster-rcnn
caffe2
Mentioned in GitHub
vimalabs/VIMA
pytorch
Mentioned in GitHub
o-evgeny/MRCNN_DeepFashion2
tf
Mentioned in GitHub
CarstenIsert/DeepBurn
tf
Mentioned in GitHub
chenwuperth/ClaRAN
tf
Mentioned in GitHub
elonashatri/pitch_mask_rcnn
tf
Mentioned in GitHub
MIC-DKFZ/RegRCNN
pytorch
Mentioned in GitHub
quocdat32461997/Mask_RCNN
tf
Mentioned in GitHub
miaohua1982/simple_fasterrcnn_pytorch
pytorch
Mentioned in GitHub
jremillard/images-to-osm
tf
Mentioned in GitHub
BlackAngel1111/Fast-RCNN
caffe2
Mentioned in GitHub
kdethoor/panoptictorch
pytorch
Mentioned in GitHub
yangyucheng000/Mask-RCNN
mindspore
Mentioned in GitHub
2023-MindSpore-1/ms-code-208
mindspore
Mentioned in GitHub
yczhang1017/SSD_resnet_pytorch
pytorch
Mentioned in GitHub
casiopa/Madrid_Rooftops
tf
Mentioned in GitHub
2023-MindSpore-1/ms-code-207
mindspore
Mentioned in GitHub
ykasten/layered-neural-atlases
pytorch
Mentioned in GitHub
soulguy/Faster-rcnn
caffe2
Mentioned in GitHub
jhihan/rsna_pneumonia_detection
tf
Mentioned in GitHub
multimodallearning/pytorch-mask-rcnn
pytorch
Mentioned in GitHub
GAOwy123/py-faster-rcnn
caffe2
Mentioned in GitHub
tryolabs/luminoth
tf
Mentioned in GitHub
NVlabs/industreallib
pytorch
Mentioned in GitHub
delldu/MaskRCNN
pytorch
Mentioned in GitHub
guanfuchen/py-faster-rcnn
caffe2
Mentioned in GitHub
SonginCV/MAF_HDA
Mentioned in GitHub
Arthur-Shi/py-faster-rcnn
caffe2
Mentioned in GitHub
ZQPei/deep_sort_pytorch
pytorch
Mentioned in GitHub
godspeedcurry/lung-nodule-detection
caffe2
Mentioned in GitHub
lucylow/salty-wet-man
tf
Mentioned in GitHub
nikhithakarennagari/Git
caffe2
Mentioned in GitHub
sunqiangxtcsun/faster-rcnn
caffe2
Mentioned in GitHub
UPCLJ/py-faster-rcnn
caffe2
Mentioned in GitHub
lichengunc/mask-faster-rcnn
pytorch
Mentioned in GitHub
zhong110020/py-faster-rcnn
caffe2
Mentioned in GitHub
noelcodes/Mask_RCNN
Mentioned in GitHub
collectionslab/Omniscribe
pytorch
Mentioned in GitHub
charlesYangM/py-faster-rcnn-80.28
caffe2
Mentioned in GitHub
saehan-choi/pixellib_auto_labelling
pytorch
Mentioned in GitHub
SfTI-Robotics/ROS-label-node
pytorch
Mentioned in GitHub
rh01/faster-rcnn
caffe2
Mentioned in GitHub
jodumagpi/Xray-ObjSep-v1
pytorch
Mentioned in GitHub
maxfrei750/FibeR-CNN
pytorch
Mentioned in GitHub
KMnP/fashionpedia-api
tf
Mentioned in GitHub
jianing-sun/Mask-YOLO
tf
Mentioned in GitHub
DivJAth/DeepLearning5922
Mentioned in GitHub
maxfrei750/DeepParticleNet
tf
Mentioned in GitHub
BupyeongHealer/Mask_RCNN_tf_2.x
tf
Mentioned in GitHub
itsasimiqbal/SeBRe
tf
Mentioned in GitHub
qq330488563/TEST
caffe2
Mentioned in GitHub
yangyucheng000/maskrcnn_mobilenetv1
mindspore
Mentioned in GitHub
beassssry/U
caffe2
Mentioned in GitHub
jiajunhua/facebookresearch-Detectron
caffe2
Mentioned in GitHub
harrybolingot/mymaskrcnn
tf
Mentioned in GitHub
fsafe/Capstone
pytorch
Mentioned in GitHub
MIC-DKFZ/DetectionAndRegression
pytorch
Mentioned in GitHub
Qinhj07/ATOMCode
pytorch
Mentioned in GitHub
louisyuzhe/car-damage-detector
tf
Mentioned in GitHub
evaristr/py-faster_rcnn
caffe2
Mentioned in GitHub
Mrnoorsingh/car-parking
Mentioned in GitHub
rh01/fast-rnn
caffe2
Mentioned in GitHub
EmGarr/kerod
tf
Mentioned in GitHub
phykn/film-defect-detection
pytorch
Mentioned in GitHub
SonginCV/GMPHD_SAF
Mentioned in GitHub
RajArPatra/Super-OCR
pytorch
Mentioned in GitHub
jklife3/maskrcnn-impl
tf
Mentioned in GitHub
leochangzliao/OPBM
Mentioned in GitHub
qilei123/pyfasterrcnn
caffe2
Mentioned in GitHub
jylins/core-text
pytorch
Mentioned in GitHub
chuanqichen/deepcoaching
pytorch
Mentioned in GitHub
xunhen/py-faster-rcnn-wjc
caffe2
Mentioned in GitHub
infini8-13/MaskRCNN_tryout
Mentioned in GitHub
ayoolaolafenwa/PixelLib
tf
Mentioned in GitHub
SonginCV/GMPHD_MAF
Mentioned in GitHub
busyboxs/What-I-have-star
tf
Mentioned in GitHub
jooyounghun/AI-Team-5
Mentioned in GitHub
ls5122/mask-rcnn
pytorch
Mentioned in GitHub
facebookresearch/detectron
pytorch
Mentioned in GitHub
alililia/ascend_maskrcnn_mobilenetv1
mindspore
Mentioned in GitHub
open-edge-platform/geti
pytorch
Mentioned in GitHub
charlesshang/fastmaskrcnn
tf
Mentioned in GitHub
xjnpark/ds
caffe2
Mentioned in GitHub
Lopezurrutia/DSB_2018
tf
Mentioned in GitHub
busyboxs/faster_rcnn_voc
Mentioned in GitHub
Makunda/DeepLearningASL
Mentioned in GitHub
TuSimple/mx-maskrcnn
tf
Mentioned in GitHub
sunhui1234/haha
caffe2
Mentioned in GitHub
samsh19/ML_project
pytorch
Mentioned in GitHub
fdac18/ForensicImages
Mentioned in GitHub
nikhithakarennagari/1311
caffe2
Mentioned in GitHub
yubaoliu/rds-slam
Mentioned in GitHub
krantirk/py-faster-rcnn
caffe2
Mentioned in GitHub
TejasBajania/Mtech_pro
Mentioned in GitHub
asyrovprog/cs230project
Mentioned in GitHub
George-Ogden/Mask-RCNN
pytorch
Mentioned in GitHub
jasjeetIM/Mask-RCNN
Mentioned in GitHub
sbetageri/MaskRCNN
pytorch
Mentioned in GitHub

Benchmarks

BenchmarkMethodologyMetrics
instance-segmentation-on-bdd100k-valMask R-CNN
AP: 20.5
instance-segmentation-on-cocoMask R-CNN (ResNeXt-101-FPN)
AP50: 60.0
AP75: 39.4
APL: 53.5
APM: 39.9
APS: 16.9
mask AP: 37.1
instance-segmentation-on-isaidMask-RCNN+
Average Precision: 37.18
instance-segmentation-on-isaidMask-RCNN
Average Precision: 36.50
keypoint-detection-on-coco-1Mask R-CNN
Test AP: 63.1
Validation AP: 69.2
keypoint-detection-on-coco-test-challengeMask R-CNN*
AP: 68.9
AP50: 89.2
AP75: 75.2
APL: 82.6
AR: 75.4
AR50: 93.2
AR75: 81.2
ARL: 76.8
ARM: 70.2
keypoint-detection-on-coco-test-devMask R-CNN
AP50: 87.3
AP75: 68.7
APL: 71.4
APM: 57.8
multi-human-parsing-on-mhp-v10Mask R-CNN
AP 0.5: 52.68%
multi-human-parsing-on-mhp-v20Mask R-CNN
AP 0.5: 14.9
multi-person-pose-estimation-on-crowdposeMask R-CNN
AP Easy: 69.4
AP Hard: 45.8
AP Medium: 57.9
mAP @0.5:0.95: 57.2
multi-person-pose-estimation-on-ochumanMask R-CNN
AP50: 33.2
AP75: 24.5
Validation AP: 20.2
multi-tissue-nucleus-segmentation-on-kumarMask R-CNN (e)
Dice: 0.760
Hausdorff Distance (mm): 50.9
nuclear-segmentation-on-cell17Mask R-CNN
Dice: 0.707
F1-score: 0.8004
Hausdorff: 12.6723
object-detection-on-cocoMask R-CNN (ResNeXt-101-FPN)
AP50: 62.3
AP75: 43.4
APL: 51.2
APM: 43.2
APS: 22.1
Hardware Burden: 9G
box mAP: 39.8
object-detection-on-cocoMask R-CNN (ResNet-101-FPN)
AP50: 60.3
AP75: 41.7
APL: 50.2
APM: 41.1
APS: 20.1
Hardware Burden: 9G
box mAP: 38.2
object-detection-on-coco-minivalMask R-CNN (ResNeXt-101-FPN)
AP50: 59.5
AP75: 38.9
box AP: 36.7
object-detection-on-coco-minivalMask R-CNN (ResNet-50-FPN)
box AP: 37.7
object-detection-on-coco-minivalMask R-CNN (ResNet-101-FPN)
box AP: 40.0
object-detection-on-coco-oMask R-CNN (ResNet-50)
Average mAP: 17.1
object-detection-on-coco-oMask R-CNN (ResNet-50)
Effective Robustness: -0.11
object-detection-on-isaidMask-RCNN
Average Precision: 36.50
object-detection-on-isaidMask-RCNN+
Average Precision: 37.18
object-localization-on-gritMask R-CNN
Localization (ablation): 44.7
Localization (test): 45.1
panoptic-segmentation-on-cityscapes-valMask R-CNN+COCO
PQth: 54.0
pose-estimation-on-coco-test-devMask-RCNN
AP: 63.1
AP50: 87.3
AP75: 68.7
APL: 71.4
real-time-object-detection-on-coco-1Mask R-CNN X-152-32x8d
box AP: 45.2

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
Mask R-CNN | Papers | HyperAI