HyperAIHyperAI

Command Palette

Search for a command to run...

5 months ago

Benchmarks for Corruption Invariant Person Re-identification

Chen Minghui ; Wang Zhiqiang ; Zheng Feng

Benchmarks for Corruption Invariant Person Re-identification

Abstract

When deploying person re-identification (ReID) model in safety-criticalapplications, it is pivotal to understanding the robustness of the modelagainst a diverse array of image corruptions. However, current evaluations ofperson ReID only consider the performance on clean datasets and ignore imagesin various corrupted scenarios. In this work, we comprehensively establish sixReID benchmarks for learning corruption invariant representation. In the fieldof ReID, we are the first to conduct an exhaustive study on corruptioninvariant learning in single- and cross-modality datasets, includingMarket-1501, CUHK03, MSMT17, RegDB, SYSU-MM01. After reproducing and examiningthe robustness performance of 21 recent ReID methods, we have someobservations: 1) transformer-based models are more robust towards corruptedimages, compared with CNN-based models, 2) increasing the probability of randomerasing (a commonly used augmentation method) hurts model corruptionrobustness, 3) cross-dataset generalization improves with corruption robustnessincreases. By analyzing the above observations, we propose a strong baseline onboth single- and cross-modality ReID datasets which achieves improvedrobustness against diverse corruptions. Our codes are available onhttps://github.com/MinghuiChen43/CIL-ReID.

Code Repositories

MinghuiChen43/CIL-ReID
Official
pytorch
Mentioned in GitHub

Benchmarks

BenchmarkMethodologyMetrics
person-re-identification-on-cuhk03-cCIL (ResNet-50)
Rank-1: 22.96
mAP: 16.33
mINP: 22.96
person-re-identification-on-market-1501-cCIL (ResNet-50)
Rank-1: 55.57
mAP: 28.03
mINP: 1.76
person-re-identification-on-msmt17-cCIL (ResNet-50)
Rank-1: 39.79
mAP: 15.33
mINP: 0.32
person-re-identification-on-sysu-mm01-cCIL (ResNet-50)
Rank-1 (All Search): 36.95
Rank-1 (Indoor Search): 40.73
mAP (All Search): 35.92
mAP (Indoor Search): 48.65
mINP (All Search): 22.48
mINP (Indoor Search): 43.11

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
Benchmarks for Corruption Invariant Person Re-identification | Papers | HyperAI