HyperAIHyperAI

Command Palette

Search for a command to run...

5 months ago

UniHCP: A Unified Model for Human-Centric Perceptions

UniHCP: A Unified Model for Human-Centric Perceptions

Abstract

Human-centric perceptions (e.g., pose estimation, human parsing, pedestriandetection, person re-identification, etc.) play a key role in industrialapplications of visual models. While specific human-centric tasks have theirown relevant semantic aspect to focus on, they also share the same underlyingsemantic structure of the human body. However, few works have attempted toexploit such homogeneity and design a general-propose model for human-centrictasks. In this work, we revisit a broad range of human-centric tasks and unifythem in a minimalist manner. We propose UniHCP, a Unified Model forHuman-Centric Perceptions, which unifies a wide range of human-centric tasks ina simplified end-to-end manner with the plain vision transformer architecture.With large-scale joint training on 33 human-centric datasets, UniHCP canoutperform strong baselines on several in-domain and downstream tasks by directevaluation. When adapted to a specific task, UniHCP achieves new SOTAs on awide range of human-centric tasks, e.g., 69.8 mIoU on CIHP for human parsing,86.18 mA on PA-100K for attribute prediction, 90.3 mAP on Market1501 for ReID,and 85.8 JI on CrowdHuman for pedestrian detection, performing better thanspecialized models tailored for each task.

Code Repositories

opengvlab/unihcp
Official
pytorch

Benchmarks

BenchmarkMethodologyMetrics
human-part-segmentation-on-atrUniHCP (FT)
pACC: 97.74
human-part-segmentation-on-cihpUniHCP (finetune)
Mean IoU: 69.8
human-part-segmentation-on-human3-6mUniHCP (finetune)
mIoU: 65.95
object-detection-on-crowdhuman-full-bodyUniHCP (finetune)
AP: 92.5
mMR: 41.6
pedestrian-attribute-recognition-on-pa-100kUniHCP (finetune)
Accuracy: 86.18
pedestrian-attribute-recognition-on-petaUniHCP (FT)
Accuracy: 88.78%
pedestrian-attribute-recognition-on-rapv2UniHCP (finetune)
Accuracy: 82.34
pedestrian-detection-on-caltechUniHCP (FT)
Heavy MR^-2: 27.2
person-re-identification-on-cuhk03UniHCP (finetune)
MAP: 83.1
person-re-identification-on-market-1501UniHCP (finetune)
mAP: 90.3
person-re-identification-on-msmt17UniHCP (finetune)
mAP: 67.3
person-re-identification-on-sensereidUniHCP (DE)
Top-1: 46
pose-estimation-on-aicUniHCP (finetune)
AP: 33.6
pose-estimation-on-mpii-human-poseUniHCP (FT)
PCKh-0.5: 93.2
pose-estimation-on-ms-cocoUniHCP (finetune)
AP: 76.5
pose-estimation-on-ochumanUniHCP (direct eval)
Test AP: 87.4
semantic-segmentation-on-lip-valUniHCP (finetune)
mIoU: 63.86%

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
UniHCP: A Unified Model for Human-Centric Perceptions | Papers | HyperAI