HyperAIHyperAI

Command Palette

Search for a command to run...

5 months ago

Domain-Adaptive Self-Supervised Pre-Training for Face & Body Detection in Drawings

Topal Barış Batuhan ; Yuret Deniz ; Sezgin Tevfik Metin

Domain-Adaptive Self-Supervised Pre-Training for Face & Body Detection
  in Drawings

Abstract

Drawings are powerful means of pictorial abstraction and communication.Understanding diverse forms of drawings, including digital arts, cartoons, andcomics, has been a major problem of interest for the computer vision andcomputer graphics communities. Although there are large amounts of digitizeddrawings from comic books and cartoons, they contain vast stylistic variations,which necessitate expensive manual labeling for training domain-specificrecognizers. In this work, we show how self-supervised learning, based on ateacher-student network with a modified student network update design, can beused to build face and body detectors. Our setup allows exploiting largeamounts of unlabeled data from the target domain when labels are provided foronly a small subset of it. We further demonstrate that style transfer can beincorporated into our learning pipeline to bootstrap detectors using a vastamount of out-of-domain labeled images from natural images (i.e., images fromthe real world). Our combined architecture yields detectors withstate-of-the-art (SOTA) and near-SOTA performance using minimal annotationeffort. Our code can be accessed fromhttps://github.com/barisbatuhan/DASS_Detector.

Code Repositories

barisbatuhan/dass_det_inference
Official
pytorch
Mentioned in GitHub
barisbatuhan/dass_detector
Official
pytorch
Mentioned in GitHub

Benchmarks

BenchmarkMethodologyMetrics
body-detection-on-clipart1kDASS-Detector (YOLOX XL)
MAP : 83.59
body-detection-on-comic2kDASS-Detector (YOLOX XL)
MAP : 73.65
body-detection-on-dcmDASS-Detector (YOLOX Tiny)
Average Precision: 87.06
body-detection-on-dcmDASS-Detector (YOLOX XL)
Average Precision: 86.14
body-detection-on-manga109DASS-Detector (YOLOX XL)
Average Precision: 87.98
body-detection-on-watercolor2kDASS-Detector (YOLOX XL)
MAP : 89.81
face-detection-on-dcmDASS-Detector (YOLOX XL)
Average Precision: 77.40
face-detection-on-dcmDASS-Detector (YOLOX Tiny)
Average Precision: 77.40
face-detection-on-icartoonfaceDASS-Detector (YOLOX Tiny)
Average Precision: 87.75
face-detection-on-icartoonfaceDASS-Detector (YOLOX XL)
Average Precision: 90.01
face-detection-on-manga109DASS-Detector (YOLOX XL)
Average Precision: 87.88
object-detection-on-manga109DASS-Detector (YOLOX Tiny)
Average Precision: 87.46
object-detection-on-manga109DASS-Detector (YOLOX XL)
Average Precision: 87.93
weakly-supervised-object-detection-on-1DASS-Detector (YOLOX Tiny)
MAP: 71.53
weakly-supervised-object-detection-on-2DASS-Detector (YOLOX Tiny)
MAP: 64.25
weakly-supervised-object-detection-on-comic2kDASS-Detector (YOLOX Tiny)
MAP: 67.41

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
Domain-Adaptive Self-Supervised Pre-Training for Face & Body Detection in Drawings | Papers | HyperAI