HyperAIHyperAI

Command Palette

Search for a command to run...

5 months ago

DAVE -- A Detect-and-Verify Paradigm for Low-Shot Counting

Pelhan Jer ; Lukežič Alan ; Zavrtanik Vitjan ; Kristan Matej

DAVE -- A Detect-and-Verify Paradigm for Low-Shot Counting

Abstract

Low-shot counters estimate the number of objects corresponding to a selectedcategory, based on only few or no exemplars annotated in the image. The currentstate-of-the-art estimates the total counts as the sum over the object locationdensity map, but does not provide individual object locations and sizes, whichare crucial for many applications. This is addressed by detection-basedcounters, which, however fall behind in the total count accuracy. Furthermore,both approaches tend to overestimate the counts in the presence of other objectclasses due to many false positives. We propose DAVE, a low-shot counter basedon a detect-and-verify paradigm, that avoids the aforementioned issues by firstgenerating a high-recall detection set and then verifying the detections toidentify and remove the outliers. This jointly increases the recall andprecision, leading to accurate counts. DAVE outperforms the top density-basedcounters by ~20% in the total count MAE, it outperforms the most recentdetection-based counter by ~20% in detection quality and sets a newstate-of-the-art in zero-shot as well as text-prompt-based counting.

Code Repositories

jerpelhan/dave
Official
pytorch
Mentioned in GitHub

Benchmarks

BenchmarkMethodologyMetrics
exemplar-free-counting-on-fsc147DAVE
MAE(test): 15.14
MAE(val): 15.54
RMSE(test): 103.49
RMSE(val): 52.67
few-shot-object-counting-and-detection-onDAVE
AP(test): 26.81
AP50(test): 62.82
MAE(test): 10.45
RMSE(test): 74.51
object-counting-on-fsc147DAVE
MAE(test): 8.66
MAE(val): 8.91
RMSE(test): 32.36
RMSE(val): 28.08

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
DAVE -- A Detect-and-Verify Paradigm for Low-Shot Counting | Papers | HyperAI