HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

Bamboo: Building Mega-Scale Vision Dataset Continually with Human-Machine Synergy

Yuanhan Zhang Qinghong Sun Yichun Zhou Zexin He Zhenfei Yin Kun Wang Lu Sheng Yu Qiao Jing Shao Ziwei Liu

Bamboo: Building Mega-Scale Vision Dataset Continually with Human-Machine Synergy

Abstract

Large-scale datasets play a vital role in computer vision. But current datasets are annotated blindly without differentiation to samples, making the data collection inefficient and unscalable. The open question is how to build a mega-scale dataset actively. Although advanced active learning algorithms might be the answer, we experimentally found that they are lame in the realistic annotation scenario where out-of-distribution data is extensive. This work thus proposes a novel active learning framework for realistic dataset annotation. Equipped with this framework, we build a high-quality vision dataset -- Bamboo, which consists of 69M image classification annotations with 119K categories and 28M object bounding box annotations with 809 categories. We organize these categories by a hierarchical taxonomy integrated from several knowledge bases. The classification annotations are four times larger than ImageNet22K, and that of detection is three times larger than Object365. Compared to ImageNet22K and Objects365, models pre-trained on Bamboo achieve superior performance among various downstream tasks (6.2% gains on classification and 2.1% gains on detection). We believe our active learning framework and Bamboo are essential for future work.

Code Repositories

davidzhangyuanhan/bamboo
Official
pytorch
Mentioned in GitHub
zhangyuanhan-ai/bamboo
Official
pytorch
Mentioned in GitHub

Benchmarks

BenchmarkMethodologyMetrics
fine-grained-image-classification-on-caltechBamboo (ViT-B/16)
Accuracy: 94.8
fine-grained-image-classification-on-oxford-1Bamboo (ViT-B/16)
Accuracy: 95.1%
fine-grained-image-classification-on-stanfordBamboo (ViT-B/16)
Accuracy: 93.9%
fine-grained-image-classification-on-sun397Bamboo (ViT-B/16)
Accuracy: 79.5
image-classification-on-cifar-10Bamboo (ViT-B/16)
Percentage correct: 98.2
image-classification-on-cifar-100Bamboo (ViT-B/16)
Percentage correct: 90.2
image-classification-on-dtdBamboo (ViT-B/16)
Accuracy: 81.9
image-classification-on-flowers-102Bamboo (ViT-B/16)
Accuracy: 99.7
image-classification-on-food-101-1Bamboo (ViTB/16)
Accuracy (%): 92.9
image-classification-on-objectnetVit B/16 (Bamboo)
Top-1 Accuracy: 53.9
image-classification-on-objectnetResNet-50 (Bamboo)
Top-1 Accuracy: 38.8
image-classification-on-omnibenchmarkBamboo-R50
Average Top-1 Accuracy: 45.4

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
Bamboo: Building Mega-Scale Vision Dataset Continually with Human-Machine Synergy | Papers | HyperAI