HyperAIHyperAI

Command Palette

Search for a command to run...

4 months ago

AutoAugment: Learning Augmentation Policies from Data

Ekin D. Cubuk; Barret Zoph; Dandelion Mane; Vijay Vasudevan; Quoc V. Le

AutoAugment: Learning Augmentation Policies from Data

Abstract

Data augmentation is an effective technique for improving the accuracy of modern image classifiers. However, current data augmentation implementations are manually designed. In this paper, we describe a simple procedure called AutoAugment to automatically search for improved data augmentation policies. In our implementation, we have designed a search space where a policy consists of many sub-policies, one of which is randomly chosen for each image in each mini-batch. A sub-policy consists of two operations, each operation being an image processing function such as translation, rotation, or shearing, and the probabilities and magnitudes with which the functions are applied. We use a search algorithm to find the best policy such that the neural network yields the highest validation accuracy on a target dataset. Our method achieves state-of-the-art accuracy on CIFAR-10, CIFAR-100, SVHN, and ImageNet (without additional data). On ImageNet, we attain a Top-1 accuracy of 83.5% which is 0.4% better than the previous record of 83.1%. On CIFAR-10, we achieve an error rate of 1.5%, which is 0.6% better than the previous state-of-the-art. Augmentation policies we find are transferable between datasets. The policy learned on ImageNet transfers well to achieve significant improvements on other datasets, such as Oxford Flowers, Caltech-101, Oxford-IIT Pets, FGVC Aircraft, and Stanford Cars.

Code Repositories

serfaniane/siamese_person_re_id
tf
Mentioned in GitHub
ilyak93/GAIN-pytorch
pytorch
Mentioned in GitHub
abcp4/DAPytorch
pytorch
Mentioned in GitHub
LMaxence/Cifar10_Classification
pytorch
Mentioned in GitHub
2han9x1a0release/RLCC
pytorch
Mentioned in GitHub
lyxxn0414/test-data-generation
tf
Mentioned in GitHub
junkwhinger/fastautoaugment_jsh
pytorch
Mentioned in GitHub
open-mmlab/mmpretrain
pytorch
Mentioned in GitHub
YaCpotato/deepaugmentFix
Mentioned in GitHub
mingsun-tse/good-da-in-kd
pytorch
Mentioned in GitHub
4uiiurz1/pytorch-auto-augment
pytorch
Mentioned in GitHub
zhanghang1989/fast-autoaug-torch
pytorch
Mentioned in GitHub
ofa-sys/chinese-clip
pytorch
Mentioned in GitHub
northeastsquare/effficientnet
tf
Mentioned in GitHub
QQBrowserVideoSearch/CBVS-UniCLIP
pytorch
Mentioned in GitHub
barisozmen/deepaugment
Mentioned in GitHub
DeepVoltaire/AutoAugment
pytorch
Mentioned in GitHub

Benchmarks

BenchmarkMethodologyMetrics
data-augmentation-on-imagenetResNet-200 (AA)
Accuracy (%): 80.0
data-augmentation-on-imagenetResNet-50 (AA)
Accuracy (%): 77.6
domain-generalization-on-vizwizEfficientNet-B0 (autoaug)
Accuracy - All Images: 34.9
Accuracy - Clean Images: 40.1
Accuracy - Corrupted Images: 27.3
domain-generalization-on-vizwizEfficientNet-B1 (autoaug)
Accuracy - All Images: 39.7
Accuracy - Clean Images: 44.4
Accuracy - Corrupted Images: 32.8
domain-generalization-on-vizwizEfficientNet-B2 (autoaug)
Accuracy - All Images: 41.6
Accuracy - Clean Images: 45.8
Accuracy - Corrupted Images: 34.3
domain-generalization-on-vizwizEfficientNet-B3 (autoaug)
Accuracy - All Images: 42.6
Accuracy - Clean Images: 47.5
Accuracy - Corrupted Images: 34.9
fine-grained-image-classification-on-caltechAutoAugment
Top-1 Error Rate: 13.07%
fine-grained-image-classification-on-fgvcAutoAugment
Accuracy: 92.67%
Top-1 Error Rate: 7.33
fine-grained-image-classification-on-oxford AutoAugment
Accuracy: 95.36%
Top-1 Error Rate: 4.64%
fine-grained-image-classification-on-oxford-1AutoAugment
Accuracy: 88.98%
Top-1 Error Rate: 11.02%
fine-grained-image-classification-on-stanfordAutoAugment
Accuracy: 94.8%
image-classification-on-cifar-100PyramidNet+ShakeDrop
Percentage correct: 89.3

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
AutoAugment: Learning Augmentation Policies from Data | Papers | HyperAI