HyperAIHyperAI

Command Palette

Search for a command to run...

4 months ago

Unsupervised Learning using Pretrained CNN and Associative Memory Bank

Qun Liu; Supratik Mukhopadhyay

Unsupervised Learning using Pretrained CNN and Associative Memory Bank

Abstract

Deep Convolutional features extracted from a comprehensive labeled dataset, contain substantial representations which could be effectively used in a new domain. Despite the fact that generic features achieved good results in many visual tasks, fine-tuning is required for pretrained deep CNN models to be more effective and provide state-of-the-art performance. Fine tuning using the backpropagation algorithm in a supervised setting, is a time and resource consuming process. In this paper, we present a new architecture and an approach for unsupervised object recognition that addresses the above mentioned problem with fine tuning associated with pretrained CNN-based supervised deep learning approaches while allowing automated feature extraction. Unlike existing works, our approach is applicable to general object recognition tasks. It uses a pretrained (on a related domain) CNN model for automated feature extraction pipelined with a Hopfield network based associative memory bank for storing patterns for classification purposes. The use of associative memory bank in our framework allows eliminating backpropagation while providing competitive performance on an unseen dataset.

Benchmarks

BenchmarkMethodologyMetrics
few-shot-image-classification-on-caltech-256UL-Hopfield (ULH)
Accuracy: 74.7
few-shot-image-classification-on-cifar100-5UL-Hopfield (ULH)
Accuracy: 89.6
fine-grained-image-classification-on-caltechUL-Hopfield (ULH)
Accuracy: 91.00
image-classification-on-cifar-10UL-Hopfield (ULH)
Percentage correct: 83.1
semi-supervised-image-classification-on-10UL-Hopfield (ULH)
Accuracy: 77.40%
semi-supervised-image-classification-on-11UL-Hopfield (ULH)
Accuracy: 77.40%
semi-supervised-image-classification-on-8UL-Hopfield (ULH)
Accuracy: 91.00%
semi-supervised-image-classification-on-9UL-Hopfield (ULH)
Accuracy: 91.00%
semi-supervised-image-classification-on-cifar-7UL-Hopfield (ULH)
Percentage error: 16.90

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
Unsupervised Learning using Pretrained CNN and Associative Memory Bank | Papers | HyperAI