HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

A comparison of small sample methods for Handshape Recognition

{Laura Lanzarini Waldo Hasperué Pedro Dal Bianco Gastón Gustavo Ríos Ulises Jeremias Cornejo Fandos Franco Ronchetti Facundo Quiroga}

Abstract

Automatic Sign Language Translation (SLT) systems can be a great asset to improve the communication with and within deaf communities. Currently, the main issue preventing effective translation models lays in the low availability of labelled data, which hinders the use of modern deep learning models.SLT is a complex problem that involves many subtasks, of which handshape recognition is the most important. We compare a series of models specially tailored for small datasets to improve their performance on handshape recognition tasks. We evaluate Wide-DenseNet and few-shot Prototypical Network models with and without transfer learning, and also using Model-Agnostic Meta-Learning (MAML).Our findings indicate that Wide-DenseNet without transfer learning and Prototipical Networks with transfer learning provide the best results. Prototypical networks, particularly, are vastly superior when using less than 30 samples, while Wide-DenseNet achieves the best results with more samples. On the other hand, MAML does not improve performance in any scenario. These results can help to design better SLT models.

Benchmarks

BenchmarkMethodologyMetrics
hand-gesture-recognition-on-lsa16Prototypical Networks + CNN
Accuracy : 98.38
hand-gesture-recognition-on-rwth-phoenixDenseNet
Accuracy : 96.05

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
A comparison of small sample methods for Handshape Recognition | Papers | HyperAI