HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

Subspace Clustering for Action Recognition with Covariance Representations and Temporal Pruning

Giancarlo Paoletti Jacopo Cavazza Cigdem Beyan Alessio Del Bue

Subspace Clustering for Action Recognition with Covariance Representations and Temporal Pruning

Abstract

This paper tackles the problem of human action recognition, defined as classifying which action is displayed in a trimmed sequence, from skeletal data. Albeit state-of-the-art approaches designed for this application are all supervised, in this paper we pursue a more challenging direction: Solving the problem with unsupervised learning. To this end, we propose a novel subspace clustering method, which exploits covariance matrix to enhance the action's discriminability and a timestamp pruning approach that allow us to better handle the temporal dimension of the data. Through a broad experimental validation, we show that our computational pipeline surpasses existing unsupervised approaches but also can result in favorable performances as compared to supervised methods.

Code Repositories

Benchmarks

BenchmarkMethodologyMetrics
skeleton-based-action-recognition-on-florenceTemporal Spectral Clustering + Temporal Subspace Clustering
Accuracy: 95.81%
skeleton-based-action-recognition-on-gamingTemporal K-Means Clustering + Temporal Covariance Subspace Clustering
Accuracy: 92.91%
skeleton-based-action-recognition-on-hdm05Temporal Subspace Clustering
Accuracy: 89.80%
skeleton-based-action-recognition-on-msrTemporal K-Means Clustering + Temporal Subspace Clustering
Accuracy: 88.51%
skeleton-based-action-recognition-on-msr-1Temporal Subspace Clustering
Accuracy: 98.02%
skeleton-based-action-recognition-on-msrc-12Temporal Subspace Clustering
Accuracy: 99.08%
skeleton-based-action-recognition-on-utTemporal Subspace Clustering
Accuracy: 99.50%

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
Subspace Clustering for Action Recognition with Covariance Representations and Temporal Pruning | Papers | HyperAI