Command Palette
Search for a command to run...
Subspace Clustering for Action Recognition with Covariance Representations and Temporal Pruning
Giancarlo Paoletti Jacopo Cavazza Cigdem Beyan Alessio Del Bue

Abstract
This paper tackles the problem of human action recognition, defined as classifying which action is displayed in a trimmed sequence, from skeletal data. Albeit state-of-the-art approaches designed for this application are all supervised, in this paper we pursue a more challenging direction: Solving the problem with unsupervised learning. To this end, we propose a novel subspace clustering method, which exploits covariance matrix to enhance the action's discriminability and a timestamp pruning approach that allow us to better handle the temporal dimension of the data. Through a broad experimental validation, we show that our computational pipeline surpasses existing unsupervised approaches but also can result in favorable performances as compared to supervised methods.
Code Repositories
Benchmarks
| Benchmark | Methodology | Metrics |
|---|---|---|
| skeleton-based-action-recognition-on-florence | Temporal Spectral Clustering + Temporal Subspace Clustering | Accuracy: 95.81% |
| skeleton-based-action-recognition-on-gaming | Temporal K-Means Clustering + Temporal Covariance Subspace Clustering | Accuracy: 92.91% |
| skeleton-based-action-recognition-on-hdm05 | Temporal Subspace Clustering | Accuracy: 89.80% |
| skeleton-based-action-recognition-on-msr | Temporal K-Means Clustering + Temporal Subspace Clustering | Accuracy: 88.51% |
| skeleton-based-action-recognition-on-msr-1 | Temporal Subspace Clustering | Accuracy: 98.02% |
| skeleton-based-action-recognition-on-msrc-12 | Temporal Subspace Clustering | Accuracy: 99.08% |
| skeleton-based-action-recognition-on-ut | Temporal Subspace Clustering | Accuracy: 99.50% |
Build AI with AI
From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.