HyperAIHyperAI

Command Palette

Search for a command to run...

5 months ago

Back to MLP: A Simple Baseline for Human Motion Prediction

Guo Wen ; Du Yuming ; Shen Xi ; Lepetit Vincent ; Alameda-Pineda Xavier ; Moreno-Noguer Francesc

Back to MLP: A Simple Baseline for Human Motion Prediction

Abstract

This paper tackles the problem of human motion prediction, consisting inforecasting future body poses from historically observed sequences.State-of-the-art approaches provide good results, however, they rely on deeplearning architectures of arbitrary complexity, such as Recurrent NeuralNetworks(RNN), Transformers or Graph Convolutional Networks(GCN), typicallyrequiring multiple training stages and more than 2 million parameters. In thispaper, we show that, after combining with a series of standard practices, suchas applying Discrete Cosine Transform(DCT), predicting residual displacement ofjoints and optimizing velocity as an auxiliary loss, a light-weight networkbased on multi-layer perceptrons(MLPs) with only 0.14 million parameters cansurpass the state-of-the-art performance. An exhaustive evaluation on theHuman3.6M, AMASS, and 3DPW datasets shows that our method, named siMLPe,consistently outperforms all other approaches. We hope that our simple methodcould serve as a strong baseline for the community and allow re-thinking of thehuman motion prediction problem. The code is publicly available at\url{https://github.com/dulucas/siMLPe}.

Code Repositories

dulucas/simlpe
Official
pytorch
Mentioned in GitHub

Benchmarks

BenchmarkMethodologyMetrics
human-pose-forecasting-on-3dpwsiMLPe
Average MPJPE (mm) 1000 msec: 72.2
human-pose-forecasting-on-amasssiMLPe
Average MPJPE (mm) 1000 msec: 65.7
human-pose-forecasting-on-expi-common-actionssiMLPe
Average MPJPE (mm) @ 200 ms: 80
human-pose-forecasting-on-harperSiMLPe
Average MPJPE (mm) @ 1000ms: 141
Average MPJPE (mm) @ 400ms: 60
Last Frame MPJPE (mm) @ 1000ms: 264
Last Frame MPJPE (mm) @ 400ms: 98
human-pose-forecasting-on-human36msiMLPe
Average MPJPE (mm) @ 1000 ms: 109.4
Average MPJPE (mm) @ 400ms: 57.3
multi-person-pose-forecasting-on-expi-commonsiMLPe
Average MPJPE (mm) @ 1000 ms: 250
Average MPJPE (mm) @ 400 ms: 128
Average MPJPE (mm) @ 600 ms: 178
multi-person-pose-forecasting-on-expi-unseensiMLPe
Average MPJPE (mm) @ 400 ms: 131
Average MPJPE (mm) @ 600 ms: 183
Average MPJPE (mm) @ 800 ms: 225

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp