HyperAIHyperAI
HomeConsoleDocsNewsPapersTutorialsDatasetsWikiSOTALLM ModelsGPU LeaderboardEvents
Search
About
HyperAIHyperAI

Command Palette

Search for a command to run...

Audio Classification On Vggsound

Metrics

Top 1 Accuracy

Results

Performance results of various models on this benchmark

Paper TitleRepository
Mirasol3B69.8Mirasol3B: A Multimodal Autoregressive model for time-aligned and contextual modalities-
ONE-PEACE (Audio-Visual)68.2ONE-PEACE: Exploring One General Representation Model Toward Unlimited Modalities
MAViL67.1--
EquiAV67.1EquiAV: Leveraging Equivariance for Audio-Visual Contrastive Learning
MMT (Audio-Visual)66.2Multiscale Multimodal Transformer for Multimodal Action Recognition-
CAV-MAE (Audio-Visual)65.9Contrastive Audio-Visual Masked Autoencoder
UAVM (Audio + Video)65.8UAVM: Towards Unifying Audio and Visual Models
Audiovisual Masked Autoencoder (Audiovisual, Single)65.0Audiovisual Masked Autoencoders
AVT (Audio-Visual)63.9AVT: Audio-Video Transformer for Multimodal Action Recognition-
ONE-PEACE (Audio-Only)59.6ONE-PEACE: Exploring One General Representation Model Toward Unlimited Modalities
CAV-MAE (Audio-Only)59.5Contrastive Audio-Visual Masked Autoencoder
Audiovisual Masked Autoencoder (Audio-only, Single)57.2Audiovisual Masked Autoencoders
MAST (Audio Only)57.0Multiscale Audio Spectrogram Transformer for Efficient Audio Classification-
UAVM (Audio Only)56.5UAVM: Towards Unifying Audio and Visual Models
MMT (Video)56.1Multiscale Multimodal Transformer for Multimodal Action Recognition-
PlayItBackX353.7Play It Back: Iterative Attention for Audio Recognition
AVT (V)53.2AVT: Audio-Video Transformer for Multimodal Action Recognition-
MBT (A)52.3Attention Bottlenecks for Multimodal Fusion
MBT (V)51.2Attention Bottlenecks for Multimodal Fusion
UAVM (Video Only)49.9UAVM: Towards Unifying Audio and Visual Models
0 of 21 row(s) selected.
Audio Classification On Vggsound | SOTA | HyperAI