HyperAI
Command Palette
Search for a command to run...
Video Understanding
Comprehending video content holistically, including action recognition, temporal localization, video question answering, and event detection.
Leaderboard
100 models total
Benchmarks
Video-MME
LongVideo Bench
MLVU
Ego-Schema
MV-Bench
NExT-QA
LV-Bench
QVHighlights
UMT (w/ audio + PT ASR Cpations)
ActivityNet-QA
MSVD-QA
MSR-VTT-QA
Charades-STA
TempCompass
Perception-Test
Video-MMMU
THUMOS-14
STAR
VSI-Bench
Coin
Streaming Bench
ActivityNet
FS-QAT
ActivityNet-Captions
Vid2Seq
Intent-QA
NExT-GQA
OVO-Bench
TACoS
CG-DETR
Kinetics-400
MMVU
ActivityNet-1.3
TGIF-QA
UCF-101
GQA
VNBench
AI2D
AGQA
CVQA
EventHallusion
NLVR2 Dev
ViLT-B/32
POPE
VQA-v2
HMDB-51
MM B
NLVR2 Test
BEiT-3
ShanghaiTech Weakly Supervised
TimeScope
Vid-Halluc
Video-Holmes
VMME
RVS-Ego
RVS-Movie
Something-Something (V2)
BLINK
K400
MF2
University-1652
LPN
MLVU-Test
UCF-Crime
Video-MME (long)
Doc-VQA
ImageNet-1K
MovieNet
ScienceQA
TextVQA
UBnormal
OCC-WS
VideoEspresso
Charades
FineVidBench
MM MU
RealWorldQA
SQA
TVSum
FlashVTG
VideoNIAH
WildVideo
YouCook2
E2vidD6-MASSalign-BiD
YouTube Highlights
CG-DETR
AVHaystacks-50
AVHaystacks-Full
Breakfast
CinePile
Math-Vista
MM-Bench
MMB-CN
MMIU
QAEgo4D
SEED
TGIF
TVBench
TVQA
VideoHallucer
VidSTG
Vinoground
VQAText
ActivityNet-RTL
ActivityNet-v1.3
CG-Bench-mini
Cholec 80
LoViT
Ego-ST Bench
Ego4D
EgoLifeQA
EGTEA
ImageNet VID 2015
Kinetics-700
Mantis
MME
SciQA
SS-V2
StreamBench
UBI-Fights
GMM
VCR-Bench
Vizwiz
ActNet-QA
Arc-Challenge
ChartQA
Cross-Task
EgoPlan
EgoSchema (subset)
Ekman6
EPIC-KITCHENS-100
eSports Sensors Dataset
SVM
FineAction
HAAN
HeiChole Benchmark
Hella-Swag
Kinetics-600
LongBench
LongTVQA
LongTVQA+
LSDBench
MIRB
MMLU
MotionBench
MSR-VTT
MSVD
NLVR2
Open-BookQA
TOMATO
VideoSIAH-Eval
VLEP
VSR
LXMERT
XD-Violence
50-Salads
AGQA-Decomp
Causal-VidQA
CLEVRER-MC
Ego4D-NLQ
FutureBench
HCSTVG-v2
HumanML3D
ST-MLP
LVU
MathVerse
MM-Vet
Moments in Time V1
MovieChat-1K
Muir-Bench
Penn Action
PercepTest
SoccerNet-v2
SSv2-MC
TemporalBench
UnAV-100
VAGU
Video-MME(no subtitle)
VideoMME w/ sub.
VideoMME w/o sub.
ViTT
VStream-QA
3D-assisted Dialogue
ActivityNet-VRL
ActivityQA
ALFRED
ANet-Caption
ANet-QA
Animal Kingdom
AoTBench
CG-Bench
Diving-48
Drive&Act
EasyCom
Ego-R1 Bench
EgoMQ
EGOPOINTVQA
EgoTempo
EK-100 CLS
EK-100 MIR
ELV-Halluc
EMMA
HACS
HC-STVG
HCSTVG-v1
How2QA
Image Edit Instruction
K700
KIT Motion-Language
MLP+GRU
LAV-DF
LLaVA-Interleave Bench
LLaVA^W
LongVideoBench_val
M3CoT
MATH-Vision
MathVerse-mv
MISAW
MLVU-dev
MM-IQ
MM-Math
MMMU-mv
MMMU-Pro
MMSI
MovieChat
MSR-Action3D
MUIR
Multi-image VQA
Multi-THUMOS
MUSIC-AVQA
MV-MATH
NBA
nuScenes VQA
OCR-Bench
OnlineMMSI
OpenEQA
Perception
PitVQA
Puzzle
Q-Bench
ScanQA
SceneBench
SciVerse-mv
SHREC'17
Sports-QA
SportsMoments
Spot the Difference
SSV2-QA
Task Decomposition
Text-rich VQA
TVQA+
VIDAL-QA
VideoChatGPT
VideoMME (w/o sub.)
VIDHAL
Visual Story Telling
VisWiz
VQAT
WebVid-QA
YouTube-HL
Active Memories Benchmark (AMB)
ActivityForensics
ActivityNet-Caption
ANC-S
AV-Counting
AV-Odyssey
ave.
AVSD
CALTECH-101
CCD
DSTA
CIFAR-100
CREMA-D
VAVL
Daily-Omni
DynPose-100K
E.T. Bench
E.T. Bench (Subset)
Ego-Exo4D
Ego4D Goal-Step
EgoProceL
EgoTaskQA
EgoTaskVQA
EventDrive
FALCON-Bench
Friends-MMC
FunQA
GraSP
MuST
HippoVlog
InfographicVQA
IntentBench
iVQA
Kinetics
L-VidBench
LLama-Vid
LongVB
Mantis-Eval
MiTv1
MM-Star
MMA-52
MMR-V
Movie QA
MultiClip-Bench
ODV-Bench
OK-VQA
OMEBench
OmniBench
Panda
PKU Multi-Modality Dataset
QVHighlight
RexTime
RivaBench
SEED-Bench-R1
SheepActivity
Shot2Story20K
Shotluck-Holmes (3.1B)
ShotBench
SQA-IMG
SQA^I
STAR-sub
Streamo-Bench
TAU-106K
Toyota Smarthome Untrimmed
TSL300
TSU
TVQA-Long
VidChapters-7M
Video-MME(wo sub)
VideoHallu
ViTIB
VLN-QA
Vript-RR
Worldsense
1 Megapixel Automotive Detection Dataset
20BN-Jester
ActionBench
Active Memory Benchmark
ActivityNet-MR
ActivityNet-RF
ANet
ANet-Captions
AVA
AVL, AVS
AVQA
BBC
BDD100K val
FM-Net
BestShot Benchmark
Breakfast Actions
C-GQA
C-Sports
CATE
CATER
Charade-STA
Charades-CG
Charades-RF
CholecT45
CIFAR-10
CLEVRER
CLIP Classification Benchmark
CLIP Retrieval Benchmark (Flickr)
CMU-MOSEI
Comma.ai
Country-211
CUEBENCH
CUVA
CVS
DTD
DynSuperCLEVR
EgoExoLearn
EgoMCQ
EgoMe
EgoMem
EgoMemoria
EgoNormia
EgoYC2
EGTEA Gaze+
EK-100
Env-QA
ERQA
Euro SAT
EV2-Bench
Event-Chat
EventBench
Explicit Omni-SILA Dataset
FavorBench
FER2013
FGV-CAircraft
FineDiving-QA
Flowers-102
Food-101
GPS
GTEA
GTSRB
H2O
HAICBench
Hallusion Bench
HD-EPIC++
HDD
HLVid
HMDB51-VISPR
Hollywood Extended
HT-Step
HTM-Align
Human-P&C
HVU
IKEA-ASM
ImageNet-Adv.
ImageNet-Ren.
ImageNet-Ske.
ImageNet-V2
Implicit Omni-SILA Dataset
K-600
Kinetics700-QA
LiViBench
LLaVA-Bench-in-the-wild
LLP
LongVideo-Reason
LongVideo-Reason-eval
LSMDC
LVB
LVR
M-VAE dataset
MA-Bench
MECD
VGCM
MM-AU
MMSI-Bench
MMT-Bench
MMVU(mc)
MNIST
MomentDETR
MOSCATO-EGTEA
MoVid-Bench-Motion
MoVid-Bench-Video
MSRVT
MUSES
Music
MUSIC-AVQA-Real
MUSIC-QA
NAP
NaVQA
NCAA
Nexar
NExT-VMR
NextQA-MC
NextQA-valset
NGSIM
TraPHic
NIV
Nymeria
ObjectNet
OC-NaVQA
OmniGround
OmniSpatial
Open X-Embodiment
OV-SD
PALADIN
PCAM
Pets
PKU-MMD-CS
PLM-VideoBench
ProReady-QA
ProstaTD
QV-M2
R-AVST
R4D-Bench
RARP
RE-SISC45
RefAVA
Rendered-SST2
RES
RoadSocial-QA
RoboX-VQA
SA
Sat
ScienceQA-Image
ScienceQA-IMG
SEED-Bench
SEED-Image
Sensor
SFX-Moment
Sports-3K-QA
SSv2-Small
ST-Align
ST-Align benchmark
Stanford-Cars
STAR-bench-QA
Sth-V2
STI-Bench
STL-10
STVD-PVCD
STVG
SUN-397
SurgPub-Video
SUTD
Swing
Temporal Audio Grounding
TemporalBench (S)
TextQA
THUMOS' 14
FS-QAT
Timeline Speech Summarization
TRAF
TraPHic
TSU-CS
TVSeries
UAV-SVG
UCF101-VISPR
Udacity
FM-Net
UFVideo-Bench
unknown
VAST-Bench
VCG-Bench
VDC
VEU-Bench
VidDiffBench
VideoEval-Pro
VideoMathQA
VideoMME (S)
VideoMME_short
VideoMME_w/sub.
VideoRefer-Bench-Q
VideoVista
VidTAB
VITATECS
VIUBench
VLM4D-real
VMB
VOC 2007
VRBench
VS-Ego
VS-Movie
VSGR
VSTI-Bench
VSTREAM-QA-EGO
VTV150K
WiFi-HAR
YJMob100K@B
YJMob100K@C
ST-MoE-BERT
YJMob100K@D