Video Retrieval On Msvd

评估指标

text-to-video R@1
video-to-text R@1

评测结果

各个模型在此基准测试上的表现结果

Paper TitleRepository
InternVideo2-6B61.485.2InternVideo2: Scaling Foundation Models for Multimodal Video Understanding
HunYuan_tvr (huge)59.073.0Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations-
InternVideo58.476.3InternVideo: General Video Foundation Models via Generative and Discriminative Learning
HunYuan_tvr58.269.1Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations-
vid-TLDR (UMT-L)57.982.7vid-TLDR: Training Free Token merging for Light-weight Video Transformer
VLAB57.5-VLAB: Enhancing Video Language Pre-training by Feature Adapting and Blending-
MDMMT-256.8-MDMMT-2: Multidomain Multimodal Transformer for Video Retrieval, One More Step Towards Generalization-
Side4Video56.1-Side4Video: Spatial-Temporal Side Network for Memory-Efficient Image-to-Video Transfer Learning
CAMoE51.869.3Improving Video-Text Retrieval by Multi-Stream Corpus Alignment and Dual Softmax Loss
Cap4Video51.870.0Cap4Video: What Can Auxiliary Captions Do for Text-Video Retrieval?
CenterCLIP (ViT-B/16)50.668.4CenterCLIP: Token Clustering for Efficient Text-Video Retrieval
X-CLIP50.466.8X-CLIP: End-to-End Multi-grained Contrastive Learning for Video-Text Retrieval
DMAE (ViT-B/32)48.7-Dual-Modal Attention-Enhanced Text-Video Retrieval with Triplet Partial Margin Contrastive Learning
QB-Norm+CLIP2Video48.0-Cross Modal Retrieval with Querybank Normalisation
DiffusionRet+QB-Norm47.960.3DiffusionRet: Generative Text-Video Retrieval with Diffusion Model
PAU47.368.9Prototype-based Aleatoric Uncertainty Quantification for Cross-modal Retrieval
X-Pool47.266.4X-Pool: Cross-Modal Language-Video Attention for Text-Video Retrieval
DiffusionRet46.661.9DiffusionRet: Generative Text-Video Retrieval with Diffusion Model
CLIP4Clip46.262.0CLIP4Clip: An Empirical Study of CLIP for End to End Video Clip Retrieval
LAFF45.4-Lightweight Attentional Feature Fusion: A New Baseline for Text-to-Video Retrieval
0 of 24 row(s) selected.
Video Retrieval On Msvd | SOTA | HyperAI超神经