HyperAIHyperAI

Command Palette

Search for a command to run...

5 months ago

LAVIB: A Large-scale Video Interpolation Benchmark

Alexandros Stergiou

LAVIB: A Large-scale Video Interpolation Benchmark

Abstract

This paper introduces a LArge-scale Video Interpolation Benchmark (LAVIB) for the low-level video task of Video Frame Interpolation (VFI). LAVIB comprises a large collection of high-resolution videos sourced from the web through an automated pipeline with minimal requirements for human verification. Metrics are computed for each video's motion magnitudes, luminance conditions, frame sharpness, and contrast. The collection of videos and the creation of quantitative challenges based on these metrics are under-explored by current low-level video task datasets. In total, LAVIB includes 283K clips from 17K ultra-HD videos, covering 77.6 hours. Benchmark train, val, and test sets maintain similar video metric distributions. Further splits are also created for out-of-distribution (OOD) challenges, with train and test splits including videos of dissimilar attributes.

Code Repositories

alexandrosstergiou/lavib
Official
pytorch
Mentioned in GitHub

Benchmarks

BenchmarkMethodologyMetrics
video-frame-interpolation-on-lavibRIFE
LPIPS: 0.1416
PSNR: 27.88
SSIM: 0.871
video-frame-interpolation-on-lavibEMA-VFI
LPIPS: 0.03105
PSNR: 33.14
SSIM: 0.978
video-frame-interpolation-on-lavibFLAVR
LPIPS: 0.02934
PSNR: 33.44
SSIM: 0.981

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp