HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

Blindly Assess Quality of In-the-Wild Videos via Quality-aware Pre-training and Motion Perception

Bowen Li Weixia Zhang Meng Tian Guangtao Zhai Xianpei Wang

Blindly Assess Quality of In-the-Wild Videos via Quality-aware Pre-training and Motion Perception

Abstract

Perceptual quality assessment of the videos acquired in the wilds is of vital importance for quality assurance of video services. The inaccessibility of reference videos with pristine quality and the complexity of authentic distortions pose great challenges for this kind of blind video quality assessment (BVQA) task. Although model-based transfer learning is an effective and efficient paradigm for the BVQA task, it remains to be a challenge to explore what and how to bridge the domain shifts for better video representation. In this work, we propose to transfer knowledge from image quality assessment (IQA) databases with authentic distortions and large-scale action recognition with rich motion patterns. We rely on both groups of data to learn the feature extractor. We train the proposed model on the target VQA databases using a mixed list-wise ranking loss function. Extensive experiments on six databases demonstrate that our method performs very competitively under both individual database and mixed database training settings. We also verify the rationality of each component of the proposed method and explore a simple manner for further improvement.

Code Repositories

zwx8981/tcsvt-2022-bvqa
pytorch
Mentioned in GitHub
zwx8981/BVQA-2021
Official
pytorch
Mentioned in GitHub

Benchmarks

BenchmarkMethodologyMetrics
video-quality-assessment-on-konvid-1kBVQA-2022
PLCC: 0.834
video-quality-assessment-on-live-fb-lsvqBVQA-2022
PLCC: 0.854
video-quality-assessment-on-live-vqcBVQA-2022
PLCC: 0.839
video-quality-assessment-on-msu-video-qualityLI
KLCC: 0.7640
PLCC: 0.9270
SRCC: 0.9131
Type: NR
video-quality-assessment-on-youtube-ugcBVQA-2022
PLCC: 0.8178

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
Blindly Assess Quality of In-the-Wild Videos via Quality-aware Pre-training and Motion Perception | Papers | HyperAI