4 个月前

BasicVSR:视频超分辨率及更广泛领域中基本组件的探索

BasicVSR:视频超分辨率及更广泛领域中基本组件的探索

摘要

视频超分辨率(VSR)方法通常比图像超分辨率方法包含更多的组件,因为它们需要利用额外的时间维度。复杂的设计并不少见。在本研究中,我们希望解开这些复杂性,并基于四个基本功能——传播、对齐、聚合和上采样——重新考虑一些最重要的组件。通过重用现有的一些组件并进行最小限度的重新设计,我们展示了一个简洁的流程,即BasicVSR,该流程在速度和恢复质量方面相比许多最先进的算法实现了显著的改进。我们进行了系统分析,解释了如何获得这些改进,并讨论了其中的不足之处。此外,我们还展示了BasicVSR的可扩展性,提出了一种信息补充机制和一种耦合传播方案以促进信息聚合。BasicVSR及其扩展版本IconVSR可以作为未来VSR方法的强大基线。

基准测试

基准方法指标
video-deraining-on-vrdsBasicVSR
PSNR: 28.35
SSIM: 0.8990
video-super-resolution-on-msu-super-1BasicVSR + x264
BSQ-rate over ERQA: 1.659
BSQ-rate over LPIPS: 1.289
BSQ-rate over MS-SSIM: 0.751
BSQ-rate over PSNR: 1.212
BSQ-rate over Subjective Score: 1.49
BSQ-rate over VMAF: 0.714
video-super-resolution-on-msu-super-1BasicVSR + aomenc
BSQ-rate over ERQA: 14.568
BSQ-rate over LPIPS: 4.938
BSQ-rate over MS-SSIM: 4.128
BSQ-rate over PSNR: 11.428
BSQ-rate over Subjective Score: 2.673
BSQ-rate over VMAF: 1.857
video-super-resolution-on-msu-super-1BasicVSR + x265
BSQ-rate over ERQA: 8.921
BSQ-rate over LPIPS: 13.198
BSQ-rate over MS-SSIM: 1.48
BSQ-rate over PSNR: 1.906
BSQ-rate over Subjective Score: 2.238
BSQ-rate over VMAF: 1.272
video-super-resolution-on-msu-super-1BasicVSR + uavs3e
BSQ-rate over ERQA: 8.251
BSQ-rate over LPIPS: 4.383
BSQ-rate over MS-SSIM: 2.261
BSQ-rate over PSNR: 6.833
BSQ-rate over Subjective Score: 2.724
BSQ-rate over VMAF: 1.523
video-super-resolution-on-msu-super-1BasicVSR + vvenc
BSQ-rate over ERQA: 18.333
BSQ-rate over LPIPS: 11.561
BSQ-rate over MS-SSIM: 0.919
BSQ-rate over PSNR: 5.781
BSQ-rate over Subjective Score: 2.659
BSQ-rate over VMAF: 0.676
video-super-resolution-on-msu-vsr-benchmarkBasicVSR
1 - LPIPS: 0.934
ERQAv1.0: 0.75
FPS: 2.128
PSNR: 31.443
QRCRv1.0: 0.709
SSIM: 0.9
Subjective score: 7.186
video-super-resolution-on-udm10-4x-upscalingIconVSR
PSNR: 40.03
SSIM: 0.9694
video-super-resolution-on-udm10-4x-upscalingBasicVSR
PSNR: 39.96
SSIM: 0.9694
video-super-resolution-on-vid4-4x-upscalingIconVSR
PSNR: 27.39
SSIM: 0.8279
video-super-resolution-on-vid4-4x-upscalingBasicVSR
PSNR: 27.24
SSIM: 0.8251
video-super-resolution-on-vid4-4x-upscaling-1IconVSR
PSNR: 28.04
SSIM: 0.8570
video-super-resolution-on-vid4-4x-upscaling-1BasicVSR
PSNR: 27.96
SSIM: 0.8553

用 AI 构建 AI

从想法到上线——通过免费 AI 协同编程、开箱即用的环境和市场最优价格的 GPU 加速您的 AI 开发

AI 协同编程
即用型 GPU
最优价格
立即开始

Hyper Newsletters

订阅我们的最新资讯
我们会在北京时间 每周一的上午九点 向您的邮箱投递本周内的最新更新
邮件发送服务由 MailChimp 提供