
摘要
视频超分辨率(VSR)方法通常比图像超分辨率方法包含更多的组件,因为它们需要利用额外的时间维度。复杂的设计并不少见。在本研究中,我们希望解开这些复杂性,并基于四个基本功能——传播、对齐、聚合和上采样——重新考虑一些最重要的组件。通过重用现有的一些组件并进行最小限度的重新设计,我们展示了一个简洁的流程,即BasicVSR,该流程在速度和恢复质量方面相比许多最先进的算法实现了显著的改进。我们进行了系统分析,解释了如何获得这些改进,并讨论了其中的不足之处。此外,我们还展示了BasicVSR的可扩展性,提出了一种信息补充机制和一种耦合传播方案以促进信息聚合。BasicVSR及其扩展版本IconVSR可以作为未来VSR方法的强大基线。
代码仓库
XPixelGroup/BasicSR
pytorch
GitHub 中提及
xinntao/BasicSR
pytorch
GitHub 中提及
Feynman1999/basicVSR_mge
tf
GitHub 中提及
Feynman1999/MgeEditing
GitHub 中提及
基准测试
| 基准 | 方法 | 指标 |
|---|---|---|
| video-deraining-on-vrds | BasicVSR | PSNR: 28.35 SSIM: 0.8990 |
| video-super-resolution-on-msu-super-1 | BasicVSR + x264 | BSQ-rate over ERQA: 1.659 BSQ-rate over LPIPS: 1.289 BSQ-rate over MS-SSIM: 0.751 BSQ-rate over PSNR: 1.212 BSQ-rate over Subjective Score: 1.49 BSQ-rate over VMAF: 0.714 |
| video-super-resolution-on-msu-super-1 | BasicVSR + aomenc | BSQ-rate over ERQA: 14.568 BSQ-rate over LPIPS: 4.938 BSQ-rate over MS-SSIM: 4.128 BSQ-rate over PSNR: 11.428 BSQ-rate over Subjective Score: 2.673 BSQ-rate over VMAF: 1.857 |
| video-super-resolution-on-msu-super-1 | BasicVSR + x265 | BSQ-rate over ERQA: 8.921 BSQ-rate over LPIPS: 13.198 BSQ-rate over MS-SSIM: 1.48 BSQ-rate over PSNR: 1.906 BSQ-rate over Subjective Score: 2.238 BSQ-rate over VMAF: 1.272 |
| video-super-resolution-on-msu-super-1 | BasicVSR + uavs3e | BSQ-rate over ERQA: 8.251 BSQ-rate over LPIPS: 4.383 BSQ-rate over MS-SSIM: 2.261 BSQ-rate over PSNR: 6.833 BSQ-rate over Subjective Score: 2.724 BSQ-rate over VMAF: 1.523 |
| video-super-resolution-on-msu-super-1 | BasicVSR + vvenc | BSQ-rate over ERQA: 18.333 BSQ-rate over LPIPS: 11.561 BSQ-rate over MS-SSIM: 0.919 BSQ-rate over PSNR: 5.781 BSQ-rate over Subjective Score: 2.659 BSQ-rate over VMAF: 0.676 |
| video-super-resolution-on-msu-vsr-benchmark | BasicVSR | 1 - LPIPS: 0.934 ERQAv1.0: 0.75 FPS: 2.128 PSNR: 31.443 QRCRv1.0: 0.709 SSIM: 0.9 Subjective score: 7.186 |
| video-super-resolution-on-udm10-4x-upscaling | IconVSR | PSNR: 40.03 SSIM: 0.9694 |
| video-super-resolution-on-udm10-4x-upscaling | BasicVSR | PSNR: 39.96 SSIM: 0.9694 |
| video-super-resolution-on-vid4-4x-upscaling | IconVSR | PSNR: 27.39 SSIM: 0.8279 |
| video-super-resolution-on-vid4-4x-upscaling | BasicVSR | PSNR: 27.24 SSIM: 0.8251 |
| video-super-resolution-on-vid4-4x-upscaling-1 | IconVSR | PSNR: 28.04 SSIM: 0.8570 |
| video-super-resolution-on-vid4-4x-upscaling-1 | BasicVSR | PSNR: 27.96 SSIM: 0.8553 |