4 个月前

SwinIA:无需卷积的自监督盲点图像去噪

SwinIA:无需卷积的自监督盲点图像去噪

摘要

自监督图像去噪是指在没有真实图像的情况下从噪声图像中恢复信号。目前该领域的最佳解决方案通常依赖于使用全卷积神经网络预测被遮掩的像素。这通常需要多次前向传递、噪声模型的信息或复杂的正则化函数。本文提出了一种基于Swin Transformer的图像自动编码器(SwinIA),这是首个用于自监督去噪的全Transformer架构。注意力机制的灵活性有助于实现卷积方法通常只能近似的盲点特性。SwinIA可以端到端地使用简单的均方误差损失进行训练,无需遮掩操作,也不需要任何关于干净数据或噪声分布的先验知识。SwinIA易于使用,并在多个常见的基准测试中建立了新的最先进水平。

基准测试

基准方法指标
color-image-denoising-on-bsd300-lambda30SwinIA
PSNR: 27.92
SSIM: 0.775
color-image-denoising-on-bsd300-lambda5-50SwinIA
PSNR: 27.74
SSIM: 0.764
color-image-denoising-on-bsd300-sigma25SwinIA
PSNR: 28.4
SSIM: 0.789
color-image-denoising-on-bsd300-sigma5-50SwinIA
PSNR: 28.4
SSIM: 0.785
color-image-denoising-on-kodak24-lambda30SwinIA
PSNR: 29.51
SSIM: 0.805
color-image-denoising-on-kodak24-lambda5-50SwinIA
PSNR: 29.06
SSIM: 0.788
color-image-denoising-on-kodak24-sigma25SwinIA
PSNR: 30.12
SSIM: 0.819
color-image-denoising-on-kodak24-sigma5-50SwinIA
PSNR: 30.3
SSIM: 0.820
color-image-denoising-on-set14-lambda30SwinIA
PSNR: 28.74
SSIM: 0.799
color-image-denoising-on-set14-lambda5-50SwinIA
PSNR: 28.27
SSIM: 0.780
color-image-denoising-on-set14-sigma25SwinIA
PSNR: 29.54
SSIM: 0.814
color-image-denoising-on-set14-sigma5-50SwinIA
PSNR: 29.49
SSIM: 0.809
grayscale-image-denoising-on-bsd68-sigma15SwinIA
PSNR: 31.07
SSIM: 0.856
grayscale-image-denoising-on-bsd68-sigma25SwinIA
PSNR: 29.17
SSIM: 0.801
grayscale-image-denoising-on-bsd68-sigma50SwinIA
PSNR: 26.61
SSIM: 0.706
grayscale-image-denoising-on-hanziSwinIA
PSNR: 14.35
SSIM: 0.556
grayscale-image-denoising-on-set12-sigma15SwinIA
PSNR: 30.37
SSIM: 0.857
grayscale-image-denoising-on-set12-sigma25SwinIA
PSNR: 28.72
SSIM: 0.817
grayscale-image-denoising-on-set12-sigma50SwinIA
PSNR: 26.03
SSIM: 0.736
medical-image-denoising-on-fmd-confocal-fishSwinIA
PSNR: 31.79
SSIM: 0.871
medical-image-denoising-on-fmd-confocal-miceSwinIA
PSNR: 37.65
SSIM: 0.960
medical-image-denoising-on-fmd-two-photonSwinIA
PSNR: 33.25
SSIM: 0.915

用 AI 构建 AI

从想法到上线——通过免费 AI 协同编程、开箱即用的环境和市场最优价格的 GPU 加速您的 AI 开发

AI 协同编程
即用型 GPU
最优价格
立即开始

Hyper Newsletters

订阅我们的最新资讯
我们会在北京时间 每周一的上午九点 向您的邮箱投递本周内的最新更新
邮件发送服务由 MailChimp 提供
SwinIA:无需卷积的自监督盲点图像去噪 | 论文 | HyperAI超神经