• 论文
主办单位:煤炭科学研究总院有限公司、中国煤炭学会学术期刊工作委员会
基于密集残差连接U型网络的噪声图像超分辨率重建
  • Title

    Super resolution reconstruction of noisy images based on dense residual connected U-shaped networks

  • 作者

    刘鹏南李龙张紫豪朱星光程德强

  • Author

    LIU Pengnan;LI Long;ZHANG Zihao;ZHU Xingguang;CHENG Deqiang

  • 单位

    中国矿业大学 信息与控制工程学院山东黄金矿业(莱西)有限公司

  • Organization
    School of Information and Control Engineering, China University of Mining and Technology
    Shandong Gold Mining (Laixi) Co., Ltd.
  • 摘要
    现有的图像超分辨率重建网络难以适用于煤矿井下噪声密集的应用场景,且多数网络通过增加深度提升性能会导致无法有效提取关键特征、高频信息丢失等问题。针对上述问题,提出了一种密集残差连接U型网络,用于对低分辨率噪声图像进行超分辨率重建。在特征提取路径中引入基于密集残差连接的去噪模块,通过密集连接的方式对图像特征进行充分提取,再利用残差学习的特点对低分辨率噪声图像进行有效去噪;在重建路径中引入残差特征注意力蒸馏模块,通过在残差块中融入增强特征注意力块,对不同空间的特征赋予不同的权重,加强网络对于图像关键特征的提取能力,同时减少图像细节特征在残差块中的损失,从而更好地恢复图像细节信息。在煤矿井下图像数据集及公共数据集上进行了对比实验,结果表明:在客观评价指标上,所提网络的结构相似度、图像感知相似度均优于对比网络,且在复杂度及运行速度上有着较好的均衡;在主观视觉效果上,所提网络重建的图像基本消除了原有图像噪声,有效恢复了图像的细节特征。
  • Abstract
    The existing image super-resolution reconstruction networks are difficult to apply to noise intensive application scenarios in coal mines. Most networks improve performance by increasing depth, which leads to problems such as ineffective extraction of key features and loss of high-frequency information. In order to solve the above problems, a dense residual connected U-shaped network is proposed for super-resolution reconstruction of low resolution noisy images. The denoising module based on dense residual connections is introduced in the feature extraction path, fully extracting image features through dense connections. The features of residual learning are used to effectively denoise low resolution noisy images. The residual feature attention distillation module is introduced in the reconstruction path, by incorporating enhanced feature attention blocks into the residual blocks, different weights are assigned to features in different spaces to enhance the network's capability to extract key image features. The loss of image detail features is reduced in the residual blocks, thus better restoring image detail information. Comparative experiments are conducted on coal mine underground image datasets and public datasets, and the results show that in terms of objective evaluation index, structure similarity and image perception similarity of the proposed network are superior to the comparison network. It has a good balance in complexity and running speed. In terms of subjective visual effects, the image reconstructed by the proposed network basically eliminates the original image noise and effectively restores the detailed features of the image.
  • 关键词

    噪声图像超分辨率重建密集残差连接U型网络去噪模块残差特征注意力蒸馏模块

  • KeyWords

    noisy images;super resolution reconstruction;dense residual connections;U-shaped network;noise reduction module;residual feature attention distillation module

  • 基金项目(Foundation)
    国家重点研发计划项目(2021YFC2902702);济宁市重点研发计划项目(2021JNZY013)。
  • DOI
  • 引用格式
    刘鹏南,李龙,张紫豪,等. 基于密集残差连接U型网络的噪声图像超分辨率重建[J]. 工矿自动化,2024,50(2):63-71.
  • Citation
    LIU Pengnan, LI Long, ZHANG Zihao, et al. Super resolution reconstruction of noisy images based on dense residual connected U-shaped networks[J]. Journal of Mine Automation,2024,50(2):63-71.
  • 相关文章
  • 图表
相关问题

主办单位:煤炭科学研究总院有限公司 中国煤炭学会学术期刊工作委员会

©版权所有2015 煤炭科学研究总院有限公司 地址:北京市朝阳区和平里青年沟东路煤炭大厦 邮编:100013
京ICP备05086979号-16  技术支持:云智互联