Perceptually enhanced super-resolution reconstruction model based on deep back projection

YANG Shuguang

  • Sponsored by:

    Editor-In-Chief:

    ISSN 1002-2082

     
  • Hosted By:

    Published By: Journal of Applied Optics

    CN 61-1171/O4

Journal of Applied Optics ›› 2021, Vol. 42 ›› Issue (4) : 691-697, 716. DOI: 10.5768/JAO202142.0402009

Perceptually enhanced super-resolution reconstruction model based on deep back projection

  • YANG Shuguang1
Author information +
History +

Abstract

The super-resolution reconstruction models represented by the super-resolution convolutional neural network (SRCNN) models usually have high peak signal to noise ratio (PSNR) and structural similarity index measure (SSIM) values, but its visual perception is not satisfactory. And the generative adversarial networks (GAN) models represented by the super-resolution generative adversarial networks (SRGAN) having high perceptual quality is prone to produce a lot of false details, which is manifested in its low PSNR and SSIM values. To solve the above problems, a perceptually enhanced super-resolution reconstruction model based on deep back projection was proposed. The dual-scale self-adaptive weighted fusion feature extraction module was adopted by this model for feature extraction, then the sampling was carried out by the deep back projection, and finally the final output was obtained after the enhanced module was enhanced. The residual connections and dense connections were adopted by the model, which facilitated the features sharing and the effective training of the model. In the index evaluation, the learned perceptual image patch similarity (LPIPS) metric based on the learning was introduced as a new quality evaluation index of image perception, together with PSNR and SSIM as the model evaluation index. The experimental results show that the average values of PSNR, SSIM, and LPIPS of the model on the test data set are 27.84, 0.7320, and 0.1258, respectively, and all the indicators are better than the comparison algorithm.

Key words

super-resolution reconstruction / deep back projection / perceived quality / learned perceptual image patch similarity metric

Cite this article

Download Citations
YANG Shuguang. Perceptually enhanced super-resolution reconstruction model based on deep back projection. Journal of Applied Optics. 2021, 42(4): 691-697, 716 https://doi.org/10.5768/JAO202142.0402009

References

DONG C, LOY C C, HE K, et al. Image super-resolution using deep convolutional networks[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence,2015,38(2):295-307.
HE K, ZHANG X, REN S, et al. Deep residual learning for image recognition[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. USA: IEEE, 2016: 770-778.
KIM J, KWON L J, MU L K. Deeply-recursive convolutional network for image super-resolution[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. USA: IEEE, 2016: 1637-1645.
TAI Y, YANG J, LIU X. Image super-resolution via deep recursive residual network[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. USA: IEEE, 2017: 3147-3155.
DONG C, LOY C C, TANG X. Accelerating the super-resolution convolutional neural network[C]//European Conference on Computer Vision. Switzerland: Springer Cham, 2016: 391-407.
SHI W, CABALLERO J, HUSZáR F, et al. Real-time single image and video super-r

14

Accesses

0

Citation

Detail

Sections
Recommended

/