Author(s)

Xiyao Li ¹

Affiliation(s)

¹ College of Electrical and Information Engineering, Lanzhou University of Technology, Lanzhou, 730050, China

Corresponding Author

Xiyao Li

ABSTRACT

For image reconstruction, the residual network ignores part of the residual information when extracting features. We propose an image super-resolution reconstruction based on residual compensation joint attention network (RCCN). Firstly, we construct a three-way residual network for compensating the feature information of the standard residual network; secondly, we design a joint attention module to complement the pixel-level image attention information by 3D attention while the channel attention learns the channel weight information; finally, our method has clearer results compared with other advanced methods, and the objective evaluation indexes are all greatly improved.

KEYWORDS

Super-resolution reconstruction; Convolutional neural networks; Deep separable convolution; Residual networks; Attention mechanisms

CITE THIS PAPER

Xiyao Li, Image super-resolution reconstruction based on residual compensation combined attention network. Journal of Electronics and Information Science (2023) Vol. 8: 48-55. DOI: http://dx.doi.org/10.23977/10.23977/jeis.2023.080107.

REFERENCES

[1] M. V. Afonso, J. M. Bioucas-Dias, and M. A. Figueiredo, "Fast image recovery using variable splitting and constrained optimization," IEEE transactions on image processing, vol. 19, no. 9, pp. 2345-2356, 2010.
[2] F. Zhou, W. Yang, and Q. Liao, "Interpolation-based image super-resolution using multisurface fitting," IEEE Transactions on Image Processing, vol. 21, no. 7, pp. 3312-3318, 2012.
[3] R. Tsai, "Multiple frame image restoration and registration," Advances in Computer Vision and Image Processing, vol. 1, pp. 1715-1989, 1989.
[4] W. T. Freeman, E. C. Pasztor, and O. T. Carmichael, "Learning low-level vision," International journal of computer vision, vol. 40, pp. 25-47, 2000.
[5] C. Dong, C. C. Loy, K. He, and X. Tang, "Image super-resolution using deep convolutional networks," IEEE transactions on pattern analysis and machine intelligence, vol. 38, no. 2, pp. 295-307, 2015.
[6] C. Dong, C. C. Loy, and X. Tang, "Accelerating the super-resolution convolutional neural network," in Computer Vision–ECCV 2016: 14th European Conference, Amsterdam, The Netherlands, October 11-14, 2016, Proceedings, Part II 14, 2016, pp. 391-407: Springer.
[7] B. Lim, S. Son, H. Kim, S. Nah, and K. Mu Lee, "Enhanced deep residual networks for single image super-resolution," in Proceedings of the IEEE conference on computer vision and pattern recognition workshops, 2017, pp. 136-144.
[8] K. He, X. Zhang, S. Ren, and J. Sun, "Deep residual learning for image recognition," in Proceedings of the IEEE conference on computer vision and pattern recognition, 2016, pp. 770-778.
[9] J. Hu, L. Shen, and G. Sun, "Squeeze-and-excitation networks," in Proceedings of the IEEE conference on computer vision and pattern recognition, 2018, pp. 7132-7141.
[10] Y. Zhang, K. Li, K. Li, L. Wang, B. Zhong, and Y. Fu, "Image super-resolution using very deep residual channel attention networks," in Proceedings of the European conference on computer vision (ECCV), 2018, pp. 286-301.
[11] H. Zhao, X. Kong, J. He, Y. Qiao, and C. Dong, "Efficient image super-resolution using pixel attention," in Computer Vision–ECCV 2020 Workshops: Glasgow, UK, August 23–28, 2020, Proceedings, Part III 16, 2020, pp. 56-72: Springer.
[12] E. Agustsson and R. Timofte, "Ntire 2017 challenge on single image super-resolution: Dataset and study," in Proceedings of the IEEE conference on computer vision and pattern recognition workshops, 2017, pp. 126-135.
[13] M. Bevilacqua, A. Roumy, C. Guillemot, and M. L. Alberi-Morel, "Low-complexity single-image super-resolution based on nonnegative neighbor embedding," 2012.
[14] R. Zeyde, M. Elad, and M. Protter, "On single image scale-up using sparse-representations," in Curves and Surfaces: 7th International Conference, Avignon, France, June 24-30, 2010, Revised Selected Papers 7, 2012, pp. 711-730: Springer.
[15] D. Martin, C. Fowlkes, D. Tal, and J. Malik, "A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics," in Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001, 2001, vol. 2, pp. 416-423: IEEE.
[16] J.-B. Huang, A. Singh, and N. Ahuja, "Single image super-resolution from transformed self-exemplars," in Proceedings of the IEEE conference on computer vision and pattern recognition, 2015, pp. 5197-5206.
[17] J. Kim, J. K. Lee, and K. M. Lee, "Accurate image super-resolution using very deep convolutional networks," in Proceedings of the IEEE conference on computer vision and pattern recognition, 2016, pp. 1646-1654.
[18] J. Kim, J. K. Lee, and K. M. Lee, "Deeply-recursive convolutional network for image super-resolution," in Proceedings of the IEEE conference on computer vision and pattern recognition, 2016, pp. 1637-1645.
[19] N. Ahn, B. Kang, and K.-A. Sohn, "Fast, accurate, and lightweight super-resolution with cascading residual network," in Proceedings of the European conference on computer vision (ECCV), 2018, pp. 252-268.
[20] J. Li, F. Fang, K. Mei, and G. Zhang, "Multi-scale residual network for image super-resolution," in Proceedings of the European conference on computer vision (ECCV), 2018, pp. 517-532. 

Sponsors, Associates, and Links

---

• Information Systems and Signal Processing Journal
  
  
• Intelligent Robots and Systems
  
  
• Journal of Image, Video and Signals
  
  
• Transactions on Real-Time and Embedded Systems
  
  
• Journal of Electromagnetic Interference and Compatibility
  
  
• Acoustics, Speech and Signal Processing
  
  
• Journal of Power Electronics, Machines and Drives
  
  
• Journal of Electro Optics and Lasers
  
  
• Journal of Integrated Circuits Design and Test
  
  
• Journal of Ultrasonics
  
  
• Antennas and Propagation
  
  
• Optical Communications
  
  
• Solid-State Circuits and Systems-on-a-Chip
  
  
• Field-Programmable Gate Arrays
  
  
• Vehicular Electronics and Safety
  
  
• Optical Fiber Sensor and Communication
  
  
• Journal of Low Power Electronics and Design
  
  
• Infrared and Millimeter Wave
  
  
• Detection Technology and Automation Equipment
  
  
• Journal of Radio and Wireless
  
  
• Journal of Microwave and Terahertz Engineering
  
  
• Journal of Communication, Control and Computing
  
  
• International Journal of Surveying and Mapping
  
  
• Information Retrieval, Systems and Services
  
  
• Journal of Biometrics, Identity and Security
  
  
• Journal of Avionics, Radar and Sonar