Welcome to Journal of Graphics share: 

Journal of Graphics ›› 2022, Vol. 43 ›› Issue (1): 70-78.DOI: 10.11996/JG.j.2095-302X.2022010070

• Image Processing and Computer Vision • Previous Articles     Next Articles

Blind image inpainting based on context gated convolution

  

  1. 1. Shanghai Film Academy, Shanghai University, Shanghai 200072, China;  2. Shanghai Engineering Research Center of Motion Picture Special Effects, Shanghai 200072, China
  • Online:2022-02-28 Published:2022-02-16
  • Supported by:
    National Natural Science Foundation of China (61303093, 61402278) 

Abstract: Image inpainting methods based on deep learning have achieved great progress. At present, most of the image inpainting methods use the input mask to reconstruct the degraded areas of the image. Based on this observation, a two-stage blind image inpainting network was proposed, comprising a mask prediction network and an image inpainting network. The input of a mask was not required in the whole inpainting process. The mask prediction network could automatically detect the degraded area of the image and generate a mask according to the input image, and the image inpainting network could restore the missing part of the input image based on the prediction mask. In order to make better use of global context information, a context-gated residual block (CGRB) module was designed based on context-gated convolution to extract feature information. In addition, the spatial attention residual block (SARB) was proposed to model the relationship between pixels in the long-distance image, filtering some irrelevant details. A large number of experimental results on the CelebA-HQ, FFHQ, and PairsStreet datasets show that the improved algorithm is superior to other comparison methods and can generate convincing images. 

Key words: image inpainting, blind image inpainting, context-gated convolution, context-gated residual block, spatial attention residual block 

CLC Number: