Virtual Viewpoint Synthesis of Quick Remove the Distortion
1. School of Computer Science and Engineering, College of Software Engineering, Southeast University, Nanjing Jiangsu 211189, China;
2. State Key Laboratory for Novel Software Technology, Nanjing University, Nanjing Jiangsu 210023, China
Abstract：Depth image based rendering (DIBR) is an effective method for virtual view synthesis. But
synthetic images often contain distortion, the main problem is ghost effect and some holes of varying
sizes. To cope with the ghost effect, the color correction of reference views is first used, and then two
fusion methods are combined which are depth-based color image fusion and direct color image fusion.
Inverse warping is adopted to fill cracks. In order to fill the remaining disocclusions, the image
inpainting with depth map is used to get a better virtual view. Because the process of image inpainting
is very time-consuming, the inpainting algorithm on GPU is implemented to accelerate the inpainting
process based on compute unified device architecture (CUDA). Experimental results show that our
proposed method improved the quality of virtual view synthetic images, and the image inpainting
algorithm based on CUDA implemented also significantly reduced the time of hole filling.