Monoscopic inpainting approach using depth information

Abstract

Cheap depth sensors that can be integrated in consumer cameras provide additional data that can be used for improved post-processing results of the captured images. Removal of objects in a scene is one such editing procedure that demands inpainting techniques that limit noticeable artifacts generated in the process. In this paper, a monoscopic inpainting technique that uses depth information to process results is presented. It allows users to select an object from the foreground that needs to be removed and then inpaints this region from the neighborhood. This approach uses texture and depth information and is pipelined in a way that allows for parallelization. Results are returned in 0.034 seconds on average. A mean opinion score evaluation was carried out and the current technique scored an average of 3.24 from a scale of 5 on the quality of inpainted regions. This exercise was held to identify the attributes that need to be improved in future implementations.