Virtual View Synthesis Using Layered Depth Image Generation and Depth-Based Inpainting for Filling Disocclusions and Translucent Disocclusions
2016 (English)In: Journal of Visual Communication and Image Representation, ISSN 1047-3203, E-ISSN 1095-9076, Vol. 38, 351-366 p.Article in journal (Refereed) Published
View synthesis is an efficient solution to produce content for 3DTV and FTV. However, proper handling of the disocclusions is a major challenge in the view synthesis. Inpainting methods offer solutions for handling disocclusions, though limitations in foreground-background classification causes the holes to be filled with inconsistent textures. Moreover, the state-of-the art methods fail to identify and fill disocclusions in intermediate distances between foreground and background through which background may be visible in the virtual view (translucent disocclusions). Aiming at improved rendering quality, we introduce a layered depth image (LDI) in the original camera view, in which we identify and fill occluded background so that when the LDI data is rendered to a virtual view, no disocclusions appear but views with consistent data are produced also handling translucent disocclusions. Moreover, the proposed foreground-background classification and inpainting fills the disocclusions with neighboring background texture consistently. Based on the objective and subjective evaluations, the proposed method outperforms the state-of-the art methods at the disocclusions.
Place, publisher, year, edition, pages
2016. Vol. 38, 351-366 p.
View synthesis, depth-image based rendering, image inpainting, texture synthesis, hole lling, disocclusions, translucent disocclusions, layered depth image
Information Systems Media and Communication Technology
IdentifiersURN: urn:nbn:se:miun:diva-27124DOI: 10.1016/j.jvcir.2016.02.017ISI: 000377149100030ScopusID: 2-s2.0-84977648945OAI: oai:DiVA.org:miun-27124DiVA: diva2:906337