Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Free View Rendering for 3D Video: Edge-Aided Rendering and Depth-Based Image Inpainting
Mid Sweden University, Faculty of Science, Technology and Media, Department of Information and Communication systems. (Realistic 3D)
2015 (English)Doctoral thesis, monograph (Other academic)
Abstract [en]

Three Dimensional Video (3DV) has become increasingly popular with the success of 3D cinema. Moreover, emerging display technology offers an immersive experience to the viewer without the necessity of any visual aids such as 3D glasses. 3DV applications, Three Dimensional Television (3DTV) and Free Viewpoint Television (FTV) are auspicious technologies for living room environments by providing immersive experience and look around facilities. In order to provide such an experience, these technologies require a number of camera views captured from different viewpoints. However, the capture and transmission of the required number of views is not a feasible solution, and thus view rendering is employed as an efficient solution to produce the necessary number of views. Depth-image-based rendering (DIBR) is a commonly used rendering method. Although DIBR is a simple approach that can produce the desired number of views, inherent artifacts are major issues in the view rendering. Despite much effort to tackle the rendering artifacts over the years, rendered views still contain visible artifacts.

This dissertation addresses three problems in order to improve 3DV quality: 1) How to improve the rendered view quality using a direct approach without dealing each artifact specifically. 2) How to handle disocclusions (a.k.a. holes) in the rendered views in a visually plausible manner using inpainting. 3) How to reduce spatial inconsistencies in the rendered view. The first problem is tackled by an edge-aided rendering method that uses a direct approach with one-dimensional interpolation, which is applicable when the virtual camera distance is small. The second problem is addressed by using a depth-based inpainting method in the virtual view, which reconstructs the missing texture with background data at the disocclusions. The third problem is undertaken by a rendering method that firstly inpaint occlusions as a layered depth image (LDI) in the original view, and then renders a spatially consistent virtual view.

Objective assessments of proposed methods show improvements over the state-of-the-art rendering methods. Visual inspection shows slight improvements for intermediate views rendered from multiview videos-plus-depth, and the proposed methods outperforms other view rendering methods in the case of rendering from single view video-plus-depth. Results confirm that the proposed methods are capable of reducing rendering artifacts and producing spatially consistent virtual views.

In conclusion, the view rendering methods proposed in this dissertation can support the production of high quality virtual views based on a limited number of input views. When used to create a multi-scopic presentation, the outcome of this dissertation can benefit 3DV technologies to improve the immersive experience.

Place, publisher, year, edition, pages
Sundsvall: Mid Sweden University, , 2015. , 125 p.
Series
Mid Sweden University doctoral thesis, ISSN 1652-893X ; 226
Keyword [en]
3DV, 3DTV, FTV, view rendering, depth-image-based rendering, hole-filling, disocclusion filling, inpainting, texture synthesis, view synthesis, layered depth image
National Category
Computer Systems Signal Processing Other Electrical Engineering, Electronic Engineering, Information Engineering
Identifiers
URN: urn:nbn:se:miun:diva-25097Local ID: STCISBN: 978-91-88025-30-2 (print)OAI: oai:DiVA.org:miun-25097DiVA: diva2:820740
Public defence
2015-06-18, L111, Holmgatan10, Sundsvall, 10:00 (English)
Opponent
Supervisors
Available from: 2015-06-15 Created: 2015-06-08 Last updated: 2016-12-23Bibliographically approved

Open Access in DiVA

Doctoral thesis 226(59464 kB)690 downloads
File information
File name FULLTEXT02.pdfFile size 59464 kBChecksum SHA-512
c2c72ed16f3c7c716f6cf53efff18d5c55d991e2d845192d64020e49bafd37d5a3e4290255fdfd45c97b1cdc25b76ea90f64ad8c7177c6de5ea2c8a4acd54319
Type fulltextMimetype application/pdf
Errata(31 kB)22 downloads
File information
File name ERRATA01.pdfFile size 31 kBChecksum SHA-512
608e7fd691609c3452a69466914f8e5e5e63d41e0134ac00cb9f190a9fb794374430fae1c576679b088049bdd2111a04acfa59e568d58cd8b602ca5028a14b32
Type errataMimetype application/pdf

Search in DiVA

By author/editor
Muddala, Suryanarayana Murthy
By organisation
Department of Information and Communication systems
Computer SystemsSignal ProcessingOther Electrical Engineering, Electronic Engineering, Information Engineering

Search outside of DiVA

GoogleGoogle Scholar
Total: 692 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

isbn
urn-nbn

Altmetric score

isbn
urn-nbn
Total: 1141 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf