Incremental depth upscaling using an edge weighted optimization concept
2012 (English)In: 3DTV-Conference, 2012, Art. no. 6365429- p.Conference paper (Refereed)
Precise scene depth information is a pre-requisite in three-dimen-sional television (3DTV), e.g. for high quality view synthesis inautostereoscopic multiview displays. Unfortunately, this informa-tion is not easily obtained and often of limited quality. Dedicatedrangesensors, suchastime-of-flight(ToF)cameras, candeliverre-liable depth information where (stereo-)matching fails. Nonethe-less, since these sensors provide only restricted spatial resolution,sophisticated upscaling methods are sought-after, to match depthinformation to corresponding texture frames. Where traditionalupscaling fails, novel approaches have been proposed, utilizingadditional information from the texture for the depth upscalingprocess. We recently proposed the Edge Weighted OptimizationConcept (EWOC) for ToF upscaling, using texture edges for ac-curate depth boundaries. In this paper we propose an importantupdate to EWOC, dividing it into smaller incremental upscalingsteps. We predict two major improvements from this. Firstly, pro-cessing time should be decreased by dividing one big calculationinto several smaller steps. Secondly, we assume an increase inquality for the upscaled depth map, due to a more coherent edgedetection on the video frame. In our evaluations we can showthe desired effect on processing time, cutting down the calculationtime more than in half. We can also show an increase in visualquality, based on objective quality metrics, compared to the origi-nal implementation as well as competing proposals.
Place, publisher, year, edition, pages
2012. Art. no. 6365429- p.
3DTV, EWOC, DIBR, time-of-flight, depth map, upscaling, edge detection, incremental, optimization, view synthesis
IdentifiersURN: urn:nbn:se:miun:diva-17023DOI: 10.1109/3DTV.2012.6365429ScopusID: 2-s2.0-84872059517Local ID: STCISBN: 978-146734905-5OAI: oai:DiVA.org:miun-17023DiVA: diva2:553431
2012 3DTV-Conference: The True Vision - Capture, Transmission and Display of 3D Video, 3DTV-CON 2012;Zurich;15 October 2012through17 October 2012;Category numberCFP1255B-ART;Code94817
Projects3D video: Capture and Compression for Distribution