Time-of-Flight Sensor Fusion with Depth Measurement Reliability Weighting
2014 (English)In: 3DTV-Conference, IEEE Computer Society, 2014, Art. no. 6874759- p.Conference paper (Refereed)
Accurate scene depth capture is essential for the success of three-dimensional television (3DTV), e.g. for high quality view synthesis in autostereoscopic multiview displays. Unfortunately, scene depth is not easily obtained and often of limited quality. Dedicated Time-of-Flight (ToF) sensors can deliver reliable depth readings where traditional methods, such as stereovision analysis, fail. However, since ToF sensors provide only limited spatial resolution and suffer from sensor noise, sophisticated upsampling methods are sought after. A multitude of ToF solutions have been proposed over the recent years. Most of them achieve ToF super-resolution (TSR) by sensor fusion between ToF and additional sources, e.g. video. We recently proposed a weighted error energy minimization approach for ToF super-resolution, incorporating texture, sensor noise and temporal information. For this article, we take a closer look at the sensor noise weighting related to the Time-of-Flight active brightness signal. We determine a depth measurement reliability function based on optimizing free parameters to test data and verifying it with independent test cases. In the presented doubleweighted TSR proposal, depth readings are weighted into the upsampling process with regard to their reliability, removing erroneous influences in the final result. Our evaluations prove the desired effect of depth measurement reliability weighting, decreasing the depth upsampling error by almost 40% in comparison to competing proposals.
Place, publisher, year, edition, pages
IEEE Computer Society, 2014. Art. no. 6874759- p.
time-of-flight, active brightness, sensor-fusion, super-resolution, 3D video, scene depth, depth map upsampling
Media and Communication Technology Signal Processing
IdentifiersURN: urn:nbn:se:miun:diva-22573DOI: 10.1109/3DTV.2014.6874759ISI: 000345738600049ScopusID: 2-s2.0-84906568735ISBN: 978-147994758-4OAI: oai:DiVA.org:miun-22573DiVA: diva2:737827
3DTV-Conference: The True Vision - Capture, Transmission and Display of 3D Video, 3DTV-CON 2014; Budapest; Hungary; 2 July 2014 through 4 July 2014; Category numberCFP1455B-ART; Code 107089