Change search
ReferencesLink to record
Permanent link

Direct link
Time-of-Flight Sensor Fusion with Depth Measurement Reliability Weighting
Mid Sweden University, Faculty of Science, Technology and Media, Department of Information and Communication systems. (Realistic3D)ORCID iD: 0000-0002-2578-7896
Mid Sweden University, Faculty of Science, Technology and Media, Department of Information and Communication systems. (Realistic3D)
Mid Sweden University, Faculty of Science, Technology and Media, Department of Information and Communication systems. (Realistic3D)
2014 (English)In: 3DTV-Conference, IEEE Computer Society, 2014, Art. no. 6874759- p.Conference paper (Refereed)
Abstract [en]

Accurate scene depth capture is essential for the success of three-dimensional television (3DTV), e.g. for high quality view synthesis in autostereoscopic multiview displays. Unfortunately, scene depth is not easily obtained and often of limited quality. Dedicated Time-of-Flight (ToF) sensors can deliver reliable depth readings where traditional methods, such as stereovision analysis, fail. However, since ToF sensors provide only limited spatial resolution and suffer from sensor noise, sophisticated upsampling methods are sought after. A multitude of ToF solutions have been proposed over the recent years. Most of them achieve ToF super-resolution (TSR) by sensor fusion between ToF and additional sources, e.g. video. We recently proposed a weighted error energy minimization approach for ToF super-resolution, incorporating texture, sensor noise and temporal information. For this article, we take a closer look at the sensor noise weighting related to the Time-of-Flight active brightness signal. We determine a depth measurement reliability function based on optimizing free parameters to test data and verifying it with independent test cases. In the presented doubleweighted TSR proposal, depth readings are weighted into the upsampling process with regard to their reliability, removing erroneous influences in the final result. Our evaluations prove the desired effect of depth measurement reliability weighting, decreasing the depth upsampling error by almost 40% in comparison to competing proposals.

Place, publisher, year, edition, pages
IEEE Computer Society, 2014. Art. no. 6874759- p.
Keyword [en]
time-of-flight, active brightness, sensor-fusion, super-resolution, 3D video, scene depth, depth map upsampling
National Category
Media and Communication Technology Signal Processing
URN: urn:nbn:se:miun:diva-22573DOI: 10.1109/3DTV.2014.6874759ISI: 000345738600049ScopusID: 2-s2.0-84906568735ISBN: 978-147994758-4OAI: diva2:737827
3DTV-Conference: The True Vision - Capture, Transmission and Display of 3D Video, 3DTV-CON 2014; Budapest; Hungary; 2 July 2014 through 4 July 2014; Category numberCFP1455B-ART; Code 107089
Available from: 2014-08-14 Created: 2014-08-14 Last updated: 2015-11-06Bibliographically approved

Open Access in DiVA

fulltext(3513 kB)44 downloads
File information
File name FULLTEXT01.pdfFile size 3513 kBChecksum SHA-512
Type fulltextMimetype application/pdf

Other links

Publisher's full textScopus

Search in DiVA

By author/editor
Schwarz, SebastianSjöström, MårtenOlsson, Roger
By organisation
Department of Information and Communication systems
Media and Communication TechnologySignal Processing

Search outside of DiVA

GoogleGoogle Scholar
Total: 44 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

Altmetric score

Total: 524 hits
ReferencesLink to record
Permanent link

Direct link