Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Time-of-Flight Sensor Fusion with Depth Measurement Reliability Weighting
Mid Sweden University, Faculty of Science, Technology and Media, Department of Information and Communication systems. (Realistic3D)ORCID iD: 0000-0002-2578-7896
Mid Sweden University, Faculty of Science, Technology and Media, Department of Information and Communication systems. (Realistic3D)ORCID iD: 0000-0003-3751-6089
Mid Sweden University, Faculty of Science, Technology and Media, Department of Information and Communication systems. (Realistic3D)
2014 (English)In: 3DTV-Conference, IEEE Computer Society, 2014, Art. no. 6874759- p.Conference paper, Published paper (Refereed)
Abstract [en]

Accurate scene depth capture is essential for the success of three-dimensional television (3DTV), e.g. for high quality view synthesis in autostereoscopic multiview displays. Unfortunately, scene depth is not easily obtained and often of limited quality. Dedicated Time-of-Flight (ToF) sensors can deliver reliable depth readings where traditional methods, such as stereovision analysis, fail. However, since ToF sensors provide only limited spatial resolution and suffer from sensor noise, sophisticated upsampling methods are sought after. A multitude of ToF solutions have been proposed over the recent years. Most of them achieve ToF super-resolution (TSR) by sensor fusion between ToF and additional sources, e.g. video. We recently proposed a weighted error energy minimization approach for ToF super-resolution, incorporating texture, sensor noise and temporal information. For this article, we take a closer look at the sensor noise weighting related to the Time-of-Flight active brightness signal. We determine a depth measurement reliability function based on optimizing free parameters to test data and verifying it with independent test cases. In the presented doubleweighted TSR proposal, depth readings are weighted into the upsampling process with regard to their reliability, removing erroneous influences in the final result. Our evaluations prove the desired effect of depth measurement reliability weighting, decreasing the depth upsampling error by almost 40% in comparison to competing proposals.

Place, publisher, year, edition, pages
IEEE Computer Society, 2014. Art. no. 6874759- p.
Keyword [en]
time-of-flight, active brightness, sensor-fusion, super-resolution, 3D video, scene depth, depth map upsampling
National Category
Media and Communication Technology Signal Processing
Identifiers
URN: urn:nbn:se:miun:diva-22573DOI: 10.1109/3DTV.2014.6874759ISI: 000345738600049Scopus ID: 2-s2.0-84906568735Local ID: STCISBN: 978-1-4799-4758-4 (electronic)OAI: oai:DiVA.org:miun-22573DiVA: diva2:737827
Conference
3DTV-Conference: The True Vision - Capture, Transmission and Display of 3D Video, 3DTV-CON 2014; Budapest; Hungary; 2 July 2014 through 4 July 2014; Category numberCFP1455B-ART; Code 107089
Available from: 2014-08-14 Created: 2014-08-14 Last updated: 2017-08-22Bibliographically approved

Open Access in DiVA

fulltext(3513 kB)