Rounding errors in floating point audio: Investigating the effects of rounding errors on the fixed point output format of a simulated digital audio chain, using fixed point input, and floating point intermediate storage
Independent thesis Basic level (degree of Bachelor), 10 credits / 15 HE creditsStudent thesis
The use of floating point number representation is very common in digital audio workstations and in signal processing. However there are no analogue to digital converters or digital to analogue converters for professional audio work that use floating point directly therefore fixed point values must be converted to floating point. The research literature on how this affects the sound quality is very scarce and thus a systematic investigation is motivated. In this thesis floating point signal chains are simulated, with various amounts of processing applied. Both 24 bit and 16 bit fixed point inputs and outputs are used. When the conversion is nontransparent, the 32 bit and 64 bit intermediate formats produce similar amounts of deviation for 16 bit input and output. When the input and output is 24 bit fixed point the 32 bit intermediate format produces fewer deviations however the magnitude is greater. When the conversion is transparent no deviations were found when using 64 bit intermediate format, regardless of input and output format. The 32 bit intermediate signal chain however produces deviations that increase in number by the square root of the number calculations performed when input and output is 24 bit. When input and output is 16 bits the 32 bit intermediate format produces no deviations from the original file.
Place, publisher, year, edition, pages
2013. , 66 p.
Teknik, floating, point, audio, rounding, error, digital, signal, processing, DAW, workstation, sound, quality, conversion, engineering
IdentifiersURN: urn:nbn:se:ltu:diva-49467Local ID: 6cd6adc7-83c9-4208-ad06-06e105892cc1OAI: oai:DiVA.org:ltu-49467DiVA: diva2:1022814
Subject / course
Student thesis, at least 15 credits
Audio Technology, bachelor's level
Lefford, NyssimEkeroot, Jonas
Validerat; 20130612 (global_studentproject_submitter)2016-10-042016-10-04Bibliographically approved