Change search
ReferencesLink to record
Permanent link

Direct link
Evaluation of four models for the sonification of elite rowing
KTH, School of Computer Science and Communication (CSC), Speech, Music and Hearing, TMH, Music Acoustics.ORCID iD: 0000-0002-8830-963X
2012 (English)In: Journal on Multimodal User Interfaces, ISSN 1783-7677, Vol. 5, no 3-4, 143-156 p.Article in journal (Refereed) Published
Abstract [en]

Many aspects of sonification represent potential benefits for the practice of sports. Taking advantage of the characteristics of auditory perception, interactive sonification offers promising opportunities for enhancing the training of athletes. The efficient learning and memorizing abilities pertaining to the sense of hearing, together with the strong coupling between auditory and sensorimotor systems, make the use of sound a natural field of investigation in quest of efficiency optimization in individual sports at a high level. This study presents an application of sonification to elite rowing, introducing and evaluating four sonification models.The rapid development of mobile technology capable of efficiently handling numerical information offers new possibilities for interactive auditory display. Thus, these models have been developed under the specific constraints of a mobile platform, from data acquisition to the generation of a meaningful sound feedback. In order to evaluate the models, two listening experiments have then been carried out with elite rowers. Results show a good ability of the participants to efficiently extract basic characteristics of the sonified data, even in a non-interactive context. Qualitative assessment of the models highlights the need for a balance between function and aesthetics in interactive sonification design. Consequently, particular attention on usability is required for future displays to become widespread.

Place, publisher, year, edition, pages
Springer, 2012. Vol. 5, no 3-4, 143-156 p.
Keyword [en]
Sonification, Rowing, Sculler, Sports, Accelerometer
National Category
Computer Science Language Technology (Computational Linguistics)
URN: urn:nbn:se:kth:diva-52253DOI: 10.1007/s12193-011-0085-1ISI: 000309998300007ScopusID: 2-s2.0-84860990213OAI: diva2:465549
Swedish Research CouncilEU, FP7, Seventh Framework Programme, FP7-ICT- STREP-215749

QC 20120628

Available from: 2012-04-23 Created: 2011-12-14 Last updated: 2013-09-10Bibliographically approved
In thesis
1. Interactive sonification of motion: Design, implementation and control of expressive auditory feedback with mobile devices
Open this publication in new window or tab >>Interactive sonification of motion: Design, implementation and control of expressive auditory feedback with mobile devices
2013 (English)Doctoral thesis, comprehensive summary (Other academic)
Abstract [en]

Sound and motion are intrinsically related, by their physical nature and through the link between auditory perception and motor control. If sound provides information about the characteristics of a movement, a movement can also be influenced or triggered by a sound pattern. This thesis investigates how this link can be reinforced by means of interactive sonification. Sonification, the use of sound to communicate, perceptualize and interpret data, can be used in many different contexts. It is particularly well suited for time-related tasks such as monitoring and synchronization, and is therefore an ideal candidate to support the design of applications related to physical training. Our objectives are to develop and investigate computational models for the sonification of motion data with a particular focus on expressive movement and gesture, and for the sonification of elite athletes movements.  We chose to develop our applications on a mobile platform in order to make use of advanced interaction modes using an easily accessible technology. In addition, networking capabilities of modern smartphones potentially allow for adding a social dimension to our sonification applications by extending them to several collaborating users. The sport of rowing was chosen to illustrate the assistance that an interactive sonification system can provide to elite athletes. Bringing into play complex interactions between various kinematic and kinetic quantities, studies on rowing kinematics provide guidelines to optimize rowing efficiency, e.g. by minimizing velocity fluctuations around average velocity. However, rowers can only rely on sparse cues to get information relative to boat velocity, such as the sound made by the water splashing on the hull. We believe that an interactive augmented feedback communicating the dynamic evolution of some kinematic quantities could represent a promising way of enhancing the training of elite rowers. Since only limited space is available on a rowing boat, the use of mobile phones appears appropriate for handling streams of incoming data from various sensors and generating an auditory feedback simultaneously. The development of sonification models for rowing and their design evaluation in offline conditions are presented in Paper I. In Paper II, three different models for sonifying the synchronization of the movements of two users holding a mobile phone are explored. Sonification of expressive gestures by means of expressive music performance is tackled in Paper III. In Paper IV, we introduce a database of mobile applications related to sound and music computing. An overview of the field of sonification is presented in Paper V, along with a systematic review of mapping strategies for sonifying physical quantities. Physical and auditory dimensions were both classified into generic conceptual dimensions, and proportion of use was analyzed in order to identify the most popular mappings. Finally, Paper VI summarizes experiments conducted with the Swedish national rowing team in order to assess sonification models in an interactive context.

Place, publisher, year, edition, pages
Stockholm: KTH Royal Institute of Technology, 2013. xiii, 33 p.
Trita-CSC-A, ISSN 1653-5723 ; 2013:09
National Category
Computer Science Human Computer Interaction
urn:nbn:se:kth:diva-127944 (URN)978-91-7501-858-4 (ISBN)
Public defence
2013-09-27, F3, Lindstedtsvägen 26, KTH, Stockholm, 13:00 (English)

QC 20130910

Available from: 2013-09-10 Created: 2013-09-09 Last updated: 2013-09-10Bibliographically approved

Open Access in DiVA

fulltext(1046 kB)235 downloads
File information
File name FULLTEXT01.pdfFile size 1046 kBChecksum SHA-512
Type fulltextMimetype application/pdf

Other links

Publisher's full textScopusThe final publication is available at

Search in DiVA

By author/editor
Dubus, Gaël
By organisation
Music Acoustics
In the same journal
Journal on Multimodal User Interfaces
Computer ScienceLanguage Technology (Computational Linguistics)

Search outside of DiVA

GoogleGoogle Scholar
Total: 235 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

Altmetric score

Total: 259 hits
ReferencesLink to record
Permanent link

Direct link