Digitala Vetenskapliga Arkivet

Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Sonification of Complex Spectral Structures
KTH, School of Electrical Engineering and Computer Science (EECS), Human Centered Technology, Media Technology and Interaction Design, MID. KMH Royal College of Music in Stockholm. (Sound and Music Computing)ORCID iD: 0000-0003-1239-6746
KTH, School of Electrical Engineering and Computer Science (EECS), Human Centered Technology, Media Technology and Interaction Design, MID. (Sound and Music Computing)ORCID iD: 0000-0002-3086-0322
2022 (English)In: Frontiers in Neuroscience, ISSN 1662-4548, E-ISSN 1662-453X, Frontiers in Neuroscience, ISSN 1662-4548, Vol. 16Article, review/survey (Refereed) Published
Abstract [en]

In this article, we present our work on the sonification of notated complex spectral structures. It is part of a larger research project about the design of a new notation system for representing sound-based musical structures. Complex spectral structures are notated with special symbols in the scores, which can be digitally rendered so that the user can hear key aspects of what has been notated. This hearing of the notated data is significantly different from reading the same data, and reveals the complexity hidden in its simplified notation. The digitally played score is not the music itself but can provide essential information about the music in ways that can only be obtained in sounding form. The playback needs to be designed so that the user can make relevant sonic readings of the sonified data. The sound notation system used here is an adaptation of Thoresen and Hedman’s spectromorphological analysis notation. Symbols originally developed by Lasse Thoresen from Pierre Schaeffer’s typo-morphology have in this system been adapted to display measurable spectral features of timbrel structure for the composition and transcription of sound-based musical structures. Spectrum category symbols are placed over a spectral grand-staff that combines indications of pitch and frequency values for the combined display of music related to pitch-based and spectral values. Spectral features of a musical structure such as spectral width and density are represented as graphical symbols and sonically rendered. In perceptual experiments we have verified that users can identify spectral notation parameters based on their sonification. This confirms the main principle of sonification that is that the data/dimensions relations in one domain, in our case notated representation of spectral features, are transformed in perceived relations in the audio domain, and back.

Place, publisher, year, edition, pages
Frontiers Media SA , 2022. Vol. 16
Keywords [en]
sonification, complex spectral structure, music, spectrum, perception, listening, comprehension
National Category
Music Media and Communications Media and Communication Technology Humanities and the Arts Human Computer Interaction
Research subject
Media Technology; Human-computer Interaction; Art, Technology and Design; Information and Communication Technology
Identifiers
URN: urn:nbn:se:kth:diva-310444DOI: 10.3389/fnins.2022.832265ISI: 000787244500001PubMedID: 35360157Scopus ID: 2-s2.0-85127350223OAI: oai:DiVA.org:kth-310444DiVA, id: diva2:1648638
Projects
The harmony of noise
Funder
Swedish Research Council, 2017-03979
Note

QC 20230207

Available from: 2022-03-31 Created: 2022-03-31 Last updated: 2023-05-23Bibliographically approved
In thesis
1. Sound Notation: The visual representation of sound for composition and analysis
Open this publication in new window or tab >>Sound Notation: The visual representation of sound for composition and analysis
2023 (English)Doctoral thesis, comprehensive summary (Other academic)
Abstract [en]

This compilation thesis details steps taken to develop and evaluate a new Sound Notation system for composition, analysis, and transcription with the capacity to describe all types of sound. Ideas from electroacoustic music analysis are combined with traditional notation to form a hybrid system. In this notation, all symbols are related to physical qualities in the sound, so that a person or a computer can identify the symbols from their sonification or musical interpretation.

Pierre Schaeffer early identified musique concrète's lack of music theory and music vocabulary as a major problem for its integration with music theory and musicology. Schaeffer, Denis Smalley, and later Lasse Thoresen would go a long way to provide the genre of electroacoustic music with classification, terminology, and graphical symbols for the benefit of its study. But if we are to think of music as a language, it becomes apparent that the lack of a shared inter-subjective notation system is a problem. Such a notation system would provide sound-based music with possibilities that were previously only afforded music based on pitch structures. This includes transcriptions and re-interpretations of musical works, notation-based ear-training and (computer-aided) composition.

Abstract [sv]

Denna sammanläggningsavhandling beskriver steg som tagits för att utveckla och utvärdera Sound Notation, ett nytt notationssystem för komposition, analys och transkription med kapacitet att beskriva alla typer av ljud. Idéer från elektroakustisk musikanalys kombineras med traditionell notation för att bilda ett hybridsystem. I denna notation är alla symboler relaterade till fysiska egenskaper i ljudet, så att en person eller en dator kan identifiera symbolerna från deras sonifiering eller musikaliska tolkning.

Pierre Schaeffer identifierade tidigt musique concrètes brist på musikteori och musikvokabulär som ett stort problem för dess integration med musikteori och musikvetenskap. Schaeffer, Denis Smalley och senare Lasse Thoresen skulle gå långt för att förse genren elektroakustisk musik med klassificering, terminologi och grafiska symboler till förmån för dess studium. Men om vi ska tänka på musik som ett språk blir det uppenbart att avsaknaden av ett delat intersubjektivt notsystem är ett problem. Ett sådant notsystem skulle ge ljudbaserad musik möjligheter som tidigare endast erbjöds musik baserad på tonhöjdsstrukturer. Detta inkluderar transkriptioner och omtolkningar av musikaliska verk, notationsbaserad gehörsträning och (datorunderstödd) komposition.

Place, publisher, year, edition, pages
Stockholm: KTH Royal Institute of Technology, 2023. p. xii, 63
Series
TRITA-EECS-AVL ; 2023:39
Keywords
notation, aural sonology, music analysis, electroacoustic music, computer-aided composition
National Category
Media and Communication Technology
Research subject
Media Technology
Identifiers
urn:nbn:se:kth:diva-327291 (URN)978-91-8040-576-8 (ISBN)
Public defence
2023-06-07, https://kth-se.zoom.us/j/62182993824, Nathan Milsteinsalen, Kungl. Musikhögskolan, Valhallavägen 105, Stockholm, 14:00 (English)
Opponent
Supervisors
Note

QC 20230523

Available from: 2023-05-23 Created: 2023-05-23 Last updated: 2023-06-06Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

Publisher's full textPubMedScopushttps://www.frontiersin.org/article/10.3389/fnins.2022.832265

Search in DiVA

By author/editor
Sköld, MattiasBresin, Roberto
By organisation
Media Technology and Interaction Design, MID
In the same journal
Frontiers in Neuroscience
MusicMedia and CommunicationsMedia and Communication TechnologyHumanities and the ArtsHuman Computer Interaction

Search outside of DiVA

GoogleGoogle Scholar

doi
pubmed
urn-nbn

Altmetric score

doi
pubmed
urn-nbn
Total: 228 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf