Digitala Vetenskapliga Arkivet

Endre søk
RefereraExporteraLink to record
Permanent link

Direct link
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Annet format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annet språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf
Sonification of Complex Spectral Structures
KTH, Skolan för elektroteknik och datavetenskap (EECS), Människocentrerad teknologi, Medieteknik och interaktionsdesign, MID. KMH Royal College of Music in Stockholm. (Sound and Music Computing)ORCID-id: 0000-0003-1239-6746
KTH, Skolan för elektroteknik och datavetenskap (EECS), Människocentrerad teknologi, Medieteknik och interaktionsdesign, MID. (Sound and Music Computing)ORCID-id: 0000-0002-3086-0322
2022 (engelsk)Inngår i: Frontiers in Neuroscience, ISSN 1662-4548, E-ISSN 1662-453X, Frontiers in Neuroscience, ISSN 1662-4548, Vol. 16Artikkel, forskningsoversikt (Fagfellevurdert) Published
Abstract [en]

In this article, we present our work on the sonification of notated complex spectral structures. It is part of a larger research project about the design of a new notation system for representing sound-based musical structures. Complex spectral structures are notated with special symbols in the scores, which can be digitally rendered so that the user can hear key aspects of what has been notated. This hearing of the notated data is significantly different from reading the same data, and reveals the complexity hidden in its simplified notation. The digitally played score is not the music itself but can provide essential information about the music in ways that can only be obtained in sounding form. The playback needs to be designed so that the user can make relevant sonic readings of the sonified data. The sound notation system used here is an adaptation of Thoresen and Hedman’s spectromorphological analysis notation. Symbols originally developed by Lasse Thoresen from Pierre Schaeffer’s typo-morphology have in this system been adapted to display measurable spectral features of timbrel structure for the composition and transcription of sound-based musical structures. Spectrum category symbols are placed over a spectral grand-staff that combines indications of pitch and frequency values for the combined display of music related to pitch-based and spectral values. Spectral features of a musical structure such as spectral width and density are represented as graphical symbols and sonically rendered. In perceptual experiments we have verified that users can identify spectral notation parameters based on their sonification. This confirms the main principle of sonification that is that the data/dimensions relations in one domain, in our case notated representation of spectral features, are transformed in perceived relations in the audio domain, and back.

sted, utgiver, år, opplag, sider
Frontiers Media SA , 2022. Vol. 16
Emneord [en]
sonification, complex spectral structure, music, spectrum, perception, listening, comprehension
HSV kategori
Forskningsprogram
Medieteknik; Människa-datorinteraktion; Konst, teknik och design; Informations- och kommunikationsteknik
Identifikatorer
URN: urn:nbn:se:kth:diva-310444DOI: 10.3389/fnins.2022.832265ISI: 000787244500001PubMedID: 35360157Scopus ID: 2-s2.0-85127350223OAI: oai:DiVA.org:kth-310444DiVA, id: diva2:1648638
Prosjekter
The harmony of noise
Forskningsfinansiär
Swedish Research Council, 2017-03979
Merknad

QC 20230207

Tilgjengelig fra: 2022-03-31 Laget: 2022-03-31 Sist oppdatert: 2023-05-23bibliografisk kontrollert
Inngår i avhandling
1. Sound Notation: The visual representation of sound for composition and analysis
Åpne denne publikasjonen i ny fane eller vindu >>Sound Notation: The visual representation of sound for composition and analysis
2023 (engelsk)Doktoravhandling, med artikler (Annet vitenskapelig)
Abstract [en]

This compilation thesis details steps taken to develop and evaluate a new Sound Notation system for composition, analysis, and transcription with the capacity to describe all types of sound. Ideas from electroacoustic music analysis are combined with traditional notation to form a hybrid system. In this notation, all symbols are related to physical qualities in the sound, so that a person or a computer can identify the symbols from their sonification or musical interpretation.

Pierre Schaeffer early identified musique concrète's lack of music theory and music vocabulary as a major problem for its integration with music theory and musicology. Schaeffer, Denis Smalley, and later Lasse Thoresen would go a long way to provide the genre of electroacoustic music with classification, terminology, and graphical symbols for the benefit of its study. But if we are to think of music as a language, it becomes apparent that the lack of a shared inter-subjective notation system is a problem. Such a notation system would provide sound-based music with possibilities that were previously only afforded music based on pitch structures. This includes transcriptions and re-interpretations of musical works, notation-based ear-training and (computer-aided) composition.

Abstract [sv]

Denna sammanläggningsavhandling beskriver steg som tagits för att utveckla och utvärdera Sound Notation, ett nytt notationssystem för komposition, analys och transkription med kapacitet att beskriva alla typer av ljud. Idéer från elektroakustisk musikanalys kombineras med traditionell notation för att bilda ett hybridsystem. I denna notation är alla symboler relaterade till fysiska egenskaper i ljudet, så att en person eller en dator kan identifiera symbolerna från deras sonifiering eller musikaliska tolkning.

Pierre Schaeffer identifierade tidigt musique concrètes brist på musikteori och musikvokabulär som ett stort problem för dess integration med musikteori och musikvetenskap. Schaeffer, Denis Smalley och senare Lasse Thoresen skulle gå långt för att förse genren elektroakustisk musik med klassificering, terminologi och grafiska symboler till förmån för dess studium. Men om vi ska tänka på musik som ett språk blir det uppenbart att avsaknaden av ett delat intersubjektivt notsystem är ett problem. Ett sådant notsystem skulle ge ljudbaserad musik möjligheter som tidigare endast erbjöds musik baserad på tonhöjdsstrukturer. Detta inkluderar transkriptioner och omtolkningar av musikaliska verk, notationsbaserad gehörsträning och (datorunderstödd) komposition.

sted, utgiver, år, opplag, sider
Stockholm: KTH Royal Institute of Technology, 2023. s. xii, 63
Serie
TRITA-EECS-AVL ; 2023:39
Emneord
notation, aural sonology, music analysis, electroacoustic music, computer-aided composition
HSV kategori
Forskningsprogram
Medieteknik
Identifikatorer
urn:nbn:se:kth:diva-327291 (URN)978-91-8040-576-8 (ISBN)
Disputas
2023-06-07, https://kth-se.zoom.us/j/62182993824, Nathan Milsteinsalen, Kungl. Musikhögskolan, Valhallavägen 105, Stockholm, 14:00 (engelsk)
Opponent
Veileder
Merknad

QC 20230523

Tilgjengelig fra: 2023-05-23 Laget: 2023-05-23 Sist oppdatert: 2023-06-06bibliografisk kontrollert

Open Access i DiVA

Fulltekst mangler i DiVA

Andre lenker

Forlagets fulltekstPubMedScopushttps://www.frontiersin.org/article/10.3389/fnins.2022.832265

Søk i DiVA

Av forfatter/redaktør
Sköld, MattiasBresin, Roberto
Av organisasjonen
I samme tidsskrift
Frontiers in Neuroscience

Søk utenfor DiVA

GoogleGoogle Scholar

doi
pubmed
urn-nbn

Altmetric

doi
pubmed
urn-nbn
Totalt: 217 treff
RefereraExporteraLink to record
Permanent link

Direct link
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Annet format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annet språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf