Digitala Vetenskapliga Arkivet

Ändra sökning
RefereraExporteraLänk till posten
Permanent länk

Direktlänk
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Annat format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annat språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf
Sound Notation: The visual representation of sound for composition and analysis
KTH, Skolan för elektroteknik och datavetenskap (EECS), Människocentrerad teknologi, Medieteknik och interaktionsdesign, MID. Kungl. Musikhögskolan, Institutionen för komposition, dirigering och musikteori. (Sound and Music Computing)ORCID-id: 0000-0003-1239-6746
2023 (Engelska)Doktorsavhandling, sammanläggning (Övrigt vetenskapligt)
Abstract [en]

This compilation thesis details steps taken to develop and evaluate a new Sound Notation system for composition, analysis, and transcription with the capacity to describe all types of sound. Ideas from electroacoustic music analysis are combined with traditional notation to form a hybrid system. In this notation, all symbols are related to physical qualities in the sound, so that a person or a computer can identify the symbols from their sonification or musical interpretation.

Pierre Schaeffer early identified musique concrète's lack of music theory and music vocabulary as a major problem for its integration with music theory and musicology. Schaeffer, Denis Smalley, and later Lasse Thoresen would go a long way to provide the genre of electroacoustic music with classification, terminology, and graphical symbols for the benefit of its study. But if we are to think of music as a language, it becomes apparent that the lack of a shared inter-subjective notation system is a problem. Such a notation system would provide sound-based music with possibilities that were previously only afforded music based on pitch structures. This includes transcriptions and re-interpretations of musical works, notation-based ear-training and (computer-aided) composition.

Abstract [sv]

Denna sammanläggningsavhandling beskriver steg som tagits för att utveckla och utvärdera Sound Notation, ett nytt notationssystem för komposition, analys och transkription med kapacitet att beskriva alla typer av ljud. Idéer från elektroakustisk musikanalys kombineras med traditionell notation för att bilda ett hybridsystem. I denna notation är alla symboler relaterade till fysiska egenskaper i ljudet, så att en person eller en dator kan identifiera symbolerna från deras sonifiering eller musikaliska tolkning.

Pierre Schaeffer identifierade tidigt musique concrètes brist på musikteori och musikvokabulär som ett stort problem för dess integration med musikteori och musikvetenskap. Schaeffer, Denis Smalley och senare Lasse Thoresen skulle gå långt för att förse genren elektroakustisk musik med klassificering, terminologi och grafiska symboler till förmån för dess studium. Men om vi ska tänka på musik som ett språk blir det uppenbart att avsaknaden av ett delat intersubjektivt notsystem är ett problem. Ett sådant notsystem skulle ge ljudbaserad musik möjligheter som tidigare endast erbjöds musik baserad på tonhöjdsstrukturer. Detta inkluderar transkriptioner och omtolkningar av musikaliska verk, notationsbaserad gehörsträning och (datorunderstödd) komposition.

Ort, förlag, år, upplaga, sidor
Stockholm: KTH Royal Institute of Technology, 2023. , s. xii, 63
Serie
TRITA-EECS-AVL ; 2023:39
Nyckelord [en]
notation, aural sonology, music analysis, electroacoustic music, computer-aided composition
Nationell ämneskategori
Medieteknik
Forskningsämne
Medieteknik
Identifikatorer
URN: urn:nbn:se:kth:diva-327291ISBN: 978-91-8040-576-8 (tryckt)OAI: oai:DiVA.org:kth-327291DiVA, id: diva2:1758712
Disputation
2023-06-07, https://kth-se.zoom.us/j/62182993824, Nathan Milsteinsalen, Kungl. Musikhögskolan, Valhallavägen 105, Stockholm, 14:00 (Engelska)
Opponent
Handledare
Anmärkning

QC 20230523

Tillgänglig från: 2023-05-23 Skapad: 2023-05-23 Senast uppdaterad: 2023-06-06Bibliografiskt granskad
Delarbeten
1. The Visual Representation of Timbre
Öppna denna publikation i ny flik eller fönster >>The Visual Representation of Timbre
2022 (Engelska)Ingår i: Organised Sound, ISSN 1355-7718, E-ISSN 1469-8153, Vol. 27, nr 3, s. 387-400Artikel i tidskrift (Refereegranskat) Published
Abstract [en]

This text deals with the difficult task of notating timbre by addressing how it can be classified, synthesised, recognised and related to visual correspondences, and then looking at the relevance of these topics for notational purposes. Timbre is understood as dependent on both spectral and time-dependent features that can be notated in ways that make sense in relation to both perception and acoustics. This is achieved by taking the starting point in Lasse Thoresen’s spectromorphological analysis. Symbols originally developed for perception-based analysis are adapted for use over a hybrid spectrum-staff system to indicate the spectral qualities of timbre. To test the system, it was used to transcribe excerpts of three classic electroacoustic music works. In addition to the benefit of being able to compare the three excerpts transcribed with the same system, there is the advantage that the visual representation is based on spectral measurable qualities in the music. The notation system’s intuitiveness was also explored in listening tests, showing that it was possible to understand spectral notation symbols placed over a staff system, particularly for examples with two sound objects instead of one.

Ort, förlag, år, upplaga, sidor
Cambridge: Cambridge University Press (CUP), 2022
Nyckelord
Timbre, notation, electroacoustic music, aural sonology
Nationell ämneskategori
Musik
Identifikatorer
urn:nbn:se:kth:diva-326846 (URN)10.1017/s1355771822000541 (DOI)000898933900001 ()2-s2.0-85159407031 (Scopus ID)
Anmärkning

QC 20230522

Tillgänglig från: 2023-05-12 Skapad: 2023-05-12 Senast uppdaterad: 2023-09-26Bibliografiskt granskad
2. The visual representation of spatialisation for composition and analysis
Öppna denna publikation i ny flik eller fönster >>The visual representation of spatialisation for composition and analysis
2019 (Engelska)Ingår i: Combined proceedings of the Nordic Sound and Music Computing Conference 2019 and the Interactive Sonification Workshop 2019 / [ed] Andre Holzapfel and Sandra Pauletto, Stockholm: KTH Royal Institute of Technology , 2019, s. 70-77Konferensbidrag, Publicerat paper (Refereegranskat)
Abstract [en]

The motivation for this text is my ongoing research into creating a uniform and comprehensive notation system for music regardless of sound sources, acoustic or electronic. I propose a way to visually represent the positions and movements of sound in composition and analysis of music which in different ways utilises space as a parameter. I address a number of aspects of spatialised music to take into account when defining a notation language for the music. I suggest visually representing the room in different ways depending on how the music relates to the concept of space: as projections from the center of a sphere for more structural work, or as coordinates in a cubic room for works that depict a physical or imagined space. I also show how these descriptions of space are integrated with my existing notation system.

Ort, förlag, år, upplaga, sidor
Stockholm: KTH Royal Institute of Technology, 2019
Nyckelord
Sonology, Notation, Spatialisation
Nationell ämneskategori
Musik
Identifikatorer
urn:nbn:se:kth:diva-326847 (URN)
Konferens
Nordic Sound and Music Computing Conference 2019
Projekt
The Harmony of Noise
Anmärkning

QC 20230522

Tillgänglig från: 2023-05-12 Skapad: 2023-05-12 Senast uppdaterad: 2023-05-23Bibliografiskt granskad
3. The notation of sound for composition and transcription: An adaptation of Lasse Thoresen's spectromorphological analysis
Öppna denna publikation i ny flik eller fönster >>The notation of sound for composition and transcription: An adaptation of Lasse Thoresen's spectromorphological analysis
2020 (Engelska)Ingår i: Proceedings of the International Conference on Technologies for Music Notation and Representation -- TENOR'20 / [ed] Rama Gottfried, Georg Hajdu, Jacob Sello, Alessandro Anatrini, John MacCallum, Hamburg, 2020, s. 106-113Konferensbidrag, Publicerat paper (Refereegranskat)
Abstract [en]

This paper details my adaptation of Lasse Thoresen’s spectromorphological analysis notation for the sake of composition and transcription, re-imagining the analysis symbols for use over a spectrum staff system over which pitch and spectra can be indicated with great detail, and possibly interpreted by musicians and computers for performance. A sound object is notated with regard to its spectral width, density, centroid frequency, significant sound components, modulation and amplitude envelope. It can also have a spectrum reference. The symbols are placed over a spectrum grand-staff with a frequency scale to show each parameter both from a frequency and pitch perspective. Also included are suggestions for the visual representation of spatialisation where positions and movements are displayed in two or three dimensions above the sound notation while constant rotations are notated as modulations. 

Ort, förlag, år, upplaga, sidor
Hamburg: , 2020
Nyckelord
notation, sonology, analysis
Nationell ämneskategori
Musik
Identifikatorer
urn:nbn:se:kth:diva-326848 (URN)
Konferens
TENOR'20
Anmärkning

Part of proceedings: ISBN 978-3-00-066930-9

QC 20230522

Tillgänglig från: 2023-05-12 Skapad: 2023-05-12 Senast uppdaterad: 2023-05-23Bibliografiskt granskad
4. Sonification of Complex Spectral Structures
Öppna denna publikation i ny flik eller fönster >>Sonification of Complex Spectral Structures
2022 (Engelska)Ingår i: Frontiers in Neuroscience, ISSN 1662-4548, E-ISSN 1662-453X, Frontiers in Neuroscience, ISSN 1662-4548, Vol. 16Artikel, forskningsöversikt (Refereegranskat) Published
Abstract [en]

In this article, we present our work on the sonification of notated complex spectral structures. It is part of a larger research project about the design of a new notation system for representing sound-based musical structures. Complex spectral structures are notated with special symbols in the scores, which can be digitally rendered so that the user can hear key aspects of what has been notated. This hearing of the notated data is significantly different from reading the same data, and reveals the complexity hidden in its simplified notation. The digitally played score is not the music itself but can provide essential information about the music in ways that can only be obtained in sounding form. The playback needs to be designed so that the user can make relevant sonic readings of the sonified data. The sound notation system used here is an adaptation of Thoresen and Hedman’s spectromorphological analysis notation. Symbols originally developed by Lasse Thoresen from Pierre Schaeffer’s typo-morphology have in this system been adapted to display measurable spectral features of timbrel structure for the composition and transcription of sound-based musical structures. Spectrum category symbols are placed over a spectral grand-staff that combines indications of pitch and frequency values for the combined display of music related to pitch-based and spectral values. Spectral features of a musical structure such as spectral width and density are represented as graphical symbols and sonically rendered. In perceptual experiments we have verified that users can identify spectral notation parameters based on their sonification. This confirms the main principle of sonification that is that the data/dimensions relations in one domain, in our case notated representation of spectral features, are transformed in perceived relations in the audio domain, and back.

Ort, förlag, år, upplaga, sidor
Frontiers Media SA, 2022
Nyckelord
sonification, complex spectral structure, music, spectrum, perception, listening, comprehension
Nationell ämneskategori
Musik Medie- och kommunikationsvetenskap Medieteknik Humaniora och konst Människa-datorinteraktion (interaktionsdesign)
Forskningsämne
Medieteknik; Människa-datorinteraktion; Konst, teknik och design; Informations- och kommunikationsteknik
Identifikatorer
urn:nbn:se:kth:diva-310444 (URN)10.3389/fnins.2022.832265 (DOI)000787244500001 ()35360157 (PubMedID)2-s2.0-85127350223 (Scopus ID)
Projekt
The harmony of noise
Forskningsfinansiär
Vetenskapsrådet, 2017-03979
Anmärkning

QC 20230207

Tillgänglig från: 2022-03-31 Skapad: 2022-03-31 Senast uppdaterad: 2023-05-23Bibliografiskt granskad
5. Notation as visual representation of sound-based music
Öppna denna publikation i ny flik eller fönster >>Notation as visual representation of sound-based music
2022 (Engelska)Ingår i: Journal of New Music Research, ISSN 0929-8215, E-ISSN 1744-5027, Vol. 51, nr 2-3, s. 186-202Artikel i tidskrift (Refereegranskat) Published
Abstract [en]

This text describes the musical evaluation of a hybrid music notation system that combines traditional notation with symbols and concepts from spectromorphological analysis. During three academic years from 2017 to 2020, three groups of composition students learned to work with sound notation, recreating and interpreting short electroacoustic music sketches based solely on their notation transcriptions – they had not heard the original sketches. The students’ score interpretations bore obvious similarities to the original music sketches and their written reflections showed that there were no major difficulties in understanding the notation although some difficulties existed concerning finding suitable sounds, especially sounds with stable pitch.

Ort, förlag, år, upplaga, sidor
Oxfordshire: Informa UK Limited, 2022
Nationell ämneskategori
Musik
Identifikatorer
urn:nbn:se:kth:diva-326849 (URN)10.1080/09298215.2023.2174144 (DOI)000932171100001 ()2-s2.0-85148068928 (Scopus ID)
Anmärkning

QC 20230522

Tillgänglig från: 2023-05-12 Skapad: 2023-05-12 Senast uppdaterad: 2023-10-10Bibliografiskt granskad
6. Computer-aided Composition Using a Sound-Based Notation
Öppna denna publikation i ny flik eller fönster >>Computer-aided Composition Using a Sound-Based Notation
(Engelska)Ingår i: Computer music journal, ISSN 0148-9267, E-ISSN 1531-5169Artikel i tidskrift (Övrigt vetenskapligt) Accepted
Abstract [en]

This article describes the music data format of the recently introduced Sound Notation system, and how it makes possible computer-aided composition of scores represent- ing sound-based music. The Sound Notation system is an adaptation of Lasse Thoresen’s spectromorphological analysis notation, developed for composition and analysis. A detailed description of the data format is followed by two examples of its application in a computer-aided composi- tion process resulting in the sounding interpretation of two score excerpts of an electroacoustic composition. Generat- ing sound structures as symbolic notation data in this way provided possibilities for the creation of sound-based mu- sic otherwise limited to works of traditional notation.

Nyckelord
Computer-aided composition, notation, algorithmic composition
Nationell ämneskategori
Musik
Identifikatorer
urn:nbn:se:kth:diva-326850 (URN)
Projekt
Sound Notation
Anmärkning

QC 20230522

Tillgänglig från: 2023-05-12 Skapad: 2023-05-12 Senast uppdaterad: 2023-05-23Bibliografiskt granskad

Open Access i DiVA

Mattias Sköld - Sound Notation(6487 kB)928 nedladdningar
Filinformation
Filnamn FULLTEXT01.pdfFilstorlek 6487 kBChecksumma SHA-512
a430cd6e0bf3b12e43e34247e746cc03bd9ee324619d9d607eb904ebe53fbcde374049da19fa9b9d92040c68c60670246e14a67e1abd0a6e670e07a3a8cc522f
Typ fulltextMimetyp application/pdf

Sök vidare i DiVA

Av författaren/redaktören
Mattias, Sköld
Av organisationen
Medieteknik och interaktionsdesign, MID
Medieteknik

Sök vidare utanför DiVA

GoogleGoogle Scholar
Totalt: 928 nedladdningar
Antalet nedladdningar är summan av nedladdningar för alla fulltexter. Det kan inkludera t.ex tidigare versioner som nu inte längre är tillgängliga.

isbn
urn-nbn

Altmetricpoäng

isbn
urn-nbn
Totalt: 2057 träffar
RefereraExporteraLänk till posten
Permanent länk

Direktlänk
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Annat format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annat språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf