Digitala Vetenskapliga Arkivet

Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
A Comparison of Temporal Encoders for Neuromorphic Keyword Spotting with Few Neurons
Luleå University of Technology, Department of Computer Science, Electrical and Space Engineering, Embedded Internet Systems Lab.ORCID iD: 0000-0003-1024-5821
Bio-Inspired Circuits and Systems (BICS) Lab, Zernike Institute for Advanced Materials, University of Groningen, Groningen, The Netherlands; Groningen Cognitive Systems and Materials Center (CogniGron), University of Groningen, Groningen, The Netherlands. (Bio-Inspired Circuits and Systems Lab)
Bio-Inspired Circuits and Systems (BICS) Lab, Zernike Institute for Advanced Materials, University of Groningen, Groningen, The Netherlands; Groningen Cognitive Systems and Materials Center (CogniGron), University of Groningen, Groningen, The Netherlands. (Bio-Inspired Circuits and Systems Lab)ORCID iD: 0000-0002-4009-174X
Luleå University of Technology, Department of Computer Science, Electrical and Space Engineering, Embedded Internet Systems Lab.ORCID iD: 0000-0002-6756-0147
Show others and affiliations
2023 (English)In: 2023 International Joint Conference on Neural Networks (IJCNN): Conference Proceedings, IEEE, 2023Conference paper, Published paper (Refereed)
Abstract [en]

With the expansion of AI-powered virtual assistants, there is a need for low-power keyword spotting systems providing a “wake-up” mechanism for subsequent computationally expensive speech recognition. One promising approach is the use of neuromorphic sensors and spiking neural networks (SNNs) implemented in neuromorphic processors for sparse event-driven sensing. However, this requires resource-efficient SNN mechanisms for temporal encoding, which need to consider that these systems process information in a streaming manner, with physical time being an intrinsic property of their operation. In this work, two candidate neurocomputational elements for temporal encoding and feature extraction in SNNs described in recent literature—the spiking time-difference encoder (TDE) and disynaptic excitatory-inhibitory (E-I) elements—are comparatively investigated in a keyword-spotting task on formants computed from spoken digits in the TIDIGITS dataset. While both encoders improve performance over direct classification of the formant features in the training data, enabling a complete binary classification with a logistic regression model, they show no clear improvements on the test set. Resource-efficient keyword spotting applications may benefit from the use of these encoders, but further work on methods for learning the time constants and weights is required to investigate their full potential.

Place, publisher, year, edition, pages
IEEE, 2023.
Series
Proceedings of International Joint Conference on Neural Networks, ISSN 2161-4393, E-ISSN 2161-4407
Keywords [en]
Neuromorphic computing, Edge intelligence, Keyword spotting, Temporal code, Neural heterogeneity
National Category
Other Electrical Engineering, Electronic Engineering, Information Engineering
Research subject
Cyber-Physical Systems; Machine Learning
Identifiers
URN: urn:nbn:se:ltu:diva-94115DOI: 10.1109/IJCNN54540.2023.10191938ISI: 001046198707007Scopus ID: 2-s2.0-85169584278ISBN: 978-1-6654-8867-9 (electronic)ISBN: 978-1-6654-8868-6 (print)OAI: oai:DiVA.org:ltu-94115DiVA, id: diva2:1711071
Conference
2023 International Joint Conference on Neural Networks (IJCNN), June 18-23, 2023, Gold Coast, Australia
Funder
The Kempe Foundations, JCK-1809
Note

Funder: ECSEL JU (737459); CogniGron research center; Ubbo Emmius Funds (University of Groningen)

This article has previously appeared as a manuscript in a thesis.

Available from: 2022-11-15 Created: 2022-11-15 Last updated: 2024-03-07Bibliographically approved
In thesis
1. Event-Driven Architectures for Heterogeneous Neuromorphic Computing Systems
Open this publication in new window or tab >>Event-Driven Architectures for Heterogeneous Neuromorphic Computing Systems
2023 (English)Doctoral thesis, comprehensive summary (Other academic)
Alternative title[sv]
Händelsedrivna arkitekturer för heterogena neuromorfa datorsystem
Abstract [en]

Mixed-signal neuromorphic processors have brain-like organization and device physics optimized for emulation of spiking neural networks (SNNs), and offer an energy-efficient alternative for implementing artificial intelligence in applications where deep learning based on conventional digital computing is unfeasible or unsustainable. However, efficient use of such hardware requires appropriate configuration of its inhomogeneous, analog neurosynaptic circuits, with methods for sparse, spike-timing-based information encoding and processing. Furthermore, as neuromorphic processors are event-driven and asynchronous with massively parallel dynamic processing and colocated memory, they differ fundamentally from conventional von Neumann computers. Therefore, there is a need to investigate programming approaches and learning mechanisms for efficient use of neuromorphic processors, as well as abstractions required for large-scale integration of such devices into the present computational infrastructure of distributed digital systems. In this thesis, a disynaptic excitatory–inhibitory (E–I) element for resource-efficient generation of synaptic delay dynamics for spike-timing-based computation in neuromorphic hardware is proposed. Chip-in-the-loop experiments with a DYNAP-SE neuromorphic processor and SNN simulations are presented, demonstrating how such E–I elements leverage hardware inhomogeneity for representational variance and feature tuning for time-dependent pattern recognition. Using the E–I elements, spatiotemporal receptive fields with up to five dimensions per hardware neuron were characterized, for instance in a modified Spatiotemporal Correlator (STC) network and in an insect-inspired SNN. The energy dissipation of the proposed E–I element is one order of magnitude lower per lateral connection (0.65 vs. 9.6 nJ per spike) than the original delay-based hardware implementation of the STC. Thus, it is shown how the analog synaptic circuits could be used for efficient implementation of STC network layers, in a way that enables digital synapse-address reprogramming as an observable and reproducible mechanism for feature tuning in SNN layers. This approach may serve as a complement to more accurate but resource-intensive delay-based SNNs, as it offers a digital network-state representation and adaptation concept that can fully benefit from the inhomogeneous neurosynaptic dynamics in the inference stage. Furthermore, a microservice-based conceptual framework for neuromorphic systems integration is proposed. The framework consists of a neuromorphic-system proxy that provides virtualization and communication capabilities required in distributed settings, combined with a declarative programming approach offering engineering-process abstraction. By combining several well-established concepts from different domains of computer science, this work addresses the gap between the state of the art in digitization and neuromorphic computing software development.

Place, publisher, year, edition, pages
Luleå: Luleå tekniska universitet, 2023
Series
Doctoral thesis / Luleå University of Technology 1 jan 1997 → …, ISSN 1402-1544
Keywords
Neuromorphic computing, Mixed-signal, Low-power, Non-von Neumann, Spatiotemporal pattern recognition, System integration
National Category
Other Electrical Engineering, Electronic Engineering, Information Engineering
Research subject
Cyber-Physical Systems
Identifiers
urn:nbn:se:ltu:diva-94116 (URN)978-91-8048-219-6 (ISBN)978-91-8048-220-2 (ISBN)
Public defence
2023-02-06, A109, Luleå tekniska universitet, Luleå, 13:00 (English)
Opponent
Supervisors
Funder
The Kempe Foundations, JCK-1809EU, Horizon 2020, 737459
Available from: 2022-11-21 Created: 2022-11-21 Last updated: 2023-09-05Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

Publisher's full textScopus

Search in DiVA

By author/editor
Nilsson, MattiasKhacef, LyesLiwicki, FoteiniChicca, ElisabettaSandin, Fredrik
By organisation
Embedded Internet Systems Lab
Other Electrical Engineering, Electronic Engineering, Information Engineering

Search outside of DiVA

GoogleGoogle Scholar

doi
isbn
urn-nbn

Altmetric score

doi
isbn
urn-nbn
Total: 501 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf