Change search
ReferencesLink to record
Permanent link

Direct link
Implementation and Robustness of Hopfield Networks with Spiking Neurons
KTH, School of Engineering Sciences (SCI).
2014 (English)Independent thesis Basic level (degree of Bachelor), 10 credits / 15 HE creditsStudent thesis
Abstract [en]

Computational models of neural activity and neural networks have been an active area of research as long as there have been computers, and have led several important discoveries in the eld of machine learning. One kind of articial network proposed by John J. Hopeld in 1982 has been among the more successful ones, and is still in active use today. It has been suggested that in addition to its merits in machine learning, it could also serve as a foundation of the explanation of human ability of recollection and association. However, Hopeld's original design used a very simplied model of neurons. By using so called integrate-and-remodels, higher realism can be achieved.

This report begins with a discussion of mechanistic and quantitative description of neurons, in particular the induction of action potentials, and furthermore why an integrate-and-re model is a reasonable choice for a model of intermediate complexity. By explicitly describing individual spikes, a fundamental but often neglected characteristic of communication between neurons is captured. Integrate-and-re models are included in the Neural Simulation Tool (NEST), and in this report such a neural model is applied to Hopeld networks. Both spike-rate coding and temporal coding are studied, as well as a simple model of synaptic Spike-Timing DependentPlasticity (STDP) for online learning. The networks' robustness is evaluated with respect to changes in (a) global scaling of the synaptic weights, (b) delays in the synaptic connections, (c) level of noise and (d) strength of input stimuli. They are found to be somewhat sensitive, with (a) giving the most denite results, suggesting that the used description of Hopfield networks might not be an immediately plausible biological model. In particular, networks using temporal coding are found to be especially difficult to calibrate. This could reveal a potential weakness in relatively recent and apparently successful models.

Place, publisher, year, edition, pages
2014. , 32 p.
National Category
Computer Science
URN: urn:nbn:se:kth:diva-153770OAI: diva2:753649
Educational program
Master of Science in Engineering -Engineering Physics
Available from: 2014-10-08 Created: 2014-10-08 Last updated: 2014-10-08Bibliographically approved

Open Access in DiVA

Emil Wärnberg kandidatexam(1653 kB)234 downloads
File information
File name FULLTEXT01.pdfFile size 1653 kBChecksum SHA-512
Type fulltextMimetype application/pdf

By organisation
School of Engineering Sciences (SCI)
Computer Science

Search outside of DiVA

GoogleGoogle Scholar
Total: 234 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

Total: 322 hits
ReferencesLink to record
Permanent link

Direct link