Loughborough University
Browse

CDNA-SNN: A new spiking neural network for pattern classification using neuronal assemblies

Download (1.94 MB)
journal contribution
posted on 2024-04-08, 13:13 authored by Vahid Saranirad, Shirin DoraShirin Dora, Thomas Martin McGinnity, Damien Coyle

Spiking neural networks (SNNs) mimic their biological counterparts more closely than their predecessors and are considered the third generation of artificial neural networks. It has been proven that networks of spiking neurons have a higher computational capacity and lower power requirements than sigmoidal neural networks. This article introduces a new type of SNN that draws inspiration and incorporates concepts from neuronal assemblies in the human brain. The proposed network, termed as class-dependent neuronal activation-based SNN (CDNA-SNN), assigns each neuron learnable values known as CDNAs which indicate the neuron’s average relative spiking activity in response to samples from different classes. A new learning algorithm that categorizes the neurons into different class assemblies based on their CDNAs is also presented. These neuronal assemblies are trained via a novel training method based on spike-timing-dependent plasticity (STDP) to have high activity for their associated class and low firing rate for other classes. Also, using CDNAs, a new type of STDP that controls the amount of plasticity based on the assemblies of pre-and postsynaptic neurons is proposed. The performance of CDNA-SNN is evaluated on five datasets from the University of California, Irvine (UCI) machine learning repository, as well as Modified National Institute of Standards and Technology (MNIST) and Fashion MNIST, using nested cross-validation (N-CV) for hyperparameter optimization. Our results show that CDNA-SNN significantly outperforms synaptic weight association training  (SWAT) ( p < 0.0005) and SpikeProp ( p < 0.05) on 3/5 and self-regulating evolving spiking neural (SRESN) ( p < 0.05) on 2/5 UCI datasets while using the significantly lower number of trainable parameters. Furthermore, compared to other supervised, fully connected SNNs, the proposed SNN reaches the best performance for Fashion MNIST and comparable performance for MNIST and neuromorphic-MNIST (N-MNIST), also utilizing much less (1%–35%) parameters.

Funding

Dr. George Moore Ph.D. Scholarship in intelligent data analytics

Turing AI Fellowship: AI for Intelligent Neurotechnology and Human-Machine Symbiosis

Engineering and Physical Sciences Research Council

Find out more...

History

School

  • Science

Department

  • Computer Science

Published in

IEEE Transactions on Neural Networks and Learning Systems

Volume

36

Issue

2

Pages

2274 - 2287

Publisher

IEEE

Version

  • AM (Accepted Manuscript)

Rights holder

© IEEE

Publisher statement

© 2024 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.

Acceptance date

2023-12-01

Publication date

2024-02-08

Copyright date

2024

ISSN

2162-237X

eISSN

2162-2388

Language

  • en

Depositor

Dr Shirin Dora. Deposit date: 3 April 2024

Usage metrics

    Loughborough Publications

    Exports

    RefWorks
    BibTeX
    Ref. manager
    Endnote
    DataCite
    NLM
    DC