Monitor-Based Spiking Recurrent Network for the Representation of Complex Dynamic Patterns

Int J Neural Syst. 2019 Oct;29(8):1950006. doi: 10.1142/S0129065719500060. Epub 2019 Feb 8.

Abstract

Neural networks are powerful computation tools for mimicking the human brain to solve realistic problems. Since spiking neural networks are a type of brain-inspired network, called the novel spiking system, Monitor-based Spiking Recurrent network (MbSRN), is derived to learn and represent patterns in this paper. This network provides a computational framework for memorizing the targets using a simple dynamic model that maintains biological plasticity. Based on a recurrent reservoir, the MbSRN presents a mechanism called a 'monitor' to track the components of the state space in the training stage online and to self-sustain the complex dynamics in the testing stage. The network firing spikes are optimized to represent the target dynamics according to the accumulation of the membrane potentials of the units. Stability analysis of the monitor conducted by limiting the coefficient penalty in the loss function verifies that our network has good anti-interference performance under neuron loss and noise. The results of solving some realistic tasks show that the MbSRN not only achieves a high goodness-of-fit of the target patterns but also maintains good spiking efficiency and storage capacity.

Keywords: Spiking recurrent network; monitor; online learning; robustness; storage capacity.

MeSH terms

  • Action Potentials*
  • Machine Learning*
  • Neural Networks, Computer*
  • Pattern Recognition, Automated