TY - JOUR
T1 - A Memristive Spiking Neural Network Circuit with Selective Supervised Attention Algorithm
AU - Deng, Zekun
AU - Wang, Chunhua
AU - Lin, Hairong
AU - Sun, Yichuang
PY - 2022/12/14
Y1 - 2022/12/14
N2 - Spiking neural networks (SNNs) are biologicallyplausible and computationally powerful. The current computingsystems based on the von Neumann architecture are almostthe hardware basis for the implementation of SNNs. However,performance bottlenecks in computing speed, cost, and energyconsumption hinder the hardware development of SNNs. Therefore,efficient non-Neumann hardware computing systems forSNNs remain to be explored. In this paper, a selective supervisedalgorithm for spiking neurons inspired by the selective attentionmechanism is proposed, and a memristive spiking neuron circuitas well as a memristive SNN circuit based on the proposedalgorithm are designed. The memristor realizes the learningand memory of the synaptic weight. The proposed algorithmincludes a top-down selective supervision method and a bottomupselective supervision method. Compared with other supervisedalgorithms, the proposed algorithm has excellent performance onsequence learning. Moreover, top-down and bottom-up attentionencoding circuits are designed to provide the hardware foundationfor encoding external stimuli into top-down and bottomupattention spikes, respectively. The proposed memristive SNNcircuit can perform classification on the MNIST dataset and theFashion-MNIST dataset with superior accuracy after learninga small number of labeled samples, which greatly reduces thecost of manual annotation and improves the supervised learningefficiency of the memristive SNN circuit.
AB - Spiking neural networks (SNNs) are biologicallyplausible and computationally powerful. The current computingsystems based on the von Neumann architecture are almostthe hardware basis for the implementation of SNNs. However,performance bottlenecks in computing speed, cost, and energyconsumption hinder the hardware development of SNNs. Therefore,efficient non-Neumann hardware computing systems forSNNs remain to be explored. In this paper, a selective supervisedalgorithm for spiking neurons inspired by the selective attentionmechanism is proposed, and a memristive spiking neuron circuitas well as a memristive SNN circuit based on the proposedalgorithm are designed. The memristor realizes the learningand memory of the synaptic weight. The proposed algorithmincludes a top-down selective supervision method and a bottomupselective supervision method. Compared with other supervisedalgorithms, the proposed algorithm has excellent performance onsequence learning. Moreover, top-down and bottom-up attentionencoding circuits are designed to provide the hardware foundationfor encoding external stimuli into top-down and bottomupattention spikes, respectively. The proposed memristive SNNcircuit can perform classification on the MNIST dataset and theFashion-MNIST dataset with superior accuracy after learninga small number of labeled samples, which greatly reduces thecost of manual annotation and improves the supervised learningefficiency of the memristive SNN circuit.
U2 - 10.1109/TCAD.2022.3228896
DO - 10.1109/TCAD.2022.3228896
M3 - Article
JO - IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems
JF - IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems
SN - 0278-0070
ER -