Next Article in Journal
Verification Method of Safety Properties of Embedded Assembly Program by Combining SMT-Based Bounded Model Checking and Reduction of Interrupt Handler Executions
Next Article in Special Issue
Unified System Network Architecture: Flexible and Area-Efficient NoC Architecture with Multiple Ports and Cores
Previous Article in Journal
Design of Differential Variable-Gain Transimpedance Amplifier in 0.18 µm SiGe BiCMOS
Previous Article in Special Issue
Delta Multi-Stage Interconnection Networks for Scalable Wireless On-Chip Communication
Article

Towards Efficient Neuromorphic Hardware: Unsupervised Adaptive Neuron Pruning

1
Division of Computer, Electrical and Mathematical Sciences and Engineering, King Abdullah University of Science and Technology, Thuwal 23955, Saudi Arabia
2
Department of Electrical Engineering and Computer Science, University of California-Irvine, Irvine, CA 92612, USA
*
Author to whom correspondence should be addressed.
Electronics 2020, 9(7), 1059; https://doi.org/10.3390/electronics9071059
Received: 14 May 2020 / Revised: 6 June 2020 / Accepted: 23 June 2020 / Published: 27 June 2020
To solve real-time challenges, neuromorphic systems generally require deep and complex network structures. Thus, it is crucial to search for effective solutions that can reduce network complexity, improve energy efficiency, and maintain high accuracy. To this end, we propose unsupervised pruning strategies that are focused on pruning neurons while training in spiking neural networks (SNNs) by utilizing network dynamics. The importance of neurons is determined by the fact that neurons that fire more spikes contribute more to network performance. Based on these criteria, we demonstrate that pruning with an adaptive spike count threshold provides a simple and effective approach that can reduce network size significantly and maintain high classification accuracy. The online adaptive pruning shows potential for developing energy-efficient training techniques due to less memory access and less weight-update computation. Furthermore, a parallel digital implementation scheme is proposed to implement spiking neural networks (SNNs) on field programmable gate array (FPGA). Notably, our proposed pruning strategies preserve the dense format of weight matrices, so the implementation architecture remains the same after network compression. The adaptive pruning strategy enables 2.3× reduction in memory size and 2.8× improvement on energy efficiency when 400 neurons are pruned from an 800-neuron network, while the loss of classification accuracy is 1.69%. And the best choice of pruning percentage depends on the trade-off among accuracy, memory, and energy. Therefore, this work offers a promising solution for effective network compression and energy-efficient hardware implementation of neuromorphic systems in real-time applications. View Full-Text
Keywords: neuromorphic computing; spiking neural network; neuron pruning; network compression; unsupervised STDP learning; digital implementation; FPGA platform neuromorphic computing; spiking neural network; neuron pruning; network compression; unsupervised STDP learning; digital implementation; FPGA platform
Show Figures

Figure 1

MDPI and ACS Style

Guo, W.; Yantır, H.E.; Fouda, M.E.; Eltawil, A.M.; Salama, K.N. Towards Efficient Neuromorphic Hardware: Unsupervised Adaptive Neuron Pruning. Electronics 2020, 9, 1059. https://doi.org/10.3390/electronics9071059

AMA Style

Guo W, Yantır HE, Fouda ME, Eltawil AM, Salama KN. Towards Efficient Neuromorphic Hardware: Unsupervised Adaptive Neuron Pruning. Electronics. 2020; 9(7):1059. https://doi.org/10.3390/electronics9071059

Chicago/Turabian Style

Guo, Wenzhe, Hasan E. Yantır, Mohammed E. Fouda, Ahmed M. Eltawil, and Khaled N. Salama 2020. "Towards Efficient Neuromorphic Hardware: Unsupervised Adaptive Neuron Pruning" Electronics 9, no. 7: 1059. https://doi.org/10.3390/electronics9071059

Find Other Styles
Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.

Article Access Map by Country/Region

1
Back to TopTop