Next Article in Journal
The Impact of Virtualisation Techniques on Power System Control Networks
Next Article in Special Issue
IoT-Oriented Design of an Associative Memory Based on Impulsive Hopfield Neural Network with Rate Coding of LIF Oscillators
Previous Article in Journal
Forensic Analysis of Fitbit Versa 2 Data on Android
 
 
Article

Neural Network for Low-Memory IoT Devices and MNIST Image Recognition Using Kernels Based on Logistic Map

Institute of Physics and Technology, Petrozavodsk State University, 31 Lenina Str., 185910 Petrozavodsk, Russia
Electronics 2020, 9(9), 1432; https://doi.org/10.3390/electronics9091432
Received: 29 July 2020 / Revised: 25 August 2020 / Accepted: 29 August 2020 / Published: 2 September 2020
(This article belongs to the Special Issue Ambient Intelligence in IoT Environments)
This study presents a neural network which uses filters based on logistic mapping (LogNNet). LogNNet has a feedforward network structure, but possesses the properties of reservoir neural networks. The input weight matrix, set by a recurrent logistic mapping, forms the kernels that transform the input space to the higher-dimensional feature space. The most effective recognition of a handwritten digit from MNIST-10 occurs under chaotic behavior of the logistic map. The correlation of classification accuracy with the value of the Lyapunov exponent was obtained. An advantage of LogNNet implementation on IoT devices is the significant savings in memory used. At the same time, LogNNet has a simple algorithm and performance indicators comparable to those of the best resource-efficient algorithms available at the moment. The presented network architecture uses an array of weights with a total memory size from 1 to 29 kB and achieves a classification accuracy of 80.3–96.3%. Memory is saved due to the processor, which sequentially calculates the required weight coefficients during the network operation using the analytical equation of the logistic mapping. The proposed neural network can be used in implementations of artificial intelligence based on constrained devices with limited memory, which are integral blocks for creating ambient intelligence in modern IoT environments. From a research perspective, LogNNet can contribute to the understanding of the fundamental issues of the influence of chaos on the behavior of reservoir-type neural networks. View Full-Text
Keywords: logistic map; constrained devices; IoT; neural network; reservoir computing; handwritten digits recognition; ambient intelligence; Lyapunov exponent; chaos logistic map; constrained devices; IoT; neural network; reservoir computing; handwritten digits recognition; ambient intelligence; Lyapunov exponent; chaos
Show Figures

Figure 1

MDPI and ACS Style

Velichko, A. Neural Network for Low-Memory IoT Devices and MNIST Image Recognition Using Kernels Based on Logistic Map. Electronics 2020, 9, 1432. https://doi.org/10.3390/electronics9091432

AMA Style

Velichko A. Neural Network for Low-Memory IoT Devices and MNIST Image Recognition Using Kernels Based on Logistic Map. Electronics. 2020; 9(9):1432. https://doi.org/10.3390/electronics9091432

Chicago/Turabian Style

Velichko, Andrei. 2020. "Neural Network for Low-Memory IoT Devices and MNIST Image Recognition Using Kernels Based on Logistic Map" Electronics 9, no. 9: 1432. https://doi.org/10.3390/electronics9091432

Find Other Styles
Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.

Article Access Map by Country/Region

1
Back to TopTop