Skip to Content
You are currently on the new version of our website. Access the old version .
EntropyEntropy
  • Article
  • Open Access

31 October 2025

17 Pages

Information Entropy of Biometric Data in a Recurrent Neural Network with Low Connectivity

,
,
,
and
1
Grupo de Neurocomputación Biológica, Dpto. de Ingeniería Informática, Escuela Politécnica Superior, Universidad Autónoma de Madrid, 28049 Madrid, Spain
2
SI2Lab, FICA, Universidad de las Américas, Quito 170124, Ecuador
3
ETSII, Universidad Rey Juan Carlos, 28933 Madrid, Spain
4
Instituto de Física, Universidade Federal do Rio Grande do Sul, Porto Alegre 91501-970, RS, Brazil
This article belongs to the Special Issue Entropy Based Machine Learning Models

Abstract

In this paper, we explore the storage capacity and maximal information content of a random recurrent neural network characterized by a very low connectivity. A specific set of patterns is embedded into the network according to the Hebb prescription, a fundamental principle in neural learning. We thoroughly examine how various properties of the network, such as its connectivity and the level of synaptic noise, influence its performance and information retention capabilities, which is evaluated through an entropy measure. Our theoretical analyses are complemented by extensive simulations, and the results are validated through comparisons with the retrieval of real biometric patterns, including retinal vessel maps and fingerprints. This comprehensive approach provides deeper insights into the functionality and limitations of finite-connectivity neural networks and their applicability to the retrieval of complex, structured patterns.

Article Metrics

Citations

Article Access Statistics

Multiple requests from the same IP address are counted as one view.