A Circuit-Based Neural Network with Hybrid Learning of Backpropagation and Random Weight Change Algorithms
AbstractA hybrid learning method of a software-based backpropagation learning and a hardware-based RWC learning is proposed for the development of circuit-based neural networks. The backpropagation is known as one of the most efficient learning algorithms. A weak point is that its hardware implementation is extremely difficult. The RWC algorithm, which is very easy to implement with respect to its hardware circuits, takes too many iterations for learning. The proposed learning algorithm is a hybrid one of these two. The main learning is performed with a software version of the BP algorithm, firstly, and then, learned weights are transplanted on a hardware version of a neural circuit. At the time of the weight transplantation, a significant amount of output error would occur due to the characteristic difference between the software and the hardware. In the proposed method, such error is reduced via a complementary learning of the RWC algorithm, which is implemented in a simple hardware. The usefulness of the proposed hybrid learning system is verified via simulations upon several classical learning problems. View Full-Text
Scifeed alert for new publicationsNever miss any articles matching your research from any publisher
- Get alerts for new papers matching your research
- Find out the new papers from selected authors
- Updated daily for 49'000+ journals and 6000+ publishers
- Define your Scifeed now
Yang, C.; Kim, H.; Adhikari, S.P.; Chua, L.O. A Circuit-Based Neural Network with Hybrid Learning of Backpropagation and Random Weight Change Algorithms. Sensors 2017, 17, 16.
Yang C, Kim H, Adhikari SP, Chua LO. A Circuit-Based Neural Network with Hybrid Learning of Backpropagation and Random Weight Change Algorithms. Sensors. 2017; 17(1):16.Chicago/Turabian Style
Yang, Changju; Kim, Hyongsuk; Adhikari, Shyam P.; Chua, Leon O. 2017. "A Circuit-Based Neural Network with Hybrid Learning of Backpropagation and Random Weight Change Algorithms." Sensors 17, no. 1: 16.
Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.