Next Article in Journal
Automated Detection of Multi-Rotor UAVs Using a Machine-Learning Approach
Next Article in Special Issue
Managing Cloud Intelligent Systems over Digital Ecosystems: Revealing Emerging App Technology in the Time of the COVID19 Pandemic
Previous Article in Journal
Innovative Scaled Hardware Simulator for Designing and Testing an EV’s Battery Storage System Incorporated with an Adaptive ANN Model
Article

Neuromorphic Robotic Platform with Visual Input, Processor and Actuator, Based on Spiking Neural Networks

1
Department of Electrical and Electronic Engineering, Imperial College London, London SW7 2BT, UK
2
School of Computing and Engineering, University of West London, St Mary’s Road, Ealing, London W5 5RF, UK
*
Author to whom correspondence should be addressed.
Appl. Syst. Innov. 2020, 3(2), 28; https://doi.org/10.3390/asi3020028
Received: 18 March 2020 / Revised: 19 June 2020 / Accepted: 22 June 2020 / Published: 24 June 2020
(This article belongs to the Special Issue Intelligent Industrial Application of Communication Systems)
This paper describes the design and modus of operation of a neuromorphic robotic platform based on SpiNNaker, and its implementation on the goalkeeper task. The robotic system utilises an address event representation (AER) type of camera (dynamic vision sensor (DVS)) to capture features of a moving ball, and a servo motor to position the goalkeeper to intercept the incoming ball. At the backbone of the system is a microcontroller (Arduino Due) which facilitates communication and control between different robot parts. A spiking neuronal network (SNN), which is running on SpiNNaker, predicts the location of arrival of the moving ball and decides where to place the goalkeeper. In our setup, the maximum data transmission speed of the closed-loop system is approximately 3000 packets per second for both uplink and downlink, and the robot can intercept balls whose speed is up to 1 m/s starting from the distance of about 0.8 m. The interception accuracy is up to 85%, the response latency is 6.5 ms and the maximum power consumption is 7.15 W. This is better than previous implementations based on PC. Here, a simplified version of an SNN has been developed for the ‘interception of a moving object’ task, for the purpose of demonstrating the platform, however a generalised SNN for this problem is a nontrivial problem. A demo video of the robot goalie is available on YouTube. View Full-Text
Keywords: neuromorphic engineering; SpiNNaker; DVS; robotic goalkeeper neuromorphic engineering; SpiNNaker; DVS; robotic goalkeeper
Show Figures

Figure 1

MDPI and ACS Style

Cheng, R.; Mirza, K.B.; Nikolic, K. Neuromorphic Robotic Platform with Visual Input, Processor and Actuator, Based on Spiking Neural Networks. Appl. Syst. Innov. 2020, 3, 28. https://doi.org/10.3390/asi3020028

AMA Style

Cheng R, Mirza KB, Nikolic K. Neuromorphic Robotic Platform with Visual Input, Processor and Actuator, Based on Spiking Neural Networks. Applied System Innovation. 2020; 3(2):28. https://doi.org/10.3390/asi3020028

Chicago/Turabian Style

Cheng, Ran, Khalid B. Mirza, and Konstantin Nikolic. 2020. "Neuromorphic Robotic Platform with Visual Input, Processor and Actuator, Based on Spiking Neural Networks" Applied System Innovation 3, no. 2: 28. https://doi.org/10.3390/asi3020028

Find Other Styles
Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.

Article Access Map by Country/Region

1
Back to TopTop