Next Article in Journal
Countering DDoS Attacks in SIP Based VoIP Networks Using Recurrent Neural Networks
Previous Article in Journal
Path Planning of Mobile Robots Based on a Multi-Population Migration Genetic Algorithm
Open AccessLetter

Low Frequency Vibration Visual Monitoring System Based on Multi-Modal 3DCNN-ConvLSTM

School of Electrical and Information Engineering, Tianjin University, Tianjin 300072, China
*
Author to whom correspondence should be addressed.
Sensors 2020, 20(20), 5872; https://doi.org/10.3390/s20205872
Received: 14 September 2020 / Revised: 13 October 2020 / Accepted: 15 October 2020 / Published: 17 October 2020
(This article belongs to the Section Sensing and Imaging)
Low frequency vibration monitoring has significant implications on environmental safety and engineering practices. Vibration expressed by visual information should contain sufficient spatial information. RGB-D camera could record diverse spatial information of vibration in frame images. Deep learning can adaptively transform frame images into deep abstract features through nonlinear mapping, which is an effective method to improve the intelligence of vibration monitoring. In this paper, a multi-modal low frequency visual vibration monitoring system based on Kinect v2 and 3DCNN-ConvLSTM is proposed. Microsoft Kinect v2 collects RGB and depth video information of vibrating objects in unstable ambient light. The 3DCNN-ConvLSTM architecture can effectively learn the spatial-temporal characteristics of muti-frequency vibration. The short-term spatiotemporal feature of the collected vibration information is learned through 3D convolution networks and the long-term spatiotemporal feature is learned through convolutional LSTM. Multi-modal fusion of RGB and depth mode is used to further improve the monitoring accuracy to 93% in the low frequency vibration range of 0–10 Hz. The results show that the system can monitor low frequency vibration and meet the basic measurement requirements. View Full-Text
Keywords: low frequency vibration; vibration monitoring; 3D convolutional neural network; muti-modal fusion; visual sensing low frequency vibration; vibration monitoring; 3D convolutional neural network; muti-modal fusion; visual sensing
Show Figures

Figure 1

MDPI and ACS Style

Alimasi, A.; Liu, H.; Lyu, C. Low Frequency Vibration Visual Monitoring System Based on Multi-Modal 3DCNN-ConvLSTM. Sensors 2020, 20, 5872.

Show more citation formats Show less citations formats
Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.

Article Access Map by Country/Region

1
Search more from Scilit
 
Search
Back to TopTop