Search Results (21)

In recent years, the development of computer vision technology has led to significant implementations of non-contact structural identification. This study investigates the performance offered by the Phase-Based Motion Magnification (PBMM) algorithm, which employs video acquisitions to estimate the displacements of target pixels and amplify vibrations occurring within a desired frequency band. Using low-cost acquisition setups, this technique can potentially replace the pointwise measurements provided by traditional contact sensors. The main novelty of this experimental research is the validation of PBMM-based experimental modal analyses on multi-storey frame structures with different stiffnesses, considering six structural layouts with different configurations of diagonal bracings. The PBMM results, both in terms of time series and identified modal parameters, are validated against benchmarks provided by an array of physically attached accelerometers. In addition, the influence of pixel intensity on estimates’ accuracy is investigated. Although the PBMM method shows limitations due to the low frame rates of the commercial cameras employed, along with an increase in the signal-to-noise ratio in correspondence of bracing nodes, this method turned out to be effective in modal identification for structures with modest variations in stiffness in terms of height. Moreover, the algorithm exhibits modest sensitivity to pixel intensity. An open access dataset containing video and sensor data recorded during the experiments, is available to support further research at the following https://doi.org/10.5281/zenodo.10412857. Full article

Automated tasks, mainly in the biomedical field, help to develop new technics to provide faster solutions for monitoring patients’ health status. For instance, they help to measure different types of human bio-signal, perform fast data analysis, and enable overall patient status monitoring. Eulerian Video Magnification (EVM) can reveal small-scale and hidden changes in real life such as color and motion changes that are used to detect actual pulse. However, due to patient movement during the measurement, the EVM process will result in the wrong estimation of the pulse. In this research, we provide a working prototype for effective artefact elimination using a face movement compensated EVM (MC-EVM) which aims to track the human face as the main Region Of Interest (ROI) and then use EVM to estimate the pulse. Our primary contribution lays on the development and training of two face detection models using TensorFlow Lite: the Single-Shot MultiBox Detector (SSD) and the EfficientDet-Lite0 models that are used based on the computational capabilities of the device in use. By employing one of these models, we can crop the face accurately from the video, which is then processed using EVM to estimate the pulse. MC-EVM showed very promising results and ensured robust pulse measurement by effectively mitigating the impact of patient movement. The results were compared and validated against ground-truth data that were made available online and against pre-existing solutions from the state-of-the-art. Full article

This paper introduces the improvements in natural-frequency-based SHM by applying bio-inspired optimization methods and a vision-based monitoring system for effective damage detection. This paper proposes a natural frequency extraction method using a motion magnification-based vision monitoring system with bio-inspired optimization techniques to estimate the damage location and depth in a cantilever beam. The proposed optimization techniques are inspired by natural processes and biological evolution including genetic algorithms, particle swarm optimization, sea lion optimization, and coral reefs optimization. To verify the performance of each bio-inspired optimization method, the eigenvalues of a two-bay truss structure are used for estimating the damaged elements. Then, using the proposed video motion magnification method, the natural frequency for each undamaged and damaged cantilever beam is extracted and compared with the LDV sensor to verify the proposed vision-based monitoring system. The performance of each bio-inspired optimizer in damage detection is compared. As a result, coral reefs optimization shows the lowest average error, around 1%, in damage detection using the natural frequency. Full article

As a non-contact method, vision-based measurement for vibration extraction and modal parameter identification has attracted much attention. In most cases, artificial textures are crucial elements for visual tracking, and this feature limits the application of vision-based vibration measurement on textureless targets. As a computation technique for visualizing subtle variations in videos, the video magnification technique can analyze modal responses and visualize modal shapes, but the efficiency is low, and the processing results contain clipping artifacts. This paper proposes a novel method for the application of a modal test. In contrast to the deviation magnification that exaggerates subtle geometric deviations from only a single image, the proposed method extracts vibration signals with sub-pixel accuracy on edge positions by changing the perspective of deviations from space to timeline. Then, modal shapes are visualized by decoupling all spatial vibrations following the vibration theory of continuous linear systems. Without relying on artificial textures and motion magnification, the proposed method achieves high operating efficiency and avoids clipping artifacts. Finally, the effectiveness and practical value of the proposed method are validated by two laboratory experiments on a cantilever beam and an arch dam model. Full article

Rotating machinery condition monitoring and fault diagnosis are important bases for maintenance decisions, as the vibrations generated during operation are usually imperceptible to the naked eye. Eulerian video motion magnification (EVMM) can reveal subtle changes and has been widely used in various fields such as medicine, structural analysis, and fault diagnosis, etc. However, the method has a bound relationship among three parameters: spatial wavelength, amplification factor, and displacement function, so it is necessary to adjust the parameters manually in practical applications. In this paper, on the basis of the original method, an automatic solution of spatial cutoff wavelength based on brightness is proposed. First, an input video is decomposed into image sequences, their RGB color spaces are transformed into HSV color spaces, and the Value channel image representing brightness is selected to automatically calculate the spatial cutoff frequency, and then the spatial cutoff wavelength is determined, and the motion magnification video in the specified frequency band is obtained by substituting it into the original method. Then, a publicly available video is taken as an example for simulation analysis. By comparing the time-brightness curves of the three videos (original video, motion magnification video obtained by the original method and the improved method), it is apparent that the proposed method exhibits the most significant brightness variation. Finally, taking an overhung rotor-bearing test device as the object, five conditions are set, respectively: normal, rotor unbalance, loosened anchor bolt of the bearing seat, compound fault, rotor misalignment. The proposed method is adopted to magnify the motion of the characteristic frequency bands including 1X frequency and 2X frequency. The results show that no obvious displacement is found in normal working conditions, and that the rotor unbalance fault has an overall axial shaking, the bearing seat at the loose place has an obvious vertical displacement, while the compound fault combines the both fault characteristics, and the rotor misalignment fault has an obvious axial displacement of the free-end bearing seat. The method proposed in this paper can automatically obtain the space cutoff wavelength, which solves the problem of defects arising from manually adjusting the parameters in the original method, and provides a new method for rotating machinery fault diagnosis and other fields of application. Full article

This paper explores the potential of a low-cost, advanced video-based technique for the assessment of structural damage to buildings caused by seismic loading. A low-cost, high-speed video camera was utilized for the motion magnification processing of footage of a two-story reinforced-concrete frame building subjected to shaking table tests. The damage after seismic loading was estimated by analyzing the dynamic behavior (i.e., modal parameters) and the structural deformations of the building in magnified videos. The results using the motion magnification procedure were compared for validation of the method of the damage assessment obtained through analyses of conventional accelerometric sensors and high-precision optical markers tracked using a passive 3D motion capture system. In addition, 3D laser scanning to obtain an accurate survey of the building geometry before and after the seismic tests was carried out. In particular, accelerometric recordings were also processed and analyzed using several stationary and nonstationary signal processing techniques with the aim of analyzing the linear behavior of the undamaged structure and the nonlinear structural behavior during damaging shaking table tests. The proposed procedure based on the analysis of magnified videos provided an accurate estimate of the main modal frequency and the damage location through the analysis of the modal shapes, which were confirmed using advanced analyses of the accelerometric data. Consequently, the main novelty of the study was the highlighting of a simple procedure with high potential for the extraction and analysis of modal parameters, with a special focus on the analysis of the modal shape’s curvature, which provides accurate information on the location of the damage in a structure, while using a noncontact and low-cost method. Full article

The breathing rate monitoring is an important measure in medical applications and daily physical activities. The contact sensors have shown their effectiveness for breathing monitoring and have been mostly used as a standard reference, but with some disadvantages for example in burns patients with vulnerable skins. Contactless monitoring systems are then gaining attention for respiratory frequency detection. We propose a new non-contact technique to estimate the breathing rate based on the motion video magnification method by means of the Hermite transform and an Artificial Hydrocarbon Network (AHN). The chest movements are tracked by the system without the use of an ROI in the image video. The machine learning system classifies the frames as inhalation or exhalation using a Bayesian-optimized AHN. The method was compared using an optimized Convolutional Neural Network (CNN). This proposal has been tested on a Data-Set containing ten healthy subjects in four positions. The percentage error and the Bland–Altman analysis is used to compare the performance of the strategies estimating the breathing rate. Besides, the Bland–Altman analysis is used to search for the agreement of the estimation to the reference.The percentage error for the AHN method is $2.19\pm 2.1$ with and agreement with respect of the reference of ≈99%. Full article

In recent years, the ENEA has introduced a novel methodology based on motion magnification (MM) into the Italian cultural heritage protection and monitoring field. It consists of a digital video signal processing technique able to amplify enormously the tiny movements recorded in conventional videos, while preserving the general topology of the acquired frames. Though the idea of such a methodology is not new, it has recently been provided with an efficient algorithm that makes possible a viable and low-cost magnification. Applications are extremely varied in almost every field of science and technology; however, we are interested in its application to the safeguarding of architectural heritage, a sector of the utmost importance for Italy. As ancient buildings can be extremely sensitive to even minimally invasive instrumentation, most common monitoring sensors can be replaced by contactless tools and methods, such as video-based techniques like MM. It offers many advantages: easy to use, contactless devices, virtual sensors, reusability of the videos, practicality, intuitive graphical results, quantitative analyses capability and low costs. These characteristics are well suited to the monitoring of large ancient monuments; on the other hand, historical sites have peculiarities of their own, requiring careful approaches, proper tools and trained personnel. Moreover, outdoor applications of MM present quite notable difficulties from a practical point of view, e.g., the dimensions of the studied objects, uncontrolled environmental conditions, spurious vibrations, lighting change/instability, etc. Here we give a general idea of the potential of MM and related issues, using some relevant in-the-field case studies in Italian heritage protection. Full article

As a promising alternative to conventional contact sensors, vision-based technologies for a structural dynamic response measurement and health monitoring have attracted much attention from the research community. Among these technologies, Eulerian video magnification has a unique capability of analyzing modal responses and visualizing modal shapes. To reduce the noise interference and improve the quality and stability of the modal shape visualization, this study proposes a hybrid motion magnification framework that combines linear and phase-based motion processing. Based on the assumption that temporal variations can represent spatial motions, the linear motion processing extracts and manipulates the temporal intensity variations related to modal responses through matrix decomposition and underdetermined blind source separation (BSS) techniques. Meanwhile, the theory of Fourier transform profilometry (FTP) is utilized to reduce spatial high-frequency noise. As all spatial motions in a video are linearly controllable, the subsequent phase-based motion processing highlights the motions and visualizes the modal shapes with a higher quality. The proposed method is validated by two laboratory experiments and a field test on a large-scale truss bridge. The quantitative evaluation results with high-speed cameras demonstrate that the hybrid method performs better than the single-step phase-based motion magnification method in visualizing sound-induced subtle motions. In the field test, the vibration characteristics of the truss bridge when a train is driving across the bridge are studied with a commercial camera over 400 m away from the bridge. Moreover, four full-field modal shapes of the bridge are successfully observed. Full article

Detecting the onset of structural damage and its progressive evolution is crucial for the assessment and maintenance of the built environment. This paper describes the application of a computer-vision-based methodology for structural health monitoring to a shake table investigation. Three rubble stone masonry walls, one unreinforced and two reinforced, were tested under natural earthquake base inputs, progressively scaled up to collapse. White noise signals were also applied for dynamic identification purposes. Throughout the experiments, videos were recorded, under both white noise excitation and environmental vibrations, with the table at rest. The videos were preprocessed with motion magnification algorithms and analyzed through a principal component analysis. The natural frequencies of the walls were detected and their progressive decay was associated with damage accumulation. Results agreed with those obtained from another measurement system available in the laboratory and were consistent with the crack pattern development surveyed during the tests. The proposed approach proved useful to derive information on the progressive deterioration of the structural properties, showing the feasibility of this methodology for real field applications. Full article

Estimating heart rate is important for monitoring users in various situations. Estimates based on facial videos are increasingly being researched because they allow the monitoring of cardiac information in a non-invasive way and because the devices are simpler, as they require only cameras that capture the user’s face. From these videos of the user’s face, machine learning can estimate heart rate. This study investigates the benefits and challenges of using machine learning models to estimate heart rate from facial videos through patents, datasets, and article review. We have searched the Derwent Innovation, IEEE Xplore, Scopus, and Web of Science knowledge bases and identified seven patent filings, eleven datasets, and twenty articles on heart rate, photoplethysmography, or electrocardiogram data. In terms of patents, we note the advantages of inventions related to heart rate estimation, as described by the authors. In terms of datasets, we have discovered that most of them are for academic purposes and with different signs and annotations that allow coverage for subjects other than heartbeat estimation. In terms of articles, we have discovered techniques, such as extracting regions of interest for heart rate reading and using video magnification for small motion extraction, and models, such as EVM-CNN and VGG-16, that extract the observed individual’s heart rate, the best regions of interest for signal extraction, and ways to process them. Full article

The ability to discern subtle image changes over time is useful in applications such as product quality control, civil engineering structure evaluation, medical video analysis, music entertainment, and so on. However, tiny yet useful variations are often combined with large motions, which severely distorts current video amplification methods bounded by external constraints. This paper presents a novel use of spectra to make motion magnification robust to large movements. By exploiting spectra, artificial limitations and the magnification of small motions are avoided at similar frequency levels while ignoring large ones at distinct spectral pixels. To achieve this, this paper constructs spline-kerneled chirplet transform (SCT) into an empirical Bayesian paradigm that applies to the entire time series, giving powerful spectral resolution and robust performance to noise in nonstationary nonlinear signal analysis. The important advance reported is Bayesian-rule embedded SCT (BE-SCT); two numerical experiments show its superiority over current approaches. For applying to spectrum-aware motion magnification, an elaborate analytical framework is established that captures global motion, and use of the proposed BE-SCT for dynamic filtering enables a frequency-based motion isolation. Our approach is demonstrated on real-world and synthetic videos. This approach shows superior qualitative and quantitative results with less visual artifacts and more local details over the state-of-the-art methods. Full article

Much information can be derived from operational deflection shapes of vibrating structures and the magnification of their motion. However, the acquisition of deflection shapes usually requires a manual definition of an object’s points of interest, while general motion magnification is computationally inefficient. We propose easy extraction of operational deflection shapes straight from vision data by analyzing and processing optical flow information from the video and then, based on these graphs, morphing source data to magnify the shape of deflection. We introduce several processing routines for automatic masking of the optical flow data and frame-wise information fusion. The method is tested based on data acquired both in numerical simulations and real-life experiments in which cantilever beams were subjected to excitation around their natural frequencies. Full article

The locations and breathing signal of people in disaster areas are significant information for search and rescue missions in prioritizing operations to save more lives. For detecting the living people who are lying on the ground and covered with dust, debris or ashes, a motion magnification-based method has recently been proposed. This current method estimates the locations and breathing signal of people from a drone video by assuming that only human breathing-related motions exist in the video. However, in natural disasters, background motions, such as swing trees and grass caused by wind, are mixed with human breathing, that distort this assumption, resulting in misleading or even no life signs locations. Therefore, the life signs in disaster areas are challenging to be detected due to the undesired background motions. Note that human breathing is a natural physiological phenomenon, and it is a periodic motion with a steady peak frequency; while background motion always involves complex space-time behaviors, their peak frequencies seem to be variable over time. Therefore, in this work we analyze and focus on the frequency properties of motions to model a frequency variability feature used for extracting only human breathing, while eliminating irrelevant background motions in the video, which would ease the challenge in detection and localization of life signs. The proposed method was validated with both drone and camera videos recorded in the wild. The average precision measures of our method for drone and camera videos were 0.94 and 0.92, which are higher than that of compared methods, demonstrating that our method is more robust and accurate to background motions. The implications and limitations regarding the frequency variability feature were discussed. Full article

The monitoring of respiratory rate is a relevant factor in medical applications and day-to-day activities. Contact sensors have been used mostly as a direct solution and they have shown their effectiveness, but with some disadvantages for example in vulnerable skins such as burns patients. For this reason, contactless monitoring systems are gaining increasing attention for respiratory detection. In this paper, we present a new non-contact strategy to estimate respiratory rate based on Eulerian motion video magnification technique using Hermite transform and a system based on a Convolutional Neural Network (CNN). The system tracks chest movements of the subject using two strategies: using a manually selected ROI and without the selection of a ROI in the image frame. The system is based on the classifications of the frames as an inhalation or exhalation using CNN. Our proposal has been tested on 10 healthy subjects in different positions. To compare performance of methods to detect respiratory rate the mean average error and a Bland and Altman analysis is used to investigate the agreement of the methods. The mean average error for the automatic strategy is $3.28\pm 3.33$ % with and agreement with respect of the reference of ≈98%. Full article