An acoustic matching layer is an essential component of an ultrasound transducer to achieve maximum ultrasound transmission efficiency. Here, we develop a flexible printed circuit board (FPCB) with a composite structure consisting of multiple polyimide and copper layers and demonstrate it as a novel acoustic matching layer. With a flexible substrate and robust ACF bonding, the FPCB not only serves as an acoustic matching layer between piezoelectric elements and the surrounding medium but also as a ground for the electrical connection between the transducer array elements and the folded substrate. A 1D linear ultrasound transducer array with the FPCB matching layer exhibits larger output pressure, wider -3dB bandwidth, and higher ultrasound beam intensity compared to that of an ultrasound transducer array with the alumina/epoxy matching layer, which is one of the most commonly applied composite matching layers. The enhanced transmission performance verifies that the proposed FPCB is an excellent matching layer for 1D linear ultrasound transducer arrays. Full article

In urban areas, pedestrians are the road users category that is the most exposed to road accident fatalities. In this context, the present article proposes a totally new architecture, which aims to increase the safety of pedestrians on the crosswalk. The first component of the design is a pedestrian detection system, which identifies the user’s presence in the region of the crosswalk and determines the future street crossing action possibility or the presence of a pedestrian engaged in street crossing. The second component of the system is the visible light communications part, which is used to transmit this information toward the approaching vehicles. The proposed architecture has been implemented at a regular scale and experimentally evaluated in outdoor conditions. The experimental results showed a 100% overall pedestrian detection rate. On the other hand, the VLC system showed a communication distance between 5 and 40 m when using a standard LED light crosswalk sign as a VLC emitter, while maintaining a bit error ratio between 10⁻⁷ and 10⁻⁵. These results demonstrate the fact that the VLC technology is now able to be used in real applications, making the transition from a high potential technology to a confirmed technology. As far as we know, this is the first article presenting such a pedestrian street crossing assistance system. Full article

Magneto-mechano-electric (MME) composite devices have been used in energy harvesting and magnetic field sensing applications due to their advantages including their high-performance, simple structure, and stable properties. Recently developed MME devices can convert stray magnetic fields into electric signals, thus generating an output power of over 50 mW and detecting ultra-tiny magnetic fields below pT. These inherent outstanding properties of MME devices can enable the development of not only self-powered energy harvesters for internet of thing (IoT) systems but also ultra-sensitive magnetic field sensors for diagnosis of human bio-magnetism or others. This manuscript provides a brief overview of recently reported high-performance MME devices for energy harvesting and magnetic sensing applications. Full article

Gesture recognition based on wearable devices is one of the vital components of human–computer interaction systems. Compared with skeleton-based recognition in computer vision, gesture recognition using wearable sensors has attracted wide attention for its robustness and convenience. Recently, many studies have proposed deep learning methods based on surface electromyography (sEMG) signals for gesture classification; however, most of the existing datasets are built for surface EMG signals, and there is a lack of datasets for multi-category gestures. Due to model limitations and inadequate classification data, the recognition accuracy of these methods cannot satisfy multi-gesture interaction scenarios. In this paper, a multi-category dataset containing 20 gestures is recorded with the help of a wearable device that can acquire surface electromyographic and inertial (IMU) signals. Various two-stream deep learning models are established and improved further. The basic convolutional neural network (CNN), recurrent neural network (RNN), and Transformer models are experimented on with our dataset as the classifier. The CNN and the RNN models’ test accuracy is over 95%; however, the Transformer model has a lower test accuracy of 71.68%. After further improvements, the CNN model is introduced into the residual network and augmented to the CNN-Res model, achieving 98.24% accuracy; moreover, it has the shortest training and testing time. Then, after combining the RNN model and the CNN-Res model, the long short term memory (LSTM)-Res model and gate recurrent unit (GRU)-Res model achieve the highest classification accuracy of 99.67% and 99.49%, respectively. Finally, the fusion of the Transformer model and the CNN model enables the Transformer-CNN model to be constructed. Such improvement dramatically boosts the performance of the Transformer module, increasing the recognition accuracy from 71.86% to 98.96%. Full article

Electromyography (EMG) sensors have been used for measuring muscle signals and for diagnosing neuromuscular disease. Available commercial EMG sensor are expensive and not easily available for individuals. The aim of the study is to validate our designed low-cost sensor against a well-known commercial system for measuring muscle activity and fatigue assessment. The evaluation of the designed system was done through a series of dynamic exercises performed by volunteers. Our low-cost EMG sensor and the commercially available system were placed on the vastus lateralis muscle to concurrently record the signal in a maximum voluntary contraction (MVC). The signal analysis was done using two validation indicators: Spearman’s correlation, and intra-class cross correlation on SPSS 26.0 version. For the muscle fatigue assessment, the root mean square (RMS), mean absolute value (MAV) and mean frequency (MNF) indicators were used. The results at the peak and mean level muscle contraction intensity were computed. The relative agreement for the two systems was excellent at peak level muscle contraction range (ICC 0.74–0.92), average 0.83 and mean level muscle contraction intensity range (ICC 0.65–0.85) with an average of 0.74. The Spearman’s correlation average was 0.76 with the range of (0.71–0.85) at peak level contraction, whiles the mean level contraction average was 0.71 at a range of (0.62–0.81). In determining muscle fatigue, the RMS and MAV showed increasing values in the time domain, while the MEF decreased in the frequency domain. Overall, the results indicated a good to excellent agreement of the two systems and confirmed the reliability of our design. The low-cost sensor also proved to be suitable for muscle fatigue assessment. Our designed system can therefore be implemented for rehabilitation, sports science, and ergonomics. Full article

In computer-assisted surgery, it is typically required to detect when the tool comes into contact with the patient. In activated electrosurgery, this is known as the energy event. By continuously tracking the electrosurgical tools’ location using a navigation system, energy events can help determine locations of sensor-classified tissues. Our objective was to detect the energy event and determine the settings of electrosurgical cautery—robustly and automatically based on sensor data. This study aims to demonstrate the feasibility of using the cautery state to detect surgical incisions, without disrupting the surgical workflow. We detected current changes in the wires of the cautery device and grounding pad using non-invasive current sensors and an oscilloscope. An open-source software was implemented to apply machine learning on sensor data to detect energy events and cautery settings. Our methods classified each cautery state at an average accuracy of 95.56% across different tissue types and energy level parameters altered by surgeons during an operation. Our results demonstrate the feasibility of automatically identifying energy events during surgical incisions, which could be an important safety feature in robotic and computer-integrated surgery. This study provides a key step towards locating tissue classifications during breast cancer operations and reducing the rate of positive margins. Full article

Today, there are many attempts to introduce the Internet of Things (IoT) in high-voltage systems, where partial discharges are a focus of concern since they degrade the insulation. The idea is to detect such discharges at a very early stage so that corrective actions can be taken before major damage is produced. Electronic image sensors are traditionally based on charge-coupled devices (CCDs) and, next, on complementary metal oxide semiconductor (CMOS) devices. This paper performs a review and analysis of state-of-the-art image sensors for detecting, locating, and quantifying partial discharges in insulation systems and, in particular, corona discharges since it is an area with an important potential for expansion due to the important consequences of discharges and the complexity of their detection. The paper also discusses the recent progress, as well as the research needs and the challenges to be faced, in applying image sensors in this area. Although many of the cited research works focused on high-voltage applications, partial discharges can also occur in medium- and low-voltage applications. Thus, the potential applications that could potentially benefit from the introduction of image sensors to detect electrical discharges include power substations, buried power cables, overhead power lines, and automotive applications, among others. Full article

Fitness is important in people’s lives. Good fitness habits can improve cardiopulmonary capacity, increase concentration, prevent obesity, and effectively reduce the risk of death. Home fitness does not require large equipment but uses dumbbells, yoga mats, and horizontal bars to complete fitness exercises and can effectively avoid contact with people, so it is deeply loved by people. People who work out at home use social media to obtain fitness knowledge, but learning ability is limited. Incomplete fitness is likely to lead to injury, and a cheap, timely, and accurate fitness detection system can reduce the risk of fitness injuries and can effectively improve people’s fitness awareness. In the past, many studies have engaged in the detection of fitness movements, among which the detection of fitness movements based on wearable devices, body nodes, and image deep learning has achieved better performance. However, a wearable device cannot detect a variety of fitness movements, may hinder the exercise of the fitness user, and has a high cost. Both body-node-based and image-deep-learning-based methods have lower costs, but each has some drawbacks. Therefore, this paper used a method based on deep transfer learning to establish a fitness database. After that, a deep neural network was trained to detect the type and completeness of fitness movements. We used Yolov4 and Mediapipe to instantly detect fitness movements and stored the 1D fitness signal of movement to build a database. Finally, MLP was used to classify the 1D signal waveform of fitness. In the performance of the classification of fitness movement types, the mAP was 99.71%, accuracy was 98.56%, precision was 97.9%, recall was 98.56%, and the F1-score was 98.23%, which is quite a high performance. In the performance of fitness movement completeness classification, accuracy was 92.84%, precision was 92.85, recall was 92.84%, and the F1-score was 92.83%. The average FPS in detection was 17.5. Experimental results show that our method achieves higher accuracy compared to other methods. Full article

Automatic recognition of human emotions is not a trivial process. There are many factors affecting emotions internally and externally. Expressing emotions could also be performed in many ways such as text, speech, body gestures or even physiologically by physiological body responses. Emotion detection enables many applications such as adaptive user interfaces, interactive games, and human robot interaction and many more. The availability of advanced technologies such as mobiles, sensors, and data analytics tools led to the ability to collect data from various sources, which enabled researchers to predict human emotions accurately. Most current research uses them in the lab experiments for data collection. In this work, we use direct and real time sensor data to construct a subject-independent (generic) multi-modal emotion prediction model. This research integrates both on-body physiological markers, surrounding sensory data, and emotion measurements to achieve the following goals: (1) Collecting a multi-modal data set including environmental, body responses, and emotions. (2) Creating subject-independent Predictive models of emotional states based on fusing environmental and physiological variables. (3) Assessing ensemble learning methods and comparing their performance for creating a generic subject-independent model for emotion recognition with high accuracy and comparing the results with previous similar research. To achieve that, we conducted a real-world study “in the wild” with physiological and mobile sensors. Collecting the data-set is coming from participants walking around Minia university campus to create accurate predictive models. Various ensemble learning models (Bagging, Boosting, and Stacking) have been used, combining the following base algorithms (K Nearest Neighbor KNN, Decision Tree DT, Random Forest RF, and Support Vector Machine SVM) as base learners and DT as a meta-classifier. The results showed that, the ensemble stacking learner technique gave the best accuracy of 98.2% compared with other variants of ensemble learning methods. On the contrary, bagging and boosting methods gave (96.4%) and (96.6%) accuracy levels respectively. Full article

Skin cancer is a deadly disease, and its early diagnosis enhances the chances of survival. Deep learning algorithms for skin cancer detection have become popular in recent years. A novel framework based on deep learning is proposed in this study for the multiclassification of skin cancer types such as Melanoma, Melanocytic Nevi, Basal Cell Carcinoma and Benign Keratosis. The proposed model is named as SCDNet which combines Vgg16 with convolutional neural networks (CNN) for the classification of different types of skin cancer. Moreover, the accuracy of the proposed method is also compared with the four state-of-the-art pre-trained classifiers in the medical domain named Resnet 50, Inception v3, AlexNet and Vgg19. The performance of the proposed SCDNet classifier, as well as the four state-of-the-art classifiers, is evaluated using the ISIC 2019 dataset. The accuracy rate of the proposed SDCNet is 96.91% for the multiclassification of skin cancer whereas, the accuracy rates for Resnet 50, Alexnet, Vgg19 and Inception-v3 are 95.21%, 93.14%, 94.25% and 92.54%, respectively. The results showed that the proposed SCDNet performed better than the competing classifiers. Full article

Recently, the ever-growing interest in the continuous monitoring of heart function in out-of-laboratory settings for an early diagnosis of cardiovascular diseases has led to the investigation of innovative methods for cardiac monitoring. Among others, wearables recording seismic waves induced on the chest surface by the mechanical activity of the heart are becoming popular. For what concerns wearable-based methods, cardiac vibrations can be recorded from the thorax in the form of acceleration, angular velocity, and/or displacement by means of accelerometers, gyroscopes, and fiber optic sensors, respectively. The present paper reviews the currently available wearables for measuring precordial vibrations. The focus is on sensor technology and signal processing techniques for the extraction of the parameters of interest. Lastly, the explored application scenarios and experimental protocols with the relative influencing factors are discussed for each technique. The goal is to delve into these three fundamental aspects (i.e., wearable system, signal processing, and application scenario), which are mutually interrelated, to give a holistic view of the whole process, beyond the sensor aspect alone. The reader can gain a more complete picture of this context without disregarding any of these 3 aspects. Full article

Developing machine learning algorithms for time-series data often requires manual annotation of the data. To do so, graphical user interfaces (GUIs) are an important component. Existing Python packages for annotation and analysis of time-series data have been developed without addressing adaptability, usability, and user experience. Therefore, we developed a generic open-source Python package focusing on adaptability, usability, and user experience. The developed package, Machine Learning and Data Analytics (MaD) GUI, enables developers to rapidly create a GUI for their specific use case. Furthermore, MaD GUI enables domain experts without programming knowledge to annotate time-series data and apply algorithms to it. We conducted a small-scale study with participants from three international universities to test the adaptability of MaD GUI by developers and to test the user interface by clinicians as representatives of domain experts. MaD GUI saves up to 75% of time in contrast to using a state-of-the-art package. In line with this, subjective ratings regarding usability and user experience show that MaD GUI is preferred over a state-of-the-art package by developers and clinicians. MaD GUI reduces the effort of developers in creating GUIs for time-series analysis and offers similar usability and user experience for clinicians as a state-of-the-art package. Full article

In this paper, machine learning models for an effective estimation of soil moisture content using a microwave short-range and wideband radar sensor are proposed. The soil moisture is measured as the volumetric water content using a short-range off-the-shelf radar sensor operating at 3–10 GHz. The radar captures the reflected signals that are post processed to determine the soil moisture which is mapped to the input features extracted from the reflected signals for the training of the machine learning models. In addition, the results are compared and analyzed with a contact-based Vernier soil sensor. Different machine learning models trained using neural network, support vector machine, linear regression and k-nearest neighbor are evaluated and presented in this work. The efficiency of the model is computed using root mean square error, co-efficient of determination and mean absolute error. The RMSE and MAE values of KNN, SVM and Linear Regression are 11.51 and 9.27, 15.20 and 12.74, 3.94 and 3.54, respectively. It is observed that the neural network gives the best results with an R2 value of 0.9894. This research work has been carried out with an intention to develop cost-effective solutions for common users such as agriculturists to monitor the soil moisture conditions with improved accuracy. Full article

Researchers can improve the ecological validity of brain research by studying humans moving in real-world settings. Recent work shows that dual-layer EEG can improve the fidelity of electrocortical recordings during gait, but it is unclear whether these positive results extrapolate to non-locomotor paradigms. For our study, we recorded brain activity with dual-layer EEG while participants played table tennis, a whole-body, responsive sport that could help investigate visuomotor feedback, object interception, and performance monitoring. We characterized artifacts with time-frequency analyses and correlated scalp and reference noise data to determine how well different sensors captured artifacts. As expected, individual scalp channels correlated more with noise-matched channel time series than with head and body acceleration. We then compared artifact removal methods with and without the use of the dual-layer noise electrodes. Independent Component Analysis separated channels into components, and we counted the number of high-quality brain components based on the fit of a dipole model and using an automated labeling algorithm. We found that using noise electrodes for data processing provided cleaner brain components. These results advance technological approaches for recording high fidelity brain dynamics in human behaviors requiring whole body movement, which will be useful for brain science research. Full article

This paper presents a lateral and longitudinal coupling controller for a trajectory-tracking control system. The proposed controller can simultaneously minimize lateral tracking deviation while tracking the desired trajectory and vehicle speed. Firstly, we propose a hierarchical control structure composed of upper and lower-level controllers. In the upper-level controller, the linear quadratic regulator (LQR) controller is designed to compute the desired front wheel steering angle for minimizing the lateral tracking deviation, and the model-predictive controller is developed to compute the desired acceleration for maintaining the planed vehicle speed. The lower-level controller enables the achievement of the desired steering angle and acceleration via the corresponding component devices. Furthermore, an observer based on the Extended Kalman Filter (EKF) is proposed to update the vehicle driving states, which are sensitive to the trajectory-tracking control and difficult to measure directly using the existing vehicle sensors. Finally, the Co-simulation (CarSim-MATLAB/Simulink) results demonstrate that the proposed coupling controller is able to robustly realize the trajectory tracking control and can effectively reduce the lateral tracking error. Full article