The energy consumed in buildings constitutes more than half of the total electricity consumption and is highly correlated with the number of occupants; therefore, it is necessary to use occupancy information in energy consumption analysis. However, the number of occupants may not be accurate owing to measurement errors caused by various factors, such as the locations of sensors or cameras and the communication environment. In this study, occupancy was measured using an object recognition camera, the number of people was additionally collected by manual aggregation, measurement error in occupancy count was analyzed, and the true count was estimated using a deep learning model. The energy consumption based on occupancy was predicted using the measured and estimated values. To this end, deep learning was used to predict energy consumption after analyzing the correlation between occupancy and energy consumption. Results showed that the performance of occupancy estimation was 1.9 based on RMSE, which is a 71.1% improvement compared to the original occupancy sensing. The RMSE of predicted energy consumption based on the estimated occupancy was 56.0, which is a 5.2% improvement compared to the original energy estimation. Full article

In this paper, an original construction of a vehicle vibration damper controlled by means of a valve based on piezoelectric actuator is presented and investigated. The presented valve allows us to control dissipation characteristics of the damper faster than in other solutions adjusting the size of the gap through which the oil flows between the chambers of the damper. The article also presents the results of the experimental investigation of the above-mentioned damper showing the possibility of changing the value of the damping force five times in about 10 ms by changing the voltage supplying the piezoelectric actuator. Based on these results, dissipative characteristics were determined which enabled the identification of the parameters of the damper numerical model. The article also presents the results of numerical investigations a vehicle model equipped with the developed dampers. The results showed that the developed damper controlled by the use of the piezoelectric actuator can significantly affect vehicle traffic safety by reducing the variation of vertical forces acting on the wheels. The results obtained are so promising that the authors undertook preparations to conduct road tests of a vehicle equipped with the developed dampers. Full article

Although face recognition technology is currently integrated into industrial applications, it has open challenges, such as verification and identification from arbitrary poses. Specifically, there is a lack of research about face recognition in surveillance videos using, as reference images, mugshots taken from multiple Points of View (POVs) in addition to the frontal picture and the right profile traditionally collected by national police forces. To start filling this gap and tackling the scarcity of databases devoted to the study of this problem, we present the Face Recognition from Mugshots Database (FRMDB). It includes 28 mugshots and 5 surveillance videos taken from different angles for 39 distinct subjects. The FRMDB is intended to analyze the impact of using mugshots taken from multiple points of view on face recognition on the frames of the surveillance videos. To validate the FRMDB and provide a first benchmark on it, we ran accuracy tests using two CNNs, namely VGG16 and ResNet50, pre-trained on the VGGFace and VGGFace2 datasets for the extraction of face image features. We compared the results to those obtained from a dataset from the related literature, the Surveillance Cameras Face Database (SCFace). In addition to showing the features of the proposed database, the results highlight that the subset of mugshots composed of the frontal picture and the right profile scores the lowest accuracy result among those tested. Therefore, additional research is suggested to understand the ideal number of mugshots for face recognition on frames from surveillance videos. Full article

With the rise of latency-sensitive and computationally intensive applications in mobile edge computing (MEC) environments, the computation offloading strategy has been widely studied to meet the low-latency demands of these applications. However, the uncertainty of various tasks and the time-varying conditions of wireless networks make it difficult for mobile devices to make efficient decisions. The existing methods also face the problems of long-delay decisions and user data privacy disclosures. In this paper, we present the FDRT, a federated learning and deep reinforcement learning-based method with two types of agents for computation offload, to minimize the system latency. FDRT uses a multi-agent collaborative computation offloading strategy, namely, DRT. DRT divides the offloading decision into whether to compute tasks locally and whether to offload tasks to MEC servers. The designed DDQN agent considers the task information, its own resources, and the network status conditions of mobile devices, and the designed D3QN agent considers these conditions of all MEC servers in the collaborative cloud-side end MEC system; both jointly learn the optimal decision. FDRT also applies federated learning to reduce communication overhead and optimize the model training of DRT by designing a new parameter aggregation method, while protecting user data privacy. The simulation results showed that DRT effectively reduced the average task execution delay by up to 50% compared with several baselines and state-of-the-art offloading strategies. FRDT also accelerates the convergence rate of multi-agent training and reduces the training time of DRT by 61.7%. Full article

Evaluation of team performance in naturalistic contexts has gained popularity during the last two decades. Among other human factors, physiological synchrony has been adopted to investigate team performance and emotional state when engaged in collaborative team tasks. A variety of methods have been reported to quantify physiological synchrony with a varying degree of correlation with the collaborative team task performance and emotional state, reflected in the inconclusive nature of findings. Little is known about the effect of the choice of synchrony calculation methods and the level of analysis on these findings. In this research work, we investigate the relationship between outcomes of different methods to quantify physiological synchrony, emotional state, and team performance of three-member teams performing a collaborative team task. The proposed research work employs dyadic-level linear (cross-correlation) and team-level non-linear (multidimensional recurrence quantification analysis) synchrony calculation measures to quantify task performance and the emotional state of the team. Our investigation indicates that the physiological synchrony estimated using multidimensional recurrence quantification analysis revealed a significant negative relationship between the subjectively reported frustration levels and overall task performance. However, no relationship was found between cross-correlation-based physiological synchrony and task performance. The proposed research highlights that the method of choice for physiological synchrony calculation has direct impact on the derived relationship of team task performance and emotional states. Full article

Blockchain introduces challenges related to the reliability of user identity and identity management systems; this includes detecting unfalsified identities linked to IoT applications. This study focuses on optimizing user identity verification time by employing an efficient encryption algorithm for the user signature in a peer-to-peer decentralized IoT blockchain network. To achieve this, a user signature-based identity management framework is examined by using various encryption techniques and contrasting various hash functions built on top of the Modified Merkle Hash Tree (MMHT) data structure algorithm. The paper presents the execution of varying dataset sizes based on transactions between nodes to test the scalability of the proposed design for secure blockchain communication. The results show that the MMHT data structure algorithm using SHA3 and AES-128 encryption algorithm gives the lowest execution time, offering a minimum of 36% gain in time optimization compared to other algorithms. This work shows that using the AES-128 encryption algorithm with the MMHT algorithm and SHA3 hash function not only identifies malicious codes but also improves user integrity check performance in a blockchain network, while ensuring network scalability. Therefore, this study presents the performance evaluation of a blockchain network considering its distinct types, properties, components, and algorithms’ taxonomy. Full article

Multimodal fusion approaches that combine data from dissimilar sensors can better exploit human-like reasoning and strategies for situational awareness. The performance of a six-layer convolutional neural network (CNN) and an 18-layer ResNet architecture are compared for a variety of fusion methods using synthetic aperture radar (SAR) and electro-optical (EO) imagery to classify military targets. The dataset used is the Synthetic and Measured Paired Labeled Experiment (SAMPLE) dataset, using both original measured SAR data and synthetic EO data. We compare the classification performance of both networks using the data modalities individually, feature level fusion, decision level fusion, and using a novel fusion method based on the three RGB-input channels of a residual neural network (ResNet). In the proposed input channel fusion method, the SAR and the EO imagery are separately fed to each of the three input channels, while the third channel is fed a zero vector. It is found that the input channel fusion method using ResNet was able to consistently perform to a higher classification accuracy in every equivalent scenario. Full article

Convolutional neural network (CNN) is widely deployed on edge devices, performing tasks such as objective detection, image recognition and acoustic recognition. However, the limited resources and strict power constraints of edge devices pose a great challenge to applying the computationally intensive CNN models. In addition, for the edge applications with real-time requirements, such as real-time computing (RTC) systems, the computations need to be completed considering the required timing constraint, so it is more difficult to trade off between computational latency and power consumption. In this paper, we propose a low-power CNN accelerator for edge inference of RTC systems, where the computations are operated in a column-wise manner, to realize an immediate computation for the currently available input data. We observe that most computations of some CNN kernels in deep layers can be completed in multiple cycles, while not affecting the overall computational latency. Thus, we present a multi-cycle scheme to conduct the column-wise convolutional operations to reduce the hardware resource and power consumption. We present hardware architecture for the multi-cycle scheme as a domain-specific CNN architecture, which is then implemented in a 65 nm technology. We prove our proposed approach realizes up to 8.45%, 49.41% and 50.64% power reductions for LeNet, AlexNet and VGG16, respectively. The experimental results show that our approach tends to cause a larger power reduction for the CNN models with greater depth, larger kernels and more channels. Full article

This work presents a modular approach to the development of strain sensors for large deformations. The proposed method separates the extension and signal transduction mechanisms using a soft, elastomeric transmission and a high-sensitivity microelectromechanical system (MEMS) transducer. By separating the transmission and transduction, they can be optimized independently for application-specific mechanical and electrical performance. This work investigates the potential of this approach for human health monitoring as an implantable cardiac strain sensor for measuring global longitudinal strain (GLS). The durability of the sensor was evaluated by conducting cyclic loading tests over one million cycles, and the results showed negligible drift. To account for hysteresis and frequency-dependent effects, a lumped-parameter model was developed to represent the viscoelastic behavior of the sensor. Multiple model orders were considered and compared using validation and test data sets that mimic physiologically relevant dynamics. Results support the choice of a second-order model, which reduces error by 73% compared to a linear calibration. In addition, we evaluated the suitability of this sensor for the proposed application by demonstrating its ability to operate on compliant, curved surfaces. The effects of friction and boundary conditions are also empirically assessed and discussed. Full article

The power demand from gas turbines in electrical grids is becoming more dynamic due to the rising demand for power generation from renewable energy sources. Therefore, including the transient data in the fault diagnostic process is important when the steady-state data are limited and if some component faults are more observable in the transient condition than in the steady-state condition. This study analyses the transient behaviour of a three-shaft industrial gas turbine engine in clean and degraded conditions with consideration of the secondary air system and variable inlet guide vane effects. Different gas path faults are simulated to demonstrate how magnified the transient measurement deviations are compared with the steady-state measurement deviations. The results show that some of the key measurement deviations are considerably higher in the transient mode than in the steady state. This confirms the importance of considering transient measurements for early fault detection and more accurate diagnostic solutions. Full article

One of the most effective vital signs of health conditions is blood pressure. It has such an impact that changes your state from completely relaxed to extremely unpleasant, which makes the task of blood pressure monitoring a main procedure that almost everyone undergoes whenever there is something wrong or suspicious with his/her health condition. The most popular and accurate ways to measure blood pressure are cuff-based, inconvenient, and pricey, but on the bright side, many experimental studies prove that changes in the color intensities of the RGB channels represent variation in the blood that flows beneath the skin, which is strongly related to blood pressure; hence, we present a novel approach to blood pressure estimation based on the analysis of human face video using hybrid deep learning models. We deeply analyzed proposed approaches and methods to develop combinations of state-of-the-art models that were validated by their testing results on the Vision for Vitals (V4V) dataset compared to the performance of other available proposed models. Additionally, we came up with a new metric to evaluate the performance of our models using Pearson’s correlation coefficient between the predicted blood pressure of the subjects and their respiratory rate at each minute, which is provided by our own dataset that includes 60 videos of operators working on personal computers for almost 20 min in each video. Our method provides a cuff-less, fast, and comfortable way to estimate blood pressure with no need for any equipment except the camera of your smartphone. Full article

Internet of Drones (IoD), designed to coordinate the access of unmanned aerial vehicles (UAVs), is a specific application of the Internet of Things (IoT). Drones are used to control airspace and offer services such as rescue, traffic surveillance, environmental monitoring, delivery and so on. However, IoD continues to suffer from privacy and security issues. Firstly, messages are transmitted over public channels in IoD environments, which compromises data security. Further, sensitive data can also be extracted from stolen mobile devices of remote users. Moreover, drones are susceptible to physical capture and manipulation by adversaries, which are called drone capture attacks. Thus, the development of a secure and lightweight authentication scheme is essential to overcoming these security vulnerabilities, even on resource-constrained drones. In 2021, Akram et al. proposed a secure and lightweight user–drone authentication scheme for drone networks. However, we discovered that Akram et al.’s scheme is susceptible to user and drone impersonation, verification table leakage, and denial of service (DoS) attacks. Furthermore, their scheme cannot provide perfect forward secrecy. To overcome the aforementioned security vulnerabilities, we propose a secure mutual authentication and key agreement scheme between user and drone pairs. The proposed scheme utilizes physical unclonable function (PUF) to give drones uniqueness and resistance against drone stolen attacks. Moreover, the proposed scheme uses a fuzzy extractor to utilize the biometrics of users as secret parameters. We analyze the security of the proposed scheme using informal security analysis, Burrows–Abadi–Needham (BAN) logic, a Real-or-Random (RoR) model, and Automated Verification of Internet Security Protocols and Applications (AVISPA) simulation. We also compared the security features and performance of the proposed scheme and the existing related schemes. Therefore, we demonstrate that the proposed scheme is suitable for IoD environments that can provide users with secure and convenient wireless communications. Full article

Two common difficulties which people face in their daily lives are managing effective communication with others and dealing with what makes them feel uncertain. Past research highlights that the result of not being able to handle these difficulties influences people’s performance in the task at hand substantially, especially in the context of a social environment such as a workplace. Perceived uncertainty of information is a key influential factor in this regard, with effects on the quality of the information transfer between sender and receiver. Uncertainty of information can be induced into the communication system in three ways: when there is any kind of information deficit that makes the target message unclear for the receiver, when there are some requested changes that could not be predicted by the receiver, and when the content of the message is so interconnected and complex that it limits understanding. Since uncertainty is an inseparable feature of our lives, studying the effects that different levels of it have on individuals and how individuals nevertheless accomplish the tasks of daily living is of high importance. Modern technologies such as immersive virtual reality (VR) have been successful in providing effective platforms to support human behavioral and social well-being studies. In this paper, we suggest the design, development, and evaluation of an immersive VR serious game platform to study behavioral responses to the uncertain features of interpersonal communications. In addition, we report the result of a within-subject user study with 17 participants aged between 20 and 35 and their behavioral responses to two levels of uncertainty with subjective and objective measures. The results convey that the application successfully and meaningfully measured some behavioral responses related to exposure to different levels of uncertainty and overall, the participants were satisfied with the experience. Full article

The rehabilitation evaluation of Parkinson’s disease has always been the research focus of human assistive systems. It is a research hotspot to objectively and accurately evaluate the gait condition of Parkinson’s disease patients, thereby adjusting the actuators of the human–machine system and making rehabilitation robots better adapt to the recovery process of patients. The rehabilitation evaluation of Parkinson’s disease has always been the research focus of rehabilitation robots. It is a research hotspot to be able to objectively and accurately evaluate the recovery of Parkinson’s disease patients, thereby adjusting the driving module of the human–machine collaboration system in real time, so that rehabilitation robots can better adapt to the recovery process of Parkinson’s disease. The gait task in the Unified Parkinson’s Disease Rating Scale (UPDRS) is a widely accepted standard for assessing the gait impairments of patients with Parkinson’s disease (PD). However, the assessments conducted by neurologists are always subjective and inaccurate, and the results are determined by the neurologists’ observation and clinical experience. Thus, in this study, we proposed a novel machine learning-based method of automatically assessing the gait task in UPDRS with wearable sensors as a more convenient and objective alternative means for PD gait assessment. In the design, twelve gait features, including three spatial–temporal features and nine kinematic features, were extracted and calculated from two shank-mounted IMUs. A novel nonlinear model is developed for calculating the score of gait task from the gait features. Twenty-five PD patients and twenty-eight healthy subjects were recruited for validating the proposed method. For comparison purpose, three traditional models, which have been used in previous studies, were also tested by the same dataset. In terms of percentages of participants, 84.9%, 73.6%, 73.6%, and 66.0% of the participants were accurately assigned into the true level with the proposed nonlinear model, the support vector machine model, the naive Bayes model, and the linear regression model, respectively, which indicates that the proposed method has a good performance on calculating the score of the UPDRS gait task and conformance with the rating done by neurologists. Full article

The motion planning module is the core module of the automated vehicle software system, which plays a key role in connecting its preceding element, i.e., the sensing module, and its following element, i.e., the control module. The design of an adaptive polar lattice-based local obstacle avoidance (APOLLO) algorithm proposed in this paper takes full account of the characteristics of the vehicle’s sensing and control systems. The core of our approach mainly consists of three phases, i.e., the adaptive polar lattice-based local search space design, the collision-free path generation and the path smoothing. By adjusting a few parameters, the algorithm can be adapted to different driving environments and different kinds of vehicle chassis. Simulations show that the proposed method owns strong environmental adaptability and low computation complexity. Full article