13 pages, 1492 KiB  
Article
Automated Loss-of-Balance Event Identification in Older Adults at Risk of Falls during Real-World Walking Using Wearable Inertial Measurement Units
by Jeremiah Hauth, Safa Jabri, Fahad Kamran, Eyoel W. Feleke, Kaleab Nigusie, Lauro V. Ojeda, Shirley Handelzalts, Linda Nyquist, Neil B. Alexander, Xun Huan, Jenna Wiens and Kathleen H. Sienko
Sensors 2021, 21(14), 4661; https://doi.org/10.3390/s21144661 - 7 Jul 2021
Cited by 14 | Viewed by 5000
Abstract
Loss-of-balance (LOB) events, such as trips and slips, are frequent among community-dwelling older adults and are an indicator of increased fall risk. In a preliminary study, eight community-dwelling older adults with a history of falls were asked to perform everyday tasks in the [...] Read more.
Loss-of-balance (LOB) events, such as trips and slips, are frequent among community-dwelling older adults and are an indicator of increased fall risk. In a preliminary study, eight community-dwelling older adults with a history of falls were asked to perform everyday tasks in the real world while donning a set of three inertial measurement sensors (IMUs) and report LOB events via a voice-recording device. Over 290 h of real-world kinematic data were collected and used to build and evaluate classification models to detect the occurrence of LOB events. Spatiotemporal gait metrics were calculated, and time stamps for when LOB events occurred were identified. Using these data and machine learning approaches, we built classifiers to detect LOB events. Through a leave-one-participant-out validation scheme, performance was assessed in terms of the area under the receiver operating characteristic curve (AUROC) and the area under the precision recall curve (AUPR). The best model achieved an AUROC ≥0.87 for every held-out participant and an AUPR 4-20 times the incidence rate of LOB events. Such models could be used to filter large datasets prior to manual classification by a trained healthcare provider. In this context, the models filtered out at least 65.7% of the data, while detecting ≥87.0% of events on average. Based on the demonstrated discriminative ability to separate LOBs and normal walking segments, such models could be applied retrospectively to track the occurrence of LOBs over an extended period of time. Full article
(This article belongs to the Special Issue Wearable Sensors for Gait and Falls Monitoring)
Show Figures

Figure 1

25 pages, 6079 KiB  
Article
A New Method for Gaining the Control of Standalone Underwater Sensor Nodes Based on Power Supply Sensing
by Daniel Rodríguez García, Juan A. Montiel-Nelson, Tomás Bautista and Javier Sosa
Sensors 2021, 21(14), 4660; https://doi.org/10.3390/s21144660 - 7 Jul 2021
Cited by 3 | Viewed by 2727
Abstract
In this paper, a new method for gaining the control of standalone underwater sensor nodes based on sensing the power supply evolution is presented. Underwater sensor networks are designed to support multiple extreme scenarios such as network disconnections. In those cases, the sensor [...] Read more.
In this paper, a new method for gaining the control of standalone underwater sensor nodes based on sensing the power supply evolution is presented. Underwater sensor networks are designed to support multiple extreme scenarios such as network disconnections. In those cases, the sensor nodes involved should go into standalone, and its wired and wireless communications should be disabled. This paper presents how to exit from the standalone status and enter into debugging mode following a practical ultra-low power design methodology. In addition, the discharge and regeneration effects are analyzed and modeled to minimize the error using the sensor node self measurements. Once the method is presented, its implementation details are discussed including other solutions like wake up wireless modules or a pin interruption solution. Its advantages and disadvantages are discussed. The method proposed is evaluated with several simulations and laboratory experiments using a real aquaculture sensor node. Finally, all the results obtained demonstrate the usefulness of our new method to gain the control of a standalone sensor node. The proposal is better than other approaches when the hibernation time is longer than 167.45 μs. Finally, our approach requires two orders of magnitude less energy than the best practical solution. Full article
(This article belongs to the Collection Underwater Sensor Networks and Internet of Underwater Things)
Show Figures

Figure 1

31 pages, 22124 KiB  
Article
Multi-Camera Vessel-Speed Enforcement by Enhancing Detection and Re-Identification Techniques
by Matthijs H. Zwemer, Herman G. J. Groot, Rob Wijnhoven, Egor Bondarev and Peter H. N. de With
Sensors 2021, 21(14), 4659; https://doi.org/10.3390/s21144659 - 7 Jul 2021
Cited by 6 | Viewed by 4293
Abstract
This paper presents a camera-based vessel-speed enforcement system based on two cameras. The proposed system detects and tracks vessels per camera view and employs a re-identification (re-ID) function for linking vessels between the two cameras based on multiple bounding-box images per vessel. Newly [...] Read more.
This paper presents a camera-based vessel-speed enforcement system based on two cameras. The proposed system detects and tracks vessels per camera view and employs a re-identification (re-ID) function for linking vessels between the two cameras based on multiple bounding-box images per vessel. Newly detected vessels in one camera (query) are compared to the gallery set of all vessels detected by the other camera. To train and evaluate the proposed detection and re-ID system, a new Vessel-reID dataset is introduced. This extensive dataset has captured a total of 2474 different vessels covered in multiple images, resulting in a total of 136,888 vessel bounding-box images. Multiple CNN detector architectures are evaluated in-depth. The SSD512 detector performs best with respect to its speed (85.0% Recall@95Precision at 20.1 frames per second). For the re-ID of vessels, a large portion of the total trajectory can be covered by the successful detections of the SSD model. The re-ID experiments start with a baseline single-image evaluation obtaining a score of 55.9% Rank-1 (49.7% mAP) for the existing TriNet network, while the available MGN model obtains 68.9% Rank-1 (62.6% mAP). The performance significantly increases with 5.6% Rank-1 (5.7% mAP) for MGN by applying matching with multiple images from a single vessel. When emphasizing more fine details by selecting only the largest bounding-box images, another 2.0% Rank-1 (1.4% mAP) is added. Application-specific optimizations such as travel-time selection and applying a cross-camera matching constraint further enhance the results, leading to a final 88.9% Rank-1 and 83.5% mAP performance. Full article
(This article belongs to the Collection Computer Vision Based Smart Sensing)
Show Figures

Figure 1

10 pages, 7434 KiB  
Communication
A Long-Lasting Textile-Based Anatomically Realistic Head Phantom for Validation of EEG Electrodes
by Granch Berhe Tseghai, Benny Malengier, Kinde Anlay Fante and Lieva Van Langenhove
Sensors 2021, 21(14), 4658; https://doi.org/10.3390/s21144658 - 7 Jul 2021
Cited by 8 | Viewed by 4619
Abstract
During the development of new electroencephalography electrodes, it is important to surpass the validation process. However, maintaining the human mind in a constant state is impossible which in turn makes the validation process very difficult. Besides, it is also extremely difficult to identify [...] Read more.
During the development of new electroencephalography electrodes, it is important to surpass the validation process. However, maintaining the human mind in a constant state is impossible which in turn makes the validation process very difficult. Besides, it is also extremely difficult to identify noise and signals as the input signals are not known. For that reason, many researchers have developed head phantoms predominantly from ballistic gelatin. Gelatin-based material can be used in phantom applications, but unfortunately, this type of phantom has a short lifespan and is relatively heavyweight. Therefore, this article explores a long-lasting and lightweight (−91.17%) textile-based anatomically realistic head phantom that provides comparable functional performance to a gelatin-based head phantom. The result proved that the textile-based head phantom can accurately mimic body-electrode frequency responses which make it suitable for the controlled validation of new electrodes. The signal-to-noise ratio (SNR) of the textile-based head phantom was found to be significantly better than the ballistic gelatin-based head providing a 15.95 dB ± 1.666 (±10.45%) SNR at a 95% confidence interval. Full article
(This article belongs to the Special Issue EEG Signal Processing for Biomedical Applications)
Show Figures

Figure 1

17 pages, 31428 KiB  
Article
Fast and Accurate Lane Detection via Graph Structure and Disentangled Representation Learning
by Yulin He, Wei Chen, Chen Li, Xin Luo and Libo Huang
Sensors 2021, 21(14), 4657; https://doi.org/10.3390/s21144657 - 7 Jul 2021
Cited by 5 | Viewed by 4044
Abstract
It is desirable to maintain high accuracy and runtime efficiency at the same time in lane detection. However, due to the long and thin properties of lanes, extracting features with both strong discrimination and perception abilities needs a huge amount of calculation, which [...] Read more.
It is desirable to maintain high accuracy and runtime efficiency at the same time in lane detection. However, due to the long and thin properties of lanes, extracting features with both strong discrimination and perception abilities needs a huge amount of calculation, which seriously slows down the running speed. Therefore, we design a more efficient way to extract the features of lanes, including two phases: (1) Local feature extraction, which sets a series of predefined anchor lines, and extracts the local features through their locations. (2) Global feature aggregation, which treats local features as the nodes of the graph, and builds a fully connected graph by adaptively learning the distance between nodes, the global feature can be aggregated through weighted summing finally. Another problem that limits the performance is the information loss in feature compression, mainly due to the huge dimensional gap, e.g., from 512 to 8. To handle this issue, we propose a feature compression module based on decoupling representation learning. This module can effectively learn the statistical information and spatial relationships between features. After that, redundancy is greatly reduced and more critical information is retained. Extensional experimental results show that our proposed method is both fast and accurate. On the Tusimple and CULane benchmarks, with a running speed of 248 FPS, F1 values of 96.81% and 75.49% were achieved, respectively. Full article
(This article belongs to the Special Issue Sensing and Semantic Perception in Autonomous Driving)
Show Figures

Figure 1

29 pages, 12108 KiB  
Article
Automation Pyramid as Constructor for a Complete Digital Twin, Case Study: A Didactic Manufacturing System
by Edwin Mauricio Martinez, Pedro Ponce, Israel Macias and Arturo Molina
Sensors 2021, 21(14), 4656; https://doi.org/10.3390/s21144656 - 7 Jul 2021
Cited by 40 | Viewed by 13479
Abstract
Nowadays, the concept of Industry 4.0 aims to improve factories’ competitiveness. Usually, manufacturing production is guided by standards to segment and distribute its processes and implementations. However, industry 4.0 requires innovative proposals for disruptive technologies that engage the entire production process in factories, [...] Read more.
Nowadays, the concept of Industry 4.0 aims to improve factories’ competitiveness. Usually, manufacturing production is guided by standards to segment and distribute its processes and implementations. However, industry 4.0 requires innovative proposals for disruptive technologies that engage the entire production process in factories, not just a partial improvement. One of these disruptive technologies is the Digital Twin (DT). This advanced virtual model runs in real-time and can predict, detect, and classify normal and abnormal operating conditions in factory processes. The Automation Pyramid (AP) is a conceptual element that enables the efficient distribution and connection of different actuators in enterprises, from the shop floor to the decision-making levels. When a DT is deployed into a manufacturing system, generally, the DT focuses on the low-level that is named field level, which includes the physical devices such as controllers, sensors, and so on. Thus, the partial automation based on the DT is accomplished, and the information between all manufacturing stages could be decremented. Hence, to achieve a complete improvement of the manufacturing system, all the automation pyramid levels must be included in the DT concept. An artificial intelligent management system could create an interconnection between them that can manage the information. As a result, this paper proposed a complete DT structure covering all automation pyramid stages using Artificial Intelligence (AI) to model each stage of the AP based on the Digital Twin concept. This work proposes a virtual model for each level of the traditional AP and the interactions among them to flow and control information efficiently. Therefore, the proposed model is a valuable tool in improving all levels of an industrial process. In addition, It is presented a case study where the DT concept for modular workstations underpins the development of technologies within the framework of the Automation Pyramid model is implemented into a didactic manufacturing system. Full article
(This article belongs to the Topic New Frontiers in Industry 4.0)
Show Figures

Figure 1

17 pages, 4042 KiB  
Article
Machine Learning for Sensorless Temperature Estimation of a BLDC Motor
by Dariusz Czerwinski, Jakub Gęca and Krzysztof Kolano
Sensors 2021, 21(14), 4655; https://doi.org/10.3390/s21144655 - 7 Jul 2021
Cited by 32 | Viewed by 6791
Abstract
In this article, the authors propose two models for BLDC motor winding temperature estimation using machine learning methods. For the purposes of the research, measurements were made for over 160 h of motor operation, and then, they were preprocessed. The algorithms of linear [...] Read more.
In this article, the authors propose two models for BLDC motor winding temperature estimation using machine learning methods. For the purposes of the research, measurements were made for over 160 h of motor operation, and then, they were preprocessed. The algorithms of linear regression, ElasticNet, stochastic gradient descent regressor, support vector machines, decision trees, and AdaBoost were used for predictive modeling. The ability of the models to generalize was achieved by hyperparameter tuning with the use of cross-validation. The conducted research led to promising results of the winding temperature estimation accuracy. In the case of sensorless temperature prediction (model 1), the mean absolute percentage error MAPE was below 4.5% and the coefficient of determination R2 was above 0.909. In addition, the extension of the model with the temperature measurement on the casing (model 2) allowed reducing the error value to about 1% and increasing R2 to 0.990. The results obtained for the first proposed model show that the overheating protection of the motor can be ensured without direct temperature measurement. In addition, the introduction of a simple casing temperature measurement system allows for an estimation with accuracy suitable for compensating the motor output torque changes related to temperature. Full article
(This article belongs to the Special Issue Machine Learning in Sensors and Imaging)
Show Figures

Figure 1

20 pages, 25659 KiB  
Article
Histogram Adjustment of Images for Improving Photogrammetric Reconstruction
by Piotr Łabędź, Krzysztof Skabek, Paweł Ozimek and Mateusz Nytko
Sensors 2021, 21(14), 4654; https://doi.org/10.3390/s21144654 - 7 Jul 2021
Cited by 11 | Viewed by 4456
Abstract
The accuracy of photogrammetric reconstruction depends largely on the acquisition conditions and on the quality of input photographs. This paper proposes methods of improving raster images that increase photogrammetric reconstruction accuracy. These methods are based on modifying color image histograms. Special emphasis was [...] Read more.
The accuracy of photogrammetric reconstruction depends largely on the acquisition conditions and on the quality of input photographs. This paper proposes methods of improving raster images that increase photogrammetric reconstruction accuracy. These methods are based on modifying color image histograms. Special emphasis was placed on the selection of channels of the RGB and CIE L*a*b* color models for further improvement of the reconstruction process. A methodology was proposed for assessing the quality of reconstruction based on premade reference models using positional statistics. The analysis of the influence of image enhancement on reconstruction was carried out for various types of objects. The proposed methods can significantly improve the quality of reconstruction. The superiority of methods based on the luminance channel of the L*a*b* model was demonstrated. Our studies indicated high efficiency of the histogram equalization method (HE), although these results were not highly distinctive for all performed tests. Full article
Show Figures

Figure 1

22 pages, 5039 KiB  
Article
Dual-Arm Coordinated Control Strategy Based on Modified Sliding Mode Impedance Controller
by Xuefei Liu, Xiangrong Xu, Zuojun Zhu and Yanglin Jiang
Sensors 2021, 21(14), 4653; https://doi.org/10.3390/s21144653 - 7 Jul 2021
Cited by 20 | Viewed by 4413
Abstract
To meet the high-accuracy position/force control requirements of dual-arm robots for handling a target object, a control algorithm for dual-arm robots based on the modified sliding mode impedance controller MSMIC(tanh) is proposed. First, the combinative kinematics equation of the dual-arm robots and the [...] Read more.
To meet the high-accuracy position/force control requirements of dual-arm robots for handling a target object, a control algorithm for dual-arm robots based on the modified sliding mode impedance controller MSMIC(tanh) is proposed. First, the combinative kinematics equation of the dual-arm robots and the unified dynamics model combining the manipulated object is established. Second, according to the impedance control motion model for the object, the desired joint angular accelerations of the manipulators are obtained, and the sliding mode controller based on the hyperbolic tangent function as the switch function is introduced to design the coordinated control strategy for dual-arm robots. The stability and convergence of the designed controller are proved according to the Lyapunov function theory. Finally, the operation tasks of the coordinated transport the target object for dual-arm robots are carried out in the simulated experiment environment. Simulation results show that the proposed control scheme can stably output the required internal force and achieve a high-precision trajectory tracking effect while reducing the periodic torque and joint chattering amplitude generated in the conventional sliding mode control algorithm. Full article
(This article belongs to the Section Intelligent Sensors)
Show Figures

Figure 1

22 pages, 4265 KiB  
Article
Intelligent Platform Based on Smart PPE for Safety in Workplaces
by Sergio Márquez-Sánchez, Israel Campero-Jurado, Jorge Herrera-Santos, Sara Rodríguez and Juan M. Corchado
Sensors 2021, 21(14), 4652; https://doi.org/10.3390/s21144652 - 7 Jul 2021
Cited by 35 | Viewed by 10828
Abstract
It is estimated that we spend one-third of our lives at work. It is therefore vital to adapt traditional equipment and systems used in the working environment to the new technological paradigm so that the industry is connected and, at the same time, [...] Read more.
It is estimated that we spend one-third of our lives at work. It is therefore vital to adapt traditional equipment and systems used in the working environment to the new technological paradigm so that the industry is connected and, at the same time, workers are as safe and protected as possible. Thanks to Smart Personal Protective Equipment (PPE) and wearable technologies, information about the workers and their environment can be extracted to reduce the rate of accidents and occupational illness, leading to a significant improvement. This article proposes an architecture that employs three pieces of PPE: a helmet, a bracelet and a belt, which process the collected information using artificial intelligence (AI) techniques through edge computing. The proposed system guarantees the workers’ safety and integrity through the early prediction and notification of anomalies detected in their environment. Models such as convolutional neural networks, long short-term memory, Gaussian Models were joined by interpreting the information with a graph, where different heuristics were used to weight the outputs as a whole, where finally a support vector machine weighted the votes of the models with an area under the curve of 0.81. Full article
(This article belongs to the Special Issue Edge Computing Architectures in Industry 4.0)
Show Figures

Figure 1

21 pages, 6653 KiB  
Article
Spectral Relative Attenuation of Solar Radiation through a Skylight Focused on Preventive Conservation: Museo De L’almoina in Valencia (Spain) Case Study
by María-Antonia Serrano, José-Luis Baró Zarzo, Juan-Carlos Moreno Esteve and Fernando-Juan García-Diego
Sensors 2021, 21(14), 4651; https://doi.org/10.3390/s21144651 - 7 Jul 2021
Cited by 2 | Viewed by 2812
Abstract
The aim of the present study was to evaluate the relative attenuation of VIS, UV and NIR solar radiation through a large pond skylight into the interior of the l’Almoina Archaeological Museum (Valencia, Spain), and to determine how relative attenuation varied throughout the [...] Read more.
The aim of the present study was to evaluate the relative attenuation of VIS, UV and NIR solar radiation through a large pond skylight into the interior of the l’Almoina Archaeological Museum (Valencia, Spain), and to determine how relative attenuation varied throughout the year and time of day. Measurements were taken at 9:00 a.m., 12:00 p.m. and 3:00 p.m. during July 2019 and January 2020. Relative attenuation values were obtained from the measurement of spectral irradiance in the exterior and at different points in the interior by means of two Ocean Optics spectrometers: HR4000CG-UV-NIR for VIS (400–700 nm) and NIR (700–1000 nm) bands, and FLAME-S-UV-VIS for UV-A (280–315 nm) and UV-A (315–400 nm) bands. The central points of the skylight had relative attenuation at 520 nm, reaching a value of 50% in summer at noon and 38% in the afternoon. At noon in winter, there were two relative attenuation peaks above 33% at 520 nm and at 900 nm. For mean relative attenuation, in the UVB range, the highest relative attenuation (20%) was inside the ruins in the morning in both summer and winter, and the UVA band relative attenuation was quite constant throughout the museum, but lower than that of the UVB band, in the range 0–3%. Full article
(This article belongs to the Special Issue Sensors and Data Processing Techniques for Cultural Heritage)
Show Figures

Figure 1

19 pages, 15008 KiB  
Article
Ultra-Wideband Indoor Positioning and IMU-Based Activity Recognition for Ice Hockey Analytics
by Robbe Vleugels, Ben Van Herbruggen, Jaron Fontaine and Eli De Poorter
Sensors 2021, 21(14), 4650; https://doi.org/10.3390/s21144650 - 7 Jul 2021
Cited by 37 | Viewed by 7817
Abstract
Currently, gathering statistics and information for ice hockey training purposes mostly happens by hand, whereas the automated systems that do exist are expensive and difficult to set up. To remedy this, in this paper, we propose and analyse a wearable system that combines [...] Read more.
Currently, gathering statistics and information for ice hockey training purposes mostly happens by hand, whereas the automated systems that do exist are expensive and difficult to set up. To remedy this, in this paper, we propose and analyse a wearable system that combines player localisation and activity classification to automatically gather information. A stick-worn inertial measurement unit was used to capture acceleration and rotation data from six ice hockey activities. A convolutional neural network was able to distinguish the six activities from an unseen player with a 76% accuracy at a sample frequency of 100 Hz. Using unseen data from players used to train the model, a 99% accuracy was reached. With a peak detection algorithm, activities could be automatically detected and extracted from a complete measurement for classification. Additionally, the feasibility of a time difference of arrival based ultra-wideband system operating at a 25 Hz update rate was determined. We concluded that the system, when the data were filtered and smoothed, provided acceptable accuracy for use in ice hockey. Combining both, it was possible to gather useful information about a wide range of interesting performance measures. This shows that our proposed system is a suitable solution for the analysis of ice hockey. Full article
Show Figures

Figure 1

19 pages, 6319 KiB  
Article
Development of a Low-Power Underwater NFC-Enabled Sensor Device for Seaweed Monitoring
by Caroline Peres, Masoud Emam, Hamed Jafarzadeh, Marco Belcastro and Brendan O’Flynn
Sensors 2021, 21(14), 4649; https://doi.org/10.3390/s21144649 - 7 Jul 2021
Cited by 14 | Viewed by 5226
Abstract
Aquaculture farming faces challenges to increase production while maintaining welfare of livestock, efficiently use of resources, and being environmentally sustainable. To help overcome these challenges, remote and real-time monitoring of the environmental and biological conditions of the aquaculture site is highly important. Multiple [...] Read more.
Aquaculture farming faces challenges to increase production while maintaining welfare of livestock, efficiently use of resources, and being environmentally sustainable. To help overcome these challenges, remote and real-time monitoring of the environmental and biological conditions of the aquaculture site is highly important. Multiple remote monitoring solutions for investigating the growth of seaweed are available, but no integrated solution that monitors different biotic and abiotic factors exists. A new integrated multi-sensing system would reduce the cost and time required to deploy the system and provide useful information on the dynamic forces affecting the plants and the associated biomass of the harvest. In this work, we present the development of a novel miniature low-power NFC-enabled data acquisition system to monitor seaweed growth parameters in an aquaculture context. It logs temperature, light intensity, depth, and motion, and these data can be transmitted or downloaded to enable informed decision making for the seaweed farmers. The device is fully customisable and designed to be attached to seaweed or associated mooring lines. The developed system was characterised in laboratory settings to validate and calibrate the embedded sensors. It performs comparably to commercial environmental sensors, enabling the use of the device to be deployed in commercial and research settings. Full article
(This article belongs to the Special Issue State-of-the-Art Sensors Technologies in Ireland 2020)
Show Figures

Figure 1

23 pages, 4001 KiB  
Article
Hough Transform-Based Angular Features for Learning-Free Handwritten Keyword Spotting
by Subhranil Kundu, Samir Malakar, Zong Woo Geem, Yoon Young Moon, Pawan Kumar Singh and Ram Sarkar
Sensors 2021, 21(14), 4648; https://doi.org/10.3390/s21144648 - 7 Jul 2021
Cited by 9 | Viewed by 3274
Abstract
Handwritten keyword spotting (KWS) is of great interest to the document image research community. In this work, we propose a learning-free keyword spotting method following query by example (QBE) setting for handwritten documents. It consists of four key processes: pre-processing, vertical zone division, [...] Read more.
Handwritten keyword spotting (KWS) is of great interest to the document image research community. In this work, we propose a learning-free keyword spotting method following query by example (QBE) setting for handwritten documents. It consists of four key processes: pre-processing, vertical zone division, feature extraction, and feature matching. The pre-processing step deals with the noise found in the word images, and the skewness of the handwritings caused by the varied writing styles of the individuals. Next, the vertical zone division splits the word image into several zones. The number of vertical zones is guided by the number of letters in the query word image. To obtain this information (i.e., number of letters in a query word image) during experimentation, we use the text encoding of the query word image. The user provides the information to the system. The feature extraction process involves the use of the Hough transform. The last step is feature matching, which first compares the features extracted from the word images and then generates a similarity score. The performance of this algorithm has been tested on three publicly available datasets: IAM, QUWI, and ICDAR KWS 2015. It is noticed that the proposed method outperforms state-of-the-art learning-free KWS methods considered here for comparison while evaluated on the present datasets. We also evaluate the performance of the present KWS model using state-of-the-art deep features and it is found that the features used in the present work perform better than the deep features extracted using InceptionV3, VGG19, and DenseNet121 models. Full article
(This article belongs to the Section Intelligent Sensors)
Show Figures

Figure 1

20 pages, 2284 KiB  
Article
Human-Machine Shared Driving Control for Semi-Autonomous Vehicles Using Level of Cooperativeness
by Anh-Tu Nguyen, Jagat Jyoti Rath, Chen Lv, Thierry-Marie Guerra and Jimmy Lauber
Sensors 2021, 21(14), 4647; https://doi.org/10.3390/s21144647 - 7 Jul 2021
Cited by 22 | Viewed by 5093
Abstract
This paper proposes a new haptic shared control concept between the human driver and the automation for lane keeping in semi-autonomous vehicles. Based on the principle of human-machine interaction during lane keeping, the level of cooperativeness for completion of driving task is introduced. [...] Read more.
This paper proposes a new haptic shared control concept between the human driver and the automation for lane keeping in semi-autonomous vehicles. Based on the principle of human-machine interaction during lane keeping, the level of cooperativeness for completion of driving task is introduced. Using the proposed human-machine cooperative status along with the driver workload, the required level of haptic authority is determined according to the driver’s performance characteristics. Then, a time-varying assistance factor is developed to modulate the assistance torque, which is designed from an integrated driver-in-the-loop vehicle model taking into account the yaw-slip dynamics, the steering dynamics, and the human driver dynamics. To deal with the time-varying nature of both the assistance factor and the vehicle speed involved in the driver-in-the-loop vehicle model, a new linear parameter varying control technique is proposed. The predefined specifications of the driver-vehicle system are guaranteed using Lyapunov stability theory. The proposed haptic shared control method is validated under various driving tests conducted with high-fidelity simulations. Extensive performance evaluations are performed to highlight the effectiveness of the new method in terms of driver-automation conflict management. Full article
(This article belongs to the Special Issue Sensors Fusion for Vehicle Detection and Control)
Show Figures

Figure 1