Search Results (13)

Craniofacial deformities, particularly craniosynostosis, present significant surgical challenges due to complex anatomy and the need for individualised, high-precision interventions. Augmented reality (AR) has emerged as a promising tool in craniofacial surgery, offering enhanced spatial visualisation, real-time anatomical referencing, and improved surgical accuracy. This review explores the current and emerging applications of AR in preoperative planning, intraoperative navigation, and surgical education within paediatric craniofacial surgery. Through a literature review of peer-reviewed studies, we examine how AR platforms, such as the VOSTARS system and Microsoft HoloLens, facilitate virtual simulations, precise osteotomies, and collaborative remote guidance. Despite demonstrated benefits in feasibility and accuracy, widespread clinical adoption is limited by technical, ergonomic, financial, and training-related challenges. Future directions include the integration of artificial intelligence, haptic feedback, and robotic assistance to further augment surgical precision and training efficacy. AR holds transformative potential for improving outcomes and efficiency in craniofacial deformity correction, warranting continued research and clinical validation. Full article

The existing strawberry ripeness detection algorithm has the problems of a low precision and a high missing rate in real complex scenes. Therefore, we propose a novel model based on a hybrid attention mechanism. Firstly, a partial convolution-based compact inverted block is developed, which significantly enhances the feature extraction capability of the model. Secondly, an efficient partial hybrid attention mechanism is established, which realizes the remote dependence and accurate localization of strawberry fruit. Meanwhile, a multi-scale progressive feature pyramid network is constructed, and the fine-grained features of strawberry targets of different sizes are accurately extracted. Finally, a Focaler-shape-IoU loss function is proposed to effectively solve the problem of the difficulty imbalance between strawberry samples and the influence of the shape and size of the bounding box on the regression. The experimental results show that the model’s precision and mAP0.5 reach 92.1% and 92.7%, respectively, which are 2.0% and 1.7% higher than the baseline model. Additionally, our model is better in detection performance than most models with fewer parameters and lower FLOPs. In summary, the model can accurately identify the maturity of strawberry fruit under complex farmland environments and provide certain technical guidance for automated strawberry-picking robots. Full article

The restoration of fine motor function in the hand is crucial for stroke survivors with hemiplegia to reintegrate into daily life and presents a significant challenge in post-stroke rehabilitation. Current mirror rehabilitation systems based on wearable devices require medical professionals or caregivers to assist patients in donning sensor gloves on the healthy side, thus hindering autonomous training, increasing labor costs, and imposing psychological burdens on patients. This study developed a low-load wearable hand function mirror rehabilitation robotic system based on visual gesture recognition. The system incorporates an active visual apparatus capable of adjusting its position and viewpoint autonomously, enabling the subtle monitoring of the healthy side’s gesture throughout the rehabilitation process. Consequently, patients only need to wear the device on their impaired hand to complete the mirror training, facilitating independent rehabilitation exercises. An algorithm based on hand key point gesture recognition was developed, which is capable of automatically identifying eight distinct gestures. Additionally, the system supports remote audio–video interaction during training sessions, addressing the lack of professional guidance in independent rehabilitation. A prototype of the system was constructed, a dataset for hand gesture recognition was collected, and the system’s performance as well as functionality were rigorously tested. The results indicate that the gesture recognition accuracy exceeds 90% under ten-fold cross-validation. The system enables operators to independently complete hand rehabilitation training, while the active visual system accommodates a patient’s rehabilitation needs across different postures. This study explores methods for autonomous hand function rehabilitation training, thereby offering valuable insights for future research on hand function recovery. Full article

Remotely operated vehicles (ROVs) provide practical solutions for a wide range of activities in a particularly challenging domain, despite their dependence on support ships and operators. Recent advancements in AI, machine learning, predictive analytics, control theories, and sensor technologies offer opportunities to make ROVs (semi) autonomous in their operations and to remotely test and monitor their dynamics. This study moves towards that goal by formulating a complete navigation, guidance, and control (NGC) system for a six DoF BlueROV2, offering a solution to the current challenges in the field of marine robotics, particularly in the areas of power supply, communication, stability, operational autonomy, localization, and trajectory planning. The vehicle can operate (semi) autonomously, relying on a sensor acoustic USBL localization system, tethered communication with the surface vessel for power, and a line of sight (LOS) guidance system. This strategy transforms the path control problem into a heading control problem, aligning the vehicle’s movement with a dynamically calculated reference point along the desired path. The control system uses PID controllers implemented in the navigator flight controller board. Additionally, an infrastructure has been developed that synchronizes and communicates between the real ROV and its digital twin within the Unity environment. The digital twin acts as a visual representation of the ROV’s movements and considers hydrodynamic behaviors. This approach combines the physical properties of the ROV with the advanced simulation and analysis capabilities of its digital counterpart. All findings were validated at the Point Rouge port located in Marseille and at the port of Ancona. The NGC implemented has proven positive vehicle stability and trajectory tracking in time despite external interferences. Additionally, the digital part has proven to be a reliable infrastructure for a future bidirectional communication system. Full article

Bridge inspection and monitoring are usually used to evaluate the status and integrity of bridge structures to ensure their safety and reliability. Computer vision (CV)-based methods have the advantages of being low cost, simple to operate, remote, and non-contact, and have been widely used in bridge inspection and monitoring in recent years. Therefore, this paper reviews three significant aspects of CV-based methods, including surface defect detection, vibration measurement, and vehicle parameter identification. Firstly, the general procedure for CV-based surface defect detection is introduced, and its application for the detection of cracks, concrete spalling, steel corrosion, and multi-defects is reviewed, followed by the robot platforms for surface defect detection. Secondly, the basic principle of CV-based vibration measurement is introduced, followed by the application of displacement measurement, modal identification, and damage identification. Finally, the CV-based vehicle parameter identification methods are introduced and their application for the identification of temporal and spatial parameters, weight parameters, and multi-parameters are summarized. This comprehensive literature review aims to provide guidance for selecting appropriate CV-based methods for bridge inspection and monitoring. Full article

Global Navigation Satellite Systems (GNSS) in precision agriculture (PA) represent a cornerstone for field mapping, machinery guidance, and variable rate technology. However, recent improvements in GNSS components (GPS, GLONASS, Galileo, and BeiDou) and novel remote sensing and computer processing-based solutions in PA have not been comprehensively analyzed in scientific reviews. Therefore, this study aims to explore novelties in GNSS components with an interest in PA based on the analysis of scientific papers indexed in the Web of Science Core Collection (WoSCC). The novel solutions in PA using GNSS were determined and ranked based on the citation topic micro criteria in the WoSCC. The most represented citation topics micro based on remote sensing were “NDVI”, “LiDAR”, “Harvesting robot”, and “Unmanned aerial vehicles” while the computer processing-based novelties included “Geostatistics”, “Precise point positioning”, “Simultaneous localization and mapping”, “Internet of things”, and “Deep learning”. Precise point positioning, simultaneous localization and mapping, and geostatistics were the topics that most directly relied on GNSS in 93.6%, 60.0%, and 44.7% of the studies indexed in the WoSCC, respectively. Meanwhile, harvesting robot research has grown rapidly in the past few years and includes several state-of-the-art sensors, which can be expected to improve further in the near future. Full article

Telepresence robots are gaining more popularity as a means of remote communication and human–robot interaction, allowing users to control and operate a physical robot remotely. However, controlling these robots can be challenging due to the inherent delays and latency in the communication systems. In this research paper, we propose a novel hybrid algorithm exploiting deep reinforcement learning (DRL) with a dueling double-deep Q-network (DDQN) and a gated recurrent unit (GRU) to assist and maneuver the telepresence robot during the delayed operating signals from the operator. The DDQN is used to learn the optimal control policy for the telepresence robot in a remote healthcare environment during delayed communication signals. In contrast, the GRU is employed to model the control signals’ temporal dependencies and handle the variable time delays in the communication system. The proposed hybrid approach is evaluated analytically and experimentally. The results demonstrate the approach’s effectiveness in improving telepresence robots’ tracking accuracy and stability performance. Multiple experiments show that the proposed technique depicts improved controlling efficiency with no guidance from the teleoperator. It can control and manage the operations of the telepresence robot during the delayed communication of 15 seconds by itself, which is 2.4% better than the existing approaches. Overall, the proposed hybrid approach demonstrates the potential implementation of RL and deep learning techniques in improving the control and stability of the telepresence robot during delayed operating signals from the operator. Full article

Agricultural machinery telemetry collects and shares data, which are sent remotely and become precious information. Thus, accurate and instantaneous monitoring can provide an important base of information for adjusting the parameters of the most diverse mechanized agricultural operations, reducing input costs and maintenance expenses. In recent years, this theme has gained more strength and importance for managing rural properties. Therefore, the present study developed a bipartite bibliometric analysis in two lines of research and described the state of the art of this data collection methodology (via telemetry), presenting its technological evolution. The study presents the evolution and connection of telemetry and the processes of robotization of agricultural operations and automation provided by data collection via telemetry in real time. The main countries, keywords, researchers, institutions, and the Dickson quality index indicate a high growth in the last decade. Thus, the present study contributes to decision making regarding research topics, guidance on the state of the art, and contextualization of telemetry’s importance in current research. Full article

Telepresence robots are becoming popular in social interactions involving health care, elderly assistance, guidance, or office meetings. There are two types of human psychological experiences to consider in robot-mediated interactions: (1) telepresence, in which a user develops a sense of being present near the remote interlocutor, and (2) co-presence, in which a user perceives the other person as being present locally with him or her. This work presents a literature review on developments supporting robotic social interactions, contributing to improving the sense of presence and co-presence via robot mediation. This survey aims to define social presence, co-presence, identify autonomous “user-adaptive systems” for social robots, and propose a taxonomy for “co-presence” mechanisms. It presents an overview of social robotics systems, applications areas, and technical methods and provides directions for telepresence and co-presence robot design given the actual and future challenges. Finally, we suggest evaluation guidelines for these systems, having as reference face-to-face interaction. Full article

From autonomous vehicles to robotics and machinery, organizations are developing autonomous transportation systems in various domains. Strategic incentives point towards a fourth industrial revolution of cyber–physical systems with higher levels of automation and connectivity throughout the Internet of Things (IoT) that interact with the physical world. In the construction and mining sectors, these developments are still at their infancy, and practitioners are interested in autonomous solutions to enhance efficiency and reliability. This paper illustrates the enhanced design of a driverless bulldozer prototype using IoT-based solutions for the remote control and navigation tracking of the mobile machinery. We illustrate the integration of a cloud application, communication protocols and a wireless communication network to control a small-scale bulldozer from a remote workstation. Furthermore, we explain a new tracking functionality of work completion using maps and georeferenced indicators available via a user interface. Finally, we provide a preliminary safety and security risk assessment of the system prototype and propose guidance for application in real-scale machinery. Full article

Haptic guidance is a promising method for assisting an operator in solving robotic remote operation tasks. It can be implemented through different methods, such as virtual fixtures, where a predefined trajectory is used to generate guidance forces, or interactive guidance, where sensor measurements are used to assist the operator in real-time. During the last years, the use of learning from demonstration (LfD) has been proposed to perform interactive guidance based on simple tasks that are usually composed of a single stage. However, it would be desirable to improve this approach to solve complex tasks composed of several stages or gestures. This paper extends the LfD approach for object telemanipulation where the task to be solved is divided into a set of gestures that need to be detected. Thus, each gesture is previously trained and encoded within a Gaussian mixture model using LfD, and stored in a gesture library. During telemanipulation, depending on the sensory information, the gesture that is being carried out is recognized using the same LfD trained model for haptic guidance. The method was experimentally verified in a teleoperated peg-in-hole insertion task. A KUKA LWR4+ lightweight robot was remotely controlled with a Sigma.7 haptic device with LfD-based shared control. Finally, a comparison was carried out to evaluate the performance of Gaussian mixture models with a well-established gesture recognition method, continuous hidden Markov models, for the same task. Results show that the Gaussian mixture models (GMM)-based method slightly improves the success rate, with lower training and recognition processing times. Full article

This paper describes the theoretical and practical foundations for remote control of a mobile robot for nonlinear trajectory tracking using an external localisation sensor. It constitutes a classical networked control system, whereby event-based techniques for both control and state estimation contribute to efficient use of communications and reduce sensor activity. Measurement requests are dictated by an event-based state estimator by setting an upper bound to the estimation error covariance matrix. The rest of the time, state prediction is carried out with the Unscented transformation. This prediction method makes it possible to select the appropriate instants at which to perform actuations on the robot so that guidance performance does not degrade below a certain threshold. Ultimately, we obtained a combined event-based control and estimation solution that drastically reduces communication accesses. The magnitude of this reduction is set according to the tracking error margin of a P3-DX robot following a nonlinear trajectory, remotely controlled with a mini PC and whose pose is detected by a camera sensor. Full article

Objective: To evaluate the performance of three tele-echography systems for routine use in isolated medical centers. Methods: Three systems were used for deep (abdomen, pelvis, fetal) and superficial (muscle, thyroid, carotid artery) examinations: (a) a robotic arm (RA) holding an echographic probe; (b) an echograph with a motorized probe (MP); and (c) remote guidance (RG) where the patient site operator performed the examination assisted by an expert via videoconference. All systems were tested in the same medical center located 60 km away from the university hospital. Results: A total of 340 remote echography examinations were performed (41% RA and MP, 59% RG). MP and RA allowed full control of the probe orientation by the expert, and provided diagnoses in 97% of cases. The use of RG was sufficient for superficial vessel examinations and provided diagnoses in 98% of cases but was not suited for deep or superficial organs. Assessment of superficial organs was best accomplished using the MP. Discussion: Both teleoperated systems provided control of the probe orientation by the expert necessary for obtaining appropriate views of deep organs but the MP was much more ergonomic and easier to use than the RA. RG was appropriate for superficial vessels while the MP was better for superficial volumic organs. Full article