Search Results (68)

In recent years, Location-Based Augmented Reality (LAR) systems have been increasingly implemented in various applications for tourism, navigation, education, and entertainment. Unfortunately, the LAR content creation using conventional desktop-based authoring tools has become a bottleneck, as it requires time-consuming and skilled work. Previously, we proposed an in-situ mobile authoring tool as an efficient solution to this problem by offering direct authoring interactions in real-world environments using a smartphone. Currently, the evaluation through the comparison between the proposal and conventional ones is not sufficient to show superiority, particularly in terms of interaction, authoring performance, and cognitive workload, where our tool uses 6DoF device movement for spatial input, while desktop ones rely on mouse-pointing. In this paper, we present a comparative study of authoring performances between the tools across three authoring phases: (1) Point of Interest (POI) location acquisition, (2) AR object creation, and (3) AR object registration. For the conventional tool, we adopt Unity and ARCore SDK. As a real-world application, we target the LAR content creation for pedestrian landmark annotation across campus environments at Okayama University, Japan, and Brawijaya University, Indonesia, and identify task-level bottlenecks in both tools. In our experiments, we asked 20 participants aged 22 to 35 with different LAR development experiences to complete equivalent authoring tasks in an outdoor campus environment, creating various LAR contents. We measured task completion time, phase-wise contribution, and cognitive workload using NASA-TLX. The results show that our tool made faster creations with 60% lower cognitive loads, where the desktop tool required higher mental efforts with manual data input and object verifications. Full article

This study focuses on the cooperative formation control problem of six-degree-of-freedom (6-DOF) fixed-wing unmanned aerial vehicles (UAVs) under constraints of limited communication resources and strict time requirements. The core innovation of the proposed framework lies in the deep integration of a dynamic self-triggered communication mechanism (DSTCM) with a prescribed-time control strategy. Furthermore, a fuzzy control strategy is designed to effectively suppress system disturbances, enhancing the robustness of the formation. The designed DSTCM not only retains the adaptive triggering threshold characteristic of dynamic event-triggered communication, significantly reducing communication frequency, but also completely eliminates the need for continuous state monitoring required by traditional event-triggered mechanisms. As a result, both communication and onboard computational resources are effectively conserved. In parallel, a novel time-varying unilateral constrained performance function is introduced to construct a prescribed-time controller, which guarantees that the formation tracking error converges to a predefined residual set within a user-specified time. The convergence process is independent of initial conditions and strictly adheres to full-state constraints. A rigorous Lyapunov-based stability analysis demonstrates that all signals in the closed-loop UAV velocity and attitude system are semi-globally uniformly ultimately bounded (SGUUB). Furthermore, the proposed DSTCM ensures the existence of a strictly positive lower bound on the inter-event triggering intervals of the UAVs, thereby avoiding the occurrence of Zeno behavior. Numerical simulation results are provided to verify the effectiveness and superiority of the proposed control scheme. Full article

This study compares immersive VR-based control systems with conventional keyboard-based control to examine the efficacy of VR interfaces for controlling robotic arms in Internet of Things (IoT) education. A 5-DOF robotic arm with MG996R servomotors and controlled by an Arduino microcontroller and Raspberry Pi wireless communication was operated by 31 third-year engineering students in hands-on experiments using both control modalities. To determine student preferences across in-person, online, and hybrid learning contexts, the study applied a mixed-methods approach that combined qualitative evaluation using open-ended questionnaires and quantitative analysis through Likert-scale surveys. First, it should be mentioned that most of the reported papers either use a robotic arm or a VR system in education. However, we are among the first to report a combination of the two. Secondly, in most cases, there are either technical papers or educational quantitative/qualitative research papers on existing technologies reported in the literature. We combine an innovative education context (robotic arm and VR), completed with a quantitative and qualitative study, making it a complete experiment. Lastly, combining qualitative with quantitative research that complement each other is an innovative aspect in itself in this field. Full article

Accurate target recognition and localization remain significant challenges for robotic fruit harvesting in unstructured orchard environments characterized by branch occlusion and leaf clutter. To address the difficulty in identifying and locating apples under such visually complex conditions, this paper proposes an improved YOLOv5-based visual recognition algorithm incorporating an efficient channel attention (ECA) module. The ECA module is strategically integrated into specific C3 layers (C3-3, C3-6, C3-9) of the YOLOv5 network architecture to enhance feature representation for occluded targets. During operation, the system simultaneously acquires apple pose information and achieves precise spatial localization through coordinate transformation matrices. Comprehensive experimental evaluations demonstrate the effectiveness of the proposed system. The custom-designed six-degree-of-freedom (6-DOF) robotic arm exhibits a wide operational range with a maximum working angle of 120°. The ECA-enhanced YOLOv5 model achieves a confidence level of 90% and an impressive in-range apple recognition rate of 98%, representing a 2.5% improvement in the mean Average Precision (mAP) compared to the baseline YOLOv5s algorithm. The end-effector positioning error is consistently controlled within 1.5 mm. The motion planning success rate reaches 92%, with the picking completed within 23 s per apple. This work provides a novel and effective vision recognition solution for future development of harvesting robots. Full article

With the application and rapid development of light industrial robots, it is vital to accelerate the prototype design to fulfill the demands of shortening the robot’s production cycle, owing to rapid update iterations. Since the traditional design method cannot intuitively and efficiently check the deficiencies in the design preparation, the secondary design iterations will result in higher equipment costs, longer design cycles, and lower development efficiency. The MBD (model-based design), a full 3D (three-dimensional) design and manufacturing method, is proposed to swiftly finish the prototype design for solving the above problems. Firstly, the robot design preparation is completed with the design requirements to generate a robot 3D model. Secondly, several design methods are used: (i) the rapid prototyping, which includes the joint component verification and selection to further optimize the 3D model; (ii) the robot kinematics algorithm, which provides a theoretical foundation for the 3D model design; (iii) the robot kinematics simulation, which verifies the correctness of the kinematics algorithm. Finally, the feasibility of the MBD is verified by the robot prototype and the motion control system test. Taking the MBD to design a 5-DoF (five-degrees-of-freedom) robot as an example, the joint verification and selection are finished quickly and accurately to build the robot prototype without the need for secondary design processing, and the kinematic algorithm verified by the co-simulation platform can be used directly in the actual motion control of the robot prototype, which accelerates the development of the robot motion control system. Full article

Soft continuum robots are constructed from soft and compliant materials and can provide high flexibility and adaptability to various applications. They have theoretically infinite degrees of freedom (DOFs) and can generate highly nonlinear behaviors, which leads to challenges in accurately modeling and controlling their deformation, compliance, and behaviors. Inspired by animals, embodied intelligence utilizes physical bodies as an intelligent resource for information processing and task completion and offloads the computational cost of central control, which provides a unique approach to understanding and modeling soft robotics. In this study, we propose a theoretical framework to explain and guide distributed sensing enabled embodied intelligence for soft finger manipulation from a physics-based perspective. Specifically, we aim to provide a theoretical foundation to guide future sensor design and placement by addressing two key questions: (1) whether and why the state of a specific material point such as the tip trajectory of a soft finger can be predicted using distributed sensing, and, (2) how many sensors are sufficient for accurate prediction. These questions are critical for the design of soft and compliant robotic systems with embedded sensing for embodied intelligence. In addition to theoretical analysis, the study presents a feasible approach for real-time trajectory prediction through optimized sensor placement, with results validated through both simulation and experiment. The results showed that the tip trajectory of a soft finger can be predicted with a finite number of sensors with proper placement. While the proposed method is demonstrated in the context of soft finger manipulation, the framework is theoretically generalizable to other compliant soft robotic systems. Full article

This paper presents the development and analysis of a novel 6-DOF Cartesian parallel mechanism intended for use as a haptic device for initial sonography training. The system integrates a manipulator designed for delivering force feedback in five degrees of freedom; however, in the current stage, only mechanical architecture and kinematic validation have been conducted. Future enhancements will focus on implementing and evaluating closed-loop force control to enable complete haptic feedback. To assess the kinematic performance of the mechanism, a detailed kinematic model was developed, and both the Kinematic Conditioning Index (KCI) and Global Conditioning Index (GCI) were computed to evaluate the system’s dexterity. A trajectory simulation was conducted to validate the mechanism’s movement, using motion patterns typical in sonography procedures. Quasi-static analysis was performed to study the transmission of force and torque for generating realistic haptic feedback, critical for simulating real-life sonography. The simulation results showed consistent performance, with dexterity and torque distribution confirming the suitability of the mechanism for haptic applications in sonography training. Additionally, structural analysis verified the robustness of key components under expected loads. In order to validate the proposed design, the prototype was constructed using a combination of aluminum components and 3D-printed ABS parts, with Igus^® linear guides for precise motion. The outcomes of this study provide a foundation for the further development of a low-cost, effective sonography training system. Full article

Gearboxes are autonomous devices essential for power transmission in various mechanical systems. When a failure occurs, it can lead to an inability to perform the required functions, potentially resulting in a complete shutdown of the mechanism and causing significant operational disruptions. Consequently, deploying expert methods for fault detection and diagnosis is crucial to ensuring the reliability and efficiency of these systems. Artificial intelligence (AI) techniques show promise for fault diagnosis, but their accuracy can be hindered by noise and manufacturing imperfections that distort mechanical signatures. Thorough data analysis and preprocessing are vital to preserving these critical features. Validating approaches through numerical simulations before experimentation is essential to identify model limitations and minimize risks. A hybrid approach, combining AI and physics-based models, could provide a robust solution by leveraging the strengths of both domains: AI for its ability to process large volumes of data and physics-based models for their reliability in modeling complex mechanical behaviors. This paper proposes a comprehensive diagnostic methodology. It starts with feature extraction from time-domain analysis, which helps identify critical indicators of gearbox performance. Following this, a feature selection process is applied using the Fisher criterion, which ensures that only the most relevant features are retained for further analysis. These selected features are then employed to train an Adaptive Neuro-Fuzzy Inference System (ANFIS), a sophisticated approach that combines the learning capabilities of neural networks with the reasoning abilities of fuzzy logic. The proposed methodology is evaluated using a dataset of gear faults generated through energy simulations based on a six-degree-of-freedom (6-DOF) model, followed by a secondary validation on an experimental dataset. Full article

The safety of Jettisoned FDRS in the process of separation from an aircraft is a key factor in designing Jettisoned FDRs and enabling them to pass airworthiness certification and be widely used in civil aircraft. The separation process of Jettisoned FDR installed on NASA Common Research Model is studied by the simulation method based on anisotropic unstructured hybrid grid and overset grid technology coupled with the rigid body 6-DOF equation. First, the numerical simulation accuracy of software under same simulation method is verified by WPFS standard model. Then, according to the three main aerodynamic parameters, including incoming Mach number, angle of attack α and sideslip angle β, 10 conditions including standard condition are designed and the separation process of recorder is simulated numerically. The simulation obtained the movement of Jettisoned FDRs in 6 degrees of freedom relative to the body coordinate system in different operating conditions during the separation process and confirmed that Jettisoned FDRs can be safely separated under these operating conditions. Finally, combined with the standard operating condition, the impact of three parameters’ changes on recorder’s 6 degrees of freedom motion and the time required to complete separation are analyzed, and conditions to ensure the safe separation of Jettisoned FDRs are summarized according to the requirements of airworthiness terms. Full article

This paper presents the development of a virtual walker for wheelchair users designed for use in highly immersive environments, such as Cave Automatic Virtual Environments (CAVEs). The system allows users to navigate virtual environments using their natural wheelchair movements, providing haptic feedback based on the terrain they traverse. Both the control software and hardware have been developed from scratch and integrated into various CAVEs, including one with a six-degree-of-freedom (DOF) motion platform. To test the system, a comparative study was conducted with 21 users, measuring the time taken to complete the same course using different interaction methods and various feedback configurations with the virtual environment. The results show that the shortest times were achieved when users navigated using their natural interaction with their wheelchairs. Full article

Robotic manipulators are widely used in various industries for complex and repetitive tasks. However, they remain vulnerable to unexpected hardware failures. In this study, we address the challenge of enabling a robotic manipulator to complete tasks despite joint malfunctions. Specifically, we develop a reinforcement learning (RL) framework to adaptively compensate for a nonfunctional joint during task execution. Our experimental platform is the Franka robot with seven degrees of freedom (DOFs). We formulate the problem as a partially observable Markov decision process (POMDP), where the robot is trained under various joint failure conditions and tested in both seen and unseen scenarios. We consider scenarios where a joint is permanently broken and where it functions intermittently. Additionally, we demonstrate the effectiveness of our approach by comparing it with traditional inverse kinematics-based control methods. The results show that the RL algorithm enables the robot to successfully complete tasks even with joint failures, achieving a high success rate with an average rate of 93.6%. This showcases its robustness and adaptability. Our findings highlight the potential of RL to enhance the resilience and reliability of robotic systems, making them better suited for unpredictable environments. Full article

The combination of the dark fiber in existing Optical Fiber Composite Overhead Ground Wire (OPGW) with Distributed Optical Fiber Sensing (DOFS) technology can be used to enable online monitoring and provide early warnings of anomalies in high-voltage transmission lines. Accurate mapping of the optical cable length to the geographic coordinates of actual towers is a key factor in achieving this goal. This paper discusses the principle of using a DOFS system for transmission line tower positioning and presents four available positioning features. To overcome the limitations of single physical parameter positioning, this paper presents a self-developed hybrid DOFS that simultaneously captures Rayleigh backscattering and Brillouin scattering signals. Several physical parameters, including temperature, strain, and vibration, are acquired synchronously. Through hybrid multi-parameter analysis, the rapid and accurate positioning of OPGW line towers is achieved. Experimental results have shown that the proposed method, based on the hybrid DOFS system, can locate up to 82 towers, while the traditional method could only identify 12. The hybrid system was able to complete 80% of the tension towers in 40 h. This paper presents a novel multi-parameter localization method that has the potential to significantly improve the efficiency and reliability of grid operation and maintenance. Full article

Snake robots have broad application potential, but their motion-control and motion-planning problems are extremely challenging due to the high redundancy of degrees of freedom (DoFs), and the lack of complete system tools further hinders the research of snake robots. In this paper, a coordinate system and a kinematic model were established based on the D-H method for snake robots. The rhythm-generation model for multimodal motion gait and a novel sliding-window five-point interpolation-derivative model were proposed based on a bio-inspired central pattern generator (CPG) model. A prototype and simulator were constructed based on the designed snake robot models to achieve the multimodal motion gait for the snake robot and improve its environmental adaptability. Furthermore, a novel structure–drive–perception–control integration snake robot system (SnakeSys) was built based on the robot-operating system (ROS). Finally, the effectiveness, feasibility, and accuracy of the kinematic model and control model in motion control and information perception were verified through simulations and experiments. We open sourced SnakeSys so that relevant researchers or developers can directly utilize or further develop it. Full article

Dynamics parameter identification in the establishment of a multiple degree-of-freedom (DOF) robot’s dynamics model poses significant challenges. This study employs a non-symbolic numerical method to establish a dynamics model based on the Newton–Euler formula and then derives a proper dynamics model through decoupling. Initially, a minimum inertial parameter set is acquired by using QR decomposition, with the inclusion of a friction model in the robot dynamics model. Subsequently, the least squares method is employed to solve for the minimum inertial parameters, forming the basis for a comprehensive robot dynamics parameter identification system. Then, after the optimization of the genetic algorithm, the Fourier series trajectory function is used to derive the trajectory function for parameter identification. Validation of the robot’s dynamics parameter identification is performed through simulation and experimentation on a 6-DOF robot, leading to a precise identification value of the robot’s inertial parameters. Furthermore, two methods are employed to verify the inertia parameters, with analysis of experimental errors demonstrating the effectiveness of the robot dynamics parameter identification method. Overall, the effectiveness of the entire calibration system is verified by experiments, which can provide valuable insights for practical engineering applications, and a complete and effective robot dynamics parameter identification scheme for a 6-DOF robot is established and improved. Full article

Remotely operated vehicles (ROVs) provide practical solutions for a wide range of activities in a particularly challenging domain, despite their dependence on support ships and operators. Recent advancements in AI, machine learning, predictive analytics, control theories, and sensor technologies offer opportunities to make ROVs (semi) autonomous in their operations and to remotely test and monitor their dynamics. This study moves towards that goal by formulating a complete navigation, guidance, and control (NGC) system for a six DoF BlueROV2, offering a solution to the current challenges in the field of marine robotics, particularly in the areas of power supply, communication, stability, operational autonomy, localization, and trajectory planning. The vehicle can operate (semi) autonomously, relying on a sensor acoustic USBL localization system, tethered communication with the surface vessel for power, and a line of sight (LOS) guidance system. This strategy transforms the path control problem into a heading control problem, aligning the vehicle’s movement with a dynamically calculated reference point along the desired path. The control system uses PID controllers implemented in the navigator flight controller board. Additionally, an infrastructure has been developed that synchronizes and communicates between the real ROV and its digital twin within the Unity environment. The digital twin acts as a visual representation of the ROV’s movements and considers hydrodynamic behaviors. This approach combines the physical properties of the ROV with the advanced simulation and analysis capabilities of its digital counterpart. All findings were validated at the Point Rouge port located in Marseille and at the port of Ancona. The NGC implemented has proven positive vehicle stability and trajectory tracking in time despite external interferences. Additionally, the digital part has proven to be a reliable infrastructure for a future bidirectional communication system. Full article