Search Results (40)

This article proposes a framework for the development of process digital twins (DTs) in the shipbuilding sector, based on the ISO 23247 standard and structured around the achievement of three levels of digital maturity. The framework is demonstrated through a real pilot cell developed at the Innovation and Robotics Center of NAVANTIA—Ferrol shipyard, incorporating various cutting-edge technologies such as robotics, artificial intelligence, automated welding, computer vision, visual inspection, and autonomous vehicles for the manufacturing of minor pre-assembly components. Additionally, the study highlights the crucial role of discrete event simulation (DES) in adapting traditional methodologies to meet the requirements of Process digital twins. By addressing these challenges, the research contributes to bridging the gap in the current state of the art regarding the development and implementation of Process digital twins in the naval sector. Full article

Structure detection (SD) has emerged as a critical technology for ensuring the safety and longevity of infrastructure, particularly in housing and civil engineering. Traditional SD methods often rely on manual inspections, which are time-consuming, labor-intensive, and prone to human error, especially in complex environments such as dense urban settings or aging buildings with deteriorated materials. Recent advances in autonomous systems—such as Unmanned Aerial Vehicles (UAVs) and climbing robots—have shown promise in addressing these limitations by enabling efficient, real-time data collection. However, challenges persist in accurately detecting and analyzing structural defects (e.g., masonry cracks, concrete spalling) amidst cluttered backgrounds, hardware constraints, and the need for multi-scale feature integration. The integration of machine learning (ML) and deep learning (DL) has revolutionized SD by enabling automated feature extraction and robust defect recognition. For instance, RepConv architectures have been widely adopted for multi-scale object detection, while attention mechanisms like TAM (Technology Acceptance Model) have improved spatial feature fusion in complex scenes. Nevertheless, existing works often focus on singular sensing modalities (e.g., UAVs alone) or neglect the fusion of complementary data streams (e.g., ground-based robot imagery) to enhance detection accuracy. Furthermore, computational redundancy in multi-scale processing and inconsistent bounding box regression in detection frameworks remain underexplored. This study addresses these gaps by proposing a generalized safety inspection system that synergizes UAV and stair-climbing robot data. We introduce a novel multi-scale targeted feature extraction path (Rep-FasterNet TAM block) to unify automated RepConv-based feature refinement with dynamic-scale fusion, reducing computational overhead while preserving critical structural details. For detection, we combine traditional methods with remote sensor fusion to mitigate feature loss during image upsampling/downsampling, supported by a structural model GIOU [Mathematical Definition: GIOU = IOU − (C − U)/C] that enhances bounding box regression through shape/scale-aware constraints and real-time analysis. By siting our work within the context of recent reviews on ML/DL for SD, we demonstrate how our hybrid approach bridges the gap between autonomous inspection hardware and AI-driven defect analysis, offering a scalable solution for large-scale housing safety assessments. In response to challenges in detecting objects accurately during housing safety assessments—including large/dense objects, complex backgrounds, and hardware limitations—we propose a generalized inspection system leveraging data from UAVs and stair-climbing robots. To address multi-scale feature extraction inefficiencies, we design a Rep-FasterNet TAM block that integrates RepConv for automated feature refinement and a multi-scale attention module to enhance spatial feature consistency. For detection, we combine dynamic-scale remote feature fusion with traditional methods, supported by a structural GIOU model that improves bounding box regression through shape/scale constraints and real-time analysis. Experiments demonstrate that our system increases masonry/concrete assessment accuracy by 11.6% and 20.9%, respectively, while reducing manual drawing restoration workload by 16.54%. This validates the effectiveness of our hybrid approach in unifying autonomous inspection hardware with AI-driven analysis, offering a scalable solution for SD in housing infrastructure. Full article

Surface defects on stay cables are primary contributors to wire corrosion and breakage. Traditional manual inspection methods are inefficient, inaccurate, and pose safety risks. Recently, cable-climbing robots have shown significant potential for surface defect detection, but existing designs are constrained by large size, limited operational speed, and complex installation, restricting their field applicability. This study presents an intelligent robotic system for detecting cable surface defects. The system features a dual-wheel driving mechanism, and a computer vision–based defect recognition framework is proposed. Image preprocessing techniques, including histogram equalization, Gaussian filtering, and Sobel edge detection, are applied. Interfering information, such as sheath edges and rain lines, is removed using the Hough Line Detection Algorithm and template matching. The geometry of identified defects is automatically calculated using connected component analysis and contour extraction. The system’s performance is validated through laboratory and field tests. The results demonstrate easy installation, adaptability to cable diameters from 70 mm to 270 mm and inclination angles from 0° to 90°, and a maximum speed of 26 m/min. The proposed defect recognition framework accurately identifies typical defects and captures their morphological characteristics, achieving an average precision of 92.37%. Full article

Autonomous navigation in GPS-denied, unstructured environments such as murky waters or complex seabeds remains a formidable challenge for robotic systems, primarily due to sensory degradation and the computational inefficiency of conventional algorithms. Drawing inspiration from the robust navigation strategies of marine species such as the sea turtle’s quantum-assisted magnetoreception, the octopus’s tactile-chemotactic integration, and the jellyfish’s energy-efficient flow sensing this study introduces a novel neuromorphic framework for resilient robotic navigation, fundamentally based on the co-design of marine-inspired sensors and event-based neuromorphic processors. Current systems lack the dynamic, context-aware multisensory fusion observed in these animals, leading to heightened susceptibility to sensor failures and environmental perturbations, as well as high power consumption. This work directly bridges this gap. Our primary contribution is a hybrid sensor fusion model that co-designs advanced sensing replicating the distributed neural processing of cephalopods and the quantum coherence mechanisms of migratory marine fauna with a neuromorphic processing backbone. Enabling real-time, energy-efficient path integration and cognitive mapping without reliance on traditional methods. This proposed framework has the potential to significantly enhance navigational robustness by overcoming the limitations of state-of-the-art solutions. The findings suggest the potential of marine bio-inspired design for advancing autonomous systems in critical applications such as deep-sea exploration, environmental monitoring, and underwater infrastructure inspection. Full article

Underwater imaging is affected by spatially varying blur caused by water flow turbulence, light scattering, and camera motion, resulting in severe visual quality loss and diminished performance in downstream vision tasks. Although numerous underwater image enhancement methods have been proposed, the issue of addressing non-uniform blur under realistic underwater conditions remains largely underexplored. To bridge this gap, we propose PMSPNet, a Progressive Multi-Scale Perception Network, designed to handle underwater non-uniform blur. The network integrates a Hybrid Interaction Attention Module to enable precise modeling of feature ambiguity directions and regional disparities. In addition, a Progressive Motion-Aware Perception Branch is employed to capture spatial orientation variations in blurred regions, progressively refining the localization of blur-related features. A Progressive Feature Feedback Block is incorporated to enhance reconstruction quality by leveraging iterative feature feedback across scales. To facilitate robust evaluation, we construct the Non-uniform Underwater Blur Benchmark, which comprises diverse real-world blur patterns. Extensive experiments on multiple real-world underwater datasets demonstrate that PMSPNet consistently surpasses state-of-the-art methods, achieving on average 25.51 dB PSNR and an inference speed of 0.01 s, which provides high-quality visual perception and downstream application input from underwater sensors for underwater robots, marine ecological monitoring, and inspection tasks. Full article

In recent years, the deterioration of social infrastructure such as bridges has become a serious issue in many countries around the world. To maintain the functionality of aging bridges over the long term, it is necessary to conduct regular inspections, detect damage at an early stage, and perform timely repairs. However, inspections require significant cost and time, and ensuring the safety of inspectors remains a major challenge. As a result, inspection using robots has attracted increasing attention. This study focuses on a wire-driven bridge inspection robot designed to inspect the underside of bridge girders. To use this robot, wires must be installed in the space beneath the girders. However, it is difficult to install wires over areas such as rivers. To address this problem, we developed a robotic arm capable of throwing a spear attached to a string. In order to throw the spear accurately to the target location, a three-dimensional dynamic model of the spear in flight was constructed, considering the tension of the string. Using this model, we accurately estimated the required throwing conditions and confirmed that the robotic arm could successfully throw the spear to the target location. Full article

An accurate 3D pose estimation of spherical objects remains challenging in industrial inspections and robotics due to their geometric symmetries and limited feature discriminability. This study proposes a texture-optimized simulation framework to enhance pose prediction accuracy through optimizing the surface texture features of the design samples. A hierarchical texture design strategy was developed, incorporating complexity gradients (low to high) and color contrast principles, and implemented via VTK-based 3D modeling with automated Euler angle annotations. The framework generated 2297 synthetic images across six texture variants, which were used to train a MobileNet model. The validation tests demonstrated that the high-complexity color textures achieved superior performance, reducing the mean absolute pose error by 64.8% compared to the low-complexity designs. While color improved the validation accuracy universally, the test set analyses revealed its dual role: complex textures leveraged chromatic contrast for robustness, whereas simple textures suffered color-induced noise (a 35.5% error increase). These findings establish texture complexity and color complementarity as critical design criteria for synthetic datasets, offering a scalable solution for vision-based pose estimation. Physical experiments confirmed the practical feasibility, yielding 2.7–3.3° mean errors. This work bridges the simulation-to-reality gaps in symmetric object localization, with implications for robotic manipulation and industrial metrology, while highlighting the need for material-aware texture adaptations in future research. Full article

In the rapidly evolving field of aerial robotics, the coordinated management of multiple unmanned aerial vehicle (multi-UAV) systems to address complex and dynamic environments is increasingly critical. Multi-UAV systems promise enhanced efficiency and effectiveness in various applications, from disaster response to infrastructure inspection, by leveraging the collective capabilities of UAV fleets. However, the dynamic nature of such environments presents significant challenges in task allocation and real-time adaptability. This paper introduces a novel hybrid algorithm designed to optimize multi-UAV task assignments in dynamic environments. State-of-the-art solutions in this domain have exhibited limitations, particularly in rapidly responding to dynamic changes and effectively scaling to large-scale environments. The proposed solution bridges these gaps by combining clustering to group and assign tasks in an initial offline phase with a dynamic partial reassignment process that locally updates assignments in response to real-time changes, all within a centralized–distributed communication topology. The simulation results validate the superiority of the proposed solution and demonstrate its improvements in efficiency and responsiveness over existing solutions. Additionally, the results highlight the scalability of the solution in handling large-scale problems and demonstrate its ability to efficiently manage a growing number of UAVs and tasks. It also demonstrated robust adaptability and enhanced mission effectiveness across a wide range of dynamic events and different scale scenarios. Full article

Drones are useful tools for performing tasks that are difficult for humans. Thus, they are being increasingly utilized in various fields. In smart construction, a range of methods, including robots and drones, has been proposed to inspect facilities and other similar structures. Global navigation satellite system (GNSS) shadowing can occur when large bridge substructures, which are difficult for humans to access, are inspected using drones because GNSS is a major component in drone operation. This study develops a path planning algorithm to address areas with GNSS shadowing. The operation mode of the drone is classified into waypoint selection based on the photography point algorithm (WPS-PPA) and GNSS non-shadowing area algorithm (WPS-GNSA). Both algorithms are experimentally compared for flight performance in the GNSS shadowing area. A field experiment was conducted by varying the distance between the drone and the bridge substructure and by comparing the success of the flights. In successful flights, the GNSS reception of WPS-GNSA reached 1.4 times that of WPS-PPA. Furthermore, even in failed flights, compared to the WPS-PPA algorithm, the WPS-GNSA algorithm continued flight until the GNSS signal further deteriorated. Accordingly, WPS-GNSA is more favorable than WPS-PPA for inspecting bridge substructures under GNSS signal shadowing. Full article

Traditional path planning algorithms typically focus only on path length, which fails to meet the low energy consumption requirements for wall-climbing robots in bridge inspection. This paper proposes an improved sparrow search algorithm based on logistic–tent chaotic mapping and differential evolution, aimed at addressing the issue of the sparrow search algorithm’s tendency to fall into local optima, thereby optimizing path planning for bridge inspection. First, the initial population is optimized using logistic–tent chaotic mapping and refracted opposition-based learning, with dynamic adjustments to the population size during the iterative process. Second, improvements are made to the position updating formulas of both discoverers and followers. Finally, the differential evolution algorithm is introduced to enhance the global search capability of the algorithm, thereby reducing the robot’s energy consumption. Benchmark function tests verify that the proposed algorithm exhibits superior optimization capabilities. Further path planning simulation experiments demonstrate the algorithm’s effectiveness, with the planned paths not only consuming less energy but also exhibiting shorter path lengths, fewer turns, and smaller steering angles. Full article

In response to problems such as insufficient adhesion, difficulty in adjustment, and weak obstacle-crossing capabilities in traditional robots, an innovative design has been developed for a five-wheeled climbing robot equipped with a pendulum-style magnetic control adsorption module. This design effectively reduces the weight of the robot, and sensors on the magnetic adsorption module enable real-time monitoring of magnetic force. Intelligent control adjusts the pendulum angle to modify the magnetic force according to different wall conditions. The magnetic adsorption module, using a Halbach array, enhances the concentration effect of the magnetic field, ensuring excellent performance in high-load tasks such as building maintenance, bridge inspection, and ship cleaning. The five-wheel structural design enhances the stability and obstacle-crossing capability, making it suitable for all-terrain environments. Simulation experiments using Maxwell analyzed the effects of the magnetic gap and the angle between the adsorption module and the wall, and mechanical performance analysis confirmed the robot’s ability to adhere safely and operate stably. Full article

The timely and accurate recognition of multi-type structural surface damage (e.g., cracks, spalling, corrosion, etc.) is vital for ensuring the structural safety and service performance of civil infrastructure and for accomplishing the intelligent maintenance of smart cities. Deep learning and computer vision have made profound impacts on automatic structural damage recognition using nondestructive test techniques, especially non-contact vision-based algorithms. However, the recognition accuracy highly depends on the training data volume and damage completeness in the conventional supervised learning pipeline, which significantly limits the model performance under actual application scenarios; the model performance and stability for multi-type structural damage categories are still challenging. To address the above issues, this study proposes a dual-stage optimization-based few-shot learning segmentation method using only a few images with supervised information for multi-type structural damage recognition. A dual-stage optimization paradigm is established encompassing an internal network optimization based on meta-task and an external meta-learning machine optimization based on meta-batch. The underlying image features pertinent to various structural damage types are learned as prior knowledge to expedite adaptability across diverse damage categories via only a few samples. Furthermore, a mathematical framework of optimization-based few-shot learning is formulated to intuitively express the perception mechanism. Comparative experiments are conducted to verify the effectiveness and necessity of the proposed method on a small-scale multi-type structural damage image set. The results show that the proposed method could achieve higher segmentation accuracies for various types of structural damage than directly training the original image segmentation network. In addition, the generalization ability for the unseen structural damage category is also validated. The proposed method provides an effective solution to achieve image-based structural damage recognition with high accuracy and robustness for bridges and buildings, which assists the unmanned intelligent inspection of civil infrastructure using drones and robotics in smart cities. Full article

Operations and maintenance (O&M) of floating offshore wind turbines (FOWTs) require regular inspection activities to predict, detect, and troubleshoot faults at high altitudes and in harsh environments such as strong winds, waves, and tides. Their costs typically account for more than 30% of the lifetime cost due to high labor costs and long downtime. Different inspection methods, including manual inspection, permanent sensors, climbing robots, remotely operated vehicles (ROVs), and unmanned aerial vehicles (UAVs), can be employed to fulfill O&M missions. The UAVs, as an enabling technology, can deal with time and space constraints easily and complete tasks in a cost-effective and efficient manner, which have been widely used in different industries in recent years. This study provides valuable insights into the existing applications of UAVs in FOWT inspection, highlighting their potential to reduce the inspection cost and thereby reduce the cost of energy production. The article introduces the rationale for applying UAVs to FOWT inspection and examines the current technical status, research gaps, and future directions in this field by conducting a comprehensive literature review over the past 10 years. This paper will also include a review of UAVs’ applications in other infrastructure inspections, such as onshore wind turbines, bridges, power lines, solar power plants, and offshore oil and gas fields, since FOWTs are still in the early stages of development. Finally, the trends of UAV technology and its application in FOWTs inspection are discussed, leading to our future research direction. Full article

The morphological characteristics of a crack serve as crucial indicators for rating the condition of the concrete bridge components. Previous studies have predominantly employed deep learning techniques for pixel-level crack detection, while occasionally incorporating monocular devices to quantify the crack dimensions. However, the practical implementation of such methods with the assistance of robots or unmanned aerial vehicles (UAVs) is severely hindered due to their restrictions in frontal image acquisition at known distances. To explore a non-contact inspection approach with enhanced flexibility, efficiency and accuracy, a binocular stereo vision-based method incorporating full convolutional network (FCN) is proposed for detecting and measuring cracks. Firstly, our FCN leverages the benefits of the encoder–decoder architecture to enable precise crack segmentation while simultaneously emphasizing edge details at a rate of approximately four pictures per second in a database that is dominated by complex background cracks. The training results demonstrate a precision of 83.85%, a recall of 85.74% and an F1 score of 84.14%. Secondly, the utilization of binocular stereo vision improves the shooting flexibility and streamlines the image acquisition process. Furthermore, the introduction of a central projection scheme achieves reliable three-dimensional (3D) reconstruction of the crack morphology, effectively avoiding mismatches between the two views and providing more comprehensive dimensional depiction for cracks. An experimental test is also conducted on cracked concrete specimens, where the relative measurement error in crack width ranges from −3.9% to 36.0%, indicating the practical feasibility of our proposed method. Full article

The automated inspection and mapping of engineering structures are mainly based on photogrammetry and laser scanning. Mobile robotic platforms like unmanned aerial vehicles (UAVs) and unmanned ground vehicles (UGVs), but also handheld platforms, allow efficient automated mapping. Engineering structures like bridges shadow global navigation satellite system (GNSS), which complicates precise localization. Simultaneous localization and mapping (SLAM) algorithms offer a sufficient solution, since they do not require GNSS. However, testing and comparing SLAM algorithms in GNSS-denied areas is difficult due to missing ground truth data. This work presents an approach to measuring the performance of SLAM in indoor and outdoor GNSS-denied areas using a terrestrial scanner Leica RTC360 and a tachymeter to acquire point cloud and trajectory information. The proposed method is independent of time synchronization between robot and tachymeter and also works on sparse SLAM point clouds. For the evaluation of the proposed method, three LiDAR-based SLAM algorithms called KISS-ICP, SC-LIO-SAM, and MA-LIO are tested using a UGV equipped with two light detection and ranging (LiDAR) sensors and an inertial measurement unit (IMU). KISS-ICP is based solely on a single LiDAR scanner and SC-LIO-SAM also uses an IMU. MA-LIO, which allows multiple (different) LiDAR sensors, is tested on a horizontal and vertical one and an IMU. Time synchronization between the tachymeter and SLAM data during post-processing allows calculating the root mean square (RMS) absolute trajectory error, mean relative trajectory error, and the mean point cloud to reference point cloud distance. It shows that the proposed method is an efficient approach to measure the performance of SLAM in GNSS-denied areas. Additionally, the method shows the superior performance of MA-LIO in four of six test tracks with 5 to 7 cm RMS trajectory error, followed by SC-LIO-SAM and KISS-ICP in last place. SC-LIO-SAM reaches the lowest point cloud to reference point cloud distance in four of six test tracks, with 4 to 12 cm. Full article