Search Results (166)

Efficient and non-destructive extraction of organ-level phenotypic parameters of sesame (Sesamum indicum L.) plants is a key bottleneck in current sesame phenotyping research. To address this issue, this study proposes a method for organ segmentation and phenotypic parameter extraction based on CAVF-PointNet++ and geometric clustering. First, this method constructs a high-precision 3D point cloud using multi-view RGB image sequences. Based on the PointNet++ model, a CAVF-PointNet++ model is designed to perform feature learning on point cloud data and realize the automatic segmentation of stems, petioles, and leaves. Meanwhile, different leaves are segmented using curvature-density clustering technology. Based on the results of segmentation, this study extracted a total of six organ-level phenotypic parameters, including plant height, stem diameter, leaf length, leaf width, leaf angle, and leaf area. The experimental results show that in the segmentation tasks of stems, petioles, and leaves, the overall accuracy of CAVF-PointNet++ reaches 96.93%, and the mean intersection over union is 82.56%, which are 1.72% and 3.64% higher than those of PointNet++, demonstrating excellent segmentation performance. Compared with the results of manual segmentation of different leaves, the proposed clustering method achieves high levels in terms of precision, recall, and F1-score, and the segmentation results are highly consistent. In terms of phenotypic parameter measurement, the coefficients of determination between manual measurement values and algorithmic measurement values are 0.984, 0.926, 0.962, 0.942, 0.914, and 0.984 in sequence, with root-mean-square errors of 5.9 cm, 1.24 mm, 1.9 cm, 1.2 cm, 3.5°, and 6.22 cm², respectively. The measurement results of the proposed method show a strong correlation with the actual values, providing strong technical support for sesame phenotyping research and precision agriculture. It is expected to provide reference and support for the automated 3D phenotypic analysis of other crops in the future. Full article

The automatic detection and accurate geolocation of key railway objects plays a crucial role in the mapping, monitoring and management of railway infrastructure. This study presents a novel approach for the identification and geolocation of key railway elements through point cloud analysis. The methodology relies on high-density LiDAR point clouds acquired along railway lines using a mobile laser-scanning system operating in the infrared (IR). This research contributes to the advancement of railway mapping and monitoring technologies by providing an innovative solution that can be integrated into railway infrastructure management software. Full article

The concept of symmetry is a fundamental principle in various scientific and engineering fields, including welding technology. In the context of this paper, symmetry could play a role in optimizing the welding trajectory. Welding trajectory point detection relies on machine vision perception and intelligent algorithms to extract welding trajectory, which is crucial for the automatic welding of steel parts. However, in practice, sieve-net welding still relies on manual or semi-automatic operations, which have limitations, such as fixed positions and sizes, making it unsafe and inefficient. This paper proposes a 2D skeleton extraction algorithm for detecting weld joints in a sieve-net point cloud. First, the algorithm applies principal component analysis (PCA) to transform the point cloud and projects it into a 2D image with minimal information loss. Second, the expansion corrosion method is then employed to enhance the connectivity and refinement of the sieve-net mesh to serve the extraction of 2D skeleton. Third, the algorithm extracts the skeleton of the sieve-net grid and detects solder points. The average detection accuracy of the proposed algorithm is over 95%, which confirms its feasibility and practical application value in sieve-net welding. Full article

This work presents a generative design algorithm for the semi-automatic reconstruction of sweepable surfaces from point clouds obtained through three-dimensional scanning. The proposed algorithm enables, starting from a 3D acquisition dataset, the correct automatic orientation of the mesh, the selection of a suitable cutting edge, and the specification of the number of transversal sections for an effective 3D model reconstruction. Additionally, it suggests a maximum number of points to be used for reconstructing the sectional curves. The mesh reconstruction is performed through a lofting operation, resulting in a non-uniform rational B-spline (NURBS) surface. The algorithm has been applied to a case study involving the front wing surface of a foil from the Olympic class iQFoil, which has recently garnered significant attention from researchers in the field of performance analysis. The obtained reconstructed surface exhibits very low deviation values when compared to the original mesh. This demonstrates the reliability of the results obtained with the proposed approach, which provides sufficient accuracy and is obtained in a considerably shorter time compared to the traditional manual reconstruction approach, enabling the reconstruction of a 3D model in just a few semi-automatic steps, ready for subsequent numerical analyses if needed. Full article

This paper introduces an innovative automatic trajectory generation method for the robotic deburring of molded parts, effectively addressing challenges posed by burr defects and workpiece deformation common in casting and injection molding processes. Existing offline trajectory planning methods often struggle with substantial burr sizes and complex surface deformations, resulting in compromised machining quality due to over-adaptation. To overcome these issues, the proposed approach utilizes 3D vision techniques to achieve precise burr localization. A novel burr point cloud segmentation method based on feature analysis, combined with a tolerance-constrained non-rigid registration algorithm, accurately identifies burr regions and optimizes trajectory positioning within defined manufacturing tolerances. Furthermore, the method employs quantitative burr height distribution analysis to dynamically adjust robotic feed rates, significantly enhancing processing efficiency. Experimental validations demonstrated that the proposed method reduces the deburring time by up to 68% compared to conventional techniques, achieving an average trajectory deviation of only 0.79 mm. This study provides a robust, efficient, and precise solution for automating deburring operations in complex molded components, highlighting its substantial potential for industrial applications. Full article

Accurate registration of multi-platform light detection and ranging (LiDAR) point clouds is essential for detailed forest structure analysis and ecological monitoring. In this study, we developed a novel two-stage method for aligning terrestrial and unmanned aerial vehicle LiDAR point clouds in forest environments. The method first performs coarse alignment using canopy-level digital surface models and Fast Point Feature Histograms, followed by fine registration with Iterative Closest Point. Experiments conducted in six forest plots achieved an average registration accuracy of 0.24 m within 5.14 s, comparable to manual registration but with substantially reduced processing time and human intervention. In contrast to existing tree-based methods, the proposed approach eliminates the need for individual tree segmentation and ground filtering, streamlining preprocessing and improving scalability for large-scale forest monitoring. The proposed method facilitates a range of forest applications, including structure modeling, ecological parameter retrieval, and long-term change detection across diverse forest types and platforms. Full article

The detection of citrus separation lines is a crucial step in the citrus processing industry. Inspired by the achievements of line-structured light technology in surface defect detection, this paper proposes a method for detecting citrus separation lines based on line-structured light. Firstly, a gamma-corrected Otsu method is employed to extract the laser stripe region from the image. Secondly, an improved skeleton extraction algorithm is employed to mitigate the bifurcation errors inherent in original skeleton extraction algorithms while simultaneously acquiring 3D point cloud data of the citrus surface. Finally, the least squares progressive iterative approximation algorithm is applied to approximate the ideal surface curve; subsequently, principal component analysis is used to derive the normals of this ideally fitted curve. The deviation between each point (along its corresponding normal direction) and the actual geometric characteristic curve is then adopted as a quantitative index for separation lines positioning. The average similarity between the extracted separation lines and the manually defined standard separation lines reaches 92.5%. In total, 95% of the points on the separation lines obtained by this method have an error of less than 4 pixels. Experimental results demonstrate that through quantitative deviation analysis of geometric features, automatic detection and positioning of the separation lines are achieved, satisfying the requirements of high precision and non-destructiveness for automatic citrus splitting. Full article

The detection of coils in reservoir areas is part of the environmental perception technology of unmanned cranes. In order to improve the perception ability of unmanned cranes to include environmental information in reservoir areas, a method of automatic detection of coils based on two-dimensional LiDAR dynamic scanning is proposed, which realizes the detection of the position and attitude of coils in reservoir areas. This algorithm realizes map reconstruction of 3D point cloud by fusing LiDAR point cloud data and the motion position information of intelligent cranes. Additionally, a processing method based on histogram statistical analysis and 3D normal curvature estimation is proposed to solve the problem of over-segmentation and under-segmentation in 3D point cloud segmentation. Finally, for segmented point cloud clusters, coil models are fitted by the RANSAC method to identify their position and attitude. The accuracy, recall, and F1 score of the detection model are all higher than 0.91, indicating that the model has a good recognition effect. Full article

The equator’s unique combination of high humidity and temperature renders optical satellite imagery highly susceptible to persistent cloud cover. In contrast, synthetic aperture radar (SAR) offers a robust alternative due to its ability to penetrate clouds with microwave imaging. This study addresses the challenges of cloud-induced data gaps and cross-sensor geometric biases by proposing an advanced optical and SAR image-matching framework specifically designed for cloud-prone equatorial regions. We use a prompt-driven visual segmentation model with automatic prompt point generation to produce cloud masks that guide cross-modal feature-matching and joint adjustment of optical and SAR data. This process results in a comprehensive digital orthophoto map (DOM) with high geometric consistency, retaining the fine spatial detail of optical data and the all-weather reliability of SAR. We validate our approach across four equatorial regions using five satellite platforms with varying spatial resolutions and revisit intervals. Even in areas with more than 50 percent cloud cover, our method maintains sub-pixel edging accuracy under manual check points and delivers comprehensive DOM products, establishing a reliable foundation for downstream environmental monitoring and ecosystem analysis. Full article

In recent years, automatic segmentation and classification of data from digital surveys have taken a central role in built heritage studies. However, the application of Machine and Deep Learning (ML and DL) techniques for semantic segmentation of point clouds is complex in the context of historic architecture because it is characterized by high geometric and semantic variability. Data quality, subjectivity in manual labeling, and difficulty in defining consistent categories may compromise the effectiveness and reproducibility of the results. This study analyzes the influence of three key factors—annotator specialization, point cloud density, and sensor type—in the supervised classification of architectural elements by applying the Random Forest (RF) algorithm to datasets related to the architectural typology of the Franciscan cloister. The main innovation of the study lies in the development of an advanced feature selection technique, based on multibeam statistical analysis and evaluation of the p-value of each feature with respect to the target classes. The procedure makes it possible to identify the optimal radius for each feature, maximizing separability between classes and reducing semantic ambiguities. The approach, entirely in Python, automates the process of feature extraction, selection, and application, improving semantic consistency and classification accuracy. Full article

Under the synergy of urban heritage conservation and regional cultural continuity, this study explores the spatial features of “mausoleum–city symbiosis” landscapes in Huangling County’s gully regions. Focusing on Fangzhou Ancient City, we address historical spatial degradation caused by excessive industrialization and disordered urban expansion. A methodological framework is proposed, combining low-altitude UAV-derived high-density point cloud data with RandLA-Net for semi-automatic semantic segmentation of buildings, vegetation, and roads by integrating multispectral and geometric attributes. Key findings reveal: (1) Modern buildings’ abnormal elevation in steep slopes disrupts the plateau–city visual corridor; (2) Statistical analysis shows significant morphological disparities between historical and modern streets; (3) Modern structures exceed traditional height limits, while divergent roof slopes aggravate aesthetic fragmentation. This multi-level spatial analysis offers a paradigm for quantifying historical urban spaces and validates deep learning’s feasibility in heritage spatial analytics, providing insights for balancing conservation and development in ecologically fragile areas. Full article

To address the challenges of automatic detection caused by the variation of surface normal vectors in automotive steering knuckles, an automatic detection method based on ultrasonic phased array technology is herein proposed. First, a point cloud model of the workpiece was constructed using ultrasonic distance measurement, and Gaussian-weighted principal component analysis was used to estimate the normal vectors of the point cloud. By utilizing the normal vectors, water layer thickness during detection, and the incident angle of the sound beam, the probe pose information corresponding to the detection point was precisely calculated, ensuring the stability of the sound beam incident angle during the detection process. At the same time, in the trajectory planning process, piecewise cubic Hermite interpolation was used to optimize the detection trajectory, ensuring continuity during probe movement. Finally, an automatic detection system was set up to test a steering knuckle specimen with surface circumferential cracks. The results show that the point cloud data of the steering knuckle specimen, obtained using phased array ultrasound, had a relative measurement error controlled within 1.4%, and the error between the calculated probe angle and the theoretical angle did not exceed 0.5°. The probe trajectory derived from these data effectively improved the B-scan image quality during the automatic detection of the steering knuckle and increased the defect signal amplitude by 5.6 dB, demonstrating the effectiveness of this method in the automatic detection of automotive steering knuckles. Full article

With the acceleration of urbanization, surface deformation monitoring has become crucial. Existing monitoring systems face several challenges, such as data singularity, the poor nighttime monitoring quality of video surveillance, and fragmented visual data. To address these issues, this paper presents a 3D real-scene (3DRS)-enhanced GNSS/intelligent vision surface deformation monitoring system. The system integrates GNSS monitoring terminals and multi-source meteorological sensors to accurately capture minute displacements at monitoring points and multi-source Internet of Things (IoT) data, which are then automatically stored in MySQL databases. To enhance the functionality of the system, the visual sensor data are fused with 3D models through streaming media technology, enabling 3D real-scene augmented reality to support dynamic deformation monitoring and visual analysis. WebSocket-based remote lighting control is implemented to enhance the quality of video data at night. The spatiotemporal fusion of UAV aerial data with 3D models is achieved through Blender image-based rendering, while edge detection is employed to extract crack parameters from intelligent inspection vehicle data. The 3DRS model is constructed through UAV oblique photography, 3D laser scanning, and the combined use of SVSGeoModeler and SketchUp. A visualization platform for surface deformation monitoring is built on the 3DRS foundation, adopting an “edge collection–cloud fusion–terminal interaction” approach. This platform dynamically superimposes GNSS and multi-source IoT monitoring data onto the 3D spatial base, enabling spatiotemporal correlation analysis of millimeter-level displacements and early risk warning. Full article

The rapid measurement of three-dimensional bridge geometric shapes is crucial for assessing construction quality and in-service structural conditions. Existing geometric shape measurement methods predominantly rely on traditional surveying instruments, which suffer from low efficiency and are limited to sparse point sampling. This study proposes a novel framework that utilizes an airborne LiDAR–camera fusion system for data acquisition, reconstructs high-precision 3D bridge models through real-time mapping, and automatically extracts structural geometric shapes using deep learning. The main contributions include the following: (1) A synchronized LiDAR–camera fusion system integrated with an unmanned aerial vehicle (UAV) and a microprocessor was developed, enabling the flexible and large-scale acquisition of bridge images and point clouds; (2) A multi-sensor fusion mapping method coupling visual-inertial odometry (VIO) and Li-DAR-inertial odometry (LIO) was implemented to construct 3D bridge point clouds in real time robustly; and (3) An instance segmentation network-based approach was proposed to detect key structural components in images, with detected geometric shapes projected from image coordinates to 3D space using LiDAR–camera calibration parameters, addressing challenges in automated large-scale point cloud analysis. The proposed method was validated through geometric shape measurements on a concrete arch bridge. The results demonstrate that compared to the oblique photogrammetry method, the proposed approach reduces errors by 77.13%, while its detection time accounts for 4.18% of that required by a stationary laser scanner and 0.29% of that needed for oblique photogrammetry. Full article

This paper describes a proposed method for preserving tangible cultural heritage by reconstructing a 3D model of cultural heritage using 2D captured images. The input data represent a set of multiple 2D images captured using different views around the object. An image registration technique is applied to configure the overlapping images with the depth of images computed to construct the 3D model. The automatic 3D reconstruction system consists of three steps: (1) Image registration for managing the overlapping of 2D input images; (2) Depth computation for managing image orientation and calibration; and (3) 3D reconstruction using point cloud and stereo-dense matching. We collected and recorded 2D images of tangible cultural heritage objects, such as high-relief and round-relief sculptures, using a low-cost digital camera. The performance analysis of the proposed method, in conjunction with the generation of 3D models of tangible cultural heritage, demonstrates significantly improved accuracy in depth information. This process effectively creates point cloud locations, particularly in high-contrast backgrounds. Full article