Search Results (64)

In target detection tasks equipped with depth sensors, it is crucial to adopt the point cloud pretreatment process, which is directly related to the quality of the obtained three-dimensional model of the target. However, there are few methods that can be combined with common preprocessing methods to quickly process ToF camera output. In real-life experiments, the common method is to adopt multiple types of preprocessing methods and adjust parameters separately. We proposed PcBD, a method that integrates outlier removal, boundary detection, and smooth sliders. PcBD does not limit the number of input points, and can remove outliers and predict smooth projection boundaries at one time while ensuring that the total number of points remains unchanged. We also introduced Bound57, a benchmark dataset that contains point clouds with synthetic noise, outliers, and projected boundary labels. Experimental results show that PcBD performs significantly better than state-of-the-art methods in various de-noising and boundary detection tasks. Full article

The intelligent extraction of highway assets is pivotal for advancing transportation infrastructure and autonomous systems, yet traditional methods relying on manual inspection or 2D imaging struggle with sparse, occluded environments, and class imbalance. This study proposes an enhanced MinkUNet-based framework to address data scarcity, occlusion, and imbalance in highway point cloud segmentation. A large-scale dataset (PEA-PC Dataset) was constructed, covering six key asset categories, addressing the lack of specialized highway datasets. A hybrid conical masking augmentation strategy was designed to simulate natural occlusions and enhance local feature retention, while semi-supervised learning prioritized foreground differentiation. The experimental results showed that the overall mIoU reached 73.8%, with the IoU of bridge railings and emergency obstacles exceeding 95%. The IoU of columnar assets increased from 2.6% to 29.4% through occlusion perception enhancement, demonstrating the effectiveness of this method in improving object recognition accuracy. The framework balances computational efficiency and robustness, offering a scalable solution for sparse highway scenes. However, challenges remain in segmenting vegetation-occluded pole-like assets due to partial data loss. This work highlights the efficacy of tailored augmentation and semi-supervised strategies in refining 3D segmentation, advancing applications in intelligent transportation and digital infrastructure. Full article

The precise extractions of tree components such as wood (i.e., trunk and branches) and leaves are fundamental prerequisites for obtaining the key attributes of trees, which will provide significant benefits for ecological and physiological studies and forest applications. Terrestrial laser scanning technology offers an efficient means for acquiring three-dimensional information on tree attributes, and has marked potential for extracting the detailed tree attributes of tree components. However, previous studies on wood–leaf separation exhibited limitations in unsupervised adaptability and robustness to complex tree architectures, while demonstrating inadequate performance in fine branch detection. This study proposes a novel unsupervised model (NE-PC) that synergizes geometric features with graph-based path analysis to achieve accurate wood–leaf classification without training samples or empirical parameter tuning. First, the boundary-preserved supervoxel segmentation (BPSS) algorithm was adapted to generate supervoxels for calculating geometric features and representative points for constructing the undirected graph. Second, a node expansion (NE) approach was proposed, with nodes with similar curvature and verticality expanded into wood nodes to avoid the omission of trunk points in path frequency detection. Third, a path concatenation (PC) approach was developed, which involves detecting salient features of nodes along the same path to improve the detection of tiny branches that are often deficient during path retracing. Tested on multi-station TLS point clouds from trees with complex leaf–branch architectures, the NE-PC model achieved a 94.1% mean accuracy and a 86.7% kappa coefficient, outperforming renowned TLSeparation and LeWos (ΔOA = 2.0–29.7%, Δkappa = 6.2–53.5%). Moreover, the NE-PC model was verified in two other study areas (Plot B, Plot C), which exhibited more complex and divergent branch structure types. It achieved classification accuracies exceeding 90% (Plot B: 92.8 ± 2.3%; Plot C: 94.4 ± 0.7%) along with average kappa coefficients above 80% (Plot B: 81.3 ± 4.2%; Plot C: 81.8 ± 3.2%), demonstrating robust performance across various tree structural complexities. Full article

UAV-Enabled Corridor Photogrammetry is applied to survey linear transport infrastructure projects’ sites. The corridor flight missions cause a misalignment of the point cloud called the “bowl” effect. The purpose of this study is to offer a methodology based on statistical compensation methods to mitigate this effect and to improve the accuracy and density of the generated point cloud. The aerial images’ post-processing was carried out by varying the aerotriangulation methods. Subsequently, the accuracy improvement was completed by integrating the coordinates of the ground control points (GCPs) through different spatial distributions. Finally, Mean and RANSAC compensations were proposed to address the errors induced by the “bowl” effect on the coordinates of the images’ perspective centres (PCs). The findings indicate that the optimised aerotriangulation using Post-Processed Kinematic (PPK) data significantly contribute to reducing the “bowl” effect. Moreover, the GCP pyramidal spatial distribution allows accuracy improvement to a centimetre level. The Mean compensation method yields optimal outcomes in accuracy. It also helps to optimise on-site survey time and computing resources. RANSAC compensation optimises the accuracy and allows the retrieval of a 5-times-denser point cloud. Furthermore, the results give better accuracy compared to some current approaches. Full article

This paper proposes a novel point cloud multi-scale completion algorithm guided by image rotation attention mechanisms to address the challenges of severe information loss and suboptimal fusion effects in multi-modal feature extraction and integration during point cloud shape completion. The proposed network employs an encoder–decoder structure, integrating a Rotating Channel Attention (RCA) module for enhanced image feature extraction and a multi-scale feature extraction method for point clouds to improve both local and global feature information. The network also utilizes multi-level self-attention mechanisms to achieve effective multi-modal feature fusion. The decoder employs a multi-branch completion method, guided by Chamfer distance loss, to accomplish the point cloud completion task. Extensive experiments on the ShapeNet-ViPC and ModelNet40ViPC datasets demonstrate the effectiveness of the proposed algorithm. Compared to eight related algorithms, the proposed method achieves superior performance in terms of completion accuracy and efficiency. Specifically, compared to the state-of-the-art XMFnet, the average Chamfer distance (CD) value is reduced by 11.71%. The algorithm also shows significant improvements in visual comparisons, with more distinct structural details and a more uniform density distribution in the completed point clouds. The ablation studies further validate the effectiveness of the RCA module and the multi-scale module, highlighting their complementary nature in enhancing point cloud completion accuracy. Future work will focus on improving the network’s performance and exploring its application in more complex 3D vision tasks. Full article

In order to detect the abrasion of rails, a new point cloud alignment method combining 4-points congruent sets (4PCS) coarse alignment based on internal shape signature (ISS) and K-dimensional iterative closest points (KD-ICP) fine alignment is proposed, and for the first time, the combined algorithm is applied to the detection of rail wear. Due to the large amount of 3D rail point cloud data collected by the 3D line laser sensor, the original data are first downsampled by voxel filtering. Then, ISS feature points are extracted from the processed point cloud data for 4PCS coarse alignment, and the feature points are quantitatively analyzed, which in turn provides good alignment conditions for fine alignment. Then, the K-dimensional tree structure is used for the near-neighbor search to improve the alignment efficiency of the ICP algorithm. Finally, the total rail wear is calculated by combining the fine alignment results with the wear calculation formula. The experimental results show that when the number of ISS feature points extracted is 4496, the 4PCS coarse alignment algorithm based on ISS feature points is higher than the original 4PCS algorithm as well as the other algorithms in terms of alignment accuracy; the ICP fine alignment algorithm based on the kd-tree is less than the original ICP algorithm as well as the other algorithms in terms of the time consumed. Further, the proposed new ISS-4PCS + KD-ICP two-stage point cloud alignment method is superior to the original 4PCS + ICP algorithm both in terms of alignment accuracy and runtime. The combined algorithm is applied to the detection of rail wear for the first time, which provides a reference for the non-contact rail wear detection method. The high accuracy and low time consumption of the proposed algorithm lays a good foundation for the calculation of rail wear in the next step. Full article

This meta-survey provides a comprehensive review of 3D point cloud (PC) applications in remote sensing (RS), essential datasets available for research and development purposes, and state-of-the-art point cloud compression methods. It offers a comprehensive exploration of the diverse applications of point clouds in remote sensing, including specialized tasks within the field, precision agriculture-focused applications, and broader general uses. Furthermore, datasets that are commonly used in remote-sensing-related research and development tasks are surveyed, including urban, outdoor, and indoor environment datasets; vehicle-related datasets; object datasets; agriculture-related datasets; and other more specialized datasets. Due to their importance in practical applications, this article also surveys point cloud compression technologies from widely used tree- and projection-based methods to more recent deep learning (DL)-based technologies. This study synthesizes insights from previous reviews and original research to identify emerging trends, challenges, and opportunities, serving as a valuable resource for advancing the use of point clouds in remote sensing. Full article

Precise aboveground biomass (AGB) estimation of forests is crucial for sustainable carbon management and ecological monitoring. Traditional methods, such as destructive sampling, field measurements of Diameter at Breast Height with height (DBH and H), and optical remote sensing imagery, often fall short in capturing detailed spatial heterogeneity in AGB estimation and are labor-intensive. Recent advancements in remote sensing technologies, predominantly Light Detection and Ranging (LiDAR), offer potential improvements in accurate AGB estimation and ecological monitoring. Nonetheless, there is limited research on the combined use of UAS (Uncrewed Aerial System) and Backpack-LiDAR technologies for detailed forest biomass. Thus, our study aimed to estimate AGB at the plot level for Picea crassifolia forests in eastern Qinghai, China, by integrating UAS-LiDAR and Backpack-LiDAR data. The Comparative Shortest Path (CSP) algorithm was employed to segment the point clouds from the Backpack-LiDAR, detect seed points and calculate the DBH of individual trees. After that, using these initial seed point files, we segmented the individual trees from the UAS-LiDAR data by employing the Point Cloud Segmentation (PCS) method and measured individual tree heights, which enabled the calculation of the observed/measured AGB across three specific areas. Furthermore, advanced regression models, such as Random Forest (RF), Multiple Linear Regression (MLR), and Support Vector Regression (SVR), are used to estimate AGB using integrated data from both sources (UAS and Backpack-LiDAR). Our results show that: (1) Backpack-LiDAR extracted DBH compared to field extracted DBH shows about (R² = 0.88, RMSE = 0.04 m) whereas UAS-LiDAR extracted height achieved the accuracy (R² = 0.91, RMSE = 1.68 m), which verifies the reliability of the abstracted DBH and height obtained from the LiDAR data. (2) Individual Tree Segmentation (ITS) using a seed file of X and Y coordinates from Backpack to UAS-LiDAR, attaining a total accuracy F-score of 0.96. (3) Using the allometric equation, we obtained AGB ranges from 9.95–409 (Mg/ha). (4) The RF model demonstrated superior accuracy with a coefficient of determination (R²) of 89%, a relative Root Mean Square Error (rRMSE) of 29.34%, and a Root Mean Square Error (RMSE) of 33.92 Mg/ha compared to the MLR and SVR models in AGB prediction. (5) The combination of Backpack-LiDAR and UAS-LiDAR enhanced the ITS accuracy for the AGB estimation of forests. This work highlights the potential of integrating LiDAR technologies to advance ecological monitoring, which can be very important for climate change mitigation and sustainable environmental management in forest monitoring practices. Full article

Currently, many digital elevation models (DEMs) are derived from airborne LiDAR data acquisition flights. The vertical accuracy of both products has typically been evaluated using methods based on randomly sampled control points. However, due to the superficial nature of the DEM, logic suggests that it is more appropriate to use a superficial object as an evaluation and control element, that is, a “control surface” or “control patch”. Our approach proposes a method for obtaining each patch from a georeferenced point cloud (PC) measured with a terrestrial laser scanner (TLS). In order to reduce the dilution of precision due to very acute angles of incidence that occur between the terrain and the scanner′s rays when it is stationed on a conventional tripod, a system has been created that allows the scanner to be placed face down at a height of up to 7 m. Stationing the scanner at that height also has the advantage of reducing shadow areas in the presence of possible obstacles. In our experiment, the final result is an 18 m × 18 m PC patch which, after resampling, can be transformed into a high-density (10,000 points/m²) and high-quality (absolute positional uncertainty < 0.05 m) DEM patch, that is, with a regular mesh format. This DEM patch can be used as the ground truth to assess the surface accuracy of DEMs (DEM format) or airborne LiDAR data acquisition flights (PC format). Full article

The dimensional quality inspection of prefabricated concrete (PC) elements is crucial for ensuring overall assembly quality and enhancing on-site construction efficiency. However, current practices remain heavily reliant on manual inspection, which results in high operator dependency and low efficiency. Existing Light Detection and Ranging (LiDAR)-based methods also require skilled professionals for scanning and subsequent point cloud processing, thereby presenting technical challenges. This study developed a 3D LiDAR system for the automatic identification and measurement of the dimensional quality of PC elements. The system consists of (1) a hardware system integrated with camera and LiDAR components to acquire 3D point cloud data and (2) a user-friendly graphical user interface (GUI) software system incorporating a series of algorithms for automated point cloud processing using PyQt5. Field experiments comparing the system’s measurements with manual measurements on prefabricated bridge columns demonstrated that the system’s average measurement error was approximately 5 mm. The developed system can provide a quick, accurate, and automated inspection tool for dimensional quality assessment of PC elements, thereby enhancing on-site construction efficiency. Full article

Three-dimensional (3D) applications lead the digital transition toward more immersive and interactive multimedia technologies. Point clouds (PCs) are a fundamental element in capturing and rendering 3D digital environments, but they present significant challenges due to the large amount of data typically needed to represent them. Although PC compression techniques can reduce the size of PCs, they introduce degradations that can negatively impact the PC’s quality and therefore the object representation’s accuracy. This trade-off between data size and PC quality highlights the critical importance of PC quality assessment (PCQA) techniques. In this article, we review the state-of-the-art no-reference (NR) objective quality metrics for PCs, which can accurately estimate the quality of generated and compressed PCs solely based on feature information extracted from the distorted PC. These characteristics make NR PCQA metrics particularly suitable in real-world application scenarios where the original PC data are unavailable for comparison, such as in streaming applications. Full article

This study presents an integrated system for object recognition, six-degrees-of-freedom pose estimation, and dexterous manipulation using a JACO robotic arm with an Intel RealSense D435 camera. This system is designed to automate the manipulation of industrial valves by capturing point clouds (PCs) from multiple perspectives to improve the accuracy of pose estimation. The object recognition module includes scene segmentation, geometric primitives recognition, model recognition, and a color-based clustering and integration approach enhanced by a dynamic cluster merging algorithm. Pose estimation is achieved using the random sample consensus algorithm, which predicts position and orientation. The system was tested within a 60° field of view, which extended in all directions in front of the object. The experimental results show that the system performs reliably within acceptable error thresholds for both position and orientation when the objects are within a ±15° range of the camera’s direct view. However, errors increased with more extreme object orientations and distances, particularly when estimating the orientation of ball valves. A zone-based dexterous manipulation strategy was developed to overcome these challenges, where the system adjusts the camera position for optimal conditions. This approach mitigates larger errors in difficult scenarios, enhancing overall system reliability. The key contributions of this research include a novel method for improving object recognition and pose estimation, a technique for increasing the accuracy of pose estimation, and the development of a robot motion model for dexterous manipulation in industrial settings. Full article

As a compression standard, Geometry-based Point Cloud Compression (G-PCC) can effectively reduce data by compressing both geometric and attribute information. Even so, due to coding errors and data loss, point clouds (PCs) still face distortion challenges, such as the encoding of attribute information may lead to spatial detail loss and visible artifacts, which negatively impact visual quality. To address these challenges, this paper proposes an iterative removal method for attribute compression artifacts based on a graph neural network. First, the geometric coordinates of the PCs are used to construct a graph that accurately reflects the spatial structure, with the PC attributes treated as signals on the graph’s vertices. Adaptive graph convolution is then employed to dynamically focus on the areas most affected by compression, while a bi-branch attention block is used to restore high-frequency details. To maintain overall visual quality, a spatial consistency mechanism is applied to the recovered PCs. Additionally, an iterative strategy is introduced to correct systematic distortions, such as additive bias, introduced during compression. The experimental results demonstrate that the proposed method produces finer and more realistic visual details, compared to state-of-the-art techniques for PC attribute compression artifact removal. Furthermore, the proposed method significantly reduces the network runtime, enhancing processing efficiency. Full article

This work focuses on investigating the accuracy of 3D reconstructions from fixed stereo-photogrammetric monitoring systems through different camera calibration procedures. New reliable and effective calibration methodologies that require minimal effort and resources are presented. A full-format camera equipped with fixed 50 and 85 mm focal length optics is considered, but the methodologies are general and can be applied to other systems. Four different calibration strategies are considered: (i) full-field calibration (FF); (ii) multi-image on-the-job calibration (MI); (iii) point cloud-based calibration (PC); and (iv) self (on-the-job) calibration (SC). To evaluate the calibration strategies and assess their actual performance and practicality, two test sites are used. The full-field calibration, while very reliable, demands significant effort if it needs to be repeated. The multi-image strategy emerges as a favourable compromise, offering good results with minimal effort for its realisation. The point cloud-based method stands out as the optimal choice, balancing ease of implementation with quality results; however, it requires a reference 3D point cloud model. On-the-job calibration with monitoring images is the simplest but least reliable option, prone to uncertainty and potential inaccuracies, and should hence be avoided. Ultimately, prioritising result reliability over absolute accuracy is paramount in continuous monitoring systems. Full article

Extracting moso bamboo parameters from single-source point cloud data has limitations. In this article, a new approach for extracting moso bamboo parameters using airborne laser scanning (ALS) and terrestrial laser scanning (TLS) point cloud data is proposed. Using the field-surveyed coordinates of plot corner points and the Iterative Closest Point (ICP) algorithm, the ALS and TLS point clouds were aligned. Considering the difference in point distribution of ALS, TLS, and the merged point cloud, individual bamboo plants were segmented from the ALS point cloud using the point cloud segmentation (PCS) algorithm, and individual bamboo plants were segmented from the TLS and the merged point cloud using the comparative shortest-path (CSP) method. The cylinder fitting method was used to estimate the diameter at breast height (DBH) of the segmented bamboo plants. The accuracy was calculated by comparing the bamboo parameter values extracted by the above methods with reference data in three sample plots. The comparison results showed that by using the merged data, the detection rate of moso bamboo plants could reach up to 97.30%; the R² of the estimated bamboo height was increased to above 0.96, and the root mean square error (RMSE) decreased from 1.14 m at most to a range of 0.35–0.48 m, while the R² of the DBH fit was increased to a range of 0.97–0.99, and the RMSE decreased from 0.004 m at most to a range of 0.001–0.003 m. The accuracy of moso bamboo parameter extraction was significantly improved by using the merged point cloud data. Full article