Next Article in Journal
Analysis Based on Computer Vision of Machined Surfaces by Hybrid Ultrasonic and Classic Electrical Discharge Machining of CoCr Alloys
Previous Article in Journal
The Design, Construction, and Experimental Validation of a Custom Linear Reciprocating Tribometer
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Intelligent Recognition and Trajectory Planning for Welds Grinding Based on 3D Visual Guidance

1
China Academy of Machinery Science and Technology, Beijing 100044, China
2
School of Mechanical Engineering, Beijing Institute of Petrochemical Technology, Beijing 102699, China
*
Author to whom correspondence should be addressed.
Machines 2026, 14(4), 393; https://doi.org/10.3390/machines14040393
Submission received: 13 March 2026 / Revised: 28 March 2026 / Accepted: 1 April 2026 / Published: 3 April 2026
(This article belongs to the Section Advanced Manufacturing)

Abstract

In the fabrication process of pipelines for petrochemical and other industries, weld reinforcement is often excessive and adversely affects subsequent processes such as anticorrosion treatment and surface coating. Weld reinforcement must be removed through a grinding process. Welding deformation and fit-up errors often lead to highly irregular weld geometries, which makes robotic grinding difficult and causes the task to still heavily rely on manual operation. To address this issue, this study proposes an automatic weld recognition and grinding trajectory planning method based on 3D visualization and deep learning. A weld recognition network, termed WSR-Net, has been developed based on an improved PointNet++ architecture with a cross-attention mechanism, achieving a segmentation accuracy of 98.87% and a mean intersection over union of 90.71% on the test set. An intrinsic shape signature (ISS) key point selection algorithm with orthogonal slicing-based pruning optimization is developed to robustly extract key weld ridge points that characterize the weld trend on rugged weld surfaces. According to the height differences between the weld and the adjacent base metal surfaces, the grinding reference surface is fitted using the weld contour through the moving least-squares method. The ridge line points are projected onto the grinding reference surface along the local normal to generate the expected grinding trajectory points. The grinding trajectory that meets the process constraints is generated through reverse layer slicing. Grinding experiments demonstrate that the proposed WSR-Net achieves robust segmentation performance for both planar and curved surface welds. With the reverse layered trajectory planning method, the proposed method enables high-precision automatic grinding of complex spatially curved surface welds. The results show that the final grinding mean error is 0.316 mm, which satisfies the preprocessing requirements for subsequent processes. The proposed method provides a feasible technical method for the intelligent grinding of spatially curved surface welds.

1. Introduction

In many industrial fields, including aerospace, shipbuilding, nuclear power, and petrochemicals, weld grinding has become a critical process to ensure the surface quality and facilitate subsequent operations, such as coating and anticorrosion treatments [1,2]. Taking the prefabrication of pipelines in the petrochemical industry as an example, the welding workload is substantial, and all-position welding is frequently required. Weld reinforcement often forms at overhead positions, where if it is not removed by grinding in a timely manner, it severely degrades coating adhesion and anticorrosion performance. Prefabricated pipelines are typically produced in small batches and are highly customized. The external geometric features of the weld seam are complex. The weld surface presents irregular waves, uneven protrusion heights and widths, and the weld trajectory is usually a three-dimensional path with changing directions and curvatures. Existing dedicated pipe-grinding devices often perform straight-line motions along a single weld and require manual installation; therefore, their applicability is limited by the pipe diameter range. Although six-degree-of-freedom industrial robots offer flexible motion capabilities, they still lack weld recognition and trajectory planning capabilities; consequently, weld grinding for prefabricated pipelines still mainly relies on manual operation.
With the rapid development of 3D vision technology, high-density surface point clouds can now be obtained relatively easily [3], which provides the basic conditions for the automatic grinding of complex welds. Research on weld recognition based on reverse engineering or geometric modeling has become a focus in robotic automatic work [4,5]. For point cloud feature extraction, representative local feature descriptors include point signatures [6], local feature size histograms (LFSH) [7], spin images [8,9], and 3D shape context [10], among others. When weld morphology is relatively regular, traditional methods can achieve high accuracy, but the point cloud data collected in industrial settings contains a large amount of noise and workpieces have the characteristics of small-batch customization. Once the working conditions change, the processing flow needs to be redesigned, and a large number of manual parameter adjustments for thresholds, filtering scales, and fitting templates are required, resulting in limited engineering adaptability.
Deep learning-based point cloud segmentation methods can learn multi-scale geometric features from unordered point sets and reduce the dependence on hand-crafted feature design. Representative architectures include PointNet/PointNet++, PointCNN, DGCNN, Point Transformer, KPConv, and SparseConvNet. PointNet and PointNet++ provide a simple and effective raw point set learning framework, though PointNet++ may still lose fine geometric details during hierarchical down-sampling [11,12]. PointCNN extracts local features through X-transformation-based point convolution; however, its architecture is relatively complex and may increase the computational cost in practical deployments [13]. DGCNN improves local structure modeling through dynamic graph construction and EdgeConv, but graph updating increases the computational burden [14]. Point Transformer enhances context aggregation through self-attention at the cost of higher memory and computational requirements [15]. KPConv performs convolution directly on irregular point sets and is effective for local geometry learning, but it is sensitive to neighborhood and kernel design [16]. SparseConvNet is efficient for voxelizing sparse data, yet voxelization may sacrifice local surface fidelity [17]. Therefore, considering segmentation accuracy, model complexity, and engineering practicality, PointNet++ has been selected as the backbone of the proposed weld recognition network, and further structural optimization has been carried out on this basis.
The most effective method for planning grinding operation trajectories is to directly extract key points that accurately represent the weld trend within the ROI and use spline curves to fit these key points to generate the machining path [18]. Feng et al. obtained key weld points by calculating the difference between the data before and after moving average filtering. The robot tool pose was estimated by implementing a principal component analysis (PCA) algorithm, with B-spline curves subsequently fitted to generate the grinding path [19,20]. Some researchers have obtained key trajectory points via octree slicing or the intersection of planes and point clouds [21]. Wu et al. [22] simultaneously generated the working position and contact direction based on B-spline curves, whereas Tong et al. [23] employed differences in the workpiece curvature to extract path points and improve the surface quality [24]. Beyond geometric accuracy and kinematic feasibility, robot trajectory planning should also account for engineering objectives such as execution time, energy consumption, and operational costs [25]. This perspective is consistent with the concept of Industry 5.0, which emphasizes sustainable manufacturing; in this context, optimizing robot motion trajectories and operating parameters can contribute to improved energy efficiency, reduced resource consumption, and lower production costs while maintaining process quality [26]. Therefore, it is of great significance to develop an efficient trajectory planning method for weld grinding that can accommodate the geometric complexity of weld surfaces while ensuring smooth surface continuity between the weld and the adjacent base metal after grinding.
To achieve automatic recognition of spatial welds and automatic grinding trajectory planning, a 3D vision-based weld recognition network and a trajectory planning module has been proposed. This paper is organized as follows: Section 2 provides an overview of the proposed framework. Section 3 describes the weld dataset construction process and the architecture of WSR-Net. Section 4 presents the reference surface-based reverse layer-wise trajectory planning method. Section 5 reports the results of the experimental validation.

2. An Overview of the Method

The method of the automatic weld grinding system mainly consisted of weld recognition and weld grinding trajectory planning, which is shown in Figure 1. The proposed automatic weld grinding method consisted of four components: (i) construction of a weld point cloud dataset to train the weld recognition network; (ii) design and training of a weld recognition network for weld ROI identification; (iii) generation of the grinding reference surface and reference path to define the target ground profile; and (iv) generation and pose optimization of the grinding trajectories to produce executable paths for robotic grinding work. The effectiveness of the proposed method was validated through the grinding experiments.

3. Weld Recognition

In order to eliminate the dependence of the traditional weld recognition method on manual parameter adjustment, a weld dataset and a weld recognition network were constructed to achieve automatic identification of the weld area.

3.1. Construction of the Weld Dataset

The welds considered in this study include planar welds and curved surface welds. Based on this, grinding workpieces of different sizes were collected. A total of 22 weld workpieces were selected, including 15 flat workpieces and seven prefabricated pipe fittings (6 and 8 inches in diameter), as shown in Figure 2. The grinding robot carried a 3D camera to collect point cloud data of the weld area from multiple angles. The acquired point clouds contained noise caused by the strong surface reflection and background interference under industrial conditions. In order to improve the quality of the point clouds, the background structure was first removed based on the plane fitting, and then the outliers were removed by statistical filtering.
To reduce the risk of overfitting and avoid data leakage, the dataset was constructed using a sample-wise split strategy. All point clouds acquired from different viewpoints of the same weld workpiece were assigned to only one subset (training, validation, or testing). Since point clouds captured from different viewing angles of the same workpiece differed in visible regions, point density distribution, and local geometric completeness, 20 viewpoints were collected for each of the 22 weld samples to increase data diversity. This resulted in 440 raw point clouds. Data augmentation, including random rotation, jittering, scaling, and point sampling, was applied only to the training set, and the final dataset contained 2200 point cloud samples. Among the 22 weld samples, 15 were planar welds and seven were curved surface welds, with pipe diameters of 6 and 8 inches. The 22 weld samples were split at the workpiece level into training, validation, and test sets in an 8:1:1 ratio to avoid data leakage across the subsets. This dataset was intended to validate the feasibility of the proposed method under representative planar and curved surface weld conditions rather than to claim broad generalization across all industrial weld types.

3.2. Weld Recognition Network

A weld recognition network, WSR-Net, was designed based on the PointNet++ framework, as shown in Figure 3.
Preprocessed point clouds were first fed into a shared MLP to embed the input coordinates into an initial feature space of [N, 32]. WSR-Net then adopted a PointNet++-style encoder–decoder architecture with four set abstraction (SA) layers [27], where features were transformed by local MLPs and aggregated by max pooling within each local neighborhood, producing hierarchical multi-scale features at [N/4, 64], [N/16, 128], [N/64, 256], and [N/256, 512]. The decoder consisted of four feature propagation (FP) layers that progressively up-sample and fuse contextually interpolating features from [N/64, 256], [N/16, 128], [N/4, 128], and [N, 128]. At each stage, the up-sampled features are concatenated with the corresponding encoder features and refined by the MLPs, with channel dimensions reduced to 256, 128, 128, and 128, yielding the final full-resolution feature map [N, 128].
A cross-attention module was integrated into the U-shaped PointNet++ backbone to improve the aggregation of point cloud information and segmentation accuracy, as depicted in Figure 3. Given the input point cloud F = { f 1 , f 2 , , f N } R N × C where N is the number of sampled points and C is the feature dimension of each point, three shared-MLP branches were first used to generate the query, key, and value embeddings. In the implementation, these branches were realized by three 1 × 1 convolutions. The query and key branches projected the input feature from 128 channels to 32 channels and shared the same projection weights, while the value branch preserved the original 128-channel representation. The affinity matrix was computed from the query and key features and normalized by Softmax, followed by an additional normalization step to stabilize the attention distribution. The resulting attention map was then used to aggregate contextual information from the value branch. The aggregated feature was further refined by a CBL block and fused with the original input through a residual correction pathway, producing the output feature set O i = { o 1 , o 2 , , o N } R N × C , defined as follows:
O i = F C B L F S o f t m a x K ^ i Q ^ i T V ^ i
where S o f t m a x denotes the normalized exponential function; represents matrix operations; and CBL denotes a Conv–BatchNorm–LeakyReLU block. This attention mechanism enhanced the aggregation of geometric features in the weld regions, thus improving the weld segmentation accuracy. Ultimately, the network learned to map between point cloud features and weld labels.
In the process of model training, the cross-entropy loss function [24] was employed to quantify the discrepancy between the prediction outcomes and the true labels:
C E ( y , y ^ ) = i = 1 n   y i l o g y ^ i
where n denotes the number of classes; y i represents the ground-truth label; and y ^ i is the predicted probability.
The trained WSR-Net was deployed for automatic weld ROI recognition. An example of the segmentation results is shown in Figure 4.

4. Weld Grinding Trajectory Planning Module

The recognized point cloud consisted of two components, the weld and the base metal—it cannot be directly used for robot grinding. Weld grinding can be regarded as a process of moving the grinding tool along the trajectory points that represent the weld morphology until the desired target surface has been reached; therefore, it was necessary to determine the grinding path points and the reference surface.

4.1. Generation of Weld Feature Points

To achieve a uniform and robust extraction of the weld ridge points under different weld morphologies, an ISS-based key point screening method with orthogonal slicing constraints was proposed. The standard ISS algorithm was first employed to identify geometrically salient points. Subsequently, the weld ridge points were explicitly defined as local maxima on cross-sectional planes orthogonal to the principal weld direction, thereby refining the selection stage and improving the accuracy and robustness of ridge point extraction.
(1)
ISS-based salient point screening
For each point p i in the weld ROI, a local neighborhood with radius r was established, and the covariance matrix C [28] of the neighborhood point set N { p i } was computed:
C = 1 N { p i } P j N { }   ( p j p μ ) ( p j p μ ) r ,             p μ = 1 N { p i } P j N { p i }   p j
By letting λ 1 ,   λ 2 ,   a n d   λ 3 denote the eigenvalues of C , the point set p i can be retained if the ratio of two consecutive feature values satisfies the following condition:
λ 2 λ 1 < γ 21 ,   λ 3 λ 2 < γ 32
where γ 21 and γ 32 are eigenvalue ratio thresholds that can be used to suppress non-salient or nearly isotropic points [29]. The resulting set of geometrically salient points can be denoted as C i s s .
(2)
Weld-oriented orthogonal slicing
To incorporate the geometric priors of the weld morphology, an orthonormal basis { v 1 ,   v 2 , v 3 } can be obtained via principal component analysis (PCA), where v 1 represents the global axial direction of the weld, and ( ν 2 , ν 3 ) span the cross-sectional plane.
For any point p in the set C i s s , the axial scalar can be defined as s = ( p j p μ ) ν 1 . Over the interval [ s m i n , s m a x ] , N cross-sections { s k } can be selected to construct thin slabs of thickness δ :
Π k = p N { p i } : | s p s k | δ
where all points in Π k are projected onto the transverse plane, and the ridge point in the k -th section is defined as the point with the maximum height along the v 3 direction:
r k = a r g   m a x p ϵ Π i   p j p μ ν 3
Collecting ridge points from all cross-sections can yield the ridge point set R = { r k } k = 1 N , which is finally sorted according to the axial coordinate to obtain the ridge points uniformly distributed along the weld surface, as shown in Figure 5.

4.2. Generation of the Grinding Reference Surface

As the base metal surfaces on both sides of the weld may exhibit misalignment and warping due to welding assembly errors and thermal distortion, the desired grinding target cannot be represented by a simple plane; therefore, a reference surface can be fitted from the contour and adjacent base metal regions. In this study, a reference surface was fitted from the edge points of the weld contour as the ultimate goal of the weld grinding.
Edge points were first extracted using an angle criterion. For each point p , the maximum normal angle θ m a x in its local neighborhood was computed; if θ m a x > ξ (threshold), p was classified as a contour point. The set of contour points P = { p 1 , p 2 , , p m } is shown in Figure 6.
The grinding reference surface was then fitted using moving least-squares (MLS) over the contour and adjacent base metal region. By letting p = x , y , z denote the query point at which the reference surface is evaluated, N p = { p i } i = 1 n denote the neighboring point cloud samples around p , and where p i = x i , y i , z i is the i -th neighboring point, the local height value of p i in the local fitting frame centered at p can be denoted by h i . The reference surface can then be expressed as:
F ^ ( p ) = j = 1 m   b j ( p ) a j ( p )
where m denotes the number of basis function terms; a j ( p ) denotes their corresponding coefficients; and b j ( p ) represents the basic functions. The cubic basis functions can be selected for b j ( p ) , which can be expressed as follows:
b T = ( 1 , x , y , z , x 2 , x y , x z , y 2 , y z , z 2 , x 3 , x 2 y , x 2 z , x y 2 , x y z , x z 2 , y 3 , y 2 z , y z 2 , z 3 )
The coefficient vector a j ( p ) can minimize the weighted least-squares objective:
a * ( p ) = a r g   m i n a   i = 1 n   w ( p p i 2 ) b ( p i ) a h i 2
where n is the number of neighboring point cloud samples around p ; h i is the local height value of the neighboring point p i ; and w ( p p i 2 ) is a smooth distance-based weight function. Inside the support domain, the weight is positive, whereas at and outside the support boundary, the weight becomes zero.
By substituting the optimal coefficient vector a * p into Equation (7), the fitted MLS reference surface can be written in an implicit form as:
F ( p ) = b ( p ) a * ( p ) = 0
The fitted surface (Figure 7) can serve as the global reference for the subsequent generation of the grinding trajectory.

4.3. Generation of the Grinding Trajectories

Due to the variation in the weld height, a reverse layer-wise trajectory generation strategy based on ridge point projection was proposed to ensure controllability of the grinding process. The desired grinding target points were first obtained by projecting ridge points onto the fitted reference surface. Reverse layer-wise offsetting was then performed from the target layer to the initial weld surface to generate the executable grinding trajectories.
For each ridge point, neighboring points in the non-weld region were searched within a fixed radius to estimate the local normal vector:
n i = ν i ν i
where ν i is the eigenvector corresponding to the minimum eigenvalue; and the normalized n i is the local normal vector [30].
The projection point on the reference surface was searched along the normal direction of each ridge point using the Newton iterative method. The iteration formula can be given by:
p k + 1 = p k F ^ T ( p k ) n 1 F ^ ( p k ) n
where p k is the current iteration point; n is the normal vector; F ^ T ( p k ) is the gradient of F ^ ( p ) at p k ; and F ^ T ( p k ) n is the directional derivative along the normal vector. The iteration terminates once the residual F ^ p k < ε . The final projection points q = { q 1 , q 2 , , q N ] of the ridge points set R on the reference surface are shown in Figure 8.
Assuming that the material removal rate of the grinding tool under the given operating conditions is Q 0 and the robot feed velocity is ν f , the k -th grinding layer must satisfy the constant material removal constraint:
Q 0 = A k ν f
The grinding cross-sectional area can be approximated as:
A k ω k , m a x a p , k
where ω k , m a x denotes the maximum weld width on the desired grinding surface at the k -th layer; and a p , k represents the grinding thickness at the location of maximum width for that layer. By sequentially solving the inter-layer grinding thickness that can satisfy the constant material removal constraint, stable control of material removal can be achieved throughout the multi-layer grinding process. The multi-layer grinding trajectories generated using the above offset-trajectory construction and feed-rate planning method are illustrated in Figure 9 and Figure 10.

5. Experiments and Discussion

The experimental platform, as shown in Figure 11, consisted of a SINSUN 210 six-degree-of-freedom industrial robot (SIASUN Robot & Automation Co., Ltd., Shenyang, China), a KW-DCW 3D camera (Suzhou 3DSWAY Intelligent Technology Co., Ltd., Suzhou, China), and an electric grinding tool with a detachable measurement module (Jiangsu Dongcheng Power Tools Co., Ltd., Qidong, China). The robot has a repeatability accuracy of 0.2 mm, and the camera provided a measurement accuracy of approximately 0.2 mm. The grinding tool was an angle grinder (rated power 1500 W, maximum speed 6000 r/min) equipped with a brazed diamond grinding disk with a diameter of 125 mm, a thickness of 6 mm, and a grit size of #36. The computer configuration included an Intel Core i5-13600 processor and an NVIDIA GeForce RTX 3090 graphics processing unit (GPU), which were responsible for point cloud processing, deep learning inference, and generating robot motion control instructions.

5.1. Weld Region Recognition Experiments

The WSR-Net was implemented in PyTorch 1.13.1 and trained for 200 epochs. Key hyperparameters such as the learning rate and batch size are listed in Table 1. The evolution of the loss function and accuracy during training is shown in Figure 12. Finally, the WSR-Net network achieved a segmentation accuracy of 98.87% and a mean intersection over union (mIoU) of 90.71% on the test set. As can be observed from the accuracy and mIoU curves, the model tended to stabilize after approximately 100 epochs, while the performance gained from further training was limited. To ensure sufficient convergence and to obtain the best performance under the adopted training setting, the total number of training epochs was set to 200.
To evaluate the segmentation performance of the proposed method, PointNet++, DGCNN, and Point Transformer were trained and tested on the same dataset under the same evaluation protocol, and the results are summarized in Table 2. PointNet++ was used as the primary baseline, while DGCNN and Point Transformer were introduced as representative graph-based and attention-based point cloud segmentation methods, respectively. By contrast, methods such as KPConv and SparseConvNet involved substantially different input representations or model-specific preprocessing and were therefore not included in the present benchmark.
As shown in Table 2, WSR-Net achieved an accuracy of 98.87% and the highest curved surface weld mIoU of 91.19%. Compared with PointNet++, WSR-Net improved the accuracy by 2.56 percentage points and the average mIoU by 1.02 percentage points, verifying the effectiveness of the introduced cross-attention module and the overall network optimization. Compared with DGCNN, WSR-Net achieved better results on all evaluation metrics. Compared with Point Transformer, WSR-Net obtained slightly higher accuracy and curved surface weld mIoU, while showing comparable performance in planar weld mIoU and average mIoU. These results indicated that the proposed method achieved competitive and robust segmentation performance under both planar and curved surface weld conditions.
To examine the effect of data augmentation, additional experiments were conducted under the same training settings with and without augmentation. As reported in Table 2, data augmentation increased the accuracy from 96.57% to 98.87% and the average mIoU from 88.05% to 90.71%. The planar weld mIoU and curved surface weld mIoU also increased from 87.76% to 90.23% and from 88.33% to 91.19%, respectively. These results demonstrated that the adopted augmentation strategy effectively improved sample diversity and enhanced the robustness and generalization capability of the proposed network.
The camera collected the point cloud data of the test weld workpiece and inputted the trained weld recognition network after preprocessing to obtain the segmentation result of the weld area. Examples of the weld recognition and segmentation for planar and curved surface welds are shown in Figure 13. WSR-Net accurately separated weld regions from the surrounding base metal areas. Under the default training setting used in this study, WSR-Net contained 1.771 million trainable parameters. The average inference time was 7.69 s per sample (the number of points is 60,000). These results indicated that the proposed network maintained a relatively low computational cost while achieving high segmentation accuracy.

5.2. Grinding Trajectory Generation

The effectiveness of the proposed trajectory planning module was evaluated from two perspectives: the accuracy of the ridge point generation and the height difference in the post-grinding surface. Owing to the relatively lower complexity of planar welds, the experimental evaluation in this study focused primarily on arc surface welds.
In the experiment of ridge point generation accuracy, the improved ISS algorithm proposed in this study was used to extract the ridge points. The parameters were set to γ 21 = 0.12 and γ 32 = 0.98, while the neighborhood radius was set to r = 5.3 mm. A detection method was used to measure the accuracy of the generated ridge points, and a dial indicator was installed at the end of the robot that moved along the circumferential direction of the weld. When the dial indicator reading reached its maximum at a location, the corresponding coordinate was recorded as the actual ridge point at that position, as illustrated in Figure 14.
The position deviations between the key generated ridge points and the key measured ridge points are shown in Figure 15.
By letting m i denote the actual ridge point coordinate at the i -th measurement point, g i as the generated ridge point coordinate, and n as the number of trajectory points, the mean error (ME) M e and root mean square error (RMSE) [31] can be defined as:
M e = i = 1 n ( m i g i ) n ,   R n s e = i = 1 n ( m i g i ) 2 n
Table 3 compares the performance of the proposed method with existing methods in terms of the mean error, root mean square error, and Euclidean distance error. The results showed that the proposed ridge generation method achieved an RMSE of 0.5 mm, which had obvious advantages in trajectory accuracy compared with similar methods, and confirmed its effectiveness and robustness in complex curved surface weld scenarios.

5.3. Weld Grinding Experiments Based on Trajectory Planning

In this subsection, a cylindrical weld grinding experiment was conducted. To evaluate the continuity of the weld surface after grinding, the height difference between the area after grinding and the adjacent base metal after grinding was analyzed by a dial gauge.
(1)
Grinding object and parameters
The grinding experiments were conducted using a rough grinding process on both planar and curved surface workpieces. The planar workpiece made of Q235 steel had a weld width of 13.47 mm and a reinforcement of 5.13 mm, while the curved surface workpiece made of X65 steel had a weld width of approximately 12.27 mm and a reinforcement of 4.47 mm. The feed speed was set to 3 mm/s for the Q235 workpiece and 2 mm/s for the X65 workpiece. The workpieces before and after grinding are shown in Figure 16. The planned grinding layer information using the reverse layer-wise trajectory generation strategy is summarized in Table 4.
(2)
Grinding accuracy evaluation
The grinding results are shown in Figure 16. A dial indicator was used to perform precise measurements at 50 positions on each side of the weld–base metal transition region after grinding. The mean and root mean square values of the height difference between the weld region and the two sides of the base metal were computed. The distribution of the height differences is shown in Figure 17.
Figure 17 summarizes the height differences between the welds surfaces after grinding and the base metal surfaces on the top of the two workpieces. For the two welds, the maximum height differences between the ground surfaces and the base metal were 0.36 mm and 0.40 mm, with corresponding root mean square errors of 0.295 mm and 0.316 mm. The experimental results showed that the proposed robotic automatic grinding method could stably remove the weld reinforcement from both the planar and curved surface workpieces.
The final residual height of the weld reinforcement after grinding was significantly smaller than the RMS of ridge detection. This indicated that the reverse layer-by-layer grinding trajectory planning strategy based on the reference surface could reduce the errors in the generated ridge points. The height difference between the base metal and surface after grinding was not significant, which showed that the grinding reference surface could effectively adapt to the height differences in the base metal on both sides of the weld.

6. Conclusions

A robotic automatic grinding method was proposed to robustly recognize the weld regions and automatically plan grinding trajectories. Some conclusions have been drawn as follows.
(1) A weld recognition and segmentation network, WSR-Net, was constructed to recognize and segment ROIs of both the planar and curved surface welds automatically. Experimental results showed that WSR-Net achieved an improvement in segmentation accuracy of approximately 2.13% compared with PointNet++.
(2) An ISS key point selection algorithm with orthogonal slicing constraints was proposed for path generation. Experimental results showed that the resulting ridge generation method achieved the RMSE of 0.5 mm.
(3) A reverse layer-wise grinding trajectory planning method based on a reference surface was proposed to address the issues of inconsistent weld reinforcement height differences on the base metal surface. Experimental results showed that the final grinding mean error was 0.316 mm, meeting the accuracy requirements for grinding of planar welds and prefabricated pipe welds.
The final post-grinding height error was lower than the RMSE of ridge point detection. This indicated that the reference surface-based reverse layer-wise trajectory planning strategy could mitigate the influence of the local ridge point extraction errors on the final grinding result. In addition, the small height difference between the ground weld region and the adjacent base metal suggested that the fitted reference surface could effectively accommodate base metal height inconsistencies on both sides of the weld.

Author Contributions

Conceptualization, methodology, P.Z.; software, validation, formal analysis, investigation, resources, data curation, P.Z. and L.X.; writing—original draft preparation, P.Z., L.X. and J.H.; writing—review and editing, P.Z., Y.Z. and F.H. All authors have read and agreed to the published version of the manuscript.

Funding

This work was supported by the National Key Research and Development Program of China (2023YFB3407700).

Data Availability Statement

Data are contained within the article.

Acknowledgments

The authors have reviewed and edited the output and take full responsibility for the content of this publication.

Conflicts of Interest

Author Pengrui Zhong was employed by the company China Academy of Machinery Science and Technology. The remaining authors declare that the research was conducted in the absence of any commercial or financial relation-ships that could be construed as a potential conflict of interest.

References

  1. Kurt, B.; Özdoğan, L.; Güney, B.; Bölükbaşı, Ö.S.; Günen, A. Characterization and wear behavior of TiBC coatings formed by thermo-reactive diffusion technique on AISI D6 steel. Surf. Coat. Technol. 2020, 385, 125332. [Google Scholar] [CrossRef]
  2. Güney, B. Microstructure analysis of welding fume of low and medium carbon steels. Rev. Metal. 2021, 57, e187. [Google Scholar]
  3. Zhu, D.; Feng, X.; Xu, X. Robotic grinding of complex components: A step towards efficient and intelligent machining—Challenges, solutions, and applications. Robot. Comput.-Integr. Manuf. 2020, 65, 101908. [Google Scholar] [CrossRef]
  4. Ge, J.; Deng, Z.; Li, Z.; Liu, W.; Zhuo, R.; Chen, X. Quantitative grinding depth model for robotic weld seam grinding systems. J. Manuf. Process. 2023, 89, 397–409. [Google Scholar] [CrossRef]
  5. Ge, J.; Deng, Z.; Li, Z.; Liu, T.; Zhuo, R.; Chen, X. Adaptive parameter optimization approach for robotic grinding of weld seam based on laser vision sensor. Robot. Comput.-Integr. Manuf. 2023, 82, 102540. [Google Scholar] [CrossRef]
  6. Zhang, H.; Wang, W.; Zhang, S.; Wang, Z.; Zhang, Y.; Zhou, J.; Huang, B. Point cloud self-supervised learning for machining feature recognition. J. Manuf. Syst. 2024, 77, 78–95. [Google Scholar] [CrossRef]
  7. Yang, J.; Cao, Z.; Zhang, Q. A fast and robust local descriptor for 3D point cloud registration. Inf. Sci. 2016, 346–347, 163–179. [Google Scholar] [CrossRef]
  8. Lee, E.T.; Fan, Z.A.; Sencer, B. A new approach to detect surface defects from 3D point cloud data with surface normal Gabor filter (SNGF). J. Manuf. Process. 2023, 92, 196–205. [Google Scholar] [CrossRef]
  9. Johnson, A.E.; Hebert, M. Using spin images for efficient object recognition in cluttered 3D scenes. IEEE Trans. Pattern Anal. Mach. Intell. 1999, 21, 433–449. [Google Scholar] [CrossRef]
  10. Wang, X.; Zhang, X.; Wang, S.; Zhang, J.; Yan, H.; Zhu, L. Optimal positioning of reference holes in forged turbine blades under adaptive point cloud registration based on robotic arm. J. Manuf. Process. 2025, 134, 285–298. [Google Scholar] [CrossRef]
  11. Qi, C.R.; Su, H.; Mo, K.; Guibas, L.J. PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA, 21–26 July 2017; pp. 77–85. [Google Scholar]
  12. Qi, C.R.; Yi, L.; Su, H.; Guibas, L.J. PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Space. In Advances in Neural Information Processing Systems 30, Proceedings of the 31st Conference on Neural Information Processing Systems (NIPS 2017), Long Beach, CA, USA, 4–9 December 2017; NIPS Foundation: San Diego, CA, USA, 2017; pp. 5099–5108. [Google Scholar]
  13. Li, Y.; Bu, R.; Sun, M.; Wu, W.; Di, X.; Chen, B. PointCNN: Convolution on X-transformed points. In Proceedings of the 32nd Conference on Neural Information Processing Systems (NeurIPS 2018), Montréal, QC, Canada, 3–8 December 2018. [Google Scholar]
  14. Wang, Y.; Sun, Y.; Liu, Z.; Sarma, S.E.; Bronstein, M.M.; Solomon, J.M. Dynamic graph CNN for learning on point clouds. ACM Trans. Graph. 2019, 38, 146. [Google Scholar] [CrossRef]
  15. Zhao, H.; Jiang, L.; Jia, J.; Torr, P.H.S.; Koltun, V. Point Transformer. In Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), Montreal, QC, Canada, 10–17 October 2021; pp. 16259–16268. [Google Scholar]
  16. Thomas, H.; Qi, C.R.; Deschaud, J.-E.; Marcotegui, B.; Goulette, F.; Guibas, L.J. KPConv: Flexible and Deformable Convolution for Point Clouds. In Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), Seoul, Republic of Korea, 27 October–2 November 2019; pp. 6411–6420. [Google Scholar]
  17. Graham, B.; van der Maaten, L. Submanifold Sparse Convolutional Networks. arXiv 2017, arXiv:1706.01307. [Google Scholar] [PubMed]
  18. Weingartshofer, T.; Bischof, B.; Meiringer, M.; Hartl-Nesic, C.; Kugi, A. Optimization-based path planning framework for industrial manufacturing processes with complex continuous paths. Robot. Comput.-Integr. Manuf. 2023, 82, 102516. [Google Scholar] [CrossRef]
  19. Zhang, G.; Wang, J.; Cao, F.; Li, Y.; Chen, X. 3D curvature grinding path planning based on point cloud data. In Proceedings of the 2016 12th IEEE/ASME International Conference on Mechatronic and Embedded Systems and Applications (MESA), Auckland, New Zealand, 29–31 August 2016; pp. 1–6. [Google Scholar]
  20. Ren, X.; Chen, G.; Wang, Z.; Sun, L. Polishing path planning based on point cloud. In Proceedings of the 2020 4th International Conference on Innovation in Artificial Intelligence (ICIAI 2020); Association for Computing Machinery (ACM): New York, NY, USA, 2020; pp. 222–228. [Google Scholar]
  21. Wang, G.; Cheng, J.; Li, R.; Chen, K. A new point cloud slicing based path planning algorithm for robotic spray painting. In Proceedings of the 2015 IEEE International Conference on Robotics and Biomimetics (ROBIO 2015), Zhuhai, China, 6–9 December 2015; pp. 1717–1722. [Google Scholar]
  22. Wu, H.; Zou, T.; Burke, H.; King, S.; Burke, B. A novel approach for porcupine crab identification and processing based on point cloud segmentation. In Proceedings of the 2021 20th International Conference on Advanced Robotics (ICAR 2021), Ljubljana, Slovenia, 6–10 December 2021; pp. 1101–1108. [Google Scholar]
  23. Tong, N.; Kong, M.; Xu, S. A spray path planning algorithm based on 3D point cloud. In Proceedings of the 2019 IEEE 3rd Advanced Information Management, Communicates, Electronic and Automation Control Conference (IMCEC), Chongqing, China, 11–13 October 2019; pp. 1112–1117. [Google Scholar]
  24. Ma, K.W.; Han, L.; Sun, X.X.; Liang, C.; Zhang, S.S.; Shi, Y.D.; Wang, X.S. A path planning method of robotic belt grinding for workpieces with complex surfaces. IEEE/ASME Trans. Mechatron. 2020, 25, 728–738. [Google Scholar] [CrossRef]
  25. Peta, K.; Wiśniewski, M.; Kotarski, M.; Ciszak, O. Comparison of single-arm and dual-arm collaborative robots in precision assembly. Appl. Sci. 2025, 15, 2976. [Google Scholar] [CrossRef]
  26. Peta, K.; Suszyński, M.; Wiśniewski, M.; Mitek, M. Analysis of energy consumption of robotic welding stations. Sustainability 2024, 16, 2837. [Google Scholar] [CrossRef]
  27. Wang, W.; Yun, C. A path planning method for robotic belt surface grinding. Chin. J. Aeronaut. 2011, 24, 520–526. [Google Scholar] [CrossRef]
  28. Lv, Y.; Peng, Z.; Qu, C.; Tang, X.; Li, X.; Wang, W. An adaptive trajectory planning algorithm for robotic belt grinding of blade leading and trailing edges based on material removal profile model. Robot. Comput.-Integr. Manuf. 2020, 66, 101987. [Google Scholar] [CrossRef]
  29. Pirotti, F.; Ravanelli, R.; Fissore, F.; Masiero, A. Implementation and assessment of two density-based outlier detection methods over large spatial point clouds. Open Geospat. Data Softw. Stand. 2018, 3, 14. [Google Scholar] [CrossRef]
  30. Alexa, M.; Behr, J.; Cohen-Or, D.; Fleishman, S.; Levin, D.; Silva, C.T. Computing and rendering point set surfaces. IEEE Trans. Vis. Comput. Graph. 2003, 9, 3–15. [Google Scholar] [CrossRef]
  31. Mineo, C.; Pierce, S.G.; Summan, R. Novel algorithms for 3D surface point cloud boundary detection and edge reconstruction. J. Comput. Des. Eng. 2019, 6, 81–91. [Google Scholar] [CrossRef]
  32. Geng, Y.; Lai, M.; Tian, X.; Xu, X.; Jiang, Y.; Zhang, Y. A novel seam extraction and path planning method for robotic welding of medium-thickness plate structural parts based on 3D vision. Robot. Comput.-Integr. Manuf. 2023, 79, 102433. [Google Scholar] [CrossRef]
Figure 1. Overview of weld recognition and grinding trajectory planning method.
Figure 1. Overview of weld recognition and grinding trajectory planning method.
Machines 14 00393 g001
Figure 2. Samples of welds. (a) Planar welds; (b) curved surface welds.
Figure 2. Samples of welds. (a) Planar welds; (b) curved surface welds.
Machines 14 00393 g002
Figure 3. Network structure of WSR-Net for weld recognition.
Figure 3. Network structure of WSR-Net for weld recognition.
Machines 14 00393 g003
Figure 4. Results of weld recognition. (a) Planar weld; (b) curved surface weld.
Figure 4. Results of weld recognition. (a) Planar weld; (b) curved surface weld.
Machines 14 00393 g004
Figure 5. Extraction of weld ridge points. (a) Planar weld; (b) curved surface weld.
Figure 5. Extraction of weld ridge points. (a) Planar weld; (b) curved surface weld.
Machines 14 00393 g005
Figure 6. Boundary extraction results. (a) Planar weld; (b) curved surface weld.
Figure 6. Boundary extraction results. (a) Planar weld; (b) curved surface weld.
Machines 14 00393 g006
Figure 7. The fitted grinding surfaces. (a) Planar weld; (b) curved surface weld.
Figure 7. The fitted grinding surfaces. (a) Planar weld; (b) curved surface weld.
Machines 14 00393 g007
Figure 8. Projection results of the ridge points on the grinding reference surface. (a) Planar weld; (b) curved surface weld.
Figure 8. Projection results of the ridge points on the grinding reference surface. (a) Planar weld; (b) curved surface weld.
Machines 14 00393 g008
Figure 9. Trajectory generation strategy through reverse layering.
Figure 9. Trajectory generation strategy through reverse layering.
Machines 14 00393 g009
Figure 10. The final grinding trajectories. (a) Planar weld; (b) curved surface weld.
Figure 10. The final grinding trajectories. (a) Planar weld; (b) curved surface weld.
Machines 14 00393 g010
Figure 11. Experimental robotic platform for weld grinding.
Figure 11. Experimental robotic platform for weld grinding.
Machines 14 00393 g011
Figure 12. Training results. (a) Class average mIoU; (b) segmentation accuracy.
Figure 12. Training results. (a) Class average mIoU; (b) segmentation accuracy.
Machines 14 00393 g012
Figure 13. Weld segmentation results. (a) Planar weld; (b) curved surface weld.
Figure 13. Weld segmentation results. (a) Planar weld; (b) curved surface weld.
Machines 14 00393 g013
Figure 14. Ridge point detection.
Figure 14. Ridge point detection.
Machines 14 00393 g014
Figure 15. The generated and measured ridge points. (a) Planar weld; (b) curved surface weld.
Figure 15. The generated and measured ridge points. (a) Planar weld; (b) curved surface weld.
Machines 14 00393 g015
Figure 16. Welds before and after grinding. (a) Planar weld; (b) curved surface weld.
Figure 16. Welds before and after grinding. (a) Planar weld; (b) curved surface weld.
Machines 14 00393 g016
Figure 17. Differences in height between the weld region and adjacent base metal.
Figure 17. Differences in height between the weld region and adjacent base metal.
Machines 14 00393 g017
Table 1. Hyperparameter settings for WSR-Net training.
Table 1. Hyperparameter settings for WSR-Net training.
ParametersPoint NumberLearning RateBatch SizeWeight DecayRate Decay
Value16,3840.001160.00040.5
Table 2. Comparison of segmentation performance.
Table 2. Comparison of segmentation performance.
NetworkAccuracyPlane mIoUCamber mIoUAverage mIoU
PointNet++96.31%89.21%90.18%88.695%
WSR-Net98.87%90.23%91.19%90.71%
DGCNN 96.48%89.27%90.24%89.75%
Point Transformer98.62%90.32%91.16%90.74%
WSR-Net (No data enhancement)96.57%87.76%88.33%88.05%
Table 3. Accuracy analysis of ridge point generation.
Table 3. Accuracy analysis of ridge point generation.
SampleError TypeY (mm)Z (mm)Euclidean Distance
Geng [32]ME0.950.791.53
RMSE0.680.360.99
OursME0.240.410.49
RMSE0.260.430.50
Table 4. Information on grinding layer planning.
Table 4. Information on grinding layer planning.
LayerPlanar WeldCurved Surface Weld
Width/mmThickness/mmWidth/mmThickness/mm
17.381.036.180.71
28.460.937.60.46
39.670.458.50.38
410.550.399.180.33
511.070.329.70.28
611.410.2710.10.26
711.760.2310.50.25
812.040.210.80.23
912.270.211.10.22
1012.500.1911.340.21
1112.750.1911.550.20
1212.980.1911.750.20
1313.270.1811.90.19
1413.400.1812.10.19
1513.470.1812.20.18
1612.270.18
— = not applicable.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Zhong, P.; Xue, L.; Huang, J.; Zou, Y.; Han, F. Intelligent Recognition and Trajectory Planning for Welds Grinding Based on 3D Visual Guidance. Machines 2026, 14, 393. https://doi.org/10.3390/machines14040393

AMA Style

Zhong P, Xue L, Huang J, Zou Y, Han F. Intelligent Recognition and Trajectory Planning for Welds Grinding Based on 3D Visual Guidance. Machines. 2026; 14(4):393. https://doi.org/10.3390/machines14040393

Chicago/Turabian Style

Zhong, Pengrui, Long Xue, Jiqiang Huang, Yong Zou, and Feng Han. 2026. "Intelligent Recognition and Trajectory Planning for Welds Grinding Based on 3D Visual Guidance" Machines 14, no. 4: 393. https://doi.org/10.3390/machines14040393

APA Style

Zhong, P., Xue, L., Huang, J., Zou, Y., & Han, F. (2026). Intelligent Recognition and Trajectory Planning for Welds Grinding Based on 3D Visual Guidance. Machines, 14(4), 393. https://doi.org/10.3390/machines14040393

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop