Next Article in Journal
Enhancing Cross-Prompt Essay Trait Scoring via External Knowledge Similarity Transfer
Previous Article in Journal
Threshold Fully Homomorphic Encryption Scheme Based on NGS of Symmetric Encryption
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Handheld 3D Scanning-Based Robotic Trajectory Planning for Multi-Layer Multi-Pass Welding of a Large Intersecting Line Workpiece with Asymmetric Profiles

1
State Key Laboratory of Precision Welding & Joining of Materials and Structures, Harbin Institute of Technology, Harbin 150001, China
2
School of Mechanical and Electrical Engineering, Harbin Institute of Technology, Harbin 150001, China
*
Author to whom correspondence should be addressed.
Symmetry 2025, 17(5), 738; https://doi.org/10.3390/sym17050738
Submission received: 15 April 2025 / Revised: 1 May 2025 / Accepted: 7 May 2025 / Published: 11 May 2025
(This article belongs to the Special Issue Symmetry Application in Metals and Alloys)

Abstract

:
Traditional offline programming has limitations for large parts with significant machining or assembly deviations. This study proposes a 3D scanning-assisted method that generates accurate STereoLithography (STL) models and enables multi-layer multi-bead welding trajectory planning for large intersecting line workpieces. The proposed framework implements a robust STL model processing pipeline incorporating Random Sample Consensus (RANSAC)-based cylindrical approximation, cross-sectional slicing, and automated feature detection to achieve high-precision groove feature recognition. For asymmetric variable-section grooves, a multi-layer and multi-pass path-planning algorithm based on template affine projection transformation is developed to ensure accurate deposition of welds along complex geometric contours. Experimental validation demonstrates sub-millimeter trajectory accuracy (positional errors < 1.0 mm), meeting stringent arc welding specifications and substantially expanding the applicability of offline programming systems.

1. Introduction

The geometric profile and penetration depth of intersecting line welds in large double-curvature penetration structures exhibit spatial dependency. In thick-walled components with extensive groove dimensions, the substantial cross-sectional area requires systematic multi-layer multi-pass deposition. Conventional manual welding has several issues. These include high labor intensity, low productivity, and inconsistent joint quality caused by differences in operator skills. As a result, robotic welding systems have become a viable technological solution [1,2]. The core technical challenge in robotic welding implementation lies in trajectory planning for the welding torch [3,4]. Currently, robotic welding systems predominantly employ three operational paradigms: teach-and-repeat, offline programming, and sensor-assisted guidance [5].
Conventional teach-and-repeat approaches exhibit limitations in programming large intersecting line welds with variable profiles, which are characterized by labor-intensive teaching processes, low efficiency, and trajectory instability due to human operator dependencies. Sensor-driven autonomous trajectory planning has emerged as a prominent research frontier, with two dominant technical paradigms: line-structured light guidance systems [6,7] and raster-stereo vision configurations [8].
In the field of line-structured light guidance systems, J. Fan et al. [9] developed a laser vision sensor with additional Light Emitting Diode (LED) lights for narrow seam welding, which solves the challenges of initial point alignment and seam tracking caused by insignificant laser stripe deformation in narrow seams through extracting weld feature points combined with visual models to obtain 3D coordinates. Researchers led by J. Gao et al. [10] employed line-structured light technology to accurately extract weld position and gap features, providing crucial support for autonomous sensor path planning. Y. Zou et al. [11] proposed a robotic seam tracking system integrating lightweight segmentation network design with ADMM-structured pruning, ensuring stable torch operation under strong interference. Wang et al. [12] established a structured light vision system capable of identifying initial welding points for fillet welds. Liu et al. [13] developed a novel sensor that locates initial weld points using combined information from crossed and parallel laser stripes, enhancing system adaptability to irregular workpieces.
Regarding line-structured light guidance systems, to overcome the inefficiency of conventional teaching programming, Zhang’s team [14] developed a robot path-planning approach based on 3D visual guidance. Geng et al. [15] obtained welding paths through multi-view point cloud stitching for complex main-intersection pipelines. Fang [16] proposed a welding trajectory-planning method combining non-rigid point cloud registration with 3D model offline processing. Liu et al. [17] employed deep learning networks combined with symbolic splicing to plan welding trajectories. Ma et al. [18] proposed a deep neural network-based method for weld type recognition and initial point guidance, significantly enhancing the intelligence level of welding robots.
Researchers worldwide have carried out numerous studies on two methodologies—line-structured laser guidance and raster-based stereoscopic vision—within the domain of self-planning welding path sensors. The former focuses on seam tracking and initial weld point localization. However, its detection capabilities are largely limited to specific welding conditions, showing inadequate adaptability to complex and diverse working scenarios. Additionally, the complex detection equipment at the torch end is susceptible to arc light and spatter interference, resulting in system instability. The latter primarily involves constructing vision systems for different workpieces to plan paths, acquiring surface morphology information for welding trajectory planning. However, when handling irregular workpiece placement and environmental interference, technical immaturity issues persist, requiring improved adaptability to diverse scenarios. To summarize, sensor guidance technology remains relatively immature with poor adaptability.

Related Work

Using robot offline programming software for welding path planning of large saddle-shaped seams proves to be a highly effective approach. The template matching-based weld recognition method simplifies complex image processing procedures by constructing Computer-Aided Design (CAD) models and comparing them with point cloud data to obtain required weld seams and their characteristics.
Geng et al. [19] proposed a 3D vision-based method for robotic welding of medium-thickness plates, using improved RANSAC to fit point cloud planes and extract weld seams via intersecting line analysis. The approach integrates geometric feature-based seam extraction for three structural models, combined with welding path planning according to seam spatial structure and a dihedral-based posture planning method, enabling teach-free automation. While effective for medium-thickness plate structures, the method’s multi-layer multi-pass path-planning algorithm relies on predefined geometric constraints, limiting flexibility in adapting to complex, variable cross-sectional weld profiles.
Curiel et al. [20] introduced a symmetry-driven algorithm for tool path selection in robotic welding, leveraging profile scanning and CAD model integration. This method optimizes torch orientation and bead placement for thick-walled components with non-uniform grooves, enhancing efficiency in gas metal arc welding. However, their approach assumes symmetric joint configurations, which may not generalize to the asymmetric multi-layer multi-pass welds typical of large intersecting line workpieces.
Arko and Jezeršek [21] presented an automated calibration procedure for 3D scanner-robot systems, achieving sub-0.06 mm accuracy through Powell’s optimization algorithm. This method ensures precise alignment between the scanner and robot coordinate systems, which is critical for adaptive welding of thick pipes and thin sheets. While their calibration framework enhances system stability, it does not explicitly address geometric feature extraction from scanned data.
Lei et al. [22] proposed a row–column grayscale segmentation method to extract cross-sectional weld bead morphology, enabling quantitative assessment of contour and area with <10% error. This technique complements our trajectory-planning pipeline by providing post-weld quality insights. However, their focus is on offline analysis rather than real-time path adaptation.
Zhao et al. [23] advanced the field by specifically targeting intersecting pipe structures, introducing a planning algorithm that accounts for spatial geometric constraints during multi-layer deposition. Their approach emphasizes kinematic optimization and groove profile analysis to generate collision-free paths, demonstrating improved accuracy for symmetric intersecting joints compared to traditional teach-and-repeat methods. However, this methodology exhibits limitations in handling asymmetric profiles and manufacturing tolerances, as it relies on idealized CAD models for initial path generation. In scenarios with significant assembly deviations, which are common in large-scale weldments like shipbuilding components, pre-defined geometric assumptions may lead to trajectory mismatches, compromising weld quality.
Neto and Mendes [24] investigated the data-mapping process from virtual CAD models to real-world environments for automated robot path and program generation. Wang et al. [25] innovatively integrated CAD model information with visual data, establishing new perspectives for enhancing the flexibility and reliability of spot-welding robot systems. Fu et al. [26] proposed a template-based identification framework for aerospace components that integrates Hausdorff distance metrics with Monte Carlo simulations, optimizing template candidate screening processes. The research team under Zheng et al. [27] introduced an integrated offline programming strategy that synergizes CAD modeling, visual perception, and their mutual interactions, markedly enhancing robotic welding performance in terms of productivity, accuracy, and adaptability for intricate workpieces.
However, conventional offline programming methodologies exhibit three critical limitations:
  • Reliance on idealized CAD models, neglecting actual manufacturing tolerances during path generation;
  • Omission of assembly-induced positional discrepancies between components;
  • Suboptimal bead-sequencing strategies in multi-layer multi-pass welding, especially when handling variable-profile joint configurations.
These issues are particularly pronounced in large-scale weldments for non-high-precision applications such as shipbuilding and construction [28,29,30], where manufacturing tolerances vary substantially with production techniques and temporary tack-welded assemblies introduce stochastic positional variations. Consequently, robot trajectories generated from nominal CAD models prove non-executable in practical welding operations.
To address these challenges, a handheld 3D scanning system with superior metrological performance is implemented, outperforming raster-stereo vision systems in both accuracy and angular adaptability. An adaptive multi-layer multi-pass deposition algorithm is proposed, integrating model slicing, geometric feature extraction, and projective transformation-based bead sequencing for variable-profile groove welding. Sensor-derived 3D digital models enable more accurate path generation than conventional CAD-based offline programming, particularly for components with manufacturing variances. The proposed methodology extends the applicability of offline programming systems, demonstrating critical advancements in robotic welding applications with geometric uncertainties.

2. Materials and Methods

Figure 1 illustrates the proposed path-planning framework, which operates through eight sequential processing stages:
  • Acquisition of as-built component geometry using a handheld 3D scanning system, generating STL models, dense point clouds, and fiducial marker coordinates for spatial registration;
  • Implementation of RANSAC-based cylindrical fitting to establish the central branch pipe axis, followed by Euclidean distance thresholding for point cloud segmentation. This preprocessing stage eliminates geometrically irrelevant data points, optimizing computational load for subsequent operations;
  • Generation of a cutting plane around the pipeline axis and reconstruction of the topology of the disordered STL mesh, followed by calculation of the intersection of the cutting plane and the STL model to obtain the groove section;
  • Accurate extraction of groove feature points by straight line fitting and compensation of missing feature points by spatial interpolation of adjacent cross-sectional data;
  • To solve the geometric asymmetry and manufacturing tolerance problems of intersecting welds, a multi-layer and multi-pass adaptive arrangement of welds is implemented based on template affine projection transformation. This method can adapt to the changes in the cross-sectional profiles of different welding areas while maintaining the consistency of the weld pattern. This will be described in detail in Section 2.3;
  • According to the planned cross-sectional sequence, the welding trajectory is generated according to the path on the groove and then transferred to the offline programming environment. Finally, an executable program is generated;
  • Virtual simulation motion is performed through kinematic simulation, which can verify the robot’s accessibility and eliminate the risk of collision before actual application;
  • To carry out coordinate system transformation, this paper generates corresponding user coordinate systems in the actual robot system and offline programming system according to the scanning positioning points and generates robot execution files in this coordinate system to complete the path planning of multi-layer and multi-pass offline programming of a large saddle-shaped welding workpiece.
The core technologies of this paper include STL model slicing, geometric feature extraction, and adaptive path planning based on template affine projection, which constitute the important components of the proposed 3D scanning-driven welding framework.

2.1. Scanned STL Model Slicing

To efficiently extract groove profiles from cutting planes, STL model slicing is implemented. The inherent disorder of triangular facet representations necessitates computationally intensive operations, including full facet traversal for intersection detection and subsequent segment ordering—processes that are particularly inefficient for dense scanning-derived STL models. Scanning-acquired STL models with ultra-dense facet distributions (typically in the tens of millions) exacerbate computational complexity, as brute-force traversal algorithms yield unordered intersection segments with O(n) time complexity. To address these issues, the following topological optimization was implemented on the STL structure, as illustrated in Figure 2.
The optimization algorithm runs through five steps, as shown in Figure 3:
  • Read the STL model and optimize the topology structure: First, the unordered triangles will be sorted into point set, line set, face set. The point object contains x, y, and z coordinate information and a flag flagPoint used to record the positional relationship with the plane; the edge object contains the two vertex pointers pt1 and pt2 that constitute the edge and the pointers face1 and face2 of the two triangles to which the edge belongs, as well as a flag flagEdge used to mark whether it intersects with the plane. Each face object contains the pointers edge_AB, edge_AC, and edge_BC that constitute the three edges of the triangle.
  • Determine the positional relationship: Traverse the point set and implement the CalPointFlag method in sequence to calculate the positional relationship between all points and the plane (i.e., on the plane, in the plane, and under the plane) and record them.
  • Generate the intersected edge set: Traverse the line set and implement the CalEdgeFlag method in sequence to calculate whether the line intersects with the plane. If the flagPoint attribute values of the two endpoints of the line are different, it is determined to be intersecting.
  • Construct an ordered intersected edge list: Randomly find an intersecting edge, use the FindAnotherInsectionEdge method of its member face1, find another edge in face1 that intersects with the plane, and record it as edgeNew. Then, use the FindAnotherInsectionFace method of edgeNew to find one of the two triangles to which edgeNew belongs that is not face1. Repeat this cycle until this edge is a boundary, and obtain an edge chain. Repeat the above steps until all intersecting edges have been calculated, and obtain multiple edge chains.
  • Obtain the sequence of intersection lines: Traverse the edge chain, calculate the intersection points of the edge and the triangle, and connect the intersection points in sequence to obtain a contour.
With this method, only the triangles that actually intersect the slice surface need to be traversed during one slicing process. At the same time, the obtained path segments are ordered, which is convenient for subsequent processing. The slicing effects on workpiece STL models through these steps are shown in Figure 4, the greyscale parts in the picture are the scanned model, and the red line is the calculated intersection line.
In order to quantitatively describe the efficiency of the algorithm, the actual slicing time and effect of three STL models with different densities are statistically analyzed with or without topological structure optimization, as shown in Table 1. It can be seen that topological structure optimization can significantly reduce the slicing time. When multiple slicing operations are performed on a model with a large number of triangles, the calculation time can be significantly shortened.

2.2. Feature Point Identification

After obtaining cross-sectional contours, geometric feature identification is required for subsequent multi-layer multi-pass bead arrangement. For intersecting line welds, the narrow gap relative to the workpiece and highly reflective machined groove surfaces lead to scanning data loss near grooves when using handheld 3D scanners. Additionally, temporary tack-welding on large components causes groove information loss, as shown in Figure 5.
Therefore, to achieve more accurate and stable feature point localization, this study employs least squares fitting of groove contours rather than inflection point detection through segment slope variations. Figure 6 defines four characteristic points (Pt1, Pt2, Pc1, Pc2), and the intersection line welding groove is approximated by a quadrilateral.
The definition and fitting procedures for feature points are as follows:
  • Generate points with uniform distance distribution on the cross-sectional contour composed of ordered line segments.
  • First, calculate the equation of the straight line at the intersection of the cross-section and the branch pipe, use the Hough line transform algorithm to extract the straight line in the cross-sectional contour, and select the straight line l according to the angle range between the straight line and the cylinder axis of the branch pipe.
  • Calculate the distance from all other points on the contour to the straight line l. According to the design size of the groove, it is easy to find three distance intervals to ensure that the points in the corresponding distance intervals are at the main pipe, the main area of the groove, and the tongue area of the groove. Then, use the least squares method to fit the straight line to obtain l1, l2, and l3 respectively.
  • Calculate intersections of l1l2 and l2l3 as Pt1 and Pt2. Project these points onto line l to obtain Pc1 and Pc2. The quadrilateral formed by these four points effectively describes the groove morphology.
In order to mitigate the disappearance or error of feature positioning due to missing scan information, spline-based interpolation is used to correct data gaps and position errors. The final feature recognition results shown in Figure 7 demonstrate robust performance, and the groove features can be stably detected despite the presence of point cloud defects and spot-welding interference.
The definition and fitting procedures for feature points are as follows:
  • Generate points with uniform distance distribution on the cross-sectional contour composed of ordered line segments.
  • First, calculate the equation of the straight line at the intersection of the cross-section and the branch pipe, use the Hough line transform algorithm to extract the straight line in the cross-sectional contour, and select the straight line l according to the angle range between the straight line and the cylinder axis of the branch pipe.
  • Calculate the distance from all other points on the contour to the straight line l. According to the design size of the groove, it is easy to find three distance intervals to ensure that the points in the corresponding distance intervals are at the main pipe, the main area of the groove, and the tongue area of the groove. Then, use the least squares method to fit the straight line to obtain l1, l2, and l3, respectively.
  • Calculate intersections of l1l2 and l2l3 as Pt1 and Pt2. Project these points onto line l to obtain Pc1 and Pc2. The quadrilateral formed by these four points effectively describes the groove morphology.
In order to mitigate the disappearance or error of feature positioning due to missing scan information, spline-based interpolation is used to correct data gaps and position errors. The final feature recognition results shown in Figure 6 demonstrate robust performance, and the groove features can be stably detected despite the presence of point cloud defects and tack-welding interference.

2.3. Multi-Layer Multi-Pass Bead Arrangement and Planning Algorithm for Asymmetric Grooves

As shown in Figure 8, the groove angles (∠A, ∠B, ∠C) vary across different positions of intersecting line welds. This requires weld torch posture to be planned differently for robotic welding at various spatial locations on the saddle-shaped surface.
The saddle-shaped geometry induces depth variations along the weld path, resulting in continuously changing cross-sectional profiles and areas, as shown in Figure 9. Comparative cross-sectional views at positions A-A, B-B, and C-C reveal significant profile differences, necessitating multi-pass weld path planning with multiple layers on the varying cross-sections.
Current automatic planning algorithms (with constant height and constant area) use deposit height and volume to generate paths. However, complex spatial welds that require all-position welding processes usually rely on empirical weld bead arrangements derived through trial and error. According to the above analysis, the cross-sectional shapes of the grooves at different positions of saddle welds are not strictly equal, that is, the weld bead on the planned coordinate system cannot be mapped to the actual groove position only through rigid transformations such as rotation and translation. This study introduces an adaptive planning algorithm based on a template affine projection transformation that can be determined by engineers, which can adapt to cross-sectional changes in multi-layer and multi-pass weld workpieces.
Figure 10 compares rigid transformation (rotation/translation) with affine projection results. Rigid transformations fail to accommodate groove shape changes, while affine projection maintains bead pattern similarity. The specific implementation steps of the algorithm are as follows.
First, a local coordinate system X-O-Y is established on groove cross-sections (Figure 11). Characteristic points pt1(x1, y1), pt2(x2, y2), pc1(x3, y3), pc1(x4, y4) are determined from K-type groove dimensions. Beads are uniquely defined by 2D coordinates and angles relative to the X-axis. Since the groove feature points (Pt1, Pt2, Pc1, Pc2) obtained by slicing and fitting are three-dimensional coordinates in the three-dimensional coordinate system of the model, and the template is established in a two-dimensional plane, the coordinate dimensions are different and cannot be directly transformed through transmission. To this end, the groove section should be rotated to a surface parallel to the X-O-Y plane in the three-dimensional coordinate system, so that its z-axis value becomes the same value. Ignoring the dimension of the z-axis, this transformation matrix can be calculated through the normal of the groove section and will not be repeated here. Suppose the coordinates of the groove feature points after rotation transformation are Pt1(x1′, y1′, C), Pt2(x2′, y2′, C), Pc1(x3′, y3′, C), Pc1(x4′, y4′, C), where C is an arbitrary constant. Let H denote the affine transformation matrix from the template coordinate system to the groove coordinate system, which can be expressed as
H = h 1 h 2 h 3 h 4 h 5 h 5 h 7 h 8 1 ,
The matrix components are determined through linear system solution:
x 1 0 x 2 0 x 3 0 x 4 0 y 1 0 y 2 0 y 3 0 y 4 0 1 0 1 0 1 0 1 0 0 x 1 0 x 2 0 x 3 0 x 4 0 y 1 0 y 2 0 y 3 0 y 4 0 1 0 1 0 1 0 1 x 1 x 1 y 1 x 1 x 2 x 2 y 2 x 2 x 3 x 3 y 3 x 3 x 4 x 4 y 4 x 4 x 1 y 1 y 1 y 1 x 2 y 2 y 2 y 2 x 3 y 3 y 3 y 3 x 4 y 4 y 4 y 4 h 1 h 2 h 3 h 4 h 5 h 6 h 7 h 8 = x 1 y 1 x 2 y 2 x 3 y 3 x 4 y 4 ,
Vector-described beads in spatial groove sections require additional direction parameters to fully define the robot pose. In offline programming systems, a coordinate system (tag point) uniquely defines the robot pose. This study uses section plane normals as the Y-axis, bead vectors as torch axes, and vector origins as coordinate system origins. Figure 12 shows (a) a 2D bead pattern template; (b) projection-mapped beads on actual grooves; and (c) corresponding tag points in offline programming.

2.4. Coordinate System Calibration

Since the model is acquired by a handheld 3D scanner, all current operations are performed in the model coordinate system established based on the camera coordinate system of the first frame scan, and the robot lacks knowledge of the actual position of the workpiece. This paper establishes the corresponding user coordinate system in the workpiece and the robot system by scanning the positioning markers, so that the robot can find the workpiece position.
The robot user coordinate system is calibrated using the three-point calibration method, as shown in Figure 13. Three label points are selected on the workpiece surface as the origin, a point on the X-axis of the user coordinate system, and a point on the X-O-Y plane. During the calibration process, the welding gun direction remains unchanged to minimize the tool coordinate system error. The three-point calibration is completed at the center of the welding wire contact marker point, thereby establishing the user coordinate system in the robot system.
On the model, three corresponding points P1, P2, and P3 are selected as the origin, X-axis point, and X-O-Y plane point of the user coordinate system.
The unit vectors for the user coordinate system’s X, Y, and Z axes are calculated as follows:
X user = P 2 - P 1 P 2 - P 1 Z user = P 2 - P 1 P 2 - P 1 × P 3 - P 1 P 3 - P 1 Y user = Z user × X user   ,
where P 1 , P 2 , P 3 are vectors of the three tag points in the model coordinate system, and X user , Y user , Z user are unit vectors of the user coordinate system’s axes. The transformation matrix from user coordinate systems to camera coordinates is
T 4 × 4 = X user Y user Z user P 1 0   0 0   1 = n x x n x y n x z x 0 n x y n y y n y z y 0 n x z 0 n z y 0 n z z 0 z 0 1   ,
Consequently, the transformation from model coordinates ( x m o d e l i , y m o d e l i , z m o d e l i ) to user coordinates ( x u s e r i , y u s e r i , z u s e r i ) follows Equation (5):
x u s e r i y u s e r i z u s e r i 1 = n x x n x y n y x n y y n x z ( n x x x 0 + n x y y 0 + n x z z 0 ) n y z ( n y x x 0 + n y y y 0 + n y z z 0 ) n z x n z y 0 0 n z z ( n z x x 0 + n z y y 0 + n z z z 0 ) 0 1 x m o d e l i y m o d e l i z m o d e l i 1 ,
Figure 14 compares coordinate systems before/after transformation. Paths generated in this coordinate system can be directly converted into robot-executable programs.

3. Experiment and Discussion

The experimental system is shown in Figure 15. The traveling mechanism is composed of two 9-degrees-of-freedom KUKA-R1610 manipulators from KUKA Robotics (Shanghai) Co., Ltd., Shanghai, China, with the workpiece placed in the middle position between the two robots. During actual welding, the two robots perform double-sided welding simultaneously. The selected handheld scanner is the ZhongGuan Scan 717 from Wuhan ZhongGuan Automation Technology Co., Ltd., Wuhan, China, featuring a scanning accuracy of 0.03 mm, as illustrated in Figure 16. The large-scale pipe–pipe intersecting workpiece containing intersecting line welds is shown in Figure 17, with the main pipe diameter being 10 m and the branch pipe diameter 0.3 m.
The offline programming system V1.0 was independently developed using C++ and Qt, integrating functions of model preprocessing, STL model slicing, groove feature recognition, and multi-layer multi-pass arrangement. As illustrated in Figure 18, the system architecture primarily consists of three modules: model processing, planar weld bead layout, and robotic simulation motion.

3.1. Verification Experiment for Multi-Layer Multi-Pass Layout

To verify the algorithm’s efficacy, a comprehensive test of its workflow was conducted. Initially, the RANSAC cylinder fitting algorithm was used on the scanned model to reconstruct the branch pipe cylinder, as depicted in Figure 19. Following that, the STL model’s topological structure was reconstructed, and cutting planes were generated at 1° intervals around the branch pipe’s central axis. Geometric feature points of the groove were identified on the sliced cross-sections, and a bead layout template was designed in the planar space. Welding paths were generated via projective transformation, with the template and path label points illustrated in Figure 20. Finally, motion simulation was performed in the offline programming system, as shown in Figure 21, and an executable file was generated with spline interpolation commands between path points.
Corresponding user coordinate systems were established in both the offline programming and physical robot systems using identical marker points. Weld bead trajectories and poses were converted from the world coordinate system to the user coordinate system, and robot-executable programs were generated for welding operations. The planned positions and poses of multi-layer multi-pass welds are depicted in Figure 22. Observation shows that the actual robot poses match the planned templates exactly, validating the feasibility of the proposed path-planning algorithm.

3.2. Experimental Verification of System Accuracy

To validate system accuracy, a robot motion trajectory is created along the groove perimeter, where the welding torch’s advancing direction is normal to the cutting plane and its axis is perpendicular to the groove surface. The trajectory transitions from the groove base to the top, rotating 180° around the central axis. Five equally spaced detection points are positioned at 6 o’clock, 4:30, 3 o’clock, 1:30, and 12 o’clock orientations along the path. At each specific position of the manipulator, the distance from the tool tip to the workpiece perimeter is measured. The planned trajectory and detection point layout are illustrated in Figure 23.
The measurement process and results are shown in Figure 24 and Table 2, respectively. For each test point, the average value is taken as the mean deviation of the point by finding three workers to estimate. The results show that all deviations are less than 1.0 mm, indicating that the proposed method meets the positioning accuracy requirements of large intersecting line groove welds. The system error sources include scanning error, robot tool coordinate system calibration error, robot user coordinate system calibration error, robot motion accuracy error, and groove feature extraction error, but the overall error is within an acceptable range.

4. Conclusions

In this study, a handheld 3D scanner was used to scan a pipe-to-pipe intersecting workpiece containing large-sized intersecting line welds to obtain an actual STL model of the assembled workpiece. The RANSAC cylindrical fitting method was used to fit the model and extract the linear equation of the central axis of the branch pipe. On this basis, the model was simplified and sliced circumferentially, and the geometric feature points of the actual weld groove were extracted according to the intersection line. Using template transmission projection, an adaptive-shape variable cross-section multi-layer multi-pass path-planning algorithm was implemented. Finally, the transformation matrix between the model coordinate system and the user coordinate system was derived using the marked positioning points on the workpiece surface, and the robot-executable file was generated. The multi-layer multi-pass arrangement test showed that the robot’s position at the variable cross-section groove was consistent with the planned position, verifying the effectiveness of the proposed algorithm. In addition, an accuracy verification path was generated along the outer edge of the groove. Field measurements showed that the deviation between the robot motion position planned by scanning and groove feature recognition and the actual position was less than 1.0 mm, which met the positioning accuracy requirements of arc welding for large double intersecting groove welds.
This study builds on traditional offline programming. It uses sensor-based online modeling to obtain the actual workpiece model. This model generates accurate welding paths. The approach solves the problem of invalid paths caused by large deviations between nominal CAD models and real workpieces in traditional offline programming. It also expands the application scope of offline programming. With the popularization of reverse modeling technology, the path generation algorithm based on this technology is expected to become an important research hotspot and development trend. However, the feature extraction algorithm proposed in this paper is only for the dual intersecting line model and relies on the threshold based on the standard model size in the feature extraction process, which has certain limitations. Future research will combine deep learning technologies such as PointNet++ to enhance the universality of the algorithm.

Author Contributions

Methodology, X.L., S.Y. and G.Z.; Software, J.M.; Data curation, S.Y.; Writing—original draft, X.L.; Writing—review & editing, G.C. All authors have read and agreed to the published version of the manuscript.

Funding

This work is financially supported by the National Key R&D Program No. 2024YFB4709401, the Heilongjiang Postdoctoral Funded Project under Grant No. LHB-Z23159, the State Key Laboratory of Advanced Welding and Joining Independent Funded Project, and the National Natural Science Foundations of China (NSFC) under Grant 52075121.

Data Availability Statement

The original contributions presented in this study are included in the article. Further inquiries can be directed to the corresponding author.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. He, S.; Chen, S.; Zhao, Y.; Qi, N.; Zhan, X. Study on the intelligent model database modeling the laser welding for aerospace aluminum alloy. J. Manuf. Process. 2021, 63, 121–129. [Google Scholar] [CrossRef]
  2. Liu, X. Analysis of Automobile Body Structure and Monocoque Body Welding Technology. J. Phys. Conf. Ser. 2021, 1852, 042063. [Google Scholar] [CrossRef]
  3. Hu, K.; Dong, Q.; Ma, Z.; Li, B.; Qi, T. Welding robot path planning based on ant colony algorithm. In Proceedings of the 2024 5th International Conference on Artificial Intelligence and Electromechanical Automation (AIEA), Shenzhen, China, 14–16 June 2024; pp. 13–18. [Google Scholar]
  4. Zhou, P.; Peng, R.; Xu, M.; Wu, V.; Navarro-Alarcon, D. Path Planning with Automatic Seam Extraction Over Point Cloud Models for Robotic Arc Welding. IEEE Robot. Autom. Lett. 2021, 6, 5002–5009. [Google Scholar] [CrossRef]
  5. Iakovou, D. Sensor Development and Integration for Robotized Laser Welding. Ph.D. Thesis, University of Twente, Enschede, The Netherlands, 2017. [Google Scholar]
  6. Xiao, R.; Xu, Y.; Hou, Z.; Chen, C.; Chen, S. An adaptive feature extraction algorithm for multiple typical seam tracking based on vision sensor in robotic arc welding. Sens. Actuators A Phys. 2019, 297, 111533. [Google Scholar] [CrossRef]
  7. Guo, Q.; Yang, Z.; Xu, J.; Jiang, Y.; Wang, W.; Liu, Z.; Zhao, W.; Sun, Y. Progress, challenges and trends on vision sensing technologies in automatic/intelligent robotic welding: State-of-the-art review. Robot. Comput. Manuf. 2024, 89, 102767. [Google Scholar] [CrossRef]
  8. Liu, X.; Li, A.; Deng, Z.; Chen, H. Advances in Three-Dimensional Imaging Technologies Based on Single-Camera Stereo Vision. Laser Optoelectron. Prog. 2022, 59, 1415007. [Google Scholar]
  9. Fan, J.; Deng, S.; Jing, F.; Zhou, C.; Yang, L.; Long, T.; Tan, M. An Initial Point Alignment and Seam-Tracking System for Narrow Weld. IEEE Trans. Ind. Inform. 2019, 16, 877–886. [Google Scholar] [CrossRef]
  10. Gao, J.; Hong, Y.; Hong, B.; Li, X.; Jia, A.; Qu, Y. A Method of Feature Extraction of Position Detection and Weld Gap for GMAW Seam Tracking System of Fillet Weld with Variable Gaps. IEEE Sens. J. 2021, 21, 23537–23550. [Google Scholar] [CrossRef]
  11. Zou, Y.; Wan, Y. Robotic Seam Tracking System Combining Lightweight Segmentation Network Design and ADMM-Based Structured Pruning. IEEE Trans. Instrum. Meas. 2024, 73, 5016515. [Google Scholar] [CrossRef]
  12. Wang, N.; Shi, X.; Zhang, X. Recognition of initial welding position based on structured-light for arc welding robot. In Intelligent Robotics and Applications, Proceedings of the 10th International Conference, ICIRA 2017, Wuhan, China, 16–18 August 2017; Proceedings, Part II 10; Springer International Publishing: Cham, Switzerland, 2017; pp. 564–575. [Google Scholar]
  13. Liu, H.; Tian, Y.; Li, L.; Lu, Y.; Xi, F. One-shot, integrated positioning for welding initial points via co-mapping of cross and parallel stripes. Robot. Comput. Manuf. 2023, 84, 102602. [Google Scholar] [CrossRef]
  14. Zhang, Y.; Geng, Y.; Tian, X.; Zhou, L. Feature extraction and robot path planning method in 3D vision-guided welding for multi-blade wheel structures. Opt. Lasers Eng. 2024, 176, 108066. [Google Scholar] [CrossRef]
  15. Geng, Y.; Zhang, Y.; Tian, X.; Zhou, L. A novel 3D vision-based robotic welding path extraction method for complex intersection curves. Robot. Comput. Manuf. 2024, 87, 102702. [Google Scholar] [CrossRef]
  16. Fang, W. Research on Key Technologies of Intelligent Trajectory Planning for Robot Welding Based on 3D Vision. Ph.D. Dissertation, Shandong University, Jinan, China, 2023. [Google Scholar]
  17. Liu, J.; Jiao, T.; Li, S.; Wu, Z.; Chen, Y.F. Automatic seam detection of welding robots using deep learning. Autom. Constr. 2022, 143, 104582. [Google Scholar] [CrossRef]
  18. Ma, Y.; Fan, J.; Zhou, Z.; Zhao, S.; Jing, F.; Tan, M. WeldNet: A deep learning based method for weld seam type identification and initial point guidance. Expert Syst. Appl. 2024, 238, 121700. [Google Scholar] [CrossRef]
  19. Geng, Y.; Lai, M.; Tian, X.; Xu, X.; Jiang, Y.; Zhang, Y. A novel seam extraction and path planning method for robotic welding of medium-thickness plate structural parts based on 3D vision. Robot. Comput. Manuf. 2023, 79, 102433. [Google Scholar] [CrossRef]
  20. Curiel, D.; Veiga, F.; Suarez, A.; Villanueva, P.; Aldalur, E. Automatic Trajectory Determination in Automated Robotic Welding Considering Weld Joint Symmetry. Symmetry 2023, 15, 1776. [Google Scholar] [CrossRef]
  21. Arko, P.; Jezeršek, M. Automatic Calibration of the Adaptive 3D Scanner-Based Robot Welding System. Front. Robot. AI 2022, 9, 876717. [Google Scholar] [CrossRef]
  22. Lei, T.; Gong, S.; Wu, C. A Multi-Layer Multi-Pass Weld Bead Cross-Section Morphology Extraction Method Based on Row–Column Grayscale Segmentation. Materials 2024, 17, 4683. [Google Scholar] [CrossRef]
  23. Zhao, X.; Wang, Z.; Tian, X. Research on robotic multi-layer multi-pass welding planning of intersecting pipe. Proc. SPIE 2023, 12940, 516–523. [Google Scholar]
  24. Neto, P.; Mendes, N. Direct off-line robot programming via a common CAD package. Robot. Auton. Syst. 2013, 61, 896–910. [Google Scholar] [CrossRef]
  25. Wang, X.; Yan, Y.; Gu, X. Spot welding robot path planning using intelligent algorithm. J. Manuf. Process. 2019, 42, 1–10. [Google Scholar] [CrossRef]
  26. Fu, K.; Dou, F.Z.; Li, H.C.; Diao, W.H.; Sun, X.; Xu, G.L. Aircraft Recognition in SAR Images Based on Scattering Structure Feature and Template Matching. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 2018, 11, 4206–4217. [Google Scholar] [CrossRef]
  27. Zheng, C.; An, Y.; Wang, Z.; Wu, H.; Qin, X.; Eynard, B.; Zhang, Y. Hybrid offline programming method for robotic welding systems. Robot. Comput. -Integr. Manuf. 2022, 73, 102238. [Google Scholar] [CrossRef]
  28. Hua, L.; Xu, Y.; Han, Y.; Hou, Z.; Chen, S. Optimization Design of the Robot Welding System of More Subsection Welding in Large Ship Cabin. J. Shanghai Jiao Tong Univ. 2016, 50, 36–39. [Google Scholar]
  29. Sadahiro, K. Robot Welding System for Large Assembly in Shipbuilding; Kobe Steel, Ltd.: Kobe, Japan, 2017. [Google Scholar]
  30. Li, W. Ship Outfield Intelligent Robot Welding Technology and Application Strategy. Guangdong Shipbuild. 2024, 43, 97–99. [Google Scholar] [CrossRef]
Figure 1. Flowchart of the welding path-planning scheme.
Figure 1. Flowchart of the welding path-planning scheme.
Symmetry 17 00738 g001
Figure 2. Topology of STL model optimization.
Figure 2. Topology of STL model optimization.
Symmetry 17 00738 g002
Figure 3. Slicing algorithm process.
Figure 3. Slicing algorithm process.
Symmetry 17 00738 g003
Figure 4. Cross-sectional contours at varied positions.
Figure 4. Cross-sectional contours at varied positions.
Symmetry 17 00738 g004
Figure 5. Scan model defects.
Figure 5. Scan model defects.
Symmetry 17 00738 g005
Figure 6. Definition of weld groove feature points.
Figure 6. Definition of weld groove feature points.
Symmetry 17 00738 g006
Figure 7. Groove Feature Identification Results.
Figure 7. Groove Feature Identification Results.
Symmetry 17 00738 g007
Figure 8. Schematic of welding angles at different positions.
Figure 8. Schematic of welding angles at different positions.
Symmetry 17 00738 g008
Figure 9. Top view of the workpiece and cross-sectional schematics.
Figure 9. Top view of the workpiece and cross-sectional schematics.
Symmetry 17 00738 g009
Figure 10. Comparison of rigid vs. affine transformations.
Figure 10. Comparison of rigid vs. affine transformations.
Symmetry 17 00738 g010
Figure 11. Bead definition and projective transformation process on planar surfaces.
Figure 11. Bead definition and projective transformation process on planar surfaces.
Symmetry 17 00738 g011
Figure 12. Affine projection bead arrangement.
Figure 12. Affine projection bead arrangement.
Symmetry 17 00738 g012
Figure 13. Schematic diagram of three-point user coordinate system calibration.
Figure 13. Schematic diagram of three-point user coordinate system calibration.
Symmetry 17 00738 g013
Figure 14. Comparison before/after coordinate system transformation.
Figure 14. Comparison before/after coordinate system transformation.
Symmetry 17 00738 g014
Figure 15. Physical diagram of the field test system.
Figure 15. Physical diagram of the field test system.
Symmetry 17 00738 g015
Figure 16. Handheld 3D scanner.
Figure 16. Handheld 3D scanner.
Symmetry 17 00738 g016
Figure 17. Dimensions of the workpiece with intersecting line welds.
Figure 17. Dimensions of the workpiece with intersecting line welds.
Symmetry 17 00738 g017
Figure 18. Rendering of the main interface of the system software.
Figure 18. Rendering of the main interface of the system software.
Symmetry 17 00738 g018
Figure 19. Schematic diagram of the cylindrical fitting of the branch pipe.
Figure 19. Schematic diagram of the cylindrical fitting of the branch pipe.
Symmetry 17 00738 g019
Figure 20. Planar weld bead layout template and resulting trajectories.
Figure 20. Planar weld bead layout template and resulting trajectories.
Symmetry 17 00738 g020
Figure 21. Rendering of the simulated motion.
Figure 21. Rendering of the simulated motion.
Symmetry 17 00738 g021
Figure 22. Verification of positions and poses.
Figure 22. Verification of positions and poses.
Symmetry 17 00738 g022
Figure 23. Generated robot validation trajectory and detection points.
Figure 23. Generated robot validation trajectory and detection points.
Symmetry 17 00738 g023
Figure 24. Accuracy verification of robot trajectories.
Figure 24. Accuracy verification of robot trajectories.
Symmetry 17 00738 g024
Table 1. Slicing time cost statistics.
Table 1. Slicing time cost statistics.
Model GroupsTime Cost With Optimization
(ms)
Time Cost Without Optimization
(ms)
Slicing Effect
Model-1
(0.78 million triangles)
21.335.0Symmetry 17 00738 i001
Model-2
(3.12 million triangles)
86.0147.6Symmetry 17 00738 i002
Model-3
(12.51 million triangles)
373.0599.6Symmetry 17 00738 i003
Table 2. Measured error values.
Table 2. Measured error values.
Detection PointEstimated Value 1 (mm)Estimated Value 2 (mm)Estimated Value 3 (mm)Mean Error (mm)
Point 1−0.6−0.6−0.50.57
Point 20.40.30.40.37
Point 3−0.8−0.9−0.80.83
Point 40.30.50.50.43
Point 50.50.60.50.53
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Li, X.; Yao, S.; Ma, J.; Chi, G.; Zhang, G. Handheld 3D Scanning-Based Robotic Trajectory Planning for Multi-Layer Multi-Pass Welding of a Large Intersecting Line Workpiece with Asymmetric Profiles. Symmetry 2025, 17, 738. https://doi.org/10.3390/sym17050738

AMA Style

Li X, Yao S, Ma J, Chi G, Zhang G. Handheld 3D Scanning-Based Robotic Trajectory Planning for Multi-Layer Multi-Pass Welding of a Large Intersecting Line Workpiece with Asymmetric Profiles. Symmetry. 2025; 17(5):738. https://doi.org/10.3390/sym17050738

Chicago/Turabian Style

Li, Xinlei, Shida Yao, Jiawei Ma, Guanxin Chi, and Guangjun Zhang. 2025. "Handheld 3D Scanning-Based Robotic Trajectory Planning for Multi-Layer Multi-Pass Welding of a Large Intersecting Line Workpiece with Asymmetric Profiles" Symmetry 17, no. 5: 738. https://doi.org/10.3390/sym17050738

APA Style

Li, X., Yao, S., Ma, J., Chi, G., & Zhang, G. (2025). Handheld 3D Scanning-Based Robotic Trajectory Planning for Multi-Layer Multi-Pass Welding of a Large Intersecting Line Workpiece with Asymmetric Profiles. Symmetry, 17(5), 738. https://doi.org/10.3390/sym17050738

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop