1. Introduction
In manufacturing plants, many articulated robots are installed, and they must operate without colliding with each other. In general, manual teaching, in which operators directly manipulate the robots, requires considerable time and effort. Therefore, off-line robot teaching, performed prior to on-site teaching, is an effective approach. Off-line teaching commonly utilizes CAD models of articulated robots.
In factory environments, robots are equipped with various wire harnesses for power and signal transmission. However, accurate 3D models of wire harnesses are rarely created. Because the harnesses are typically installed with slack to accommodate the robot’s movements, it is difficult to model them precisely during the design phase. Moreover, their mounting positions are often determined empirically by experienced workers on the factory floor, making their exact configurations hard to predict in advance. The clamping positions and attachment methods for wire harnesses vary depending on the robot’s geometry and the type of end-effector, making it labor-intensive to create detailed CAD models for each robot. If wire harnesses are not modeled, however, their motion cannot be simulated during off-line teaching, resulting in discrepancies between simulated and actual robot behavior. Unintended harness motion may cause interference between robots or even lead to mechanical damage.
In practice, wire harnesses present several inherent challenges for geometric reconstruction. Large portions of the harness surface are typically missing in point clouds because the backside is occluded by robot links, clamps, or surrounding devices. Furthermore, the harness shape is not rigid: slack produces irregular sagging and deformation that vary across robot poses. Consequently, the resulting point clouds are highly incomplete, anisotropic, and non-watertight, making them difficult to process using conventional 3D reconstruction techniques.
In recent years, terrestrial laser scanners have enabled the acquisition of dense point clouds of manufacturing plants.
Figure 1 shows an example of a terrestrial laser scanner. These scanners can capture the 3D geometry of factory equipment as point clouds consisting of millions to billions of points. By extracting wire harnesses from these data and converting them into 3D mesh models for integration with robot CAD models, more accurate interference analysis can be achieved. This process requires isolating movable components, such as wire harnesses, from the factory’s point cloud data and replacing them with corresponding 3D models.
Wire harnesses can be broadly categorized into two types: those fixed to the robot body and those that change their relative position as the robot moves. The latter cannot simply be attached to the robot model, as their motion is independent of the robot’s rigid links. In such cases, each harness must be modeled separately, and dynamic motion simulations need to be performed to reproduce its behavior accurately. Even when the harness is directly attached to the robot, it is still important to identify the appropriate link for attachment and to segment the harness point cloud for each link. These segmented point clouds then serve as the basis for reconstructing explicit 3D geometric models of the harnesses, which are required for downstream analysis such as interference checking and motion simulation.
Moreover, the reconstructed 3D models are intended to be used in physics-based motion simulation, where the dynamic harness segments are treated as flexible bodies constrained at clamp locations. Although detailed simulation modeling is beyond the scope of this paper, the reconstructed centerlines and radii provide the geometric foundation required for applying such constraints within common physics engines.
Many researchers have investigated 3D model reconstruction from point cloud data [
1,
2,
3,
4,
5]. Poisson surface reconstruction [
6], for example, is widely used to generate smooth 3D surfaces from dense point clouds. However, it often fails to produce accurate results when multiple objects are in close proximity or when the data contain severe occlusions. Since it is impractical to capture complete point clouds of numerous wire harnesses in large-scale factory environments, such methods are not well suited for harness modeling.
In the field of industrial facility modeling, numerous studies have focused on detecting and reconstructing piping structures [
7,
8,
9]. For instance, Midorikawa et al. [
10] modeled pipes by extracting generalized cylinders from point clouds. However, these methods depend on identifying circular cross-sections to define the pipe geometry, which limits their applicability to wire harnesses. Point clouds of wire harnesses often contain large missing portions due to occlusions, and their centerlines must be estimated as highly flexible freeform curves, which poses challenges distinct from those of rigid, static piping.
Many studies on mesh processing have addressed skeletonization, which aims to extract the centerline (skeleton) from arbitrary 3D shapes. Laplacian-based contraction [
11,
12], a well-known approach, iteratively shrinks the shape toward its medial axis, thereby effectively capturing its topology. However, this technique is primarily designed for closed, watertight meshes and is therefore unsuitable for unclosed, partial point-cloud surfaces obtained from terrestrial laser scanners. Because the entire backside of a wire harness is often missing, the Laplacian averaging process tends to cause the estimated centerline to deviate significantly from the true geometry. Hence, a different and more robust approach is required to estimate the centerline from such incomplete data.
Recent studies have also addressed the geometric reconstruction of wire-like structures such as railway catenaries and high-voltage transmission lines [
13,
14,
15]. These wires are typically characterized by small diameters and are constrained only at their endpoints, allowing their trajectories to be represented by analytic geometric curves such as catenaries. However, robot wire harnesses generally have larger diameters and follow more complex routing paths to accommodate the robot’s motion.
Although many reconstruction and skeletonization techniques have been proposed, they generally assume watertight surfaces, complete cross-sections, or uniformly sampled points. TLS-derived wire-harness point clouds violate all of these assumptions: they contain severe occlusions, missing backside surfaces, irregular sampling density, and sometimes multi-branch structures. Existing methods thus fail to recover stable centerlines or correct topology under real factory conditions, leaving a clear technical gap that must be addressed.
To overcome these limitations, this paper proposes a comprehensive method to extract, segment, and reconstruct wire harnesses from incomplete point clouds of articulated robots. The main contributions of this study are summarized as follows:
Integrated Pipeline: A fully automated framework for processing large-scale factory point clouds to generate collision-ready mesh models of wire harnesses.
Motion-Based Segmentation: A novel classification method that distinguishes between static harnesses (fixed to links) and dynamic harnesses (moving independently), enabling more realistic kinematic simulations.
Robust Reconstruction Strategy: A hybrid centerline estimation approach combining OBB-trees and Reeb graphs, specifically designed to handle non-watertight surfaces, backside occlusions, and missing data.
Real-World Validation: Experimental evaluation on articulated robots installed in an operational automotive assembly plant, demonstrating effectiveness in terms of reconstruction accuracy and computation time.
The following sections provide an overview of the proposed method.
Section 3 presents the extraction of wire harness point clouds from the overall robot point cloud.
Section 4 describes the segmentation of the wire harness point clouds into parts that move relative to the robot links and parts that are fixed to them.
Section 5 introduces the shape reconstruction approach for unbranched wire harnesses.
Section 6 explains the centerline estimation and 3D model generation methods for branched wire harnesses. Finally,
Section 7 presents the experimental results and conclusions.
2. Overview
Figure 2 shows point clouds of an articulated robot captured using a terrestrial laser scanner. The data were acquired from multiple scanning locations. In this paper, we describe our method using the point clouds of this robot, which consists of 10 links performing rotational or translational motion. A wire harness runs along the robot structure, extending from the base to the end effector.
An outline of the proposed method is shown in
Figure 3, which provides a flowchart of the overall processing pipeline. First, wire harness point clouds are extracted from the robot point clouds. Because the harness is attached along the robot links, directly isolating it is difficult. Fortunately, CAD models of most industrial robots are available from robot manufacturers. Therefore, we first align the CAD model of the articulated robot to the point-cloud data and remove the points corresponding to the robot links. The remaining points serve as candidates for wire-harness points, from which we detect the actual wire harness point clouds.
Wire harnesses include both static portions that are firmly fixed to each link and dynamic portions that move relative to the link due to slack, as illustrated in
Figure 2. In our method, harnesses are classified into these two types. Each type is then detected and segmented using cutting planes perpendicular to the axis of each robot link.
The extracted harness point clouds often contain substantial missing regions. The laser beam cannot reach the backside of the harness when it is tightly attached to a link, covered by clamps, or partially occluded by surrounding objects. As a result, it is difficult to detect a continuous centerline directly from such incomplete data. To address this, we estimate the centerline by obtaining representative points from oriented bounding boxes (OBBs) and connecting them to form a continuous curve. For harnesses with branches, we employ a Reeb graph [
16] to determine the centerline topology. The estimated centerlines are then approximated using B-spline curves to smoothly interpolate missing segments.
The wire harness is modeled as a generalized cylinder. The 3D model is generated by sweeping circles of varying radius, computed from cross-sectional points along the centerline. The effectiveness of the proposed method is demonstrated using point clouds of articulated robots installed in an automotive manufacturing environment.
3. Extraction of Candidate Points for Wire Harnesses
This section describes the extraction of candidate point clouds for wire harnesses.
Figure 4a shows the point cloud of an articulated robot with wire harnesses attached along its links. To isolate the harness point clouds, we first detect and remove the points corresponding to the robot links from the original point cloud.
Figure 4e shows the resulting point cloud after removing the link regions. The remaining points constitute the candidate points from which the wire harnesses will be identified.
CAD models of articulated robots used in factory environments are typically provided by robot manufacturers mainly for off-line teaching. In this study, we assume that the movable parts of the robot are available as independent 3D models and that a complete assembled CAD model of the robot is also provided.
The proposed method uses these CAD models to separate the point clouds associated with individual wire harnesses. We first align the CAD models of the robot links to the measured point cloud using the method of Kawasaki et al. [
17] and then remove the corresponding link regions from the point clouds. This fitting method enables precise alignment of each link model with the measured data.
In Kawasaki’s method, the CAD model of each link is sequentially fitted to the point cloud, starting from the base link and proceeding toward the end effector by exploiting the kinematic relationships between connected links. In this procedure, a constrained ICP formulation is employed in which the rotational axis of each CAD link is required to coincide with the axis of the previously aligned link. This constraint allows the link models to be fitted sequentially and consistently to the measured point cloud.
Figure 4b shows the initial CAD models of the robot links, and
Figure 4c illustrates the fitted models after applying this procedure.
Once the CAD models are aligned, the point clouds corresponding to the robot links can be extracted by selecting the points within a specified distance from the fitted link surfaces, as shown in
Figure 4d. In this study, we used a neighbor distance of 3 cm. Candidate wire-harness points are then obtained by removing these link points from the original point cloud, as shown in
Figure 4e. The remaining points correspond to those not represented by the CAD models and include not only wire harnesses but also other components such as clamps, ground-mounted devices, and stands.
5. Generation of 3D Mesh Models for Dynamic Wire Harnesses
In this section, we describe the process of generating a 3D model for each wire harness from the segmented point clouds. Static wire harnesses are rigidly attached to robot links and move together with them. Therefore, their geometry can be used directly as point clouds for collision checking. In contrast, dynamic wire harnesses move independently of the robot links because they contain slack. To simulate their motion and evaluate potential interference accurately, it is necessary to construct a mesh model that can be used in dynamic analysis. For this reason, we generate a mesh model from the point clouds of each dynamic wire harness.
A wire harness can be approximated as a generalized cylinder, defined by an arbitrary centerline and a variable radius. Thus, both the centerline and the radius must be estimated from the point cloud. This section describes the centerline estimation method for wire harnesses without branches.
5.1. Estimation of the Centerline of Wire Harness
Figure 8a shows the point cloud of a dynamic wire harness. Portions of the wire harness are often missing on the backside, around clamps, or in occluded regions, making direct centerline estimation unreliable.
Before estimating the centerline, residual points that are not part of the harness are removed to ensure robustness. The input point cloud is first converted into a graph by connecting spatially neighboring points, following Step 1 of Algorithm 1. This graph is then decomposed into independent connected components, and any isolated component containing fewer points than a predefined threshold is treated as noise and discarded. This removes the residual points visible ensuring that they do not affect the subsequent OBB-tree construction.
To obtain a stable centerline from the filtered point cloud, the data must be subdivided into small regions from which representative points can be extracted reliably. This subdivision is performed using an OBB-tree constructed exactly as described in Algorithm 1. Each subset
is enclosed by an oriented bounding box (OBB) whose orientation is determined from the eigenvectors of its covariance matrix. If
or the OBB length falls below
, the OBB center is recorded; otherwise, the subset is recursively split along a plane perpendicular to the principal direction
.
Figure 8b illustrates the resulting OBBs (red boxes) and the remaining wire-harness points (blue points).
The centers of all terminal OBBs form the set , which serves as the input for polyline extraction. To estimate the centerline, these centers are connected using a growing procedure consistent with Step 3 of Algorithm 1. An arbitrary center point is selected as the initial node, and the polyline grows by searching for neighboring centers within a distance threshold .
Among these candidates, only those satisfying an angular constraint are considered. Let
be the direction vector of the previous segment and
be the vector to a candidate point. The candidate is accepted only if the turning angle
satisfies:
where
is the predefined angle threshold. Among the valid candidates, the closest point is chosen as the next node, exactly as in Step 27 of Algorithm 1. By iteratively applying this rule, a polyline grows along the direction of the wire harness, as illustrated in
Figure 8c.
This procedure is applied repeatedly from multiple starting points, producing a set of candidate polylines. In accordance with Step 34 of Algorithm 1, the polyline containing the largest number of connected OBB centers—that is, the longest valid path—is selected as the main centerline, while very short or fragmented polylines are discarded as invalid. Finally, the selected centerline is smoothed using B-spline fitting, as shown in
Figure 8d.
| Algorithm 1 OBB-based Centerline Estimation |
| Input: | Wire harness point cloud , Thresholds |
| Output: | Smooth centerline curve |
| 1: | //Step 1: Pre-processing (Noise Removal) |
| 2: | Build graph from using connectivity |
| 3: | Largest Connected Component () |
| 4: | //Step 2: OBB-tree Construction |
| 5: |
|
| 6: | while is not empty do |
| 7: |
|
| 8: | Compute covariance matrix of |
| 9: | Calculate eigenvectors and eigenvalues |
| 10: | Construct OBB enclosing oriented along |
| 11: | if |
| | then |
| 12: | . add (OBB.center) |
| 13: |
else |
| 14: | Split into along plane through mean perpendicular to |
| 15: |
|
| 16: | end if |
| 17: | end while |
| 18: | //Step 3: Polyline Growing |
| 19: |
|
| 20: | for each point as start node do |
| 21: |
|
| 22: | repeat |
| 23: | Find neighbors |
| 24: | Filter by angle: |
| 25: |
|
| 26: | if exists then |
| 27: | else break |
| 28: | until termination |
| 29: |
|
| 30: | end for |
| 31: | |
| 32: | |
| 33: | return
|
5.2. Generation of Generalized Cylinders
To generate a generalized cylinder, the radius of the wire harness must be estimated at multiple locations along the centerline. For this purpose, cross-section points are computed from the wire-harness point cloud. Because wire-harness point clouds are often sparse and contain missing regions, they are first converted into wireframe models to extract cross-section points more reliably.
It is well known in terrestrial laser scanning that a point cloud acquired from a single scanner position can be mapped onto a two-dimensional grid whose axes correspond to the altitude and azimuth angles of the laser beams [
3,
4,
5]. Each scan position therefore provides a structured 2D grid in angle space, and by connecting adjacent grid points, a wireframe representation can be constructed.
Cross-section points are obtained by slicing the wireframe model with cutting planes. These cutting planes are placed at equally spaced intervals along the centerline, and their normals are defined by the tangent directions of the B-spline curve representing the centerline. The intersection between each cutting plane and the wireframe model yields the cross-section points, as illustrated in
Figure 9a, where different colors indicate individual cross-sections.
The center of the generalized cylinder is then refined using these cross-section points. When many points are missing, the centers of the OBBs used earlier may not coincide with the true center of the wire harness. Therefore, a circle is fitted to each cross-section using the RANSAC method, and the circle center is adopted as the section center. By computing these centers for all cutting planes, the centerline of the wire harness is refined. The radius at each section is estimated as the distance from the center to the farthest cross-section point to ensure conservative collision avoidance, as shown in
Figure 9b.
Local distortions in the wire-harness surface may cause fluctuations in the estimated radii. To obtain a gradual and realistic variation, the radii are treated as a function of the centerline arc length, and a smooth B-spline curve is fitted to this data. The fitted curve is then used to correct the radius values along the centerline.
Finally, the generalized cylinder is generated by interpolating the refined centerline and the corresponding smoothed radius values. The resulting 3D model is shown in
Figure 9c presents examples of generated wire-harness models displayed together with an articulated robot.
8. Conclusions
In this paper, we present a comprehensive method for extracting, segmenting, and reconstructing 3D models of wire harnesses installed on articulated robots. Candidate wire-harness point clouds are first identified by removing the robot geometry through comparison with its CAD model. The extracted points are then classified into static harnesses, which move together with the robot links, and dynamic harnesses, which move independently.
For 3D reconstruction, two complementary centerline estimation strategies were introduced, depending on whether the harness contains branches. An OBB-tree-based approach is applied to unbranched harnesses and remains robust even when the point cloud contains significant occlusion. For branched harnesses, a Reeb-graph-based method was developed to capture the global branching topology. The experimental results on six industrial robots demonstrated that accurate 3D models can be reconstructed from point clouds with mean errors on the order of only a few millimeters and within practical computation times.
There remain several opportunities for further improvement. First, thin-diameter harnesses were difficult to identify with the current approach due to limitations in TLS resolution. In addition, the present method primarily assumes tree-like structures without cycles; future work will extend the framework to handle looped configurations and more complex sagging behaviors by incorporating more advanced topological analysis.
Second, discrepancies between CAD models and actual robot geometry, including unmodeled accessories, may affect extraction accuracy. To address this issue, we plan to investigate learning-based and template-matching approaches for automatically detecting attachment elements such as clamps during the extraction stage. Furthermore, to improve practical usability, we aim to increase the level of automation in selecting adaptive parameters by developing algorithms that optimize parameter values based on local point-cloud characteristics and geometric context.
Finally, we intend to apply the reconstructed 3D models to robot motion-planning and collision-avoidance simulations in operational automotive assembly environments, and to evaluate the scalability of the proposed solution across a wider variety of robotic workcells.