Next Article in Journal
High-Throughput Control-Data Acquisition for Multicore MCU-Based Real-Time Control Systems Using Double Buffering over Ethernet
Next Article in Special Issue
Potential of Deep Learning Models for Point Cloud-Based Infrastructure Management
Previous Article in Journal
Transient Synchronization Stability Analysis of DFIG-Based Wind Turbines with Virtual Resistance Demagnetization Control
Previous Article in Special Issue
Evolution and Emerging Frontiers in Point Cloud Technology
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Preoperative Surgical Planning for Lumbar Spine Pedicle Screw Placement Using PointNet

1
Department of Electrical, Electronic, and Computer Engineering, University of Ulsan, Ulsan 44610, Republic of Korea
2
Department of Orthopedic Surgery, Gyeongsang National University Changwon Hospital, Gyeongsang National University School of Medicine, Changwon 51472, Republic of Korea
3
School of Mechanical Engineering, University of Ulsan, Ulsan 44610, Republic of Korea
*
Author to whom correspondence should be addressed.
These authors contributed equally to this work.
Electronics 2026, 15(2), 468; https://doi.org/10.3390/electronics15020468
Submission received: 8 December 2025 / Revised: 17 January 2026 / Accepted: 20 January 2026 / Published: 21 January 2026

Abstract

This study introduces a novel framework for defining screw trajectory that utilizes PointNet—a deep neural network trained on lumbar vertebrae point clouds—to improve the manual surgical planning procedures. The conventional architecture of PointNet was modified to accommodate various vertebral orientations and predict six values, which were reconstructed into two control points that define a linear trajectory. A custom loss function was designed to align the predicted trajectory with the ground-truth trajectory. The neural networks were trained on 4284 point clouds of vertebrae, and 28 unseen point clouds were used to evaluate the model’s performance based on translational error, angular error, and clinical accuracy. For the left pedicle, the mean translational errors were 1.5 ± 0.8 mm at the entry point and 2.3 ± 1.2 mm at the target point. For the right pedicle, the mean translational errors were 1.5 ± 0.7 mm at the entry point and 2.3 ± 1.0 mm at the target point. The mean angular error was 3.5 ± 2.3° for the left pedicle and 3.9 ± 1.7° for the right pedicle. Clinically, the network generated 52 out of 56 trajectories without medial-cortical violations of the spinal canal. The trained neural network demonstrated promising technical and clinical accuracy, generating feasible screw trajectories across various vertebral orientations. Integrating a spinal segmentation network with the proposed framework could enable fully automated surgical planning in the future.

1. Introduction

Pedicle screw placement is commonly used in surgeries for patients with conditions such as spinal scoliosis, deformities, and intervertebral disk herniations. Historically, the success of these procedures has relied heavily on the surgeon’s expertise, as freehand techniques are often employed. However, surgical navigation and robotic guidance have substantially improved outcomes, enabling safer and more precise screw insertion than traditional methods [1,2,3,4]. Pedicle screw placement is also frequently used in minimally invasive, percutaneous procedures, providing benefits such as reduced muscle and tissue damage, decreased postoperative pain, and shorter hospital stays [5,6]. Achieving successful pedicle screw placement with navigation and robotic guidance involves multiple preoperative and intraoperative steps, including a CT scan, surgical planning, and registration [7,8]. Generally, the surgical plan includes the screw’s linear trajectory, dimensions, and insertion depth. The screw’s linear trajectory is defined by two three-dimensional control points—the entry and target points, as illustrated in Figure 1. Currently, surgical planning for screw insertion is performed manually during the preoperative and intraoperative phases based on CT scans [9]. Automated, optimized surgical planning could streamline workflows, reduce radiation exposure, and minimize the risk of screw mispositioning.
Several studies have explored automated and optimized methods for surgical planning. Knez et al. developed a computer-assisted planning approach for determining pedicle screw dimensions and insertion trajectories for the thoracic spine by modeling the vertebrae and pedicles as elliptical cylinders [10]. They compared their method with manual planning performed by two surgical professionals and found that their approach aligned well with the anatomical technique by following the pedicle’s anatomical axis [11]. Cai et al. trained a deep neural network to output six regression values that define the screw’s entry and direction points, respectively [12]. They designed a U-Net-like segmentation model to reconstruct vertebrae from CT scans, connecting it to a location network for regressing the six values. They suggested that a more advanced network architecture could better extract vertebral features for the location network. Qi et al. introduced an automatic framework for determining screw trajectories by establishing a local vertebral coordinate system to align screw trajectories based on vertebrae’s anatomical and geometrical features [13]. Zhang et al. presented a planning framework for lumbar pedicle screw placement, which estimates vertebral pose using the YOLOPOSE3D network and segments vertebrae from CT volumes with 3D U-NET, maximizing the trajectory distance from avoidance areas on axial and sagittal planes [14]. Massalimova et al. adopted PointNet++ to detect the screw entry and pedicle regions for defining an initial screw trajectory. The initial trajectory is then refined through anatomically constrained optimization [15].
Previous research has used spinal CT volumes to segment vertebrae through machine learning techniques, importing the binary segmentation directly into neural networks designed to generate screw trajectories. Alternatively, screw trajectories have been derived from rule-based algorithms that utilize segmented vertebrae. In computer graphics, there are algorithms capable of creating triangular meshes from three-dimensional scalar voxel fields, such as segmented vertebrae in CT scans [16,17]. Using this approach, triangular mesh data of vertebrae can be generated. By randomly sampling points on the mesh surface, a three-dimensional point cloud can be formed. Separately, Qi et al. developed a deep neural network, PointNet, designed to train on unordered point cloud data, achieving permutation invariance through a symmetric function that aggregates features from individual points [18]. PointNet’s architecture effectively captures and interprets global geometrical features within point clouds for applications like object classification and segmentation. However, it does not explicitly model local geometrical features.
In this study, we propose a novel framework for preoperative pedicle screw planning that utilizes the deep neural network PointNet. We conducted both clinical and technical evaluations of this framework to assess its accuracy in surgical planning procedures. The framework utilizes point cloud data generated from segmented lumbar vertebrae in CT volumes. The trained neural network outputs two control points, defining the predicted trajectory of the pedicle screw within the CT volume’s coordinate system. The primary contributions of this study are as follows:
  • Modification of the PointNet architecture to optimize for determining the pedicle screw trajectories.
  • Development of a loss function tailored for linear screw trajectories.

2. Materials and Methods

Our framework comprises three main steps for preoperative lumbar pedicle screw placement planning, as illustrated in Figure 2.
  • Training Data Preparation and Preprocessing: Training data included polygonal models of each vertebra along with control points for the screw trajectory, which were created and preprocessed.
  • Data Augmentation: We enhanced the robustness of the neural network by increasing the variety of vertebral models using three-dimensional affine rotation transformations. A total of 2048 points were sampled from the surface of each augmented vertebra model to form a point cloud.
  • Neural Network Architecture and Training: The neural network was created by modifying the standard PointNet architecture and was trained with a customized loss function to align the predicted trajectory with the ground-truth trajectory. The network’s output was then used to calculate entry and target points for screw insertion.
The following sections provide detailed explanations of each step, as well as specifics on training and evaluation metrics.

2.1. Training Data Generation and Preprocessing

To create the point cloud inputs for the neural network, each vertebra in the lumbar spine CT scan was segmented and processed, as shown in Figure 3. The segmented binary volume was converted into a polygonal mesh using the Flying Edge algorithm [16]. Each pedicle label included two three-dimensional control points—an entry point and a target point—that defined a straight-line trajectory in three-dimensional space. This approach is consistent with a prior method used for defining preoperative surgical planning data for pedicle screw placement in surgical navigation systems [19]. Furthermore, to minimize positional biases, we translated the center of vertices in each vertebra model to the origin of the coordinate system, where N is the number of vertices (1). The same transformation was applied to the control points associated with each vertebra.
L a b e l = E n t r y T a r g e t = x e , y e , z e , 1 x t , y t , z t , 1 V e r t i c e s = V 1 V 2 V N = V 1 x , V 1 y , V 1 z , 1 V 2 x , V 2 y , V 2 z , 1 V N x , V N y , V N z , 1 C e n t e r = i = 1 N V i x N , i = 1 N V i y N , i = 1 N V i z N T C e n t e r e d   V e r t i c e s = I C e n t e r 0 1 V T T C e n t e r e d   L a b e l = I C e n t e r 0 1 L a b e l T T

2.2. Data Augmentation

The initial number of lumbar vertebrae models was insufficient to ensure the robustness of the trained neural network. Furthermore, because the orientation of each lumbar vertebra may vary during CT scans, a data augmentation process was implemented to improve model robustness and account for the rotational diversity of vertebrae, as illustrated in Figure 4.
To achieve data augmentation, a three-dimensional rotation operation using affine transformation was applied [20]. Within a range of −30° to +30°, three random integers were selected, and sequentially used to construct a 3 × 3 rotation matrix based on Euler angles in the z-y-x order (2). A total of 51 different rotation matrices were generated for each vertebra model and its associated control points, including the identity matrix (3). Subsequently, 2048 points were sampled from the surface of each vertebra model, creating a point cloud, which was then used as input for the neural network (Figure 4).
γ , β , α Z [ 30 ,   30 ] R = R x ( α ) · R y ( β ) · R z ( γ )
A u g m e n t e d   V e r t i c e s = R 0 0 1 C e n t e r e d   V e r t e c e s T T A u g m e n t e d   L a b e l = A u g m e n t e d   L a b e l = R 0 0 1 C e n t e r e d   L a b e l T T

2.3. Training of the Neural Network and Determination of Screw Trajectory

The primary function of the PointNet neural network is to classify point clouds into distinct categories and perform segmentation [18]. In this study, we leveraged PointNet’s ability to capture and interpret the geometric features of point clouds for preoperative surgical planning. To achieve this, we modified the conventional PointNet architecture and developed a custom loss function to optimize the alignment of the predicted screw trajectories with the ground truth.
Figure 5 illustrates both the conventional PointNet architecture and the modified version used in this study, with alterations applied exclusively to the classification framework. As noted in the Data augmentation section, vertebral orientations in CT scans are not uniform. Consequently, the neural network must generate varying outputs for the same vertebra presented in different orientations. To address this, we excluded the input and feature transformations from the conventional architecture, which are typically employed to ensure consistent results across varying orientations.
Moreover, in the conventional PointNet classification architecture, the output typically consists of scores for k classes. In contrast, the output layer of the modified network was adjusted to regress six values. These values were subsequently reconstructed into two three-dimensional control points that define a linear screw trajectory, as shown in Figure 5.
Figure 6 depicts the augmented ground-truth labels, denoted as P 1   t r u e and P 2   t r u e , alongside the predicted points, denoted as P 1   p r e d i c t and P 2   p r e d i c t . These are used to visualize the loss measurement for machine learning. The two three-dimensional lines, l p r e d i c t and l t r u e , are defined as follows:
l p r e d i c t = P 1   p r e d i c t + λ p u p l t r u e = P 1   t r u e + λ t u t
where λ p ,   λ t R and u p , u t are the unit vector of P 1   p r e d i c t P 2   p r e d i c t and P 1   t r u e P 2   t r u e , respectively. As shown in Figure 6, D 1 and D 2 are the Euclidean distances P 1   t r u e P 1 ¯ and P 2   t r u e P 2 ¯ , respectively, where P 1 and P 2 are on the l p r e d i c t . The perpendicular points of P 1 and P 2 onto l t r u e are equal to P 1   t r u e and P 2   t r u e respectively. To calculate P 1 and P 2 , we first determine the perpendicular points P 1   p e r p e n d i c u l a r and P 2   p e r p e n d i c u l a r  (5). After calculating these points, we use trapezoidal similarity to compute the Euclidean distances P 1 P 1   p r e d i c t ¯ and P 2 P 2   p r e d i c t ¯  (6) and then calculate P 1 and P 2 accordingly (7). The total loss function L is defined as the sum of D 1 and D 2  (8).
θ 1 = cos 1 P 1   t r u e P 2   t r u e · P 1   t r u e P 1   p r e d i c t P 1   t r u e P 2   t r u e P 1   t r u e P 1   p r e d i c t ,   θ 2 = cos 1 P 2   t r u e P 1   t r u e · P 2   t r u e P 2   p r e d i c t P 2   t r u e P 1   t r u e P 2   t r u e P 2   p r e d i c t P 1   p e r p e n d i c u l a r = P 1   t r u e + P 1   t r u e P 1   p r e d i c t cos θ 1 P 1   t r u e P 2   t r u e P 1   t r u e P 2   t r u e P 2   p e r p e n d i c u l a r = P 2   t r u e + P 2   t r u e P 2   p r e d i c t cos θ 2 P 2   t r u e P 1   t r u e P 2   t r u e P 1   t r u e
P 1 P 1   p r e d i c t ¯ = P 1   p r e d i c t P 2   p r e d i c t ¯   P 1   t r u e P 1   p e r p e n d i c u l a r ¯ P 1   p e r p e n d i c u l a r P 2   p e r p e n d i c u l a r ¯ P 2 P 2   p r e d i c t ¯ = P 2   p r e d i c t P 1   p r e d i c t ¯   P 2   t r u e P 2   p e r p e n d i c u l a r ¯ P 2   p e r p e n d i c u l a r P 1   p e r p e n d i c u l a r ¯
P 1 = P 1   p r e d i c t u p cos θ 1 cos θ 1 P 1 P 1   p r e d i c t ¯ P 2 = P 2   p r e d i c t + u p cos θ 2 cos θ 2 P 2 P 2   p r e d i c t ¯
L = D 1 + D 2 = P 1 P 1   t r u e ¯ + P 2 P 2   t r u e ¯
The two predicted control points were used to define the entry and target points of the screw trajectory. Expanding the predicted control points in both directions results in at least two intersection points on the surface of each vertebra model, as shown in Figure 7. The posterior apex of these intersections was designated as the entry point of screw trajectory while the target point was positioned 45 mm from the entry point, along the direction of P 1   p r e d i c t P 2   p r e d i c t .

2.4. Data Acquisition and Training Configuration

In this study, 84 vertebrae from 17 lumbar spine CT volumes were segmented for the training dataset, while 28 vertebrae from six additional CT volumes were used for the experimental dataset. CT scans were performed using two scanners: the Philips Iqon Spectral CT (Philips, Amsterdam, The Netherlands) and the Toshiba Aquilion One Vision Edition CT (Toshiba, Tokyo, Japan) at Gyeongsang National University Changwon Hospital. The in-plane voxel size ranged from 0.244 to 0.350 mm, with a slice thickness of 2 mm. Each slice had a resolution of 512 × 512 pixels. The dataset included 14 male and nine female participants, aged between 22 and 57 yr (mean = 43, median = 46). Lumbar vertebrae segmentation was performed using the 3D Slicer software (version 5.2.2, www.slicer.org) [21]. Following data augmentation, a total of 4284 point clouds representing vertebrae and corresponding ground-truth labels were generated and used for training.
The neural network was configured using TensorFlow and Keras libraries and trained on a Windows desktop PC with the following specifications: Intel i7-13700-K CPU, 31.8 GB DDR4 RAM, and an NVIDIA GeForce RTX 4080 GPU. The neural network was implemented and trained in Python (version 3.8.10) using the TensorFlow (version 2.8.0) and Keras (version 2.8.0) libraries. Key hyperparameters included a learning rate of 0.001, a batch size of 8, 300 epochs, and a dropout rate of 0.3. The network used hyperbolic tangent activation functions for hidden layers and linear activation for the output layer. Training terminated early after 10 epochs without improvement in training loss. To determine screw trajectories bilaterally, two separate neural networks were trained for the right and left pedicles. The final validation losses were 3.23 for the left pedicle network and 4.04 for the right pedicle network.

2.5. Evaluation

The performance of the trained neural network was assessed in terms of both technical and clinical accuracy. An orthopedic surgeon labeled the desired screw trajectories on unseen lumbar vertebrae models, which served as the ground truth for calculating technical accuracy.
The technical accuracy was evaluated based on translational, and angular errors. Translational error refers to the deviation between the predicted trajectory and the ground truth at the entry and target points, computed using the same method as the distances D 1 and D 2 in Figure 6. Angular error is the angle between the predicted and ground-truth trajectory for each pedicle, calculated as follows (9):
θ = cos 1 P 1   t r u e P 2   t r u e · P 1   p r e d i c t P 2   p r e d i c t P 1   t r u e P 2   t r u e P 1   p r e d i c t P 2   p r e d i c t
The Gertzbein–Robbins classification was used to assess the clinical accuracy of the predicted trajectories [22]. For this evaluation, we assumed the insertion of a screw 45 mm in length with a major diameter of 6.0 mm, represented as a cylinder model of the same dimensions (Figure 8). The predicted trajectories were classified into grades A to E based on the degree of medial-cortical violation (Figure 8a) observed in the CT scan.
  • Grade A: Intrapedicular insertion
  • Grade B: Violation of <2 mm
  • Grade C: Violation between 2 and 4 mm
  • Grade D: Violation between 4 and 6 mm
  • Grade E: Violation > 6 mm

3. Results

In this study, 28 unseen lumbar vertebrae models from CT scans of six patients were used to generate bilateral pedicle screw trajectories through a trained neural network. The network generated 56 pairs of points, with screw trajectories determined for each pedicle. Figure 8 illustrates a lumbar spine with screw trajectories successfully defined by the neural network.
Translational errors are summarized in Table 1. The mean translational error for the left pedicle at the entry point was 1.5 ± 0.8 mm and 2.3 ± 1.2 mm at the target point. For the right pedicle, the corresponding errors were 1.5 ± 0.7 mm at the entry point and 2.3 ± 1.0 mm at the target point. Translational errors were 52.8% and 54.0% larger at the target point than the entry point for the left and right pedicles, respectively. Angular errors are detailed in Table 2. The neural network for the left pedicle deviated by 3.5 ± 2.3° from the ground truth, and for the right pedicle, the deviation was 3.9 ± 1.7°.
Clinically, 52 of the 56 cylinder models along the predicted trajectories did not breach the medial wall of the pedicles. However, four trajectories showed medial-cortical violations of <2 mm, classified as grade B (Table 3). Figure 9 shows axial slices of the screw trajectories classified as grade B. The slices labeled (b), (c), and (d) in Figure 9, from the same patient, demonstrate pedicle radii < 6 mm.

4. Discussion

This study introduces a method for preoperative pedicle screw trajectory planning using a machine learning-based neural network trained on point cloud data. We evaluated the performance of the neural network by comparing screw trajectories generated by the network to manually defined trajectories for unseen vertebrae.
Preoperative trajectory planning assisted by computers offers a streamlined surgical workflow and greater planning accuracy than manual methods, which require additional steps and depend on the surgeon’s clinical experience. In contrast, our approach can reduce the time spent on manual planning by directly generating accurate screw trajectories, requiring only minor adjustments.
Previous studies have assessed various methods for computer-assisted screw trajectory planning and evaluated their frameworks. Knez et al. found that the interclass variability between surgical planning by two surgeons and parametric modeling was within the intraclass variability of individual surgeons [10,11]. Qi et al. achieved a 93% success rate in clinical evaluations of their automated path planning method [13]. Cai et al. reported a validated mean squared error of 1.340 for the six regression values in their deep neural network, which were reconstructed as 3D entry and direction points [12]. Zhang et al. observed angular deviations and point-to-point distances between manually defined trajectories and vertebral pose estimation-based trajectories for lumbar spines with scoliosis. Their angular deviations were reported as 4.77°, 5.53°, 5.19°, 4.11°, and 7.61° for L1–L5, respectively. For L1–L4, the mean minimum point-to-point distance was 0.79 mm, and the mean maximum was 2.47 mm, which were located around the middle of the trajectory and at the anterior end of the screw tip [14]. Massalimova et al. reported an entry point offset (∆EP) of 3.53 ± 1.0 mm and an angular deviation (∆θ) of 7.31 ± 3.34° using a point cloud derived from CT meshes [15]. Compared with this study, previous works incorporated deep learning techniques as submodules within a trajectory determination framework. Qi et al. utilized a deep neural network to segment individual vertebrae and subsequently established a local coordinate system for each vertebra [13]. Zhang et al. employed deep learning–based models for both vertebral segmentation and pose estimation [14]. Massalimova et al. employed PointNet++ to segment anatomical landmarks [15]. Chang et al. adopted PointNet architecture to identify entry and exit clusters of vertebrae point clouds [23]. In contrast, Cai et al. adopted a similar approach to this study, where the neural network directly predicts the screw trajectory [12].
Our findings align with results of previous studies, demonstrating that translational errors exhibited greater deviations at the anterior end of the screw trajectory than at the posterior end. Unlike previous approaches, which primarily employ machine learning as submodules for anatomical segmentation or candidate region identification, our method directly applies and evaluates a machine learning model for the screw trajectory prediction. Moreover, we trained the neural network using a novel loss function, specifically designed to accurately model the ground truth of 3D straight-line trajectories.
The computational time of the proposed framework was not considered as a primary metric for evaluation. This study focuses on validating the feasibility and generalization capability of the neural network itself, rather than on optimizing an end-to-end clinical workflow. The proposed framework involves manual CT segmentation of vertebrae, in contrast to previous studies that used automated segmentation via another neural network [12,13,14]. Manual segmentation inevitably involves human error, which may propagate to the neural network and affect final performance in terms of accuracy. If integrated with both segmentation and trajectory determination, computer-assisted screw trajectory planning could be incorporated directly into the surgical workflow, as mobile intraoperative CT scan devices are readily available. However, the neural network used in this study generates only two control points based on the geometrical features of each vertebra, excluding essential anatomical considerations such as the radius of the pedicle isthmus. Consequently, the network is unable to consistently avoid medial-cortical and lateral-cortical violations. In some cases, shown in Figure 9, the predicted trajectory caused a medial wall violation, but the pedicle size was thinner than the screw diameter. If performed in the human body, screw fixation could occur without damaging the medial wall due to the viscoelasticity of the bone. In addition, even if the pedicle size was smaller than the screw size, we were instructed to insert the screw laterally to reduce medial wall violation if possible. Furthermore, while previous studies have optimized pedicle screw planning by accounting for both the screw trajectory and its dimensions (e.g., diameter and length), our study focused on defining the screw trajectory, parameterized by a 3D line equation derived from the ground truth. The proposed method relies primarily on local geometric features of individual vertebrae, rather than on global spinal alignment or intervertebral relationships, which may influence optimal screw orientation in complex deformities. Additionally, augmentation was limited to rotations within ±30°, which restricts robustness to wider pose variations. Despite the data augmentation technique adopted in this study, limited dataset size may restrict the ability to fully demonstrate generalizability. Furthermore, all datasets were collected from a single medical center and an orthopedic surgeon, which may limit data diversity and acquisition-related noise variability. Also, the number of input points was uniformly sampled from each vertebral surface to construct the input point cloud, without a systematic evaluation of sampling density, which may influence both prediction accuracy and computational efficiency.
Given these limitations, we propose several directions for future research to enhance the surgical planning framework. The integration of spinal segmentation [24,25] with the neural network developed in this study could fully automate the surgical planning process, making it suitable for surgical navigation systems or robotic guidance. Such an approach could be applied intraoperatively, eliminating the need for preoperative CT scans and significantly reducing the time spent on surgical planning compared with manual methods. Accordingly, a comprehensive analysis of computational performance—from CT acquisition to final trajectory generation—will be addressed in future studies as part of a fully integrated framework. With sufficiently large and diverse datasets, more robust augmentation methods covering broader orientations, or an additional framework for orientation normalization, could be explored to improve general applicability. To further optimize surgical planning, collecting training datasets from multiple medical centers, along with parameter tuning through sensitivity analysis, could improve data diversity and generalizability. Additional patient-specific factors such as pedicle radius and safety margins [26] should be incorporated when determining the screw trajectory and dimensions. Furthermore, incorporating surrounding anatomical structures, including intervertebral disks and nerve root foramina, could provide additional anatomical constraints for safer and more clinically applicable trajectory planning. Diagnostic factors, such as osteoporosis, can also refine trajectory labeling. Preoperative screw trajectories for osteoporotic vertebrae, for instance, may require different inclinations of the screw direction on the axial plane [27].

5. Conclusions

This study proposes a framework for preoperative lumbar pedicle screw trajectory determination using the deep neural network PointNet. The major contribution of this study is the modification of the conventional architecture of PointNet and the design of a novel loss function optimized for linear screw trajectory prediction. The trained neural network generates feasible screw trajectories, even when the orientation of vertebrae differs. Additionally, it achieved promising clinical accuracy, which can be utilized in surgical navigation systems and robotic guidance. We expect that automated surgical planning will streamline the comprehensive surgical procedure by integrating another neural network for spinal segmentation. Simultaneously, the anatomical features of vertebrae should be considered in surgical planning to establish a more optimized framework.

Author Contributions

S.H. contributed to the development of the surgical planning algorithm, conducted the experiments, acquired the data, analyzed the data, and wrote the paper; S.-J.L. contributed to the development of the surgical planning algorithm as a clinical expert, and conducted experiments, analyzed the data, and wrote the paper; S.K. contributed to the paper review and editing, provided supervision, project administration. All authors contributed to the paper. All authors have read and agreed to the published version of the manuscript.

Funding

This work was supported by the 2024 Research Fund of University of Ulsan.

Data Availability Statement

The data presented in this study are not publicly available due to privacy and ethical considerations.

Conflicts of Interest

The authors declare that they have no conflicts of interests.

References

  1. Lee, Y.S.; Cho, D.C.; Kim, K.T. Navigation-guided/robot-assisted spinal surgery: A review article. Neurospine 2024, 21, 8–17. [Google Scholar] [CrossRef] [PubMed]
  2. Yamout, T.; Orosz, L.D.; Good, C.R.; Jazini, E.; Allen, B.; Gum, J.L. Technological advances in spine surgery: Navigation, robotics, and augmented reality. Orthop. Clin. N. Am. 2023, 54, 237–246. [Google Scholar] [CrossRef] [PubMed]
  3. Li, Y.; Wang, Y.; Ma, X.; Ma, J.; Dong, B.; Yang, P.; Sun, Y.; Zhou, L.; Shen, J. Comparison of short-term clinical outcomes between robot-assisted and freehand pedicle screw placement in spine surgery: A meta-analysis and systematic review. J. Orthop. Surg. Res. 2023, 18, 359. [Google Scholar] [CrossRef] [PubMed]
  4. Al-Naseem, A.O.; Al-Muhannadi, A.; Ramadhan, M.; Alfadhli, A.; Marwan, Y.; Shafafy, R.; Abd-El-Barr, M.M. Robot-assisted pedicle screw insertion versus navigation-based and freehand techniques for posterior spinal fusion in scoliosis: A systematic review and meta-analysis. Spine Deform. 2024, 12, 1203–1215. [Google Scholar] [CrossRef] [PubMed]
  5. Mobbs, R.J.; Sivabalan, P.; Li, J. Technique, challenges and indications for percutaneous pedicle screw fixation. J. Clin. Neurosci. 2011, 18, 741–749. [Google Scholar] [CrossRef] [PubMed]
  6. Lu, J.; Chen, Y.; Hu, M.; Sun, C. Systematic review and meta-analysis of the effect of using percutaneous pedicle screw internal fixation for thoracolumbar fractures. Ann. Palliat. Med. 2022, 11, 250–259. [Google Scholar] [CrossRef] [PubMed]
  7. Mezger, U.; Jendrewski, C.; Bartels, M. Navigation in surgery. Langenbecks Arch. Surg. 2013, 398, 501–514. [Google Scholar] [CrossRef] [PubMed]
  8. Ewurum, C.H.; Guo, Y.; Pagnha, S.; Feng, Z.; Luo, X. Surgical navigation in orthopedics: Workflow and system review. Adv. Exp. Med. Biol. 2018, 1093, 47–63. [Google Scholar] [PubMed]
  9. Gharagozloo, F.; Patel, V.R.; Giulianotti, P.C.; Poston, R.; Gruessner, R.; Meyer, M. Robotic Surgery, 2nd ed.; Springer: Berlin/Heidelberg, Germany, 2021. [Google Scholar]
  10. Knez, D.; Likar, B.; Pernus, F.; Vrtovec, T. Computer-assisted screw size and insertion trajectory planning for pedicle screw placement surgery. IEEE Trans. Med. Imaging 2016, 35, 1420–1430. [Google Scholar] [CrossRef] [PubMed]
  11. Knez, D.; Mohar, J.; Cirman, R.J.; Likar, B.; Pernuš, F.; Vrtovec, T. Variability analysis of manual and computer-assisted preoperative thoracic pedicle screw placement planning. Spine 2018, 43, 1487–1495. [Google Scholar] [CrossRef] [PubMed]
  12. Cai, D.; Wang, Z.; Liu, Y.; Zhang, Q.; Han, X.; Liu, W. Automatic path planning for navigated pedicle screw surgery based on deep neural network. In Proceedings of the 2nd WRC Symposium on Advanced Robotics and Automation, Beijing, China, 21–22 August 2019. [Google Scholar]
  13. Qi, X.; Meng, J.; Li, M.; Yang, Y.; Hu, Y.; Li, B. An automatic path planning method of pedicle screw placement based on preoperative CT images. IEEE Trans. Med. Robot. Bionics. 2022, 4, 403–413. [Google Scholar] [CrossRef]
  14. Zhang, Y.; Liu, W.; Zhao, J.; Wang, D.; Peng, F.; Cui, S.; Wang, B.; Shi, Z.; Liu, B.; He, D.; et al. Improving pedicle screw path planning by vertebral posture estimation. Phys. Med. Biol. 2023, 68, 185011. [Google Scholar] [CrossRef] [PubMed]
  15. Massalimova, A.; Bauer, D.; Cavalcanti, N.; Carrillo, F.; Mazda, F.; Fuernstahl, P. Feasibility of automatic screw planning via transformer-based shape completion from RGB-D imaging. Sci. Rep. 2025, 15, 37617. [Google Scholar] [CrossRef] [PubMed]
  16. Schroeder, W.; Maynard, R.; Geveci, B. Flying edges: A high-performance scalable isocontouring algorithm. In Proceedings of the 2015 IEEE 5th Symposium on Large Data Analysis and Visualization (LDAV), Chicago, IL, USA, 25–26 October 2015. [Google Scholar]
  17. Lorensen, W.E.; Cline, H.E. Marching Cubes: A high resolution 3D surface construction algorithm. In Proceedings of the 14th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH ’87), Anaheim, CA, USA, 27–31 July 1987; Volume 21, pp. 163–169. [Google Scholar]
  18. Qi, C.R.; Su, H.; Mo, K.; Guibas, L.J. PointNet: Deep learning on point sets for 3D classification and segmentation. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA, 21–26 July 2017. [Google Scholar]
  19. Hwang, S.; Lee, S.J.; Kim, S. Surgical navigation system for pedicle screw placement based on mixed reality. Int. J. Control Autom. Syst. 2023, 21, 3983–3993. [Google Scholar] [CrossRef]
  20. Zhu, Q.; Fan, L.; Weng, N. Advancements in point cloud data augmentation for deep learning: A survey. Pattern Recognit. 2024, 153, 110532. [Google Scholar] [CrossRef]
  21. Fedorov, A.; Beichel, R.; Kalpathy-Cramer, J.; Finet, J.; Fillion-Robin, J.; Pujol, S.; Bauer, C.; Jennings, D.; Fennessy, F.; Sonka, M.; et al. 3D Slicer as an image computing platform for the quantitative imaging network. Magn. Reson. Imaging 2012, 30, 1323–1341. [Google Scholar] [CrossRef] [PubMed]
  22. Gertzbein, S.D.; Robbins, S.E. Accuracy of pedicular screw placement in vivo. Spine 1990, 15, 11–14. [Google Scholar] [CrossRef] [PubMed]
  23. Chang, Y.-Z.; Sahani, S.K.; Wu, C.-T. Automated Patient-Specific C1–C2 Posterior Cervical Fusion Screw Trajectory Planning Using 3D Deep Learning. In Proceedings of the International Joint Conference on Neural Networks (IJCNN), Yokohama, Japan, 30 June–5 July 2024; pp. 1–6. [Google Scholar]
  24. Janssens, R.; Zeng, G.; Zheng, G. Fully automatic segmentation of lumbar vertebrae from CT images using cascaded 3D fully convolutional networks. In Proceedings of the 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018), Washington, DC, USA, 4–7 April 2018. [Google Scholar]
  25. Lu, J.T.; Pedemonte, S.; Bizzo, B.; Doyle, S.; Andriole, K.P.; Michalski, M.H.; Gilberto Gonzalez, R.; Pomerantz, S.R. Deep spine: Automated lumbar vertebral segmentation, disc-level designation, and spinal stenosis grading using deep learning. In Proceedings of the Machine Learning for Healthcare Conference, Palo Alto, CA, USA, 17–18 August 2018. [Google Scholar]
  26. Lee, J.; Kim, S.; Kim, Y.S.; Chung, W.K. Optimal surgical planning guidance for lumbar spinal fusion considering operational safety and vertebra-screw interface strength. Int. J. Med. Robot. 2012, 8, 261–272. [Google Scholar] [CrossRef] [PubMed]
  27. Cho, W.; Cho, S.K.; Wu, C. The biomechanics of pedicle screw-based instrumentation. J. Bone Jt. Surg. Br. 2010, 92, 1061–1065. [Google Scholar] [CrossRef] [PubMed]
Figure 1. Illustration of pedicle screw placement and the trajectory of the inserted screw.
Figure 1. Illustration of pedicle screw placement and the trajectory of the inserted screw.
Electronics 15 00468 g001
Figure 2. Framework for preoperative planning of pedicle screw placement.
Figure 2. Framework for preoperative planning of pedicle screw placement.
Electronics 15 00468 g002
Figure 3. Preprocessing steps for generating centered polygonal models of vertebrae and assigning labels to each model.
Figure 3. Preprocessing steps for generating centered polygonal models of vertebrae and assigning labels to each model.
Electronics 15 00468 g003
Figure 4. Data augmentation using three-dimensional rotation operations and sampling point clouds from the surfaces of augmented vertebrae models.
Figure 4. Data augmentation using three-dimensional rotation operations and sampling point clouds from the surfaces of augmented vertebrae models.
Electronics 15 00468 g004
Figure 5. Neural network architectures for the conventional and modified PointNet. The modified architecture omits the input and output transformations, and the output layer generates two three-dimensional control points.
Figure 5. Neural network architectures for the conventional and modified PointNet. The modified architecture omits the input and output transformations, and the output layer generates two three-dimensional control points.
Electronics 15 00468 g005
Figure 6. Loss measurement for machine learning. The sum of D 1 and D 2 is calculated as the total loss.
Figure 6. Loss measurement for machine learning. The sum of D 1 and D 2 is calculated as the total loss.
Electronics 15 00468 g006
Figure 7. Determination of the screw trajectory on a the left pedicle of the lumbar 1 vertebra.
Figure 7. Determination of the screw trajectory on a the left pedicle of the lumbar 1 vertebra.
Electronics 15 00468 g007
Figure 8. Illustration of a bilaterally predicted screw trajectory generated from the trained neural networks (blue cylinder) and ground truth trajectory (red cylinder) for an unseen lumbar spine, visualized alongside cylinder models for evaluation. (a) Superior-inferior view of lumbar vertebrae models with axial slices, including the projection of cylinder models onto the CT images. (b) Visualization of lumbar vertebrae models with the predicted left pedicle screw trajectories. (c) Visualization of lumbar vertebrae models with the predicted right pedicle screw trajectories.
Figure 8. Illustration of a bilaterally predicted screw trajectory generated from the trained neural networks (blue cylinder) and ground truth trajectory (red cylinder) for an unseen lumbar spine, visualized alongside cylinder models for evaluation. (a) Superior-inferior view of lumbar vertebrae models with axial slices, including the projection of cylinder models onto the CT images. (b) Visualization of lumbar vertebrae models with the predicted left pedicle screw trajectories. (c) Visualization of lumbar vertebrae models with the predicted right pedicle screw trajectories.
Electronics 15 00468 g008
Figure 9. Four axial slices of lumbar vertebrae showing the intersection boundary of cylinder models along the screw trajectory generated from the trained neural network (blue) and ground truth trajectory (red). The screw trajectories from the trained neural network are classified as grade B. (a) Right pedicle of L4. (b) Left pedicle of L1. (c) Right pedicle of L2. (d) Left pedicle of L2.
Figure 9. Four axial slices of lumbar vertebrae showing the intersection boundary of cylinder models along the screw trajectory generated from the trained neural network (blue) and ground truth trajectory (red). The screw trajectories from the trained neural network are classified as grade B. (a) Right pedicle of L4. (b) Left pedicle of L1. (c) Right pedicle of L2. (d) Left pedicle of L2.
Electronics 15 00468 g009
Table 1. Translational error at the entry and target points based on the labeled trajectories.
Table 1. Translational error at the entry and target points based on the labeled trajectories.
LeftRight
VertebranEntry (mm)Target (mm)Entry (mm)Target (mm)
L161.9 ± 1.12.6 ± 1.61.1 ± 0.72.0 ± 0.3
L261.2 ± 0.61.9 ± 0.71.5 ± 0.92.0 ± 0.9
L361.5 ± 0.92.2 ± 1.51.8 ± 0.72.4 ± 1.4
L451.4 ± 1.02.4 ± 1.51.8 ± 0.83.1 ± 0.8
L551.3 ± 0.52.1 ± 0.91.2 ± 0.61.9 ± 1.4
Total281.5 ± 0.82.3 ± 1.21.5 ± 0.72.3 ± 1.0
Table 2. Angular error between the predicted and the labeled trajectories.
Table 2. Angular error between the predicted and the labeled trajectories.
VertebranLeft (deg)Right (deg)
L164.4 ± 2.92.9 ± 0.8
L262.7 ± 1.23.8 ± 1.7
L363.5 ± 3.24.5 ± 2.2
L455.2 ± 2.15.3 ± 1.0
L553.1 ± 1.82.8 ± 1.3
Total283.5 ± 2.33.9 ± 1.7
Table 3. Clinical accuracy based on Gertzbein–Robbins classification.
Table 3. Clinical accuracy based on Gertzbein–Robbins classification.
GradeLeft (n)Right (n)
A2626
B22
C00
D00
E00
Total2828
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Hwang, S.; Lee, S.-J.; Kim, S. Preoperative Surgical Planning for Lumbar Spine Pedicle Screw Placement Using PointNet. Electronics 2026, 15, 468. https://doi.org/10.3390/electronics15020468

AMA Style

Hwang S, Lee S-J, Kim S. Preoperative Surgical Planning for Lumbar Spine Pedicle Screw Placement Using PointNet. Electronics. 2026; 15(2):468. https://doi.org/10.3390/electronics15020468

Chicago/Turabian Style

Hwang, Seokbin, Suk-Joong Lee, and Sungmin Kim. 2026. "Preoperative Surgical Planning for Lumbar Spine Pedicle Screw Placement Using PointNet" Electronics 15, no. 2: 468. https://doi.org/10.3390/electronics15020468

APA Style

Hwang, S., Lee, S.-J., & Kim, S. (2026). Preoperative Surgical Planning for Lumbar Spine Pedicle Screw Placement Using PointNet. Electronics, 15(2), 468. https://doi.org/10.3390/electronics15020468

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop