Next Article in Journal
Pediatric Type 1 Diabetes: Is Age at Onset a Determining Factor in Advanced Hybrid Closed-Loop Insulin Therapy?
Next Article in Special Issue
Low Response Rate to Follow-Up Using Telemedicine after Total Knee Replacement during the COVID-19 Pandemic in Italy
Previous Article in Journal
Real-World Efficacy and Safety of an 8-Week Glecaprevir/Pibrentasvir Regimen in Children and Adolescents with Chronic Hepatitis C—Results of a Multicenter EpiTer-2 Study
Previous Article in Special Issue
Evaluation of Isokinetic Knee Strengths after ACL Reconstruction with Quadrupled Semitendinosus Suspensory Femoral and Tibial Fixation versus Four-Strand Semitendinosus and Gracilis Suspensory Femoral and Tibial Screw Fixation
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Initial Learning Curve for Robot-Assisted Total Knee Arthroplasty in a Dedicated Orthopedics Center

by
Serban Dragosloveanu
1,2,
Mihnea-Alexandru Petre
2,
Bogdan Sorin Capitanu
2,
Christiana Diana Maria Dragosloveanu
1,3,
Romica Cergan
1,4 and
Cristian Scheau
1,4,*
1
The “Carol Davila” University of Medicine and Pharmacy, 050474 Bucharest, Romania
2
Department of Orthopaedics, “Foisor” Clinical Hospital of Orthopaedics, Traumatology and Osteoarticular TB, 021382 Bucharest, Romania
3
Department of Ophthalmology, Clinical Hospital for Ophthalmological Emergencies, 010464 Bucharest, Romania
4
Department of Radiology and Medical Imaging, “Foisor” Clinical Hospital of Orthopaedics, Traumatology and Osteoarticular TB, 021382 Bucharest, Romania
*
Author to whom correspondence should be addressed.
J. Clin. Med. 2023, 12(21), 6950; https://doi.org/10.3390/jcm12216950
Submission received: 16 October 2023 / Revised: 30 October 2023 / Accepted: 4 November 2023 / Published: 6 November 2023
(This article belongs to the Special Issue Advances in Knee Surgery and Musculoskeletal Rehabilitation)

Abstract

:
Background and objectives: Our study aimed to assess the learning curve for robot-assisted (RA) total knee arthroplasty (TKA) in our hospital, compare operative times between RA-TKAs and manual TKAs, and assess the early complications rate between the two approaches. Methods: We included 39 patients who underwent RA-TKA and 45 control patients subjected to manual TKA in the same period and operated on by the same surgical staff. We collected demographic and patient-related data to assess potential differences between the two groups. Results: No statistical differences were recorded in regard to age, BMI, sex, Kellgren–Lawrence classification, or limb alignment between patients undergoing RA-TKA and manual TKA, respectively. Three surgeons transitioned from the learning to the proficiency phase in our study after a number of 6, 4, and 3 cases, respectively. The overall operative time for the learning phase was 111.54 ± 20.45 min, significantly longer compared to the average of 86.43 ± 19.09 min in the proficiency phase (p = 0.0154) and 80.56 ± 17.03 min for manual TKAs (p < 0.0001). No statistically significant difference was recorded between the global operative time for the proficiency phase TKAs versus the controls. No major complications were recorded in either RA-TKA or manual TKA groups. Conclusions: Our results suggest that experienced surgeons may adopt RA-TKA using this platform and quickly adapt without significant complications.

1. Introduction

Total knee arthroplasty (TKA) is a highly effective orthopedic treatment for patients with symptomatic end-stage knee osteoarthritis (OA), a common condition in the elderly population and one of the leading causes of disability [1,2,3]. Recent studies have shown that implant survivorship may be higher than 90% at 10 years of follow-up [4,5], with a patient satisfaction rate within the range of 75% to 92% [6,7,8,9]. Despite advances in materials used for implants, improvement in designs, surgical approaches, recovery programs, thromboembolic and antibiotic prophylaxis patient satisfaction rate is lower compared to patients following total hip arthroplasty [10,11,12]. A variety of surgeon-dependent variables may affect patient outcomes, such as implant positioning, flexion-extension gaps, soft tissue preservation, etc. [13,14].
Robotic technology has emerged as a technological method aiming to eliminate human error and improve patient outcomes. The first robotic-assisted TKA (RA-TKA) was performed in 1988 in the United Kingdom using the ACROBOT® robotic system [15]. The main advantages of robotic surgery over manual TKA are the reduction of postoperative alignment outliers, improvement in gap balance, and increased reproducibility of postoperative knee biomechanics [16,17].
Robots used for TKA are either semi-active or fully active [16]. Semi-active robotic systems enable the surgeon to maintain control over bone resection and implant positioning and provide live intraoperative assistance; examples include ROSA® (Zimmer-Biomet, Warsaw, IN, USA), Mako (Stryker, Kalamazoo, MI, USA), and NAVIO (Smith & Nephew, London, UK). Fully active robotic systems work autonomously to perform femoral and tibial bone resections (e.g., DigiMatch™ ROBODOC® surgical system, Curexo Technology Corp, Fremont, CA, USA), while the surgeon supervises the bone resection and may stop the process if needed [18,19].
The Robotic Surgical Assistant (ROSA®) Knee robot was developed by Zimmer-Biomet in collaboration with MedTech [20]. This system is an interactive robotic platform with a robotic arm that allows the cutting guides to be optimally positioned based on the intraoperative plan determined using navigation jigs. The surgeon performs the surgical approach, retractors positioning, and sawing process [21].
There are, however, several reported controversies about RA-TKA, including the high cost of installation, compatibility with certain prosthetic designs, and potentially higher radiation exposure [22]. Moreover, availability for the entirety of surgical staff and accommodation to robotic or navigation systems were also reported as limitations of these systems [23].
The primary objective of this study was to assess the learning curve of experienced high-volume orthopedic surgeons performing RA-TKA using the ROSA® platform in our dedicated orthopedics hospital. Additionally, we compared the operative times and rate of complications between RA-TKA and manual TKA surgeries. We hypothesized that the cumulative experience of the surgical staff in performing RA-TKA would lead to improved operative times with comparable surgical complications.

2. Materials and Methods

2.1. Study Population

Our retrospective cohort study included 84 patients who underwent TKA in our hospital between March and September 2023. The study group consisted of a subset of 39 consecutive patients undergoing RA-TKA and 45 consecutive patients undergoing manual TKA. All patients subjected to RA-TKA during the specified period were considered for this study, as well as all patients where manual TKA was performed in the same time intervals by the same surgical staff training with ROSA® as controls for comparing the operative time. Patients for each surgeon were randomly assigned either to the RA-TKA or the manual TKA group and scheduled for surgery based on the availability of the ROSA® system (Tx2 version 1.2). The inclusion criteria were patients over 18 years old with symptomatic end-stage OA and correctable varus/valgus deformity of <15 degrees. The exclusion criteria were patients with tumoral involvement of the knee, inflammatory arthritis, neurological conditions affecting knee mobility, knee instability, or previous primary TKA.
We collected a series of demographic parameters such as age, sex, and BMI to ensure consistency between subgroups. Radiological scores and parameters such as the Kellgren–Lawrence score and the hip–knee–ankle angle were also employed.
Ethical approval was obtained from the Institutional Ethics Council. All procedures related to patient care and processing of their medical data were performed in accordance with the Declaration of Helsinki adopted in 1964 and its later amendments.

2.2. Surgical Protocol

All ROSA®-assisted TKAs were performed as described in the Zimmer Biomet ROSA surgical technique guide. After the initial correct positioning of the Robotic Unit and ROSA Optical Unit, the knee incision was performed with the preferred approach of the surgeon; in this case, subvastus and medial parapatellar approaches were used. The robotic arm preparation, case upload, robot settings, and draping were performed while the surgeon performed the surgical approach to the knee. The second step was installing the femoral and tibial trackers according to the ROSA® surgical guide. Two femoral pins were installed in the proximal medial side of the distal femur. The two tibial pins were placed 4 fingers distally to the distal part of the wound, on the anteromedial tibial crest. The pins were 3.2 mm diameter ROSA®-specific pins. The next step was the assessment of the femoral head center of rotation (Figure 1) and digitalization of the bony landmarks (Figure 2 and Figure 3).
After acquiring the femoral and tibial bony landmarks, the surgeon assessed the knee range of motion and performed varus and valgus laxity tests (Figure 4), while also removing large osteophytes that could have negatively influenced these tests.
All ROSA®-assisted TKAs performed in this study were imageless cases. The last step before performing the bone cuts was the ROSA® software planning panel. After the appropriate balancing of the knee was achieved and the proper knee implant was selected, the surgeon performed the knee extension and flexion gaps (Figure 5). A restricted kinematic approach for balancing the knee was used in all cases.
The manual or “classic” TKAs were also performed taking into consideration the surgeons’ preferred surgical approach, i.e., the subvastus or medial parapatellar approach. For the femoral cut, all surgeons used the intramedullary guide, while for the tibial cut, both intra- and extramedullary NexGen® guides were used, depending on the surgeon’s preference. For balancing the knee, each surgeon used their preferred TKA alignment approach between anatomic, mechanical, and restricted kinematics. After balancing the extension gap using the necessary soft tissue release technique, the next step was achieving a balanced flexion gap using the 4-in-1 cutting guide.
For all RA-TKAs, the Persona® (The Personalized Knee®) PS prosthesis was used, while for all manual TKAs, the NexGen® Complete Knee Solution PS was the preferred choice. The order of bone cuts was identical for RA-TKAs and manual TKAs. Tourniquet usage in TKA procedures remains a subject of ongoing debate in the orthopedic literature, with advocates for both sides [24,25,26]. In this regard, in our service and for the purposes of this study, the tourniquet was prepared but not inflated.
The surgical staff had prior training workshops for robotic-assisted TKAs, especially for the ROSA® Knee robot. They were instructed on how to properly set up the surgical theater and ROSA® system. The surgical staff had the same composition throughout this study. A total of 12 surgeons underwent training with ROSA® and, for each of them, the operative time was assessed for every surgery. For each surgeon, both RA-TKAs and manual TKAs were performed using the same approach.

2.3. Complications

All patients were closely followed perioperatively by the case anesthesiologist and all complications, both related to the ROSA surgical technique and non-robotic-related situations, were recorded in the surgical protocol for each procedure.

2.4. Statistical Analysis

A cumulative summation (CUMSUM) analysis was performed to describe the learning curve and determine the inflection point, i.e., the transition from the learning phase into the proficiency (or experience) phase. The CUMSUM values for each surgeon were calculated as the running total of differences between the particular data point (i.e., surgical time) and the standardized target, which was established as the mean operative time for RA-TKAs performed by that surgeon. The t-test was used to compare continuous variables such as age or BMI across patient subgroups. Cohen’s d method was used to measure the size of the differences between the compared groups. The Chi-squared test was employed to determine whether the frequency of one parameter, such as gender or laterality, was significantly higher in a specific group. Analysis of variance was used to compare operative times across categories. The data were tested for normal distribution using the Shapiro–Wilk test. The statistical software used in this study was MedCalc® Version 14.8.1 (MedCalc Software Ltd., Ostend, Belgium). Results were considered statistically significant for p-values < 0.05.

3. Results

A comparison of baseline demographics was performed and the results are depicted in Table 1 and Table S1. No statistical differences were recorded between the two subgroups. However, in terms of the mechanical axis of the lower limb, we identified six patients with valgus alignment in the manual TKA group, while no patients with valgus underwent RA-TKA in our study.
The analysis of the operative times for RA-TKA showed that only three surgeons achieved the inflection point by the end of our study. The respective CUMSUM analysis for each surgeon is presented in Figure 6. The surgeons transitioned from the learning phase to the proficiency phase after 6, 3, and 4 cases, respectively.
A further comparative analysis was performed on the cases undergoing RA-TKA in the learning phase, cases performed in the proficiency phase, and patients operated by manual TKA in the same time period by the three surgeons (Table 2 and Table S2).
The overall operative time for the learning phase was significantly longer than both the times of surgeries performed in the proficiency phase and that of manual TKAs. No statistically significant difference was recorded between the global operative time for the proficiency phase TKAs versus the controls.
A detailed analysis of the operative times of each surgeon revealed that surgeries performed in the learning phase took significantly longer than those performed in the proficiency phase or the controls for Surgeons 1 and 3 (p < 0.001). However, we found significant differences between surgeons regarding the operative times of the three subgroups; the fastest manual TKAs were performed on average by Surgeon 1, while Surgeon 2 had the longest operative time (p < 0.001). In the learning phase, surgeries took significantly longer for Surgeon 3 than for Surgeon 1 (p = 0.0105), while in the proficiency phase, Surgeon 1 was faster than both Surgeons 2 and 3 (p < 0.01) (Figure 7).
No major complications were recorded in the RA-TKA or manual TKA groups. We recorded no wound dehiscence or infection, joint stiffness, urinary infections, central or peripheral neurologic complications, unexpected pain, or edema of the limbs. No postoperative pin insertion site infection occurred. At the time of this study, there were no documented perioperative or delayed complications related to the surgical protocol, including but not limited to acute or delayed periprosthetic infection, ligament instability, periprosthetic fracture, or thromboembolism.

4. Discussion

The primary objective of our study was to assess the average number of procedures needed by each surgeon to reach the inflection point between the learning and proficiency phases. Our study concluded that to achieve the proficiency state, each surgeon needed to complete a number of 6, 3, and 4 cases, respectively, for the three surgeons. We aimed to compare our findings with existing reports; however, there is a relative scarcity of literature data on ROSA-assisted TKA due to the novelty of the technology. Nevertheless, previous studies on the learning curve of other robotic systems, such as the one published by Kayani et al. [27], state that after the initial learning phase, the average RA-TKA time was similar to that of manual TKA. This finding is similar to those of several studies on RA-TKA [28,29,30,31,32]. Bolam et al. stated that the proficiency state was reached as early as after case number 5 [29]. Vanlommel et al. completed the learning curve after 6 ROSA® TKAs [33], while Kayani et al. reported that 7 cases are sufficient to reach the inflection point [27]. Other reports cited longer learning curves, requiring 12 or more RA-TKA cases to transition to the proficiency phase [31,32].
Upon examination, the steep learning curve can be attributed to multiple factors, ranging from each surgeon’s experience in TKA procedures, with each surgeon performing 300+ TKA procedures annually, to the extensive resources available at our hospital dedicated solely to orthopedic procedures. The extensive experience of the surgeons can lead to confidence in the robotic-assisted procedure and the implementation of minor adjustments in the surgical technique, such as a reduced necessity for additional gap validation, quicker balancing plan of the knee, and enhanced comprehension of ROSA® RA-TKA.
In our study, the average manual TKA duration was 80.56 ± 17.03 min, slightly shorter than the duration declared in other studies, such as the paper of Shah et al. [34], who reported an average surgical procedure duration of 116 ± 25 min over 1300 primary TKA interventions. In the study of Halawi et al. in 2020 [35], a number of 287 Medicare, Medicaid, and other commercial insurance TKAs were analyzed. The median intraoperative duration for TKA procedures was 113 min [35].
We recorded an average duration for RA-TKA of 111.54 ± 20.45 min in the learning phase and 86.43 ± 19.09 min in the proficiency phase. These durations fall within the typical time depicted in the available studies on primary TKA procedures [27,34,35]. No statistically significant difference was recorded between the operative time for the proficiency phase TKAs versus the controls represented by manual TKAs. Since no complications were recorded in these two groups, we consider that the surgeons had an acceptable manual TKA operative time, and reaching similar times in the proficiency phase was an ideal result. Literature data show that comparable operative times to manual TKA can be achieved with robotic-assisted technology within several months following its debut [28]. Moreover, longitudinal studies show that surgical times can keep improving even up to one year from the adoption of RA-TKA [36]. In their study, Weber et al. reached similar conclusions as they performed manual TKAs in an average of 77.3 min, while navigated TKAs took slightly longer, with an average of 84.1 min [37]. The similar operative times can be attributed to the fact that while RA-TKAs require some preparation, this can be performed concurrently with the surgical approach of the knee; moreover, while RA-TKA involves a series of specific steps such as pin placement, knee soft tissue evaluation, and bone reference acquisition and balancing, which are distinct from those performed during manual TKA, some surgical steps are not required, such as drilling the femoral canal or setting up an extra/intramedullary tibial guide [38,39,40]. Therefore, it is reasonable to obtain an overall similar operative time between the two methods. Nevertheless, some authors report much shorter operative times, with no significant differences regarding complications, accuracy, or patient outcomes [41].
Another particular finding of our study was the difference in operative times between orthopedic surgeons. This can be attributed, in part, to their particular medical background; type, intensity, and duration of prior medical training; and surgical mastery skills. While all surgeons benefited from the same training workshops for the ROSA® system, personal surgical aptitudes can play a major role, especially when using a preferred surgical approach, as was the case in our study [42,43,44].
The constantly evolving field of medicine, especially regarding TKA surgical procedures, has raised the quality of patient care, efficiency, and precision while lowering the risk of human error and postoperative complications [22,25,45,46,47,48,49]. Incorporating robotic-assisted technologies into routine TKA procedures contributes to improvements in surgical precision, overall results, consistency, and reproducibility by offering real-time validation and step-by-step feedback. This approach ultimately leads to a personalized method, taking into consideration the patient’s knee joint anatomy and the type of prosthesis being used [38].
As expected, the introduction of a new technique to the operating theater has a learning curve and might involve complications resulting from a surgeon’s inexperience [50,51]. Frequently reported drawbacks of utilizing new modern robotic technologies in the operating room are the initial extended duration of the surgical procedure, with an inherently higher risk of surgical site infection, and the higher risk of complications in the initial learning phase [52,53,54].
Robotic systems may help improve the skills of orthopedic surgeons and the workflow of TKAs [55,56,57]. However, there are some concerns that robotic-assisted surgery may have unsatisfactory results regarding mechanical axis alignments, leading to potential deficiencies in surgical outcomes [58]. TKA accuracy relies on adequate preoperative planning and an optimal choice of implant type and approach [2,59]. Nevertheless, various studies have noted acceptable outcomes and no additional risk of complications when using ROSA® compared to manual TKA [29]. Furthermore, it was shown that using this system decreases orthopedic surgeons’ stress levels and postural strain, potentially improving the ergonomics of the surgical act [60].
A challenging aspect in taking up RA-TKA is adapting to the new required steps, such as correctly acquiring the bone references, conducting the soft tissue knee state evaluation, and properly balancing the implant and knee joint. However, robotic assistance can be helpful for less experienced surgeons, and an increase in the accuracy and precision of in-training surgical fellows was observed when performing RA-TKA compared to manual TKA [61].
Another important feature of choosing RA-TKA over manual TKA is the supplementary cost associated with the robotic surgery. The cost per case was reported to be higher in RA-TKA compared to manual TKA in a recent study that included more than 4700 cases [62]. Nevertheless, a longitudinal financial analysis showed that within 3 months, costs are actually lower in robotic-assisted arthroplasty due to fewer readmissions, shorter hospital stays, and less frequent discharge into skilled nursing facilities, with patients usually going to home care [63]. The cost savings are further increased up to one year after RA-TKA, with no significant differences in complications or readmission rates [64]. These encouraging results are confirmed by the increased interest in RA-TKA, despite the high initial cost, and is preferred to manual TKA in multiple hospitals worldwide [65,66,67,68,69]. The decreased blood loss combined with superior patient outcomes and reduction in revision TKA and opioid use are strong arguments in favor of choosing RA-TKA over manual TKA [65,66,67,70].
Our study has several limitations, including the size of the study population. Only three surgeons achieved the inflection point, while the others had an insufficient number of cases needed to reach the proficiency phase. However, we included all available RA-TKA cases in order to properly assess the overall learning process and the arising complications during this period. Moreover, considering the high volume of procedures performed in our dedicated orthopedics hospital, short learning curves of the surgical staff were expected. These findings may be transferable to other tertiary centers with an intensive focus on arthroplasty but are potentially less relevant in hospitals where trauma or oncology play larger roles in the daily routine. Nevertheless, our study showed that experienced surgeons may adopt RA-TKA using this platform and quickly adapt without significant complications.

5. Conclusions

Robot-assisted total knee arthroplasty represents a major leap forward in orthopedic surgery. Our results suggest that this method can be quickly adopted, especially by experienced high-volume surgeons, and its implementation into routine practice may be considered achievable within a reasonable time frame. Equally importantly, we did not identify a higher rate of perioperative complications in patients subjected to robotic surgery compared to controls. In the evolving field of orthopedics, our findings support the implementation of robot-assisted technology, which can be beneficial to patients and healthcare systems alike and can improve the surgical outcomes and quality of care of patients undergoing total knee arthroplasty.

Supplementary Materials

The following supporting information can be downloaded at https://www.mdpi.com/article/10.3390/jcm12216950/s1: Table S1: Cohen’s d effect sizes for baseline parameters comparison between RA-TKA and manual TKA in the patient group; Table S2: Cohen’s d effect sizes for pairwise comparison of parameters between RA-TKA subgroups and manual TKA patients.

Author Contributions

Conceptualization, methodology, and validation, S.D., M.-A.P. and C.S.; formal analysis, R.C. and C.S.; investigation and resources, M.-A.P., B.S.C. and C.D.M.D.; writing—original draft preparation, S.D., M.-A.P., B.S.C., C.D.M.D., R.C. and C.S.; writing—review and editing, S.D., R.C. and C.S.; visualization, M.-A.P. and B.S.C.; supervision, R.C. and C.S. All authors have read and agreed to the published version of the manuscript.

Funding

Publication of this paper was supported by the University of Medicine and Pharmacy Carol Davila, through the institutional program Publish not Perish.

Institutional Review Board Statement

This study was conducted in accordance with the Declaration of Helsinki and approved by the Ethics Council of the “Foisor” Clinical Hospital of Orthopaedics, Traumatology, and Osteoarticular TB (registration no. 4956/22 May 2023).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The data presented in this study are available upon reasonable request from the corresponding author.

Conflicts of Interest

The authors declare no conflict of interest. The funders had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript; or in the decision to publish the results.

References

  1. Kayani, B.; Haddad, F.S. Robotic total knee arthroplasty: Clinical outcomes and directions for future research. Bone Jt. Res. 2019, 8, 438–442. [Google Scholar] [CrossRef] [PubMed]
  2. Cristea, S.; Predescu, V.; Dragosloveanu, S.; Cuculici, S.; Marandici, N. Surgical Approaches for Total Knee Arthroplasty; IntechOpen: London, UK, 2016; pp. 25–47. [Google Scholar] [CrossRef]
  3. Schwabe, M.T.; Hannon, C.P. The Evolution, Current Indications and Outcomes of Cementless Total Knee Arthroplasty. J. Clin. Med. 2022, 11, 6608. [Google Scholar] [CrossRef] [PubMed]
  4. Argenson, J.-N.; Boisgard, S.; Parratte, S.; Descamps, S.; Bercovy, M.; Bonnevialle, P.; Briard, J.-L.; Brilhault, J.; Chouteau, J.; Nizard, R. Survival analysis of total knee arthroplasty at a minimum 10 years’ follow-up: A multicenter French nationwide study including 846 cases. Orthop. Traumatol. Surg. Res. 2013, 99, 385–390. [Google Scholar] [CrossRef] [PubMed]
  5. Ollivier, M.; Parratte, S.; Lino, L.; Flecher, X.; Pesenti, S.; Argenson, J.-N. No benefit of computer-assisted TKA: 10-year results of a prospective randomized study. Clin. Orthop. Relat. Res. 2018, 476, 126. [Google Scholar] [CrossRef]
  6. Bourne, R.B.; Chesworth, B.M.; Davis, A.M.; Mahomed, N.N.; Charron, K.D. Patient satisfaction after total knee arthroplasty: Who is satisfied and who is not? Clin. Orthop. Relat. Res. 2010, 468, 57–63. [Google Scholar] [CrossRef]
  7. Choi, Y.-J.; Ra, H.J. Patient satisfaction after total knee arthroplasty. Knee Surg. Relat. Res. 2016, 28, 1. [Google Scholar] [CrossRef]
  8. Stoica, C.I.; Nedelea, G.; Cotor, D.C.; Gherghe, M.; Georgescu, D.E.; Dragosloveanu, C.; Dragosloveanu, S. The Outcome of Total Knee Arthroplasty for Patients with Psychiatric Disorders: A Single-Center Retrospective Study. Medicina 2022, 58, 1277. [Google Scholar] [CrossRef]
  9. Merle-Vincent, F.; Couris, C.M.; Schott, A.-M.; Conrozier, T.; Piperno, M.; Mathieu, P.; Vignon, É.; Osteoarthritis Section of the French Society for Rheumatology. Factors predicting patient satisfaction 2 years after total knee arthroplasty for osteoarthritis. Jt. Bone Spine 2011, 78, 383–386. [Google Scholar] [CrossRef]
  10. Bourne, R.B.; Chesworth, B.; Davis, A.; Mahomed, N.; Charron, K. Comparing patient outcomes after THA and TKA: Is there a difference? Clin. Orthop. Relat. Res. 2010, 468, 542–546. [Google Scholar] [CrossRef]
  11. Gunaratne, R.; Pratt, D.N.; Banda, J.; Fick, D.P.; Khan, R.J.K.; Robertson, B.W. Patient Dissatisfaction Following Total Knee Arthroplasty: A Systematic Review of the Literature. J. Arthroplast. 2017, 32, 3854–3860. [Google Scholar] [CrossRef]
  12. Klem, N.R.; Smith, A.; O’Sullivan, P.; Dowsey, M.M.; Schütze, R.; Kent, P.; Choong, P.F.; Bunzli, S. What Influences Patient Satisfaction after TKA? A Qualitative Investigation. Clin. Orthop. Relat. Res. 2020, 478, 1850–1866. [Google Scholar] [CrossRef] [PubMed]
  13. Hampp, E.L.; Chughtai, M.; Scholl, L.Y.; Sodhi, N.; Bhowmik-Stoker, M.; Jacofsky, D.J.; Mont, M.A. Robotic-arm assisted total knee arthroplasty demonstrated greater accuracy and precision to plan compared with manual techniques. J. Knee Surg. 2019, 32, 239–250. [Google Scholar] [CrossRef] [PubMed]
  14. Alesi, D.; Meena, A.; Fratini, S.; Rinaldi, V.G.; Cammisa, E.; Lullini, G.; Vaccari, V.; Zaffagnini, S.; Marcheggiani Muccioli, G.M. Total knee arthroplasty in valgus knee deformity: Is it still a challenge in 2021? Musculoskelet. Surg. 2022, 106, 1–8. [Google Scholar] [CrossRef] [PubMed]
  15. Shatrov, J.; Parker, D. Computer and robotic—Assisted total knee arthroplasty: A review of outcomes. J. Exp. Orthop. 2020, 7, 70. [Google Scholar] [CrossRef]
  16. St Mart, J.-P.; Goh, E.L. The current state of robotics in total knee arthroplasty. EFORT Open Rev. 2021, 6, 270. [Google Scholar] [CrossRef]
  17. Song, E.-K.; Seon, J.-K.; Yim, J.-H.; Netravali, N.A.; Bargar, W.L. Robotic-assisted TKA reduces postoperative alignment outliers and improves gap balance compared to conventional TKA. Clin. Orthop. Relat. Res. 2013, 471, 118–126. [Google Scholar] [CrossRef]
  18. Park, S.E.; Lee, C.T. Comparison of robotic-assisted and conventional manual implantation of a primary total knee arthroplasty. J. Arthroplast. 2007, 22, 1054–1059. [Google Scholar] [CrossRef]
  19. Haddad, F. Evolving techniques: The need for better technology. Bone Jt. J. 2017, 99, 145–146. [Google Scholar] [CrossRef]
  20. Technology, O.D. Medtech Marks First ROSA Surgery System Sale in U.S. Available online: https://www.odtmag.com/contents/view_breaking-news/2016-03-14/medtech-marks-first-rosa-surgery-system-sale-in-us/ (accessed on 12 October 2023).
  21. Li, T.; Badre, A.; Alambeigi, F.; Tavakoli, M. Robotic Systems and Navigation Techniques in Orthopedics: A Historical Review. Appl. Sci. 2023, 13, 9768. [Google Scholar] [CrossRef]
  22. Kayani, B.; Konan, S.; Ayuob, A.; Onochie, E.; Al-Jabri, T.; Haddad, F.S. Robotic technology in total knee arthroplasty: A systematic review. EFORT Open Rev. 2019, 4, 611–617. [Google Scholar] [CrossRef]
  23. Batailler, C.; Hannouche, D.; Benazzo, F.; Parratte, S. Concepts and techniques of a new robotically assisted technique for total knee arthroplasty: The ROSA knee system. Arch. Orthop. Trauma Surg. 2021, 141, 2049–2058. [Google Scholar] [CrossRef] [PubMed]
  24. Dennis, D.A.; Kittelson, A.J.; Yang, C.C.; Miner, T.M.; Kim, R.H.; Stevens-Lapsley, J.E. Does tourniquet use in TKA affect recovery of lower extremity strength and function? A randomized trial. Clin. Orthop. Relat. Res. 2016, 474, 69–77. [Google Scholar] [CrossRef] [PubMed]
  25. Dragosloveanu, S.; Dragosloveanu, C.; Petre, M.; Gherghe, M.E.; Cotor, D.C. The Impact of Tourniquet Usage on TKA Outcome: A Single-Center Prospective Trial. Medicina 2023, 59, 870. [Google Scholar] [CrossRef]
  26. Tai, T.-W.; Lin, C.-J.; Jou, I.-M.; Chang, C.-W.; Lai, K.-A.; Yang, C.-Y. Tourniquet use in total knee arthroplasty: A meta-analysis. Knee Surg. Sports Traumatol. Arthrosc. 2011, 19, 1121–1130. [Google Scholar] [CrossRef] [PubMed]
  27. Kayani, B.; Konan, S.; Huq, S.; Tahmassebi, J.; Haddad, F. Robotic-arm assisted total knee arthroplasty has a learning curve of seven cases for integration into the surgical workflow but no learning curve effect for accuracy of implant positioning. Knee Surg. Sports Traumatol. Arthrosc. 2019, 27, 1132–1141. [Google Scholar] [CrossRef]
  28. Sodhi, N.; Khlopas, A.; Piuzzi, N.S.; Sultan, A.A.; Marchand, R.C.; Malkani, A.L.; Mont, M.A. The learning curve associated with robotic total knee arthroplasty. J. Knee Surg. 2018, 31, 17–21. [Google Scholar] [CrossRef]
  29. Bolam, S.M.; Tay, M.L.; Zaidi, F.; Sidaginamale, R.P.; Hanlon, M.; Munro, J.T.; Monk, A.P. Introduction of ROSA robotic-arm system for total knee arthroplasty is associated with a minimal learning curve for operative time. J. Exp. Orthop. 2022, 9, 86. [Google Scholar] [CrossRef]
  30. Bell, C.; Grau, L.; Orozco, F.; Ponzio, D.; Post, Z.; Czymek, M.; Ong, A. The successful implementation of the Navio robotic technology required 29 cases. J. Robot. Surg. 2022, 16, 495–499. [Google Scholar] [CrossRef]
  31. Mahure, S.A.; Teo, G.M.; Kissin, Y.D.; Stulberg, B.N.; Kreuzer, S.; Long, W.J. Learning curve for active robotic total knee arthroplasty. Knee Surg. Sports Traumatol. Arthrosc. 2022, 30, 2666–2676. [Google Scholar] [CrossRef]
  32. Naziri, Q.; Cusson, B.C.; Chaudhri, M.; Shah, N.V.; Sastry, A. Making the transition from traditional to robotic-arm assisted TKA: What to expect? A single-surgeon comparative-analysis of the first-40 consecutive cases. J. Orthop. 2019, 16, 364–368. [Google Scholar] [CrossRef]
  33. Vanlommel, L.; Neven, E.; Anderson, M.B.; Bruckers, L.; Truijen, J. The initial learning curve for the ROSA® Knee System can be achieved in 6-11 cases for operative time and has similar 90-day complication rates with improved implant alignment compared to manual instrumentation in total knee arthroplasty. J. Exp. Orthop. 2021, 8, 119. [Google Scholar] [CrossRef] [PubMed]
  34. Shah, R.P.; Lauthen, D.; Geller, J.A.; Cooper, H.J. Average operative times for 1313 primary total hip arthroplasty and 1300 primary total knee arthroplasty over 39 months are roughly equal to Medicare attributed operative times. J. Arthroplast. 2019, 34, 1553–1556. [Google Scholar] [CrossRef] [PubMed]
  35. Halawi, M.J.; Mirza, M.; Osman, N.; Cote, M.P.; Kerr, J.M.; Huddleston, J.I. Quantifying surgeon work in total hip and knee arthroplasty: Where do we stand today? J. Arthroplast. 2020, 35, 1170–1173. [Google Scholar] [CrossRef] [PubMed]
  36. Marchand, K.B.; Ehiorobo, J.; Mathew, K.K.; Marchand, R.C.; Mont, M.A. Learning Curve of Robotic-Assisted Total Knee Arthroplasty for a High-Volume Surgeon. J. Knee Surg. 2022, 35, 409–415. [Google Scholar] [CrossRef]
  37. Weber, M.; Worlicek, M.; Voellner, F.; Woerner, M.; Benditz, A.; Weber, D.; Grifka, J.; Renkawitz, T. Surgical training does not affect operative time and outcome in total knee arthroplasty. PLoS ONE 2018, 13, e0197850. [Google Scholar] [CrossRef]
  38. Massé, V.; Cholewa, J.; Shahin, M. Personalized alignment™ for total knee arthroplasty using the ROSA(®) Knee and Persona(®) knee systems: Surgical technique. Front. Surg. 2023, 9, 1098504. [Google Scholar] [CrossRef]
  39. Selvanathan, N.; Ayeni, F.E.; Sorial, R. Incidence of soft tissue releases in robotic assisted cementless TKA with mechanical alignment and flexion gap balancing. Arthroplasty 2023, 5, 28. [Google Scholar] [CrossRef]
  40. Lonner, J.H.; Goh, G.S. Moving beyond radiographic alignment: Applying the Wald Principles in the adoption of robotic total knee arthroplasty. Int. Orthop. 2023, 47, 365–373. [Google Scholar] [CrossRef]
  41. Stulberg, B.N.; Zadzilka, J.D.; Kreuzer, S.; Kissin, Y.D.; Liebelt, R.; Long, W.J.; Campanelli, V. Safe and effective use of active robotics for TKA: Early results of a multicenter study. J. Orthop. 2021, 26, 119–125. [Google Scholar] [CrossRef]
  42. Lee, D.; Yu, H.W.; Kwon, H.; Kong, H.J.; Lee, K.E.; Kim, H.C. Evaluation of Surgical Skills during Robotic Surgery by Deep Learning-Based Multiple Surgical Instrument Tracking in Training and Actual Operations. J. Clin. Med. 2020, 9, 1964. [Google Scholar] [CrossRef]
  43. Pakkasjärvi, N.; Krishnan, N.; Ripatti, L.; Anand, S. Learning Curves in Pediatric Robot-Assisted Pyeloplasty: A Systematic Review. J. Clin. Med. 2022, 11, 6935. [Google Scholar] [CrossRef] [PubMed]
  44. Perazzini, P.; Trevisan, M.; Sembenini, P.; Alberton, F.; Laterza, M.; Marangon, A.; Magnan, B. The Mako™ robotic arm-assisted total hip arthroplasty using direct anterior approach: Surgical technique, skills and pitfals. Acta Bio-Medica Atenei Parm. 2020, 91, 21–30. [Google Scholar] [CrossRef]
  45. Hampp, E.L.; Sodhi, N.; Scholl, L.; Deren, M.E.; Yenna, Z.; Westrich, G.; Mont, M.A. Less iatrogenic soft-tissue damage utilizing robotic-assisted total knee arthroplasty when compared with a manual approach: A blinded assessment. Bone Jt. Res. 2019, 8, 495–501. [Google Scholar] [CrossRef] [PubMed]
  46. Jacofsky, D.J.; Allen, M. Robotics in arthroplasty: A comprehensive review. J. Arthroplast. 2016, 31, 2353–2363. [Google Scholar] [CrossRef]
  47. King, C.A.; Jordan, M.; Bradley, A.T.; Wlodarski, C.; Tauchen, A.; Puri, L. Transitioning a practice to robotic total knee arthroplasty is correlated with favorable short-term clinical outcomes—A single surgeon experience. J. Knee Surg. 2020, 35, 078–082. [Google Scholar] [CrossRef]
  48. Liow, M.H.L.; Goh, G.S.-H.; Wong, M.K.; Chin, P.L.; Tay, D.K.-J.; Yeo, S.-J. Robotic-assisted total knee arthroplasty may lead to improvement in quality-of-life measures: A 2-year follow-up of a prospective randomized trial. Knee Surg. Sports Traumatol. Arthrosc. 2017, 25, 2942–2951. [Google Scholar] [CrossRef]
  49. Aparisi Gómez, M.P.; Marcheggiani Muccioli, G.M.; Guglielmi, G.; Zaffagnini, S.; Bazzocchi, A. Particularities on Anatomy and Normal Postsurgical Appearances of the Knee. Radiol. Clin. N. Am. 2023, 61, 219–247. [Google Scholar] [CrossRef]
  50. Ali, M.; Phillips, D.; Kamson, A.; Nivar, I.; Dahl, R.; Hallock, R. Learning curve of robotic-assisted total knee arthroplasty for non-fellowship-trained orthopedic surgeons. Arthroplast. Today 2022, 13, 194–198. [Google Scholar] [CrossRef]
  51. Sarpong, N.O.; Herndon, C.L.; Held, M.B.; Neuwirth, A.L.; Hickernell, T.R.; Geller, J.A.; Cooper, H.J.; Shah, R.P. What is the learning curve for new technologies in total joint arthroplasty? A review. Curr. Rev. Musculoskelet. Med. 2020, 13, 675–679. [Google Scholar] [CrossRef]
  52. Teo, B.J.X.; Yeo, W.; Chong, H.-C.; Tan, A.H.C. Surgical site infection after primary total knee arthroplasty is associated with a longer duration of surgery. J. Orthop. Surg. 2018, 26, 2309499018785647. [Google Scholar] [CrossRef]
  53. Ravi, B.; Jenkinson, R.; O’Heireamhoin, S.; Austin, P.C.; Aktar, S.; Leroux, T.S.; Paterson, M.; Redelmeier, D.A. Surgical duration is associated with an increased risk of periprosthetic infection following total knee arthroplasty: A population-based retrospective cohort study. EClinicalMedicine 2019, 16, 74–80. [Google Scholar] [CrossRef] [PubMed]
  54. Peersman, G.; Laskin, R.; Davis, J.; Peterson, M.; Richart, T. Prolonged operative time correlates with increased infection rate after total knee arthroplasty. HSS J. 2006, 2, 70–72. [Google Scholar] [CrossRef] [PubMed]
  55. Knapp, P.W.; Nett, M.P.; Scuderi, G.R. Optimizing Total Knee Arthroplasty with ROSA® Robotic Technology. Surg. Technol. Int. 2022, 40, 289–296. [Google Scholar] [CrossRef] [PubMed]
  56. Motesharei, A.; Batailler, C.; De Massari, D.; Vincent, G.; Chen, A.F.; Lustig, S. Predicting robotic-assisted total knee arthroplasty operating time: Benefits of machine-learning and 3D patient-specific data. Bone Jt. Open 2022, 3, 383–389. [Google Scholar] [CrossRef]
  57. Khlopas, A.; Sodhi, N.; Sultan, A.A.; Chughtai, M.; Molloy, R.M.; Mont, M.A. Robotic Arm-Assisted Total Knee Arthroplasty. J. Arthroplast. 2018, 33, 2002–2006. [Google Scholar] [CrossRef] [PubMed]
  58. Shin, C.; Crovetti, C.; Huo, E.; Lionberger, D. Unsatisfactory accuracy of recent robotic assisting system ROSA for total knee arthroplasty. J. Exp. Orthop. 2022, 9, 82. [Google Scholar] [CrossRef]
  59. Dragosloveanu, S.; Petre, M.A.; Gherghe, M.E.; Nedelea, D.G.; Scheau, C.; Cergan, R. Overall Accuracy of Radiological Digital Planning for Total Hip Arthroplasty in a Specialized Orthopaedics Hospital. J. Clin. Med. 2023, 12, 4503. [Google Scholar] [CrossRef]
  60. Haffar, A.; Krueger, C.A.; Goh, G.S.; Lonner, J.H. Total Knee Arthroplasty with Robotic Surgical Assistance Results in Less Physician Stress and Strain Than Conventional Methods. J. Arthroplast. 2022, 37, S193–S200. [Google Scholar] [CrossRef]
  61. Scholl, L.Y.; Hampp, E.L.; de Souza, K.M.; Chang, T.-C.; Deren, M.; Yenna, Z.C.; Sodhi, N.; Mont, M.A.; Westrich, G.H. How does robotic-arm assisted technology influence total knee arthroplasty implant placement for surgeons in fellowship training? J. Knee Surg. 2020, 35, 198–203. [Google Scholar] [CrossRef]
  62. Tompkins, G.S.; Sypher, K.S.; Li, H.F.; Griffin, T.M.; Duwelius, P.J. Robotic Versus Manual Total Knee Arthroplasty in High Volume Surgeons: A Comparison of Cost and Quality Metrics. J. Arthroplast. 2022, 37, S782–S789. [Google Scholar] [CrossRef]
  63. Cool, C.L.; Jacofsky, D.J.; Seeger, K.A.; Sodhi, N.; Mont, M.A. A 90-day episode-of-care cost analysis of robotic-arm assisted total knee arthroplasty. J. Comp. Eff. Res. 2019, 8, 327–336. [Google Scholar] [CrossRef] [PubMed]
  64. Ong, K.L.; Coppolecchia, A.; Chen, Z.; Watson, H.N.; Jacofsky, D.; Mont, M.A. Robotic-Arm Assisted Total Knee Arthroplasty: Cost Savings Demonstrated at One Year. Clin. Outcomes Res. 2022, 14, 309–318. [Google Scholar] [CrossRef] [PubMed]
  65. Heinz, T.; Eidmann, A.; Anderson, P.; Weißenberger, M.; Jakuscheit, A.; Rudert, M.; Stratos, I. Trends in Computer-Assisted Surgery for Total Knee Arthroplasty in Germany: An Analysis Based on the Operative Procedure Classification System between 2010 to 2021. J. Clin. Med. 2023, 12, 549. [Google Scholar] [CrossRef] [PubMed]
  66. Cotter, E.J.; Wang, J.; Illgen, R.L. Comparative Cost Analysis of Robotic-Assisted and Jig-Based Manual Primary Total Knee Arthroplasty. J. Knee Surg. 2022, 35, 176–184. [Google Scholar] [CrossRef]
  67. Sousa, P.L.; Sculco, P.K.; Mayman, D.J.; Jerabek, S.A.; Ast, M.P.; Chalmers, B.P. Robots in the Operating Room During Hip and Knee Arthroplasty. Curr. Rev. Musculoskelet. Med. 2020, 13, 309–317. [Google Scholar] [CrossRef] [PubMed]
  68. Steffens, D.; Karunaratne, S.; McBride, K.; Gupta, S.; Horsley, M.; Fritsch, B. Implementation of robotic-assisted total knee arthroplasty in the public health system: A comparative cost analysis. Int. Orthop. 2022, 46, 481–488. [Google Scholar] [CrossRef]
  69. Stauss, R.; Savov, P.; Tuecking, L.R.; Windhagen, H.; Ettinger, M. Robotic-assisted TKA reduces surgery duration, length of stay and 90-day complication rate of complex TKA to the level of noncomplex TKA. Arch. Orthop. Trauma Surg. 2023, 143, 3423–3430. [Google Scholar] [CrossRef]
  70. Tompkins, G.S.; Sypher, K.S.; Griffin, T.M.; Duwelius, P.D. Can a Reduction in Revision Rates Make Robotic Total Knee Arthroplasty Cost Neutral with Manual Total Knee Arthroplasty at Ten-Year Follow-Up? An Episode Cost Analysis. J. Arthroplast. 2022, 37, S777–S781.e773. [Google Scholar] [CrossRef]
Figure 1. Assessing femoral head center.
Figure 1. Assessing femoral head center.
Jcm 12 06950 g001
Figure 2. Capturing femoral bony landmarks.
Figure 2. Capturing femoral bony landmarks.
Jcm 12 06950 g002
Figure 3. Capturing tibial bony landmarks.
Figure 3. Capturing tibial bony landmarks.
Jcm 12 06950 g003
Figure 4. Assessing the range of motion of the knee, performing varus–valgus stress for ligament laxity.
Figure 4. Assessing the range of motion of the knee, performing varus–valgus stress for ligament laxity.
Jcm 12 06950 g004
Figure 5. Balancing software (version 1.2).
Figure 5. Balancing software (version 1.2).
Jcm 12 06950 g005
Figure 6. CUMSUM analysis of the learning curves for the three surgeons that passed from the learning phase to the proficiency phase. The transition between phases is marked by the vertical dashed line (i.e., inflection point).
Figure 6. CUMSUM analysis of the learning curves for the three surgeons that passed from the learning phase to the proficiency phase. The transition between phases is marked by the vertical dashed line (i.e., inflection point).
Jcm 12 06950 g006
Figure 7. Operative times for each surgeon depicting their average times in the learning curve for robotic-assisted versus manual total knee arthroplasties. Each individual case is depicted by a circle. TKA = Total knee arthroplasty.
Figure 7. Operative times for each surgeon depicting their average times in the learning curve for robotic-assisted versus manual total knee arthroplasties. Each individual case is depicted by a circle. TKA = Total knee arthroplasty.
Jcm 12 06950 g007
Table 1. Baseline parameters in the patient group.
Table 1. Baseline parameters in the patient group.
ParameterRA-TKA,
n = 39
Manual TKA,
n = 45
p-Value
Age (years)69.15 ± 5.2467.22 ± 7.700.1896
BMI (kg/m2)30.82 ± 4.9530.11 ± 4.090.4770
Sex (male/female)8/319/360.8306
Laterality (left/right)18/2123/220.8146
Kellgren–Lawrence classification (percentage)
   315180.9362
   42427
Limb alignment (number, HKA angle)
   Varus 39, 4.97 ± 2.27°39, 5.00 ± 2.36°0.9611
   Valgus-6, 5.17 ± 2.27°-
TKA = Total knee arthroplasty; RA-TKA = Robotic-assisted total knee arthroplasty; BMI = Body mass index; HKA = Hip–knee–ankle.
Table 2. Overall comparison between RA-TKA subgroups and manual TKA patients.
Table 2. Overall comparison between RA-TKA subgroups and manual TKA patients.
ParameterLearning PhaseProficiency PhaseManual TKAp-Value
Age (years)68.00 ± 5.4969.71 ± 7.8967.94 ± 7.710.835
BMI (kg/m2)32.35 ± 5.3330.91 ± 7.8830.20 ± 4.030.432
Sex (male/female)4/92/56/250.6778
Laterality (left/right)6/72/515/160.6333
Kellgren–Lawrence classification (percentage)
   333100.6519
   410421
Pre-operative varus (HKA)5.30 ± 2.53°5.85 ± 2.79° 4.93 ± 2.40°0.663
Operative time (minutes)111.54 ± 20.4586.43 ± 19.0980.56 ± 17.03<0.001 1
1 Tukey–Kramer test showed significant differences in the learning phase vs. proficiency phase and manual TKA. TKA = Total knee arthroplasty; RA-TKA = Robotic-assisted total knee arthroplasty; BMI = Body mass index; HKA = Hip–knee–ankle.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Dragosloveanu, S.; Petre, M.-A.; Capitanu, B.S.; Dragosloveanu, C.D.M.; Cergan, R.; Scheau, C. Initial Learning Curve for Robot-Assisted Total Knee Arthroplasty in a Dedicated Orthopedics Center. J. Clin. Med. 2023, 12, 6950. https://doi.org/10.3390/jcm12216950

AMA Style

Dragosloveanu S, Petre M-A, Capitanu BS, Dragosloveanu CDM, Cergan R, Scheau C. Initial Learning Curve for Robot-Assisted Total Knee Arthroplasty in a Dedicated Orthopedics Center. Journal of Clinical Medicine. 2023; 12(21):6950. https://doi.org/10.3390/jcm12216950

Chicago/Turabian Style

Dragosloveanu, Serban, Mihnea-Alexandru Petre, Bogdan Sorin Capitanu, Christiana Diana Maria Dragosloveanu, Romica Cergan, and Cristian Scheau. 2023. "Initial Learning Curve for Robot-Assisted Total Knee Arthroplasty in a Dedicated Orthopedics Center" Journal of Clinical Medicine 12, no. 21: 6950. https://doi.org/10.3390/jcm12216950

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop