Next Article in Journal
A Review of Research on Dropwise Condensation Heat Transfer
Next Article in Special Issue
Genetic Deletion of Interleukin-15 Is Not Associated with Major Structural Changes Following Experimental Post-Traumatic Knee Osteoarthritis in Rats
Previous Article in Journal
Shaking Table Test on the Response of a Cross Interchange Metro Station under Harmonic Excitations Refers to a Single Two-Storey Metro Station
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Knee MRI Underestimates the Grade of Cartilage Lesions

1
Department of Traumatology and Emergency Medicine, Medical University of Lublin, Staszica 11, 20-081 Lublin, Poland
2
Department of Machine Design and Mechatronics, Faculty of Mechanical Engineering, Lublin University of Technology, Nadbystrzycka 36, 20-618 Lublin, Poland
*
Author to whom correspondence should be addressed.
Appl. Sci. 2021, 11(4), 1552; https://doi.org/10.3390/app11041552
Submission received: 21 December 2020 / Revised: 5 February 2021 / Accepted: 5 February 2021 / Published: 9 February 2021

Abstract

:
Purpose: This study was conducted in order to evaluate the clinical utility of MRI in detecting cartilage lesions and its dependence on anatomical location and lesion grade. Methods: A retrospective analysis of MRI reports and arthroscopic findings was performed on 190 consecutive patients treated in one orthopaedic department. MRI protocols were prepared by 18 radiologists from 10 different MRI centers with the use of 1.5 T magnets. The image protocols were selected by reading radiologists. Four hundred and fifty-three chondral lesions in five anatomic locations were identified during this study and graded according to the ICRS classification. Sensitivity, specificity, receiver operating characteristic (ROC), and Bangdiwala’s observer agreement charts were utilized to evaluate the diagnostic performance. Results: Only approximately 30% of MRI showed an adequate cartilage status in all anatomical locations. The sensitivity ranged from 92% in healthy cartilage to 5% in grade I lesions. The specificity differed also grossly depending on the lesion grade, reaching 96.5% in grade four lesions and 38% in healthy cartilage. The medial compartment Bangdiwala’s observer agreement charts show a gross underestimation of cartilage lesions, and the area under the curve (AUC) of ROC surpasses 0.7 only in the medial femoral condyle and patella-femoral joint. Overall, the medial compartment accuracy was significantly higher than the lateral compartment. The MRI showed correspondence of its diagnostic performance with cartilage lesion severity. Conclusion: MRI underestimates the extent of cartilage injury and evaluation of cartilage defects based on MRI should be taken with caution by orthopaedic surgeons in planning surgery. Surgical planning on MRI should take cartilage lesions under consideration, even if no cartilage lesions are reported on the MRI.

1. Introduction

Chondral defects are a common cause of knee dysfunction found in over 60% of patients requiring arthroscopy [1]. It has become an important topic due to the poor healing capacity of the cartilage and the progressive nature of chondral defects irreversibly leading to osteoarthritis if untreated [2]. The complex mesh of collagen fibres enables the cartilage to withstand shearing forces, while water accumulated by proteoglycans is responsible for resisting compressive forces. The only widely accessible non-invasive modality appropriate for the detection of cartilage lesions is magnetic resonance imaging (MRI) [3]. However, the literature suggests that a pure morphologic evaluation of cartilage lacks sensitivity in detecting cartilage defects and provides insufficient information regarding exact cartilage grading [3]. Moreover, the sensitivity of the examination differs grossly in the literature, ranging from 45% up to 94% [4,5], with some authors even suggesting that the MRI might not be helpful in cases with a typical history and firm clinical findings [6]. In pursuit of a better cartilage evaluation, new imaging techniques based on MRI have been introduced in recent years. These techniques include sodium imaging, delayed gadolinium-enhanced MRI of cartilage (dGEMRIC), glycosaminioglycan specific chemical exchange saturation transfer (gagCEST), diffusion-weighted imaging (DWI), diffusion tensor imaging (DTI), and relaxometry measurements [7]. Such techniques enable the differentiation between a healthy and repaired cartilage [8], can correspond with glycosaminoglycans concentration [9,10,11], or enable the quantitative monitoring of macromolecules in early osteoarthritis [12]. Therefore, the techniques in question might be suitable for the detection and evaluation of early cartilage changes as well as an accurate cartilage evaluation. However, the techniques present certain limitations. First, the availability of specialized techniques is limited. Moreover, dGEMRIC requires gadolinium administration and potential side effects can be encountered [13]. Joint effusion can interfere with the gagCEST evaluation due to the presence of glycosaminoglycans in the synovial fluid [14].
Even after introducing a 3D MRI [15], which exhibits high sensitivity to grade III and IV lesions [16] and is more accessible than the compositional techniques, the 1.5 T MRI examination remains a workhorse for cartilage evaluation. Of special interest to the orthopaedic surgeons is the estimation of cartilage defect grade, size, and location, which strongly influences the decision of switching from a conservative to surgical treatment [17,18]. However, some authors suggest that the information obtained by MRI does not change scheduled arthroscopic surgeries and does not affect the overall treatment costs [19]. To date, there is a sparse number of articles presenting the diagnostic efficacy of MRI regarding the grade and lesion location in a typical clinical setting. A great number of papers published on the subject depend on the evaluation performed by a musculoskeletal radiologist, who is trained specifically for such diagnosis [20]. However, in many instances, the MRI is evaluated by a general radiologist, or often a referring orthopaedic surgeon that has no knowledge whether the radiologist specializes in musculoskeletal disorders. Moreover, clinical experience suggests that a routinely performed MRI may show significant differences in regard to the diagnostic accuracy of cartilage lesion depending on a lesion grade and anatomic location.
The aim of this study was to evaluate the sensitivity and specificity of MRI in detecting cartilage lesions and its dependence on anatomical location and lesion grade in the knee joint.

2. Materials and Methods

This retrospective cohort study was conducted on medical records of patients treated in the orthopaedic department of Leczna Hospital in Poland between September 2014 and February 2020. During this time, 190 consecutive knee arthroscopies with preoperatively obtained and stored MRI images and reports were performed. A bioethical committee at the Medical University in Lublin, with approval number KE-0254/262/2019, was obtained for the study. In addition, each patient signed a written consent concerning the use of medical data for clinical purposes without revealing personal data. Only examinations performed on 1.5 Tesla MRI with a full written report in the medical history were included in the study. MRI protocols were selected by radiology specialists based on an examination referral. In this study, we have not gained access to the referrals and had no influence on the MRI protocols or sequences used in the examination, which presents a common clinical setting. The MRI reports were prepared by 18 radiologists from 10 different MRI centres. There is no data concerning the experience or the field of interest of radiologists evaluating the images. The information of cartilage status was noted, and each articular cartilage deviation was noted in a written report. If no information on the cartilage defects was given, then the cartilage was regarded as a grade O as per the International Cartilage Repair Society (ICRS) [21,22]. A grade 0 for cartilage defects which are not mentioned was assumed due to the fact that an orthopaedic surgeon reading an MRI report will consider the lack of mentioning of cartilage defects as a healthy cartilage. This assumption was made in 57 patients. Arthroscopic surgery was a gold standard for the estimation of MRI diagnostic accuracy. All the surgeries were performed by three surgeons specializing in sports knee surgery with an experience of 5–15 years, with a standard 30-degree optics in a standardized eight-step knee evaluation. Typical antero-lateral and antero-medial portals with accessory portals (when indicated) were utilized for the surgery. Indications for the surgery were made by the treating surgeon, based on the medical history, along with clinical and radiological findings. During arthroscopy, chondral lesions were graded 0–4 with the use of the ICRS classification system [21,22]. Images presenting cartilage lesions are shown in Figure 1, Figure 2, Figure 3 and Figure 4. Locations such as medial femoral condyle (MFC), lateral femoral condyle (LFC), medial tibial condyle (MTC), lateral tibial condyle (LTC), and patellofemoral joint (PFJ) were evaluated. All the tissues during the arthroscopy were visualised and examined with a probe. Images of all the intraoperative findings were taken during the surgery and stored in the hospital database. The data concerning the cartilage status during arthroscopy was obtained from operative notes.

Statistical Analysis

The data were analysed by a statistics specialist with the use of Microsoft Excel and the IBM SPSS software. The overall capacity of MRI for detecting chondral lesions was estimated with the use of the receiver operating characteristic (ROC) curves. Additionally, the sensitivity and specificity for each anatomic location and the grade of lesion were counted, which is easy to incorporate in daily practice. These are values that describe the ability of a test to detect the trait being tested (sensitivity) or detect the absence of that trait (specificity). The sensitivity of a test is the ratio of true positives (TP) to the sum of true positives (TP) and false negatives (FN). Test specificity is the ratio of true negatives (TN) to the sum of true negatives (TN) and false positives (FP). The MRI diagnostic accuracy for each location was evaluated with the use of weighted Kappa [23] and visualized with Bangdiwala’s observer agreement charts [24], where a graphical presentation of the results compliance is determined by the size of the field. A black colour indicates compliance, while a grey colour indicates one adjacent level of compliance. The direction of the observer bias is verified by examining the “path of the rectangles” and its deviation from the diagonal line [24,25,26]. A perfect congruence is when the black rectangles line up along the red line and they are black, not grey. Rectangles along the diagonal but partially grey signify a partial agreement, but if they move away from the diagonal, then there is a systematic error in the method that underestimates or overestimates the diagnosis.The Kappa statistics proposed by the B statistics are used to quantify the agreement between two observers, independently classifying the same n units into the same k category [27]. The Kappa Cohen takes values from 0 to 1. The closer to 1, the more consistent the two observer’s assessments are, the closer to 0, the more divergent the marks are [28]. The most commonly used guidelines for Kappa are due to Landis and Koch [29]. The interpretation of the Kappa score according to Landis and Koch is as follows: 0—poor, 0 to 0.2 slight, 0.2 to 0.4 fair, 0.4 to 0.6 moderate, 0.6 to 0.8 substantial, and 0.8 to 1 almost perfect. The B-score interpretation was considered poor less than 0.25, fair 0.25 to 0.49, good 0.5 to 0.74, excellent 0.75 to 0.99, and perfect 1 [26].

3. Results

In our study, 74 females and 116 males were included with an average age of 41.3 (SD 15.3). The main indication for arthroscopic surgery were meniscal lesions (n = 88), followed by ACL tears (n = 75). Isolated chondral lesions without any concomitant intraarticular lesions were found in 27 patients. The mean time between the onset of symptoms to the MRI examination was 31 months (median 5.2). On average, patients waited nearly 4 months (3.9) for arthroscopic surgery after obtaining the MRI results. During arthroscopic surgery, chondral lesions were diagnosed in 139 knees, out of which 112 had concomitant injuries such as meniscal lesions or ACL tears. Grade II lesions were the most common in our study. Femoral condyles were affected more commonly by chondral lesions rather than by tibial condyles. Moreover, chondral lesions were most frequently found in the medial compartment. Overall, 453 chondral defects were encountered during arthroscopy. The lesions showed predilection for MFC (n = 118), followed by MTC (n = 91) and PFJ (n = 90). LFC and LTC were affected evenly and 77 lesions were found in each location. Chondral defects were multifocal and in over 90% (n = 106) of patients, multiple anatomical locations were involved. Only 7.2% (n = 33) of chondral lesions affected one location. The majority of isolated chondral lesions were located in MFC 54.5% (n = 18). Moreover, grade VI and III lesions were most prevalent on MFC, where nearly a half of grade IV defects was found 46.7% (n = 43), and one-third of grade III lesions 33% (n = 36). Grade IV chondral defects in the lateral compartment accounted only for 11% (n = 10) of all grade IV lesions. The results of the arthroscopic evaluation are shown in Table 1.
Grade II lesions were encountered most frequently, followed by grade I lesions. Even though grade IV lesions were the rarest, they accounted for one-fifth of all the lesions. An adequate description of cartilage status on MRI was found only in 59 patients in all anatomical locations during arthroscopy. In 119 patients, at least one anatomical location was underestimated regarding the chondral lesion grade, and in 48 patients, at least one location was overestimated. In 36 patients, at least one anatomical location was overestimated and at least one was underestimated in regard to lesion severity. The MRI showed low sensitivity ranging from 24% to 42% depending on the anatomical location. The highest sensitivity was found in MFC and PFJ. The mean specificity of MRI in detecting chondral lesions ranged from 82% to 87.4%. Moreover, the specificity was highest in MFC and PFJ. A healthy cartilage was properly evaluated in over 60% regardless of the anatomical location with sensitivity over 90% and specificity of 39%. The sensitivity of MRI was increasing proportionally with an increasing grade of the cartilage lesion. Grade I lesions showed sensitivity only of 4.8%, and grade IV of 39%. The specificity of MRI in detecting a healthy cartilage was estimated as only 39%. If the cartilage lesion was observed, then the specificity of the MRI ranged from 96% to 97%. A low sensitivity was found for grade I lesions not exceeding 10% in any anatomical location. The sensitivity of 0% was found for grade I MFC lesions and for grade III LTC lesions. Overall, the MRI capacity for detecting lesions was evaluated with ROC curves. The MRI showed the greatest capacity for detecting chondral lesions in PFJ with an AUC of 0.737, followed by MFC. A lowest capacity was observed in LTC with AUC reaching only 0.578. A summary of the sensitivity, specificity, ROC evaluation, Bangdiwala’s observer agreement charts, and Kappa values are shown in Table 2, Table 3 and Table 4 and Figure 5 and Figure 6.

4. Discussion

The key finding of this study is the underestimation of cartilage lesion by MRI. Cartilage lesions are one of the most common findings during knee arthroscopy [1]. Moreover, it has a poor healing capacity and often requires surgical intervention. Therefore, an adequate preoperative assessment of the cartilage status is an important factor for surgical planning. Multiple factors can affect the cartilage, such as overuse, trauma, post-surgical gait changes, or rheumatoid diseases, joint inflammation, or malalignment [30,31,32,33]. In our study, cartilage lesions were found in the vast majority of patients who underwent knee arthroscopy, and if apparent, then in the majority of cases, the lesions were multifocal. Femoral condyles and the medial knee compartment were found to be most commonly affected. Unfortunately, there are no specific clinical tests for the evaluation of articular cartilage, and distinguishing between chondral or meniscal lesions is impossible during physical examination [34]. For this purpose, MRI becomes the only available diagnostic modality for a routine cartilage examination [35]. In our study, we have chosen arthroscopic visualization as a gold standard in grading cartilage lesions. The overall good inter-observer reliability [36] can be lowered by the lack of surgeon experience [37]. Therefore, for this study, only experienced surgeons that specialized in sports were selected.
Literature data show gross discrepancy regarding the sensitivity of MRI in the cartilage evaluation ranging from 45% to 94% [38]. However, most of the studies were performed on small patient groups. In our study, we have found 453 chondral lesions affecting different anatomical locations in 190 patients. The overall diagnostic accuracy in detecting chondral lesions was rather weak, with Kappa values lower than 0.6. Only healthy cartilages and grade IV lesions were evaluated with acceptable accuracy. Similar findings are reported by Figueroe et al. [4], showing that diagnostic accuracy increases with the chondral lesion severity (in a prospective study on 190 knees). This phenomenon is also found in 3 T MRI examinations [16], where sensitivity for grade I lesions reached only 8.8%. The diagnostic accuracy was also dependable on the anatomic location, with the highest accuracy in the patellofemoral joint and the medial compartment of the knee. New MRI-based compositional and functional techniques are being proposed in the literature. Techniques such as DWI have a potential to distinguish between the healthy and diseased cartilage and, moreover, have the potential to distinguish the healthy cartilage from a repaired one [8]. Methods of functional cartilage evaluation are also proposed in the literature, including serial T1 and T2 mapping under loading [39]. Techniques such as T1rho have the ability to assess the proteoglycan concentration in the cartilage [21,40]. These techniques seem to be the most promising due to providing insight into the histologic composition of the cartilage. In addition, they require no administration of contrast agents and present an excellent range of interobserver reliability and capacity to detect even mild cartilage changes [41]. These new imaging techniques may be of wide use in the future and may perform better in grading and evaluating cartilage defects than the standard morphologic MRI. However, at the moment, the availability of such modalities is limited and papers concerning actual diagnostic performance in vivo are limited, as well. These techniques require further investigation.
The medial compartment of the knee was most commonly affected with grade III and IV lesions. As shown in our study as well as previous studies, the diagnostic accuracy increases with the lesion grade, which can explain the higher overall accuracy in the medial compartment of the knee. The results found in PFJ can be explained by a great visualization of the cartilage on transverse views, where one can appreciate the lesions with little effort. In our study, Kappa values for any anatomical location did not surpass 0.6, which strongly shows a discrepancy between MRI and arthroscopy findings. These findings are clearly represented on Bangdiwala’s observer agreement charts. The severity of the cartilage lesion was grossly underestimated, which can significantly affect the planned surgical procedure during arthroscopy.
Our study shows that even though MRI is the best available imaging modality for cartilage evaluation, it has significant weaknesses in regard to its specificity and sensitivity. It has a limited diagnostic accuracy for grade I-III chondral lesions. MRI showed the lowest sensitivity on the lateral tibial condyle, regardless of the lesion grade. This finding can be attributed to a small number of grade III and IV lesions, which are most apparent on the MRI. It is known that chondral lesions progress over time [42,43]. Therefore, in our study, we have taken into consideration the time-lapse between the examination and surgery. However, no significant correlation between the time-lapse and the diagnostic accuracy was found for any anatomical location or grade of chondral lesions (p = 0.783). The ROC analysis was utilized to evaluate the diagnostic performance of MRI for the detection of any lesion, regardless of the lesion grade in specific anatomical locations. Only MFC and PFJ showed an acceptable diagnostic accuracy, with AUC exceeding 0.7. This shows that lesions in the lateral compartment of the knee can be omitted during an MRI examination. A systemic review by Quatman et al. [44] showed similar results. In our study, we have used only 1.5 T scanners for the examination. However, a study by Kijowski et al. [45] suggests that 3 T scanners show a similar diagnostic performance as the standard MRI protocol. Therefore, some authors seek indirect methods of knee cartilage status evaluation. Carotti et al. [46] proposed the identification of early osteoarthrosis which is not based on the cartilage status, but on visible bone marrow lesions and infrapatellar fat pad synovitis. Such an approach can be explained by the so-called satisfaction of the search [47] when the detection of abnormality can reduce the detectability of other intraarticular lesions.
The bias of this study consists of the lack of access to MRI referrals. This could influence the low sensitivity and the accuracy of MRI in our study when no attention in the referral was put on cartilage evaluation. As shown by Solivetti et al. [48], approximately 40% of MRI referrals may be totally inappropriate or uncertain. Moreover, some authors suggest that an MRI examination prior to the planned arthroscopic surgery does not change the treatment strategy [19]. The findings are supported by other researchers [49], however, if the MRI is ordered by an orthopaedic surgeon, it has a greater impact on the planned treatment [50] compared to a primary care physician. The accurate referral may incline the usage of cartilage dedicated sequences, which improves the overall diagnostic accuracy [51]. The experience and training of a radiologist performing the cartilage evaluation is also a factor which influences the diagnostic performance of the MRI [52]. In conclusion, the MRI is the best available modality for cartilage evaluation. However, it should be used with caution, and an underestimation of the cartilage defect severity should be taken into consideration when planning a surgical procedure. Chondral lesions identification is acceptable only in MFC and PFJ. Apart from healthy cartilage and grade IV lesions, the MRI results should be suspected of severity underestimation.

5. Limitations

The bias of this study consists of MRI referrals which were made by multiple orthopaedic surgeons. In addition, we had no access to the MRI referrals, which could have influenced the MRI acquisition, sequences, and finally interpretation of examination. Moreover, we had no information on the radiologists’ experience in knee MRI, which could impact the overall diagnostic accuracy, if the experience was low. However, this setting represents the most common clinical presentation that an orthopaedic surgeon may encounter. Furthermore, a lack of blinding of the study could introduce a risk of bias. Even though the lack of information on the cartilage status is usually considered a healthy cartilage, in this study it could influence the overall results.

6. Conclusions

The MRI underestimates the extent of cartilage injury. In addition, the evaluation of cartilage defects based on the MRI should be taken with caution by orthopaedic surgeons planning a surgery. Surgical planning which is based on an MRI should take cartilage lesions under consideration, even if no cartilage lesions have been reported on the MRI scans.

Author Contributions

Conceptualization, P.K. and R.K.; methodology, P.K.; software, R.K.; validation, R.K. and M.J.; formal analysis, J.J. and R.K.; investigation, P.K., R.K., and. A.N.; resources, P.K.; data curation, R.K.; writing—original draft preparation, P.K.; writing—review and editing, R.K.; visualization, R.K.; supervision, J.J.; project administration, P.K.; funding acquisition, M.J. and R.K. All authors have read and agreed to the published version of the manuscript.

Funding

The research was financed by the Medical University of Lublin, grant no. DS 117.

Institutional Review Board Statement

The study was conducted according to the guidelines of the Declaration of Helsinki, and approved by the Ethics Committee of Medical University in Lublin with approval number KE-0254/262/2019.

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The data presented in this study are available on request from the corresponding author. The data are not publicly available due to patients privacy.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Curl, W.W.; Krome, J.; Gordon, E.S.; Rushing, J.; Smith, B.P.; Poehling, G.G. Cartilage Injuries: A Review of 31,516 Knee Arthroscopies. Arthroscopy 1997, 13, 456–460. [Google Scholar] [CrossRef]
  2. Cibere, J.; Sayre, E.C.; Guermazi, A.; Nicolaou, S.; Kopec, J.A.; Esdaile, J.M.; Thorne, A.; Singer, J.; Wong, H. Natural History of Cartilage Damage and Osteoarthritis Progression on Magnetic Resonance Imaging in a Population-Based Cohort with Knee Pain. Osteoarthr. Cartil. 2011, 19, 683–688. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  3. Palmer, A.J.R.; Brown, C.P.; McNally, E.G.; Price, A.J.; Tracey, I.; Jezzard, P.; Carr, A.J.; Jones, G.S. Non-Invasive Imaging of Cartilage in Early Osteoarthritis. Bone Jt. J. 2013, 95, 738–746. [Google Scholar] [CrossRef] [PubMed]
  4. Figueroa, D.; Calvo, R.; Vaisman, A.; Carrasco, M.A.; Moraga, C.; Delgado, I. Knee Chondral Lesions: Incidence and Correlation Between Arthroscopic and Magnetic Resonance Findings. Arthroscopy J. Arthrosc. Relat. Surg. 2007, 23, 312–315. [Google Scholar] [CrossRef]
  5. Bredella, M.A.; Tirman, P.F.; Peterfy, C.G.; Zarlingo, M.; Feller, J.F.; Bost, F.W.; Belzer, J.P.; Wischer, T.K.; Genant, H.K. Accuracy of T2-Weighted Fast Spin-Echo MR Imaging with Fat Saturation in Detecting Cartilage Defects in the Knee: Comparison with Arthroscopy in 130 Patients. Am. J. Roentgenol. 1999, 172, 1073–1080. [Google Scholar] [CrossRef] [Green Version]
  6. Thomas, S.; Pullagura, M.; Robinson, E.; Cohen, A.; Banaszkiewicz, P. The Value of Magnetic Resonance Imaging in Our Current Management of ACL and Meniscal Injuries. Knee Surg. Sports Traumatol. Arthrosc. 2007, 15, 533–536. [Google Scholar] [CrossRef]
  7. Guermazi, A.; Alizai, H.; Crema, M.D.; Trattnig, S.; Regatte, R.R.; Roemer, F.W. Compositional MRI Techniques for Evaluation of Cartilage Degeneration in Osteoarthritis. Osteoarthr. Cartil. 2015, 23, 1639–1653. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  8. Friedrich, K.M.; Mamisch, T.C.; Plank, C.; Langs, G.; Marlovits, S.; Salomonowitz, E.; Trattnig, S.; Welsch, G. Diffusion-Weighted Imaging for the Follow-up of Patients after Matrix-Associated Autologous Chondrocyte Transplantation. Eur. J. Radiol. 2010, 73, 622–628. [Google Scholar] [CrossRef] [PubMed]
  9. Lesperance, L.M.; Gray, M.L.; Burstein, D. Determination of Fixed Charge Density in Cartilage Using Nuclear Magnetic Resonance. J. Orthop. Res. 1992, 10, 1–13. [Google Scholar] [CrossRef]
  10. Allen, R.G.; Burstein, D.; Gray, M.L. Monitoring Glycosaminoglycan Replenishment in Cartilage Explants with Gadolinium-Enhanced Magnetic Resonance Imaging: Monitoring Glycosaminoglycan Replenishment with Mri. J. Orthop. Res. 1999, 17, 430–436. [Google Scholar] [CrossRef]
  11. Bashir, A.; Gray, M.L.; Boutin, R.D.; Burstein, D. Glycosaminoglycan in Articular Cartilage: In Vivo Assessment with Delayed Gd (DTPA) (2-)-Enhanced MR Imaging. Radiology 1997, 205, 551–558. [Google Scholar] [CrossRef]
  12. Regatte, R.R.; Akella, S.V.S.; Lonner, J.H.; Kneeland, J.B.; Reddy, R. T1ρ Relaxation Mapping in Human Osteoarthritis (OA) Cartilage: Comparison of T1ρ with T2. J. Magn. Reson. Imaging 2006, 23, 547–553. [Google Scholar] [CrossRef]
  13. Burstein, D.; Velyvis, J.; Scott, K.T.; Stock, K.W.; Kim, Y.J.; Jaramillo, D.; Boutin, R.D.; Gray, M.L. Protocol Issues for Delayed Gd (DTPA) (2-)-Enhanced MRI (DGEMRIC) for Clinical Evaluation of Articular Cartilage. Magn. Reason. Med. 2001, 45, 36–41. [Google Scholar] [CrossRef]
  14. Abrar, D.B.; Schleich, C.; Radke, K.L.; Frenken, M.; Stabinska, J.; Ljimani, A.; Wittsack, H.J.; Antoch, G.; Bittersohl, B.; Hesper, T.; et al. Detection of Early Cartilage Degeneration in the Tibiotalar Joint Using 3 T GagCEST Imaging: A Feasibility Study. Magn. Reason. Mater. Phy. 2020. [Google Scholar] [CrossRef]
  15. Shakoor, D.; Guermazi, A.; Kijowski, R.; Fritz, J.; Farahani, J.S.; Mohajer, B.; Eng, J.; Demehri, S. Diagnostic Performance of Three-Dimensional MRI for Depicting Cartilage Defects in the Knee: A Meta-Analysis. Radiology 2018, 289, 71–82. [Google Scholar] [CrossRef]
  16. Kohl, S.; Meier, S.; Ahmad, S.S.; Bonel, H.; Exadaktylos, A.K.; Krismer, A.; Evangelopoulos, D.S. Accuracy of Cartilage-Specific 3-Tesla 3D-DESS Magnetic Resonance Imaging in the Diagnosis of Chondral Lesions: Comparison with Knee Arthroscopy. J. Orthop. Surg. Res. 2015, 10, 191. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  17. Gomoll, A.H.; Farr, J.; Gillogly, S.D.; Kercher, J.S.; Minas, T. Surgical Management of Articular Cartilage Defects of the Knee. Instr. Course Lect. 2011, 60, 461–483. [Google Scholar] [PubMed]
  18. Smith, G.D.; Knutsen, G.; Richardson, J.B. A Clinical Review of Cartilage Repair Techniques. J. Bone Jt. Surg. Br. Vol. 2015, 87-B, 445–449. [Google Scholar] [CrossRef]
  19. Bryan, S.; Bungay, H.P.; Weatherburn, G.; Field, S. Magnetic Resonance Imaging for Investigation of the Knee Joint: A Clinical and Economic Evaluation. Int. J. Technol. Assess. Health Care 2004, 20, 222–229. [Google Scholar] [CrossRef] [PubMed]
  20. Smith, T.O.; Drew, B.T.; Toms, A.P.; Donell, S.T.; Hing, C.B. Accuracy of Magnetic Resonance Imaging, Magnetic Resonance Arthrography and Computed Tomography for the Detection of Chondral Lesions of the Knee. Knee Surg. Sports Traumatol. Arthrosc. 2012, 20, 2367–2379. [Google Scholar] [CrossRef] [PubMed]
  21. Cameron, M.L.; Briggs, K.K.; Steadman, J.R. Reproducibility and Reliability of the Outerbridge Classification for Grading Chondral Lesions of the Knee Arthroscopically. Am. J. Sports Med. 2003, 31, 83–86. [Google Scholar] [CrossRef] [PubMed]
  22. Brittberg, M.; Winalski, C.S. Evaluation of Cartilage Injuries and Repair. J. Bone Jt. Surg. Am. 2003, 85, 58–69. [Google Scholar] [CrossRef]
  23. Cohen, J. Weighted Kappa: Nominal Scale Agreement Provision for Scaled Disagreement or Partial Credit. Psychol. Bull. 1968, 70, 213–220. [Google Scholar] [CrossRef] [PubMed]
  24. Bangdiwala, S.I.; Haedo, A.S.; Natal, M.L.; Villaveces, A. The Agreement Chart as an Alternative to the Receiver-Operating Characteristic Curve for Diagnostic Tests. J. Clin. Epidemiol. 2008, 61, 866–874. [Google Scholar] [CrossRef] [PubMed]
  25. Bangdiwala, S.I.; Shankar, V. The Agreement Chart. BMC Med. Res. Methodol. 2013, 13, 97. [Google Scholar] [CrossRef] [Green Version]
  26. On behalf of the College of Intensive Care Medicine of Australia and New Zealand [CICM] Ultrasound Special Interest Group [USIG]; Orde, S.; Slama, M.; Yastrebov, K.; Mclean, A.; Huang, S. Subjective Right Ventricle Assessment by Echo Qualified Intensive Care Specialists: Assessing Agreement with Objective Measures. Crit. Care 2019, 23, 70. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  27. Munoz, S.R.; Bangdiwala, S.I. Interpretation of Kappa and B Statistics Measures of Agreement. J. Appl. Stat. 1997, 24, 105–112. [Google Scholar] [CrossRef]
  28. Warrens, M.J. Five Ways to Look at Cohen’s Kappa. J. Psychol. Psychother. 2015, 5, 1. [Google Scholar] [CrossRef] [Green Version]
  29. Landis, J.R.; Koch, G.G. The Measurement of Observer Agreement for Categorical Data. Biometrics 1977, 33, 159–174. [Google Scholar] [CrossRef] [Green Version]
  30. Roemer, F.; Jarraya, M.; Niu, J.; Silva, J.; Frobell, R.; Guemrazi, A. Increased Risk for Radiographic Osteoarthritis Features in Young Active Athletes: A Cross-Sectional Matched Case–Control Study. Osteoarthr. Cartil. 2015, 23, 239–243. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  31. Królikowska, A.; Czamara, A.; Kentel, M. Does Gracilis Tendon Harvest During ACL Reconstruction with a Hamstring Autograft Affect Torque of Muscles Responsible for Shin Rotation? Med. Sci. Monit. 2015, 21, 2084–2093. [Google Scholar] [CrossRef] [Green Version]
  32. Abrar, D.B.; Schleich, C.; Nebelung, S.; Frenken, M.; Ullrich, T.; Radke, K.L.; Antoch, G.; Vordenbäumen, S.; Brinks, R.; Schneider, M.; et al. Proteoglycan Loss in the Articular Cartilage Is Associated with Severity of Joint Inflammation in Psoriatic Arthritis—a Compositional Magnetic Resonance Imaging Study. Arthritis Res. Ther. 2020, 22, 124. [Google Scholar] [CrossRef]
  33. Said, O.; Schock, J.; Krämer, N.; Thüring, J.; Hitpass, L.; Schad, P.; Kuhl, C.; Abrar, D.; Truhn, D.; Nebelung, S. An MRI-Compatible Varus–Valgus Loading Device for Whole-Knee Joint Functionality Assessment Based on Compartmental Compression: A Proof-of-Concept Study. Magn. Reason. Mater. Phy. 2020, 33, 839–854. [Google Scholar] [CrossRef]
  34. Krakowski, P.; Nogalski, A.; Jurkiewicz, A.; Karpiński, R.; Maciejewski, R.; Jonak, J. Comparison of Diagnostic Accuracy of Physical Examination and MRI in the Most Common Knee Injuries. Appl. Sci. 2019, 9, 4102. [Google Scholar] [CrossRef] [Green Version]
  35. Crema, M.D.; Roemer, F.W.; Marra, M.D.; Burstein, D.; Gold, G.E.; Eckstein, F.; Baum, T.; Mosher, T.J.; Carrino, J.A.; Guermazi, A. Articular Cartilage in the Knee: Current MR Imaging Techniques and Applications in Clinical Practice and Research. Radiographics 2011, 31, 37–61. [Google Scholar] [CrossRef] [Green Version]
  36. Marx, R.G.; Connor, J.; Lyman, S.; Amendola, A.; Andrish, J.T.; Kaeding, C.; McCarty, E.C.; Parker, R.D.; Wright, R.W.; Spindler, K.P. Multirater Agreement of Arthroscopic Grading of Knee Articular Cartilage. Am. J. Sports Med. 2005, 33, 1654–1657. [Google Scholar] [CrossRef] [PubMed]
  37. Javed, A.; Siddique, M.; Vaghela, M.; Hui, A.C.W. Interobserver Variations in Intra-Articular Evaluation during Arthroscopy of the Knee. J. Bone Jt. Surg. Br. 2002, 84, 48–49. [Google Scholar] [CrossRef]
  38. Wong, K.P.L.; Han, A.X.; Wong, J.L.Y.; Lee, D.Y.H. Reliability of Magnetic Resonance Imaging in Evaluating Meniscal and Cartilage Injuries in Anterior Cruciate Ligament-Deficient Knees. Knee Surg. Sports Traumatol. Arthrosc. 2017, 25, 411–417. [Google Scholar] [CrossRef] [PubMed]
  39. Hafner, T.; Schock, J.; Post, M.; Abrar, D.B.; Sewerin, P.; Linka, K.; Knobe, M.; Kuhl, C.; Truhn, D.; Nebelung, S. A Serial Multiparametric Quantitative Magnetic Resonance Imaging Study to Assess Proteoglycan Depletion of Human Articular Cartilage and Its Effects on Functionality. Sci. Rep. 2020, 10, 15106. [Google Scholar] [CrossRef] [PubMed]
  40. Akella, S.V.S.; Regatte, R.R.; Gougoutas, A.J.; Borthakur, A.; Shapiro, E.M.; Kneeland, J.B.; Leigh, J.S.; Reddy, R. Proteoglycan-Induced Changes InT1? Relaxation of Articular Cartilage at 4T. Magn. Reson. Med. 2001, 46, 419–423. [Google Scholar] [CrossRef]
  41. MacKay, J.W.; Low, S.B.L.; Smith, T.O.; Toms, A.P.; McCaskie, A.W.; Gilbert, F.J. Systematic Review and Meta-Analysis of the Reliability and Discriminative Validity of Cartilage Compositional MRI in Knee Osteoarthritis. Osteoarthr. Cartil. 2018, 26, 1140–1152. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  42. Svoboda, S.J. ACL Injury and Posttraumatic Osteoarthritis. Clin. Sports Med. 2014, 33, 633–640. [Google Scholar] [CrossRef] [PubMed]
  43. Jones, M.H.; Spindler, K.P. Risk Factors for Radiographic Joint Space Narrowing and Patient Reported Outcomes of Post-Traumatic Osteoarthritis after ACL Reconstruction: Data from the MOON Cohort: Ptoa After Acl Reconstruction in Moon. J. Orthop. Res. 2017, 35, 1366–1374. [Google Scholar] [CrossRef] [PubMed]
  44. Quatman, C.E.; Hettrich, C.M.; Schmitt, L.C.; Spindler, K.P. The Clinical Utility and Diagnostic Performance of Magnetic Resonance Imaging for Identification of Early and Advanced Knee Osteoarthritis: A Systematic Review. Am. J. Sports Med. 2011, 39, 1557–1568. [Google Scholar] [CrossRef]
  45. Kijowski, R.; Davis, K.W.; Woods, M.A.; Lindstrom, M.J.; De Smet, A.A.; Gold, G.E.; Busse, R.F. Knee Joint: Comprehensive Assessment with 3D Isotropic Resolution Fast Spin-Echo MR Imaging—Diagnostic Performance Compared with That of Conventional MR Imaging at 3.0 T. Radiology 2009, 252, 486–495. [Google Scholar] [CrossRef] [Green Version]
  46. Carotti, M.; Salaffi, F.; Di Carlo, M.; Giovagnoni, A. Relationship between Magnetic Resonance Imaging Findings, Radiological Grading, Psychological Distress and Pain in Patients with Symptomatic Knee Osteoarthritis. Radiol. Med. 2017, 122, 934–943. [Google Scholar] [CrossRef]
  47. Vanhoenacker, F.; De Vos, N.; Van Dyck, P. Common Mistakes and Pitfalls in Magnetic Resonance Imaging of the Knee. J. Belg. Soc. Radiol. 2016, 100, 99. [Google Scholar] [CrossRef] [Green Version]
  48. Solivetti, F.M.; Guerrisi, A.; Salducca, N.; Desiderio, F.; Graceffa, D.; Capodieci, G.; Romeo, P.; Sperduti, I.; Canitano, S. Appropriateness of Knee MRI Prescriptions: Clinical, Economic and Technical Issues. Radiol. Med. 2016, 121, 315–322. [Google Scholar] [CrossRef]
  49. García, G.J.M.; Romero, G.F.J.; Jiménez, A.M.; Gracia, N.J.F.; Mollá, S.M. Appropriateness of Magnetic Resonance Imaging Requested by Primary Care Physicians for Patients with Knee Pain. Int. J. Qual. Health Care 2018, 30, 565–570. [Google Scholar] [CrossRef]
  50. Roberts, T.T.; Singer, N.; Hushmendy, S.; Dempsey, I.J.; Roberts, J.T.; Uhl, R.L.; Johnson, P.E. MRI for the Evaluation of Knee Pain: Comparison of Ordering Practices of Primary Care Physicians and Orthopaedic Surgeons. J. Bone Jt. Surg. Am. Vol. 2015, 97, 709–714. [Google Scholar] [CrossRef]
  51. Nacey, N.C.; Geeslin, M.G.; Miller, G.W.; Pierce, J.L. Magnetic Resonance Imaging of the Knee: An Overview and Update of Conventional and State of the Art Imaging: Knee MRI: Overview and Update. J. Magn. Reson. Imaging 2017, 45, 1257–1275. [Google Scholar] [CrossRef] [PubMed]
  52. Koo, S.; Gold, G.E.; Andriacchi, T.P. Considerations in Measuring Cartilage Thickness Using MRI: Factors Influencing Reproducibility and Accuracy. Osteoarthr. Cartil. 2005, 13, 782–789. [Google Scholar] [CrossRef] [PubMed] [Green Version]
Figure 1. (a) Arthroscopic view of healthy smooth articular cartilage of medial femoral condyle (MFC) and grade I lesions of medial tibial condyle (MTC) with visible superficial lesions and softening of the cartilage; (b) healthy articular cartilage visible on MFC and grade I cartilage lesions in a sagittal proton density fat-suppressed sequence.
Figure 1. (a) Arthroscopic view of healthy smooth articular cartilage of medial femoral condyle (MFC) and grade I lesions of medial tibial condyle (MTC) with visible superficial lesions and softening of the cartilage; (b) healthy articular cartilage visible on MFC and grade I cartilage lesions in a sagittal proton density fat-suppressed sequence.
Applsci 11 01552 g001
Figure 2. (a) Arthroscopic view of grade II cartilage lesions with less than 50% of cartilage depth affected on lateral femoral condyle (LFC); (b) grade II cartilage lesion on MFC seen in a coronal proton density fat-suppressed sequence.
Figure 2. (a) Arthroscopic view of grade II cartilage lesions with less than 50% of cartilage depth affected on lateral femoral condyle (LFC); (b) grade II cartilage lesion on MFC seen in a coronal proton density fat-suppressed sequence.
Applsci 11 01552 g002
Figure 3. (a) Arthroscopic view of grade III cartilage lesions with more than 50% of cartilage depth affected on MFC; (b) grade III cartilage lesion on MFC seen in a sagittal proton density fat-suppressed sequence.
Figure 3. (a) Arthroscopic view of grade III cartilage lesions with more than 50% of cartilage depth affected on MFC; (b) grade III cartilage lesion on MFC seen in a sagittal proton density fat-suppressed sequence.
Applsci 11 01552 g003
Figure 4. (a) Arthroscopic view of grade IV cartilage lesions with total cartilage loss and exposure of subchondral bone on LFC; (b) grade IV cartilage lesion on LFC seen in a sagittal proton density fat-suppressed sequence.
Figure 4. (a) Arthroscopic view of grade IV cartilage lesions with total cartilage loss and exposure of subchondral bone on LFC; (b) grade IV cartilage lesion on LFC seen in a sagittal proton density fat-suppressed sequence.
Applsci 11 01552 g004
Figure 5. ROC presenting the MRI diagnostic accuracy for anatomic locations, regardless of the lesion grade (a) MFC, (b) LFC, (c) MTC, (d) lateral tibial condyle (LTC), (e) patellofemoral joint (PFJ). The red lines represent reference line and the blue line represents ROC curve.
Figure 5. ROC presenting the MRI diagnostic accuracy for anatomic locations, regardless of the lesion grade (a) MFC, (b) LFC, (c) MTC, (d) lateral tibial condyle (LTC), (e) patellofemoral joint (PFJ). The red lines represent reference line and the blue line represents ROC curve.
Applsci 11 01552 g005aApplsci 11 01552 g005bApplsci 11 01552 g005c
Figure 6. Bangdiwala’s observer agreement charts presenting the diagnostic accuracy of MRI for each anatomic location and grade of lesion (a) MFC, (b) LFC, (c) MTC, (d) LTC, (e) PFJ.
Figure 6. Bangdiwala’s observer agreement charts presenting the diagnostic accuracy of MRI for each anatomic location and grade of lesion (a) MFC, (b) LFC, (c) MTC, (d) LTC, (e) PFJ.
Applsci 11 01552 g006aApplsci 11 01552 g006bApplsci 11 01552 g006c
Table 1. Grading and location of chondral lesions in an arthroscopic view.
Table 1. Grading and location of chondral lesions in an arthroscopic view.
LocationCartilage Status According to ICRSCartilage Lesions in Total
01234
MFC7215243643118
LFC113292519477
MTC992332191791
LTC113322811677
PFJ1002024242290
Total49711913310992453
Table 2. Sensitivity and specificity of magnetic resonance imaging (MRI) in the dependence of grade and anatomical location of the lesion.
Table 2. Sensitivity and specificity of magnetic resonance imaging (MRI) in the dependence of grade and anatomical location of the lesion.
MFCLFCMTCLTCPFJMean
0Sensitivity91.67%92.04%94.95%92.92%91.00%92.51%
Specificity49.15%27.27%39.56%22.08%55.56%38.72%
1Sensitivity0.00%3.45%4.35%6.25%10.00%4.81%
Specificity98.86%96.89%97.60%95.57%97.65%97.31%
2Sensitivity25.00%4.00%9.38%3.57%41.67%16.72%
Specificity93.98%95.15%98.10%97.53%95.18%95.99%
3Sensitivity27.78%21.05%26.32%0.00%33.33%21.70%
Specificity98.05%97.08%96.49%96.09%92.77%96.10%
4Sensitivity65.12%0.00%58.82%33.33%36.36%38.73%
Specificity96.60%96.77%94.80%98.91%95.83%96.58%
MeanSensitivity41.91%24.11%38.76%27.22%42.47%
Specificity87.33%82.63%85.31%82.04%87.40%
Table 3. Area under the curve (AUC) values of receiver operating characteristic (ROC) curves for the MRI diagnostic accuracy of any chondral lesion depending on anatomical location.
Table 3. Area under the curve (AUC) values of receiver operating characteristic (ROC) curves for the MRI diagnostic accuracy of any chondral lesion depending on anatomical location.
Asymptotic 95% Confidence Interval
Tested VariablesArea under the CurveSDAsymptotic SignificanceInferior Boundary ValueSuperior Boundary Value
MFC0.7150.0360.0000.6430.786
LFC0.6030.0430.0160.5180.687
MTC0.6750.0400.0000.5970.752
LTC0.5780.0430.0680.4930.663
PFJ0.7370.0370.0000.6640.811
Table 4. Kappa and B statistic values for the MRI and arthroscopy agreement depending on anatomical location.
Table 4. Kappa and B statistic values for the MRI and arthroscopy agreement depending on anatomical location.
ValueASEz
MFCUnweighted0.390.0468.387
Weighted0.570.05410.684
LFCUnweighted0.130.0423.015
Weighted0.360.0774.739
MTCUnweighted0.290.0476.094
Weighted0.560.0648.777
LTCUnweighted0.100.0412.473
Weighted0.350.0923.819
PFJUnweighted0.380.0497.626
Weighted0.500.0697.335
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Krakowski, P.; Karpiński, R.; Jojczuk, M.; Nogalska, A.; Jonak, J. Knee MRI Underestimates the Grade of Cartilage Lesions. Appl. Sci. 2021, 11, 1552. https://doi.org/10.3390/app11041552

AMA Style

Krakowski P, Karpiński R, Jojczuk M, Nogalska A, Jonak J. Knee MRI Underestimates the Grade of Cartilage Lesions. Applied Sciences. 2021; 11(4):1552. https://doi.org/10.3390/app11041552

Chicago/Turabian Style

Krakowski, Przemysław, Robert Karpiński, Mariusz Jojczuk, Agata Nogalska, and Józef Jonak. 2021. "Knee MRI Underestimates the Grade of Cartilage Lesions" Applied Sciences 11, no. 4: 1552. https://doi.org/10.3390/app11041552

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop