Next Article in Journal
Effects of Yeast Culture Supplementation on Growth Performance, Nutrient Digestibility, Blood Metabolites, and Immune Response in Geese
Previous Article in Journal
Expansion of Canine Heartworm in Spain
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Inter-Observer Agreement in Radiographic Diagnosis of Coxofemoral Joint Disease in a Closed Cohort of Four-Month-Old Rottweilers

1
Small Animal Surgery, Department for Companion Animals and Horses, University of Veterinary Medicine, 1210 Vienna, Austria
2
Section of Physical Therapy, Small Animal Surgery, Department for Companion Animals and Horses, University of Veterinary Medicine, 1210 Vienna, Austria
3
Diagnostic Imaging, Department for Companion Animals and Horses, University of Veterinary Medicine, 1210 Vienna, Austria
4
Clinica Veterinaria Vezzoni S.R.L., 26100 Cremona, Italy
5
Platform Bioinformatics and Biostatistics, Department for Biomedical Services, University of Veterinary Medicine, 1210 Vienna, Austria
*
Author to whom correspondence should be addressed.
Animals 2022, 12(10), 1269; https://doi.org/10.3390/ani12101269
Submission received: 5 April 2022 / Revised: 12 May 2022 / Accepted: 14 May 2022 / Published: 15 May 2022
(This article belongs to the Section Veterinary Clinical Studies)

Abstract

:

Simple Summary

Canine hip dysplasia is an important orthopedic disorder in veterinary medicine. In addition to body weight, fat intake, rapid growth, and hormonal changes, heredity is one of its underlying factors. Diagnosis of hip dysplasia under one year of age would help veterinarians to plan proper preventive/therapeutic methods and exclude dysplastic dogs from breeding programs to reduce the incidence of the disease in future generations. Therefore, having an accurate method for the early diagnosis of dysplastic dogs is an important subject, and a limited number of screening methods are used globally. Assessment of the accuracy of these methods can be examined with intra- and inter-observer studies. In this study, we aimed to assess the inter-observer agreements of the eight radiographic parameters from four different radiographic projections between five experienced observers (two of them certified scrutineers for canine hip dysplasia) to evaluate the reproducibility of the protocols. In our study, high inter-observer agreements were recorded for measurable values such as angle measurements, whereas the results of the subjective grading were low. Thus, it can be deduced that quantitative parameters are reliable values and a combination of these values with other screening programs such as clinical examinations might increase the accuracy of the examinations.

Abstract

Canine hip dysplasia is a complex and multifactorial disease. The early diagnosis of dysplastic dogs under one year of age helps veterinarians to plan proper preventive/therapeutic methods. Having an accurate screening method increases the chance of the early detection of dysplasia. The goal of our study was to assess the inter-observer reliability of eight radiographic parameters in four-month-old Rottweilers. Radiographs of the 28 Rottweilers were investigated by five experienced observers. The radiographs were taken in ventrodorsal view with extended legs, frog-leg ventrodorsal view, distraction view, and dorsal acetabular rim view. Four quantitative parameters such as Norberg angle (NA), distraction index (DI), dorsal acetabular rim slope (DARS), and center edge angle (CEA) and four qualitative parameters such as sclerosis of the cranial acetabular rim (SCAR), location of the center of the femoral head (LCFH), grading of the degenerative joint disease (GDJD), and grading of the dorsal acetabular rim (GDAR) were evaluated. High inter-observer agreements were recorded for quantitative values, whereas the inter-observer agreement of the qualitative parameters was low. It can be deduced that the evaluated quantitative parameters are reliable, and a combination of these methods with clinical examinations might increase the accuracy of the examinations.

1. Introduction

Canine hip dysplasia (CHD) is a progressive, complex, and polygenic disease, which develops during postnatal skeletal growth and is characterized by malformation of the coxofemoral joint leading to joint laxity, subsequent degenerative joint disease, and loss of articular function [1,2]. The main etiology of CHD is still under investigation, but genetics, dog breed, body weight and size, rapid growth, fat intake, and hormonal changes have been reported to be the most important factors [1,2,3,4,5,6]. Hip laxity is reported to be a primitive sign of CHD and an important predisposing factor of degenerative joint diseases [7,8]. A direct relationship has been reported between the severity of coxofemoral laxity and the incidence of degenerative joint disease [7,8]. Ossification disorders of the acetabulum and degeneration of the femoral head ligament and joint capsule have been considered as the main causes of hip laxity [9,10]. Hip laxity causes micro-fractures in the subchondral bone during the gait cycle, resulting in osteoarthritis [9].
Early diagnosis of hip laxity in medium- to large-breed dogs for a screening time of one year would make veterinarians capable of determining predisposed or affected hips at young ages and performing preventive or therapeutic procedures to restrict the disease or reduce the symptoms of CHD in older ages. These procedures would promote the animals’ welfare and reduce therapeutic costs in the future. Furthermore, dysplastic dogs should be excluded from breeding programs due to the importance of heredity in this disease (OMIA 000473-9615) [3,4,11]. Breeding is multifactorial, and excluding solely CHDs would reduce the genetic diversity of a breed especially those with historically increased laxity.
Early diagnosis of CHD is based on clinical orthopedic examinations and different radiographic screening methods. Clinical orthopedic methods consist of qualitative methods such as Barlow, Ortolani, and Bardens tests which are based on the examination of the instability of the hip joint [12,13,14], and quantitative examinations such as measurements of the reduction or subluxation angles [15].
The Ortolani test can be performed from 7 to 8 weeks of age [16] but a high number of false-negative results (up to 85%) can be seen at this age [17]. The results of the Ortolani test, from 16 weeks of age, were reported to be more accurate, with 92% sensitivity [17,18]. The Bardens test can be conducted from 8 to 9 weeks of age with 83% accuracy [19]. It should be considered that the degree of hip-joint laxity can be raised between the ages of 8 and 12 weeks due to the expansion of the joint capsule and false-positive results might be observed [20,21]. On the other hand, in juvenile dogs with severe grades of hip laxity, false-negative orthopedic examinations might be recorded because of the fibrosis of the joint capsule [20]. Thus, due to the possibility of false-negative or false-positive results, a combination of the physical and radiographic examinations is recommended [22,23,24].
Along with physical examinations, radiography is widely used for screening for CHD. The main aim of the radiographic examination is to determine hip-joint laxity or signs of degenerative joint diseases. Limited numbers of standardized radiographic screening protocols, such as guidelines of the Fédération Cynologique Internationale (FCI), the Pennsylvania Hip Improvement Program (PennHIP), the Orthopedic Foundation for Animals (OFA), and the British Veterinary Association/The Kennel Club (BVA/KC) are used globally [25,26,27,28].
In a previous study, we focused on clinical orthopedic examinations for early diagnosis of hip laxity and investigated the correlation between clinical examination and final radiographic score according to the FCI guidelines. A positive correlation was recorded between orthopedic examinations (reduction angle and Ortolani maneuver) and final FCI score from 8 months of age in that study [23].
Assessment of the objectivity of radiographic studies can be made by agreement studies. These studies aim to distinguish the methods with no-to-good agreements. Since the interpretation of the radiographs relies on the observer, in the case of low agreements, the results may not represent the investigated values and lead to inaccurate data. Thus, the recommended imaging method must have good-to-high agreements. Given that the radiographic landmarks might be less distinct or even missing for identifying and scoring coxofemoral joint disease in juvenile dogs, the main objective of the current study was to investigate the inter-observer agreement of the eight radiographic parameters in a closed cohort of four-month-old Rottweilers. We hypothesized that there would be a good inter-observer agreement for the values measured in this study, due to the experience of the observers.

2. Materials and Methods

2.1. Approval and Consent

This study was discussed and approved by the Institutional Ethics and Animal Welfare Committee of the University of Veterinary Medicine, Vienna in accordance with good scientific practice guidelines and national legislation (ETK-17/12/97/2015).

2.2. Study Design and Inclusion Criteria

In this prospective study, a closed cohort of Rottweilers was investigated. Closed cohort studies are longitudinal follow-up studies with fixed subjects driven by researchers to assess the outcomes among the groups [29]. In closed cohort studies, the subjects are fixed; thus, no new patients are added to the study, and the study population may decrease because of the loss of the subjects. A total of 28 purebred Rottweilers of the Austrian Armed Forces was investigated in our study. The dogs were representative of a defined population and all of them had different parents. All of the dogs underwent general clinical examination prior to the study. The inclusion criterion was being free of any clinical musculoskeletal diseases. The age of each dog was controlled by breeding documents and the body weight was recorded. All of the clinical examinations were performed by an experienced orthopedic surgeon (B.V.).

2.3. Anesthesia

Due to the importance of the radiographic positioning, and to avoid musculature contraction during the radiographic examination, all the dogs underwent general anesthesia in this study. The dogs were premedicated with medetomidine (0.01–0.02 mg/kg, IV) and inducted with propofol (1–5 mg/kg, IV). The maintenance of the anesthesia was performed with propofol (0.2 mg/kg/min, IV).

2.4. Radiographic Examinations

All radiographs included in this study were taken at the Diagnostic Imaging of the University of Veterinary Medicine, Vienna. The radiographs were carried out in four different projections such as ventrodorsal view with extended legs [30], ventrodorsal frog-leg view [31], ventrodorsal distraction view (Badertscher method modified by Vezzoni) [32], and dorsal acetabular rim (DAR) view [33]. The radiographs were exposed with 75–96 kV and 9 mAs with a film-focus distance of 90 cm in a storage phosphor screen/cassette system (Kodak Carestream, Health Inc., Rochester, NY, USA). All images were digitally stored and evaluated (dicomPACS View Version 6.0.2, 457, Bodmin, England and Oehm und Rehbein, Rostock, Germany). The radiographs and their orders were anonymized prior to the study by an experienced technician. Five experienced investigators evaluated the radiographs in this study, including two experienced orthopedic surgeons (observers 1 and 2) and three experienced radiologists (observers 3, 4, and 5). One of the surgeons (observer 1) and one of the radiologists (observer 4) were certified CHD scrutineers. The investigators recorded their observations for each parameter of the hips separately. The inter-observer variability was based on the measurement of the values among the five observers.

2.5. Investigated Parameters

Eight radiographic parameters were investigated in this study. Three parameters were evaluated in ventrodorsal view radiographs with extended legs, including Norberg angle (NA), sclerosis of the cranial acetabular rim (SCAR), and location of the center of the femoral head (LCFH). Grading of the degenerative joint disease (GDJD) was performed on frog-leg view radiographs and the distraction index (DI) was measured on distraction view radiographs according to the PennHIP method. Furthermore, three parameters were investigated in DAR-view radiographs, including dorsal acetabular rim slope (DARS), center edge angle (CEA), and grading of the dorsal acetabular rim (GDAR). These eight parameters were divided into quantitative (NA, DI, DARS, and CEA) and qualitative (SCAR, LCFH, GDJD, and GDAR) parameters.

2.5.1. The Norberg Angle (NA)

The NA presents information about the location of the center of the femoral head relative to the craniolateral acetabular margin and is reported to be ≥105° in normal hips in most breeds [1]. Smaller NA values usually represent subluxated/luxated femoral heads. The measurement of the NA is based on the measurement of the angle between the straight line connecting the centers of the contralateral femoral heads in ventrodorsal radiographs and the line connecting the center of the femoral head at each side with the intersection of the dorsal rim and craniolateral border of the acetabulum. The measurement of the NA is shown in Figure 1.

2.5.2. Sclerosis of the Cranial Acetabular Rim (SCAR)

The SCAR was investigated according to its uniformity and thickness and was categorized as regular and thin sclerosis (normal), regular and thick sclerosis, or laterally increased thickness of sclerosis (abnormal).

2.5.3. Location of the Center of the Femoral Head (LCFH)

The LCFH was evaluated according to its position relative to the dorsal acetabular rim (medial, on, or lateral). The results were categorized as medial to DAR, superimposing DAR, 0–2 mm lateral to DAR, and more than 2 mm lateral to DAR (Figure 1).

2.5.4. Grading of the Degenerative Joint Disease (GDJD)

The grading of the DJD of the coxofemoral joint was based on the evaluation of the joint space and the existence of the osteophytes. The results were classified as hips with congruent joint space and no osteophytes (normal), hips with incongruent joint space and no osteophytes, and hips with incongruent joint space with osteophytes.

2.5.5. The Distraction Index (DI)

To quantify the DI, ventrodorsal distraction view radiographs (Badertscher method modified by Vezzoni) were taken, and the calculation of the DI was performed using the PennHIP measurement method [26]. The DI is calculated by dividing the distance between the centers of the femoral head and acetabulum by the radius of the femoral head during distraction and is a number between zero (healthy hip) and one (severe laxity). The incidence of hip laxity in dogs with DI ≤ 0.3 and DI ≥ 0.6 is reported to be low and high, respectively [34]. The measurement of the DI on the distraction view radiograph is shown in Figure 2.

2.5.6. Dorsal Acetabular Rim Slope (DARS)

The DARS is the angle between the intersection of the perpendicular line drawn from the center of the femoral head to the mid-sagittal plane of the pelvis/sacrum, and the line drawn tangent to the most lateral point of the dorsal acetabular rim [33]. The DARS is reported to be ≤7.5° in healthy hips, whereas higher values indicate hips with increased laxity [33]. The measurement of the DARS on a DAR-view radiograph is shown in Figure 3A.

2.5.7. The Center Edge Angle (CEA)

The CEA is an angle between the straight line, drawn from the center of the femoral head tangential to the outer edge of the acetabular rim, and the straight line, drawn parallel to the mid-sagittal axis of the pelvis/sacrum on DAR-view radiographs [35,36]. The CEA is used to assess the acetabular coverage of the head of the femur and is reported to be greater than 12° for healthy hips [36]. The magnification of the measurement of the CEA in a Rottweiler dog is shown in Figure 3B.

2.5.8. Grading of the Dorsal Acetabular Rim (GDAR)

The GDAR was based on the shape of the DAR and degenerative changes. The results were graded into five groups such as DAR with a triangular shape and no osteophytes (group 0), mild rounded DAR and no osteophytes (group 1), rounded DAR with mild osteophytes (group 2), truncated-shape DAR where the edge looks cut off with significant laxity and poor roofing (group 3), and the rounded-shape DAR with severe osteophytes (group 4).

2.6. Statistical Analysis

The statistical analysis of the measured data was performed using IBM SPSS Statistics software version 25 and descriptive statistics were calculated. The differences between observers were analyzed using a general linear model (GLM) and multiple comparisons were performed using Bonferroni’s alpha correction procedure. The results with a p-value < 0.05 were considered significant.
The intra-class correlation coefficient (ICC) was calculated to assess the inter-observer reliabilities of the quantitative data. The ICC ranged from 0 (no agreement) to 1 (excellent agreement). The values below 0.4 were considered poor agreement, the values between 0.4 and 0.59 were considered fair agreement, an ICC between 0.6 and 0.74 was considered good agreement, and an ICC higher than 0.75 was considered excellent agreement [37].
To evaluate the inter-observer agreement of the qualitative data, Cohen’s kappa coefficient (κ) was calculated (κ = 0: no agreement, and κ = 1: excellent agreement). The values with a kappa below 0.20 indicate poor agreement, and the values between 0.21 and 0.40 indicate weak agreement. The values between 0.41 and 0.60, and between 0.61 and 0.80 indicate moderate and good agreements, respectively. Results with a kappa above 0.80 indicate excellent agreement.
A few qualitative data were reported to be indefinable by observer 5. The absence of these data might have a negligible impact on statistics.

3. Results

Altogether, 28 purebred Rottweilers (in total 56 hips) with a mean ± standard deviation (SD) age of 19.3 ± 1.4 weeks (range: 20.8–16.4 weeks) and a mean ± SD body weight of 16.5 ± 5.6 kg (range: 20.5–12.5 kg) were investigated in this study. Of the examined dogs, 20 were male (all intact) and 8 were female (all intact).

3.1. Quantitative Results

No significant difference was recorded between observers regarding NA, and the highest mean difference ± standard error (SE) between observers was 3.7° ± 1.4°. As with NA, no significant difference was recorded for DI between observers, and the highest mean difference ± SE between observers was 0.05 ± 0.03 mm.
Two of the radiologists (observers 3 and 5) who had less experience than the others measured significantly different DARS than other observers (p-value < 0.02) with a highest mean difference ± SE of 7.1° ± 0.9°. No significant difference was recorded between other observers (observers 1, 2, and 4) regarding DARS.
Except for one case, the measurements of the CEA did not show a significant difference between observers, either. A significant difference (p-value = 0.04) was only seen between observers 2 (surgeon) and 4 (radiologist) regarding CEA. The highest mean difference ± SE of the CEA between these observers was 2.9° ± 1°. The descriptive statistics of the quantitative values are summarized in Table 1. Furthermore, the results of the general linear model and Bonferroni’s alpha correction procedure are shown in the Supplementary Materials (Figure S1).

3.2. Qualitative Results

From the total SCAR measurements, 84.1% of the hips were graded with regular and thin sclerosis, 12.6% of the hips were marked as regular and thick sclerosis, and 3.3% of the hips were graded as laterally increased thickness of sclerosis.
From the total LCFH measurements, 49.3% of the femoral heads were classified as medial to DAR, 29.1% were classified as superimposing DAR, 18.7% of the results were classified as 0–2 mm lateral to DAR, and 3% of the femoral heads were categorized as more than 2 mm lateral to DAR.
Evaluation of the GDJD was based on the assessment of the joint space and existence of the osteophytes and 68.1% of the hips were categorized as hips with congruent joint space and no osteophytes. Furthermore, 26.8% of the hips were categorized as hips with incongruent joint space and no osteophytes, and 5.1% were classified as hips with incongruent joint space with osteophytes.
The hips were divided into five groups based on the shape of the DAR and the existence of the osteophytes. Of all the investigated hips, 31.6% were diagnosed with a triangular shape and no osteophytes, 40.7% were diagnosed with mild rounded DAR and no osteophytes, 19.3% were diagnosed with rounded DAR with mild osteophytes, 6.2% were diagnosed with the truncated shape of the DAR where the edge looks cut off or dabbed with clear laxity and less roofing, and 2.2% of the results were categorized as a rounded shape of DAR with severe osteophytes. The results of the evaluation of the qualitative values are shown in Table 2 for each observer.

3.3. Inter-Observer Agreements of Quantitative Values

The ICCs recorded for NA, DI, and CEA were higher than 0.75, indicating an excellent inter-observer agreement. However, the ICC recorded for DARS was 0.74, indicating a good inter-observer agreement. The inter-observer ICCs are shown in Table 3 for each parameter.

3.4. Inter-Observer Agreements of Qualitative Values

Despite quantitative values, low inter-observer agreements were recorded for qualitative values. A high number (80%) of the recorded kappa values for SCAR were lower than 0.2, indicating poor-to-no agreements and only one (10%) weak (κ = 0.35) and one (10%) moderate (κ = 0.41) agreement were recorded between observers.
Weak (40%) to moderate (60%) inter-observer agreements were recorded for LCFH between observers. The highest agreement was κ = 0.57, and the lowest was κ = 0.25.
Most of the inter-observer agreements (90%) regarding GDJD and GDAR were below 0.20, indicating poor-to-no agreements. The highest kappa values for GDJD and GDAR were 0.29 and 0.21, respectively. No good or excellent agreement was recorded for any of the qualitative parameters in this study. The results of Cohen’s kappa coefficient for qualitative values are shown in the Supplementary Materials (Figure S2).

4. Discussion

This study was designed to assess the inter-observer reliability of the radiographic methods reported for diagnosis of the coxofemoral joint disease in juvenile Rottweilers. The aim of our study was to evaluate the reproducibility of the radiographic examinations by different groups of experienced investigators in a closed cohort of four-month-old Rottweilers. We hypothesized that there would be a good inter-observer agreement for the values measured in this study.
Our findings indicate that the inter-observer agreements among the observers varied between the quantitative and qualitative results. High and low inter-observer agreements were recorded for quantitative and qualitative values, respectively. Therefore, our hypothesis was partially confirmed.
All of the quantitative values (NA, DI, DARS, and CEA) had excellent to good inter-observer agreements in this study (75% excellent and 25% good agreement), whereas the reported results for qualitative values had week to poor agreements. These findings confirm the results of the previously performed studies, which reported low agreement for qualitative values (qualitative parameters of the FCI scoring method) and good inter-observer agreement for quantitative values such as NA and DI [38,39,40,41]. Based on our findings, it can be deduced that quantitative values are more accurate and reliable for diagnosis of the coxofemoral joint diseases. The results of the general linear model confirm these findings, where no significant differences were recorded between observers regarding NA, DI, and CEA (except for one observer) and only a few differences were recorded between observers regarding DARS. Contrary to quantitative values, most of the qualitative measurements had poor agreements. The reason for low agreement of the qualitative values might arise from the nature of these values, which are more relative to the observers than quantitative values; therefore, the distinction of the qualitative parameters might differ between observers, especially in the case of near-normal or mild hip dysplasia [39].
Given that there is no single standard method for the diagnosis of CHD, the accuracy of the investigated values can only be evaluated by intra- and inter-observer agreements [38]. Due to the qualitative nature of most scales for observers and because of the importance of the identification of the anatomic landmarks in measurements, it is important to have a repeatable and reproducible method to assess CHD. The screening protocols with poor intra- and inter-observer agreements represent inaccurate measurements and can cause inefficient screening programs and affect preventive or therapeutic planning; therefore, a combination of different screening protocols such as FCI, OFA, or BVA/KC which are very similar to each other, with other methods such as PennHIP and clinical examinations might increase the accuracy of the results.
An intra- and inter-observer study on the measurement of the femoral and tibial alignments in small-breed dogs showed that, upon increasing the number of the anatomical landmarks or increasing the complexity of the anatomical structures, the intra- and inter-observer agreement decreased [42]. Due to the importance of the early diagnosis of CHD and due to the complexity of the screening protocols, it would be of interest to evaluate the accuracy of the measurements of the hip joint, especially between different observers with high levels of experience.
The experience of the observers can affect the examinations. A study by Verhoeven et al. [39] showed that the inter-observer agreement increases with the experience of the observers. All of the observers in our study were experienced surgeons/radiologists. Observers 1 and 4 were certified CHD scrutineers (observer 1: surgeon; observer 4: radiologist) and observer 2 (orthopedic surgeon) was used to performing hip examinations routinely in the clinic due to the nature of her job. Observer 3 had less experience than the other examiners in this study and, despite the high level of experience of observer 5 in diagnostic imaging, this observer did not perform hip examinations routinely; thus, observers 1, 2, and 4 had more experience in hip examinations than the others.
No significant difference was recorded between surgeons regarding NA, DI, DARS, and CEA. Results of the examinations of the radiologist were similar to those of the surgeons regarding NA, DI, and CEA, and only in one case (CEA) a significant difference (p = 0.04) was recorded between one of the surgeons (observer 2) and one of the radiologists (observer 4). The mean difference and standard error between these observers were only 2.9° ± 1°, which might be negligible due to the small amount and low impact on the final results.
The results reported for DARS differed between observers. No significant difference was recorded between more experienced observers (observers 1, 2, and 4), whereas the measurements of observers 3 and 5 differed significantly from others (p = 0.00). The mean difference and standard error of these measurements were 7.1° ± 0.9°. This difference might be significant, as the hips with DARS ≤ 7.5° are considered healthy [33]. This result confirms the impact of the experience of the observer in the measurement of complex values. It would be of interest to investigate the agreement between DARS and CEA with the final FCI grade. Due to the complexity of these measurements, and poor results extracted from observers with lower experience, it could be deduced that DARS and CEA may not be appropriate for routine examinations and should be performed by certified CHD scrutineer to increase the accuracy.
The measurement of the qualitative results was similar between all the observers, and poor agreements were recorded. Low intra- and inter-observer reliabilities were reported in previous studies regarding subjective scoring of the hips on ventrodorsal hip-extended radiographs [38,39,40,43]. In an inter-observer study between different observers from different European countries, despite a specified evaluation method (FCI criteria), various results were reported and the agreement was low [39]. These findings emphasize the importance of standardizing the film reading and re-evaluation of the screening protocols.
Despite previous studies that evaluated a combination of different dog breeds, in the current study we investigated inter-observer reliability of the different methods for early diagnosis of the CHD on only one specific dog breed. We presume that the breed difference might be a significant factor in diagnosing CHD, as the results of our previous study [23] on purebred Rottweilers differed from previously reported results in the literature.
Despite the recommended examination age (12 or 18 months) from the FCI, we investigated values in four-month-old dogs, which increased the difficulty of the procedure due to the lack of perfect skeletal maturity. At four months of age, relative musculoskeletal growth is reached; therefore, different studies investigated dogs from this age [44]. It should be noted that because of the relative musculoskeletal maturity, growth, and subsequent increased pressure on the hip joint and therefore increased incidence of the clinical and radiographical signs, the results of the early diagnosis of CHD at older ages are more reliable [23,44]. On the other hand, early detection of the hip laxity in puppies would help veterinarians perform preventive or therapeutic procedures to reduce the severity of the disease in older ages such as juvenile pubic symphysiodesis (JPS), which should be performed on dogs of a young age (3.5–4 months) [45].
Our findings underline the importance of accurate diagnostic methods to achieve accurate results. According to the importance of heredity in controlling CHD, false-negative results would allow the breeding of dysplastic dogs, which are falsely considered as non-dysplastic, and prevent declination of the population of the dysplastic dogs. A retrospective study in Switzerland showed that, over a period of 20 years, the incidence of the mild-to-severe grades of the CHD (C, D, and E) decreased significantly [46]. Similar results were reported in France between 1997 and 2017 for large breeds such as Cane Corso, Gordon Setter, Rottweiler, and White Swiss Shepherd [47]. Therefore, it is recommended to use methods with high inter- and intra-observer agreements, to achieve better results and decrease the incidence of the disease in future.
The image quality of the radiograph is another important topic that could affect the assessments. An inter-observer study showed that improving the technical quality of the radiographs does not improve the inter-observer agreement [40], while positioning errors can affect radiographic examinations [48,49]. Therefore, all of the included radiographs in our study were taken according to the FCI guidelines by experienced technicians and evaluated by experienced radiologists, to confirm the inclusion criteria and to eliminate the risk of positioning errors in this study.
Our study had some limitations. All of the investigations were performed on four-month-old puppies, which made radiographic examinations more difficult due to the immature/newly matured musculoskeletal system of the dogs. The intra-observer agreements were not assessed in this study; these could give us more information about the repeatability of the examinations. In a few cases, some of the qualitative parameters were reported to be indefinable by observer 5 (4.1% of the measurements). These missing data might have a negligible impact on statistics. Investigating a specific breed at a certain age, despite being intentional, makes the comparison between current and previous studies that have used a combination of different breeds at different ages more difficult. Further investigations are needed to evaluate the influence of aging on the inter-observer agreements, as detection of the degenerative changes might be easier in older ages; however, it would be of interest to investigate the final FCI score of the Rottweilers included in this study and assess the predictability of the methods used at four months of age.

5. Conclusions

In conclusion, excellent-to-good inter-observer agreements were recorded for quantitative values (NA, DI, DARS, and CEA) in our study, whereas the results of the inter-observer evaluation of the qualitative values (SCAR, LCFH, GDJD, and GDAR) were poor. The results reported by surgeons and radiologists were mostly similar, and only one observer (radiologist) had different results than others. According to the significance of the early diagnosis of CHD, evaluated quantitative values could be considered as reliable values, and a combination of these methods with other methods might increase the accuracy of the examinations and improve the efficiency of the screening methods.

Supplementary Materials

The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/ani12101269/s1, Figure S1: The results of the general linear model and Bonferroni’s alpha correction procedure of the quantitative data. Figure S2: The results of Cohen’s kappa coefficient for qualitative values.

Author Contributions

Conceptualization, B.V. and B.B.; methodology, B.V., M.A., S.K., A.V., M.G., H.H., A.T. and B.B.; validation, B.V., M.A., S.K., A.V., M.G., H.H., A.T. and B.B.; formal analysis, M.A. and A.T.; investigation, B.V. and M.A.; resources, B.V.; data curation, B.B. and M.A.; writing—original draft preparation, B.V. and M.A.; writing—review and editing, B.V., M.A., S.K., A.V., M.G., H.H., A.T. and B.B.; visualization, B.V., M.A., S.K., A.V., M.G., H.H., A.T. and B.B.; supervision, B.B.; project administration, B.V.; funding acquisition, B.V. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the Austrian Federal Ministry of Defense (Bundesministerium für Landesverteidigung). It had no influence on the study design; the collection, analysis, and interpretation of data; the writing of the report; or the decision to submit the manuscript for publication. “Open Access Funding by the University of Veterinary Medicine Vienna”.

Institutional Review Board Statement

The study was conducted according to the guidelines of the Declaration of Helsinki, and approved by the Institutional Ethics Committee of the University of Veterinary Medicine, Vienna (ETK-17/12/97/2015, 2015).

Informed Consent Statement

Not applicable.

Data Availability Statement

The data presented in this study are available in the Supplementary Materials.

Acknowledgments

The authors are grateful to the Austrian Armed Forces and their great support, especially Dietmar Rackl, and their animals for participating in our research. In addition, the authors thank Johann Ryschawy and Günther Borka for their patience and great efforts in taking the radiographs.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Henrigson, B.; Norberg, I.; Olssons, S.-E. On the etiology and pathogenesis of hip dysplasia: A comparative review. J. Small Anim. Pract. 1966, 7, 673–688. [Google Scholar] [CrossRef] [PubMed]
  2. Lust, G. An overview of the pathogenesis of canine hip dysplasia. J. Am. Vet. Med. Assoc. 1997, 210, 1443–1445. [Google Scholar] [PubMed]
  3. LaFond, E.; Breur, G.J.; Austin, C.C. Breed susceptibility for developmental orthopedic diseases in dogs. J. Am. Anim. Hosp. Assoc. 2002, 38, 467–477. [Google Scholar] [CrossRef] [PubMed]
  4. Zhang, Z.; Zhu, L.; Sandler, J.; Friedenberg, S.S.; Egelhoff, J.; Williams, A.J.; Dykes, N.L.; Hornbuckle, W.; Krotscheck, U.; Moise, N.S. Estimation of heritabilities, genetic correlations, and breeding values of four traits that collectively define hip dysplasia in dogs. Am. J. Vet. Res. 2009, 70, 483–492. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  5. Kealy, R.D.; Lawler, D.F.; Ballam, J.M.; Mantz, S.L.; Biery, D.N.; Greeley, E.H.; Lust, G.; Segre, M.; Smith, G.K.; Stowe, H.D. Effects of diet restriction on life span and age-related changes in dogs. J. Am. Vet. Med. Assoc. 2002, 220, 1315–1320. [Google Scholar] [CrossRef] [Green Version]
  6. Smith, G.K.; Paster, E.R.; Powers, M.Y.; Lawler, D.F.; Biery, D.N.; Shofer, F.S.; McKelvie, P.J.; Kealy, R.D. Lifelong diet restriction and radiographic evidence of osteoarthritis of the hip joint in dogs. J. Am. Vet. Med. Assoc. 2006, 229, 690–693. [Google Scholar] [CrossRef] [Green Version]
  7. Smith, G.K.; Gregor, T.P.; Rhodes, W.H.; Biery, D.N. Coxofemoral joint laxity from distraction radiography and its contemporaneous and prospective correlation with laxity, subjective score, and evidence of degenerative joint disease from conventional hip-extended radiography in dogs. Am. J. Vet. Res. 1993, 54, 1021–1042. [Google Scholar]
  8. Smith, G.K.; Popovitch, C.A.; Gregor, T.P.; Shofer, F.S. Evaluation of risk factors for degenerative joint disease associated with hip dysplasia in dogs. J. Am. Vet. Med. Assoc. 1995, 206, 642–647. [Google Scholar]
  9. Riser, W.H. The Dysplastic Hip Joint: Its Radiographic and Histologic Development. Vet. Radiol. 1973, 14, 35–50. [Google Scholar] [CrossRef]
  10. Köppel, E. Hüftgelenksdysplasie des Hundes—Welche Methode eignet sich zur Früherkennung? Kleintier Konkret 2009, 12, 3–7. [Google Scholar] [CrossRef]
  11. Sydney School of Veterinary Science. OMIA 000473-9615: Hip Dysplasia in Canis Lupus Familiaris. Available online: https://omia.org/OMIA000473/9615/ (accessed on 5 April 2022).
  12. Barlow, T.G. Early diagnosis and treatment of congenital dislocation of the hip. J. Bone Jt. Surg. Br. 1962, 44, 292–301. [Google Scholar] [CrossRef]
  13. Chalman, J.A.; Butler, H.C. Coxofemoral joint laxity and the Ortolani sign. J. Am. Anim. Hosp. Assoc. 1985, 21, 671–676. [Google Scholar]
  14. Bardens, J.W.; Hardwick, H. New observations on the diagnosis and cause of hip dysplasia. Vet. Med. Small Anim. Clin. 1968, 63, 238–245. [Google Scholar] [PubMed]
  15. Schulz, K.; Dejardin, L. Surgical treatment of canine hip dysplasia. In Textbook of Small Animal Surgery; Slatter, D.H., Ed.; Saunders: Philadelphia, PA, USA, 2003; pp. 2029–2056. ISBN 0-7216-8607-9. [Google Scholar]
  16. Schimke, E.; Spreng, D.; Schawalder, P.; Van Ryssen Bernadette, V.B.H. Gelenkerkrankungen. In Klinik der Hundekrankheiten; Grünbaum Ernst-Günther, S.E., Ed.; Enke Verlag: Stuttgart, Germany, 2007; pp. 925–958. ISBN 978-3830410218. [Google Scholar]
  17. Adams, W.M.; Dueland, R.T.; Meinen, J.; O’Brien, R.T.; Giuliano, E.; Nordheim, E. V Early detection of canine hip dysplasia: Comparison of two palpation and five radiographic methods. J. Am. Anim. Hosp. Assoc. 1998, 34, 339–347. [Google Scholar] [CrossRef] [PubMed]
  18. Ginja, M.M.D.; Gonzalo-Orden, J.M.; Melo-Pinto, P.; Bulas-Cruz, J.; Orden, M.A.; San Roman, F.; Llorens-Pena, M.P.; Ferreira, A.J.A. Early hip laxity examination in predicting moderate and severe hip dysplasia in Estrela Mountain Dog: PAPER. J. Small Anim. Pract. 2008, 49, 641–646. [Google Scholar] [CrossRef] [PubMed]
  19. Wright, P.J.; Mason, T.A. The usefulness of palpation of joint laxity in puppies as a predictor of hip dysplasia in a guide dog breeding programme. J. Small Anim. Pract. 1977, 18, 513–522. [Google Scholar] [CrossRef]
  20. Schachner, E.R.; Lopez, M.J. Diagnosis, prevention, and management of canine hip dysplasia: A review. Vet. Med. Res. Rep. 2015, 6, 181–192. [Google Scholar]
  21. Taroni, M.; Genevois, J.P.; Viguier, E.; Carozzo, C.; Livet, V.; Baldinger, A.; Cachon, T. Evolution of Radiographic Parameters of Canine Passive Hip Laxity at 4, 6 and 12 months: A Study of 306 Dogs. Vet. Comp. Orthop. Traumatol. 2018, 31, 321–326. [Google Scholar] [CrossRef]
  22. Gatineau, M.; Dupuis, J.; Beauregard, G.; Charette, B.; Breton, L.; Beauchamp, G.; D’Anjou, M.A. Palpation and Dorsal Acetabular Rim Radiographic Projection for Early Detection of Canine Hip Dysplasia: A Prospective Study. Vet. Surg. 2012, 41, 42–53. [Google Scholar] [CrossRef]
  23. Vidoni, B.; Bauer, V.; Bockstahler, B.; Gumpenberger, M.; Tichy, A.; Aghapour, M. Early diagnosis of canine hip laxity: Correlation between clinical orthopedic examinations and the fci scoring method in a closed cohort of rottweilers. Animals 2021, 11, 416. [Google Scholar] [CrossRef]
  24. Gaisbauer, S. Literaturübersicht Über die Diagnostischen Möglichkeiten der Hüftgelenksdysplasie Beim Hund, Unter Besonderer Berücksichtigung der Hüftgelenkslaxizität; University of Veterinary Medicine Vienna: Wien, Austria, 2012. [Google Scholar]
  25. Federation Cynologique Internationale. Available online: http://www.fci.be/en/Hip-and-Elbow-Dysplasia-162.html (accessed on 5 April 2022).
  26. PennHIP. Available online: https://antechimagingservices.com/antechweb/pennhip (accessed on 5 April 2022).
  27. Flückiger, M. Scoring radiographs for canine hip dysplasia-The big three organisations in the world. Eur. J. Companion Anim. Pract. 2007, 17, 135–140. [Google Scholar]
  28. Gibbs, C. The BVA/KC scoring scheme for control of hip dysplasia: Interpretation of criteria. Vet. Rec. 1997, 141, 275–284. [Google Scholar] [PubMed]
  29. Belbasis, L.; Bellou, V. Introduction to epidemiological studies. Genet. Epidemiol. 2018, 1793, 1–6. [Google Scholar]
  30. Rendano, V.T., Jr.; Ryan, G. Canine hip dysplasia evaluation. Vet. Radiol. 1985, 26, 170–186. [Google Scholar] [CrossRef]
  31. Von Pückler, K.H.; Tellhelm, B.; Kirberger, R.M. The hip joint and pelvis. In BSAVA Manual of Canine and Feline Musculoskeletal Imaging; Kirberger, R.M., McEvoy, F.J., Eds.; British Small Animal Veterinary Association: While, UK, 2016; pp. 212–232. ISBN 9781905319787. [Google Scholar]
  32. Vezzoni, A.; Dravelli, G.; Corbari, A.; De Lorenzi, M.; Cirla, A.; Tranquillo, V. Early diagnosis of canine hip dysplasia. J. Comp. Anim. Pract. 2005, 11, 173–183. [Google Scholar]
  33. Slocum, B.; Devine, T.M. Dorsal acetabular rim radiographic view for evaluation of the canine hip. J. Am. Anim. Hosp. Assoc. 1990, 26, 289–296. [Google Scholar]
  34. Smith, G.K.; Mayhew, P.D.; Kapatkin, A.S.; McKelvie, P.J.; Shofer, F.S.; Gregor, T.P. Evaluation of risk factors for degenerative joint disease associated with hip dysplasia in German shepherd dogs, golden retrievers, labrador retrievers, and rottweilers. J. Am. Vet. Med. Assoc. 2001, 219, 1719–1724. [Google Scholar] [CrossRef] [Green Version]
  35. Wiberg, G.; Lund, D. Shelf operation in congenital dysplasia of the acetabulum and in subluxation and dislocation of the hip. J. Bone Jt. Surg. 1953, 35, 65–80. [Google Scholar] [CrossRef]
  36. Meomartino, L.; Fatone, G.; Potena, A.; Brunetti, A. Morphometric assessment of the canine hip joint using the dorsal acetabular rim view and the centre-edge angle. J. Small Anim. Pract. 2002, 43, 2–6. [Google Scholar] [CrossRef]
  37. Cicchetti, D. V Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology. Psychol. Assess. 1994, 6, 284. [Google Scholar] [CrossRef]
  38. Fortrie, R.R.; Verhoeven, G.; Broeckx, B.; Duchateau, L.; Janssens, L.; Samoy, Y.; Schreurs, E.; Saunders, J.; van Bree, H.; Vandekerckhove, P. Intra-and interobserver agreement on radiographic phenotype in the diagnosis of canine hip dysplasia. Vet. Surg. 2015, 44, 467–473. [Google Scholar] [CrossRef] [PubMed]
  39. Verhoeven, G.; Coopman, F.; Duchateau, L.; Saunders, J.H.; Van Rijssen, B.; Van Bree, H. Interobserver agreement in the diagnosis of canine hip dysplasia using the standard ventrodorsal hip-extended radiographic method. J. Small Anim. Pract. 2007, 48, 387–393. [Google Scholar] [CrossRef] [PubMed]
  40. Verhoeven, G.E.C.; Fortrie, R.R.; Duchateau, L.; Saunders, J.H.; Van Ryssen, B.; Van Bree, H.; Coopman, F. The effect of a technical quality assessment of hip-extended radiographs on interobserver agreement in the diagnosis of canine hip dysplasia. Vet. Radiol. Ultrasound 2010, 51, 498–503. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  41. Klever, J.; Brühschwein, A.; Wagner, S.; Reese, S.; Meyer-Lindenberg, A. Comparison of Reliability of Norberg Angle and Distraction Index as Measurements for Hip Laxity in Dogs. Vet. Comp. Orthop. Traumatol. 2020, 33, 274–278. [Google Scholar] [CrossRef]
  42. Aghapour, M.; Bockstahler, B.; Kneissl, S.; Tichy, A.; Vidoni, B. Femoral and tibial alignments in chihuahuas with patellar luxation by radiograph: Angular values and intra- and inter-observer agreement of measurements. PLoS ONE 2019, 14, e0214579. [Google Scholar] [CrossRef]
  43. Verhoeven, G.E.C.; Coopman, F.; Duchateau, L.; Bosmans, T.; Van Ryssen, B.; Van Bree, H. Interobserver agreement on the assessability of standard ventrodorsal hip-extended radiographs and its effect on agreement in the diagnosis of canine hip dysplasia and on routine FCI scoring. Vet. Radiol. Ultrasound 2009, 50, 259–263. [Google Scholar] [CrossRef]
  44. Lust, G.; Williams, A.J.; Burton-Wurster, N.; Pijanowski, G.J.; Beck, K.A.; Rubin, G.; Smith, G.K. Joint laxity and its association with hip dysplasia in Labrador retrievers. Am. J. Vet. Res. 1993, 54, 1990–1999. [Google Scholar]
  45. Vezzoni, A. Definition and clinical diagnosis of canine hip dysplasia; early diagnosis and treatment options. Eur. J. Companion Anim. Pract. 2007, 17, 126–132. [Google Scholar]
  46. Ohlerth, S.; Geiser, B.; Flückiger, M.; Geissbühler, U. Prevalence of Canine Hip Dysplasia in Switzerland Between 1995 and 2016—A Retrospective Study in 5 Common Large Breeds. Front. Vet. Sci. 2019, 6, 378. [Google Scholar] [CrossRef] [Green Version]
  47. Baldinger, A.; Genevois, J.-P.; Moissonnier, P.; Barthélemy, A.; Carozzo, C.; Viguier, É.; Cachon, T. Prevalence of canine hip dysplasia in 10 breeds in France, a retrospective study of the 1997–2017 radiographic screening period. PLoS ONE 2020, 15, e0235847. [Google Scholar] [CrossRef]
  48. Swiderski, J.K.; Radecki, S.V.; Park, R.D.; Palmer, R.H. Comparison of radiographic and anatomic femoral varus angle measurements in normal dogs. Vet. Surg. 2008, 37, 43–48. [Google Scholar] [CrossRef] [PubMed]
  49. Barnes, D.M.; Anderson, A.A.; Frost, C.; Barnes, J. Repeatability and reproducibility of measurements of femoral and tibial alignment using computed tomography multiplanar reconstructions. Vet. Surg. 2015, 44, 85–93. [Google Scholar] [CrossRef] [PubMed]
Figure 1. (A) Extended FCI conform ventrodorsal radiograph of a four-month-old Rottweiler with what were assumed to be normal hip joints. Note the transitional lumbosacral vertebrae (type III). Right is always to the left of the images. (B) Magnification of (A), focusing on the hip joints: demonstration of Norberg angle measurement. (C) Section of a VD radiograph in another four-month-old Rottweiler puppy with obvious laxity of both hip joints, more severe on the left side. The femoral head center is positioned on, or barely medial to, the dorsal acetabular rim in (B) and definitely lateral to the DAR in (C) bilaterally. (D) Magnification of (C), demonstrating the actual distance of the femoral head center from the DAR.
Figure 1. (A) Extended FCI conform ventrodorsal radiograph of a four-month-old Rottweiler with what were assumed to be normal hip joints. Note the transitional lumbosacral vertebrae (type III). Right is always to the left of the images. (B) Magnification of (A), focusing on the hip joints: demonstration of Norberg angle measurement. (C) Section of a VD radiograph in another four-month-old Rottweiler puppy with obvious laxity of both hip joints, more severe on the left side. The femoral head center is positioned on, or barely medial to, the dorsal acetabular rim in (B) and definitely lateral to the DAR in (C) bilaterally. (D) Magnification of (C), demonstrating the actual distance of the femoral head center from the DAR.
Animals 12 01269 g001
Figure 2. (A) Distraction view VD radiograph of a four-month-old Rottweiler (same dog as in Figure 1A,B). (B) A magnification of the right and (C) a magnification of the left hip joint demonstrating the distraction index measurements. Note the laxity in the left joint which was not obvious in the extended view.
Figure 2. (A) Distraction view VD radiograph of a four-month-old Rottweiler (same dog as in Figure 1A,B). (B) A magnification of the right and (C) a magnification of the left hip joint demonstrating the distraction index measurements. Note the laxity in the left joint which was not obvious in the extended view.
Animals 12 01269 g002
Figure 3. Dorsal acetabular rim view radiographs of the same Rottweiler shown in Figure 1 A,B as well as Figure 2. Measurement of the dorsal acetabular rim slope is demonstrated on (A) and of the center edge angle on (B). Right is always to the left of the image.
Figure 3. Dorsal acetabular rim view radiographs of the same Rottweiler shown in Figure 1 A,B as well as Figure 2. Measurement of the dorsal acetabular rim slope is demonstrated on (A) and of the center edge angle on (B). Right is always to the left of the image.
Animals 12 01269 g003
Table 1. Descriptive statistics of the measured quantitative values in four-month-old Rottweilers.
Table 1. Descriptive statistics of the measured quantitative values in four-month-old Rottweilers.
NA °DI mmDARS °CEA °
Mean ± SD 1Observer 1103 ± 7.30.3 ± 0.17.3 ± 3.516.9 ± 4
Observer 2100.5 ± 60.3 ± 0.18.2 ± 5.317.8 ± 5.2
Observer 399.4 ± 7.80.4 ± 0.211.6 ± 416 ± 5.6
Observer 4102.9 ± 7.20.3 ± 0.17.7 ± 4.714.8 ± 5.7
Observer 5103.1 ± 6.50.3 ± 0.24.4 ± 5.616 ± 6
Overall101.8 ± 7.10.3 ± 0.28.1 ± 516.2 ± 5.5
Range 2118–721–033.7–0.130.3–1.6
1 Standard Deviation. 2 Maximum–minimum.
Table 2. Percentage (%) of the diagnosed qualitative values by each observer at four months old.
Table 2. Percentage (%) of the diagnosed qualitative values by each observer at four months old.
SCAR
ObserverRegular and Thin SclerosisRegular and Thick SclerosisLaterally Increased Thickness of Sclerosis
1 (Surgeon) *100.000
2 (Surgeon)76.823.20
3 (Radiologist)68.516.714.8
4 (Radiologist) *96.43.60
5 (Radiologist)70.030.00
Total84.112.63.3
LCFH
ObserverMedial to DARSuperimposing DAR0–2 mm Lateral to DARMore than 2 mm Lateral to DAR
1 (Surgeon)53.737.07.41.9
2 (Surgeon)57.119.621.41.8
3 (Radiologist)44.625.023.27.1
4 (Radiologist)41.235.321.62.0
5 (Radiologist)49.029.419.62.0
Total49.329.118.73.0
GDJD
ObserverCongruent Joint Space and No OsteophytesIncongruent Joint Space and No osteophytesIncongruent Joint Space with Osteophytes
1 (Surgeon)88.911.10
2 (Surgeon)55.444.60
3 (Radiologist)44.644.610.7
4 (Radiologist)76.821.41.8
5 (Radiologist)75.911.113.0
Total68.126.85.1
GDAR
ObserverTriangular Shape and No OsteophytesMild Rounded DAR and No OsteophytesRounded DAR with Mild OsteophytesTruncated Shape of the DAR with Laxity and Less RoofingRounded Shape of the DAR with Severe Osteophytes
1 (Surgeon)79.618.501.90
2 (Surgeon)12.569.617.900
3 (Radiologist)1.841.135.716.15.4
4 (Radiologist)37.541.116.15.40
5 (Radiologist)28.332.126.47.55.7
Total31.640.719.36.22.2
* Certified CHD scrutineer; SCAR, sclerosis of the cranial acetabular rim; LCFH, location of the center of the femoral head; GDJD, grading of the degenerative joint disease; GDAR, grading of the dorsal acetabular rim.
Table 3. Intra-class correlation coefficient (ICC) for inter-observer variability between the observers.
Table 3. Intra-class correlation coefficient (ICC) for inter-observer variability between the observers.
ParameterICCSignificance
NA0.93p < 0.001
DI0.95p < 0.001
DARS0.74p < 0.001
CEA0.86p < 0.001
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Vidoni, B.; Aghapour, M.; Kneissl, S.; Vezzoni, A.; Gumpenberger, M.; Hechinger, H.; Tichy, A.; Bockstahler, B. Inter-Observer Agreement in Radiographic Diagnosis of Coxofemoral Joint Disease in a Closed Cohort of Four-Month-Old Rottweilers. Animals 2022, 12, 1269. https://doi.org/10.3390/ani12101269

AMA Style

Vidoni B, Aghapour M, Kneissl S, Vezzoni A, Gumpenberger M, Hechinger H, Tichy A, Bockstahler B. Inter-Observer Agreement in Radiographic Diagnosis of Coxofemoral Joint Disease in a Closed Cohort of Four-Month-Old Rottweilers. Animals. 2022; 12(10):1269. https://doi.org/10.3390/ani12101269

Chicago/Turabian Style

Vidoni, Britta, Masoud Aghapour, Sibylle Kneissl, Aldo Vezzoni, Michaela Gumpenberger, Harald Hechinger, Alexander Tichy, and Barbara Bockstahler. 2022. "Inter-Observer Agreement in Radiographic Diagnosis of Coxofemoral Joint Disease in a Closed Cohort of Four-Month-Old Rottweilers" Animals 12, no. 10: 1269. https://doi.org/10.3390/ani12101269

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop