Next Article in Journal
Self-Reported Medication Use among Pregnant and Breastfeeding Women during the COVID-19 Pandemic: A Cross-Sectional Study in Five European Countries
Next Article in Special Issue
Artificial Intelligence in Bone Metastases: An MRI and CT Imaging Review
Previous Article in Journal
The Effect of Exercise on Cardiometabolic Risk Factors in Women with Polycystic Ovary Syndrome: A Systematic Review and Meta-Analysis
Previous Article in Special Issue
Epidural Steroid Injections for Low Back Pain: A Narrative Review
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Can Hip-Knee Line Angle Distinguish the Size of Pelvic Incidence?—Development of Quick Noninvasive Assessment Tool for Pelvic Incidence Classification

1
Department of Occupational and Environmental Health, Graduate School of Medical Sciences, Nagoya City University, Nagoya 4678601, Japan
2
Department of Rehabilitation, Nagoya City University West Medical Center, Nagoya 4628508, Japan
3
Faculty of Rehabilitation Sciences, Nagoya Gakuin University, Nagoya 4568612, Japan
4
Spine Center, Department of Orthopedic Surgery, Nagoya City University West Medical Center, Nagoya 4628508, Japan
*
Author to whom correspondence should be addressed.
Int. J. Environ. Res. Public Health 2022, 19(3), 1387; https://doi.org/10.3390/ijerph19031387
Submission received: 24 November 2021 / Revised: 7 January 2022 / Accepted: 22 January 2022 / Published: 26 January 2022
(This article belongs to the Special Issue Low Back Pain (LBP))

Abstract

:
This study aimed to explore effective measurement angles for pelvic incidence (PI) classification and to develop a quick, noninvasive assessment tool for PI classification. We defined five variation types of hip–knee line (HKL) angles and tested the discrimination ability of the receiver operating characteristic (ROC) analysis using 125 photographs of upright standing posture from the right lateral side. ROC analysis revealed an applicable HKL angle defined by the line connecting the most raised part of the buttock and the central point of the knee and the midthigh line. The acceptable cut-off points for discriminating small or large PIs in terms of HKL angle were 18.5° for small PI (sensitivity, 0.91; specificity, 0.79) and 21.5° for large PI discrimination (sensitivity, 0.74; specificity, 0.72). In addition, we devised a quick noninvasive assessment tool for PI classification using the cut-offs of the HKL angle with a view to practical application. The results of intra- and inter-rater reliability ensured a substantial/moderate level of the tool (Cohen’s kappa coefficient, 0.79; Fleiss’s kappa coefficient, 0.50–0.54). These results revealed that the HKL angle can distinguish the size of the PI with a high/moderate discrimination ability. Furthermore, the tool indicated acceptable inter-/intra-rater reliability for practical applications.

1. Introduction

Low back pain (LBP) is one of the most common health problems worldwide. According to a systematic review, the lifetime prevalence in the general population is 60–80% [1]. The one-year prevalence in the general population is 38%, the one-month prevalence is 23–26%, and the point prevalence is 12–14% [2,3,4]. According to the Global Burden of Diseases study, the average disability-adjusted life years (DALY) for all generations of LBP increased from 1.7 years to 2.5 years as of 2019 compared to 1990 [5]. Out of 310 diseases, LBP was the leading cause of the years lived with disability in 2017 [6]. Furthermore, the DALY of LBP in the working generation is at a high level of 3.9 years. Hence, LBP, the most commonly reported work-related musculoskeletal disorder, has also received attention in terms of outcomes leading to a decline in labor productivity and economic loss [7,8].
Effective measures for LBP are still controversial. Although a recent meta-analysis [9] showed some intervention effects such as exercise in combination with education, there is no solid evidence found for others such as back belts, ergonomic adjustments, or training on manual material handling [10]. One of the possible reasons for such a discrepancy in the effect of LBP can be found in nonpersonalized countermeasures without considering individual biomechanical features of the lumbar spine.
For example, pelvic incidence (PI), which is measured by lateral spine radiography, has been attracting attention as a determinant of LBP. PI is an important clinical parameter generally applied in the field of spinal surgery after Legaye et al. reported it in 1993 [11]. Since then, it has been used for PI-based spinal surgery alignment design and analysis of clinical outcomes [12,13]. PI has some features representing an angle that: (1) defines the lumbar lordosis [14,15], (2) indicates the inclination of the sacrum in the pelvis [16], (3) is fixed during puberty [17], and (4) is a constant independent of posture changes [18]. Recent research shows that PI also has no differences in any age groups and sex [19], but there are differences in ethnicity [20]. PI represents the physiological lordosis of the lumbar spine, inducing differences in mechanical stress on the intervertebral discs and facet joints depending on the degree of angle. If we could successfully grasp the angle of PI in a simple way without exposure to X-rays, PI may be available as a personalized preventive measure for LBP according to the angle of individual PIs. Thus, we devised a noninvasive indirect measurement using surrogate indicators to estimate the PI using anthropometric landmarks on the body surface. Our previous studies [21,22] revealed a surrogate angle on the body surface reflecting the PI. The surrogate angle of the PI can be defined as “the angle between the line connecting the upper edges of the greater trochanter and iliac crest, and the line connecting the upper edge of the iliac crest and the buttock at the same height as the greater trochanter”. It has sufficient practical reliability to estimate the PI (R2 = 0.63), although the measurement method requires substantial time (about 15 min/person) and physiotherapist skill for palpation. Another possible approach that can more easily determine the classification of PI might be to use a body silhouette. As shown in a commentary paper by Ramchandran et al. providing a theoretical interpretation of PI, changing PI visually reflects the waistline and buttocks due to increasing pelvic overhang with increasing sacroiliac joint angulation [23]. For further simplification, we can hypothesize that those with an anatomically large PI will have raised buttocks; in contrast, those with a small PI will have a smaller bulge in the buttocks. However, little research has been conducted to determine whether the thickness of the buttocks (silhouette) may reflect the actual size of the PI.
Therefore, we focused on the thickness of the buttocks on the silhouette to find an easy, noninvasive way to classify the stage of the PIs. The purpose of this study was to explore effective measurement angles for PI classification in terms of discrimination ability using receiver operating characteristic (ROC) curve analysis, and to identify the availability of visual buttock silhouettes (Study 1). Furthermore, the intra- and inter-rater reliability of a devised tool for simple PI classification focusing on the visual buttock silhouette was assessed (Study 2).

2. Materials and Methods (Study 1: Exploring Effective Surrogate Angles for PI Classification Focusing on the Buttocks)

2.1. Measurement Angular Definition

We discussed potential landmarks applicable for the estimation of PI based on anatomical, anthropometric, and physiotherapy aspects: (1) the most raised part of the buttock; (2) top of the head; (3) the anterior (patella), central, and posterior points of the sagittal knee; and (4) center of the thigh (the anterior–posterior diameter of the transition between the buttocks and the thigh). To verify the PI with the appearance of the body silhouette, the posterior and anterior surfaces of the knee are landmarks that can be easily confirmed, and have been used in many studies in ergonomics and clinical practice. Furthermore, the lines at the center of the knee and the center of the thigh on the lateral side (sagittal plane) are used to measure the range of motion of the hip and knee joints in clinical situations. The parietal point was adopted as a frequently used landmark for cervical and standing posture analyses.
The hip–knee line (HKL) angles were defined as the angle between the following two intersecting lines on the sagittal plane: the line connecting the most raised part of the buttock and either the anterior, central, or posterior knee; and the line connecting either knee point and either of vertical lines as the parietal, vertical, or the midthigh line. The midthigh line was defined as the femoral axis (the central part of the anterior–posterior diameter of the knee and the center of the thigh). As a combination of the lines, five variation types of HKL angles (A1, A2, B1, B2, and C) were defined as shown in Figure 1.

2.2. Procedures

The 125 voluntary participants (71 males, 54 females; average age 55.9 ± 18.9 years) were recruited in line with the following inclusion criteria: (1) normal spinal alignment with sagittal vertical axis less than 40mm, (2) standing alignment without knee flexion contracture, (3) no difference in leg length, and (4) maintained postural standing stability. We provided a sufficient explanation for this study (IRB No. 60-21-0072, Nagoya City University). They were then asked to assume a neutral posture in an upright position. Subsequently, a photograph of their upright standing posture from the right lateral side was taken using a digital camera (Power Shot S5, Canon Inc., Tokyo, Japan) fixed on a camera tripod at a height of 60 cm, with the focus distance to the subject set to 3 m.

2.3. Measurement of HKL Angles and Outcome Variable

The landmarks in each picture were obtained using the ImageJ ver. 1.48 software (NIH, Bethesda, MD, USA), and five types of HKL angles (A1, A2, B1, B2, and C) were measured using the landmarks.
The surrogate angle correlating with PI [21,22] was used to measure the outcome. The surrogate angle of the PI can be defined as “the angle between the line connecting the upper edges of the greater trochanter and iliac crest, and the line connecting the upper edge of the iliac crest and the buttock at the same height as the greater trochanter”. The details of the measurement and reliability of the landmarks used to estimate the surrogate angle by palpation have been described elsewhere [22]. The surrogate angle has sufficient practical reliability for estimating PI (R2 = 0.63).

2.4. Data Analysis and Statistical Analyses

The surrogate angles of PI obtained from the 125 photographs were classified by using quartiles: small (“S”, less than 42°, indicating the first quartile), medium (“M”, between 42° and 51°, the first and third quartile range), or large (“L”, more than 51°, the third quartile). To explore effective measurement angles for PI classification in terms of discrimination ability using ROC analysis, the outcome variables were further converted to the two dichotomous variables determining S/ML and SM/L.
To assess the discriminating ability of the HKL angles relative to S/ML and SM/L of PI, ROC curves were created by plotting values of sensitivity for the y-axis and 1-specificity for the x-axis to calculate the area under the curve (AUC). Discriminating ability was assessed by the AUC of the ROC curve by the following criteria: 0.5–0.7 as low accuracy, 0.7–0.9 as moderate accuracy, and >0.9 as high accuracy. We considered the HKL angle with the highest AUC out of the five HKL angles as a candidate angle applicable for a practical PI classification tool using the thickness of the buttocks. Focusing on the candidate angle with the highest AUC, the Youden index of the candidate angle, indicating the maximum difference between sensitivity and specificity, was calculated to assess the optimal threshold value (cut-off point) of S/ML and SM/L for HKL angles. These analyses were conducted using SPSS version 26.0 (IBM Corp., Armonk, NY, USA).

2.5. Criteria for Selecting Cut-Off Points Applicable to Practical PI Classification Tools Using Buttock Thickness

To devise a practical PI classification tool, we empirically considered that at least the following levels were needed as an acceptable range of cut-off points: ≥0.7 sensitivity and specificity. The acceptable range should include the maximum value of the Youden index. Furthermore, to ensure the availability of visual buttock silhouettes, angular differences between thresholds of S/ML and SM/L for PI classification should be set at least more than 3°.

3. Results (Study 1)

3.1. AUCs of HKL Angles Discriminating Small or Large PIs

The average value of surrogate angles of PI was 47.0 ± 6.2° (male 45.4 ± 5.1°; female, 49.1 ± 7.0°) and BMI was 23.4 ± 3.4kg/m2. Figure 2 shows the AUCs of the HKL angles discriminating small (<42°) or large (>51°) PIs. The HKL angle with the highest AUC value was the HKL angle C, reaching a high accuracy of 0.93 for the small and moderate PIs, and 0.82 for the large PIs. On the other hand, the HKL angle with the lowest AUC was A2, which had low accuracies of 0.61 for the small PIs and 0.58 for the large PIs.

3.2. Cut-Off Points Applicable to Practical PI Classification Tool Using the Thickness of the Buttocks

In terms of the AUC value, the HKL angle C was considered to be an appropriate candidate for a practical PI classification tool using the thickness of the buttocks. Table 1 shows the results of the sensitivity, specificity, and Youden index of the HKL angle C. Columns that are shaded in gray in the table mean out of criteria (unacceptable range of cut-off points); namely, sensitivity and specificity of >0.7. The acceptable cut-off angles relative to S/ML discrimination ranged from 18.5° to 19.5° based on the criteria for selecting the cut-off points. The acceptable range also included a maximum Youden index value of 0.74 at 19.5°. Similar trends were observed in the strata of males and females.
The acceptable cut-off angle for SM/L discrimination was 21.5°, with a maximum Youden index value of 0.46. For male participants, the acceptable range was from 21.5° to 22.5°, while no acceptable range was found for female participants.

3.3. Devised PI Classification Tool Using the HKL Angle

Emphasizing the ease of use and quick assessment, we developed a practical PI classification tool using the HKL angle, focusing on the thickness of the buttocks (Figure 3). The tool, which was printed on a transparent film, can be used to estimate the HKL angle sizes of S, M, and L by looking through it at the standing posture of the lateral side. Based on the acceptable range of cut-off points, the thresholds were set to 18.5° for S/ML and 21.5° for SM/L discrimination. In terms of the Youden index, the optimal cut-off angle was 19.5°; however, we applied an acceptable cut-off angle of 18.5° relative to S/ML. Angular differences between thresholds of S/ML and SM/L for PI classification should be set at least more than 3° in order to ensure the availability of visual buttock silhouettes. The tool enables quick assessment following two steps. First, align the points of (a) the central point of the anterior–posterior diameter of the knee and (b) the center of the thigh in the tool with those on the body surface of the subject. Depending on the focal length, measurement points A, B, and C were selected. Then, we determined where the most-raised point of the buttock was placed in the S, M, or L areas of the HKL angle.

4. Materials and Methods (Study 2: Assessing Intra-/Inter-Rater Reliability of the PI Classification Tool Using the HKL Angle)

4.1. Participants

A total of 14 healthy persons (working/studying at university/hospital, mean age 37.3 ± 10.0 years, 7 males and 7 females) voluntarily participated in this study as examiners for evaluating intra- and inter-rater consistency. Informed consent was obtained from the participants after an explanation of the study.

4.2. Materials Used for the Assessment

Of the 125 photos used in Survey 1, three sets of 24 photos were randomly selected for testing. Of these test materials, one was intended for use in prior training, and the other two were used for the assessment of intra-and inter-rater reliability. The ratio of classification was 1:2:1 for S:M:L. The developed PI classification tool using the HKL angle (Figure 3) was printed on a transparent film with a length of 14.8 cm and width of 21 cm (A5 size).

4.3. Procedures

The photos of the material were randomly projected on the screen and reduced to 1/2 of the actual subject size. This means that the focal distance between the examiner and the screen needed to be converted to 1/2 size. Therefore, the examiner was requested to sit in front of the screen 75 cm away at a focal distance of 1.5 m. Subsequently, the examiners were trained in advance on how to use the tool using the photo material for prior training.
In the training session, the examiners sitting in front of the screen were instructed to hold the tool and keep their eye level horizontal with the height of the subject on the screen. In addition, they were asked to place their eyes and the tool on a vertical line to the screen. After the setting, the researchers instructed them by showing 24 prior training photos one by one on how to use the tool already represented in Section 4.3. Examples of applications of the tool for practice are shown in Figure 4. Each examiner evaluated the materials for the assessment twice, with intervals for rest after training.

4.4. Data Analysis and Statistical Analysis

As one of the usability metrics, we measured the required time of first and second sessions to complete the classification of PI. The mean time (s/photo) of classifying 24 photos in each session was calculated. Furthermore, the correct rate was calculated as an effectiveness metric. The correct rate represented the extent to which examiners’ responses agreed with an external criterion for the classification of the HKL angle. We applied the surrogate angle of the PI as an external criterion, calculated in Study 1. A paired t-test was conducted to show the significant differences in the means for each metric between sessions.
Cohen’s kappa coefficient was calculated to examine the intra-rater reliability of measurements, showing the test–retest reliability of each examiner within the first and second sessions. Fleiss’s kappa coefficient (quadratic) was applied as a weighted inter-rater reliability, meaning reliability between the initial test (first session) and retest (second session) measurements obtained from all examiners. Both coefficients were estimated using 95% confidence intervals (CIs). According to Landis’s criteria [24], reliability levels of kappa coefficients were defined as 0 for poor, 0.01–0.20 for slight, 0.21–0.40 for fair, 0.41–0.60 for moderate, 0.61–0.80 for substantial, and 0.81–1.00 for almost perfect. These analyses were conducted using SPSS version 26.0 (IBM Corp., Armonk, NY, USA).

5. Results (Study 2)

5.1. Usability Metrics

The mean time (sec/photo) was 17.0 ± 4.7 for the first session and 13.6 ± 2.9 for the second session (Table 2); this difference was significant (mean difference, 3.4; 95% CI, 1.6–5.2; t(13) = 4.1, p = 0.001). The correct rate (%) reached 77.1 ± 6.9 for the first session and 79.8 ± 6.9 for the second session; no significant difference was found (t(13) = 1.0, p = 0.32).

5.2. Intra-/Inter-Rater Reliability

Table 2 also shows the results of intra- and inter-rater reliability of the PI classification tool using the HKL angle. The mean Cohen’s kappa coefficient as intra-rater reliability was 0.79 (95% CI, 0.61–0.96), indicating “substantial” levels of test–retest consistency. No sex difference was found in intra-rater reliability, even when focusing on the differences in the stratified analysis of the male and female subjects in the photos.
The mean Fleiss’s kappa coefficient as inter-rater reliability was 0.50 (95% CI, 0.47–0.53) for the first session and 0.54 (95% CI, 0.51–0.57) for the second session, both indicating “moderate” levels of consistency between examiners. We also conducted a stratified analysis, showing that raters tended to do better with female subjects than male ones (first session, 0.43 for males and 0.56 for females; second session, 0.50 for males and 0.57 for females, respectively).

6. Discussion

This was the first study to show that the HKL angle formed by lateral body landmarks focusing on the area of the femur and buttock can discriminate the classification of small or large PIs. We examined the optimal cut-off points for discriminating small or large PIs in terms of HKL angle, leading to an acceptable cut-off angle of 18.5° for S/ML and 21.5° for SM/L discrimination, considering a threshold range of more than 3° or larger angle. In addition, we devised a quick noninvasive assessment tool for PI classification using the cut-offs of the HKL angle with a view to practical application. The results of intra- and inter-rater reliability indicated certain limitations, but ensured a substantial/moderate level of the tool, meaning that it has sufficient potential for practical use. We will discuss the relationship between the HKL angle and PI, as well as the intra-and inter-rater reliability of the tool, in the following sections.

6.1. Relationship between the HKL Angle and PI Using the Visual Buttock Silhouette

HKL angle C reached a high accuracy of 0.93 for the small and moderate of 0.82 for the large PIs, whereas the HKL angle A2 showed the lowest AUC among all types of HKL angles. This difference deserves careful attention when interpreting the rationale for the HKL angles reflecting PI.
The HKL angles A1 and A2 shown in Figure 1 used the line connecting the top of the head and anterior/posterior knee points. The line was intended to reflect the alignment of the whole body, because whole-body alignment is a key clinical parameter generally applied in the field of spinal surgery to evaluate the bending characteristics of the spinal column from the standing posture of the sagittal plane. In addition, the Kendall classification [25], which is known as a representative of the classification of whole-body alignment, can be generally used to study muscle shortening and weakness in the clinical field of physiotherapy, and to correlate the relationship between the type of Kendall posture and lumbar pain [26]. Furthermore, PI is anatomically considered to have tendencies to be larger in the order of flat-back (S), sway-back (M), and ideal (L) and kyphosis–lordosis (LL) in the Kendall postures [27].
On the other hand, whole-body alignment maintains a standing posture under the influence of the movement control of many joints, such as the large angular displacement of the hip joint in a static standing position and curvature of the spinal column [28]. Moreover, the spinal column alignment compensates to maintain the whole-body balance of the head, chest, lumbar region, and lower limbs [29]. These findings provide an insight that the use of the line connecting the top of the head and anterior/posterior knee points for estimating PI, which is a part of spinal alignment indicating the inclination of the sacrum in the pelvis, might have disadvantages. This might also be explained by the differences between the HKL angles A and B. In fact, the HKL angles B1/B2 were intended to exclude the effect of whole-body alignment by using the line connecting the reference vertical line and the knee points. In addition, the HKL angle B1/B2 formed by the line connecting the raised part of the buttocks and either the anterior/posterior knee point or the reference vertical line can be considered to be an angle that simply indicates the degree of the uplift of the buttocks (sacrum). The AUCs of HKL angle B1/B2, excluding body alignment effects, were relatively high compared to HKL angle A2, regardless of the anterior/posterior knee positions. Moreover, the effect of compensation on body alignment is expected to be smaller for A1 than A2, owing to a relatively smaller angle, and leading to a relatively high AUC of A1 compared to that of A2. Therefore, it seems reasonable to suppose that HKL angle A2 showed a relatively low discriminating ability of PI due to these findings.
What needs to be emphasized here is that the HKL angle C focuses not on the whole spinal alignment, but on the limited area of the femur and buttock. It should be noted that HKL angle C defines an angle using a line connecting the central point of the anterior–posterior diameter of the transition between the buttocks and the thigh and the midpoint of the lateral joint space of the knee. This indicates the equivalent line connecting the great trochanter and the epicondyle of the femur used in the measurement of the flexion/extension angle of the hip and knee joint defined in the range of motion, or the line connecting the femoral epicondyle and the hip joint center of rotation defined in the International Society of Biomechanics’ recommendation [30].
This equivalent line has the following advantages: First, humans have a strategy of maintaining standing balance, the so-called “cone of economy” with the feet as the fulcrum; in other words, standing posture can be maintained in the conical space with the foot as the apex [31]. To compensate for changes in spinal alignment, the central line of the femur plays an important role in a stable standing posture. Humans compensate for age-related changes in spinal alignment by increasing posterior pelvic tilt and changing leg alignments to maintain the gravity line over the feet [32]. This indicates the possibility that the central line of the femur sensitively represents the extent of the PI. Second, according to a recent study that investigated the correlation between the sway of the center of gravity and spinal alignment such as PI, the larger the PI, the more the center of gravity moved forward [33]. This indicated that the axis of the thigh, when viewed from the lateral side, had shifted forward, and the larger the PI, the larger the angle of the HKL angle C. Thus, the HKL angle C reflecting the central line of the femur may be linked to postural fluctuations due to anterior–posterior bending of the body, which might have resulted in the highest AUC of HKL angle C sensitively reflecting PI.

6.2. Optimal Cut-Off Points Applicable to Practical PI Classification Tool

The acceptable cut-off values of the HKL angle C were 18.5° (sensitivity, 0.91; specificity, 0.79) for S/ML and 21.5° (sensitivity, 0.74; specificity, 0.72) for SM/L discrimination. Although it seemed to be sufficient for discriminating abilities in terms of application to a quick, noninvasive tool in practical use, some challenges remain.
The first thing we noticed was that Youden index value at 18.5° of the HKL angle for discriminating small (<42°) PI showed 0.69, whereas the value for large (>51°) PI was as low as 0.46 at 21.5° of the HKL angle. One of the reasons for this is the PI characteristics of the Japanese population. Asians such as Japanese or Koreans generally have smaller PI values than Caucasians; for example, Kanemura reported Japanese PI as 46.7 ± 8.7° [34], and another similar study showed 46.7 ± 8.9° in 86 Japanese healthy adults aged from 23 to 59 years [35], and 47.8 ± 9.3° for the Korean population [36]. In contrast, 52.0 ± 9.0° was reported from the United States [12], 50.6 ± 10.2° [37] and 54.7 ± 10.6° [38] from France, and 50.2 ± 10.0° [11] from Belgium. Thus, the Japanese population not only has a smaller PI, but also a narrower range of standard deviation than Caucasians. Another reason might be the feature of the Japanese physique with relatively flat, smaller swelling of the buttocks compared to Westerners [35]. This means that even if the PI was large, the HKL angle tended to be underestimated in the case of focusing on the visual buttock silhouette.
Second, we should focus on the differences in the stratified analysis of male and female participants. The Youden index is relatively smaller in females than in males, indicating that the HKL angle might have disadvantages when applied to female patients. This might be due to the anatomical sex difference in the pelvis. The female pelvis has a large lateral diameter and is circular, and the anterior–posterior direction of the female is also larger than that of the male [39]. In this study, since we defined and assessed the HKL angle from the lateral side, such an anatomical feature may have biased the HKL angle in female participants. Another possibility may depend on the sample population used in this study. In general, it is believed that there is no sex difference in PI itself, although the samples of participants included in this study had a slight tendency to have a larger PI of 49.1 ± 7.0° in females, as compared to 45.4 ± 5.1° for males. The PI obtained from the 125 photographs were classified by quartiles regardless of sex, and the large PI was tentatively defined as >51° using the threshold in the third quartile. The large PI category consequently resulted in more females than males. Such biases might have led to a relatively low discriminating ability under the condition of SM/L.

6.3. Intra-/Inter-Rater Reliability of Tool Using HKL Angle

As shown in Table 2, the mean Cohen’s kappa coefficient as intra-rater reliability was 0.79 (95% CI, 0.61–0.96), indicating “substantial” levels of test–retest consistency. No sex difference was found in intra-rater reliability, even when focusing on the differences in the stratified analysis of the male and female subjects in the photos.
In contrast, some challenges seem to be in the inter-rater reliability in the results of Fleiss’s kappa coefficients, which might be considered insufficient levels due to “moderate” consistency between examiners. However, it should be noted that Fleiss’s kappa coefficient contains a paradox, meaning that the kappa statistic may behave inconsistently in case of strong agreement between raters, since this index assumes lower values than would have been expected [40]. Second, the stratified analysis showed tendencies to be better for female subjects than male subjects (first session, 0.43 for males and 0.56 for females; second session, 0.50 for males and 0.57 for females). This might be related to the points previously discussed regarding the anatomical sex difference of the pelvis and sampling biases resulting in the inclusion of more females in the large PI category. Third, we should focus on improving the inter-rater reliability in the second session compared to the first session. We provided sufficient training to examiners using the 24 prior training photos individually. Nevertheless, we observed a tendency to be better in the 2nd session. Furthermore, a significant improvement in the meantime was observed between sessions. These results indicated that they did not reach a plateau, so further improvements in the inter-rater reliability could be expected.
Considering the results comprehensively, the devised assessment tool for PI classification using the cut-offs of the HKL angle has sufficient potential for practical use.

6.4. Practical Implication and Limitation

This study provides useful information about how to estimate PI using the HKL angle in a validated, noninvasive way. PI is considered to be one of the possible determinants of low back pain, and has been attracting attention as a new countermeasure considering individual biomechanical features of the lumbar spine. This knowledge can contribute not only to improving the new insight of occupational health research, but also to developing new noninvasive technologies for measuring PI using image recognition with artificial intelligence.
This study had some limitations. First, the values of PI were estimated by using the surrogate angle, not measured by X-rays. The surrogate angle has sufficient reliability for estimating PI under practical use (R2 = 0.63); however, the remaining variation of R2 can lead to misclassification into small, medium, or large PIs. Second, the study population was limited to Japanese adults, so the proposed acceptable range of cut-off points might vary with ethnicity [41]. Third, the small sample size may lead to imbalanced distributions of the target variable so that the sample size would need to be even larger in terms of the robustness of the results [42]. Fourth, a morbidly obese patient and an underweight patient with the same PI will likely have a different HKL angle; however, this study could not provide any evidence of the effect of BMI on the HKL angles. Japanese have a relatively low BMI compared to other ethnicities; morbidly obese patients (BMI > 35) are rare in the Japanese population, and none were in the current study population. In addition, there were only five underweight participants (BMI < 18.5). Further research is warranted in various populations. Fifth, the results of the AUC and Youden index showed that the discriminating ability of HKL angles for detecting large PIs was relatively low, as was the case for female patients. Such cases may require multiple measurements with different examiners to ensure the reliability of the PI classification tool. Sixth, standard procedures for training manuals should be prepared using various photos with a wide range of ages and/or multiple features of curvature of the spinal column. Further improvement is warranted to enhance the intra- and inter-rater reliability of the tools for practical use.

7. Conclusions

To explore effective measurement angles for PI classification, we determined the applicable HKL angle defined as the angle of two intersecting lines on the sagittal plane, the line connecting the most raised part of the buttock and central point of the knee, and the midthigh line (the femoral axis). This study revealed that the HKL angle could distinguish the size of PI with high/moderate discrimination ability. Furthermore, a quick, noninvasive assessment tool devised for PI classification using the cut-offs of the HKL angle indicated acceptable inter- and intra-rater reliability, enough for practical application.

Author Contributions

Conceptualization, S.Y., T.E. and M.K.; methodology, S.Y., K.A., T.U. and T.E.; formal analysis, S.Y. and T.E.; investigation, S.Y., T.E., T.U., S.K., Y.S., A.Y. and M.K.; resources, A.I. and T.E.; data curation, S.Y., T.E., T.M. and M.K.; visualization, S.Y. and T.E.; writing—original draft, S.Y.; writing—review and editing, T.E., T.M., K.A., A.I. and M.K.; supervision, T.E., T.M., K.A. and M.K.; project administration, T.E., A.I. and M.K. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

The study was conducted according to the guidelines of the Declaration of Helsinki and approved by the Institutional Review Board of Nagoya City University Graduate School of Medical Sciences (No. 60-21-0072).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The anonymized data presented in this study are available upon request from the corresponding author. The data are not publicly available due to privacy considerations or ethical challenges.

Acknowledgments

We would like to thank the staff (physiotherapists, occupational therapists, speech therapists, pharmacists, and nurses) and patients of the Nagoya City University West Medical Center for their active consent to participate in this study. We would also like to thank the staff of Nagoya City University for their active consent to participate in this study.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Ganesan, S.; Acharya, A.S.; Chauhan, R.; Acharya, S. Prevalence and risk factors for low back pain in 1,355 young adults: A cross-sectional study. Asian Spine J. 2017, 11, 610–617. [Google Scholar] [CrossRef]
  2. Andersson, G.B. Epidemiological features of chronic low-back pain. Lancet 1999, 354, 581–585. [Google Scholar] [CrossRef]
  3. Manchikanti, L.; Singh, V.; Falco, F.J.; Benyamin, R.M.; Hirsch, J.A. Epidemiology of low back pain in adults. Neuromodulation 2014, 17 (Suppl. S2), 3–10. [Google Scholar] [CrossRef]
  4. Meucci, R.D.; Fassa, A.G.; Faria, N.M. Prevalence of chronic low back pain: Systematic review. Rev. Saude Publica 2015, 49, 73. [Google Scholar] [CrossRef]
  5. Diseases, G.B.D.; Injuries, C. Global burden of 369 diseases and injuries in 204 countries and territories, 1990–2019: A systematic analysis for the Global Burden of Disease Study 2019. Lancet 2020, 396, 1204–1222. [Google Scholar]
  6. Wu, A.; March, L.; Zheng, X.; Huang, J.; Wang, X.; Zhao, J.; Blyth, F.M.; Smith, E.; Buchbinder, R.; Hoy, D. Global low back pain prevalence and years lived with disability from 1990 to 2017: Estimates from the Global Burden of Disease Study 2017. Ann. Transl Med. 2020, 8, 299. [Google Scholar] [CrossRef] [PubMed]
  7. Itoh, H.; Kitamura, F.; Yokoyama, K. Estimates of annual medical costs of work-related low back pain in Japan. Ind. Health 2013, 51, 524–529. [Google Scholar] [CrossRef] [Green Version]
  8. Punnett, L.; Pruss-Utun, A.; Nelson, D.I.; Fingerhut, M.A.; Leigh, J.; Tak, S.; Phillips, S. Estimating the global burden of low back pain attributable to combined occupational exposures. Am. J. Ind. Med. 2005, 48, 459–469. [Google Scholar] [CrossRef] [PubMed]
  9. Steffens, D.; Maher, C.G.; Pereira, L.S.; Stevens, M.L.; Oliveira, V.C.; Chapple, M.; Teixeira-Salmela, L.F.; Hancock, M.J. Prevention of low back pain: A systematic review and meta-analysis. JAMA Intern. Med. 2016, 176, 199–208. [Google Scholar] [CrossRef]
  10. Verbeek, J.H.; Martimo, K.P.; Karppinen, J.; Kuijer, P.P.; Viikari-Juntura, E.; Takala, E.P. Manual material handling advice and assistive devices for preventing and treating back pain in workers. Cochrane Database Syst Rev. 2011, 6. [Google Scholar] [CrossRef]
  11. Legaye, J.; Duval-Beaupere, G.; Hecquet, J.; Marty, C. Pelvic incidence: A fundamental pelvic parameter for three-dimensional regulation of spinal sagittal curves. Eur. Spine J. 1998, 7, 99–103. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  12. Schwab, F.; Patel, A.; Ungar, B.; Farcy, J.P.; Lafage, V. Adult spinal deformity-postoperative standing imbalance: How much can you tolerate? An overview of key parameters in assessing alignment and planning corrective surgery. Spine 2010, 35, 2224–2231. [Google Scholar] [CrossRef]
  13. Schwab, F.J.; Blondel, B.; Bess, S.; Hostin, R.; Shaffrey, C.I.; Smith, J.S.; Boachie-Adjei, O.; Burton, D.C.; Akbarnia, B.A.; Mundis, G.M.; et al. Radiographical spinopelvic parameters and disability in the setting of adult spinal deformity: A prospective multicenter analysis. Spine 2013, 38, e803–e812. [Google Scholar] [CrossRef] [Green Version]
  14. Chen, R.Q.; Hosogane, N.; Watanabe, K.; Funao, H.; Okada, E.; Fujita, N.; Hikata, T.; Iwanami, A.; Tsuji, T.; Ishii, K.; et al. Reliability analysis of spino-pelvic parameters in adult spinal deformity: A comparison of whole spine and pelvic radiographs. Spine 2016, 41, 320–327. [Google Scholar] [CrossRef] [Green Version]
  15. Tyrakowski, M.; Yu, H.; Siemionow, K. Pelvic incidence and pelvic tilt measurements using femoral heads or acetabular domes to identify centers of the hips: Comparison of two methods. Eur. Spine J. 2015, 24, 1259–1264. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  16. Lowe, T.; Berven, S.H.; Schwab, F.J.; Bridwell, K.H. The SRS classification for adult spinal deformity: Building on the King/Moe and Lenke classification systems. Spine 2006, 31, s119–s125. [Google Scholar] [CrossRef]
  17. Bao, H.; Liabaud, B.; Varghese, J.; Lafage, R.; Diebo, B.G.; Jalai, C.; Ramchandran, S.; Poorman, G.; Errico, T.; Zhu, F.; et al. Lumbosacral stress and age may contribute to increased pelvic incidence: An analysis of 1625 adults. Eur. Spine J. 2018, 27, 482–488. [Google Scholar] [CrossRef] [PubMed]
  18. Place, H.M.; Hayes, A.M.; Huebner, S.B.; Hayden, A.M.; Israel, H.; Brechbuhler, J.L. Pelvic incidence: A fixed value or can you change it? Spine J. 2017, 17, 1565–1569. [Google Scholar] [CrossRef] [PubMed]
  19. Mac-Thiong, J.M.; Roussouly, P.; Berthonnaud, E.; Guigui, P. Age- and sex-related variations in sagittal sacropelvic morphology and balance in asymptomatic adults. Eur. Spine J. 2011, 20 (Suppl. S5), 572–577. [Google Scholar] [CrossRef] [Green Version]
  20. Chen, H.F.; Zhao, C.Q. Pelvic incidence variation among individuals: Functional influence versus genetic determinism. J. Orthop. Surg. Res. 2018, 13, 59. [Google Scholar] [CrossRef] [Green Version]
  21. Yamada, S.; Ebara, T.; Uehara, T.; Kimura, S.; Aoki, K.; Inada, A.; Kamijima, M. Reliability of anthropometric landmarks on body surface for estimating pelvic incidence without lateral X-ray. Occup Environ Med. 2021, 3. [Google Scholar] [CrossRef]
  22. Yamada, S.; Ebara, T.; Uehara, T.; Kimura, S.; Satsukawa, Y.; Aoki, K.; Inada, A.; Kamijima, M. Exploring the anthropometric parameters for improving reliability of estimation model of pelvic incidence. In Proceedings of the 46th International Society for the Study of the Lumbar Spine Annual Meeting, Kyoto, Japan, 3–7 June 2019; p. 461. [Google Scholar]
  23. Ramchandran, S. Pelvic Incidence (PI) is more easily understood as the pelvic base angle (PBA). Spine Res. 2017, 3. [Google Scholar] [CrossRef]
  24. Landis, J.R.; Koch, G.G. The measurement of observer agreement for categorical data. Biometrics 1977, 33, 159–174. [Google Scholar] [CrossRef] [Green Version]
  25. Kendall, F.P.; McCreary, E.K.; Provance, P.G.; Rodgers, M.; Romani, W. Muscles: Testing and Function with Posture and Pain, 5th ed.; Williams & Wilkins: Baltimore, MD, USA, 2005. [Google Scholar]
  26. Guimond, S.; Massrieh, W. Intricate correlation between body posture, personality trait and incidence of body pain: A cross-referential study report. PLoS ONE 2012, 7, e37450. [Google Scholar] [CrossRef]
  27. Yamada, S.; Ebara, T.; Uehara, T.; Inada, A.; Kamijima, M. Can postural pattern assessment be used to estimate pelvic incidence?: Reliability and validity of simple classification tools for postural pattern assessment. Jpn. J. Ergon. 2021, 57, 288–293. [Google Scholar]
  28. Day, B.L.; Steiger, M.J.; Thompson, P.D.; Marsden, C.D. Effect of vision and stance width on human body motion when standing: Implications for afferent control of lateral sway. J. Physiol. 1993, 469, 479–499. [Google Scholar] [CrossRef] [PubMed]
  29. Czaprowski, D.; Stolinski, L.; Tyrakowski, M.; Kozinoga, M.; Kotwicki, T. Non-structural misalignments of body posture in the sagittal plane. Scoliosis Spinal Disord. 2018, 13, 6. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  30. Wu, G.; Siegler, S.; Allard, P.; Kirtley, C.; Leardini, A.; Rosenbaum, D.; Whittle, M.; D’Lima, D.D.; Cristofolini, L.; Witte, H.; et al. Standardization; Terminology Committee of the International Society of, B. ISB recommendation on definitions of joint coordinate system of various joints for the reporting of human joint motion—Part I: Ankle, hip, and spine. Int. Soc. Biomech. J. Biomech 2002, 35, 543–548. [Google Scholar] [CrossRef]
  31. Savage, J.W.; Patel, A.A. Fixed sagittal plane imbalance. Global. Spine J. 2014, 4, 287–296. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  32. Schwab, F.; Lafage, V.; Boyce, R.; Skalli, W.; Farcy, J.P. Gravity line analysis in adult volunteers: Age-related correlation with spinal parameters, pelvic parameters, and foot position. Spine 2006, 31, e959–e967. [Google Scholar] [CrossRef]
  33. Segi, N.; Nakashima, H.; Ando, K.; Kobayashi, K.; Seki, T.; Ishizuka, S.; Takegami, Y.; Machino, M.; Ito, S.; Koshimizu, H.; et al. Spinopelvic imbalance is associated with increased sway in the center of gravity: Validation of the “cone of economy” concept in healthy subjects. Global. Spine J. 2021, 21925682211038897. [Google Scholar] [CrossRef] [PubMed]
  34. Kanemura, T. Sagittal spino-pelvic alignment in an asymptomatic japanese population. J. Spine Res. 2011, 2, 52–58. [Google Scholar]
  35. Endo, K.; Suzuki, H.; Nishimura, H.; Tanaka, H.; Shishido, T.; Yamamoto, K. Characteristics of sagittal spino-pelvic alignment in Japanese young adults. Asian Spine J. 2014, 8, 599–604. [Google Scholar] [CrossRef] [Green Version]
  36. Lee, C.S.; Chung, S.S.; Kang, K.C.; Park, S.J.; Shin, S.K. Normal patterns of sagittal alignment of the spine in young adults radiological analysis in a Korean population. Spine 2011, 36, e1648–e1654. [Google Scholar] [CrossRef] [PubMed]
  37. Roussouly, P.; Gollogly, S.; Berthonnaud, E.; Dimnet, J. Classification of the normal variation in the sagittal alignment of the human lumbar spine and pelvis in the standing position. Spine 2005, 30, 346–353. [Google Scholar] [CrossRef] [PubMed]
  38. Vialle, R.; Levassor, N.; Rillardon, L.; Templier, A.; Skalli, W.; Guigui, P. Radiographic analysis of the sagittal alignment and balance of the spine in asymptomatic subjects. J. Bone Joint. Surg. Am. 2005, 87, 260–267. [Google Scholar] [CrossRef]
  39. Jānis Šavlovskis, K.R. The Bony Pelvis & Gender Differences in Pelvic Anatomy. Available online: https://www.anatomystandard.com/Pelvis/Pelvis.html (accessed on 18 January 2022).
  40. Rosa, F.; Piero, Q. Fleiss’ kappa stastic wuthout paradoxes. Qual. Quant. 2014, 49, 463–470. [Google Scholar]
  41. Handa, V.L.; Lockhart, M.E.; Fielding, J.R.; Bradley, C.S.; Brubaker, L.; Cundiff, G.W.; Ye, W.; Richter, H.E. Pelvic Floor Disorders, Network, Racial differences in pelvic anatomy by magnetic resonance imaging. Obstet. Gynecol. 2008, 111, 914–920. [Google Scholar] [CrossRef] [Green Version]
  42. Branco, P.; Torgo, L.; Ribeiro, R. A survey of predictive modelling under imbalanced distributions. ACM Comput. Surv. 2017, 49, 1–50. [Google Scholar] [CrossRef]
Figure 1. Five variation types of hip-knee line (HKL) angles.
Figure 1. Five variation types of hip-knee line (HKL) angles.
Ijerph 19 01387 g001
Figure 2. AUCs and HKL angles discriminating small (<42°) or large (>51°) PIs.
Figure 2. AUCs and HKL angles discriminating small (<42°) or large (>51°) PIs.
Ijerph 19 01387 g002
Figure 3. Practical PI classification tool using the HKL angle.
Figure 3. Practical PI classification tool using the HKL angle.
Ijerph 19 01387 g003
Figure 4. Application examples of the practical PI classification tool. Left photo shows in case of HKL angle classified “S”, meaning small (<42°) PI. Similarly, the center photo shows in case of the HKL angle classified “M”, meaning medium (42–51°) PI. The right photo shows in case of the HKL angle classified “L”, meaning large (>51°) PI.
Figure 4. Application examples of the practical PI classification tool. Left photo shows in case of HKL angle classified “S”, meaning small (<42°) PI. Similarly, the center photo shows in case of the HKL angle classified “M”, meaning medium (42–51°) PI. The right photo shows in case of the HKL angle classified “L”, meaning large (>51°) PI.
Ijerph 19 01387 g004
Table 1. The results of sensitivity, specificity, and Youden index of the HKL angle C.
Table 1. The results of sensitivity, specificity, and Youden index of the HKL angle C.
HKL
Angle C
Cut-OffTotal (n = 125)Male (n = 71)Female (n = 54)
sen.spec.Y. Isen.spec.Y. Isen.spec.Y. I
S/ML13.01.000.000.001.000.000.00
14.51.000.040.041.000.050.051.000.000.00
15.50.980.320.301.000.380.380.960.100.10
16.50.970.360.331.000.570.43
17.50.970.570.541.000.710.710.940.080.08
18.50.910.790.690.980.810.790.830.710.54
19.50.810.930.740.900.950.850.720.860.58
20.50.700.960.660.760.950.710.631.000.63
21.50.501.000.490.541.000.540.441.000.44
22.50.321.000.320.321.000.320.331.000.33
23.50.161.000.160.141.000.140.171.000.17
24.50.091.000.080.081.000.080.091.000.09
25.50.021.000.020.021.000.020.021.000.02
26.50.011.000.010.001.000.00
28.00.001.000.000.001.000.00
HKLCut-offTotal (n = 125)Male (n = 71)Female (n = 54)
angle Csen.spec.Y. Isen.spec.Y. Isen.spec.Y. I
SM/L13.01.000.000.001.000.000.00
14.51.000.010.011.000.020.021.000.000.00
15.51.000.110.111.000.130.131.000.080.08
16.51.000.130.131.000.150.15
17.51.000.200.201.000.250.251.000.110.11
18.51.000.320.321.000.300.301.000.360.36
19.50.930.430.361.000.410.410.880.470.36
20.50.890.550.441.000.530.530.820.580.41
21.50.740.720.460.900.700.610.650.750.40
22.50.590.840.440.800.870.670.470.810.28
23.50.370.950.320.500.970.470.290.920.21
24.50.190.970.150.300.980.280.120.940.06
25.50.071.000.070.101.000.100.061.000.06
26.50.041.000.040.001.000.00
28.00.001.000.000.001.000.00
Note: sen., sensitivity; spec., specificity; Y. I, Youden index, S/ML, thresholds of HKL C angles discriminating between small (<42°) and more than medium (≥42°) pelvic incidence; SM/L, thresholds of HKL C angles discriminating between less than medium (<51°) and large (≥51°) pelvic incidence. Columns shaded in gray in the table mean out of criteria (unacceptable range of cut-off points); namely, sensitivity and specificity of >0.7.
Table 2. Results of usability metrics and intra-/inter-rater reliability of the PI classification tool using the HKL angle.
Table 2. Results of usability metrics and intra-/inter-rater reliability of the PI classification tool using the HKL angle.
Sub.
No.
Mean Time
(s/photo)
Correct Rate (%)Intrarater Reliability
Cohen Kappa (95% CI)
Inter-Rater
Fleiss’s Kappa (95% CI)
1st2nd1st2ndTotal
(n = 24)
Male
(n = 14)
Female
(n = 10)
1st2nd
120.013.888830.87
(0.72–1.00)
0.93
(0.77–1.00)
0.68
(0.34–1.00)
total
0.50
(0.47–0.53)


male
0.43
(0.39–0.47)


female
0.56
(0.46–0.68)
total
0.54
(0.51–0.57)


male
0.50
(0.27–0.57)


female
0.57
(0.51–0.73)
217.513.879880.80
(0.61–0.99)
0.83
(0.58–1.00)
0.69
(0.38–1.00)
313.112.983710.82
(0.67–0.97)
0.74
(0.52–0.96)
1.00
(1.00–1.00)
414.612.079830.87
(0.71–1.00)
0.78
(0.68–0.89)
0.78
(0.39–1.00)
519.617.167830.75
(0.56–0.94)
0.75
(0.50–0.99)
0.69
(0.38–1.00)
616.014.083830.78
(0.60–0.97)
0.71
(0.48–0.95)
0.85
(0.63–1.00)
713.212.683710.67
(0.45–0.90)
0.58
(0.27–0.88)
0.80
(0.44–1.00)
811.310.679880.75
(0.57–0.94)
0.71
(0.42–0.99)
0.79
(0.52–1.00)
912.511.375750.83
(0.67–1.00)
0.70
(0.41–0.99)
1.00
(1.00–1.00)
1015.013.167790.67
(0.45–0.88)
0.69
(0.43–0.95)
0.59
(0.29–0.90)
1124.618.371670.82
(0.64–0.99)
0.91
(0.75–1.00)
0.63
(0.38–0.88)
1221.710.367880.81
(0.66–0.97)
0.89
(0.74–1.00)
0.63
(0.38–0.88)
1326.319.883830.77
(0.58–0.95)
0.83
(0.61–1.00)
0.65
(0.43–0.87)
1412.810.475750.82
(0.65–0.99)
0.83
(0.62–1.00)
0.76
(0.42–1.00)
mean
(sd)
17.0
(4.7)
13.6
(2.9)
77.1
(6.9)
79.8
(6.9)
0.79
(0.61–0.96)
0.78
(0.59–0.97)
0.75
(0.50–0.97)
Note: 95% CI, 95% confidence interval; sub., subject; s, second.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Yamada, S.; Ebara, T.; Uehara, T.; Matsuki, T.; Kimura, S.; Satsukawa, Y.; Yoshihara, A.; Aoki, K.; Inada, A.; Kamijima, M. Can Hip-Knee Line Angle Distinguish the Size of Pelvic Incidence?—Development of Quick Noninvasive Assessment Tool for Pelvic Incidence Classification. Int. J. Environ. Res. Public Health 2022, 19, 1387. https://doi.org/10.3390/ijerph19031387

AMA Style

Yamada S, Ebara T, Uehara T, Matsuki T, Kimura S, Satsukawa Y, Yoshihara A, Aoki K, Inada A, Kamijima M. Can Hip-Knee Line Angle Distinguish the Size of Pelvic Incidence?—Development of Quick Noninvasive Assessment Tool for Pelvic Incidence Classification. International Journal of Environmental Research and Public Health. 2022; 19(3):1387. https://doi.org/10.3390/ijerph19031387

Chicago/Turabian Style

Yamada, Shota, Takeshi Ebara, Toru Uehara, Taro Matsuki, Shingo Kimura, Yuya Satsukawa, Akira Yoshihara, Kazuji Aoki, Atsushi Inada, and Michihiro Kamijima. 2022. "Can Hip-Knee Line Angle Distinguish the Size of Pelvic Incidence?—Development of Quick Noninvasive Assessment Tool for Pelvic Incidence Classification" International Journal of Environmental Research and Public Health 19, no. 3: 1387. https://doi.org/10.3390/ijerph19031387

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop