Next Article in Journal
Rare Source of Embolism in a Young Patient: Case Report and Literature Review
Previous Article in Journal
The Local Intraarterial Administration of Nimodipine Might Positively Affect Clinical Outcome in Patients with Aneurysmal Subarachnoid Hemorrhage and Delayed Cerebral Ischemia
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Psychometric Properties of the Pittsburgh Sleep Quality Index (PSQI) in Patients with Multiple Sclerosis: Factor Structure, Reliability, Correlates, and Discrimination

1
Laboratory for Human and Experimental Neurophysiology (LAHEN), Department of Neuroscience, School of Medicine, University of Split, 21000 Split, Croatia
2
Department of Psychology, Faculty of Humanities and Social Sciences, University of Zagreb, 10000 Zagreb, Croatia
3
Department of Neurology, University Hospital of Split, 21000 Split, Croatia
4
Department of Radiology, University Hospital of Split, 21000 Split, Croatia
5
Department of Marine Electrical Engineering and Information Technologies, Faculty of Maritime Studies, University of Split, 21000 Split, Croatia
6
Sleep Medical Center, University of Split, 21000 Split, Croatia
*
Author to whom correspondence should be addressed.
J. Clin. Med. 2022, 11(7), 2037; https://doi.org/10.3390/jcm11072037
Submission received: 11 February 2022 / Revised: 28 March 2022 / Accepted: 4 April 2022 / Published: 5 April 2022
(This article belongs to the Section Clinical Neurology)

Abstract

:
Sleep disturbances and poor sleep are a common complaint in the population with multiple sclerosis (MS) disease. The most commonly reported scale is the Pittsburgh Sleep Quality Index (PSQI), measuring seven components of sleep quality. Yet, till today, the PSQI instrument has not been validated in people with multiple sclerosis (pwMS). The objective of our study was to add precision in sleep quality assessment by investigating the psychometric properties of PSQI (factor structure, reliability, validity based on relations with other variables, cut-off scores) in pwMS. The cross-sectional study included data on a total of 87 patients with MS and 216 control subjects. Demographic information, education level, and MS-related variables were ascertained. Psychometric properties were examined by estimating the validity, including factor structure, metric invariance, and relations with other MS- and non-MS-related variables, reliability, and discrimination ability of the PSQI. The Croatian version of the PSQI had a two-factor structure which demonstrated loading and partial intercept invariance between pwMS and the control group. The global score and both subscales had high internal consistencies (McDonald’s omega and Cronbach’s alpha coefficients) in pwMS and showed expected relations with demographic and MS-related variables. PwMS differed significantly in the PSQI global score from the control groups, although receiver operating characteristics (ROC) curve analysis did not indicate a clear cut-off point. The PSQI is a reliable and valid scale and can be applied in clinical settings for assessing sleep quality in pwMS.

1. Introduction

Multiple sclerosis (MS) is a chronic autoimmune and inflammatory disease of the central nervous system with a broad and complex clinical picture affecting approximately 2–144 per 100,000 people in Japan, America, and Europe [1,2]. Clinical symptoms of MS include disturbances in motor functions, sensory deficits, visual impairments, fatigue, and cognitive and sleep disturbances. Poor sleep has been reported in people with MS (pwMS), with a prevalence of more than 50% of patients with MS having sleep disturbances [3,4]. Sleep disturbances in pwMS can be caused by the MS disease (demyelination affecting the suprachiasmatic nucleus) [5] or due to contributing factors often seen in pwMS (such as fatigue, pain, spasticity, anxiety, stress, depression) [3]. Poor sleep quality has been shown to be an independent predictor of reduced quality of life in pwMS [6]. Additionally, a substantial proportion (37–56%) of pwMS are at elevated risk of sleep disorders such as obstructive sleep apnea [7]. The screening inventory, such as the STOP-Bang questionnaire, has been validated to assess risks for obstructive sleep apnea in pwMS [7].
Sleep quality is often assessed using the Pittsburgh Sleep Quality Index (PSQI), a self-administered questionnaire used to evaluate sleep quality during the past month [8]. The validity of the PSQI has been confirmed by several studies in different patient populations and languages [9,10,11,12,13,14,15], but has not yet been in pwMS even though the PSQI is often used in MS research [16,17,18,19]. Analyses of seven components of PSQI (subjective sleep quality, sleep onset latency, sleep duration, sleep efficiency, sleep disturbance, use of hypnotic medication, daytime dysfunction) showed that increased sleep latency was the most frequent complaint in pwMS (especially in women), followed by sleep disturbance and daytime dysfunction [6,20]. The clinical course of MS may be influenced by sleep quality [16,18]. Given the importance of sleep quality in pwMS for understanding patient health and safety, the study goal was to examine the psychometric properties of the PSQI questionnaire for the first time in pwMS. Psychometric properties of PSQI were examined by estimating the validity, including the structure and relations with other variables, reliability, and discrimination ability. The factor structure was explored and compared between pwMS and people without MS. The study examined the associations of the PSQI with demographic variables and MS-related variables, such as the Multiple Sclerosis Impact Scale-29 (MSIS-29) [21,22]. The potential of PSQI to discriminate between pwMS and people without MS in terms of statistically significant differences and the receiver operating characteristics (ROC) curve and the area under the curve (AUC) was also explored, both in our sample and compared to data in previously published studies.

2. Materials and Methods

2.1. General Procedures

PwMS and control adult subjects were included in the study. The pwMS were recruited from the Department of Neurology of the University Hospital of Split (n = 70) and the Association of Multiple Sclerosis Societies of Croatia (n = 17). Inclusion criteria were as follows: (1) age 18 or older; (2) fluent in Croatian; (3) able to provide informed consent to all procedures; exclusion criteria were: (1) history of neurological disorder other than MS; (2) history of psychiatric disorder; (3) history of the developmental disorder (e.g., learning disability).
Since the study was conducted during the COVID-19 disease, the questionnaires were sent via Google survey. Eleven participants who were either older or not using technology completed the paper version of the questionnaires.

2.2. Participants

The participants recruited in the study were 87 pwMS and 216 control subjects. The data of all the control subjects were used when performing confirmatory factor analysis (CFA). When analyses were focused on the comparison, data of a control group (n = 134) composed of all women control subjects, and a random subsample of men chosen from the control subjects were used to achieve matching gender proportions with the pwMS group. The comparison of basic demographic characteristics for all three groups is shown in Table 1. The pwMS, control subjects, and the control group did not differ in any of the demographics, except for working status and comorbidities frequency. There were also differences in the type of comorbidities. The most common comorbidities for pwMS were endocrine, nutritional, and metabolic diseases (6.9%) and diseases of the respiratory system (4.6%). For control subjects, the most common comorbidities were diseases of the circulatory system (6%), endocrine, nutritional and metabolic diseases (3.7%), and musculoskeletal disorders (3.7%). The most common medications among the control subjects were antihypertensives (8.8%), pain medications (3.24%), and medicines for regulating thyroid function (2.78%).
Most MS subjects have been diagnosed with MS disease for 6 to 11 years (42.5%), 32.2% of people with MS have been diagnosed between 0 to 5 years ago, and 25.3% reported over 11 years of MS diagnosis. The mean duration of the disease for all people with MS was 9.14 years (SD = 7.290). A majority of the subjects had relapsing-remitting MS (RRMS) (79.3%), while others reported having primary progressive MS (PPMS) (9.2%) and secondary progressive MS (SPMS) (2.3%). Certain people with MS (9.2%) did not provide information on the type of MS. The median Expanded Disability Status Scale (EDSS) score for pwMS was 1, with 9% having a score of 4.5 or higher. Of 87 pwMS, 28.7% had comorbidities, including endocrine, nutritional, and metabolic diseases (6.9%) and diseases of the respiratory system (4.6%). Three pwMS were in wheelchairs. Of total pwMS, 58.62% were taking immunomodulatory or immunosuppressive drugs, most often glatiramer-acetate—Copaxone, i.e., Remurel (16.1%). The most common medications besides immune-related medications were vitamins and supplements (24.14%), thyroid hormones (9.2%), and pain medications (6.9%).
Thirty percent of pwMS and 7% of control subjects did not answer all questions. Each analysis was calculated on all the non-missing data for that analysis.

2.3. Questionnaires

Demographic data (age, sex, handedness), education level, comorbidity, and medication intake related to comorbidities were collected for all subjects. PwMS also reported MS-related information, including duration of the disease, MS types, EDSS score, and information on medication intake related to MS treatment.

2.3.1. Pittsburgh Sleep Quality Index (PSQI)

The Pittsburgh Sleep Quality Index (PSQI)[8] is the most commonly used instrument for the subjective assessment of sleep quality in clinical and non-clinical populations. The questionnaire consists of 24 items, 19 of which are self-report and 5 of which are assessed by a sleeping partner if available and are not used when calculating the scores. Most of the items are evaluated on a 4-point scale, while four items require a numeric answer. The results are calculated according to a specific scoring key as seven component scores: sleep quality, sleep latency, sleep duration, sleep efficiency, sleep disturbance, sleep medication, and daytime sleep dysfunction. Authors originally suggested calculating the global PSQI score as the sum of all seven components, although more recent research does not agree if the one-factor structure is fully supported by data [23,24]. The validity of the PSQI has been confirmed by several studies in different patient populations [9,10] and in other languages [9,11,12,13,14]. In the present study, the Croatian translation of the PSQI was used [15].

2.3.2. Multiple Sclerosis Impact Scale (MSIS-29)

The Multiple Sclerosis Impact Scale (MSIS-29)[21] is a self-report scale measuring the psychological and physical impact of the MS disease on the patient. The scale is structured as two subscales, a 20-item scale for measuring physical impact and a 9-item scale for measuring the psychological impact of the disease in the past two weeks. For each statement, the participant chooses the number that best describes his/her condition on a five-point Likert scale (from 1 = not at all to 5 = extremely). The MSIS-29 score is generated by summing the scores independently for each subscale, with higher scores indicating a more severe disease burden.

2.4. Validation Procedure

The CFA was performed to check the factor structure, which was compared to previous research [8,23,24,25,26], and to test the measurement invariance of the PSQI between pwMS and the control subjects. Reliability of the established scales was indicated by internal consistency indicators and compared with previous research [27,28]. Validity based on relations to other variables was tested by correlating PSQI and various demographic and MS variables and comparing the means of pwMS and other groups of subjects established in the present study and previously published studies on PSQI [15,19,28,29,30,31,32,33]. Discrimination between pwMS and control subjects on the basis of PSQI was further explored by examining the receiver operating characteristics (ROC) curve [34] and testing different possible cut-off scores.

2.5. Data Analysis and Statistics

The factor structure of PSQI was explored with CFA on the whole sample (pwMS and control subjects). Diagonally weighted least squares estimation with robust standard errors and a mean and variance adjusted test statistic was used. The models were estimated with multigroup analysis simultaneously for pwMS and control subjects. For the best fitting structural model, the measurement invariance of that model was tested between these two groups. The fit of all the models was judged by the significance of scaled χ2, the size of RMSEA (Root Mean Square Error of Approximation), CFI (Comparative Fit Indicator) and SRMR (Standardized Root Mean Squared Residual). The model fits were compared based on the significance of the difference in χ2.
For the scores suggested by CFA and previous literature [8], reliability was estimated by calculating two internal consistency indicators, McDonald’s omega, and Cronbach’s alpha coefficient. A global score composed of all components and two subscale scores were formed as item sums. Skewness and kurtosis indicators indicated deviations from a normal distribution, although visual inspection indicated normal-like distributions for most variables. Spearman’s rank-order coefficients (ρ) were used for correlations. t-test and ANOVA were used when comparing groups, considering their robustness to smaller deviations from normality. Levene’s test was used to assess the assumption of the equality of variances between groups. The Tukey-Kramer HSD post hoc test was calculated when using multiple comparisons.
The relations of PSQI scores with other variables were explored, partly on the whole sample and partly only for pwMS. Then, the discrimination power of PSQI was tested by comparing the scores of pwMS and people without MS and by analyzing the ROC curve. The Φ index, index of union, and Younden index [35], as well as previous research [9], were used to determine the cut-off point which could best differentiate pwMS from the control group. Finally, the relations of PSQI scores with relevant MS-related variables were explored.
In all calculations, a p-value of <0.05 was considered statistically significant. Data analyses were performed using the software IBM SPSS Statistics for Windows 25 (Version 25.0; IBM Corp: Armonk, NY, USA) [36], lavaan: An R Package for Structural Equation Modeling [37], MVN package for assessing multivariate normality [38], semTools for structural equation modeling [39], and StatPages [40].

2.6. PSQI Structure Procedure

To establish the PSQI structure, four basic models were compared simultaneously in pwMS and control subjects (Table 2). The one-factor model in which all seven components loaded on the same factor did not have an acceptable fit to the data. The two-factor model, with sleep duration and sleep efficiency as one factor and other components as second, had a significantly better fit to the data and fitted the data acceptably. In the three-factor model, one factor was composed of sleep duration and sleep efficiency, second of sleep disturbance and daytime dysfunction, and the third of subjective sleep quality, sleep onset latency, and use of hypnotic medication. Such a three-factor model fitted the data marginally better than the two-factor model (p = 0.047, Table 2). The inspection of parameters showed that the last two factors had a correlation 0.95 or higher in both groups, and the two-factor solution was therefore kept as the model best representing the data. In the bifactor model, all seven components loaded on one general factor, while sleep duration and sleep efficiency loaded on an independent specific factor, and other components on another independent specific factor. The bifactor model did not fit the data significantly better than the two-factor solution, prompting to keep the more parsimonious two-factor model as the best model. The two factors were PSQI sleep efficiency (composed of sleep duration and sleep efficiency components) and PSQI sleep quality (composed of other components).
Before testing the measurement invariance, some loadings were freed, which were kept equal in the previous analyses to ensure comparability with the one- and three-factor model. This led to a significant improvement in the fit to the data, Δχ2(2) = 6.55, p = 0.038, and therefore, this model was used when testing the invariance. Setting all the loadings to be equal across pwMS and the control subjects did not make the fit of the model significantly worse (Loading invariance 2F model in Table 2). However, setting all the intercepts to be invariant significantly worsened the model fit (Intercept invariance 2F model in Table 2). Then, the model was fitted in which all the intercepts were the same except for sleep efficiency (where the difference was largest), and this model fitted the data equally as well as the model with loading invariance (partial intercept invariance 2F in Table 2).

3. Results

3.1. PSQI Structure

The final two-factor structure of the PSQI is demonstrated in Figure 1. All the loadings, invariant across pwMS and control subjects, were significant and mostly high, and the correlation between factors was moderate in both groups. Based on this factor structure analysis, two subscores, PSQI sleep efficiency and PSQI sleep quality, were formed. Although the analysis strongly supported the expression of PSQI results as two subscores, the global score was calculated as is suggested in the first version of the instrument [8] and as is commonly used in research to ensure continuity and comparability.

3.2. PSQI Reliability

Table 3 presents McDonald’s omega as an indicator of PSQI sleep quality and efficiency subscores reliability (Table 3) [41]. The Cronbach’s alpha indicators are reported to enable comparison with other research (Table 3).

3.3. PSQI Relations with Other Variables

Women scored higher on the global PSQI and PSQI sleep quality but not on PSQI sleep efficiency (Table 4). Older people had higher results on all PSQI scores (Table 5). Table 5 also presents correlations of PSQI scores with MS-related variables: MSIS-29, EDSS, and duration of MS disease.

3.4. PSQI Discrimination

A t-test indicated pwMS have statistically higher PSQI scores than the control group (Table 6). One-way ANOVA indicated there is a significant difference in the mean scores on the global PSQI of pwMS and control group in the present study compared with means found in previous research (F(12, 2233) = 28.784, p < 0.001) [31,32,33]. Post hoc tests (Table 7) indicated that PSQI levels of the pwMS in the present study are similar to PSQI levels of pwMS in previously reported studies and are significantly different from the PSQI levels of almost all control groups in the present and previously reported studies [31,32,33]. The second ANOVA confirmed significant differences in mean PSQI scores between pwMS and the control group in the present study in comparison to mean PSQI scores of people suffering from sleep-related pathologies and people without pathologies reported in previous studies (F(5, 545) = 57.403, p < 0.001) [15,29]. Post hoc tests indicated that pwMS (M = 7.36, SD = 4.678) have lower PSQI scores compared to people with primary insomnia (M = 12.50, SD = 3.800) [29], do not differ from people with obstructive sleep apnea (M = 8.62, SD = 3.990) [15], and have higher scores than control groups in this and previous research (M = 3.3–5.6, SD = 1.8–3.1) [15,29].
Table 6. Differences in PSQI scores between pwMS (ms, n = 82–87) and the control group (con, n = 133–134).
Table 6. Differences in PSQI scores between pwMS (ms, n = 82–87) and the control group (con, n = 133–134).
VariableMms (SDms)Mcon (SDcon)Levene’s Test F
(p)
t
(p)
PSQI global score7.36
(4.678)
5.60
(3.100)
29.74
(0.000)
3.08
(0.002)
PSQI sleep quality5.65
(3.263)
4.16
(2.096)
21.68
(0.000)
3.72
(0.000)
PSQI sleep efficiency1.96
(2.003)
1.45
(1.500)
14.56
(0.000)
2.01
(0.046)
Table 7. Significance (p) of Tukey–Kramer HSD post hoc tests of differences between groups of patients with multiple sclerosis (pwMS) and control groups (Con) in the present and previous research and their means and standard deviations.
Table 7. Significance (p) of Tukey–Kramer HSD post hoc tests of differences between groups of patients with multiple sclerosis (pwMS) and control groups (Con) in the present and previous research and their means and standard deviations.
Present Research Lobentanz et al. [31]Ma et al. [32]Pinar et al. [33]
pwMSConpwMSConpwMSCon
n3889912312655050
nM7.00
(3.900)
4.55
(3.710)
8.90
(5.200)
5.80
(4.800)
7.90
(3.500)
6.02
(3.220)
(SD)
M (SD)
pwMS877.36 (4.678)0.9960.000 **0.0520.041 *0.9950.583
Con1345.60 (3.100)0.014 *0.0900.000 **1.0000.015 *0.999
Note. * p < 0.05. ** p < 0.01.
ROC analysis indicated that the global PSQI had AUC = 0.627, 95%CI [0.544, 0.710], p = 0.002 and PSQI sleep quality had AUC = 0.638, 95%CI [0.556, 0.719], p = 0.001, both of which were significant but indicate low accuracy in discrimination of these groups since they are close to 0.5 [34]. For PSQI sleep efficiency there was no significant discrimination, as indicated by AUC = 0.565, 95%CI [0.482, 0.648], p = 0.114. Index of union and Φ index suggested that the best cut-off point for discriminating between pwMS and the control group is score 6 and above on the global PSQI, and score 5 and above for PSQI sleep quality, while the Youden index suggests it is score 10 and above on the global PSQI, and score 7 and above for PSQI sleep quality. In Table 8, the proportions for participants categorized in groups of different PSQI levels according to these cut-off values are shown, as well as when using the cut-off of ≥5 suggested by Curcio et al. [9].

3.5. MS and PSQI

There were no significant differences in the global PSQI score nor in PSQI sleep quality between RRMS and people with other types of MS (all forming the same group due to a small number of people with other MS types (Table 9). However, people with RRMS had better PSQI sleep efficiency than other MS types (Table 9). Older people with MS had higher PSQI scores on all three PSQI variables than younger pwMS (ρ = 0.428 to 0.486, p < 0.001), similar to the whole sample analysis presented in Table 4. Unlike in the entire sample (Table 4), there were no gender differences (Table 9). There were no significant differences in any of the PSQI scores between pwMS married or cohabitating and pwMS single, separated, divorced, or widowed (Table 9). There were no differences between pwMS in sleep quality regarding the working status, but the groups differed significantly in the global PSQI score and the PSQI sleep efficiency (Table 9). Active (employed or student) and temporarily inactive (unemployed or temporarily on sick leave) pwMS had lower PSQI scores than permanently inactive pwMS (Table 9).

4. Discussion

The present study reported that the Croatian version of the PSQI had a two-factor structure which demonstrated loading and partial intercept invariance between pwMS and control subjects. We compared the fit of one-, two-, and three-factor models for PSQI proposed in previously reported studies [8,23,24,25,26]. In their systematic review, Manzar et al. [24] suggested multiple ways the two factors can be formed. In all of the two-factor solutions, the PSQI sleep duration and sleep efficiency were the common factor, while other components did not show such consistency. Based on this, we tested a two-factor solution, in which one factor was composed of sleep duration and efficiency and the other from the rest of the components, and this solution fitted the data better than the model with all components loading on the same factor (Table 2). In the systematic review of Manzar et al. [24], besides sleep duration and efficiency loading on the same factor, a common occurrence in the three-factor solutions was sleep disturbance and daytime dysfunction always being on the same factor, and therefore, we specified the second of the three factors as the combination of these two components. The third factor was composed of subjective sleep quality, sleep onset latency, and use of hypnotic medication, which was also supported by the frequency of such a factor in the overview of models by Manzar et al. [26]. The inconsistencies in factor solutions encountered in previous research [24,26] were also reflected in our results: the three-factor solution had a marginally better fit (Table 2), but the high correlation between second and third factors indicated the two-factor solution is better. The two-factor model is in agreement with the results of the systematic review that demonstrated that a two-factor solution was the most often obtained structure of PSQI [24].
The inconsistency in the structure in previous research might also indicate that PSQI has a bifactor structure, i.e., that all items load on the one general factor, but that they also load on specific group factors [42]. Bifactor structure would explain why in previously reported studies, some of the components loaded on a common factor and sometimes on specific factors. Because of this, the two-factor model was compared to a bifactor model with one general and two specific factors. However, the bifactor model did not prove to have a significantly better fit to data (Table 2), indicating there might not be one general factor explaining all the PSQI components. It might be more prudent to express PSQI as scores on two separate subscales, PSQI sleep efficiency and PSQI sleep quality, which have a medium to high correlation (Figure 1).
Based on measurement invariance testing, it was concluded that PSQI sleep quality measures the same construct in pwMS and control subjects and that both correlational and mean-level analyses comparing these two groups are justified. For PSQI sleep efficiency, only loading invariance was achieved, justifying correlation analysis, but intercepts were invariant for only one of two components, questioning whether mean-level comparison informs us on the difference in the construct or on the difference in the way the construct is related to its indicators.
To assess the reliability of the PSQI scores, two internal consistency indicators were calculated (Table 3). Although Cronbach alpha coefficient is one of the more used indicators of internal consistency, its estimation of reliability can be biased when the scale does not have a one-factor structure (i.e., when the items are not congeneric) and when the loadings on the common factor are not of the same size (i.e., when the items are not tau-equivalent) [41]. This is why it is not applicable for the PSQI global score given its two-factor structure, nor for the PSQI sleep quality given the differences between loadings (Figure 1). In such a case, McDonald’s omega can be considered a better indicator of internal consistency, although Cronbach’s alpha coefficient was also presented to ease comparison with previous research. In pwMS, the scores had levels of internal consistency similar to that in previous research [23], indicating high reliability. For control subjects, the consistency was somewhat lower than in the study of Cole et al. [23], although similar to Jia et al. [27] and Kmetec et al. [28], which might be a result of the smaller variance in the control subjects (Table 6).
The established gender and age differences in PSQI scores [27,28] were replicated in our sample (Table 4), indicating comparability of PSQI scores with previous research. Next, PSQI scores were expected to be higher (i.e., sleep quality lower) for people with the stronger psychological and physical impact of the MS disease on the patient [32]. This hypothesis was confirmed with the strong correlations of MSIS-29 subscales and PSQI scores (Table 5). As for EDSS, the predictions were not so precise: Lobentanz et al. [31] found higher EDSS is related to higher PSQI scores, Pinar et al.33 found no correlation and in Zhang et al. [19] the results were inconclusive. In the present research, the global PSQI and PSQI sleep efficiency had a significant correlation with EDSS, similar to Lobentanz et al. [31]. The correlation size was similar to Zhang et al. [19] (r = 0.248 vs. Cramer’s V = 0.205, χ2(6) = 11.926, p = 0.064, calculated based on the contingency tables presented by Zhang et al. [19]). PSQI sleep quality had an insignificant correlation, similar to Pinar et al. [33]. Regarding the MS diagnosis duration, most of the research did not establish the correlation with PSQI scores [19,31,33], which was also the case in the present study. However, the data presented in Zhang et al. [19] indicated that the relationship between MS diagnosis duration and sleep quality might not be linear, so we believe the research of this relation deserves further attention. The fact that two subscores, PSQI sleep quality and PSQI sleep efficiency, show different relations with other variables further supports the idea that PSQI should be used as two separate scores (Table 4 and Table 5).
Analyses of differences between pwMS and other groups indicated that pwMS on average showed lower sleep quality than control subjects, consistently in our and other research [15,29,31,32,33]. The sleep quality of pwMS is similar to that of people with obstructive sleep apnea and better than of people with primary insomnia [15,29]. However, different cut-off scores resulted in either a lot of pwMS being classified as not having low sleep quality or a large number of control subjects classified as having low sleep quality (Table 8). This is due to high variability in sleep quality in pwMS, with a similar number of subjects having low, moderate, or high PSQI scores. It might be that sleep quality is a problem for only certain subgroups of pwMS, e.g., only those with certain MS types or symptoms or with an inactive working status. These hypotheses need to be explored further on a larger sample to establish a clear cut-off point. Until then, we suggest using the generally accepted cut-off score 5 suggested by Curcio et al. [9].
To summarize, sleep disturbances and poor sleep are common complaints in the MS disease population. Yet, till today, the PSQI instrument has not been validated in pwMS. Our study demonstrated that the PSQI is a reliable and valid scale and can be applied in clinical settings for assessing sleep quality in pwMS. Sleep quality can influence the outcome of pwMS [16], and therefore, a reliable and validated tool is very useful for the quick screening of sleeping quality, as well as for evaluating the impact of medications on sleep profile in pwMS [18].
Our study has some limitations that need to be highlighted. The study limitation refers to the sample size with a larger number of men recruited in the control group. Further, the number of pwMS with different MS phenotypes (for progressive ones) was smaller in the present study, and therefore, exploring the influence of MS type on sleep quality and defining a clear cut-off point was not possible to investigate.

5. Conclusions

This is the first study that investigated psychometric characteristics of the PSQI, including factor structure, reliability, correlates, and discrimination in patients with multiple sclerosis. It also adds to the knowledge about PSQI in general by testing the models presented in previous reviews [24,26], including a new model of the bifactor structure, as well as exploring the measurement invariance between control subjects and pwMS. It would be recommended for future studies investigating sleep quality in pwMS to manage demographic, socioeconomic status, habits (i.e., smoking), physical activity, fatigue, anxiety, depression, quality of life, as well as cognitive aspects [43,44,45,46,47,48,49,50,51,52,53,54,55,56].

Author Contributions

Conceptualization, A.J. and M.R.V.; methodology, A.J., U.M. and M.R.V.; validation, U.M.; formal analysis, U.M. and A.J.; investigation, M.R.V., A.J. and M.M.; resources, I.V., S.P., J.Š. and M.R.V.; data curation, M.R.V. and A.J.; writing—original draft preparation, M.R.V., U.M. and A.J.; writing—review and editing, M.M., V.K., A.Ć.K., K.D., I.V., J.Š., Z.Đ. and S.P.; visualization, U.M.; supervision, Z.Đ. and M.R.V.; project administration, M.R.V., M.M., V.K., A.Ć.K., K.D., I.V., J.Š. and S.P. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

All procedures performed in studies involving human participants were in accordance with the ethical standards of The Ethics Committee of the University of Split, School of Medicine (Class: 003-08/21-03/0003; No.: 2181-198-03-04-21-0039, approved on 10 March 2020 and 23 April 2021 -annex) and the Ethical Committee of the University Hospital of Split (Class: 500-03/20-01/06, No.: 2181-147-01/06/M.S.-20-2, approved on 27 January 2020), and in accordance with the 1964 Helsinki Declaration and its later amendments or comparable ethical standards. All patients signed the informed consent.

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The data presented in this study are available on request from the corresponding author. The data are not publicly available due to privacy restrictions.

Acknowledgments

The authors thank the patients who participated in this study and the support staff (Zravka Dominović) who helped recruit the patients.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Howard, J.; Trevick, S.; Younger, D.S. Epidemiology of multiple sclerosis. Neurol. Clin. 2016, 34, 919–939. [Google Scholar] [CrossRef] [PubMed]
  2. Glaser, A.; Stahmann, A.; Meissner, T.; Flachenecker, P.; Horáková, D.; Zaratin, P.; Brichetto, G.; Pugliatti, M.; Rienhoff, O.; Vukusic, S.; et al. Multiple sclerosis registries in Europe—An updated mapping survey. Mult. Scler. Relat. Disord. 2019, 27, 171–178. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  3. Kotterba, S.; Neusser, T.; Norenberg, C.; Bussfeld, P.; Glaser, T.; Dörner, M.; Schürks, M. Sleep quality, daytime sleepiness, fatigue, and quality of life in patients with multiple sclerosis treated with interferon beta-1b: Results from a prospective observational cohort study. BMC Neurol. 2018, 18, 123. [Google Scholar] [CrossRef]
  4. Vitkova, M.; Gdovinova, Z.; Rosenberger, J.; Szilasiova, J.; Nagyová, I.; Mikula, P.; Krokavcova, M.; Groothoff, J.W.; van Dijk, J.P. Factors associated with poor sleep quality in patients with multiple sclerosis differ by disease duration. Disabil. Health J. 2014, 7, 466–471. [Google Scholar] [CrossRef] [PubMed]
  5. Taphoorn, M.; Van Someren, E.; Snoek, F.; Strijers, R.L.M.; Swaab, D.; Visscher, F.; De Waal, L.P.; Polman, C.H. Fatigue, sleep disturbances and circadian rhythm in multiple sclerosis. J. Neurol. 1993, 240, 446–448. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  6. Merlino, G.; Fratticci, L.; Lenchig, C.; Valente, M.; Cargnelutti, D.; Picello, M.; Serafini, A.; Dolso, P.; Gigli, G. Prevalence of ‘poor sleep’ among patients with multiple sclerosis: An independent predictor of mental and physical status. Sleep Med. 2009, 10, 26–34. [Google Scholar] [CrossRef] [PubMed]
  7. Singh, M.; Gavidia, R.; Dunietz, G.L.; Washnock-Schmid, E.; Romeo, A.R.; Hershner, S.; Chervin, R.D.; Braley, T.J. Validation of an obstructive sleep apnea symptom inventory in persons with multiple sclerosis. Mult. Scler. 2021, 28, 280–288. [Google Scholar] [CrossRef]
  8. Buysse, D.J.; Reynolds, C.F., III; Monk, T.H.; Berman, S.R.; Kupfer, D.J. The Pittsburgh sleep quality index: A new instrument for psychiatric practice and research. Psychiatry Res. 1989, 28, 193e213. [Google Scholar] [CrossRef]
  9. Curcio, G.; Tempesta, D.; Scarlata, S.; Marzano, C.; Moroni, F.; Rossini, P.M.; Ferrara, M.; De Gennaro, L. Validity of the Italian version of the Pittsburgh Sleep Quality Index (PSQI). Neurol. Sci. 2013, 34, 511–519. [Google Scholar] [CrossRef]
  10. Mollayeva, T.; Thurairajah, P.; Kirsteen Burton, K.; Mollayeva, S.; Shapiro, C.M.; Colantonio, A. The Pittsburgh sleep quality index as a screening tool for sleep dysfunction in clinical and non-clinical samples: A systematic review and meta-analysis. Sleep Med. Rev. 2016, 25, 52–73. [Google Scholar] [CrossRef]
  11. Tsai, P.S.; Wang, S.Y.; Wang, M.Y.; Su, C.-T.; Yang, T.-T.; Huang, C.-J.; Fang, S.-C. Psychometric evaluation of the Chinese version of the Pittsburgh Sleep Quality Index (CPSQI) in primary insomnia and control subjects. Qual. Life Res. 2005, 14, 1943–1952. [Google Scholar] [CrossRef]
  12. Bertolazi, A.N.; Fagondes, S.C.; Hoff, L.S.; Dartora, E.G.; Miozzo, I.C.D.S.; de Barba, M.E.F.; Barreto, S.S.M. Validation of the Brazilian Portuguese version of the Pittsburgh Sleep Quality Index. Sleep Med. 2011, 12, 70–75. [Google Scholar] [CrossRef] [Green Version]
  13. Farrahi Moghaddam, J.; Nakhaee, N.; Sheibani, V.; Garrusi, B.; Amirkafi, A. Reliability and validity of the Persian version of the Pittsburgh Sleep Quality Index (PSQI-P). Sleep Breath. 2012, 16, 79–82. [Google Scholar] [CrossRef]
  14. Sohn, S.I.; Kim, D.H.; Lee, M.Y.; Cho, Y.W. The reliability and validity of the Korean version of the Pittsburgh Sleep Quality Index. Sleep Breath. 2012, 16, 803–812. [Google Scholar] [CrossRef]
  15. Kalcina Lusic, L.; Valic, M.; Pecotic, R.; Pavlinac Dodig, I.; Dogas, Z. Good and poor sleepers among OSA patients: Sleep quality and overnight polysomnography findings. Neurol. Sci. 2017, 38, 1299–1306. [Google Scholar] [CrossRef]
  16. Buratti, L.; Iacobucci, D.E.; Viticchi, G.; Falsetti, L.; Lattanzi, S.; Pulcini, A.; Silvestrini, M. Sleep quality can influence the outcome of patients with multiple sclerosis. Sleep Med. 2019, 58, 56–60. [Google Scholar] [CrossRef]
  17. Motolese, F.; Rossi, M.; Albergo, G.; Stelitano, D.; Villanova, M.; Di Lazzaro, V.; Capone, F. The psychological impact of COVID-19 pandemic on people with multiple sclerosis. Front. Neurol. 2020, 11, 580507. [Google Scholar] [CrossRef]
  18. Rocchi, C.; Pulcini, A.; Vesprini, C.; Totaro, V.; Viticchi, G.; Falsetti, L.; Danni, M.C.; Bartolini, M.; Silvestrini, M.; Buratti, L. Sleep in multiple sclerosis patients treated with interferon beta: An actigraphic study. Neurol. Res. 2020, 42, 744–748. [Google Scholar] [CrossRef]
  19. Zhang, G.X.; Zhang, W.T.; Gao, S.S.; Zhao, R.Z.; Yu, W.J.; Izquierdo, G. Sleep disorders in patients with multiple sclerosis in Spain. Neurologia 2021, S0213-4853(21)00080-3. [Google Scholar] [CrossRef]
  20. Bøe Lunde, H.M.; Aae, T.F.; Indrevåg, W.; Aarseth, J.; Bjorvatn, B.; Myhr, K.-M.; Bø, L. Poor sleep in patients with multiple sclerosis. PLoS ONE 2012, 7, e49996. [Google Scholar] [CrossRef] [Green Version]
  21. Hobart, J.; Lamping, D.; Fitzpatrick, R.; Riazi, A.; Thompson, A. The Multiple Sclerosis Impact Scale (MSIS-29); a new patient-based outcome measure. Brain 2001, 124, 962–973. [Google Scholar] [CrossRef]
  22. Rogić Vidaković, M.; Šimić, N.; Poljičanin, A.; Ivanišević, M.N.; Ana, J.; Đogaš, Z. Psychometric properties of the Croatian version of the depression, anxiety, and stress scale-21 and multiple sclerosis impact scale-29 in multiple sclerosis patients. Mult. Scler. Relat. Disord. 2021, 50, 102850. [Google Scholar] [CrossRef]
  23. Cole, J.C.; Motivala, S.J.; Buysse, D.J.; Oxman, M.N.; Levin, M.J.; Irwin, M. Validation of a 3-factor scoring model for the Pittsburgh sleep quality index in older adults. Sleep 2006, 29, 112–116. [Google Scholar] [CrossRef] [Green Version]
  24. Manzar, M.D.; BaHammam, A.S.; Hameed, U.A. Dimensionality of the Pittsburgh sleep quality index: A systematic review. Health Qual. Life Outcomes 2018, 16, 89. [Google Scholar] [CrossRef]
  25. Benhayon, D.; Youk, A.; McCarthy, F.N.; Davis, S.; Keljo, D.J.; Bousvaros, A.; Fairclough, D.; Kupfer, D.; Buysse, D.J.; Szigethy, E.M. Characterization of relationships between sleep, inflammation, and psychiatric dysfunction in depressed youth with Crohn’s disease. J. Pediatr. Gastroenterol. Nutr. 2013, 57, 335–343. [Google Scholar] [CrossRef] [Green Version]
  26. Manzar, M.D.; Zannat, W.; Hussain, M.E.; Pandi-Perumal, S.R.; Bahammam, A.S.; Barakat, D.; Ojike, N.I.; Olaish, A.; Spence, D.W. Dimensionality of the Pittsburgh sleep quality index in the young collegiate adults. Springerplus 2016, 5, 1550. [Google Scholar] [CrossRef] [Green Version]
  27. Jia, Y.; Chen, S.; Deutz, N.; Bukkapatnam, S.T.S.; Woltering, S. Examining the structure validity of the Pittsburgh sleep quality index. Sleep Biol. Rhythms. 2019, 17, 209–221. [Google Scholar] [CrossRef]
  28. Kmetec, S.; Fekonja, Z.; Davey, A.; Mlinar Reljić, N.; Lorber, M. Development of a slovenian version of the pittsburgh sleep quality index (PSQI-SLO) for use with older adults. Int. J. Older People Nurs. 2021, 17, e12411. [Google Scholar] [CrossRef]
  29. Backhaus, J.; Junghanns, K.; Broocks, A.; Riemann, D.; Hohagen, F. Test-retest reliability and validity of the Pittsburgh sleep quality index in primary insomnia. J. Psychosom. Res. 2002, 53, 737–740. [Google Scholar] [CrossRef]
  30. Longfeng, L.; Sheehan, C.M.; Thompson, M.S. Measurement invariance and sleep quality differences between men and women in the Pittsburgh sleep quality index. J. Clin. Sleep Med. 2019, 5, 1769–1776. [Google Scholar] [CrossRef]
  31. Lobentanz, I.S.; Asenbaum, S.; Vass, K.; Sauter, C.; Klosch, G.; Kollegger, H.; Kristoferitsch, W.; Zeitlhofer, J. Factors influencing quality of life in multiple sclerosis patients: Disability, depressive mood, fatigue and sleep quality. Acta Neurol. Scand. 2004, 110, 6–13. [Google Scholar] [CrossRef] [PubMed]
  32. Ma, S.; Rui, X.; Qi, P.; Liu, G.; Yang, J. Sleep disorders in patients with multiple sclerosis in China. Sleep Breath. 2017, 21, 149–154. [Google Scholar] [CrossRef] [PubMed]
  33. Pinar, Ö.; Gönül, V.; Mehmet, Ö.; Şadiye, G. The relationship between quality of life and disability in multiple sclerosis patients and pain, sleep quality, mood and fatigue. Biomed. J. Sci. Tech. Res. 2018, 2, 2559–2565. [Google Scholar] [CrossRef] [Green Version]
  34. Streiner, D.L.; Cairney, J. What’s under the ROC? An introduction to receiver operating characteristics curves. Can. J. Psychiatry 2007, 52, 121–128. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  35. Unal, I. Defining an optimal cut-point value in ROC analysis: An alternative approach. Comput. Math. Methods Med. 2017, 2017, 3762651. [Google Scholar] [CrossRef] [PubMed]
  36. IBM Corp. IBM SPSS Statistics for Windows; Version 25.0; IBM Corp: Armonk, NY, USA, 2017. [Google Scholar]
  37. Rosseel, Y. lavaan: An R Package for Structural Equation Modeling. J. Stat. Softw. 2012, 48, 1–36. [Google Scholar] [CrossRef] [Green Version]
  38. Korkmaz, S.; Goksuluk, D.; Zararsiz, G. MVN: An R package for assessing multivariate normality. R J. 2014, 6, 151–162. [Google Scholar] [CrossRef] [Green Version]
  39. Jorgensen, T.D.; Pornprasertmanit, S.; Schoemann, A.M.; Rosseel, Y. semTools: Useful Tools for Structural Equation Modeling. R Package Version 0.5-3. Available online: https://CRAN.R-project.org/package=semTools (accessed on 6 November 2021).
  40. Pezzullo, J.C. Analysis of Variance from Summary Data. Available online: http://statpages.info/anova1sm.html (accessed on 6 November 2021).
  41. Dunn, T.J.; Baguley, T.; Brunsde, V. From alpha to omega: A practical solution to the pervasive problem of internal consistency estimation. Br. J. Psychol. 2014, 105, 399–412. [Google Scholar] [CrossRef] [Green Version]
  42. Reise, S.P.; Bonifay, W.E.; Haviland, M.G. Scoring and modeling psychological measures in the presence of multidimensionality. J. Pers. Assess. 2013, 95, 129–140. [Google Scholar] [CrossRef]
  43. Cederberg, K.J.; Jeng, B.; Sasaki, J.E.; Sikes, E.M.; Silveira, S.L.; Cutter, G.; Motl, R.W. Demographic, clinical, and symptomatic correlates of subjective sleep quality in adults with multiple sclerosis. Mult. Scler. Relat. Disord. 2021, 55, 103204. [Google Scholar] [CrossRef]
  44. Krupp, L.B.; LaRocca, N.G.; Muir-Nash, J.; Steinberg, A.D. The fatigue severity scale. Application to patients with multiple sclerosis and systemic lupus erythematosus. Arch. Neurol. 1989, 46, 1121–1123. [Google Scholar] [CrossRef]
  45. Gavrilov, Y.V.; Shkilnyuk, G.G.; Valko, P.O.; Stolyarov, I.D.; Ivashkova, E.V.; Ilves, A.G.; Nikiforova, I.G.; Shchelkova, O.Y.; Vasserman, L.I.; Vais, E.E.; et al. Validation of the Russian version of the fatigue impact scale and fatigue severity scale in multiple sclerosis patients. Acta Neurol. Scand. 2018, 138, 408–416. [Google Scholar] [CrossRef]
  46. Armutlu, K.; Korkmaz, N.C.; Keser, I.; Sumbuloglu, V.; Akbiyik, D.I.; Guney, Z.; Karabudak, R. The validity and reliability of the fatigue severity scale in Turkish multiple sclerosis patients. Int. J. Rehabil. Res. 2007, 30, 81–85. [Google Scholar] [CrossRef] [Green Version]
  47. Rosti-Otajärvi, E.; Hämäläinen, P.; Wiksten, A.; Hakkarainen, T.; Ruutiainen, J. Validity and reliability of the fatigue severity scale in Finnish multiple sclerosis patients. Brain Behav. 2017, 7, e00743. [Google Scholar] [CrossRef]
  48. Valko, P.O.; Bassetti, C.L.; Bloch, K.E.; Held, U.; Baumann, C.R. Validation of the fatigue severity scale in a Swiss cohort. Sleep 2008, 31, 1601–1607. [Google Scholar] [CrossRef]
  49. Jerković, A.; Proroković, A.; Matijaca, M.; Katić, A.; Košta, V.; Mihalj, M.; Dolić, K.; Đogaš, Z.; Vidaković, M.R. Validation of the fatigue severity scale in Croatian population of patients with multiple sclerosis disease: Factor structure, internal consistency, and correlates. Mult. Scler. Relat. Disord. 2021, 58, 103397. [Google Scholar] [CrossRef]
  50. Karimi, S.; Andayeshgar, B.; Khatony, A. Prevalence of Anxiety, depression, and stress in patients with multiple sclerosis in Kermanshah-Iran: A cross-sectional study. BMC Psychiatry 2020, 20, 166. [Google Scholar] [CrossRef] [Green Version]
  51. Jerković, A.; Proroković, A.; Matijaca, M.; Vuko, J.; Poljičanin, A.; Mastelić, A.; Katić, A.; Košta, V.; Kustura, L.; Dolić, K.; et al. Psychometric Properties of the HADS measure of anxiety and depression among multiple sclerosis patients in Croatia. Front. Psychol. 2021, 12, 794353. [Google Scholar] [CrossRef]
  52. Benedict, R.H.; DeLuca, J.; Phillips, G.; LaRocca, N.; Hudson, L.D.; Rudick, R. Multiple sclerosis outcome assessments consortium. Validity of the symbol digit modalities test as a cognition performance outcome measure for multiple sclerosis. Mult. Scler. 2017, 23, 721–733. [Google Scholar] [CrossRef]
  53. Jerković, A.; Matijaca, M.; Ana Proroković, A.; Šikić, A.; Košta, V.; Katić, A.; Dolić, K.; Glavor, K.D.; Šoda, J.; Đogaš, Z.; et al. Information processing speed assessed with letter digit substitution test in Croatian sample of multiple sclerosis patients. Diagnostics 2022, 12, 111. [Google Scholar] [CrossRef]
  54. Hämäläinen, P.; Vera Leo, V.; Sebastian Therman, S.; Juhani Ruutiainen, J. Validation of the Finnish version of the Brief International Cognitive Assessment for Multiple Sclerosis (BICAMS) and evaluation of the applicability of the Multiple Sclerosis Neuropsychological Questionnaire (MSNQ) and the Fatigue Scale for Motor and Cognitive Functions (FSMC). Brain Behav. 2021, 11, e02087. [Google Scholar] [CrossRef]
  55. Kahraman, T.; Ozdogar, A.T.; Abasiyanik, Z.; Ozakbas, S. Multiple sclerosis research group. Associations between smoking and walking, fatigue, depression, and health-related quality of life in persons with multiple sclerosis. Acta Neurol. Belg. 2021, 121, 1199–1206. [Google Scholar] [CrossRef]
  56. Ozdogar, A.T.; Turhan Kahraman, T.; Ozakbas, S.; Achiron, A.; Kalron, A. Fatigue is associated with physical inactivity in people with multiple sclerosis despite different environmental backgrounds: Merging and comparing cohorts from Turkey and Israel. Mult. Scler. Relat. Disord. 2021, 57, 103456. [Google Scholar] [CrossRef]
Figure 1. The two-factor model of PSQI scores for control subjects and pwMS. Note. Standardized parameters are presented for control subjects/pwMS. All reported parameters are significant at p < 0.05. PSQI components: PSQ3dur = sleep duration, PSQ4eff = sleep efficiency, PSQ1qua = sleep quality, PSQ2lat = sleep latency, PSQ5dis = sleep disturbance, PSQ6med = sleep medication, PSQ7day = daytime sleep dysfunction.
Figure 1. The two-factor model of PSQI scores for control subjects and pwMS. Note. Standardized parameters are presented for control subjects/pwMS. All reported parameters are significant at p < 0.05. PSQI components: PSQ3dur = sleep duration, PSQ4eff = sleep efficiency, PSQ1qua = sleep quality, PSQ2lat = sleep latency, PSQ5dis = sleep disturbance, PSQ6med = sleep medication, PSQ7day = daytime sleep dysfunction.
Jcm 11 02037 g001
Table 1. Comparison of percent of participants with certain demographic characteristics in pwMS (n = 87), all control subjects (n = 216) and a subsampled control group (n = 134).
Table 1. Comparison of percent of participants with certain demographic characteristics in pwMS (n = 87), all control subjects (n = 216) and a subsampled control group (n = 134).
VariableCategorypwMSAll Control SubjectsControl GrouppwMS—Control Group Comparison
GenderWomen81.650.581.3χ2(1) = 0.002
p = 0.960
Men18.449.518.7
Right hand dominanceYes93.190.793.3χ2(1) = 0.004
p = 0.951
No5.78.86
EducationPrimary school3.42.83χ2(3) = 5.453
p = 0.141
High school65.560.251.5
Undergraduate study9.210.211.2
Graduate study20.726.934.3
Marriage statusSingle21.822.220.9χ2(3) = 3.282
p = 0.350
Marriage/cohabitation63.268.171.6
Divorced/separated10.37.54.5
Widow(er)3.42.33
Working statusStudent6.966.7χ2(7) = 52.819
p < 0.001
Employee32.276.976.1
Unemployed18.47.99.7
Temporary sick leave6.90.50.7
Permanent incapacity for work5.700
A person who runs the household3.400
Disability pension238.36.7
Other2.30.50
ComorbidityNo64.480.178.4χ2(1) = 4.663
p = 0.031
Yes28.715.317.2
AgeM (SD)42.57 (12.2)43.8 (12.632)43.78 (12.749)t(219) = 0.700
p = 0.484
Range19–7318–8122–73
Note. Comparisons between pwMS and all control subjects are not presented—they were of the same significance as between pwMS and the control group, except for gender, which had significantly different proportions due to the expected ratio of male to female MS patients in the general population.
Table 2. The fit of the different PSQI structure models and their differences.
Table 2. The fit of the different PSQI structure models and their differences.
Modelχ2
(p)
dfCFIRMSEA
(0% CI)
SRMRΔχ2
(p)
Δdf
One-factor75.83
(0.000)
320.8620.097
[0.069, 0.126]
0.073
Two-factor (2F)46.03
(0.031)
300.9490.061
[0.019, 0.094]
0.05220.06
(<0.001)
2
Three-factor34.45
(0.124)
260.9730.047
[0.000, 0.086]
0.0459.64
(0.047)
4
Bifactor13.28
(0.774)
181.0000.000
[0.000, 0.051]
0.02220.33
(0.061)
12
2F with free loadings29.16
(0.404)
280.9960.017
[0.000, 0.067]
0.0366.55
(0.038)
2
Loadings invariance 2F40.62
(0.141)
320.9730.043
[0.000, 0.079]
0.0527.21
(0.125)
4
Partial intercept invariance 2F44.33
(0.160)
360.9740.040
[0.000, 0.075]
0.0543.75
(0.441)
4
Intercept invariance 2F58.44
(0.014)
370.9320.063
[0.029, 0.093]
0.06118.61
(<0.001)
1
Note. All the models were compared to the model above them, except bifactor and 2F with free loadings, which were compared to the two-factor model. CFI = Comparative Fit Indicator, RMSEA = Root Mean Square Error of Approximation, SRMR = Standardized Root Mean Squared Residual.
Table 3. Reliability of PSQI scores in pwMS (n = 79) and control subjects (n = 213) expressed as McDonald’s omega/Cronbach’s alpha.
Table 3. Reliability of PSQI scores in pwMS (n = 79) and control subjects (n = 213) expressed as McDonald’s omega/Cronbach’s alpha.
VariablepwMSControl
PSQI global score–/0.83–/0.69
PSQI sleep quality0.80/0.810.64/0.61
PSQI sleep efficiency0.79/0.790.69/0.69
Table 4. Differences in PSQI scores between women (f, n = 175–180) and men (m, n = 121–123) regardless of MS diagnosis.
Table 4. Differences in PSQI scores between women (f, n = 175–180) and men (m, n = 121–123) regardless of MS diagnosis.
VariableMf
(SDf)
Mm (SDm)Levene’s Test F
(p)
t
(p)
PSQI global score6.37(3.928)5.08(3.243)7.45(0.007)3.12(0.002)
PSQI sleep quality4.89(2.797)3.57(2.125)9.31(0.002)4.61(0.000)
PSQI sleep efficiency1.58(1.648)1.57(1.671)0.01(0.935)0.09(0.930)
Table 5. Spearman’s rang correlations of PSQI scores with expanded disability status scale (EDSS), psychological (MSIS-29 psy) and physical (MSIS-29 phy) impact of the MS disease on the patient, and MS diagnosis duration (Duration).
Table 5. Spearman’s rang correlations of PSQI scores with expanded disability status scale (EDSS), psychological (MSIS-29 psy) and physical (MSIS-29 phy) impact of the MS disease on the patient, and MS diagnosis duration (Duration).
VariableAge aEDSS bMSIS-29 psy cMSIS-29 phy cDuration d
PSQI global score0.241 **0.248 *0.772 **0.601 **−0.135
PSQI sleep quality0.148 *0.0840.826 **0.664 **−0.074
PSQI sleep efficiency0.294 **0.330 **0.461 **0.319 **−0.143
Notea n = 296–303; b n = 74–79; c n = 82–87; d n = 78–83. * p < 0.05. ** p < 0.01.
Table 8. Sensitivity (Sens), specificity (Spec), and proportions of patients with multiple sclerosis (pwMS) and the control group (Con) classified in the high/low PSQI group according to different cut-offs based on different criteria.
Table 8. Sensitivity (Sens), specificity (Spec), and proportions of patients with multiple sclerosis (pwMS) and the control group (Con) classified in the high/low PSQI group according to different cut-offs based on different criteria.
VariableCut-OffCriteriaSensSpecpwMSCon
High PSQILow PSQIHigh PSQILow PSQI
PSQI global score5Curcio et al.0.6710.4290.6440.3560.5750.425
6IuO/Φ0.6330.5710.5980.4020.4330.567
10Youden0.3920.8950.3680.6320.1040.896
PSQI sleep quality5IuO/Φ0.5950.6090.5900.4100.3910.609
7Youden0.3670.8800.3610.6390.1200.880
Table 9. Differences in PSQI scores regarding specific characteristics of pwMS.
Table 9. Differences in PSQI scores regarding specific characteristics of pwMS.
VariableCategorynPSQI Global ScorePSQI Sleep QualityPSQI Sleep Efficiency
M
(SD)
t/F
(p)
M
(SD)
t/F
(p)
M
(SD)
t/F
(p)
Type of MSRelapsing-remitting64–697.00
(4.462)
−1.40
(0.166)
5.61
(3.243)
−0.24
(0.808)
1.63
(1.768)
−2.58
(0.017)
Other MS types17–188.72
(5.345)
5.82
(3.432)
3.17
(2.358)
GenderWomen66–717.46
(4.601)
0.45
(0.651)
5.90
(3.299)
1.41
(0.163)
1.89
(1.890)
−0.54
(0.595)
Men166.88
(5.136)
4.63
(2.986)
2.25
(2.463)
Marriage statusMarried/cohabitating53–557.02
(4.148)
−1.05
(0.298)
5.45
(2.978)
−0.73
(0.466)
1.70
(1.846)
−1.64
(0.105)
Single/separated/widowed29–318.19
(5.388)
6.00
(3.742)
2.45
(2.213)
Working statusActive33–346.12
(4.617)
6.39
(0.003)
4.82
(3.264)
2.69
(0.074)
1.41
(1.725)
8.36
(0.001)
Temporarily inactive19–226.27
(4.366)
5.30
(3.246)
1.32
(1.827)
Permanently inactive24–259.92
(3.947)
6.72
(2.880)
3.25
(2.069)
Note. To see if the working status of pwMS is related to their PSQI sleep scores, pwMS people were divided in three groups: active (employed or student), temporarily inactive (unemployed or temporarily on sick leave), and permanently inactive (permanent incapacity for work or disability pension).
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Jerković, A.; Mikac, U.; Matijaca, M.; Košta, V.; Ćurković Katić, A.; Dolić, K.; Vujović, I.; Šoda, J.; Đogaš, Z.; Pavelin, S.; et al. Psychometric Properties of the Pittsburgh Sleep Quality Index (PSQI) in Patients with Multiple Sclerosis: Factor Structure, Reliability, Correlates, and Discrimination. J. Clin. Med. 2022, 11, 2037. https://doi.org/10.3390/jcm11072037

AMA Style

Jerković A, Mikac U, Matijaca M, Košta V, Ćurković Katić A, Dolić K, Vujović I, Šoda J, Đogaš Z, Pavelin S, et al. Psychometric Properties of the Pittsburgh Sleep Quality Index (PSQI) in Patients with Multiple Sclerosis: Factor Structure, Reliability, Correlates, and Discrimination. Journal of Clinical Medicine. 2022; 11(7):2037. https://doi.org/10.3390/jcm11072037

Chicago/Turabian Style

Jerković, Ana, Una Mikac, Meri Matijaca, Vana Košta, Ana Ćurković Katić, Krešimir Dolić, Igor Vujović, Joško Šoda, Zoran Đogaš, Sanda Pavelin, and et al. 2022. "Psychometric Properties of the Pittsburgh Sleep Quality Index (PSQI) in Patients with Multiple Sclerosis: Factor Structure, Reliability, Correlates, and Discrimination" Journal of Clinical Medicine 11, no. 7: 2037. https://doi.org/10.3390/jcm11072037

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop