Further Refinement of the Center for Epidemiological Studies Depression Scale-10: Complementary Evidence from Item Response Theory and Classical Test Theory
Abstract
:1. Introduction
2. Materials and Methods
2.1. Participants and Procedure
2.2. Instruments
2.3. Ethical Considerations
2.4. Data Analyses
3. Results
4. Discussion
5. Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Conflicts of Interest
References
- Naser, A.Y.; Dahmash, E.Z.; Al-Rousan, R.; Alwafi, H.; Alrawashdeh, H.M.; Ghoul, I.; Abidine, A.; Bokhary, M.A.; Al-Hadithi, H.T.; Ali, D.; et al. Mental health status of the general population, healthcare professionals, and university students during 2019 coronavirus disease outbreak in Jordan: A cross-sectional study. Brain Behav. 2020, 10, e01730. [Google Scholar] [CrossRef] [PubMed]
- Vahedian-Azimi, A.; Moayed, M.S.; Rahimibashar, F.; Shojaei, S.; Ashtari, S.; Pourhoseingholi, M.A. Comparison of the severity of psychological distress among four groups of an Iranian population regarding COVID-19 pandemic. BMC Psychiatry 2020, 20, 402. [Google Scholar] [CrossRef] [PubMed]
- Satinsky, E.N.; Kimura, T.; Kiang, M.V.; Abebe, R.; Cunningham, S.; Lee, H.; Lin, X.; Liu, C.H.; Rudan, I.; Sen, S.; et al. Systematic review and meta-analysis of depression, anxiety, and suicidal ideation among Ph.D. students. Sci. Rep. 2021, 11, 14370. [Google Scholar] [CrossRef] [PubMed]
- Odriozola-González, P.; Planchuelo-Gómez, Á.; Irurtia, M.J.; de Luis-García, R. Psychological effects of the COVID-19 outbreak and lockdown among students and workers of a Spanish university. Psychiatry Res. 2020, 290, 113108. [Google Scholar] [CrossRef] [PubMed]
- Sarokhani, D.; Delpisheh, A.; Veisani, Y.; Sarokhani, M.T.; Esmaeli Manesh, R.; Sayehmiri, K. Prevalence of Depression among University Students: A Systematic Review and Meta-Analysis Study. Depress. Res. Treat. 2013, 2013, 373857. [Google Scholar] [CrossRef]
- Li, W.; Zhao, Z.; Chen, D.; Peng, Y.; Lu, Z. Prevalence and associated factors of depression and anxiety symptoms among college students: A systematic review and meta-analysis. J. Child. Psychol. Psychiatry 2022, 63, 1222–1230. [Google Scholar] [CrossRef] [PubMed]
- De Luca, S.M.; Franklin, C.; Yueqi, Y.; Johnson, S.; Brownson, C. The Relationship Between Suicide Ideation, Behavioral Health, and College Academic Performance. Community Ment. Health J. 2016, 52, 534–540. [Google Scholar] [CrossRef]
- Vilagut, G.; Forero, C.G.; Barbaglia, G.; Alonso, J. Screening for Depression in the General Population with the Center for Epidemiologic Studies Depression (CES-D): A Systematic Review with Meta-Analysis. PLoS ONE 2016, 11, e0155431. [Google Scholar] [CrossRef]
- Dozeman, E.; van Schaik, D.J.F.; van Marwijk, H.W.J.; Stek, M.L.; van der Horst, H.E.; Beekman, A.T.F. The center for epidemiological studies depression scale (CES-D) is an adequate screening instrument for depressive and anxiety disorders in a very old population living in residential homes. Int. J. Geriatr. Psychiatry 2011, 26, 239–246. [Google Scholar] [CrossRef]
- Kellahan, S.R.; Huang, X.; Lew, D.; Xian, H.; Eisen, S.; Kim, A.H.J. Depressed Symptomatology in Systemic Lupus Erythematosus Patients. Arthritis Care Res. 2023, 75, 749–757. [Google Scholar] [CrossRef]
- Radloff, L.S. The CES-D scale: A self-report depression scale for research in the general population. Appl. Psychol. Meas. 1977, 1, 385–401. [Google Scholar] [CrossRef]
- Cosco, T.D.; Lachance, C.C.; Blodgett, J.M.; Stubbs, B.; Co, M.; Veronese, N.; Wu, Y.-T.; Prina, A.M. Latent structure of the Centre for Epidemiologic Studies Depression Scale (CES-D) in older adult populations: A systematic review. Aging Ment. Health 2020, 24, 700–704. [Google Scholar] [CrossRef] [PubMed]
- Ghazali, S.R.; Elklit, A.; Balang, R.V.; Chen, Y.Y. Concurrent validity and exploratory factor analysis of the Malay version of Center for Epidemiologic Studies-Depression Scale (Cesd) among Malaysian adolescents. Psychiatry 2016, 17, 71–78. [Google Scholar]
- Heo, E.-H.; Choi, K.-S.; Yu, J.-C.; Nam, J.-A. Validation of the Center for Epidemiological Studies Depression Scale among Korean Adolescents. Psychiatry Investig. 2018, 15, 124–132. [Google Scholar] [CrossRef] [PubMed]
- Dou, D.; Shek, D.T.L.; Zhu, X.; Zhao, L. Dimensionality of the Chinese CES-D: Is It Stable across Gender, Time, and Samples? Int. J. Environ. Res. Public Health 2021, 18, 11818. [Google Scholar] [CrossRef]
- Dardas, L.A.; Xu, H.; Shawashreh, A.; Franklin, M.S.; Wainwright, K.; Pan, W. Psychometric Properties and Factor Structure of the Center for Epidemiologic Studies Depression Scale in a National Sample of Arab Adolescents. Issues Ment. Health Nurs. 2019, 40, 437–443. [Google Scholar] [CrossRef]
- Roberts, R.E.; Andrews, J.A.; Lewinsohn, P.M.; Hops, H. Assessment of Depression in Adolescents Using the Center for Epidemiologic Studies Depression Scale. Psychol. Assess. 1990, 2, 122–128. [Google Scholar] [CrossRef]
- Skriner, L.C.; Chu, B.C. Cross-Ethnic Measurement Invariance of the SCARED and CES-D in a Youth Sample. Psychol. Assess. 2014, 26, 332–337. [Google Scholar] [CrossRef]
- Kliem, S.; Beller, J.; Tibubos, A.N.; Zenger, M.; Schmalbach, B.; Brähler, E. A reanalysis of the center for epidemiological studies depression scale (CES-D) using non-parametric item response theory. Psychiatry Res. 2020, 290, 113132. [Google Scholar] [CrossRef]
- Jiang, L.; Wang, Y.; Zhang, Y.; Li, R.; Wu, H.; Li, C.; Wu, Y.; Tao, Q. The Reliability and Validity of the Center for Epidemiologic Studies Depression Scale (CES-D) for Chinese University Students. Front. Psychiatry 2019, 10, 315. [Google Scholar] [CrossRef]
- Wang, M.; Armour, C.; Wu, Y.; Ren, F.; Zhu, X.; Yao, S. Factor Structure of the CES-D and Measurement Invariance Across Gender in Mainland Chinese Adolescents. J. Clin. Psychol. 2013, 69, 966–979. [Google Scholar] [CrossRef] [PubMed]
- Zhu, X.; Shek, D.T.L.; Dou, D. Factor structure of the Chinese CES-D and invariance analyses across gender and over time among Chinese adolescents. J. Affect. Disord. 2021, 295, 639–646. [Google Scholar] [CrossRef] [PubMed]
- Ohayon, M.M.; Schatzberg, A.F. Using chronic pain to predict depressive morbidity in the general population. Arch. Gen. Psychiatry 2003, 60, 39–47. [Google Scholar] [CrossRef] [PubMed]
- Rivera-Medina, C.L.; Caraballo, J.N.; Rodríguez-Cordero, E.R.; Bernal, G.; Dávila-Marrero, E. Factor Structure of the CES-D and Measurement Invariance Across Gender for Low-Income Puerto Ricans in a Probability Sample. J. Consult. Clin. Psychol. 2010, 78, 398–408. [Google Scholar] [CrossRef] [PubMed]
- Carleton, R.N.; Thibodeau, M.A.; Teale, M.J.N.; Welch, P.G.; Abrams, M.P.; Robinson, T.; Asmundson, G.J.G. The center for epidemiologic studies depression scale: A review with a theoretical and empirical examination of item content and factor structure. PLoS ONE 2013, 8, e58067. [Google Scholar] [CrossRef] [PubMed]
- Levine, S.Z. Evaluating the seven-item Center for Epidemiologic Studies Depression Scale short-form: A longitudinal US community study. Soc. Psychiatry Psychiatr. Epidemiol. 2013, 48, 1519–1526. [Google Scholar] [CrossRef] [PubMed]
- He, J.; Chen, Z.; Guo, F.; Zhang, J.; Yang, Y.; Wang, Q. A short Chinese version of center for epidemiologic studies depression scale. Chin. J. Behav. Med. Brain Sci. 2013, 12, 1133–1136. [Google Scholar]
- Cole, J.C.; Rabin, A.S.; Smith, T.L.; Kaufman, A.S. Development and Validation of a Rasch-Derived CES-D Short Form. Psychol. Assess. 2004, 16, 360–372. [Google Scholar] [CrossRef]
- Lee, S.W.; Stewart, S.M.; Byrne, B.M.; Wong, J.P.S.; Ho, S.Y.; Lee, P.W.H.; Lam, T.H. Factor Structure of the Center for Epidemiological Studies Depression Scale in Hong Kong Adolescents. J. Personal. Assess. 2008, 90, 175–184. [Google Scholar] [CrossRef]
- Andresen, E.M.; Malmgren, J.A.; Carter, W.B.; Patrick, D.L. Screening for Depression in Well Older Adults: Evaluation of a Short Form of the CES-D. Am. J. Prev. Med. 1994, 10, 77–84. [Google Scholar] [CrossRef]
- Zhang, W.; O’Brien, N.; Forrest, J.I.; Salters, K.A.; Patterson, T.L.; Montaner, J.S.G.; Hogg, R.S.; Lima, V.D. Validating a shortened depression scale (10 item CES-D) among HIV-positive people in British Columbia, Canada. PLoS ONE 2012, 7, e40793. [Google Scholar] [CrossRef] [PubMed]
- Yang, W.; Xiong, G.; Garrido, L.E.; Zhang, J.X.; Wang, M.-C.; Wang, C. Factor Structure and Criterion Validity Across the Full Scale and Ten Short Forms of the CES-D Among Chinese Adolescents. Psychol. Assess. 2018, 30, 1186–1198. [Google Scholar] [CrossRef] [PubMed]
- Baron, E.C.; Davies, T.; Lund, C. Validation of the 10-item centre for epidemiological studies depression scale (CES-D-10) in Zulu, Xhosa and Afrikaans populations in South Africa. BMC Psychiatry 2017, 17, 6. [Google Scholar] [CrossRef] [PubMed]
- Lee, A.E.Y.; Chokkanathan, S. Factor structure of the 10-item CES-D scale among community dwelling older adults in Singapore. Int. J. Geriatr. Psychiatry 2008, 23, 592–597. [Google Scholar] [CrossRef] [PubMed]
- Mohebbi, M.; Nguyen, V.; McNeil, J.J.; Woods, R.L.; Nelson, M.R.; Shah, R.C.; Storey, E.; Murray, A.M.; Reid, C.M.; Kirpach, B.; et al. Psychometric properties of a short form of the Center for Epidemiologic Studies Depression (CES-D-10) scale for screening depressive symptoms in healthy community dwelling older adults. Gen. Hosp. Psychiatry 2018, 51, 118–125. [Google Scholar] [CrossRef] [PubMed]
- Meijer, R.R.; Sijtsma, K.; Smid, N.G. Theoretical and empirical comparison of the Mokken and the Rasch approach to IRT. Appl. Psychol. Meas. 1990, 14, 283–298. [Google Scholar] [CrossRef]
- Sijtsma, K.; Meijer, R.R.; Andries van der Ark, L. Mokken scale analysis as time goes by: An update for scaling practitioners. Pers. Individ. Dif. 2011, 50, 31–37. [Google Scholar] [CrossRef]
- Bantjes, J.; Kessler, M.; Lochner, C.; Breet, E.; Bawa, A.; Roos, J.; Davids, C.; Muturiki, M.; Kessler, R.C.; Stein, D.J. The mental health of university students in South Africa: Results of the national student survey. J. Affect. Disord. 2023, 321, 217–226. [Google Scholar] [CrossRef]
- Kilburn, K.; Prencipe, L.; Hjelm, L.; Peterman, A.; Handa, S.; Palermo, T. Examination of performance of the Center for Epidemiologic Studies Depression Scale Short Form 10 among African youth in poor, rural households. BMC Psychiatry 2018, 18, 201. [Google Scholar] [CrossRef]
- Adams, L.B.; Farrell, M.; Mall, S.; Mahlalela, N.; Berkman, L. Dimensionality and differential item endorsement of depressive symptoms among aging Black populations in South Africa: Findings from the HAALSI study. J. Affect. Disord. 2020, 277, 850–856. [Google Scholar] [CrossRef]
- Cohen, S. Perceived stress in a probability sample of the United States. In The Social Psychology of Health; Spacapan, S., Oskamp, S., Eds.; Sage Publications: Thousand Oaks, CA, USA, 1988; pp. 31–67. [Google Scholar]
- Diener, E.D.; Emmons, R.A.; Larsen, R.J.; Griffin, S. The satisfaction with life scale. J. Personal. Assess. 1985, 49, 71–75. [Google Scholar] [CrossRef] [PubMed]
- Balsamo, M.; Carlucci, L.; Innamorati, M.; Lester, D.; Pompili, M. Further Insights Into the Beck Hopelessness Scale (BHS): Unidimensionality Among Psychiatric Inpatients. Front. Psychiatry 2020, 11, 727. [Google Scholar] [CrossRef] [PubMed]
- Engelbrecht, M.C. Construct validity and reliability of the perceived stress scale for nursing students in South Africa. Curationis 2022, 45, 2276. [Google Scholar] [CrossRef] [PubMed]
- Pretorius, T.B.; Padmanabhanunni, A. Assessing the cognitive component of subjective well-being: Revisiting the satisfaction with life scale with classical test theory and item response theory. Afr. J. Psychol. Assess. 2022, 4, 9. [Google Scholar] [CrossRef]
- Beck, A.T.; Weissman, A.; Lester, D.; Trexler, L. The measurement of pessimism: The hopelessness scale. J. Consult. Clin. Psychol. 1974, 42, 861–865. [Google Scholar] [CrossRef] [PubMed]
- Shkeer, A.S.; Awang, Z. Exploring the items for measuring the marketing information system construct: An exploratory factor analysis. Int. Rev. Manag. Mark. 2019, 9, 87–97. [Google Scholar] [CrossRef]
- O’connor, B.P. SPSS and SAS programs for determining the number of components using parallel analysis and Velicer’s MAP test. Behav. Res. Methods Instrum. Comput. 2000, 32, 396–402. [Google Scholar] [CrossRef]
- Kline, R.B. Principles and Practice of Structural Equation Modeling; Guilford Publications: New York, NY, USA, 2015. [Google Scholar]
- Hair, J.F.; Black, W.C.; Babin, B.J.; Anderson, R.E. Multivariate Data Analysis; Prentice Hall: Englewood Cliffs, NJ, USA, 2010. [Google Scholar]
- Paulsen, J.; BrckaLorenz, A. Internal Consistency Statistics; FSSE Psychometric Portfolio; Indiana University: Bloomington, IN, USA, 2017. [Google Scholar]
- DeVon, H.A.; Block, M.E.; Moyle-Wright, P.; Ernst, D.M.; Hayden, S.J.; Lazzara, D.J.; Savoy, S.M.; Kostas-Polston, E. A Psychometric Toolbox for Testing Validity and Reliability. J. Nurs. Scholarsh. 2007, 39, 155–164. [Google Scholar] [CrossRef]
- Linacre, J.M. Winsteps® Rasch Measurement Computer Program (Version 5.6.0); Computer Software. Available online: https://www.winsteps.com/ (accessed on 11 August 2023).
- Costello, A.B.; Osborne, J. Best practices in exploratory factor analysis: Four recommendations for getting the most from your analysis. Pract. Assess. Res. Eval. 2005, 10, 7. [Google Scholar] [CrossRef]
- Piedmont, R.L. Inter-item Correlations. In Encyclopedia of Quality of Life and Well-Being Research; Michalos, A.C., Ed.; Springer: Dordrecht, The Netherlands, 2014; pp. 3303–3304. [Google Scholar]
- Charles, N.E.; Strong, S.J.; Burns, L.C.; Bullerjahn, M.R.; Serafine, K.M. Increased mood disorder symptoms, perceived stress, and alcohol use among college students during the COVID-19 pandemic. Psychiatry Res. 2021, 296, 113706. [Google Scholar] [CrossRef]
- Demirtas, A.S.; Yildiz, B. Hopelessness and perceived stress: The mediating role of cognitive flexibility and intolerance of uncertainty. Dusunen Adam J. Psychiatry Neurol. Sci. 2019, 32, 259. [Google Scholar] [CrossRef]
- Haikalis, M.; Doucette, H.; Meisel, M.K.; Birch, K.; Barnett, N.P. Changes in College Student Anxiety and Depression from Pre- to During-COVID-19: Perceived Stress, Academic Challenges, Loneliness, and Positive Perceptions. Emerg. Adulthood 2022, 10, 534–545. [Google Scholar] [CrossRef] [PubMed]
Scale | 1 | 2 | 3 | 4 |
---|---|---|---|---|
1. CES-D10 | — | |||
2. PSS | 0.66 ** | — | ||
3. SWLS | −0.53 ** | −0.53 ** | — | |
4. BHS-9 | 0.50 ** | 0.47 ** | −0.52 ** | — |
Mean | 14.15 | 23.89 | 19.35 | 2.29 |
SD | 6.77 | 6.28 | 7.06 | 2.45 |
Alpha | 0.84 | 0.85 | 0.86 | 0.84 |
Omega | 0.85 | 0.86 | 0.86 | 0.84 |
Item * | Factor Loadings | |
---|---|---|
1 | 2 | |
Factor 1 | ||
1. I was bothered by things that usually don’t bother me. | 0.68 | 0.37 |
5. I had trouble keeping my mind on what I was doing. | 0.66 | 0.37 |
6. I felt depressed. | 0.76 | 0.53 |
7. I felt that everything I did was an effort. | 0.55 | 0.21 |
10. I felt fearful. | 0.60 | 0.42 |
11. My sleep was restless. | 0.58 | 0.39 |
14. I felt lonely. | 0.66 | 0.10 |
20. I could not get “going”. | 0.72 | 0.03 |
Factor 2 | ||
8. I felt hopeful about the future. | 0.31 | 0.70 |
12. I was happy. | 0.45 | 0.54 |
Items and Indices | 1 | 5 | 6 | 7 | 8 | 10 | 11 | 12 | 14 | 20 |
---|---|---|---|---|---|---|---|---|---|---|
1. Bothered | — | |||||||||
5. Keeping mind on things | 0.47 ** | — | ||||||||
6. Depressed | 0.52 ** | 0.49 ** | — | |||||||
7. Everything was an effort | 0.34 ** | 0.37 ** | 0.45 ** | — | ||||||
8. Hopeful about future | 0.17 * | 0.19 ** | 0.31 ** | 0.07 | — | |||||
10. Fearful | 0.43 ** | 0.36 ** | 0.46 ** | 0.28 ** | 0.23 ** | — | ||||
11. Sleep restless | 0.39 ** | 0.34 ** | 0.42 ** | 0.32 ** | 0.23 ** | 0.48 ** | — | |||
12. Happy | 0.31 ** | 0.27 ** | 0.38 ** | 0.17 * | 0.36 ** | 0.33 ** | 0.22 ** | — | ||
14. Lonely | 0.41 ** | 0.35 ** | 0.49 ** | 0.30 ** | 0.27 ** | 0.29 ** | 0.31 ** | 0.33 ** | — | |
20. Could not get going | 0.36 ** | 0.50 ** | 0.45 ** | 0.37 ** | 0.31 ** | 0.40 ** | 0.41 ** | 0.33 ** | 0.47 ** | — |
Mean | 1.26 | 1.55 | 1.38 | 1.71 | 1.30 | 1.10 | 1.51 | 1.43 | 1.49 | 1.43 |
SD | 0.98 | 1.00 | 1.14 | 1.09 | 1.06 | 1.03 | 1.10 | 0.94 | 1.14 | 1.04 |
α if item removed | 0.82 | 0.83 | 0.81 | 0.84 | 0.85 | 0.83 | 0.83 | 0.84 | 0.83 | 0.82 |
Item-total correlation | 0.68 ** | 0.67 ** | 0.78 ** | 0.58 ** | 0.49 ** | 0.66 ** | 0.65 ** | 0.56 ** | 0.66 ** | 0.72 ** |
Infit MnSq | 0.80 | 0.84 | 0.85 | 1.23 | 1.36 | 0.97 | 1.08 | 0.96 | 1.12 | 0.81 |
Outfit MnSq | 0.84 | 0.90 | 0.80 | 1.34 | 1.60 | 0.94 | 1.09 | 1.01 | 1.12 | 0.78 |
Index | CESD-10 | CES-D9 | Acceptable Value |
---|---|---|---|
Alpha | 0.84 | 0.85 | >0.70 |
Omega | 0.85 | 0.85 | >0.70 |
Item separation reliability * | 0.92 | 0.93 | ≥0.80 |
Item separation index * | 3.32 | 3.54 | ≥3.00 |
Person separation reliability * | 0.80 | 0.80 | ≥0.80 |
Person separation index * | 1.98 | 2.00 | ≥2.00 |
First contrast *,1 | 1.57 | 1.40 | <2.00 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2023 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Padmanabhanunni, A.; Pretorius, T.B. Further Refinement of the Center for Epidemiological Studies Depression Scale-10: Complementary Evidence from Item Response Theory and Classical Test Theory. Psych 2024, 6, 21-33. https://doi.org/10.3390/psych6010002
Padmanabhanunni A, Pretorius TB. Further Refinement of the Center for Epidemiological Studies Depression Scale-10: Complementary Evidence from Item Response Theory and Classical Test Theory. Psych. 2024; 6(1):21-33. https://doi.org/10.3390/psych6010002
Chicago/Turabian StylePadmanabhanunni, Anita, and Tyrone B. Pretorius. 2024. "Further Refinement of the Center for Epidemiological Studies Depression Scale-10: Complementary Evidence from Item Response Theory and Classical Test Theory" Psych 6, no. 1: 21-33. https://doi.org/10.3390/psych6010002
APA StylePadmanabhanunni, A., & Pretorius, T. B. (2024). Further Refinement of the Center for Epidemiological Studies Depression Scale-10: Complementary Evidence from Item Response Theory and Classical Test Theory. Psych, 6(1), 21-33. https://doi.org/10.3390/psych6010002