Reliability and Validity of the Japanese Version of the Multidimensional Evaluation Scale for Patient Impression Change (MPIC): A Brief Tool for Multidimensional Assessment in Interdisciplinary Pain Management
Abstract
1. Introduction
2. Materials and Methods
2.1. Study Design
2.2. Participants
2.3. Measures
2.3.1. Visual Analog Scale
2.3.2. PainDETECT Questionnaire
2.3.3. Pain Disability Index
2.3.4. Symptom Catastrophizing Scale
2.3.5. Pain Self-Efficacy Questionnaire
2.3.6. Psychological Measures
2.3.7. Athens Insomnia Scale
2.3.8. Multidimensional Evaluation Scale for Patient Impression of Change
2.4. Data Analysis
3. Results
3.1. Patient Demographics
3.2. Reliability and Validity of MPIC
3.3. Correlations Between MPIC Domains and Pain-Related Measures
4. Discussion
5. Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Acknowledgments
Conflicts of Interest
References
- Nakamura, M.; Nishiwaki, Y. Prevalence and characteristics of chronic musculoskeletal pain in Japan. J. Orthop. Sci. 2011, 16, 424–432. [Google Scholar] [CrossRef]
- Farrar, J.T.; Young, J.P.; LaMoreaux, L.; Werth, J.L.; Poole, R.M. Clinical importance of changes in chronic pain intensity measured on an 11-point numerical pain rating scale. Pain 2001, 94, 149–158. [Google Scholar] [CrossRef]
- Gagnon, C.M.; Scholten, P.; Atchison, J. Multidimensional Patient Impression of Change Following Interdisciplinary Pain Management. Pain Pract. 2018, 18, 997–1010. [Google Scholar] [CrossRef]
- Wakaizumi, K.; Yamada, K.; Nishigami, T.; Nishino, A.; Hikari, H.; Kosugi, S.; Morizaki, H. Development of the multifaceted measure (Multidimensional Evaluation Scale for Patient Impression Change-Japanese version: MPIC-J) of the Japanese edition patients image change with the verbal validity. J. Jpn. Soc. Pain Clin. 2021, 28, 59–63. [Google Scholar] [CrossRef]
- Jamison, R.N.; Gracely, R.H.; Raymond, S.A.; Levine, J.G.; Marino, B.; Herrmann, T.J.; Daly, M.; Fram, D.; Katz, N.P. Comparative study of electronic vs. paper VAS ratings: A randomized, crossover trial using healthy volunteers. Pain 2002, 99, 341–347. [Google Scholar] [CrossRef]
- Matsubayashi, Y.; Takeshita, K.; Sumitani, M.; Oshima, Y.; Tonosu, J.; Kato, S.; Ohya, J.; Oichi, T.; Okamoto, N.; Tanaka, S. Validity and Reliability of the Japanese Version of the painDETECT Questionnaire: A Multicenter Observational Study. PLoS ONE 2013, 8, e68013. [Google Scholar] [CrossRef]
- Pollard, C.A. Preliminary validity study of the pain disability index. Percept. Mot. Skills. 1984, 59, 974. [Google Scholar] [CrossRef]
- Yamada, K.; Mibu, A.; Kogo, S.; Iseki, M.; Nishigami, T. Development of a Japanese version of the Pain Disability Index: Translation and linguistic validation. Pain Res. 2021, 36, 1–14. [Google Scholar] [CrossRef]
- Yamada, K.; Mibu, A.; Kogo, S.; Sullivan, M.; Nishigami, T. Reliability and validity of the Japanese version of Pain Disability Index. PLoS ONE 2022, 17, e0274445. [Google Scholar] [CrossRef] [PubMed]
- Uğurlu, M.; Uğurlu, G.K.; Erten, Ş.; Ulusoy Kaymak, S.; Çayköylü, A. Reliability and Factorial Validity of the Turkish Version of the Pain Disability Index in Rheumatic Patients with Chronic Pain. Arch. Rheumatol. 2016, 31, 265–271. [Google Scholar] [CrossRef] [PubMed]
- Moore, E.; Adams, H.; Ellis, T.; Thibault, P.; Sullivan, M.J.L. Assessing catastrophic thinking associated with debilitating mental health conditions. Disabil. Rehabil. 2018, 40, 317–322. [Google Scholar] [CrossRef]
- Keiko, Y.; Kenta, W.; Akira, M.; Sonora, K.; Masako, I.; Tomohiko, N. Development of a Japanese Version of the Symptom Catastrophizing Scale. Transl. Linguist. Valid. 2022, 71, 554–561. [Google Scholar]
- Nicholas, M.K. The pain self-efficacy questionnaire: Taking pain into account. Eur. J. Pain 2007, 11, 153–163. [Google Scholar] [CrossRef]
- Adachi, T.; Nakae, A.; Maruo, T.; Shi, K.; Shibata, M.; Maeda, L.; Saitoh, Y.; Sasaki, J. Validation of the Japanese version of the pain self-efficacy questionnaire in Japanese patients with chronic pain. Pain Med. 2014, 15, 1405–1417. [Google Scholar] [CrossRef]
- Zigmond, A.S.; Snaith, R.P. The hospital anxiety and depression scale. Acta Psychiatr. Scand. 1983, 67, 361–370. [Google Scholar] [CrossRef] [PubMed]
- Fernández-de-las-Peñas, C.; Rodríguez-Jiménez, J.; Palacios-Ceña, M.; De-La-Llave-Rincón, A.; Fuensalida-Novo, S.; Florencio, L.L.; Ambite-Quesada, S.; Ortega-Santiago, R.; Arias-Buría, J.L.; Liew, B.X.W.; et al. Psychometric Properties of the Hospital Anxiety and Depression Scale (HADS) in Previously Hospitalized COVID-19 Patients. Int. J. Environ. Res. Public Health 2022, 19, 9273. [Google Scholar] [CrossRef]
- Bjelland, I.; Dahl, A.A.; Haug, T.T.; Neckelmann, D. The validity of the Hospital Anxiety and Depression Scale: An updated literature review. J. Psychosom. Res. 2002, 52, 69–77. [Google Scholar] [CrossRef] [PubMed]
- Sakurai, K.; Nishi, A.; Kondo, K.; Yanagida, K.; Kawakami, N. Screening performance of K6/K10 and other screening instruments for mood and anxiety disorders in Japan. Psychiatry Clin. Neurosci. 2011, 65, 434–441. [Google Scholar] [CrossRef] [PubMed]
- Arnaud, B.; Malet, L.; Teissedre, F.; Izaute, M.; Moustafa, F.; Geneste, J.; Schmidt, J.; Llorca, P.; Brousse, G. Validity Study of Kessler’s Psychological Distress Scales Conducted Among Patients Admitted to French Emergency Department for Alcohol Consumption–Related Disorders. Alcohol. Clin. Exp. Res. 2010, 34, 1235–1245. [Google Scholar] [CrossRef]
- Okajima, I.; Nakajima, S.; Kobayashi, M.; Inoue, Y. Development and validation of the Japanese version of the Athens Insomnia Scale. Psychiatry Clin. Neurosci. 2013, 67, 420–425. [Google Scholar] [CrossRef]
- Afolalu, E.F.; Ramlee, F.; Tang, N.K.Y. Effects of sleep changes on pain-related health outcomes in the general population: A systematic review of longitudinal studies with exploratory meta-analysis. Sleep Med. Rev. 2018, 39, 82–97. [Google Scholar] [CrossRef]
- Browne, M.W.; Cudeck, R.; Bollen, K.A.; Long, J.S. Alternative ways of assessing model fit. In Testing Structural Equation Models; Long, J.S., Bollen, K.A., Eds.; Sage: Newbury Park, CA, USA, 1993; pp. 136–162. [Google Scholar]
- Bentler, P.M. Comparative fit indexes in structural models. Psychol. Bull. 1990, 107, 238–246. [Google Scholar] [CrossRef]
- Hu, L.T.; Bentler, P.M. Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Struct. Equ. Model. 1999, 6, 1–55. [Google Scholar] [CrossRef]
- Fornell, C.; Larcker, D.F. Evaluating Structural Equation Models with Unobservable Variables and Measurement Error. J. Mark. Res. 1981, 18, 39–50. [Google Scholar] [CrossRef]
- Cronbach, L.J. Coefficient alpha and the internal structure of tests. Psychometrika 1951, 16, 297–334. [Google Scholar] [CrossRef]
- Taber, K.S. The Use of Cronbach’s Alpha When Developing and Reporting Research Instruments in Science Education. Res. Sci. Educ. 2018, 48, 1273–1296. [Google Scholar] [CrossRef]
- Koo, T.K.; Li, M.Y. A Guideline of Selecting and Reporting Intraclass Correlation Coefficients for Reliability Research. J. Chiropr. Med. 2016, 15, 155–163. [Google Scholar] [CrossRef] [PubMed]
- Hair, J.F.; Black, W.C.; Babin, B.J.; Anderson, R.E. Multivariate Data Analysis, 7th ed.; Prentice-Hall: Saddle River, NJ, USA, 2010. [Google Scholar]
- Shi, D.; Lee, T.; Maydeu-Olivares, A. Understanding the Model Size Effect on SEM Fit Indices. Educ. Psychol. Meas. 2019, 79, 310–334. [Google Scholar] [CrossRef]
- Schober, P.; Mascha, E.J.; Vetter, T.R. Statistics from A (Agreement) to Z (z Score): A Guide to Interpreting Common Measures of Association, Agreement, Diagnostic Accuracy, Effect Size, Heterogeneity, and Reliability in Medical Research. Anesth. Analg. 2021, 133, 1633–1641. [Google Scholar] [CrossRef]
- Lam, K.K.; Kunder, S.; Wong, J.; Doufas, A.G.; Chung, F. Obstructive sleep apnea, pain, and opioids: Is the riddle solved? Curr. Opin. Anaesthesiol. 2016, 29, 134–140. [Google Scholar] [CrossRef] [PubMed]
- Martinez-Calderon, J.; Jensen, M.P.; Morales-Asencio, J.M.; Luque-Suarez, A. Pain Catastrophizing and Function in Individuals with Chronic Musculoskeletal Pain: A Systematic Review and Meta-Analysis. Clin. J. Pain. 2019, 35, 279–293. [Google Scholar] [CrossRef] [PubMed]
- Karasawa, Y.; Yamada, K.; Iseki, M.; Yamaguchi, M.; Murakami, Y.; Tamagawa, T.; Kadowaki, F.; Hamaoka, S.; Ishii, T.; Kawai, A.; et al. Association between change in self-efficacy and reduction in disability among patients with chronic pain. PLoS ONE 2019, 14, e0215404. [Google Scholar] [CrossRef]
- White, M. Sample size in quantitative instrument validation studies: A systematic review of articles published in Scopus, 2021. Heliyon 2022, 8, e12223. [Google Scholar] [CrossRef] [PubMed]
- Wolf, E.J.; Harrington, K.M.; Clark, S.L.; Miller, M.W. Sample Size Requirements for Structural Equation Models: An Evaluation of Power, Bias, and Solution Propriety. Educ. Psychol. Meas. 2013, 76, 913–934. [Google Scholar] [CrossRef] [PubMed]
Age (years), mean (SD) | 54.5 (14.6) |
Women, n (%) | 66 (65.3) |
BMI (kg/m2), mean (SD) | 21.7 (3.8) |
Pain duration (month), median (min, max) | 42 (1, 660) |
Treatment period (days), median (min, max) | 169 (28, 637) |
Pain location, n (%) | |
Upper limbs | 57 (56.4) |
Head and/or neck | 52 (51.5) |
Lower limbs | 51 (50.5) |
Chest and/or abdomen | 25 (24.8) |
Back | 24 (23.8) |
Perineal | 3 (3.0) |
Mean (SD) | Pre | Post | p Value |
---|---|---|---|
VAS | 59.9 (22.1) | 52.8 (22.3) | 0.003 |
PDQ | 19.4 (6.5) | 17.9 (6.3) | 0.002 |
PDI | 27.4 (12.0) | 23.8 (12.0) | 0.003 |
SCS | 8.0 (3.6) | 5.8 (3.5) | <0.001 |
PSEQ | 22.6 (12.1) | 26.9 (11.4) | <0.001 |
AIS | 9.3 (4.7) | 8.1 (4.5) | 0.013 |
HADS-A # | 10.5 (5.3) | 8.7 (3.9) | 0.004 |
HADS-D # | 9.5 (4.3) | 8.9 (4.6) | 0.160 |
K6 $ | 8.4 (6.2) | 6.6 (5.4) | 0.002 |
MPIC, mean (SD) | |||
Overall status | 3.3 (1.3) | ||
Pain | 3.4 (1.3) | ||
Sleep | 3.7 (1.2) | ||
Mood | 3.4 (1.3) | ||
Physical functioning | 3.7 (1.3) | ||
Cope with pain | 3.3 (1.3) | ||
Manage pain flare-ups | 3.4 (0.9) | ||
Medication effectiveness | 3.4 (1.0) |
Category | Index Name | Results | Criterion of Acceptance |
---|---|---|---|
Validity | |||
Construct Validity | RMSEA | 0.23 | <0.1 [22] |
CFI | 0.86 | >0.8 [23] | |
SRMR | 0.06 | <0.08 [24] | |
Convergent validity | AVE | 0.58 | ≥0.5 [25] |
Reliability | |||
Internal consistency | Cronbach’s alpha | 0.93 | ≥0.7 [26,27] |
Test–retest reliability | ICC | 0.52 | >0.5 [28] |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2025 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Kawate, M.; Wu, Y.; Shinohara, Y.; Takaoka, S.; Tanaka, C.; Kosugi, S.; Wakaizumi, K. Reliability and Validity of the Japanese Version of the Multidimensional Evaluation Scale for Patient Impression Change (MPIC): A Brief Tool for Multidimensional Assessment in Interdisciplinary Pain Management. J. Clin. Med. 2025, 14, 6851. https://doi.org/10.3390/jcm14196851
Kawate M, Wu Y, Shinohara Y, Takaoka S, Tanaka C, Kosugi S, Wakaizumi K. Reliability and Validity of the Japanese Version of the Multidimensional Evaluation Scale for Patient Impression Change (MPIC): A Brief Tool for Multidimensional Assessment in Interdisciplinary Pain Management. Journal of Clinical Medicine. 2025; 14(19):6851. https://doi.org/10.3390/jcm14196851
Chicago/Turabian StyleKawate, Morihiko, Yihuan Wu, Yuta Shinohara, Saki Takaoka, Chisato Tanaka, Shizuko Kosugi, and Kenta Wakaizumi. 2025. "Reliability and Validity of the Japanese Version of the Multidimensional Evaluation Scale for Patient Impression Change (MPIC): A Brief Tool for Multidimensional Assessment in Interdisciplinary Pain Management" Journal of Clinical Medicine 14, no. 19: 6851. https://doi.org/10.3390/jcm14196851
APA StyleKawate, M., Wu, Y., Shinohara, Y., Takaoka, S., Tanaka, C., Kosugi, S., & Wakaizumi, K. (2025). Reliability and Validity of the Japanese Version of the Multidimensional Evaluation Scale for Patient Impression Change (MPIC): A Brief Tool for Multidimensional Assessment in Interdisciplinary Pain Management. Journal of Clinical Medicine, 14(19), 6851. https://doi.org/10.3390/jcm14196851