Next Article in Journal
The Influence of Psychosocial Factors on the Successful Formal Education Trajectories of Young Spanish People in Vulnerable Situations
Previous Article in Journal
Smartphone Addiction and Related Factors among Athletes
 
 
Search for Articles:
Title / Keyword
Author / Affiliation / Email
Journal
Article Type
 
 
Advanced Search
 
Section
Special Issue
Volume
Issue
Number
Page
 
Journals
Behavioral Sciences
Volume 14
Issue 4
10.3390/bs14040340
behavsci-logo
Submit to this Journal Review for this Journal Propose a Special Issue
► Article Menu

Article Menu

share Share announcement Help format_quote Cite question_answer Discuss in SciProfiles thumb_up
...
Endorse textsms
...
Comment
first_page
settings
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Systematic Review

Assessing the Psychometric Properties of the Illness Management and Recovery Scale: A Systematic Review Using the Consensus-Based Standards for the Selection of Health Measurement Instruments (COSMIN)

by
Nuria Martín-Ordiales
1,
María Dolores Hidalgo
2,
María Pilar Martín-Chaparro
1,
Júlia Ballester-Plané
2,3,4,5 and
Maite Barrios
4,6,*
1
Department of Psychiatry and Social Psychology, University of Murcia, 30100 Murcia, Spain
2
Department Basic Psychology and Methodology, University of Murcia, 30100 Murcia, Spain
3
Departament of Psicology, University Abat Oliba CEU, CEU Universities, 08022 Barcelona, Spain
4
Institute of Neurociencies, University of Barcelona, 08035 Barcelona, Spain
5
Institute of Research Sant Joan de Déu, 08950 Barcelona, Spain
6
Department of Social Psychology and Quantitative Psychology, University of Barcelona, 08035 Barcelona, Spain
*
Author to whom correspondence should be addressed.
Behav. Sci. 2024, 14(4), 340; https://doi.org/10.3390/bs14040340
Submission received: 5 March 2024 / Revised: 8 April 2024 / Accepted: 16 April 2024 / Published: 18 April 2024
(This article belongs to the Section Health Psychology)
Browse Figure
Review Reports Versions Notes

Abstract

:
The Illness Management and Recovery Scale (IMR-S) is based on the IMR program, developed to assess the recovery process for people with severe mental disorders by considering the perceptions of clients and clinicians involved in it. The aim of this study was to analyze the psychometric properties of the IMR-S so as to determine the reliability and suitability of its scores for evaluating recovery. Two coders searched five databases for studies, published between January 2004 and May 2023, that describe the psychometric assessment of the IMR-S. Studies were assessed using the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) Risk of Bias checklist. Finally, 46 papers were included. Methodological quality was very good for most of the studies that provide information on internal validity, and limited for those that report on responsiveness. Measurement properties were positive for convergent validity and measurement error. The quality of evidence was high for structural validity studies. Although this study only includes research published in English and may have overlooked certain psychometric properties evaluated in studies published in other languages, our findings suggest that the IMR-S is a valid and reliable instrument, demonstrating its potential to offer guidance for clinical practice.

1. Background

In recent decades there has been a shift in intervention strategies with people with severe mental disorder, and the importance of incorporating the perspective of the affected person is now recognized [1]. A key milestone in this process was the emergence in the 1980s of the recovery model as a new paradigm in mental health care [2]. According to Roosenschoon et al. (2021) [3], recovery can be understood and analyzed from three perspectives: clinical, focused on symptom reduction; objective, defined on the basis of social functionality and vocation; and subjective, which encompasses concepts such as connectedness, hope, identity, meaning in life, and empowerment. Developing and implementing interventions based on this model can complement traditional treatments and skill-training programs [4].
The Illness Management and Recovery (IMR) program [5], based on five self-management strategies, was developed as a new model of intervention. It consists of five modules: psychoeducation, improvement in the use of medication, relapse prevention, social skills, and coping strategies [6]. The IMR program aims to foster cooperation between clinicians and affected individuals [7,8].
To assess the scope of the program, the Illness Management and Recovery Scale (IMR-S) was developed in two versions, one for clinicians, the other for clients. Furthermore, to ensure a comprehensive evaluation of the intervention’s various aspects, items were generated by both IMR clients and clinicians [5]. The goal was to provide insight into how the recovery process is perceived by both [9]. These scales have proven useful for assessing recovery following a variety of therapeutic interventions, evaluating three key components: coping with the disease, knowledge and personal goals, and effective use of medication [10]. These scales are based on the stress vulnerability model of severe mental illness, suggesting that its effects can be mitigated through improved coping skills, social support, and involvement in meaningful activities.
The IMR-S appears as a strong scale because it assesses domains related to personal recovery, does not exceed 50 items, considers users’ perspectives, presents quantitative data and is scientifically tested [11]. Moreover, some psychometric studies [12] provide information about reliability, validity and responsiveness. Compared with other recovery scales, such as the Recovery Assessment Scale (RAS) [13] or Mental Health Recovery Measure (MHRM) [14], the IMR-S appears to have exhibited the highest level of service user participation throughout its development, providing added value to the scale by enhancing its understandability and applicability [12].
While the IMR-S has been widely applied in the study of recovery in mental health [6,15,16,17,18,19,20,21], the quality of these studies has not, to the best of our knowledge, been examined through a systematic review using the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) Risk of Bias checklist [22].
COSMIN is a ten-step methodology designed to guide researchers in conducting systematic reviews of patient-reported outcome measures (PROM). The first part guides researchers though performing the literature search (steps 1 to 4). The second part concerns the evaluation of the measurement properties (steps 5 to 7), where the guide provides information on how to evaluate methodological quality and measurement properties using quality criteria, and how to summarize the evidence and grade the quality of evidence. It consists of 10 boxes, containing standards for assessing the methodological quality of studies, including content validity, structural validity, internal consistency, cross-cultural validity, reliability, measurement error, criterion validity, hypothesis testing, and responsiveness. The third part focuses on evaluating the interpretability and feasibility of the PROMs, and formulating and reporting the systematic review (steps 8 to 10). This methodology has established specific and comprehensive guidelines for evaluating content validity; updated criteria for good measurement properties, a risk of bias checklist, an approach for grading the quality of evidence, and synthesizing the overall rating; and formulated recommendation standards for selection of patient-reported outcome measures (PROMs) [22,23,24]. For these reasons, to create a thorough quality assessment of IMR-S, we carried out a systematic review using the COSMIN approach.
The principal aim of this systematic review was to assess the psychometric properties of the IMR-S as reported in studies using either version of the scale (clinician or client), and based on the data extracted to determine the reliability and suitability of IMR-S scores for evaluating recovery. A secondary objective was to analyze the methodological quality of the studies selected for this review.

2. Methods

Studies describing the measurement properties of the IMR-S were examined using the latest version of COSMIN, the COSMIN Risk of Bias checklist [22], and the 2020 guidelines for Preferred Reporting Items for Systematic reviews and Meta-Analyses (PRISMA) [25]. The protocol of the current review was registered with the International Prospective Register of Systematic Reviews (PROSPERO 2022 CRD42022354851) in August 2022.

2.1. Search Strategy

Five databases (Web of Science, Scopus, PubMed, CINAHL, PsycINFO) were systematically searched for journal articles published from January 2004 through to May 2023. The search terms used were “Illness Management and Recovery” AND “scale”. The search strategy and the general characteristics of the selected studies are included as a Supplementary File.

2.2. Inclusion and Exclusion Criteria

The inclusion criteria were empirical studies that (1) applied the IMR-S (either the client, clinician, or both versions), (2) were written in English, and (3) reported data on at least one psychometric property as defined in the COSMIN Risk of Bias checklist. Therefore, theoretical papers, systematic reviews, letters, abstracts, protocols, single case studies, and editorials were excluded. Studies that only used a limited number of IMR items, not corresponding to a specific subscale or factor, were also excluded.

2.3. Screening

The identified studies were examined by two independent coders. One of the coders was a clinical psychologist with more than five years of clinical experience, while the other was a psychologist with over five years of experience in psychological research. Both coders independently assessed the titles and abstracts of the selected studies. Any discrepancies that arose during the process were discussed through consensus meetings. In the event that uncertainty or disagreement persisted, additional team members were consulted to reach a common decision. Full-text review of the initial sample led to additional articles being excluded. Once again, any differences of opinion were resolved through discussion. The use of two independent coders throughout the study screening process could have helped reduce the number of relevant unidentified studies. However, no computerized information extraction program was used in the process.

2.4. Study Selection and Data Extraction

Eligible studies were examined by the two coders, who extracted pertinent information regarding their general characteristics, as well as indications from the COSMIN Risk of Bias checklist. The general characteristics of studies that were recorded were title, authors, publication year, journal, type of study, sample characteristics, version of the scale applied, number of items, and psychometric data. The COSMIN checklist was used to evaluate the methodological quality and to obtain an overall rating of the scale in terms of its measurement properties.

2.5. Evaluation of Selected Studies

The selected studies were analyzed according to the three-phase approach outlined in the COSMIN guidelines [22,24]:
(a)
Methodological Quality Assessment: As a first step, the methodological quality of the included studies was evaluated using the COSMIN Risk of Bias checklist, which comprises 10 domains describing a specific psychometric property (see Table 1). We systematically assessed each study against the defined criteria outlined in each domain (i.e., box) and assigned a rating of very good, adequate, doubtful, or inadequate methodological quality in each case, based on the degree of rigor in a study’s design and how it was conducted and reported. This phase allowed us to analyze each study individually, understanding the strengths and limitations of the selected studies.
(b)
Measurement Property Assessment: As a second step, we assessed the measurement properties using predefined quality criteria in alignment with COSMIN guidelines. Each psychometric property was rated as sufficient (+), insufficient (−), or indeterminate (?), based on the applied quality criteria. This phase allowed us to assess the quality of each psychometric property of the IMR-S analyzed.
(c)
Evidence Synthesis and Quality Grading: As a final step, we summarized the evidence, considering both the methodological quality and measurement property assessments, using the Grading of Recommendations Assessment, Development and Evaluation (GRADE) approach [24] to evaluate the quality of evidence, considering factors such as risk of bias, inconsistency, indirectness, imprecision, and publication bias. The resulting quality level of the evidence in each domain was categorized as high, moderate, low, or very low, indicating the confidence in the results and the trustworthiness of the scale. This phase allowed us to obtain a comprehensive assessment of the evidence studied.

3. Results

3.1. Study Characteristics

The search process returned a total of 720 reports after removing duplicates. Upon screening titles and abstracts, 567 articles appeared potentially relevant and were retrieved for full-text review. Of these, 510 articles were excluded for various reasons: 39 addressed recovery in other areas of health and did not investigate the targeted outcomes, 84 were other types of study (e.g., protocol, essay), 3 did not apply the entire scale, 39 were reviews, 269 applied other scales, and 3 applied other IMR scales (i.e., Illness Management and Recovery Fidelity scale [15]). Consequently, 46 pertinent studies conducted from 2004 to 2023 were selected for the final analysis. Figure 1 presents a detailed flowchart that outlines the process of article inclusion.
The studies reviewed reported data from both clients and clinicians. The mean number of clients surveyed was 378.2, ranging from 8 [26] to 10,659 users [27]. The mean age of clients was 44.3 years, ranging from 18 to 68.8 years. A total of 17,377 people responded to the scale, of which 7350 were women (42.4%). The studies had been conducted in various countries: USA (n = 22), Israel (n = 5), Netherlands (n = 5), Sweden (n = 3), Denmark (n = 2), Turkey (n = 2), Norway (n = 1), Singapore (n = 1), England (n = 1), Canada (n = 1), Kenya (n = 1), and Japan (n = 1). The IMR-S was applied in different languages, although predominantly in English (n = 30 studies); other languages were Hebrew (n = 4), Dutch (n = 4), Swedish (n = 2), Turkish (n = 2), Norwegian (n = 1), Arabic (n = 1), Danish (n = 1), and Swahili and Kamba (n = 1). Over time, the number of publications on the IMR-S has shown an upward trend (with the exception of the years affected by COVID-19), and 73.9% of the studies have been published in the last 10 years.
Data showed that 50% of the studies applied only the client version of the IMR-S, 43.3% applied both versions, and 6.5% applied just the clinician version. A significant majority (93.2%) of the studies applied the full scale (15 items). Only 17.4% of reports were psychometric studies (n = 8), while the remaining 82.6% (n = 38) were intervention, case–control or exploratory studies. Additional details regarding the included articles can be found in Table 2.

3.2. Study Assessment: Methodological Quality, Psychometric Properties, and Quality of Evidence of the Scale

The most frequently reported psychometric properties were responsiveness (31 studies), internal consistency (20 studies), and hypothesis testing (14 studies). Those least frequently reported were content validity (1 study) and measurement error (1 study).
It should be noted that only eight of the studies were specifically designed and conducted to evaluate psychometric properties of the IMR-S. These eight psychometric studies provided information about different aspects of the scale, such as content validity (n = 1), internal consistency (n = 8), reliability (n = 3), hypothesis testing (n = 5), and responsiveness (n = 1).

3.2.1. Content Validity

Only one study (2.2%) evaluated content validity, that is, the degree to which the scale’s content accurately and comprehensively reflects the construct or concept it purports to measure; or to put it another way, whether the items in the instrument represent the full scope of the target construct accurately and comprehensively using qualitative and quantitative methods. This study was graded as being of doubtful methodological quality because it only provided information from clinicians regarding the relevance, comprehensiveness, and comprehensibility of the client version scale. Additionally, and because only a specific group of professionals (i.e., nurses) was consulted [53], the quality of evidence for content validity was graded as low. However, it should be noted that the IMR-S is based on the retrieval model, so although it is necessary to provide evidence of content validity in terms of understanding by users themselves, from the point of view of construct validity, this study provides sufficient evidence.

3.2.2. Structural Validity

Three studies (6.5%) provided information about structural validity, which concerns the degree to which scale scores accurately represent the underlying dimension of the construct being measured. Of these, two studies [27,50] were rated as having very good methodological quality, since the internal structure of the IMR-S was analyzed by confirmatory factor analysis [27], and using several indices of model fit [50]. Both studies employed an adequate sample size for their analysis (n = 697 and n = 10,659, respectively). Finally, the results regarding the goodness of fit were found to be adequate. One of them [27] performed confirmatory factor analysis, while the other [50] applied the Rasch measurement model. The third study involved an exploratory factor analysis [45], and it was, therefore, considered adequate in terms of methodological quality. The quality of the overall rating is limited because the factor structure is not the same across studies. A three-factor structure was commonly reported for the IMR-S, corresponding to coping, recovery, and symptoms (F1), management and personal goals (F2), and effective use of medication and substance abuse (F3). For each of these subscales, the reported values of reliability (in terms of internal consistency) were acceptable. However, the results referring to F3 varied across the three studies; different factorial patterns were found, mainly due to homogeneity in responses to the items referring to the use of medications and substances. The quality of evidence was high, since it met all the requirements of the GRADE approach.

3.2.3. Internal Consistency

Internal consistency, or the degree of interrelatedness among items, was calculated in 20 studies (43.5%) using Cronbach’s alpha. Most of these studies (n = 18) showed very good methodological quality, presenting alpha values for all scales and their factors, as indicated in COSMIN guidelines. Only two studies [18,50] were rated as doubtful, since they did not indicate alpha values for all of the IMR-S factors mentioned.
The client version of the IMR-S was analyzed in 18 studies. Of these, 11 studies (61.1%) reported internal consistency values greater than 0.70, indicating satisfactory internal consistency of the scores [22,24,59]. However, one study [40] reported an alpha value below 0.50, suggesting inadequate internal consistency [22,24]. The clinician version of the IMR-S was analyzed in nine studies, with eight (88.9%) reporting internal consistency values greater than 0.70. The other study [18] reported an alpha value of 0.69, slightly below the recommended threshold for satisfactory internal consistency [22].
The analysis of internal consistency by factors was reported in five studies. The coping, recovery, and symptoms factor (F1) yielded the highest values for both versions of the scale; the lowest values corresponded to the effective use of medication and substance abuse factor (F3), with only one study reporting values above 0.70 for the client version of the IMR-S [15].
Overall, therefore, the data for internal consistency suggest that the scale is consistent and useful for clinical application. It is important to note, however, that when each subscale is examined separately, some studies report lower internal consistency values. Table 3 displays the minimum and maximum internal consistency values reported for the entire scale and for each factor of the two versions of the IMR-S.

3.2.4. Reliability

Reliability, defined as the proportion of the total variance in measurement that can be attributed to true differences between individuals, is usually evaluated through repeated measurements within a defined period, during which there has been no change in the individual’s condition. Reliability was examined in only four studies (8.7%) using repeated measures. Three studies calculated Pearson’s correlation coefficient, with values ranging from 0.64 to 0.88, while the other calculated the intraclass correlation coefficient, whose value was 0.71. Each of these studies was rated as methodologically adequate. However, the quality of their evidence was graded as moderate due to the small sample sizes (fewer than 100 participants in each case). The measurement properties were rated as indeterminate (?) in this domain, because relevant information such as weighted Kappa was not reported.

3.2.5. Measurement Error

Measurement error, which refers to systematic and random error in an individual’s score (i.e., it is not attributable to true changes in the construct measured), was only analyzed in one study (2.2%), which calculated values for the standard error of measurement (SEM) and minimal important change (MIC) [30]. This study had adequate methodological quality, and the measurement properties were rated as sufficient (+), although the small sample size (n = 60) may have influenced the MIC value and its interpretability. The sample of this study was formed by 60 people from the Netherlands, diagnosed with psychotic disorder, mood anxiety disorders or other conditions, and varied in the level of daily support needed. The quality of evidence was rated as low, as only one study reported information about this psychometric characteristic, and the sample size was smaller than 100.

3.2.6. Hypothesis Testing

Hypothesis testing, which concerns the degree to which scale scores align with the predicted hypotheses, provides information about convergent validity. This property was analyzed in 14 papers (30.4%). Some of these studies had a doubtful methodological quality, as important characteristics of the subgroups were not adequately described. Nonetheless, the measurement properties for hypothesis testing received a positive rating (+), because most of these studies reported results consistent with the hypotheses. Specifically, higher scores on the IMR-S correlated with lower scores on psychopathological symptom scales. Additionally, an increase in IMR-S scores was associated with improvement on scales measuring hope, social support, coping strategies, empowerment, symptom management, and control of life [21,44,45,47]. These findings further support the convergent validity of IMR-S scores for measuring recovery and their alignment with anticipated hypotheses. The samples of these studies were primarily composed of individuals with schizophrenia, bipolar disorder, anxiety, or major depression. The participants were mainly outpatients living independently. The quality of evidence was, however, moderate, due to the doubtful rating awarded to some studies [10,48].

3.2.7. Responsiveness

Responsiveness, which refers to the ability of scale scores to detect changes in the construct over time, was the most widely analyzed property, in a total of 31 studies (67.4%). However, these studies primarily focused on assessing changes in recovery after implementing an intervention program. That is to say, the IMR-S was used to evaluate mean changes in participants, but the focus was not specifically on the ability of the scale to detect change. Data showed that 77.4% of studies detected a positive change effect in recovery, 19.4% did not detect any change, and 3.2% detected a negative change effect. A positive change effect suggests that IMR intervention produces improvements in the perception of the recovery process. Regarding methodological quality, 20 studies were rated as inadequate due to the interventions being poorly described and a lack of information about events occurring during the intervention period. In most studies, the reported results for post-treatment change were in accordance with the hypotheses, and consequently the quality of this psychometric property was rated as (+). The samples in these studies primary comprised individuals diagnosed with schizophrenia, bipolar disorder, anxiety, major depression, or personality disorder. Most participants were outpatients living independently; however, we identified three studies involving inpatient participants [6,16,52]. However, the quality of evidence was low, due to the inadequate rating awarded to some studies.
Table 4 summarizes quality levels for each measurement property.

4. Discussion

The principal aim of this systematic review was to assess the psychometric properties of the IMR-S so as to determine the reliability and suitability of its scores for evaluating recovery in patients with SMD. A broad and accurate assessment of this scale has not previously been conducted using the COSMIN Risk of Bias checklist [22], a methodology that allows the psychometric characteristics of a scale to be examined in a systematic and orderly way. COSMIN provides information about content, structural, transcultural, criterion, and convergent validity, and also about internal consistency, reliability, and responsiveness.
Over the years, the IMR-S has been frequently used alongside various recovery scales. Shanks et al. (2013) [61] conducted a systematic review of 12 different recovery measures available at that time, but they did not use the COSMIN methodology. The present review, therefore, adds to the literature by presenting a complete set of psychometric information for the IMR-S in a structured way.
A total of 46 studies, published between January 2004 and May 2023, were selected for analysis. Given that the concept of recovery focuses on the personal perception of the individual with a mental health problem [1], it is worth noting that 93% of these studies applied the client version of the scale, either independently or in combination with the clinician scale. For many years, people’s own perception of their recovery process was not taken into account when making decisions about treatment. In this respect, using a specific scale to capture their perspective is a step forward, insofar as it enhances their active participation in the recovery process. Furthermore, it aligns both with the principles outlined in the Convention on the Rights of Persons with Disabilities (CRPD, United Nations, 2006) [62] and with evolving mental health strategies adopted by numerous countries in recent years [63].
The methodological quality of the studies reviewed is insufficient in some COSMIN domains (boxes), such as content and structural validity, error measurement, and reliability. For these measures, few studies (<5) provide information on how they have been conducted. Content validity was analyzed in only one study, in which information on the client version of the scale was obtained from clinicians. Furthermore, the clinicians who assessed the scale were nurses, who usually apply intervention programs of a psycho-educational nature. This means that knowledge of recovery processes from other professional perspectives is still limited. Additionally, because client perceptions were not considered, more studies are needed to provide further evidence of content validity.
Structural validity was analyzed in three studies [27,45,50], each presenting a three-factor structure. Although these three studies agree on the overall structure of the IMR-S in terms of the number of factors, they differ regarding which items belong to each of the three factors. The different approaches to analyze the structural validity (Exploratory Factor Analysis [45], Confirmatory Factor Analysis [27], and Rasch measurement model [53]) might explain the heterogeneous findings in dimensionality.
Measurement error was analyzed in one study, which calculated the MIC value to evaluate the client perspective on change in scores. This information enables changes to be made to a client’s management through dialog between professionals and patients, as proposed by the recovery model. However, more studies are needed to bolster the results found in this research. Reliability was analyzed in four studies with adequate methodological quality. However, assessing reliability requires participants who are stable in the construct to be measured, and because recovery is a changing process, this criterion is difficult to fulfill. Therefore, assessing the reliability of the IMR-S will require short time intervals and comparison between groups of people at a similar stage of recovery. Information from the clinician version of the IMR-S can serve as a reference here and complement the perceptions of clients themselves.
Internal consistency was assessed in a significant number of studies, which showed satisfactory methodological quality. The client version of the IMR-S was the most commonly analyzed, and in most cases, reported values indicated consistency of scale scores. The clinician version presents the best internal consistency values. According to Bland criteria [64], the IMR-S achieves acceptable values of internal consistency when its total score is considered, being a satisfactory value for group comparison. However, the internal consistency values in studies that analyze the three-factor structure [15,18,27,45,47,50,53] and reported alpha values for each subscale were only moderate. Therefore, a more detailed analysis of individual scale items and of the factors or dimensions identified in previous studies [27,45] should be conducted. In this regard, it is worth noting that the use of medication or issues related to substance abuse are factors that have been identified as having a questionable impact on the perception of recovery [27], and items 13, 14, and 15 of the IMR-S are associated with these aspects. It is important to bear in mind here that historically, mental health problems have often been wrongly associated with drug use, leading to social stigma. The notion that drug use is closely linked to mental health issues may deter individuals from seeking the necessary help and support for their mental health issues [65,66].
Hypothesis testing was widely assessed in the studies reviewed, revealing significant correlations between the IMR-S and related constructs: hope, coping strategies, empowerment, symptom management, and control of life. All of these aspects are closely related to the CHIME recovery model [67], which includes factors that favor recovery: bond and supportive relationships, hope, personal identity, healthy coping strategies, and empowerment. Accordingly, IMR-S scores are shown to be related to essential concepts for describing an individual’s recovery.
The most extensively evaluated psychometric property was responsiveness. However, as previously mentioned, these studies did not specifically focus on the responsiveness of the IMR-S per se, but rather applied the scale to assess recovery after a psychoeducational intervention of some kind. This property (responsiveness), therefore, needs to be studied and analyzed in depth through specific studies, not least because the studies reviewed here were of doubtful or insufficient quality. Although the IMR-S was developed to evaluate recovery following the implementation of intervention programs [7], the reviewed studies do not provide sufficient information about the interventions carried out, and this hampers comprehensive analysis.
Although certain psychometric properties, such as content validity, require further investigation [12,40], the scale’s utility is evident due to its concise number of items, straightforward scoring method, incorporation of recovery model topics, and its capacity to capture the perspectives of both key stakeholders in the process (i.e., clients and clinicians). Incorporating the perspectives of clinicians and clients can facilitate interventions more closely aligned with clients’ needs. This enhances the understanding of the recovery process, leading to greater personal well-being and self-esteem improvements among clients. Meanwhile, clinicians may shift their recovery perspective by moving their focus from symptom reduction to emphasizing the developmental areas outlined in the CHIME model [3]. This makes the scale a valuable tool for assessing recovery in a global and practical way [11,12,37].
The eight psychometric studies included in this review exhibit heterogeneity in terms of the sociodemographic characteristics of the participants. Therefore, this diversity may limit the generalizability of the results concerning the psychometric properties of the IMR-S across different populations and recovery pathways.
Finally, a number of information gaps have been detected in this review. First, we identified no studies reporting information on criterion validity. Second, although different cultural adaptations have been identified, these studies do not provide detailed information about the adaptation procedure carried out or the psychometric properties of the adapted versions, nor do they provide evidence about cross-cultural metric equivalence [6,12,18,20,33,35,37,44].
A limitation of this systematic review is its exclusive inclusion of studies published in English. As a result, it may have overlooked certain psychometric properties of the IMR-S assessed in studies published in other languages.

5. Conclusions

The IMR-S is a tool for measuring recovery in mental health from the client and clinician perspectives, and it shows a strong relationship with factors that favor the recovery of people with SMD, such as hope, control of life, identity, symptom management, and coping. The results of this systematic review suggest that the IMR-S is a valid and reliable (in terms of internal consistency) instrument that is suitable for use in clinical practice.
The use of scales of this kind can help to guide clinical practice by facilitating dialog between clients and clinicians and by empowering clients with SMD in decision making.
However, caution is advised when it comes to interventions focused on medication use and substance abuse. Future research should assess the relevance of evaluating substance use and medication intake, suggesting possible modifications of the IMR-S items related to these factors, as they are less relevant within the framework of the person-centered recovery model. Additionally, studies should explore the divergence and convergence between clinician and client perceptions of recovery by analyzing differences and similarities in recovery scores. This analysis could provide insights into the shared or divergent understandings of the recovery process. Furthermore, future investigations should examine how insights gained from the scale can influence clinical decision-making and treatment planning, potentially improving recovery outcomes.
Further research is required to develop a fuller understanding of the scale’s psychometric properties, especially as regards those aspects about which less is currently known, such as criterion validity, content validity, and measurement error.

Supplementary Materials

The following supporting information can be downloaded at https://www.mdpi.com/article/10.3390/bs14040340/s1, Table S1. Methodological quality of assessments of the measurement properties of the IMR-S.

Funding

This study was funded by the Ministry of Science and Innovation of Spain—MCIN/AEI/10.13039/501100011033 [grant PID2019-109887GB-I00], by Grant for the Requalification of the Spanish University System, Margarita Salas Grant, Next Generation EU, and supported by the Agency for the Management of University and Research Grants of the Government of Catalonia [grant 2021SGR01071].

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Not applicable.

Conflicts of Interest

The authors declare no conflicts of interest.

References

  1. Maone, A.; D’Avanzo, B. Recuperación: Nuevos Paradigmas de Salud Mental; Psimática: Madrid, Spain, 2017. [Google Scholar]
  2. Deegan, P.E. Recovery: The lived experience of rehabilitation. Psychosoc. Rehabil. J. 1988, 11, 11–19. [Google Scholar]
  3. Roosenschoon, B.; van Weeghel, J.; Deen, M.L.; van Esveld, E.W.; Kamperman, A.M.; Mulder, C.L. Effects of Illness Management and Recovery: A Multicentric Randomized Controlled Trial. Front. Psychiatry 2021, 12, 723435. [Google Scholar] [CrossRef]
  4. Bendel-Rozow, T. Recovery-oriented dance movement therapy group with adults coping with severe mental health conditions: A controlled trial. Arts Psychother. 2021, 75, 101830. [Google Scholar] [CrossRef]
  5. Mueser, K.; Gingerich, S.; Salyers, M.; McGuire, A.; Reyes, R.; Cunningham, H. Illness Management and Recovery Scales. Psyctests Dataset 2005. [Google Scholar] [CrossRef]
  6. Polat, S.; Kutlu, Y. The effectiveness of illness management and recovery program in patients with schizophrenia. Arch. Psychiatr. Nurs. 2021, 35, 162–167. [Google Scholar] [CrossRef]
  7. Mueser, K. The Illness Management and Recovery Program: Rationale, Development, and Preliminary Findings. Schizophr. Bull. 2006, 32 (Suppl. S1), S32–S43. [Google Scholar] [CrossRef]
  8. Davidson, L.; Rowe, M.; DiLeo, P.; Bellamy, C.; Delphin-Rittmon, M. Recovery-Oriented Systems of Care: A Perspective on the Past, Present, and Future. Alcohol Res. 2021, 41, 9. [Google Scholar] [CrossRef]
  9. Mueser, K.T.; Gingerich, S. Illness Management and Recovery (IMR) Scales. In Measuring the Promise: A Compendium of Recovery Measures; Campbell-Orde, T., Chamberlin, J., Carpenter, J., Leff, H.S., Eds.; Human Services Research Institute, Evaluation Center: Cambridge, MA, USA, 2005; Volume 2. [Google Scholar]
  10. MacMillan, G.; St Clair-Thompson, H. The relationship between mental toughness and subjective mental illness recovery. New Ideas Psychol. 2021, 63, 100881. [Google Scholar] [CrossRef]
  11. Penas, P.; Iraurgi, I.; Moreno, M.C.; Uriarte, J. How is evaluated mental health recovery? A systematic review. Actas Españolas Psiquiatr. 2019, 47, 23–32. [Google Scholar]
  12. Sklar, M.; Groessl, E.; O′Connell, M.; Davidson, L.; Aarons, G. Instruments for measuring mental health recovery: A systematic review. Clin. Psychol. Rev. 2013, 33, 1082–1095. [Google Scholar] [CrossRef]
  13. Corrigan, P.W.; Giffort, D.; Rashid, F.; Leary, M.; Okele, I. Recovery as a psychological construct. Community Ment. Health J. 1999, 35, 231–239. [Google Scholar] [CrossRef]
  14. Young, S.L.; Bullock, W.A. The Mental Health Recovery Measure; University of Toledo, Department of Psychology: Toledo, OH, USA, 2003. [Google Scholar]
  15. Hasson-Ohayon, I.; Roe, D.; Kravetz, S. A Randomized Controlled Trial of the Effectiveness of the Illness Management and Recovery Program. Psychiatr. Serv. 2007, 58, 1461–1466. [Google Scholar] [CrossRef]
  16. Levitt, A.J.; Mueser, K.T.; DeGenova, J.; Lorenzo, J.; Bradford-Watt, D.; Barbosa, A.; Karlin, M.; Chernick, M. Randomized Controlled Trial of Illness Management and Recovery in Multiple-Unit Supportive Housing. Psychiatr. Serv. 2009, 60, 1629–1636. [Google Scholar] [CrossRef]
  17. Salyers, M.; McGuire, A.; Kukla, M.; Fukui, S.; Lysaker, P.; Mueser, K. A Randomized Controlled Trial of Illness Management and Recovery with an Active Control Group. Psychiatr. Serv. 2014, 65, 1005–1011. [Google Scholar] [CrossRef]
  18. Dalum, H.; Waldemar, A.; Korsbek, L.; Hjorthøj, C.; Mikkelsen, J.; Thomsen, K.; Kistrup, K.; Olander, M.; Lindschou, J.; Nordentoft, M.; et al. Participants’ and staffs’ evaluation of the Illness Management and Recovery program: A randomized clinical trial. J. Ment. Health 2016, 27, 30–37. [Google Scholar] [CrossRef]
  19. Roosenschoon, B.; Mulder, C.; Deen, M.; van Weeghel, J. Effectiveness of illness management and recovery (IMR) in the Netherlands: A randomised clinical trial. BMC Psychiatry 2016, 16, 73. [Google Scholar] [CrossRef]
  20. Egeland, K.M.; Ruud, T.; Ogden, T.; Färdig, R.; Lindstrøm, J.C.; Heiervang, K.S. How to implement Illness Management and Recovery (IMR) in mental health service settings: Evaluation of the implementation strategy. Int. J. Ment. Health Syst. 2017, 11, 13. [Google Scholar] [CrossRef]
  21. Barbic, S.; Kidd, S.; Durisko, Z.; Yachouh, R.; Rathitharan, G.; McKenzie, K. What Are the Personal Recovery Needs of Community-Dwelling Individuals with Mental Illness? Preliminary Findings from the Canadian Personal Recovery Outcome Measurement (C-PROM) Study. Can. J. Community Ment. Health 2018, 37, 29–47. [Google Scholar] [CrossRef]
  22. Mokkink, L.; de Vet, H.; Prinsen, C.; Patrick, D.; Alonso, J.; Bouter, L.; Terwee, C. COSMIN Risk of Bias checklist for systematic reviews of Patient-Reported Outcome Measures. Qual. Life Res. 2018, 27, 1171–1179. [Google Scholar] [CrossRef]
  23. Terwee, C.B.; Prinsen, C.A.C.; Chiarotto, A.; Westerman, M.J.; Patrick, D.L.; Alonso, J.; Bputer, L.M.; de Vet, H.C.W.; Mokkink, L.B. COSMIN methodology for evaluating the content validity of patient-reported outcome measures: A Delphi study. Qual. Life Res. 2018, 27, 1159–1170. [Google Scholar]
  24. Prinsen, C.; Mokkink, L.B.; Bouter, L.M.; Alonso, J.; Patrick, D.L.; De Vet, H.C. COSMIN guidelines for systematic reviews of Patient-Reporterd Outcomes Measures. Qual. Life Res. 2018, 27, 1147–1157. [Google Scholar]
  25. PRISMA Transparent Reporting of Systematic Reviews and Meta-Analyses. PRISMA 2020 Checklist. Available online: http://www.prisma-statement.org/ (accessed on 23 January 2024).
  26. Fortuna, K.; DiMilia, P.; Lohman, M.; Bruce, M.; Zubritsky, C.; Halaby, M.; Walker, R.; Brooks, J.; Bartels, S. Feasibility, Acceptability, and Preliminary Effectiveness of a Peer-Delivered and Technology Supported Self-Management Intervention for Older Adults with Serious Mental Illness. Psychiatr. Q. 2018, 89, 293–305. [Google Scholar] [CrossRef]
  27. Sklar, M.; Sarkin, A.; Gilmer, T.; Groessl, E. The psychometric properties of the Illness Management and Recovery scale in a large American public mental health system. Psychiatry Res. 2012, 199, 220–227. [Google Scholar] [CrossRef]
  28. Bartels, S.; Pratt, S.; Mueser, K.; Naslund, J.; Wolfe, R.; Santos, M.; Xie, H.; Riera, E. Integrated IMR for Psychiatric and General Medical Illness for Adults Aged 50 or Older with Serious Mental Illness. Psychiatr. Serv. 2014, 65, 330–337. [Google Scholar] [CrossRef]
  29. Beentjes, T.A.A.; Goossens, P.J.J.; Vermeulen, H.; Teerenstra, S.; Nijhuis-Van Der Sanden, M.W.G.; Van Gaal, B.G.I. E-IMR: E-health added to face-to-face delivery of Illness Management & Recovery programme for people with severe mental illness, an exploratory clustered randomized controlled trial. BMC Health Serv. Res. 2018, 18, 962. [Google Scholar] [CrossRef]
  30. Beentjes, T.A.A.; Teerenstra, S.; Vermeulen, H.; Goossens, P.J.J.; der Sanden, M.W.G.N.-V.; van Gaal, B.G.I. Identifying the minimal important difference in patient-reported outcome measures in the field of people with severe mental illness: A pre–post-analysis of the Illness Management and Recovery Programme. Qual. Life Res. 2021, 30, 1723–1733. [Google Scholar] [CrossRef]
  31. Ben-Zeev, D.; Buck, B.; Meller, S.; Hudenko, W.; Hallgren, K. Augmenting Evidence-Based Care with a Texting Mobile Interventionist: A Pilot Randomized Controlled Trial. Psychiatr. Serv. 2020, 71, 1218–1224. [Google Scholar] [CrossRef]
  32. Buck, B.; Nguyen, J.; Porter, S.; Ben-Zeev, D.; Reger, G.M. FOCUS mHealth Intervention for Veterans with Serious Mental Illness in an Outpatient Department of Veterans Affairs Setting: Feasibility, Acceptability, and Usability Study. Psychiatr. Q. 2022, 28, e26049. [Google Scholar] [CrossRef]
  33. Casey, R.; Wiener, J.C.; Krupa, T.; Lysaght, R.; Le Ber, M.J.; Ruhara, R.; Price, E.; Pervez, R.; Kidd, S.; Mutiso, V.; et al. Evaluating the feasibility and potential impacts of a recovery-oriented psychosocial rehabilitation toolkit in a health care setting in Kenya: A mixed-methods study. Psychiatr. Rehabil. J. 2023, 46, 55–64. [Google Scholar] [CrossRef]
  34. Chinman, M.; Oberman, R.S.; Hanusa, B.H.; Cohen, A.N.; Salyers, M.P.; Twamley, E.W.; Young, A.S. A cluster randomized trial of adding peer specialists to intensive case management teams in the Veterans Health Administration. J. Behav. Health Serv. Res. 2015, 42, 109–121. [Google Scholar] [CrossRef]
  35. Daass-Iraqi, S.; Mashiach-Eizenberg, M.; Garber-Epstein, P.; Roe, D. Impact of a culturally adapted version of illness management and recovery on Israeli Arabs with serious mental illness. Psychiatr. Serv. 2020, 71, 951–954. [Google Scholar] [CrossRef]
  36. Färdig, R.; Lewander, T.; Fredriksson, A.; Melin, L. Evaluation of the Illness Management and Recovery Scale in schizophrenia and schizoaffective disorder. Schizophr. Res. 2011, 132, 157–164. [Google Scholar] [CrossRef]
  37. Färdig, R.; Lewander, T.; Melin, L.; Folke, F.; Fredriksson, A. A randomized controlled trial of the illness management and recovery program for persons with schizophrenia. Psychiatr. Serv. 2011, 62, 606–612. [Google Scholar] [CrossRef]
  38. Färdig, R.; Fredriksson, A.; Lewander, T.; Melin, L.; Mueser, K. Neurocognitive functioning and outcome of the Illness Management and Recovery Program for clients with schizophrenia and schizoaffective disorder. Nord. J. Psychiatry 2016, 70, 430–435. [Google Scholar] [CrossRef]
  39. Firmin, R.L.; Luther, L.; Lysaker, P.H.; Salyers, M.P. Self-initiated helping behaviors and recovery in severe mental illness: Implications for work, volunteerism, and peer support. Psychiatr. Rehabil. J. 2015, 38, 336–341. [Google Scholar] [CrossRef]
  40. Fortuna, L.R.; Falgas-Bague, I.; Ramos, Z.; Porche, M.V.; Alegría, M. Development of a cognitive behavioral therapy with integrated mindfulness for Latinx immigrants with co-occurring disorders: Analysis of intermediary outcomes. Psychol. Trauma 2020, 12, 825–835. [Google Scholar] [CrossRef]
  41. Fortuna, K.L.; Myers, A.L.; Ferron, J.; Kadakia, A.; Bianco, C.; Bruce, M.L.; Bartels, S.J. Assessing a digital peer support self-management intervention for adults with serious mental illness: Feasibility, acceptability, and preliminary effectiveness. J. Ment. Health 2022, 31, 833–841. [Google Scholar] [CrossRef]
  42. Garber-Epstein, P.; Zisman-Ilani, Y.; Levine, S.; Roe, D. Comparative impact of professional mental health background on ratings of consumer outcome and fidelity in an illness management and recovery program. Psychiatr. Rehabil. J. 2013, 36, 236–242. [Google Scholar] [CrossRef]
  43. Gilmer, T.; Henwood, B.; Goode, M.; Sarkin, A.; Innes-Gomberg, D. Implementation of Integrated Health Homes and Health Outcomes for Persons with Serious Mental Illness in Los Angeles County. Psychiatr. Serv. 2016, 67, 1062–1067. [Google Scholar] [CrossRef]
  44. Goossens, P.; Beentjes, T.; Knol, S.; Salyers, M.; de Vries, S. Investigating the reliability and validity of the Dutch versions of the illness management and recovery scales among clients with mental disorders. J. Ment. Health 2017, 26, 489–495. [Google Scholar] [CrossRef]
  45. Hasson-Ohayon, I.; Roe, D.; Kravetz, S. The psychometric properties of the illness management and recovery scale: Client and clinician versions. Psychiatry Res. 2008, 160, 228–235. [Google Scholar] [CrossRef]
  46. Jensen, S.; Dalum, H.; Korsbek, L.; Hjorthøj, C.; Mikkelsen, J.; Thomsen, K.; Kistrup, K.; Olander, M.; Lidnschou, J.; Mueser, K.; et al. Illness management and recovery: One-year follow-up of a randomized controlled trial in Danish community mental health centers: Long-term effects on clinical and personal recovery. BMC Psychiatry 2019, 19, 65. [Google Scholar] [CrossRef]
  47. Kukla, M.; Salyers, M.; Lysaker, P. Levels of Patient Activation Among Adults with Schizophrenia. J. Nerv. Ment. Dis. 2013, 201, 339–344. [Google Scholar] [CrossRef]
  48. Matthias, M.; Fukui, S.; Salyers, M. What Factors are Associated with Consumer Initiation of Shared Decision Making in Mental Health Visits? Adm. Policy Ment. Health Ment. Health Serv. Res. 2017, 44, 133–140. [Google Scholar] [CrossRef]
  49. Matthias, M.; Fukui, S.; Kukla, M.; Eliacin, J.; Bonfils, K.; Firmin, R. Consumer and Relationship Factors Associated with Shared Decision Making in Mental Health Consultations. Psychiatr. Serv. 2014, 65, 1488–1491. [Google Scholar] [CrossRef]
  50. McGuire, A.; Kean, J.; Bonfils, K.; Presnell, J.; Salyers, M. Rasch analysis of the illness management and recovery scale-clinician version. J. Eval. Clin. Pract. 2014, 20, 383–389. [Google Scholar] [CrossRef]
  51. McGuire, A.; White, D.; Bartholomew, T.; Flanagan, M.; McGrew, J.; Rollins, A.; Mueser, K.; Salyers, M. The Relationship Between Provider Competence, Content Exposure, and Consumer Outcomes in Illness Management and Recovery Programs. Adm. Policy Ment. Health Serv. Res. 2017, 44, 81–91. [Google Scholar] [CrossRef]
  52. Miyajima, M.; Hatakeyama, Y.; Ichiki, K.; Matsuzaki, Y.; Niyama, H.; Omiya, H. A pilot study of Illness Management and Recovery in patients acutely admitted to a psychiatric ward. J. Psychosoc. Rehabil. Ment. Health 2023, 10, 35–44. [Google Scholar] [CrossRef]
  53. Polat, S.; Kutlu, Y.; Gültekin, B. Psychometric properties of the Turkish version of Illness Management and Recovery Scale-Patient form. Perspect. Psychiatr. Care 2020, 57, 279–286. [Google Scholar] [CrossRef]
  54. Pratt, C.W.; Lu, W.; Swarbrick, M.; Murphy, A. Selective provision of illness management and recovery modules. Am. J. Psychiatr. Rehabil. 2011, 14, 245–258. [Google Scholar] [CrossRef]
  55. Pratt, S.I.; Naslund, J.A.; Wolfe, R.S.; Santos, M.; Bartels, S.J. Automated telehealth for managing psychiatric instability in people with serious mental illness. J. Ment. Health 2015, 24, 261–265. [Google Scholar] [CrossRef]
  56. Salyers, M.; Godfrey, J.; Mueser, K.; Labriola, S. Measuring Illness Management Outcomes: A Psychometric Study of Clinician and Consumer Rating Scales for Illness Self-Management and Recovery. Community Ment. Health J. 2007, 43, 459–480. [Google Scholar] [CrossRef]
  57. Salyers, M.; Matthias, M.; Spann, C.; Lydick, J.; Rollins, A.; Frankel, R. The Role of Patient Activation in Psychiatric Visits. Psychiatr. Serv. 2009, 60, 1535–1539. [Google Scholar] [CrossRef]
  58. Salyers, M.P.; McGuire, A.B.; Rollins, A.L.; Bond, G.R.; Mueser, K.; Macy, V.R. Integrating assertive community treatment and illness management and recovery for consumers with severe mental illness. Community Ment. Health J. 2010, 46, 319–329. [Google Scholar] [CrossRef]
  59. Tan, C.; Ishak, R.; Lim, T.; Marimuthusamy, P.; Kaurss, K.; Leong, J. Illness management and recovery program for mental health problems: Reducing symptoms and increasing social functioning. J. Clin. Nurs. 2017, 26, 3471–3485. [Google Scholar] [CrossRef]
  60. White, D.; McGuire, A.; Luther, L.; Anderson, A.; Phalen, P.; McGrew, J. Consumer factors predicting level of treatment response to illness management and recovery. Psychiatr. Rehabil. J. 2017, 40, 344–353. [Google Scholar] [CrossRef]
  61. Shanks, V.; Williams, J.; Leamy, M.; Bird, V.; Le Boutillier, C.; Slade, M. Measures of Personal Recovery: A Systematic Review. Psychiatr. Serv. 2013, 64, 974–980. [Google Scholar] [CrossRef]
  62. UN General Assembly, Convention on the Rights of Persons with Disabilities. Available online: https://www.refworld.org/docid/45f973632.html (accessed on 16 December 2023).
  63. Sampietro, H.M.; Rojo, J.E.; Gómez-Benito, J. Recovery-oriented care in public mental health policies in Spain: Opportunities and barriers. Clínica Salud 2023, 34, 35–40. [Google Scholar] [CrossRef]
  64. Bland, J.M.; Altman, D.G. Cronbach’s Alpha. Br. Med. J. 1997, 314, 572. [Google Scholar] [CrossRef]
  65. National Academies of Sciences, Engineering, and Medicine. Ending Discrimination Against People with Mental and Substance Use Disorders: The Evidence for Stigma Change; The National Academies Press: Washington, DC, USA, 2016. [Google Scholar] [CrossRef]
  66. Amini, F.; Mousavi, S.M.; Yazdani, J. Compare social support in patients with schizophrenia or methamphetamine dependency with healthy individuals. Ment. Health Soc. Incl. 2023; in press. [Google Scholar] [CrossRef]
  67. Leamy, M.; Bird, V.J.; Le Boutillier, C.; Williams, J.; Slade, M. A conceptual framework for personal recovery in mental health: Systematic review and narrative synthesis. Br. J. Psychiatry 2011, 199, 445–452. [Google Scholar]
Behavsci 14 00340 g001
Figure 1. PRISMA flow chart.
Figure 1. PRISMA flow chart.
Behavsci 14 00340 g001
Table 1. COSMIN Risk of Bias checklist summary [22].
Table 1. COSMIN Risk of Bias checklist summary [22].
Content Validity
Box 1Outcome measure tool development
Box 2Content validity
Internal Structure
Box 3Structural validity
Box 4Internal consistency
Box 5Cross-cultural validity/measurement invariance
Remaining Measurement Properties
Box 6Reliability
Box 7Measurement error
Box 8Criterion validity
Box 9Hypothesis testing for construct validity
Box 10Responsiveness
Table 2. General characteristics of articles included in the study.
Table 2. General characteristics of articles included in the study.
AuthorsSample SizeFemales
n (%)		Mean Sample AgeIMR-S
Version AppliedNo. of Items
Barbic et al., 2018 b [21]228112 (49.1%)45.8Client13
Bartels et al., 2014 b [28]7139 (43.7%)60.3Both15
Beentjes et al., 2018 b [29]6036 (60.0%)43.8Client15
Beentjes et al., 2021 b [30]6036 (60.0%)45Client15
Bendel-Rozow, 2021 b [4]5213 (25.0%)48Both15
Ben-Zeev et al., 2020 b [31]4922 (44.9%)44.8Client15
Buck et al., 2022 b [32]175 (29.4%)55.1Client15
Casey et al., 2023 b [33]237 (30.4%)35Client15
Chinman et al., 2015 b [34]23828 (11.8%)53.2Client15
Daas-Iraqi et al., 2020 b [35]150NS40.9Both15
Dalum et al., 2016 b [18]19889 (44.9%)43Both15
Egeland et al., 2017 b [20]4416 (36.4%)40.7Both15
Färdig et al., 2011 b [36]10241 (38.3%)43Both15
Färdig et al., 2011 b [37]4119 (46.3%)40.4Both15
Färdig et al., 2016 b [38]5323 (43.4%)41.5Both15
Firmin et al., 2015 b [39]4611 (23.9%)48.5Client15
Fortuna et al., 2018 b [26]87 (87.5%)68.8Client15
Fortuna et al., 2020 b [40]341NSNSClient15
Fortuna et al., 2022 b [41]2115 (71.4%)39.9Client15
Garber-Epstein et al., 2013 b [42]252112 (44.4%)43.5Client13
Gilmer et al., 2016 b [43]1279NSNSClinician15
Goosens et al., 2017 a [44]11153 (47.7%)Between 18 →65Both15
Hasson-Ohayon et al., 2007 a [15]21073 (34.8%)34.7Both15
Hasson-Ohayon et al., 2008 a [45]21073 (34.8%)34.6Both15
Jensen et al., 2019 b [46]19889 (44.9%)43Both15
Kukla et al., 2013 b [47]11925 (21.0%)47.6Both15
Levitt et al., 2009 b [16]10438 (36.5%)53.9Both15
MacMillan et al., 2021 a [10]7758 (75.3%)Between 18 → 50Client14
Matthias et al., 2017 b [48]639 (14.3%)53Client15
Matthias et al., 2014 b [49]639 (14.3%)53Client15
McGuire et al., 2014 a [50]697331 (47.5%)NSClinician15
McGuire et al., 2017 b [51]23697 (41.1%)45.2Client15
Miyajima et al., 2023 b [52]107 (70.0%)Median 50.5Both15
Polat &Kutlu 2021 b [6]5026 (52%)39.1Client15
Polat et al., 2020 a [53]7530 (40.0%)41.6Client15
Pratt et al., 2011 b [54]4429 (65.9%)46.4Client15
Pratt et al., 2015 b [55]3827 (71.0%)46.4Client15
Roosenchoon et al., 2016 b [19]6133 (54.1%)42.4Both15
Roosenchoon et al., 2021 b [3]18788 (47.1%)44.2Both15
Salyers et al., 2007 a [56]5920 (33.9%)43.5Both15
Salyers et al., 2009 b [57]4021 (52.5%)43.5Client15
Salyers et al., 2010 b [58]324148 (45.7%)42.3Both15
Salyers et al., 2014 b [17]11824 (20.3%)47.7Client15
Sklar et al., 2012 a [27]106595283 (49.6%)43.2Clinician15
Tan et al., 2017 b [59]5031 (62.0%)44.2Both15
White et al., 2017 b [60]23697 (41.1%)45.2Client15
a: psychometric study; b: other type of study (clinical intervention, case–control, exploratory, etc.). NS = not specified.
Table 3. Internal consistency values.
Table 3. Internal consistency values.
IMR-S Client VersionIMR-S Clinician Version
Total ScaleMax0.85 [59]0.85 [59]
Min0.49 [40]0.69 [18]
F1: Coping, recovery, and symptomsMax0.73 [15]0.83 [15]
Min0.69 [44,53]0.67 [50]
F2: Management and personal goalsMax0.69 [53]0.83 [27]
Min0.50 [15]0.61 [44]
F3: Effective use of medication and substance abuseMax0.74 [15]0.69 [27]
Min0.35 [53]0.28 [44]
F = Factor.
Table 4. Summary of measurement properties of the IMR-S.
Table 4. Summary of measurement properties of the IMR-S.
Measurement PropertyCOSMIN Risk of Bias Checklist RatingsQuality of Evidence
Very GoodAdequateDoubtfulInadequate
Content validity
(n = 1)		0010Low
Structural validity
(n = 3)		2100High (?)
Internal consistency
(n = 20)		18020Moderate (−)
Reliability
(n = 4)		0400Moderate (?)
Measurement error
(n = 1)		0100Low (+)
Hypothesis testing
(n = 14)		8420Moderate (+)
Responsiveness
(n = 31)		001120Low (+)
n = number of studies assessing the measurement property.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Martín-Ordiales, N.; Hidalgo, M.D.; Martín-Chaparro, M.P.; Ballester-Plané, J.; Barrios, M. Assessing the Psychometric Properties of the Illness Management and Recovery Scale: A Systematic Review Using the Consensus-Based Standards for the Selection of Health Measurement Instruments (COSMIN). Behav. Sci. 2024, 14, 340. https://doi.org/10.3390/bs14040340

AMA Style

Martín-Ordiales N, Hidalgo MD, Martín-Chaparro MP, Ballester-Plané J, Barrios M. Assessing the Psychometric Properties of the Illness Management and Recovery Scale: A Systematic Review Using the Consensus-Based Standards for the Selection of Health Measurement Instruments (COSMIN). Behavioral Sciences. 2024; 14(4):340. https://doi.org/10.3390/bs14040340

Chicago/Turabian Style

Martín-Ordiales, Nuria, María Dolores Hidalgo, María Pilar Martín-Chaparro, Júlia Ballester-Plané, and Maite Barrios. 2024. "Assessing the Psychometric Properties of the Illness Management and Recovery Scale: A Systematic Review Using the Consensus-Based Standards for the Selection of Health Measurement Instruments (COSMIN)" Behavioral Sciences 14, no. 4: 340. https://doi.org/10.3390/bs14040340

APA Style

Martín-Ordiales, N., Hidalgo, M. D., Martín-Chaparro, M. P., Ballester-Plané, J., & Barrios, M. (2024). Assessing the Psychometric Properties of the Illness Management and Recovery Scale: A Systematic Review Using the Consensus-Based Standards for the Selection of Health Measurement Instruments (COSMIN). Behavioral Sciences, 14(4), 340. https://doi.org/10.3390/bs14040340

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop