Highlights
What are the main findings?
- A Delphi study identified 26 quality criteria for schizophrenia spectrum disorder (SSD) care.
- Consensus prioritized key areas: early diagnosis, care coordination, and access.
What are the implications of the main findings?
- Professionals and patients highlighted critical barriers in SSD healthcare.
- Results provide a foundation for a quality certification system in SSD care.
Abstract
Background/Objectives: Schizophrenia Spectrum Disorder (SSD) represents a major challenge for healthcare systems due to its chronic nature, comorbid conditions, and high socioeconomic impact. Ensuring high-quality care for patients with SSD requires well-defined quality criteria based on consensus from healthcare professionals, patients, and caregivers. This study aims to identify and prioritize quality criteria for SSD care. Methods: A qualitative research approach was applied, including incorporating two focus groups—one with patients and caregivers (n = 7) and another with healthcare professionals (n = 8)—alongside the Delphi technique. The Delphi panel included 32 participants from psychiatry, primary care, mental health nursing, social work, and patient associations. The first round had an 88.9% response rate, while the second round achieved full participation (100%). The Delphi process was conducted and reported according to recommended guidelines for consensus methods (ACCORD checklist), specifying panel composition, rounds, predefined consensus thresholds, and controlled feedback between rounds. Results: A total of 26 quality criteria were ultimately selected, categorized into 16 identified barriers to effective care. Key priorities included early diagnosis protocols, coordinated multidisciplinary care, and improved access to specialized mental health services. Conclusions: The findings underscore the necessity of integrating patient experience into healthcare evaluation and highlight the potential for implementing a certification system to standardize SSD care across healthcare settings.
1. Introduction
The term Schizophrenia Spectrum Disorder (SSD) encompasses a group of disorders with heterogeneous etiology, characterized by significant variability in clinical manifestations, treatment response, disease progression, and prognosis []. These disorders include symptoms such as hallucinations, delusions, thought disturbances, lack of motivation, cognitive deficiencies, and reduced emotional expression, all of which profoundly impact the lives of affected individuals, their families, and their communities [].
SSD is a chronic condition that requires continuous medical treatment []. Without proper management, individuals are at high risk of recurrent episodes, leading to a significant decline in health, cognitive impairment, well-being, and overall quality of life [,]. Affecting over 26 million people worldwide [], SSD is associated with reduced life expectancy due to comorbid psychiatric disorders—such as depression, anxiety, and substance abuse []—as well as physical health conditions including metabolic syndrome, diabetes, cardiovascular and respiratory diseases, and infectious illnesses [,]. Additionally, SSD places a substantial burden on families and caregivers, contributing to significant socioeconomic costs, including unemployment, reliance on social assistance, and frequent hospitalizations during acute episodes []. Social stigma, which is commonly associated with SSD and other severe mental illnesses, along with reduced perceived social support, further exacerbates the psychosocial challenges faced by patients, negatively affecting their recovery and overall well-being [].
SSD poses a considerable challenge to healthcare and social systems due to the need for continuous complex medical care, including pharmacological and psychosocial approaches [], its functional impact on patients, and the frequent comorbidity with other mental and physical health conditions []. Long-term maintenance treatment and coordinated care have been associated with reduced physical morbidity and mortality in individuals with SSD, stressing the importance of sustained and integrated management approaches [,]. These aspects highlight the importance of ensuring specialized, comprehensive care based on well-defined quality criteria.
In this context, establishing and prioritizing quality criteria for SSD care is essential to improving treatment outcomes and enhancing patients’ quality of life. Identifying these criteria allows for the development of effective, patient-centered interventions that address the complexity of the disorder. Furthermore, optimizing care can help reduce the societal burden of SSD at both the healthcare and socioeconomic levels.
Recent studies have emphasized the need to develop specific quality indicators for mental health services, including schizophrenia care, to move beyond generic performance metrics [,]. These works underline the relevance of designing condition-specific, recovery-oriented, and patient-centered measures, which our study aims to address.
The aim of this study was to identify and reach a consensus on quality criteria for the care of patients with SSD, involving patients, caregivers, and professionals across all levels of healthcare. Through this process, the study aimed to lay the foundation for a quality certification system in SSD care, ensuring that healthcare services meet the highest standards of efficacy and equity, based on a broad and representative consensus. The purpose was to create a health quality model that serves as a reference for evaluating the quality of care provided by health centers to patients suffering from SSD. The consensus process was conducted at the national level in Spain, with the intended audience being mental health professionals, service managers, and policymakers seeking to improve quality standards in schizophrenia care.
2. Materials and Methods
To achieve the proposed objective of this study, qualitative and collaborative research methods were adopted, recognized for their effectiveness in data collection within the healthcare field [,]. Figure 1 illustrates the process of developing the quality criteria and the phases of the study.
Figure 1.
Development and phases of the study.
Specifically, the focus group technique was employed, involving active participation from patients and professionals in the field. To reach a consensus on the identified quality criteria, the Delphi methodology was used, engaging a broader group that included both professionals and patients. As a preliminary step, an extensive literature review was conducted on the study topic, enabling the development of detailed scripts for the focus groups and the design of the initial questionnaire (Questionnaire 0), based on the most recent scientific evidence.
This study was conducted in strict adherence to the ethical principles outlined in the Declaration of Helsinki. The research received approval from the Ethics Committee of the San Juan de Alicante University Hospital on 29 November 2023, under reference number 23/074.
2.1. Literature Review
A comprehensive literature review was conducted to gather and analyze the most recent and relevant scientific evidence related to SSD and the quality criteria in their care. This review aimed to identify quality aspects in current healthcare models for individuals with SSD.
The databases used for this review included Medline (PubMed), ProQuest, and the International Journal of Integrated Care database, ensuring a comprehensive and high-quality selection of relevant studies. The findings from the literature review, conducted between May and June 2023, provided the foundation for developing the focus group guidelines. The insights gathered from these focus groups then informed the design of the initial Delphi questionnaire, ensuring that the study was structured based on both the most recent scientific evidence and the perspectives of key stakeholders.
This was a targeted literature review rather than a full systematic review, designed to support the development of study materials. Titles and abstracts were screened by two authors (A.S.-G. and J.J.M.S.), and recurring themes were extracted and grouped to inform the Delphi criteria.
The search strategy used for the literature review, including the databases consulted, search terms applied, and the number of results obtained, is available as Supplementary Table S1.
2.2. Patients and Informal Caregivers Focus Group
To gain a deeper understanding of the experiences and needs of individuals with SSD and their caregivers within the healthcare system, a focus group session was organized. This session included the participation of six patients previously diagnosed with SSD who were stable under treatment, as well as one informal caregiver directly involved in the daily care of a person with SSD (a total of three women and four men). Participants were recruited in collaboration with two SSD patient associations. These associations’ contribution to participant recruitment is detailed in Supplementary File S2.
To facilitate interaction and encourage idea generation, a semi-structured discussion guide was used. This guide included questions aimed at exploring the challenges faced by patients and their caregivers throughout their interaction with various levels of the healthcare system, specifying different care levels such as primary care, emergency services, hospitals, mental health units, day hospitals, and other involved services (nursing, social work, etc.).
The session, which lasted a total of three hours with a mid-session break, was audio-recorded with the prior informed consent of all participants, ensuring their privacy and confidentiality. The recording was later transcribed verbatim for qualitative analysis. The session was moderated by two researchers (M.S.V. and A.S-G.) with experience in qualitative health research. A thematic content analysis was conducted to identify and group recurrent themes across participants, following the main principles of the COREQ framework.
2.3. Professionals Focus Group
Once the barriers in the care of individuals with Schizophrenia Spectrum Disorder (SSD) were identified through the focus group with patients and caregivers, a second focus group was conducted with professionals.
The objective of this session was to present and discuss the critical points previously identified and to reach a consensus on quality criteria to improve the care of these patients. Representatives from various associations and scientific societies specializing in the care of severe mental disorders were invited. Specifically, invitations were extended to associations in the fields of psychology and psychiatry, mental health nursing, primary care, hospital pharmacy, patient support organizations, and healthcare management. Of the 10 invited societies, 8 agreed to participate, each contributing a participant to the focus group. A detailed list of the scientific societies and professional associations involved in the professional focus group is provided in Supplementary File S2.
The session was recorded with the prior consent of the participants, then analyzed qualitatively. Similar to the session with patients and caregivers, it was moderated by two researchers (M.S.V. and A.S-G.) experienced in qualitative health research, and a thematic content analysis was conducted to identify and group recurrent themes, following the main principles of the COREQ framework. As a result, a report was prepared summarizing the key findings and proposed improvements, which was reviewed and further refined by participants in an asynchronous process. This review formed the basis for the next phase of the study, in which the Delphi methodology was applied to prioritize and reach a consensus on the identified quality criteria.
2.4. Delphi
The Delphi method is a structured and iterative process used to achieve consensus among experts on complex topics, particularly in areas with limited empirical evidence or where professional judgment is essential. This methodology involves multiple rounds of surveys in which participants evaluate predefined statements or criteria, refining their responses in successive iterations until a stable consensus is reached. The Delphi technique is widely applied in healthcare research to establish quality standards, guidelines, and priorities for intervention [,]. Reporting of the Delphi process followed the ACCORD checklist to ensure transparency and completeness of methodological details.
Participants were recruited through professional associations and patient support organizations to ensure a multidisciplinary representation. A total of 36 individuals were invited, including healthcare professionals specializing in SSD care (psychiatrists, primary care physicians, mental health nurses, hospital pharmacists, and healthcare managers) and patients with firsthand experience of the disorder. Inclusion criteria included having at least three years of professional experience in the care of individuals with SSD (for clinicians) or being a diagnosed patient with substantial lived experience of the disorder (for users). Patient representatives were selected and invited by their respective associations to ensure independence and diversity of perspectives, while authors were not involved in the individual selection of participants. The panel size was defined to ensure multidisciplinary coverage (psychiatry, primary care, nursing, pharmacy, management, and patient representatives) and feasibility across rounds. The number of invited participants (N = 36) was set to secure at least 30 completers across two rounds, aligning with common practice in Delphi studies on health service quality. The panel achieved broad national representation, with participants from ten different Autonomous Communities of Spain, including Catalonia, Andalusia, the Basque Country, the Canary Islands, and others beyond the region where the study was conducted (Madrid). This distribution supports the generalizability of the findings within the Spanish health system. Each association and society was asked to nominate 2 to 4 representatives committed to completing at least two rounds of the Delphi process. An official email invitation was sent outlining the objectives of the study and requesting informed consent. Prior to the first round, the survey instrument was internally reviewed by the research team to ensure clarity and relevance, but was not externally piloted. Participation was voluntary, and panelists received a small reimbursement to compensate for time dedicated to the study, in accordance with ethical standards. Responses were collected anonymously using an online platform specialized in Delphi studies. Between rounds, aggregated results and mean scores for each item were shared with all panelists to allow them to reconsider their responses based on group feedback. The steering committee supervised the overall process but did not participate in scoring or decision-making. The Delphi was conducted in Spanish through a secure online platform, with plain-language explanations to ensure accessibility for patient participants. Templates of the focus group guide and Delphi questionnaire are available in Supplementary Files S3 and S4. Table 1 presents the sociodemographic and professional profiles of the final participants in the Delphi study.
Table 1.
Sociodemographic and Professional Profile of Delphi Study Participants.
The study was conducted in two rounds between November 2023 and March 2024. The initial list of 46 criteria was developed by combining the themes that emerged from the qualitative analysis of the focus group discussions with the main findings from the targeted literature review. This approach ensured that the items reflected both empirical evidence and stakeholder perspectives before the first Delphi round. In the first round, participants assessed 46 quality criteria identified in the previous research phases, rating their relevance on a 0-to-10 scale. Criteria that received a score of 9 or higher from at least 75% of respondents were accepted, while those rated below 60% were rejected. Items falling between these thresholds were re-evaluated in a second round, allowing participants to adjust their ratings based on group feedback. Consensus thresholds were predefined as ≥75% for acceptance and ≤60% for rejection, as summarized in Table 2.
Table 2.
Cut-off Points for Quality Criteria.
3. Results
3.1. Literature Review
The literature review included a total of 174 studies published between 2013 and 2023, addressing four key thematic areas related to the quality of schizophrenia management: treatment adherence (65 studies), illness awareness (46 studies), integrated care (58 studies), and the patient journey (5 studies).
The findings highlight the importance of treatment adherence as an essential factor in preventing relapses, identifying barriers such as lack of illness awareness, complexity of the treatment regimen, and medication side effects. Effective strategies to improve adherence were identified, including psychoeducational interventions, family support, and the use of long-acting injectable antipsychotics.
Regarding illness awareness, results show its association with disease severity and treatment compliance, emphasizing promising interventions such as cognitive-behavioral therapy, transcranial stimulation, and self-observation through video recording.
On the other hand, integrated care in schizophrenia requires a multidimensional approach, stressing the need for early detection, personalized treatment, and the integration of pharmacological and psychosocial interventions to improve prognosis and patient quality of life.
Finally, the analysis of the patient journey revealed key factors influencing their trajectory within the healthcare system, highlighting the need to improve early diagnosis, reduce the duration of untreated psychosis, and strengthen coordination between healthcare and social services to promote social integration and patient recovery.
3.2. Focus Group
The focus group with patients allowed for the identification of critical points and the barriers they encounter in the care of individuals with SSD (Table A1, see Appendix A).
The consulted patient group also identified several positive aspects they had perceived throughout the treatment of their illness. The inclusion of the mental health nurse role stood out as an improvement in case management. Additionally, they appreciated positive advancements in the pharmacological field, with medications that have fewer and milder side effects and greater effectiveness in managing symptoms. They also noted improvements in inpatient facilities and day hospitals.
The participants in the healthcare professional focus group received the results obtained from the patient focus group, and an in-depth discussion was opened on the different aspects of each barrier, providing a variety of opinions based on their extensive experience and specific knowledge. Several difficulties and proposals were taken into account to improve care and diagnosis in severe mental disorders (SSD). Additionally, quality criteria were proposed to optimize these processes. Table A2 presents the quality criteria identified for each barrier as a result.
3.3. Delphi
The Delphi process began with the initial questionnaire (Questionnaire 0), which included 46 quality criteria. These were organized based on the 16 barriers identified during the focus groups, including two criteria that applied transversally to all identified barriers. Two rounds were conducted, achieving a participation rate of 88.9% (n = 32) in the first round and 100% (n = 32) in the second round.
To determine the acceptance or rejection of each quality criterion, the predefined cut-off points established by the promoting group were applied (Table 2).
This structured consensus process led to the final prioritization of 26 quality criteria, focusing on key aspects such as early detection, continuity of care, access to appropriate treatments, and integration of psychosocial support services. This set of criteria is detailed in Table A3.
4. Discussion
This study focuses on the main difficulties people with SSD face in receiving adequate care in the Spanish National Health System and establishes a list of quality criteria to guide the work of health services to address them.
For the first time, a proposal to improve the quality of care for people with SSD is addressed through clinical and patient consensus. This can add value to SSD care processes if taken into account and implemented, as it emphasizes critical points prioritized by clinicians and patients.
Recent research highlights persistent gaps in quality measurement for schizophrenia and serious mental illness. Recent reviews [,] have shown that most existing indicators remain process-focused and often fail to capture patient experience, recovery goals, and cross-level coordination. Similarly, initiatives such as the Italian Patient Journey project have reinforced the importance of developing user-centered criteria, reporting barriers comparable to those found in our study, such as insufficient communication, limited involvement in care plans, and lack of service integration []. These findings further support the relevance of our approach, which integrates both clinical and experiential dimensions of care. The identified barriers are based on what patients have expressed and are consistent with findings from other studies [,,,,,]. Delays in receiving care, communication issues, knowledge of the disease, and its stigmatization—especially in the case of mental health—along with the necessary social support [], are the most significant factors hindering the proper care of individuals suffering from this condition.
The consensually defined quality criteria can help improve the care process for patients with SSD, as has been proposed in other pathologies []. These criteria serve as the foundation for the ongoing quality improvement efforts, enabling the establishment of an accreditation system for them [].
In our study, rejected criteria mainly referred to educational, organizational, or advocacy-oriented actions—such as awareness campaigns, staff training, or formal coordination protocols—that were perceived as less feasible or less directly impactful in daily clinical practice. In contrast, items related to clinical management, care continuity, and patient–professional communication achieved a stronger consensus. This suggests that participants prioritized pragmatic and immediately applicable measures over broader structural or policy-level reforms. It is noteworthy that, as reported in recent international reviews, a similar pattern emerges: while system-level, advocacy, and educational actions are widely recognized as important, patients and clinicians often prioritize clinical, continuity, and communication measures for immediate practical impact. This convergence suggests that to produce real changes in the quality of care for SSD, consensus processes tend to favor actions that are rapidly applicable and directly perceived by end-users, without excluding the long-term value of broader structural reforms [,].
Significant progress has been made in the care of individuals with SSD, and the Mental Health Strategy of the National Health System for the period 2022–2026 [], along with previous efforts [], addresses some of the barriers identified in this study, outlining the necessary actions. In this context, the proposed quality criteria would be highly beneficial in guiding these efforts.
Recent studies also highlight the importance of interdisciplinary collaboration in improving the quality and continuity of mental healthcare, particularly during transitions of care. The contribution of clinical pharmacists has been shown to enhance medication reconciliation and safety for patients with SSD [,]. Integrating such collaborative practices supports the implementation of several of the proposed quality criteria in this study.
Improving care for individuals with SSD represents a multifaceted challenge that requires a comprehensive and coordinated intervention across multiple levels of healthcare. The implementation of 26 consensually defined quality criteria provides a pathway toward more effective, personalized, and humane care for these patients. By addressing critical barriers such as delays in diagnosis, insufficient specialized consultations, communication improvements, and enhanced training, early diagnosis and appropriate treatment can be facilitated. This would ultimately contribute to a better quality of life by minimizing the disease’s impact on daily life and reducing the social stigma associated with mental illness [,,,]. Future research could validate these quality criteria in broader or international contexts to assess their applicability across different healthcare systems and cultural settings.
This research is based on participants’ assessments, so the selection of indicators may be influenced by biases inherent to their individual opinions and experiences. However, professionals from different centers and geographic areas were invited to ensure a broader representation of perspectives and experiences, thereby strengthening the validity and applicability of the selected indicators. Nevertheless, as the study focused on Spanish experts and patient representatives, the generalizability of the findings to other health systems may be limited. Finally, although the qualitative analyses may also involve some degree of subjectivity, multidisciplinary participation helped minimize this bias.
5. Conclusions
Improving the quality of care for patients with schizophrenia spectrum disorders requires addressing the barriers that hinder effective care. Therefore, 26 quality criteria have been consensually defined and prioritized, whose implementation may help enhance the quality of care for individuals suffering from these conditions, such as schizophrenia. We propose that those criteria can be used to improve the quality of healthcare in people with SSD and enhance the management and organization of mental health services.
Supplementary Materials
The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/healthcare13222847/s1, Table S1: Search strategy for literature review; Supplementary File S2: List of associations involved in focus groups; Supplementary File S3: Focus group guides for patients and professionals; Supplementary File S4: Delphi Round 1 Questionnaire.
Author Contributions
M.S.V., C.R. and J.J.M.S. conceptualized and designed the study. M.S.V. and A.S.-G. coordinated the focus groups and the Delphi process. C.R., L.C.B., A.F.M., M.L.M.B. and C.A.-S. supported participant recruitment and contributed relevant field perspectives. V.O.D., J.G.R. and J.R.P. assisted in the development of study materials and data collection. All authors contributed to data analysis and interpretation. C.P.-E. and A.S.-G. provided support in methodological design and statistical review. All authors have read and agreed to the published version of the manuscript.
Funding
This work was supported by Otsuka Pharmaceutical S.A. and Lundbeck Spain. During the execution of this study, JJM benefited from a research intensification contract from the Carlos III Health Institute (reference INT22/00012).
Institutional Review Board Statement
The study received ethical approval from the Ethics Committee of San Juan de Alicante University Hospital on 29 November 2023 (Reference number: 23/074).
Informed Consent Statement
All participants provided informed consent prior to their inclusion in the study.
Data Availability Statement
All data generated or analyzed during this study are included in this published article and its Supplementary Materials.
Acknowledgments
We thank the patients, caregivers, and professionals who participated in this study for their valuable contributions. We are also grateful to the patient associations that supported participant recruitment and to the scientific societies and professional associations that contributed their expertise during the research process. Their names are not included to preserve their anonymity.
Conflicts of Interest
The authors declare no conflict of interest.
Abbreviations
The following abbreviations are used in this manuscript:
| SSD | Schizophrenia Spectrum Disorders |
| PROM | Patient-Reported Outcome Measures |
| PREM | Patient-Reported Experience Measures |
| FI | Family Intervention Therapy |
Appendix A
Appendix A.1
Table A1.
Identified Barriers in the Focus Group with Patients.
Table A1.
Identified Barriers in the Focus Group with Patients.
| Description of Barrier | Verbatim |
|---|---|
| “They don’t take you seriously. They say there’s no need to see a psychiatrist, and by the time you realize, you’re already in the emergency room with a severe psychotic episode.” “I went through several misdiagnoses before they got it right. There’s no clear process.” |
| “You need more time and more consultations to figure out exactly what you have and which medication works for you.” |
| “The time between one appointment and the next is too long.” |
| “The consultations are always the same, repetitive questions, following a protocol without adapting to how you feel at the moment. Sometimes, they don’t even have time to listen to you.” “They say things like ‘Schizophrenia? Is it under control?’ as if everything that happens to me is because of the illness.” |
| “At first, you don’t understand anything. Nobody explains what schizophrenia is or what to expect in the future.” “I needed them to give me hope, some certainty that I could achieve things.” |
| “You see that your family needs support because they carry a heavy burden of the illness. Taking care of them too.” |
| “The psychosocial problems behind the disorder remain unresolved.” “Psychiatrists should provide us with information about patient associations and available resources.” |
| “When you go to the emergency room, they don’t have access to your medical history. They don’t know what medication you take or if you have any allergies. You have to explain it yourself in the middle of a crisis.” |
| “Sometimes, you feel like they just leave you alone.” “There isn’t enough support to help us reintegrate into normal life. They treat the illness, and then you’re on your own.” |
| “The transition was really difficult. Just when you finally know and trust your doctor, you have to start over with someone new.” |
| “The worst part was not knowing that I would have those side effects with this medication. You lack information to be prepared.” “It took me years to find the right medication. Until then, the side effects were unbearable.” |
| “For example, medication affects libido and weight, but they don’t offer a specialist”. “There is a lack of psychological services. We need more access to therapy, but it’s not available.” |
| “During hospitalization, the only thing you understand is that you have to behave well to be discharged.” “There is little information during the process, and you leave more scared and confused than when you entered.” “My friends couldn’t visit me while I was hospitalized, and I don’t have family.” |
| “In the emergency room, you see other patients who are much worse than you, and you think: is that what awaits me?” |
| “Sometimes they treat you like you’re dangerous, even when you’re not”. “They (the ambulance staff) doesn’t really understand the illness” |
| “People talk a lot about anxiety and depression, but no one talks about schizophrenia. It’s like we don’t exist.” |
Appendix A.2
Table A2.
Quality criteria identified by professionals for each barrier.
Table A2.
Quality criteria identified by professionals for each barrier.
Barrier 1: Delay in Diagnosis. Insufficient knowledge of the disease among healthcare professionals treating patients with schizophrenia (SSD).
|
Barrier 2: Insufficient specialized consultations for an adequate diagnosis.
|
Barrier 3: Delays in follow-up visits or lack of them.
|
Barrier 4: Repetitive, protocolized consultations with little patient-centered focus.
|
Barrier 5: Room for improvement in healthcare professionals’ communication skills. Improve patient education about their illness, treatment, and care process.
|
Barrier 6: Improve training for families and caregivers to better support patients. Strengthen family support.
|
Barrier 7: Insufficient generalized support and deficiencies in addressing associated psychosocial problems.
|
Barrier 8: Improve Comprehensive Care and address the lack of coordination and communication between services and levels of care.
|
Barrier 9: Gaps in the transition between the healthcare system and daily life during the stabilization phase.
|
Barrier 10: Risks in the transition from child-adolescent to adult mental health services.
|
Barrier 11: Delays in finding the appropriate pharmacological treatment.
|
Barrier 12: Improve accessibility to healthcare resources (psychiatry, psychology, nutrition, sexology).
|
Barrier 13: Improve inpatient care for SSD patients (enhance the humanization of hospitalizations).
|
Barrier 14: Improve emergency care for SSD patients.
|
Barrier 15: Improve ambulance services for transporting SSD patients.
|
Barrier 16: Need to promote awareness and give a voice to individuals with SSD. Combat social stigma.
|
Cross-cutting Criteria for Outcome Evaluation:
|
Appendix A.3
Table A3.
Criteria selected in Rounds 1 and 2 (ordered from highest to lowest agreement).
Table A3.
Criteria selected in Rounds 1 and 2 (ordered from highest to lowest agreement).
| Criteria Selected After the First Round | Mean | CV (%) 1 | N ≥ 9 (%) 2 |
|---|---|---|---|
| Criterion 8.3. Implement an electronic health record system accessible to all services and levels of care involved in the treatment of patients with schizophrenia (SSD). | 9.91 | 2.73 | 96.88 |
| Criterion 14.3. Provide a dedicated emergency cubicle for psychiatric patients that ensures patient privacy and high-quality care for individuals with SSD. | 9.47 | 7.28 | 93.75 |
| Criterion 15.2. Establish a specific protocol for hospital transportation of patients with SSD in the acute phase, including urgent and involuntary transfers. | 9.56 | 7.71 | 93.75 |
| Criterion 10.2. Implement intensive case management and community support services for patients with early-onset SSD. | 9.38 | 8.53 | 90.63 |
| Criterion 1.4. Provide a consultation channel for the mental health specialist responsible for patients with SSD. | 9.38 | 7.66 | 87.50 |
| Criterion 2.3. Offer priority appointments for psychiatry in cases of suspected SSD. | 9.31 | 12.36 | 87.50 |
| Criterion 3.2. Ensure early follow-up in psychiatric consultation after the first episode of schizophrenia (≤15 days). | 9.28 | 15.38 | 87.50 |
| Criterion 8.1. Patients with severe mental disorders (SSD) should be treated in a multidisciplinary unit. | 9.44 | 8.03 | 87.50 |
| Criterion 11.2. Achieve disease stability while avoiding hospital admissions. | 9.5 | 9.12 | 87.50 |
| Criterion 3.3. Provide access to consultation outside routine follow-up controls for situations of risk of relapse. | 9.19 | 12.38 | 84.38 |
| Criterion 10.1. Establish a care protocol to ensure a coordinated and effective transition from pediatric to adult care. | 9.34 | 9.17 | 84.38 |
| Criterion 12.3. Establish a Social and Healthcare Network for Severe Mental Illness. Clarification: This network brings together available resources and allows for the evaluation of specific cases. | 8.88 | 17.88 | 84.38 |
| Criterion 1. Assess the quality of life of SSD patients (Patient-Reported Outcome Measures, PROM). | 9.34 | 9.17 | 84.38 |
| Criterion 2.2. Provide multidisciplinary teams for disease detection and treatment. | 9.19 | 12.38 | 81.25 |
| Criterion 6.2. Inform SSD patients and their families about available social and healthcare support resources. | 9.28 | 9.94 | 81.25 |
| Criterion 6.3. Conduct educational activities and workshops for SSD patients and their families in collaboration with associations. | 9.22 | 9.53 | 81.25 |
| Criterion 1.3. Develop a protocol in Primary Care that includes criteria for early detection (prodromal symptoms) and referral criteria to Psychiatry. | 9.16 | 13.09 | 78.13 |
| Criterion 2.1. Establish a communication channel between Primary Care and Psychiatry for consultation on uncertain cases. | 9.06 | 10.20 | 78.13 |
| Criterion 9.1. Provide SSD patients who require it with training in social skills and daily life activities. | 9.31 | 8.98 | 78.13 |
| Criterion 15.1. Conduct training and awareness activities for professionals involved in transporting SSD patients to enhance compassionate care. | 9.09 | 16.6 | 78.13 |
| Criterion 6.1. Implement psychoeducational family intervention therapy (FI) to prevent relapses and improve disease prognosis. | 9.16 | 9.06 | 75.00 |
| Criterion 7.1. SSD patients should receive psychosocial care from the multidisciplinary team. | 9.25 | 11.14 | 75.00 |
| Criterion 14.1. Develop a clinical protocol for the management of SSD patients in emergency settings. | 9.13 | 13.5 | 75.00 |
| Criteria Selected After the Second Round | Mean | CV (%) 1 | N ≥ 9 (%) 2 |
| Criterion 13.1. Establish a protocol to determine when and how restraint should be applied to patients with schizophrenia (SSD). | 9.06 | 20.02 | 84.38 |
| Criterion 13.2. Assess physical harm (fractures, falls) in patients with SSD. | 8.84 | 13.32 | 75.00 |
| Cross-cutting Criterion 2. Implement a system for measuring patient experience (Patient-Reported Experience Measures, PREM) in mental health services for individuals with SSD. | 9.09 | 10.45 | 75.00 |
1 Coefficient of variation: A lower CV indicates greater consensus among participants (%). 2 Ordered from Highest to Lowest Agreement.
References
- American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders: DSM-5, 5th ed.; American Psychiatric Association: Washington, DC, USA, 2013. [Google Scholar]
- Owen, M.J.; Sawa, A.; Mortensen, P.B. Schizophrenia. Lancet 2016, 388, 86–97. [Google Scholar] [CrossRef]
- Kishi, T.; Ikuta, T.; Matsui, Y.; Mishima, K.; Iwata, N. Effect of discontinuation v. maintenance of antipsychotic medication on relapse rates in patients with remitted/stable first-episode psychosis: A meta-analysis. Psychol. Med. 2019, 49, 772–779. [Google Scholar] [CrossRef]
- Jauhar, S.; Johnstone, M.; McKenna, P.J. Schizophrenia. Lancet 2022, 399, 473–486. [Google Scholar] [CrossRef]
- Liao, Y.; Zhong, Y.; Yang, K.; Zhang, X.-Y. Effects of comorbid alexithymia in chronic schizophrenia: A large-sample study on the Han Chinese population. Front. Psychiatry 2025, 16, 1517540. [Google Scholar] [CrossRef]
- World Health Organization. The Global Burden of Disease: 2004 Update; World Health Organization: Geneva, Switzerland, 2008; Available online: https://iris.who.int/items/99c37bf2-a023-4afa-ae67-27dd6fdcc93f (accessed on 12 May 2025).
- Buckley, P.F.; Miller, B.J.; Lehrer, D.S.; Castle, D.J. Psychiatric Comorbidities and Schizophrenia. Schizophr. Bull. 2009, 35, 383–402. [Google Scholar] [CrossRef]
- Oud, M.J.T.; Meyboom-de Jong, B. Somatic Diseases in Patients with Schizophrenia in General Practice: Their Prevalence and Health Care. BMC Fam. Pract. 2009, 10, 32. [Google Scholar] [CrossRef] [PubMed]
- Walker, E.R.; McGee, R.E.; Druss, B.G. Mortality in Mental Disorders and Global Disease Burden Implications: A Systematic Review and Meta-Analysis. JAMA Psychiatry 2015, 72, 334–341. [Google Scholar] [CrossRef] [PubMed]
- Millan, M.J.; Andrieux, A.; Bartzokis, G.; Cadenhead, K.; Dazzan, P.; Fusar-Poli, P.; Gallinat, J.; Giedd, J.; Grayson, D.R.; Heinrichs, M.; et al. Altering the Course of Schizophrenia: Progress and Perspectives. Nat. Rev. Drug Discov. 2016, 15, 485–515. [Google Scholar] [CrossRef]
- Gagiu, C.; Dionisie, V.; Manea, M.C.; Mazilu, D.C.; Manea, M. Internalised Stigma, Self-Steem and Perceived Social Support as Psychosocial Predictors of Quality of Life in Adult Patients with Schizophrenia. J. Clin. Med. 2024, 13, 6959. [Google Scholar] [CrossRef] [PubMed]
- Schröder, S.; Massarou, C.; Pfister, T.; Bleich, S.; Proskynitopoulos, P.J.; Heck, J.; Westhoff, M.S.; Glahn, A. Drug interactions in patients with alcohol use disorder: Results from a real-world study on an addiction-specific ward. Ther. Adv. Drug Saf. 2025, 16, 20420986241311214. [Google Scholar] [CrossRef]
- Yu, T.H.; Lee, T.L.; Hsuan, C.F.; Wu, C.-C.; Wang, C.-P.; Lu, Y.-C.; Wei, C.-T.; Chung, F.-M.; Lee, Y.-J.; Tsai, I.-T.; et al. Inter-relationships of risk factors and pathways associated with all-cause mortality in patients with chronic schizophrenia. Front. Psychiatry 2024, 14, 1309822. [Google Scholar] [CrossRef] [PubMed]
- Taipale, H.; Tanskanen, A.; Mehtälä, J.; Vattulainen, P.; Correll, C.U.; Tiihonen, J. 20-year follow-up study of physical morbidity and mortality in relationship to antipsychotic treatment in a nationwide cohort of 62,250 patients with schizophrenia (FIN20). World Psychiatry 2020, 19, 61–68. [Google Scholar] [CrossRef]
- Jia, N.; Li, Z.; Li, X.; Jin, M.; Liu, Y.; Cui, X.; Hu, G.; Liu, Y.; He, Y.; Yu, Q. Long-term effects of antipsychotics on mortality in patients with schizophrenia: A systematic review and meta-analysis. Braz. J. Psychiatry 2022, 44, 664–673. [Google Scholar] [CrossRef] [PubMed]
- Anderson, J.C.; Seitz, D.P.; Crockford, D.; Addington, D.; Baek, H.; Lorenzetti, D.L.; Barry, R.; Bolton, J.M.; Taylor, V.H.; Kurdyak, P.; et al. Quality indicators for schizophrenia care: A scoping review. Schizophr. Res. 2024, 274, 406–416. [Google Scholar] [CrossRef] [PubMed]
- Kronenberg, C.; Doran, T.; Goddard, M.; Kendrick, T.; Gilbody, S.; Dare, C.R.; Aylott, L.; Jacobs, R. Identifying primary care quality indicators for people with serious mental illness: A systematic review. Br. J. Gen. Pract. 2017, 67, e519–e530. [Google Scholar] [CrossRef]
- Mira, J.J.; Pérez-Jover, V.; Lorenzo, S.; Aranaz, J.; Vitaller, J. La investigación cualitativa: Una alternativa también válida. Aten. Primaria 2004, 34, 161–166. [Google Scholar] [CrossRef]
- Weiner, B.J.; Amick, H.R.; Lund, J.L.; Lee, S.Y.D.; Hoff, T.J. Use of Qualitative Methods in Published Health Services and Management Research: A 10-Year Review. Med. Care Res. Rev. 2011, 68, 3–33. [Google Scholar] [CrossRef]
- Jorm, A.F. Using the Delphi expert consensus method in mental health research. Aust. N. Z. J. Psychiatry 2015, 49, 887–897. [Google Scholar] [CrossRef]
- Yañez Gallardo, R.; Cuadra Olmos, R. La técnica Delphi y la investigación en los servicios de salud. Cienc. Enferm. 2008, 14, 9–15. [Google Scholar]
- Vita, A.; Barlati, S.; Porcellana, M.; Sala, E.; Lisoni, J.; Brogonzoli, L.; Percudani, M.E.; Iardino, R. The patient journey project in Italian mental health services: Results from a co-designed survey on clinical interventions and current barriers to improve the care of people living with schizophrenia. Front. Psychiatry 2024, 15, 1382326. [Google Scholar] [CrossRef]
- Matin Bk Williamson, H.J.; Karyani, A.K.; Rezaei, S.; Soof, M.; Soltani, S. Barriers in access to healthcare for women with disabilities: A systematic review in qualitative studies. BMC Womens Health 2021, 21, 44. [Google Scholar] [CrossRef]
- Calleja, S.; Islam, F.m.A.; Kingsley, J.; McDonald, R. Heathcare access for autistic adults: A systematic review. Medicine 2020, 99, e20899. [Google Scholar] [CrossRef]
- Radez, J.; Reardon, T.; Creswell, C.; Lawrence, P.J.; EvdokaBurton, G.; Waite, P. Why do children and adolescents (not) seek and access professional help for their mental health problems? A systematic review of quantitative and qualitative studies. Eur. Child Adolesc. Psychiatry 2021, 30, 183–211. [Google Scholar] [CrossRef]
- Arango, C.; Bernardo, M.; Bonet, P.; Cabrera, A.; Crespo-Facorro, B.; Cuesta, M.J.; González, N.; Parrabera, S.; Sanjuan, J.; Serrano, A.; et al. When the healthcare does not follow the evidence: The case of the lack of early intervention programs for psychosis in Spain. Rev. Psiquiatr. Salud Ment. 2017, 10, 78–86. [Google Scholar] [CrossRef]
- Sepúlveda-Muñoz, J.; Quemada-González, C.; Hurtado-Lara, M.M.; García, Á.M.G.; Martí-García, C.; Pérez-Bryan, J.M.G.-H.; Morales-Asencio, J.M. Management of psychosis and schizophrenia by primary care GPs: A cross-sectional study in Spain. J. Prim. Care Community Health 2025, 16, 21501319241306177. [Google Scholar] [CrossRef]
- Barlati, S.; Nibbio, G.; Vita, A. Evidence-based psychosocial interventions in schizophrenia: A critical review. Curr. Opin. Psychiatry 2024, 37, 131–139. [Google Scholar] [CrossRef]
- Puente, J.; Algaba Arrea, F.; Buisan Rueda, O.; Gauna, D.C.; Durán, I.; Ávila, J.J.F.; Gómez-Iturriaga, A.; Blázquez, M.J.P.; Fentes, D.P.; Pardo, G.S.; et al. Criteria and indicators to evaluate quality of care in genitourinary tumour boards. Clin. Transl. Oncol. 2024, 26, 1639–1646. [Google Scholar] [CrossRef] [PubMed]
- Pérez, C.; Martin-Delgado, J.; Vinuesa, M.; Ibor, P.J.; Guilabert, M.; Gomez, J.; Beato, C.; Sánchez-Jiménez, J.; Velázquez, I.; Calvo-Espinos, C.; et al. Pain standards for Accredited Healthcare Organizations (ACDON Project): A mixed methods study. J. Pers. Med. 2021, 11, 102102. [Google Scholar] [CrossRef] [PubMed]
- Estrategia de Salud Mental del Sistema Nacional de Salud 2022-2026. Ministerio de Sanidad. Secretaria General Técnica. 2022. Available online: https://www.sanidad.gob.es/bibliotecaPub/repositorio/libros/29236_estrategia_de_salud_mental_del_Sistema_Nacional_de_Salud_2022-2026.pdf (accessed on 15 May 2025).
- Vieta, E.; Menchón Magriña, J.M.; Bernardo Arroyo, M.; Pérez Sola, V.; Moreno Ruiz, C.; Arango López, C.; Bobes García, J.; Martín Carrasco, M.; Palao Vidal, D.; González-Pinto Arrillaga, A. Basic quality indicators for clinical care of patients with major depression, schizophrenia, and bipolar disorder. Span. J. Psychiatry Ment. Health 2024, 17, 103–109. [Google Scholar] [CrossRef] [PubMed]
- Stuhec, M. Antipsychotic treatment in elderly patients on polypharmacy with schizophrenia. Curr. Opin. Psychiatry 2022, 35, 332–337. [Google Scholar] [CrossRef] [PubMed]
- Stuhec, M.; Batinic, B. Clinical pharmacist interventions in the transition of care in a mental health hospital: Case reports focused on the medication reconciliation process. Front. Psychiatry 2023, 14, 1263464. [Google Scholar] [CrossRef] [PubMed] [PubMed Central]
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2025 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).