Abstract
Mental health professionals’ perspectives on transdiagnostic mobile interventions for Emotional Disorders (EDs) remain underexplored, despite their potential role in integrating ecological interventions into psychological care. This study examined the usability, acceptability, perceived clinical utility, and implementation potential of EmoGuia, a smartphone-based Ecological Momentary Intervention grounded in the Unified Protocol. Using the Consensual Qualitative Research framework, focus groups involving nine therapists and researchers were conducted following a one-week app trial. Thematic findings identified 13 categories across three domains: (1) target population, (2) satisfaction and app experience, and (3) perceived utility. Usability was additionally assessed via the System Usability Scale (SUS). Participants perceived EmoGuia as intuitive, simple, and suitable for young adults with mild-to-moderate anxiety or depressive symptoms. It was perceived as useful for fostering emotional awareness, reinforcing therapeutic content, and preventing dropout. Recommended improvements included personalized feedback, simplified language, and better notification management. SUS scores indicated high perceived usability (M = 79.4; SD = 12.1). These findings support EmoGuia as a promising low-intensity, adjunctive tool for early intervention in EDs and provide implementation-relevant guidance for its iterative refinement. Patient-inclusive longitudinal studies are needed to establish acceptability, engagement, feasibility, and clinical effectiveness.
1. Introduction
According to the latest World Health Organization (WHO) estimates, more than one billion people globally (approximately 14% of the population) live with a mental disorder (WHO, 2019, 2025). Anxiety disorders (4.4%) and depressive disorders (4.0%), collectively referred to as emotional disorders (EDs), are among the most prevalent mental health conditions worldwide and together account for more than two-thirds of all mental disorders (WHO, 2025). In Spain, prevalence rates exceed global averages, with approximately 5.2% of adults diagnosed with anxiety disorder and 5.3% with depressive disorder (Instituto Nacional de Estadística [INE], 2020; Vieta et al., 2021). This relatively high prevalence has been associated with socioeconomic disadvantages, particularly unemployment and lower social class, together with demographic factors such as gender and age (Arias-de la Torre et al., 2018). Despite their high prevalence and associated societal and economic burden, access to evidence-based mental health services remains clearly insufficient. With most countries allocating less than 2% of their healthcare budgets to mental health, there is an urgent need for increased funding to develop innovative, scalable, and effective psychological assessment and intervention protocols for individuals with EDs (Colombo et al., 2018; Hazo et al., 2017; Rathod et al., 2017).
1.1. Transdiagnostic Approaches and Digital Mental Health Interventions
Transdiagnostic approaches have emerged as a promising response to this challenge (Brown & Barlow, 2009; Dalgleish et al., 2020). Rather than focusing on disorder-specific symptoms, these interventions target shared emotional and cognitive mechanisms underlying EDs, thereby improving cost-effectiveness, flexibility, and personalization (Brown & Barlow, 2009; Newby et al., 2015; Pearl & Norton, 2017). Among them, the Unified Protocol (UP) stands out as the most empirically supported transdiagnostic cognitive-behavioral therapy (CBT) framework, effectively reducing anxiety, depression, and comorbid symptoms across diverse populations and treatment settings (Barlow et al., 2011, 2017). In Spain, implementations of the UP have shown strong feasibility and cost-effectiveness within the public health system (Osma et al., 2015, 2018; Peris-Baquero et al., 2022, 2023), reinforcing its value as a scalable and adaptable clinical model.
Simultaneously, Information and Communication Technologies (ICTs) have transformed the delivery of psychological interventions (Bidargaddi et al., 2020; Luxton et al., 2011). In Spain, more than 88% of the population owns a smartphone, providing an ideal platform for delivering accessible, evidence-based psychological interventions in real-world settings (Ramón-Arbués et al., 2025). Although problematic smartphone use has increased worldwide, particularly among young adults and university students (Lu et al., 2024; Ramón-Arbués et al., 2025), these technological advances have also facilitated the development of innovative assessment and intervention approaches.
1.2. Ecological Momentary Assessment and Intervention
Among these innovations, Ecological Momentary Assessment (EMA) enables the repeated assessment of individuals’ emotions, cognitions, behaviors, and contextual experiences in real time and within their natural environments, thereby reducing retrospective recall bias while increasing ecological validity (Gual-Montolio et al., 2022; Hallgren et al., 2017). Historically, EMA was implemented through paper-and-pencil diaries, telephone interviews, or handheld electronic devices. However, EMA has evolved considerably with the widespread adoption of smartphones, which enable automated data collection, passive sensing through embedded sensors (e.g., accelerometers and GPS), and real-time transmission of information to clinicians and researchers (Balaskas et al., 2021; Firth et al., 2017; Hallgren et al., 2017). Building upon EMA, Ecological Momentary Interventions (EMIs) extend assessment into intervention by delivering therapeutic strategies within individuals’ daily environments when they are most needed, thereby facilitating the application and generalization of psychological skills to real-world contexts (Heron & Smyth, 2010). Smartphone-based EMIs can provide personalized, context-aware, and adaptive support through just-in-time adaptive interventions (JITAIs), increasing accessibility, engagement, and adherence while reducing patient and clinician burden (Nahum-Shani et al., 2018). Recent reviews have demonstrated the effectiveness of EMI-based interventions grounded in CBT and transdiagnostic principles across a variety of populations and disorders (Daemen et al., 2021; Reininghaus et al., 2023, 2024; Schick et al., 2021), including mood and anxiety disorders (Bakker et al., 2018; Bush et al., 2014; Martínez-García et al., 2025; Schueller et al., 2017), emotion dysregulation (Castilla et al., 2022; Osma et al., 2022), gambling (Hawker et al., 2021), and severe mental illness (Lecomte et al., 2020; Linardon et al., 2024, 2025).
Despite their considerable potential, smartphone-based mental health interventions also raise important ethical considerations. Because these technologies can collect sensitive behavioral, emotional, contextual, and geolocation data, researchers and developers must ensure robust safeguards regarding privacy, confidentiality, data security, informed consent, and transparent data governance (González et al., 2024; Martinez-Martin et al., 2021). These ethical challenges become particularly relevant when EMA is employed, as it may unintentionally capture highly sensitive information about individuals’ daily routines and behaviors (Hoelscher et al., 2025). Accordingly, the implementation of digital mental health interventions should follow privacy-by-design principles and appropriate data governance frameworks to ensure the responsible use of sensitive information while fostering users’ trust and engagement (González et al., 2024).
Addressing these ethical and implementation challenges requires not only robust technological solutions but also the active involvement of the professionals who will ultimately develop, evaluate, and integrate these interventions into routine clinical practice. However, most digital mental health tools are validated primarily with patients, while the perspectives of the professionals responsible for their implementation—therapists and researchers—are rarely examined (Dao et al., 2021). Given the increasing proliferation of mental health applications (apps), these perspectives are essential for understanding apps’ usability, acceptability, and ethical soundness (Osma et al., 2022; Torous & Roberts, 2017). While therapists contribute with practical insights into feasibility and integration within real-world care, researchers provide complementary views on both the theoretical alignment and the technical feasibility (Alqahtani & Orji, 2020; Mohr et al., 2017; van Ballegooijen et al., 2014). Therefore, integrating these viewpoints is key to the sustainable adoption of EMI-based technologies in clinical settings. Additionally, this is particularly relevant given that the evaluative process of digital health technologies ideally relies on a tripartite collaboration between researchers, clinicians, and end-users, as conceptualized within user-centered design (UCD) or participatory design (PD) (Dekker & Williams, 2017).
1.3. Objectives of the Present Study
To address this gap, the present study explores therapists’ and researchers’ experiences using EmoGuia, a transdiagnostic smartphone app designed to deliver personalized EMIs based on users’ real-time emotional states (Gual-Montolio et al., 2023). Grounded in Barlow’s Unified Protocol (2011), EmoGuia aims to provide flexible, scalable, and evidence-based psychological support through ecological assessment and intervention. Through a one-week usability trial, this study examines professionals’ perceptions of its usability, utility, and ethical considerations. By integrating their feedback, it contributes to the limited but expanding literature on digital transdiagnostic interventions.
Therefore, the objectives of this study were (1) to explore therapists’ and researchers’ perceptions regarding the usability, acceptability, and perceived clinical utility of EmoGuia; (2) to identify strengths and areas for improvement in the app; and (3) to generate recommendations to inform its future refinement and implementation in routine clinical practice. Preliminary findings suggest generally positive perceptions regarding EmoGuia’s usability and potential clinical applicability, while also identifying important ethical and implementation challenges that should inform the future refinement and integration of digital mental health tools, such as EmoGuia, into routine care.
2. Materials and Methods
2.1. Study Design
This study employed an exploratory qualitative design to explore therapists’ and researchers’ perspectives after a one-week trial of the EmoGuia mobile app. The study followed the Consensual Qualitative Research (CQR) (Hill et al., 1997, 2005; Hill, 2012), a rigorous qualitative methodology specifically developed to investigate participants’ subjective experiences while promoting methodological transparency and analytic credibility. CQR is particularly appropriate for exploratory studies seeking an in-depth understanding of relatively underexplored phenomena because it combines the inductive principles of grounded theory (Charmaz, 2014; Glaser & Strauss, 1967) with systematic procedures designed to enhance trustworthiness through researcher consensus, reflexivity, and external auditing.
Consistent with its constructivist, phenomenological, and postpositivist foundations (Hill et al., 2005; Hill, 2012), CQR acknowledges multiple interpretations of participants’ experiences while using collaborative consensus and external review to minimize the influence of individual researcher bias. Accordingly, qualitative data were collected through semi-structured focus groups and analyzed inductively by identifying domains, constructing core ideas, and conducting a cross-analysis to derive categories that reflected common patterns across participants.
To ensure methodological rigor and reporting quality, the study adhered to the Consolidated Criteria for Reporting Qualitative Research (COREQ; Tong et al., 2007) guidelines (see Supplementary File S1). In addition, quantitative data were administered to contextualize participants’ qualitative perceptions of the app. Consistent with the exploratory purpose of the study, these quantitative data were not intended to test hypotheses or support inferential statistical analyses; they were used solely to contextualize participants’ perceptions.
2.2. Participants and Recruitment
Eligible participants were licensed psychologists and psychology researchers specializing in digital mental health, each with a minimum of two years of experience in either (a) the clinical treatment of patients with EDs or (b) the development or application of psychological ICTs. Therefore, some participants were eligible based on experience in one field (clinical care) while having little or no experience in the other (digital development), and vice versa, ensuring a range of perspectives from both clinical and research settings.
Recruitment followed a convenience sampling strategy through email invitations and professional networks. Colleagues and prior collaborators were invited to participate or nominate others. Although this sampling strategy may limit representativeness, it is widely used in exploratory qualitative research to recruit information from participants with relevant expertise and was considered appropriate given the specialized profile required for this study.
Sample size was determined a priori following recommendations for CQR and focus group methodology, which suggest that approximately 5–12 participants are generally sufficient to generate rich, in-depth data while maintaining manageable group dynamics and facilitating consensus-based analysis (Hill et al., 1997; Krueger & Casey, 2008). Recruitment concluded once the predefined target sample size, established according to CQR and focus group methodological recommendations, had been reached, ensuring representation of both clinicians and researchers with complementary expertise.
All participants provided written informed consent prior to participation (see Supplementary File S2), including permission for audio recording of the focus groups (see Supplementary File S3). No personally identifiable information was collected, and all data was anonymized prior to analysis to ensure confidentiality. Ethical approval was obtained from the Universitat Jaume I Ethics Committee (CD/111/2021).
2.3. EmoGuia App
EmoGuia—registered as “My EMI, Emotional Well-Being”—is a mobile app designed to integrate EMAs and EMIs to support self-applied, transdiagnostic interventions for individuals with EDs (Gual-Montolio et al., 2023). The app delivers brief, multimedia-based psychological exercises (images, infographics, and videos) derived from Barlow’s UP framework (Barlow et al., 2011), which are tailored to users’ daily emotional states and to key mechanisms of psychological change. While happiness was initially included as a target emotion, in this study it was replaced by guilt and shame, alongside anxiety, sadness and anger. As a result, no positive emotional state was addressed, which represents an area for improvement in future developments of the app. The mechanisms of psychological change include a more general mechanism of activity engagement, as well as core therapeutic mechanisms such as understanding the role of emotions, mindfulness, cognitive flexibility, tolerance of distress, and situational exposure (Sauer-Zavala et al., 2021).
Users complete daily EMAs at a fixed time (7:00 p.m.) to assess UP mechanisms of change, with reminders to ensure adherence. Scores below a predefined threshold for two consecutive days trigger automated alarms, prompting low-intensity EMIs. Additionally, on-demand EMAs allow users to self-report outcome variables (emotional states) at any time, with high scores (above six) also triggering an alarm and prompting tailored interventions (Chan et al., 2018; Nahum-Shani et al., 2018). Missed responses are logged to maintain ecological validity. For a detailed description of the app, including the items, pre-specified clinical alarms, and corresponding EMIs, see Gual-Montolio et al. (2023) and Table 1.
Table 1.
Correspondence EMA-EMI in EmoGuia.
A decision-support system manages the escalation of support based on users’ self-reported data. In full clinical versions, persistent high-severity scores trigger therapist contact (e.g., phone or video call; Delgadillo et al., 2022). This feature was not used in the present study, as participants were professionals simulating user scenarios. The app is available for Android and iOS, with access granted through researcher-issued codes to ensure data control. Its design aligns with stepped-care and blended-treatment models, aiming for both experimental control and real-world scalability.
2.4. Measures
2.4.1. Qualitative Measures
Data were collected using a semi-structured focus group interview, developed ad hoc following prior digital mental health studies (Borkovec & Nau, 1972; Castilla et al., 2023) (see Supplementary File S4). The guide explored participants’ experiences and perceptions of the app across four main domains:
- Contributions to Therapy (6 questions)—potential clinical roles in face-to-face or blended interventions.
- General Opinion of the App (9 questions)—usability, satisfaction, visual design, and potential improvements.
- Use of Mobile Platforms (1 question)—advantages and limitations of smartphone delivery.
- Confidentiality and Privacy (3 questions)—perceptions of data protection, trust, and intrusiveness.
Additionally, participants evaluated the utility and satisfaction of EmoGuia’s core tools (daily and on-demand EMAs, multimedia content, and sections for reviewing completed content) using 0–10 rating scales and open-ended questions. The interview captured both qualitative narratives and quantitative ratings, providing a multidimensional view of usability and clinical relevance.
2.4.2. Quantitative Measure
The System Usability Scale—Short Form (SUS-short; Brooke, 1996; Castilla et al., 2023) was used to complement qualitative findings (see Supplementary File S5). This five-item instrument (1 = strongly disagree; 5 = strongly agree) yields a 0–100 usability score with benchmarks (Bangor et al., 2008):
- 85–100 = Best Imaginable;
- 73–84 = Excellent;
- 52–72 = Good.
The short version has shown satisfactory internal consistency (α = 0.77; Castilla et al., 2023).
2.5. Procedure
Participants independently installed EmoGuia and were instructed to interact with the app throughout a one-week testing period while simulating mild-to-moderate emotional symptoms. During this period, they were asked to interact with all core functionalities of the app, including completing scheduled EMAs, initiating on-demand assessments, and reviewing multimedia psychoeducational content. This testing procedure was designed to enable participants to systematically evaluate the app’s usability, perceived clinical utility, and potential integration into routine clinical practice from their professional perspective, rather than from the perspective of end users.
The focus group protocol was collaboratively developed by the research team (P.G., L.D., I.A.) and independently reviewed by the external auditor (J.B.) in line with CQR procedures (Hill et al., 1997; Hill, 2012). Before data collection, the research team discussed their professional backgrounds, prior assumptions, and expectations regarding digital psychological interventions to increase awareness of potential interpretative biases throughout the analytic process. These reflections were revisited during coding and consensus meetings to promote reflexivity in accordance with CQR recommendations (Hill et al., 2005; Hill, 2012).
Prior to conducting the focus groups, participants completed a brief sociodemographic questionnaire and provided written informed consent through Qualtrics XM (Qualtrics, Provo, UT), a secure web-based survey platform widely used in health research. Focus group sessions were subsequently scheduled using Doodle, an online scheduling platform that facilitates meeting coordination (Doodle AG, 2025).
Two virtual focus groups involving three to six participants each were conducted via Google Meet and lasted approximately 60 min. Virtual focus groups were selected because they reduce geographical and logistical barriers, facilitate participation among busy professionals, and enable the inclusion of participants from different locations without compromising interaction quality. Evidence suggests that videoconferencing platforms provide a realistic alternative to face-to-face focus groups, preserving both verbal and non-verbal communication cues while generating levels of discussion and data richness comparable to in-person groups (Kite & Phongsavan, 2017). Moreover, online videoconferencing has been shown to be a feasible, acceptable, and cost-effective method for qualitative health research, offering additional advantages such as ease of participation, secure data management, and flexibility for participants with demanding professional schedules (Archibald et al., 2019). To further promote balanced participation, focus groups were intentionally kept small (3–6 participants), allowing the moderator to encourage contributions from all participants and minimizing the likelihood that individual members would dominate the discussion (Katz-Buonincontro, 2022). All sessions were moderated by the first author (P.G.), an experienced psychologist trained in qualitative research methods. Before each session, participants were reminded of the study objectives, confidentiality procedures, and their right to withdraw at any time, and oral consent for audio recording was reconfirmed. To minimize response bias, participants were encouraged to openly discuss both positive and negative aspects of the app. The moderator followed the semi-structured interview, used neutral prompts when clarification was required, and avoided evaluative or leading questions. No detailed information about the expected outcomes of the study or hypotheses was provided in advance to preserve the spontaneity and authenticity of participants’ contributions.
All focus groups were audio-recorded, anonymized, and transcribed verbatim by four independent assistants who were not involved in the study design, data collection, or analysis. All identifying information was removed from the transcripts, and each participant received a unique identification code to preserve confidentiality. The anonymized transcripts were then analyzed by the research team following the CQR procedure described below.
2.6. Data Analysis
Quantitative data, including participants’ SUS scores and demographic variables, were analyzed using descriptive statistics in SPSS v23.0 (IBM Corp, 2015, Released).
For qualitative data, analysis followed the CQR framework (Hill et al., 1997, 2005) through two main stages:
- Team Formation and Coding Preparation
The primary analysis team comprised three coders (two PhD students, P.G. and I.A., and one PhD psychologist, L.D.), all women with complementary expertise in clinical psychology, digital mental health, and qualitative research. Although the moderator (P.G.) had interacted with participants during the focus groups, the remaining analysts had no prior contact with participants, thereby reducing the potential influence of pre-existing relationships and minimizing bias on data interpretation. Consistent with CQR recommendations (Hill et al., 2005), the multidisciplinary composition of the team facilitated the consideration of multiple perspectives during data interpretation while reducing the likelihood that a single theoretical orientation would dominate the analysis. Additionally, an experienced qualitative and clinical researcher (J.B.), a woman associate professor who was not involved in data collection or coding, served as the external auditor. Following CQR recommendations (Hill et al., 2005; Hill, 2012), the auditor independently reviewed the evolving domain structure, core ideas, categories, and supporting quotations at multiple stages of the analysis, challenging interpretations, identifying inconsistencies, and ensuring that the final coding framework remained grounded in the original data.
- 2.
- Domain and Category Development
Analyses were conducted inductively using ATLAS.ti (version 24.1.1.30813; ATLAS.ti Scientific Software Development GmbH (2023), Berlin, Germany) and followed the iterative consensus process recommended in CQR (Hill et al., 1997, 2005; Hill, 2012). First, each coder independently read the transcripts several times to achieve data familiarization before identifying preliminary domains, core ideas, and categories. Subsequently, the research team then met repeatedly to compare interpretations, refine domain boundaries, and reach consensus through discussion and continual reference to the original transcripts rather than through voting or majority decisions. Disagreements were resolved through discussion until unanimous agreement was reached, with the auditor providing critical feedback whenever necessary and ensuring alignment with CQR standards.
Following CQR procedures, domains represented broad topic areas; core ideas captured the essence of each participant’s statements within these domains; and categories summarized a cross-analysis that describes consistencies in the core ideas across different domains (Hill et al., 1997, 2005; Hill, 2012). The prevalence of each category was determined according to the number of participants who contributed data to that category and was classified using the corresponding CQR frequency labels (general, typical, variant, and rare). To provide additional descriptive information regarding the relative salience of each topic within the dataset, we also report the number of coded excerpts assigned to each category. These reference counts reflect the frequency with which a topic emerged across the focus groups and are presented solely as descriptive indicators; they should not be interpreted as reflecting the number of participants endorsing a category or its relative importance.
The final structure emerged through an iterative process of constant comparison across transcripts and continuous reference to raw data to ensure validity. Throughout the analytic process, reflexivity was actively maintained by encouraging team members to critically examine their own assumptions, consider alternative interpretations, and justify coding decisions with direct reference to participants’ accounts. Consensus meetings emphasized equal participation, open discussion, and mutual respect among researchers to minimize individual bias and enhance analytic credibility. The external auditor independently reviewed each stage of the analysis, providing critical feedback that prompted further refinement whenever necessary. These procedures are central to CQR and contribute to the transparency, credibility, dependability, confirmability, and trustworthiness of qualitative findings (Hill et al., 2005).
3. Results
3.1. Participants’ Characteristics
Of the eleven professionals initially invited, nine completed the one-week trial of EmoGuia, while the remaining two were unable to attend due to scheduling incompatibility. The final sample comprised six women and three men, aged 29 to 52 years (M = 37.9, SD = 6.8). All were licensed psychologists, and several also held academic or research positions. Clinical experience ranged from 0 to 12 years (M = 7.67, SD = 3.33), while experience with ICT tools in mental health ranged from 0 to 13 years (M = 5.56, SD = 4.55).
Participants varied in their balance of clinical and technological expertise—some specialized in direct patient care, while others focused on digital intervention design. This heterogeneity was intentional, allowing for a multidimensional evaluation of the app’s usability and clinical potential. Detailed sociodemographic and professional information is presented in Table 2.
Table 2.
Socio-demographic and professional characteristics of participants (n = 9).
3.2. Qualitative Findings
Following the CQR framework, three major domains, thirteen categories, and their corresponding core ideas were identified through inductive analysis and team consensus, later reviewed by the external auditor. These domains captured (1) perceptions of EmoGuia’s target population, (2) overall satisfaction and usability, and (3) perceived utility for patients and therapists. Given the sample size (n = 9), frequency labels were assigned following CQR recommendations. Categories endorsed by eight or nine participants were classified as general, those represented by five to seven participants as typical, those represented by two to four participants as variant, and categories identified in only one participant as rare (Hill et al., 2005; Hill, 2012). A detailed matrix of categories, core ideas, frequency and illustrative quotes is provided in Appendix A (Table A1).
3.2.1. EmoGuia’s Target Population
This domain captures participants’ views on the type of users for whom EmoGuia is most suitable. This domain was divided into four categories, ranked by the frequency of their mention:
- Type of symptomatology and severity: Participants viewed EmoGuia as most appropriate for mild or subclinical anxiety and depressive symptoms, emphasizing its preventive and adjunctive potential. For instance, one participant noted, “For mild symptoms, it can indeed be a great help” (Participant 4, P4). They agreed that individuals with severe depression or low motivation might struggle to sustain engagement, given the self-monitoring demands of the app: “With mild symptoms, because if it’s severe, you do need to have a more daily follow-up” (P3). A third participant highlighted, “In severe patients, especially those who are depressed, any small extra task requires a great effort from them” (P1).
- Motivation and commitment: This category emerged as crucial moderators of app adherence. Participants suggested that individuals who are reluctant to monitor their symptoms through other means may similarly experience difficulties engaging with the app. One participant mentioned, “In some cases, when we find that there is no motivation to record on paper, we also find that there is no commitment to using the application either” (P2). Other participants remarked, “It requires a lot of willpower to respond, to answer at the moment” (P3), and “Above all, it is necessary to have commitment” (P2).
- Age: Participants identified younger age groups, particularly those in their twenties, as more likely to benefit from the app. For example, one participant suggested, “The younger patients, I think, would be more familiar with it, particularly those in their twenties. Some even spontaneously use applications to practice more mindfulness or listen to podcasts” (P3).
- Technological resources: This category highlighted the importance of technological familiarity and resources for effective app use. Participants noted potential barriers for individuals lacking experience with technology. For example, one participant remarked, “A population that has technological resources and is generally familiar with reading and writing through their phone” (P3).
3.2.2. Satisfaction, Usability and App Experience
This domain explores participants’ opinions and satisfaction regarding different features of the app. Overall, satisfaction with EmoGuia was high, with participants describing it as intuitive, simple, and visually engaging. These positive qualitative impressions were complemented by the descriptive System Usability Scale (SUS-short form) results. Following the one-week evaluation, SUS scores ranged from 55 to 95, with a mean of 79.4 (SD = 12.1), indicating good-to-excellent perceived usability according to established interpretative guidelines (Bangor et al., 2008). Two participants provided the highest observed score (95), whereas one participant rated usability at 55. Six of the nine participants provided scores between 75 and 85. Because the SUS was administered solely to contextualize the qualitative findings, these scores were interpreted descriptively and were not used to test hypotheses or infer clinical effectiveness.
Table 3 summarizes the SUS-short results. These quantitative findings align with participants’ qualitative feedback, underscoring EmoGuia’s intuitive design, accessibility, and clinical potential while highlighting opportunities to enhance personalization and user engagement.
Table 3.
Individual System Usability Scale (SUS) scores.
Several categories were identified:
- Audiovisual psychological content: This category is related to the effectiveness of images, infographics and videos in delivering psychological transdiagnostic content. Additionally, some future proposals were suggested. Participants recommended adding reinforcement elements or self-reflection tools (e.g., notes or audio recordings). Overall, participants consistently perceived videos as more engaging and emotionally expressive than written text or static graphics: “Regarding the content, I really liked the infographics, but I think videos would be more powerful for the patients” (P3). Another participant emphasized, “The two materials that are recorded with image and audio, from my point of view, they are much more targeted, much more engaging, hearing the other person’s voice, the intonation they speak with, […]. I think it’s more impactful” (P3). Participants also proposed enhancements such as providing a space for users to write or record audio notes for specific moments. Some examples of future proposals are “A blank space where they can write or record an audio note to be more specific about what happened at that moment or something like that, right?” (P9), and “I miss a little bit of what Participant 6 mentioned about reinforcement. I think throughout the whole app, it lacks a little face that reinforces me, that tells me ‘Very well’, that it’s good that you now feel more capable of facing this, something like that” (P8).
- Psychological content adjustment to assessment responses: This category assessed how well the app’s content aligns with evaluation responses, including user alarms and notifications. Participant 3 (P3) mentioned: “I actually think that whenever you score below a specific point for some content, it should always provide you with something”. Participant 8 (P8) stated “I think the sequence is coherent”.
- Intrusiveness: This category refers to the feeling of discomfort or insecurity due to threats to confidentiality, data protection, privacy, and the perceived burden of daily notifications. Participants mentioned that perceptions of the app’s intrusiveness are subjective and depend on the users. Examples include: “For the patient who uses it, it wouldn’t be intrusive. I think those who find it intrusive are the ones who won’t engage or respond” (P3), and “There may be people who may feel the app prompts overwhelming, one more task within daily routines. But it’s true that they may express a reluctance to record on paper too” (P2).
- Opinion and future proposals of Ecological Momentary Assessment (EMA): This category refers to participants’ opinions of assessment scales and the utility of scheduled and on-demand EMAs. Participants proposed refining the response scales (e.g., Likert-type instead of numeric) and including positive emotions (e.g., joy, pride) to complement the focus on distress-related states. Some participants stated: “In line with what Participant 9 says, maybe we should rethink the response scale. I mean, instead of using a numerical scale, maybe a Likert scale could be considered, I don’t know, ranging from “not anxious” to “very anxious”. Maybe that would help to determine where to set the cutoff point” (P5), “Regarding the questions, they talk about emotions like shame, anxiety, sadness... I would add frustration, I mean, I think frustration, along with shame and guilt, is also important as a secondary emotion. Ultimately, it’s about gathering more comprehensive data” (P6), and “I don’t know if you’ve considered adding positive emotions, not just negative ones” (P5).
- Ease of use: This category refers to the app’s clean layout and straightforward navigation which facilitated engagement. Participants evaluated how user-friendly and accessible the app is in terms of its interface and overall design. Some comments were “I think it’s quite intuitive, in a rather straightforward format. I believe that for most people, they wouldn’t have a problem using it” (P4), “It’s comfortable to use, simple, and easy to understand” (P2), “Perhaps what I liked the most is the simplicity aspect; it’s very straightforward” (P5).
- Language employed: This category assesses the appropriateness and clarity of the language used in the app. A participant mentioned: “Perhaps, the language used in the videos was too technical, I don’t know... It seemed too much to me, too technical and formal, considering the type of user the app is aimed at in the end” (P5). Some professionals considered the language slightly formal or technical for end users, suggesting simplification for broader accessibility.
Overall, participants expressed confidence in EmoGuia’s usability and structure, while emphasizing refinements that could enhance personalization and emotional resonance.
3.2.3. EmoGuia Perceived Utility
Participants perceived EmoGuia primarily as a complementary tool rather than a stand-alone intervention, highlighting potential benefits for both patients and therapists.
Patient-Focused Utility Subdomain:
This category underscores the app’s utility as a complementary or support tool for patients for several purposes:
- To promote emotional awareness: This subcategory refers to the potential use to enhance emotional awareness of patients through assessments. Some participants mentioned: “I become more aware of what’s happening to me, and I find solutions” (P4), “Maybe I haven’t taken a moment all day to think about how much shame, sadness, and guilt I’ve been feeling” (P4), and “It helps working on emotional awareness” (P2).
- To maintain the connection with therapy (accompaniment): This category refers to the app’s role in providing connection and accessibility to help patients to stay engaged with therapists. Some examples include: “I would give it a ten, because with the app they feel accompanied. They know that behind all this, there is someone. They have a technological tool for support, but behind it, there is a person interested in helping whom they can turn to at any time, and that is crucial” (P4).
- As a reminder: This category highlights the app’s function in providing reminders to reinforce or review therapeutic content. Participants expressed: “The app allows you to carry it with you at all times and reminds you in the moment when you need it most” (P2), “You don’t have to carry paper around or remember, there are those reminders” (P4), “The reminders help to recall what you’ve already worked on in face-to-face therapy, so you don’t forget to practice the skills you are working on” (P8).
- Dropout prevention: Participants mentioned that the app could enhance adherence to treatment, thereby preventing dropouts and, consequently, improving efficiency. Participants mentioned that: “Helping them to stay engaged and not disconnect” (P3), and “If there’s a risk for abandonment, it seems to me that it’s a way to maintain more contact with the patient on a daily basis” (P3).
- To promote behavioral change and track progress: Participants expressed “I see the application often as an anchor moment in decision-making and behavior change process” (P7), “It’s a recap of what I’ve implemented throughout the day, reflecting on things I should change for tomorrow, like taking stock of the entire day” (P4).
- Therapist-Focused Utility Subdomain:
This category highlights the app’s role as a complementary tool for therapists for different purposes:
- Time reduction: This subcategory refers to the potential use of the app to reduce the time therapists spend on certain therapeutic tasks. Participants mentioned the need for an initial investment in teaching to use the app but emphasized its potential impact afterward. For example, “There needs to be an initial investment in teaching to use the app, but that can lead to saving time during therapy sessions” (P5), “It reduced time therapists need to invest” (P6), and “The records are already there, quantified, so you don’t have to go through everything, or make corrections” (P4).
- Patient monitoring: This utility for therapists focuses on the ease of monitoring patient progress. For example, some participants said that: “It will show the patient’s evolution between evaluations” (P4), “I believe it can help the therapist became aware of whether the patient is implementing strategies or not” (P2), “To continue verifying on a daily basis whether they are following or implementing the points we have worked on in their emotional psychoeducation” (P2).
- Precision of EMAs: This subcategory refers to the apps’ utility in recording daily objective assessments of patients, rather than relying on retrospective recall. Participants mentioned: “Many patients come in saying they haven’t been doing so badly. Then, as you start asking, you realize that things have been quite rough. Or sometimes it’s the opposite, where someone describes a horrible week, but daily assessments show it hasn’t been that bad, suggesting a generalization effect from a single day or event that clouds the rest of the week” (P4), “In that moment, it can provide a clearer picture of the situation” (P7), “The advantage of having the app with us in the moment for “ecological assessment” (P4), and “The questionnaire was very short and concise, and that is appreciated” (P9).
Collectively, these findings suggest that participants valued EmoGuia as a potential blended-care adjunct—a bridge between therapy sessions and real-life emotion regulation contexts.
4. Discussion
4.1. Main Findings and Perceived Clinical Applicability
The present study explored therapists’ and researchers’ perspectives following a one-week simulated evaluation of EmoGuia, a smartphone-based Ecological Momentary Intervention (EMI) grounded in Barlow’s Unified Protocol (UP) for transdiagnostic treatment of emotional disorders (EDs) (Barlow et al., 2011). Overall, therapists and researchers perceived EmoGuia as an intuitive and potentially valuable tool for supporting psychological treatment, while also identifying opportunities to improve personalization, engagement, and accessibility. As one of the first qualitative studies to specifically explore professionals’ perspectives on an EMA- and EMI-based smartphone intervention grounded in the UP, the present findings contribute to the growing literature on ecological transdiagnostic interventions and provide valuable guidance for the iterative refinement of digital psychological tools before large-scale clinical evaluation.
The qualitative analysis yielded three overarching domains: Target Population, Satisfaction and app Experience, and Perceived Utility, providing a comprehensive understanding of professionals’ perceptions regarding the strengths, limitations, and future development of EmoGuia. Overall, professionals generally perceived the app as most suitable for individuals experiencing mild-to-moderate emotional symptoms, particularly those who were motivated to engage in self-monitoring and comfortable using digital technologies. These perceptions are consistent with previous evidence indicating that low-intensity digital psychological interventions are particularly appropriate for individuals with subclinical or less severe symptomatology, whereas patients with more severe emotional disorders often require more intensive therapist support (Hetrick et al., 2018).
Accordingly, participants viewed EmoGuia primarily as a complement to therapist-guided treatment rather than a stand-alone intervention. They highlighted its potential to enhance emotional awareness, reinforce therapeutic learning between sessions, and promote the transfer of emotion regulation skills to daily life. These observations are consistent with previous research on digital implementations of the UP (Celleri et al., 2025; Martínez-García et al., 2025) and further support the integration of ecological smartphone interventions within blended-care and stepped-care models (Bakker et al., 2016, 2018; Castilla et al., 2022; Linardon et al., 2025). Additionally, participants perceived the app as a useful mechanism for maintaining a sense of therapeutic continuity between sessions and potentially reducing dropout, a recurrent challenge in both traditional and digital interventions (Torous et al., 2020). These findings extend those reported on the RegulEm app (Osma et al., 2022; Martínez-García et al., 2025), in which usability and clinical integration were also identified as key implementation factors. Unlike previous smartphone adaptations of the UP that mainly reproduce therapeutic modules within mobile platforms, EmoGuia combines EMA with personalized EMIs delivered in real time according to users’ emotional states, representing an ecological extension of the UP into everyday life.
Quantitative usability findings were consistent with these qualitative perceptions. The System Usability Scale (SUS-short form) score (M = 79.4) indicates good-to-excellent usability (Bangor et al., 2008) and is comparable to previous evaluations of UP-based mobile interventions (Martínez-García et al., 2025). Although these findings do not demonstrate clinical effectiveness, they support the feasibility of future implementation studies.
Despite these encouraging findings, professionals identified several areas for improvement. Professionals consistently emphasized that sustained engagement with digital mental health interventions depends not only on usability, but also on personalization, motivational support, digital literacy, and minimizing assessment burden (Osma et al., 2022; Robillard et al., 2019; Torous et al., 2018). Their recommendations—including adaptive notifications, richer multimedia resources (e.g., positive reinforcement or gamified feedback), simplified language, positive emotion tracking, and more individualized feedback—closely align with current evidence on JITAIs and digital mental health interventions (Nahum-Shani et al., 2018; Delgadillo et al., 2022). These recommendations are particularly relevant considering a recent meta-analysis showing that transdiagnostic smartphone interventions produce small but significant improvements in depression, anxiety, and psychological distress compared with control conditions (Linardon et al., 2025). However, the review also highlighted considerable variability in engagement and relatively high attrition rates, identifying sustained user engagement as one of the principal challenges facing digital mental health interventions.
4.2. Implementation and Ethical Considerations
The present findings also help clarify the complementary roles of internet-based interventions and smartphone apps within digital mental healthcare. Although both approaches aim to increase access to evidence-based psychological treatments, they differ substantially in their mode of delivery (Celleri et al., 2025; Delgadillo et al., 2022). Internet-based interventions usually deliver structured therapeutic modules, whereas ecological smartphone interventions provide continuous monitoring and context-sensitive support throughout daily life (Nahum-Shani et al., 2018). Rather than competing approaches, both formats may play complementary roles within blended-care models, with web-based programs delivering structured treatment and smartphone apps reinforcing therapeutic skills in real-world contexts (Celleri et al., 2025). From this perspective, EmoGuia should not be understood simply as a mobile version of the UP but as an ecological extension of its transdiagnostic principles into everyday life.
Beyond usability, the present findings also highlight important implementation challenges associated with ecological mobile interventions. Participants identified younger adults with mild-to-moderate emotional symptoms and adequate digital literacy as the population most likely to benefit from the current version of the app. However, successful engagement with EMIs appears to depend on more than digital literacy alone. Recent evidence suggests that EMIs also require sufficient cognitive bandwidth, that is, the attentional and executive resources necessary to respond to ecological prompts and initiate self-regulation in real time (Jaremba et al., 2026). During periods of acute psychological distress, elevated stress, or emotional overload, these cognitive resources may become temporarily compromised, making individuals less likely to engage with smartphone-delivered interventions precisely when support is most needed. Consequently, barriers to implementation are not solely technological but also cognitive and emotional, particularly among individuals experiencing greater symptom severity. These observations are consistent with broader concerns regarding digital exclusion in mental healthcare, whereby unequal access to technology, functional limitations, and differences in cognitive or digital competence may inadvertently widen existing health inequalities despite the potential of digital interventions to improve access to care (Beneito-Montagut et al., 2022; Martinez-Martin et al., 2021).
These findings suggest that the challenge for future ecological interventions is not only determining when support is needed but also when users have sufficient cognitive capacity to benefit from it. Consequently, future iterations of EmoGuia should move beyond generic accessibility principles and incorporate specific implementation and accessibility-oriented strategies aimed at reducing both technological and cognitive barriers to engagement. Potential adaptations include simplified interfaces requiring fewer interactions, reduced cognitive demands during periods of elevated distress, adaptive notification schedules based on users’ current emotional state, brief low-effort interventions (e.g., grounding or breathing exercises) during episodes of acute stress, postponement of cognitively demanding reflective exercises until emotional arousal decreases, optional voice-assisted interaction for older adults or users with limited digital literacy, and caregiver- or clinician-supported monitoring when clinically appropriate.
Importantly, these recommendations should be interpreted within the intended scope of EmoGuia. The app was conceived as an ecological complement to therapist-guided psychological treatment rather than as a stand-alone intervention. Its primary purpose is to reinforce the acquisition and generalization of UP skills within blended- and stepped-care models, or to provide low-intensity support for individuals presenting with subclinical or mild-to-moderate emotional symptoms. Accordingly, the accessibility adaptations proposed here should not be interpreted as strategies to replace clinician-guided care for individuals with severe or highly complex emotional disorders, but rather as approaches to broaden equitable access within the target population for which the intervention was designed.
Finally, although professionals primarily discussed issues related to notification burden and perceived intrusiveness, concerns regarding privacy, data governance, and the management of sensitive ecological data were comparatively limited. Rather than suggesting that these issues are unimportant, this finding may reflect the increasing normalization of digital data collection among professionals accustomed to implementing digital health technologies. Nevertheless, future implementation research should explicitly examine stakeholders’ perceptions of data privacy, transparency, trust, and governance alongside usability and acceptability outcomes, as these factors are likely to influence the successful and ethical implementation of ecological mental health interventions (González et al., 2024).
Overall, the findings suggest that the principal contribution of smartphone-based EMIs lies not simply in digitizing existing psychological interventions but in extending evidence-based therapeutic principles into everyday life. By combining continuous ecological assessment with personalized, context-sensitive interventions, apps such as EmoGuia have the potential to facilitate the generalization of therapeutic skills beyond therapy sessions, strengthen self-management, and reinforce continuity of psychological care. Importantly, these conclusions should be interpreted as reflecting therapists’ and researchers’ perspectives following a one-week simulated evaluation and therefore provide guidance for the refinement and future implementation of the application rather than evidence of clinical effectiveness in patient populations.
4.3. Strengths and Limitations
The present study has several strengths that contribute to the growing literature on digital mental health interventions. First, unlike many usability studies that focus primarily on end users, this research examined the perspectives of therapists and researchers, two stakeholder groups that play a fundamental role in the development, evaluation, and implementation of digital psychological interventions before large-scale effectiveness trials. This study is also consistent with user-centered and participatory design principles, which advocate the active involvement of multiple stakeholders throughout the development of digital health technologies (Alqahtani & Orji, 2020; Dekker & Williams, 2017). Second, the use of the CQR methodology, together with independent coding, consensus procedures, and external auditing, enhanced the credibility and trustworthiness of the qualitative analysis. The complementary descriptive SUS data further contextualized participants’ perceptions of usability. Despite these strengths, several limitations should be considered. First, the small convenience sample, recruited partly through professional networks, may have included participants with greater familiarity with digital mental health and more favorable attitudes toward digital interventions. Consequently, confirmation bias cannot be completely excluded, and the findings should be interpreted as informed professional perspectives rather than representative views of clinicians or researchers more broadly. Second, participants evaluated EmoGuia during a one-week simulated evaluation while simulating mild-to-moderate emotional symptoms. Consequently, the findings should not be interpreted as evidence of patient acceptability, engagement, or clinical effectiveness, but rather as guidance for the iterative refinement of the intervention prior to feasibility and effectiveness testing in clinical populations. Likewise, the short evaluation period may also have limited assessment of longer-term engagement, adherence, and changes in user experience. Finally, objective app usage metrics (e.g., interaction time, frequency of use, EMA completion rates, or engagement trajectories) were not collected. Consequently, it was not possible to examine the relationship between participants’ subjective evaluations and their actual patterns of interaction with the app. Future studies integrating qualitative methods with objective digital behavioral data may provide a more comprehensive understanding of engagement processes and implementation barriers.
4.4. Implications for Implementation and Future Research
Finally, although this study focused on professionals’ perspectives, the successful implementation of ecological mobile interventions ultimately depends on the experiences of end users. Therefore, future research should evaluate EmoGuia and other smartphone transdiagnostic interventions in more heterogeneous samples of mental health professionals with varying levels of experience in digital interventions, as well as in clinical populations through longitudinal feasibility studies and randomized controlled trials. These studies are needed not only to establish the app’s clinical effectiveness, acceptability, implementation outcomes, and cost-effectiveness across diverse healthcare settings (Dao et al., 2021), but also the mechanisms underlying sustained engagement, predictors of intervention receptivity, and the extent to which ecological interventions facilitate the transfer and generalization of therapeutic skills into everyday life.
Future research should continue to adopt user-centered design principles by actively involving patients, therapists, researchers, and other stakeholders throughout the iterative refinement process (Schaeuffele et al., 2025). Particular attention should be devoted to developing increasingly adaptive ecological interventions capable of responding to users’ momentary emotional, cognitive, and functional needs. Accordingly, future versions of EmoGuia should prioritize greater personalization, adaptive notification systems, simplified user interfaces, reduced cognitive burden during ecological assessments, voice-assisted interaction where appropriate, caregiver-supported functionalities for users requiring additional assistance, and transparent ethical data governance. Moreover, future JITAI algorithms should investigate whether tailoring the timing and complexity of ecological interventions according to users’ momentary cognitive and emotional capacity improves long-term engagement while reducing digital exclusion (Jaremba et al., 2026).
5. Conclusions
Overall, the present findings suggest that smartphone-based ecological transdiagnostic interventions, such as EmoGuia, may represent a promising approach to extending evidence-based psychological care beyond the therapy setting by reinforcing emotion regulation skills in everyday contexts. Although clinical effectiveness remains to be established through longitudinal feasibility studies and randomized controlled trials, the present study provides valuable evidence supporting the usability, acceptability, and implementation potential of an ecological transdiagnostic intervention from the perspective of mental health professionals following a one-week simulated evaluation of the app, thereby informing the iterative refinement of EmoGuia prior to feasibility and effectiveness testing in clinical populations. Continued stakeholder involvement, user-centered design, and rigorous ethical governance will be essential to maximize the clinical impact and scalability of future digital mental health interventions. Future development should also prioritize personalization, adaptive JITAI algorithms, and implementation strategies that optimize long-term engagement while minimizing cognitive burden and preserving equitable access across diverse user populations.
Supplementary Materials
The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/bs16091546/s1, Supplementary File S1: Table S1: Consolidated Criteria for Reporting Qualitative Research (COREQ) guidelines (Tong et al., 2007); Supplementary File S2: Participants’ informed consent; Supplementary File S3: Audio recording consent form; Supplementary File S4: Semi-structured Interview for Focus Groups (in English); Supplementary File S5: Short-form of System Usability Scale.
Author Contributions
Conceptualization P.G.-M., C.S.-R. and J.B.-L.; methodology, P.G.-M., J.B.-L., L.D.-S. and I.A.-O.; formal analysis, P.G.-M., L.D.-S. and I.A.-O.; investigation, P.G.-M., J.B.-L., L.D.-S. and I.A.-O.; data curation, P.G.-M.; writing—original draft preparation P.G.-M., C.S.-R. and J.B.-L.; writing—review and editing, P.G.-M., C.S.-R., J.B.-L., A.G.-P., L.D.-S. and I.A.-O.; supervision, C.S.-R., A.G.-P. and J.B.-L.; funding acquisition, J.B.-L. All authors have read and agreed to the published version of the manuscript.
Funding
This research was funded by UNIVERSITAT JAUME I through the Research Promotion Plan (Grant UJI-B2022-54; accounting code 22I600) and through a predoctoral grant (grant reference: PREDOC/2019/05).
Institutional Review Board Statement
The study was conducted in accordance with the Declaration of Helsinki and approved by the Universitat Jaume I Ethics Committee (protocol code CD/111/2021; date of approval: 9 December 2021).
Informed Consent Statement
Informed consent was obtained from all subjects involved in the study.
Data Availability Statement
The original contributions presented in this study are included in the article/Supplementary Material. Further inquiries can be directed to the corresponding author.
Acknowledgments
We sincerely thank all therapists and research psychologists who participated in the focus groups and engaged with EmoGuia. Their thoughtful feedback was essential to the refinement and success of this study.
Conflicts of Interest
The authors declare no known competing financial interests or personal relationships that could have influenced the work reported in this paper. The funders had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript; or in the decision to publish the results.
Appendix A
Table A1.
Results of the content analysis of therapists’ experience focus groups.
References
- Alqahtani, F., & Orji, R. (2020). Insights from user reviews to improve mental health apps. Health Informatics Journal, 26(3), 2042–2066. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Archibald, M. M., Ambagtsheer, R. C., Casey, M. G., & Lawless, M. (2019). Using zoom videoconferencing for qualitative data collection: Perceptions and experiences of researchers and participants. International Journal of Qualitative Methods, 18, 1–8. [Google Scholar] [CrossRef] [Scilit]
- Arias-de la Torre, J., Vilagut, G., Martín, V., Molina, A. J., & Alonso, J. (2018). Prevalence of major depressive disorder and association with personal and socio-economic factors. Results for Spain of the European health interview survey 2014–2015. Journal of Affective Disorders, 239, 203–207. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- ATLAS.ti Scientific Software Development GmbH. (2023). ATLAS.ti (Version 24.1.1.30813) [Qualitative data analysis software]. Available online: https://atlasti.com (accessed on 20 June 2024).
- Bakker, D., Kazantzis, N., Rickwood, D., & Rickard, N. (2016). Mental health smartphone apps: Review and evidence-based recommendations for future developments. JMIR Mental Health, 3(1), e7. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Bakker, D., Kazantzis, N., Rickwood, D., & Rickard, N. (2018). A randomized controlled trial of three smartphone apps for enhancing public mental health. Behaviour Research and Therapy, 109, 75–83. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Balaskas, A., Schueller, S. M., Cox, A. L., & Doherty, G. (2021). Ecological momentary interventions for mental health: A scoping review. PLoS ONE, 16(3), e0248152. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Bangor, A., Kortum, P. T., & Miller, J. T. (2008). An empirical evaluation of the system usability scale. International Journal of Human-Computer Interaction, 24(6), 574–594. [Google Scholar] [CrossRef] [Scilit]
- Barlow, D. H., Ellard, K. K., Fairholme, C. P., Farchione, T. J., Boisseau, C. L., May, J. T. E., & Allen, L. B. (2011). Unified protocol for transdiagnostic treatment of emotional disorders: Workbook. Oxford University Press. [Google Scholar]
- Barlow, D. H., Farchione, T. J., Bullis, J. R., Gallagher, M. W., Murray-Latin, H., Sauer-Zavala, S., Bentley, K. H., Thompson-Hollands, J., Conklin, L. R., Boswell, J. F., Ametaj, A., Carl, J. R., Boettcher, H. T., & Cassiello-Robbins, C. (2017). The unified protocol for transdiagnostic treatment of emotional disorders compared with diagnosis-specific protocols for anxiety disorders. JAMA Psychiatry, 74(9), 875–884. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Beneito-Montagut, R., Rosales, A., & Fernández-Ardèvol, M. (2022). Emerging digital inequalities: A comparative study of older adults’ smartphone use. Social Media + Society, 8(4), 1–12. [Google Scholar] [CrossRef] [Scilit]
- Bidargaddi, N., Schrader, G., Klasnja, P., Licinio, J., & Murphy, S. (2020). Designing m-health interventions for precision mental health support. Translational Psychiatry, 10(1), 222. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Borkovec, T. D., & Nau, S. D. (1972). Credibility of analogue therapy rationales. Journal of Behavior Therapy and Experimental Psychiatry, 3(4), 257–260. [Google Scholar] [CrossRef] [Scilit]
- Brooke, J. (1996). SUS—A quick and dirty usability scale. Usability Evaluation in Industry, 189(194), 4–7. [Google Scholar] [CrossRef] [Scilit]
- Brown, T. A., & Barlow, D. H. (2009). A proposal for a dimensional classification system based on the shared features of the DSM-IV anxiety and mood disorders: Implications for assessment and treatment. Psychological Assessment, 21(3), 256–271. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Bush, N. E., Ouellette, G., & Kinn, J. (2014). Utility of the T2 mood tracker mobile application among army warrior transition unit service members. Military Medicine, 179(12), 1453–1457. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Castilla, D., Jaén, I., Suso-Ribera, C., García-Soriano, G., Zaragoza, I., Bretón-López, J., Mira, A., Diaz-García, A., & García-Palacios, A. (2023). Psychometric properties of the spanish full and short forms of the system usability scale (SUS): Detecting the effect of negatively worded items. International Journal of Human–Computer Interaction, 40, 4145–4151. [Google Scholar] [CrossRef] [Scilit]
- Castilla, D., Navarro-Haro, M. V., Suso-Ribera, C., Diaz-García, A., Zaragoza, I., & Garcia-Palacios, A. (2022). Ecological momentary intervention to enhance emotion regulation in healthcare workers via smartphone: A randomized controlled trial protocol. BMC Psychiatry, 22(164), 1–18. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Celleri, M., Klajner, F., Cremades, F. C., Garay, C. J., Etchevers, M., & Osma, J. (2025). Usability and acceptance by therapists and users of an internet-based intervention based on the unified protocol in Argentina. Journal of Clinical Psychology, 12, 1294–1309. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Chan, L., Swain, V. D., Kelley, C., de Barbaro, K., Abowd, G. D., & Wilcox, L. (2018). Students’ experiences with ecological momentary assessment tools to report on emotional well-being. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 2(1), 1–20. [Google Scholar] [CrossRef] [Scilit]
- Charmaz, K. (2014). Constructing grounded theory (2nd ed.). SAGE Publications. [Google Scholar]
- Colombo, D., Palacios, A. G., Alvarez, J. F., Patané, A., Semonella, M., Cipresso, P., Kwiatkowska, M., Riva, G., & Botella, C. (2018). Current state and future directions of technology-based ecological momentary assessments and interventions for major depressive disorder: Protocol for a systematic review. Systematic Reviews, 7(1), 233. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Daemen, M., Postma, M. R., Lindauer, R., Hoes-van der Meulen, I., Nieman, D., Delespaul, P., Breedvelt, J. J. F., van der Gaag, M., Viechtbauer, W., Schruers, K., van den Berg, D., Bockting, C., van Amelsvoort, T., & Reininghaus, U. (2021). Efficacy of a transdiagnostic ecological momentary intervention for improving self-esteem (SELFIE) in youth exposed to childhood adversity: Study protocol for a multi-center randomized controlled trial. Trials, 22(1), 641. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Dalgleish, T., Black, M., Johnston, D., & Bevan, A. (2020). Transdiagnostic approaches to mental health problems: Current status and future directions. Journal of Consulting and Clinical Psychology, 88(3), 179–195. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Dao, K. P., De Cocker, K., Tong, H. L., Kocaballi, A. B., Chow, C., & Laranjo, L. (2021). Smartphone-delivered ecological momentary interventions based on ecological momentary assessments to promote health behaviors: Systematic review and adapted checklist for reporting ecological momentary assessment and intervention studies. JMIR MHealth and UHealth, 9(11), e22890. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Dekker, M. R., & Williams, A. D. (2017). The use of user-centered participatory design in serious games for anxiety and depression. Games for Health Journal, 6(6), 327–333. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Delgadillo, J., Ali, S., Fleck, K., Agnew, C., Southgate, A., Parkhouse, L., Cohen, Z. D., Derubeis, R. J., & Barkham, M. (2022). Stratified care vs. stepped care for depression: A cluster randomized clinical trial. JAMA Psychiatry, 79(2), 101–108. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Doodle AG. (2025). Doodle. Available online: https://doodle.com/es/ (accessed on 1 February 2024).
- Firth, J., Torous, J., Nicholas, J., Carney, R., Rosenbaum, S., & Sarris, J. (2017). Can smartphone mental health interventions reduce symptoms of anxiety? A meta-analysis of randomized controlled trials. Journal of Affective Disorders, 218, 15–22. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Glaser, B. G., & Strauss, A. L. (1967). The discovery of grounded theory: Strategies for qualitative research. Sociology Press. [Google Scholar]
- González, R., Lay, S., Huck, J., & Dixon, J. (2024). The use of GNSS technology in smartphones to collect sensitive data on human mobility practices: Ethical challenges and potential solutions. American Psychologist, 79(1), 52–64. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Gual-Montolio, P., Jaén, I., Martínez-Borba, V., Castilla, D., & Suso-Ribera, C. (2022). Using artificial intelligence to enhance ongoing psychological interventions for emotional problems in real- or close to real-time: A systematic review. International Journal of Environmental Research and Public Health, 19(13), 7737. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Gual-Montolio, P., Suso-Ribera, C., García-Palacios, A., Castilla, D., Zaragoza, I., & Bretón-López, J. (2023). Enhancing Internet-based psychotherapy for adults with emotional disorders using ecological momentary assessments and interventions: Study protocol of a feasibility trial with “My EMI, emotional well-being” app. Internet Interventions, 31, 100601. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Hallgren, K. A., Bauer, A. M., & Atkins, D. C. (2017). Digital technology and clinical decision making in depression treatment: Current findings and future opportunities. Depression and Anxiety, 34(6), 494–501. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Hawker, C. O., Merkouris, S. S., Youssef, G. J., & Dowling, N. A. (2021). A smartphone-delivered ecological momentary intervention for problem gambling (gamblingless: Curb your urge): Single-arm acceptability and feasibility trial. Journal of Medical Internet Research, 23(3), e25786. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Hazo, J.-B., Gandré, C., Leboyer, M., Obradors-Tarragó, C., Belli, S., McDaid, D., Park, A.-L., Maliandi, M. V., Wahlbeck, K., Wykes, T., van Os, J., Haro, J. M., & Chevreul, K. (2017). National funding for mental health research in Finland, France, Spain and the United Kingdom. European Neuropsychopharmacology, 27(9), 892–899. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Heron, K. E., & Smyth, J. M. (2010). Ecological momentary interventions: Incorporating mobile technology into psychosocial and health behavior treatments. British Journal of Health Psychology, 15(1), 1–39. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Hetrick, S. E., Robinson, J., Burge, E., Blandon, R., Mobilio, B., Rice, S. M., Simmons, M. B., Alvarez-Jimenez, M., Goodrich, S., & Davey, C. G. (2018). Youth codesign of a mobile phone app to facilitate self-monitoring and management of mood symptoms in young people with major depression, suicidal ideation, and self-harm. JMIR Mental Health, 5(1), e9. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Hill, C. E. (Ed.). (2012). Consensual qualitative research: A practical resource for investigating social science phenomena. American Psychological Association. [Google Scholar]
- Hill, C. E., Knox, S., Thompson, B. J., Williams, E. N., Hess, S. A., & Ladany, N. (2005). Consensual qualitative research: An update. Journal of Counseling Psychology, 52(2), 196–205. [Google Scholar] [CrossRef] [Scilit]
- Hill, C. E., Thompson, B. J., & Williams, E. N. (1997). A guide to conducting consensual qualitative research. The Counseling Psychologist, 25(4), 517–572. [Google Scholar] [CrossRef] [Scilit]
- Hoelscher, E. C., Victor, S. E., Kiekens, G., & Ammerman, B. (2025). Ethical considerations for the use of ecological momentary assessment in non-suicidal self-injury research. Ethics & Behavior, 35(8), 593–610. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- IBM Corp. (2015). IBM SPSS statistics for windows (version 23.0, released). IBM Corp.
- Instituto Nacional de Estadística (INE). (2020). Encuesta Europea de salud en España (EESE). Ministerio de Sanidad.
- Jaremba, A., O’Reilly, S., Mason, L., Nolte, T., Shaikh, M., & O’Driscoll, C. (2026). Optimizing just-in-time adaptive interventions for interpersonal distress: Mechanisms, prediction, and the challenge of engagement. Scientific Reports, 16, 8406. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Katz-Buonincontro, J. (2022). How to interview and conduct focus groups. American Psychological Association. [Google Scholar] [CrossRef] [Scilit]
- Kite, J., & Phongsavan, P. (2017). Insights for conducting real-time focus groups online using a web conferencing service. F1000Research, 6, 122. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Krueger, R. A., & Casey, M. A. (2008). Focus groups: A practical guide for applied research (4th ed.). SAGE Publications. [Google Scholar]
- Lecomte, T., Potvin, S., Corbière, M., Guay, S., Samson, C., Cloutier, B., Francoeur, A., Pennou, A., & Khazaal, Y. (2020). Mobile apps for mental health issues: Meta-review of meta-analyses. JMIR MHealth and UHealth, 8(5), e17458. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Linardon, J., Anderson, C., Messer, M., Liu, C., & Torous, J. (2025). Transdiagnostic-focused apps for depression and anxiety: A meta-analysis. npj Digital Medicine, 8, 443. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Linardon, J., Torous, J., Firth, J., Cuijpers, P., Messer, M., & Fuller-Tyszkiewicz, M. (2024). Current evidence on the efficacy of mental health smartphone apps for symptoms of depression and anxiety: A meta-analysis of 176 randomized controlled trials. World Psychiatry, 23(1), 139–149. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Lu, X., An, X., & Chen, S. (2024). Trends and influencing factors in problematic smartphone use prevalence (2012–2022): A systematic review and meta-analysis. Cyberpsychology, Behavior, and Social Networking, 27(9), 616–634. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Luxton, D. D., McCann, R. A., Bush, N. E., Mishkind, M. C., & Reger, G. M. (2011). mHealth for mental health: Integrating smartphone technology in behavioral healthcare. Professional Psychology: Research and Practice, 42(6), 505–512. [Google Scholar] [CrossRef] [Scilit]
- Martinez-Martin, N., Greely, H. T., & Cho, M. K. (2021). Ethical development of digital phenotyping tools for mental health applications: Delphi study. JMIR Mhealth Uhealth, 9(7), e27343. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Martínez-García, L., Belaunzaran-Mendizabal, J., Santos-Goñi, M. A., Miralles, I., & Osma, J. (2025). RegulEm, a smartphone app based on the unified protocol for the transdiagnostic treatment of emotional disorders: Description of its application in blended format in a clinical case. Digital Health, 11, 20552076251334442. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Mohr, D. C., Zhang, M., & Schueller, S. M. (2017). Personal sensing: Understanding mental health using ubiquitous sensors and machine learning. Annual Review of Clinical Psychology, 13(1), 23–47. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Nahum-Shani, I., Smith, S. N., Spring, B. J., Collins, L. M., Witkiewitz, K., Tewari, A., & Murphy, S. A. (2018). Just-in-time adaptive interventions (JITAIs) in mobile health: Key components and design principles for ongoing health behavior support. Annals of Behavioral Medicine, 52(6), 446–462. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Newby, J. M., McKinnon, A., Kuyken, W., Gilbody, S., & Dalgleish, T. (2015). Systematic review and meta-analysis of transdiagnostic psychological treatments for anxiety and depressive disorders in adulthood. Clinical Psychology Review, 40, 91–110. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Osma, J., Castellano, C., Crespo, E., & García-Palacios, A. (2015). The unified protocol for transdiagnostic treatment of emotional disorders in group format in a Spanish public mental health setting. Behavioral Psychology/Psicología Conductual, 23(3), 447–466. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Osma, J., Martínez-García, L., Prado-Abril, J., Peris-Baquero, Ó., & González-Pérez, A. (2022). Developing a smartphone app based on the Unified Protocol for the transdiagnostic treatment of emotional disorders: A qualitative analysis of users and professionals’ perspectives. Internet Interventions, 30, 100577. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Osma, J., Suso-Ribera, C., García-Palacios, A., Crespo-Delgado, E., Robert-Flor, C., Sánchez-Guerrero, A., Ferreres-Galan, V., Pérez-Ayerra, L., Malea-Fernández, A., & Torres-Alfosea, M. Á. (2018). Efficacy of the unified protocol for the treatment of emotional disorders in the Spanish public mental health system using a group format: Study protocol for a multicenter, randomized, non-inferiority controlled trial. Health and Quality of Life Outcomes, 16(1), 46. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Pearl, S. B., & Norton, P. J. (2017). Transdiagnostic versus diagnosis specific cognitive behavioral therapies for anxiety: A meta-analysis. Journal of Anxiety Disorders, 46, 11–24. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Peris-Baquero, Ó., Moreno, J. D., & Osma, J. (2023). Long-term cost-effectiveness of group unified protocol in the Spanish public mental health system. Current Psychology, 42(26), 22462–22477. [Google Scholar] [CrossRef] [Scilit]
- Peris-Baquero, Ó., Osma, J., & Martínez-Segura, V. (2022). Study on the use, acceptability and implementation of the Unified Protocol in general health psychologists in Spain. Anales de Psicología, 38(3), 399–408. [Google Scholar] [CrossRef] [Scilit]
- Ramón-Arbués, E., Echániz-Serrano, E., Granada-López, J. M., Satústegui-Dordá, P. J., Fernández-Rodrigo, M. T., & Sagarra-Romero, L. (2025). Prevalence and predictors of problematic smartphone use in a sample of Spanish undergraduate students. Scientific Reports, 15, 45457. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Rathod, S., Pinninti, N., Irfan, M., Gorczynski, P., Rathod, P., Gega, L., & Naeem, F. (2017). Mental health service provision in low- and middle-income countries. Health Services Insights, 10, 117863291769435. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Reininghaus, U., Daemen, M., Postma, M. R., Schick, A., Hoes-van der Meulen, I., Volbragt, N., Nieman, D., Delespaul, P., de Haan, L., van der Pluijm, M., Breedvelt, J. J. F., van der Gaag, M., Lindauer, R., Boehnke, J. R., Viechtbauer, W., van den Berg, D., Bockting, C., & van Amelsvoort, T. (2024). Transdiagnostic ecological momentary intervention for improving self-esteem in youth exposed to childhood adversity. JAMA Psychiatry, 81(3), 227. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Reininghaus, U., Paetzold, I., Rauschenberg, C., Hirjak, D., Banaschewski, T., Meyer-Lindenberg, A., Boehnke, J. R., Boecking, B., & Schick, A. (2023). Effects of a Novel, transdiagnostic ecological momentary intervention for prevention, and early intervention of severe mental disorder in youth (EMIcompass): Findings from an exploratory randomized controlled trial. Schizophrenia Bulletin, 49(3), 592–604. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Robillard, J. M., Feng, T. L., Sporn, A. B., Lai, J.-A., Lo, C., Ta, M., & Nadler, R. (2019). Availability, readability, and content of privacy policies and terms of agreements of mental health apps. Internet Interventions, 17, 100243. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Sauer-Zavala, S., Rosellini, A. J., Bentley, K. H., Ametaj, A. A., Boswell, J. F., Cassiello-Robbins, C., Wilner Tirpak, J., Farchione, T. J., & Barlow, D. H. (2021). Skill acquisition during transdiagnostic treatment with the unified protocol. Behavior Therapy, 52(6), 1325–1338. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Schaeuffele, C., Knaevelsrud, C., Renneberg, B., & Boettcher, J. (2025). Understanding change from the patient perspective in a transdiagnostic Internet-based intervention for emotional disorders: A qualitative content analysis. Cognitive Behaviour Therapy, 54(2), 190–207. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Schick, A., Paetzold, I., Rauschenberg, C., Hirjak, D., Banaschewski, T., Meyer-Lindenberg, A., Boehnke, J. R., Boecking, B., & Reininghaus, U. (2021). Effects of a novel, transdiagnostic, hybrid ecological momentary intervention for improving resilience in youth (EMIcompass): Protocol for an exploratory randomized controlled trial. JMIR Research Protocols, 10(12), e27462. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Schueller, S. M., Aguilera, A., & Mohr, D. C. (2017). Ecological momentary interventions for depression and anxiety. Depression and Anxiety, 34(6), 540–545. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Tong, A., Sainsbury, P., & Craig, J. (2007). Consolidated criteria for reporting qualitative research (COREQ): A 32-item checklist for interviews and focus groups. International Journal for Quality in Health Care, 19(6), 349–357. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Torous, J., Lipschitz, J., Ng, M., & Firth, J. (2020). Dropout rates in clinical trials of smartphone apps for depressive symptoms: A systematic review and meta-analysis. Journal of Affective Disorders, 263, 413–419. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Torous, J., Nicholas, J., Larsen, M. E., Firth, J., & Christensen, H. (2018). Clinical review of user engagement with mental health smartphone apps: Evidence, theory and improvements. Evidence Based Mental Health, 21(3), 116–119. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Torous, J., & Roberts, L. W. (2017). Needed innovation in digital health and smartphone applications for mental health. JAMA Psychiatry, 74(5), 437. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- van Ballegooijen, W., Cuijpers, P., van Straten, A., Karyotaki, E., Andersson, G., Smit, J. H., & Riper, H. (2014). adherence to internet-based and face-to-face cognitive behavioral therapy for depression: A meta-analysis. PLoS ONE, 9(7), e100674. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Vieta, E., Alonso, J., Pérez-Sola, V., Roca, M., Hernando, T., Sicras-Mainar, A., Sicras-Navarro, A., Herrera, B., & Gabilondo, A. (2021). Epidemiology and costs of depressive disorder in Spain: The EPICO study. European Neuropsychopharmacology, 50, 93–103. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- World Health Organization. (2019). The WHO special initiative for mental health (2019–2023): Universal health coverage for mental health (pp. 1–4). World Health Organization. Available online: https://apps.who.int/iris/bitstream/handle/10665/310981/WHO-MSD-19.1-eng.pdf?ua=1 (accessed on 1 June 2026).
- World Health Organization. (2025). World mental health today: Latest data. World Health Organization. [Google Scholar]
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2026 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license.