Next Article in Journal
Using Behavioural Skills Training with Healthcare Staff to Promote Greater Independence for People Living with Dementia: A Randomised Single-Case Experimental Design
Next Article in Special Issue
Network Analysis of Psychopathological Dimensions in Patients with and Without Suicidal Ideation
Previous Article in Journal
The Associations Between Parental Playfulness, Parenting Styles, the Coparenting Relationship and Child Playfulness
Previous Article in Special Issue
Social Cognition in Suicidal Behavior in Psychosis: A Systematic Review
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Concurrent Validity of Digital Measures of Psychological Dimensions Associated with Suicidality Using AuxiliApp

by
Miguel Zacarías Pérez Sosa
1,2,
Diego de-la-Vega-Sánchez
1,2,*,
Sergio Sanz-Gómez
2,
Adrián Alacreu-Crespo
3,
Pedro Moreno-Gea
4,
Pilar A. Saiz
5,6,7,8,
Julio Seoane Rey
9,
José Giner
2 and
Lucas Giner
2
1
Hospital Universitario Virgen Macarena, 41009 Sevilla, Spain
2
Departamento de Psiquiatría, Universidad de Sevilla, 41013 Sevilla, Spain
3
Departamento de Psicología y Sociología, Universidad de Zaragoza, 50009 Zaragoza, Spain
4
Psiquiatria, 30204 Cartagena, Spain
5
Departamento de Psiquiatría, Universidad de Oviedo, 33003 Oviedo, Spain
6
Centro de Investigación Biomédica en Red en Salud Mental (CIBERSAM), Instituto de Salud Carlos III, 28029 Madrid, Spain
7
Instituto de Investigación Sanitaria del Principado de Asturias (ISPA), 33011 Oviedo, Spain
8
Servicio de Salud del Principado de Asturias (SESPA), 33011 Oviedo, Spain
9
Departamento de Psicología Social, Universidad de Valencia, 46010 Valencia, Spain
*
Author to whom correspondence should be addressed.
Behav. Sci. 2025, 15(7), 868; https://doi.org/10.3390/bs15070868
Submission received: 27 March 2025 / Revised: 19 June 2025 / Accepted: 22 June 2025 / Published: 26 June 2025
(This article belongs to the Special Issue Suicidal Behaviors: Prevention, Intervention and Postvention)

Abstract

Suicide is a major public health concern, and accurate risk assessment is essential for prevention. Slider-format questions offer a quick, intuitive, and accessible method to evaluate suicide-related dimensions. This study examines the reliability of slider-based items compared to standardized psychometric instruments when delivered via a mobile app. A total of 299 university students completed a digital self-report questionnaire using the AuxiliApp mobile platform. Participants answered validated scales assessing depression, psychological pain, suicidal ideation, anger, impulsivity, loneliness, and reasons for living, each presented in both traditional Likert and novel slider formats. Pearson correlations were used to evaluate the relationship between traditional and slider-based scores. All correlations were statistically significant (p < 0.001). Moderate correlations were found in most domains, including depression, psychological pain, suicidal ideation, loneliness, and key aspects of impulsivity and anger. Lower correlations appeared in subscales related to anger control and protective beliefs against suicide. Slider-based items demonstrated acceptable psychometric equivalence and concurrent validity compared to traditional scales. Their brevity and compatibility with mobile devices support their use in telehealth and digital mental health screening. While not a replacement for clinical evaluation, they may facilitate early detection and ongoing monitoring in at-risk populations.

1. Introduction

Suicide remains a critical global public health issue, accounting for a significant number of deaths worldwide. According to the World Health Organization (WHO), nearly 800,000 people die by suicide each year, representing approximately 1.4% of all deaths globally (Wang et al., 2016). This issue is particularly pressing among young adults (World Health Organization, 2021). Numerous risk factors have been identified in association with suicidal behavior, including the presence of a mental disorder—87.3% of individuals who die by suicide are estimated to have been diagnosed with a mental illness prior to their death (Arsenault-Lapierre et al., 2004)—as well as traits such as impulsivity, aggressiveness, and emotional instability (Chamorro et al., 2012; Critchfield et al., 2004; Lin & Zhang, 2017).
Impulsivity—defined as a predisposition to act without forethought or planning, often resulting in adverse consequences for oneself or others—has been consistently associated with suicidal behaviors (Herpertz et al., 1995; Simeon et al., 1992; Swann et al., 2020; Moore et al., 2023), including self-harm (Hamza et al., 2015; Hamza & Willoughby, 2019), suicide attempts (Auerbach et al., 2017; Cole et al., 2019; Costanza et al., 2020; Liu et al., 2017), and deaths by suicide (Alasaarela et al., 2017; Dalca et al., 2013; Caro-Cañizares et al., 2024), particularly among younger populations (Alasaarela et al., 2017; Auerbach et al., 2017). This association is robust across various populations, including psychiatric inpatients, those with substance use disorders, and individuals with trauma histories, and its effect is especially pronounced when measured close in time to suicidal behavior (Horesh et al., 1997; Kotler et al., 2001). Neurobiological links also highlight impulsivity and aggression as associated with altered brain function in regions responsible for emotion regulation, potentially serving as biological markers for suicide risk (Lee et al., 2024; Swann et al., 2020).
Anger has also been linked to suicidal behavior (Hawkins et al., 2014; Maino et al., 2019; Rogers et al., 2017; Moore et al., 2023), especially in individuals with post-traumatic stress disorder (Dillon et al., 2020; Wilks et al., 2019; Kotler et al., 2001) and among adolescents and young adults (Nock et al., 2013; Park et al., 2010), particularly young males (Daniel et al., 2009; Esposito et al., 2003). Associations have also been observed in populations with borderline personality disorder (Evren et al., 2011; Mercer et al., 2009; Stringer et al., 2013; Giegling et al., 2009) and major depressive disorder (Painuly et al., 2007). While anger alone may be less specific to suicide risk than impulsivity, its presence is often elevated in those with mental health issues (Horesh et al., 1997; Caro-Cañizares et al., 2024). Crucially, high levels of both anger and impulsivity can act synergistically, further increasing suicide risk beyond the effect of either trait alone, mediating the impact of stressful life events on suicide risk (Horesh et al., 1997; Moore et al., 2023; Caro-Cañizares et al., 2024).
Other psychological dimensions related to suicide risk include psychological pain (Holden et al., 2001; Troister & Holden, 2012, 2013), loneliness (Ernst et al., 2021; Killgore et al., 2020), and the absence of reasons for living (Chen et al., 2020; Rozek et al., 2021). To identify individuals at elevated risk of suicide, clinicians and researchers rely on assessment tools that evaluate these dimensions. The Beck inventories, for example, have been used to detect individuals at risk through scales assessing depression (Green et al., 2015; Troister et al., 2015), hopelessness (T. Beck et al., 1990; Rueda-Jaimes et al., 2018; Sánchez-Teruel et al., 2020; Sueki, 2022), and suicidal intent (Harriss & Hawton, 2005; Stefansson et al., 2012; Sun et al., 2015; Zhang & Jia, 2007).
Several strategies have demonstrated efficacy in the prevention of suicidal behavior. These include early detection of suicidal ideation and behavior, the implementation of individualized safety plans during crises, timely access to specialized mental healthcare—especially following critical events such as hospital discharge—continuity of care, and the presence of strong social and family support networks (Turecki et al., 2019; Zalsman et al., 2016). The COVID-19 pandemic appears to have exacerbated suicide risk through two primary mechanisms: by intensifying known risk factors such as psychological distress, social isolation, and hopelessness; and by undermining the functioning of public health systems (Dubé et al., 2021; Reger et al., 2020). In response to these systemic strains and growing needs within the population, it is imperative to reconsider and innovate our approaches to suicide prevention.
New technologies and telemedicine are rapidly transforming healthcare delivery, offering unprecedented opportunities to reach individuals who might otherwise lack access to mental health services (Hilty et al., 2022; Lindsay et al., 2024; Olié et al., 2021). The COVID-19 pandemic significantly accelerated the adoption of telehealth, demonstrating its feasibility and utility for a wide range of psychiatric interventions, including psychotherapy, medication management, and crisis support (Heidari et al., 2023; Alemu et al., 2023). Mobile applications, in particular, provide a ubiquitous and convenient platform for self-monitoring, psychoeducation, and even early detection of mental health concerns, including those related to suicide risk (Areán et al., 2021). These tools can bridge geographical barriers, reduce stigma, and offer discreet support, making them invaluable assets in modern mental health frameworks (Melia et al., 2020). However, it is important to note that a systematic review of mobile applications for depression and suicide prevention revealed that only a small fraction incorporated evidence-based strategies to address suicidal behavior (Torous & Roberts, 2017). This highlights a critical gap in the application of digital technologies for suicide prevention.
Accurate and timely identification of individuals at risk is paramount for effective prevention strategies. Traditional methods of psychological assessment, though well-established, can sometimes be lengthy, resource-intensive, or less engaging, particularly for younger, digitally native populations. In this context, the development and validation of innovative assessment tools adapted to digital platforms are crucial for enhancing accessibility, efficiency, and user engagement in mental healthcare. Numerous studies have shown that participants tend to feel more comfortable completing electronic questionnaires than traditional paper-based ones. Electronic formats enhance accessibility and optimize time efficiency, while demonstrating acceptable psychometric equivalence, provided that standardized protocols are followed and the tools are properly validated (Barrigón et al., 2017).
Visual analog scales (VAS), or slider-type questions, offer a continuous graphical format that allows individuals to indicate the position that best reflects their subjective experience. These scales are generally quicker, simpler, and more intuitive to complete. Research has demonstrated robust correlations between VAS and traditional measures in domains such as affective and psychotic symptoms. For example, Palmier-Claus and colleagues (Palmier-Claus et al., 2012) validated an analog-format self-report tool named ClinTouch, comparing it with the PANSS and Calgary scales, finding moderate to strong associations for several parameters. Similarly, a review examining digital self-report questionnaires in patients with depression and mania (Faurholt-Jepsen et al., 2016) found that instruments evaluated in depression studies demonstrated good validity and reliability when compared with established clinical scales.
Given the nascent development and empirical investigation of slider-format questions for these specific psychological constructs in mobile health applications, this study aims to compare the psychometric equivalence and utility of traditional paper-based scales with matched slider-format questions assessing dimensions related to suicide risk, including suicidal intent, impulsivity, aggressiveness, anger, depression, reasons for living, loneliness, and psychological pain. This study adopts an exploratory research design to examine the psychometric equivalence between these novel digital items and established standardized scales, all administered within a mobile application.

2. Materials and Methods

This study employed a quantitative, cross-sectional, and correlational design aimed at assessing the psychometric equivalence of slider-format questions against established standardized scales when administered via a mobile application. Data collection was synchronous, meaning all data for each participant were collected at a single point in time.

2.1. Participants

A total of 299 university students from various universities across Spain participated in the study. The mean age of the sample was M = 19.86, SD = 1.86 years, and 71.2% of the participants were women. A total of 73.9% of participants were enrolled at the University of Seville, while the remaining 26.1% attended the University of Oviedo. Most participants (121) were studying medicine (50.5%), followed by nursing and physiotherapy (42.8%), and criminology (6.7%). The recruitment of participants was conducted using a non-probabilistic convenience sampling method, involving invitations distributed through university channels and social media across the country.
Inclusion criteria for participation were being a university student, being 18 years of age or older, being healthy volunteers, providing informed consent, having access to a mobile device with internet connection, and ability to comprehend and respond to questionnaires in Spanish. Exclusion criteria for participation were failure to complete all study questionnaires, providing inconsistent or invalid responses (e.g., straight-lining, obvious random responses).
The study was conducted entirely in Spanish.

2.2. Sample Size and Power Analysis

A formal power analysis was not conducted prior to data collection. This study adopted an exploratory research design to investigate the psychometric equivalence of a novel assessment format for suicide-related dimensions. The sample size was primarily determined by convenience and participant availability within the university setting, aiming to recruit a sufficient number of participants to explore the relationships between the measures. While a power analysis was not performed, the collected sample size of 299 participants was considered appropriate for detecting correlations of moderate effect size (r > 0.3) given the nature of the study and in line with typical sample sizes in instrument validation research.

2.3. Ethical Considerations

The study protocol, titled ‘Validación de escalas de valoración del riesgo de suicidio en versión analógica’, was reviewed and received a favorable dictamen from the Comité Coordinador de Ética de la Investigación Biomédica de Andalucía on 29 May 2017, under protocol version V1. All participants provided informed consent digitally prior to their participation. They were fully informed about the study’s objectives, procedures, potential risks, and benefits, as well as their right to withdraw at any time without penalty. Participant data were handled with strict confidentiality and anonymity, in accordance with ethical guidelines.

2.4. Procedure

The study was conducted entirely through AuxiliApp, a proprietary mobile application designed for mental health assessment and support. All participants completed a self-administered digital questionnaire via this mobile platform. Data collection was therefore 100% digital, ensuring consistency in the administration format.
Regarding the administration flow, participants first completed the entire battery of original, multi-item validated scales, administered digitally within the AuxiliApp (see Figure 1). Each of these original scales preserved its specific, original response format (e.g., categories, numerical ranges, or yes/no options as per its design). Following the completion of all original scales, participants then proceeded to complete a collection of single slider-format items, each carefully selected by the research team as most representative for a specific construct (e.g., mood, loneliness, impulsivity). These slider items universally utilized a 0–10 continuous scale. All assessments were conducted sequentially within a single digital session on the AuxiliApp (https://psiquiatria.com/publico/index.php; accessed on 20 December 2024), ensuring a consistent testing environment for all participants. This sequential administration within a single session allowed for the assessment of convergent validity between the traditional multi-item scales and their novel slider-format counterparts, thereby evaluating the psychometric equivalence of these different assessment formats for the same constructs.
The development of the slider-format items for AuxiliApp was a meticulous process undertaken by the research team. The team comprises university professors and distinguished academics with extensive expertise in suicidology, psychometrics, and instrument development. Notably, several members, including Professors Sáiz Martínez, Pilar, Seoane Rey, Julio, Giner Ubago, and José (all full professors), have a proven track record in both developing novel psychological instruments (e.g., the Oviedo Sleep Questionnaire; Paz García-Portilla et al., 2009) and rigorously adapting numerous internationally recognized scales into Spanish (e.g., Social Anxiety and Distress Scale, Sheehan Disability Inventory; Bobes García et al., 1999; MINI International Neuropsychiatric Interview; Ferrando et al., 1998; EuropASI; Bobes et al., 1996; Clinician Administered PTSD Scale (CAPS); Grupo Español de Trabajo para la Evaluación por Estrés Postraumático, 2000, among others).
The decision-making process for item selection and their subsequent adaptation to the slider format was achieved through multiple consensus meetings among the research team. These discussions leveraged the team’s collective clinical and psychometric expertise, informed by a thorough review of existing scientific literature on digital assessment and the psychometric properties of the original scales. The primary objective was to create digital equivalents that maintained the psychometric integrity and semantic content of established, validated instruments.
Specifically, the slider-format items were conceived as a direct, literal, one-to-one adaptation of the original items from the selected standardized scales. Minor linguistic adjustments were applied to enhance clarity and natural flow within a digital self-report context, while scrupulously preserving the semantic meaning of the original questions. For instance, an item like “I keep calm” from the original STAXI scale was rephrased to “¿Mantiene la calma?” (Do you keep calm?) or “I get angry easily” to “¿Se enfada con facilidad?” (Do you get angry easily?) in the slider format. These adaptations were solely aimed at optimizing readability and user experience within the app without altering the underlying construct being measured.
The rationale for reversing certain items was grounded in psychometric principles. For the majority of scales, a higher numerical score consistently indicates a greater severity or presence of a symptom. For items or subscales designed to measure the absence of a symptom or the presence of a protective factor (e.g., reasons for living), the response scale for the slider was intentionally reversed. This ensured that, for all measured dimensions, a higher numerical value assigned by the slider consistently reflected a greater level of the measured construct (e.g., more reasons for living), thereby maintaining a uniform interpretative direction for all data analysis.

2.5. Instruments

All instruments were administered digitally through AuxiliApp, presenting two distinct formats: the original validated Likert-type scale format and a novel slider-format adaptation. Participants completed both versions for each dimension. The dimensions assessed were suicidal intent, impulsivity, aggressiveness, anger, depression, reasons for living, loneliness, and psychological pain.
  • Beck Depression Inventory-II (BDI-II): Assesses the severity of depressive symptoms (A. T. Beck et al., 1960; Spanish adaptation by Sanz et al., 2003, which reported an excellent internal consistency of α = 0.89 in the general population). The scale consists of 21 items rated on a 4-point scale from 0 to 3, covering emotional, cognitive, and somatic aspects of depression, such as hopelessness, guilt, and physical discomfort.
  • Psychache Scale: Measures psychological pain using 13 items rated on a 5-point Likert scale (Holden et al., 2001; Spanish adaptation by Ordóñez-Carrasco et al., 2022, which reported an excellent internal consistency of α = 0.90). Higher scores indicate greater levels of psychological distress.
  • Paykel Suicide Scale (PSS): Assesses the severity and frequency of suicidal ideation. For this study, we utilized a Spanish adaptation for adolescents (Fonseca-Pedrero et al., 2018; see also Baños-Chaparro & Ramos-Vera, 2020, who reported an excellent internal consistency of α = 0.94 in a Peruvian adolescent sample).
  • State-Trait Anger Expression Inventory-2 (STAXI-2): Evaluates the experience, expression, and control of anger (Spielberger et al., 1983; Spanish adaptation by Miguel-Tobal et al., 2001). The scale comprises several subscales, including State Anger, Trait Anger, Anger Expression-Out, Anger Expression-In, Anger Control-Out, and Anger Control-In. Psychometric studies of its Spanish version have demonstrated good internal consistency, with Cronbach’s alpha values ranging from 0.70 to 0.90 for its various subscales (e.g., García-Batista et al., 2018).
  • UCLA Loneliness Scale: Designed to assess perceived loneliness and social isolation. It contains 20 items rated on a 4-point scale, with higher scores indicating more frequent experiences of loneliness (Russell, 1996; Spanish adaptation by Vázquez Morejón & Jiménez García-Bóveda, 1994; see also Velarde-Mayol et al., 2016) has shown high reliability, with an excellent internal consistency of α = 0.90.
  • Barratt Impulsiveness Scale (BIS): A widely used self-report measure of impulsivity (Patton et al., 1995). For this study, the Spanish adaptation for adolescents (Martínez-Loredo et al., 2015) was utilized, which has demonstrated good psychometric properties, including excellent internal consistency for the total scale (α = 0.89) and good consistency for its subscales (Attentional Impulsivity: α = 0.70; Non-planning Impulsivity: α = 0.81; Motor Impulsivity: α = 0.79).
  • Reasons for Living Inventory (RFL): Measures an individual’s perceived reasons for not committing suicide (Linehan et al., 1983). The Spanish adaptation (Oquendo et al., 2000) has shown excellent internal consistency, with a Cronbach’s alpha of α = 0.94 for the total scale, and values ranging from 0.70 to 0.89 for its various subscales (Survival and Coping Beliefs, Responsibility to Family, Child Concerns, Fear of Suicide, Fear of Social Disapproval, and Moral/Religious Objections).
These instruments were selected for their relevance to suicide risk and their established psychometric properties. Each was paired with a slider-format item designed to assess the same construct in a more concise and accessible visually intuitive format within the AuxiliApp.

2.6. Statistical Analysis

Pearson product–moment correlation coefficients were calculated to assess the convergent validity between scores obtained from traditional multi-item scales and their corresponding slider-format items for each relevant construct (Cohen et al., 2003). This analysis aimed to evaluate the psychometric equivalence of the novel slider format against established measures.
Regarding the distribution of continuous variables, Pearson’s correlation coefficient was used due to its ability to measure the linear relationship between variables. Given the continuous nature of the data and the sample sizes for each correlation (ranging from N = 56 for the Beck Depression Inventory to N = 274 for the Reasons for Living Inventory), this statistic was considered appropriate for the purposes of this study, relying on the robustness of Pearson’s r in samples of this size.

3. Results

Prior to presenting the main analyses, it is important to address the varying sample sizes across the instruments. While the majority of the scales included in AuxiliApp were completed by over 200 participants, the Beck Depression Inventory-II (BDI-II) had a substantially smaller valid sample size of N = 56. This discrepancy was primarily attributed to participant dropout or incomplete responses, likely due to the BDI-II being administered towards the end of a comprehensive battery of questionnaires. Given the extended length of the overall assessment, it is plausible that some participants discontinued the survey before completing this final instrument. All subsequent analyses involving the BDI-II are based on this sample size, and this limitation is acknowledged.
All Pearson correlations between the traditional scale scores and their corresponding slider-format items were statistically significant (p < 0.001). According to Guilford’s criteria (Guilford, 1956), most correlations were moderate (r = 0.40–0.70), while a subset were low (r = 0.20–0.40), particularly in subscales related to anger expression and family-based protective beliefs.
Moderate correlations were observed between the slider items and the traditional instruments assessing depression (BDI-II, r = −0.541), psychological pain (Psychache Scale, r = 0.598), suicidal ideation (Paykel, r = 0.503), loneliness (UCLA, r = 0.582), and several impulsivity and anger-related dimensions. Specifically, the BIS subscales showed correlations of r = −0.581 (Cognitive/Attentional), r = −0.445 (Non-Planning), and r = 0.426 (Motor). For anger, STAXI-2 subscales showed moderate correlations in State Anger (r = 0.459), Trait Anger (r = 0.558), and Anger Expression-In (r = 0.489).
Lower correlations were found for STAXI-2 subscales of Anger Expression-Out (r = 0.292), External Anger Control (r = 0.354), and Internal Anger Control (r = 0.380). Similarly, within the Reasons for Living Inventory (RFL), the Survival and Coping Beliefs subscale showed a moderate negative correlation (r = −0.589), while the Family Responsibility and Child-Related Concerns (r = −0.382), Fear of Suicide (r = −0.283), Fear of Social Disapproval (r = −0.455), and Moral Objections (r = −0.359) subscales showed low correlations.
In all inversely worded items, higher traditional scale scores (indicating greater symptomatology or protective beliefs) corresponded to lower scores on the associated slider question, accounting for the negative correlations. Overall, the data supports the validity of slider-format questions as a simplified yet valid alternative for assessing core dimensions related to suicide risk.
A detailed comparison of the means and correlations between the traditional and slider-format items is presented in Table 1.

4. Discussion

Our findings indicate that slider-format items can approximate scores from validated instruments with moderate correlations in most domains, including depression, psychological pain, suicidal ideation, loneliness, and core aspects of impulsivity and anger. Specifically, these moderate correlations provide evidence of convergent validity for the slider items across these dimensions. The demonstrated feasibility of digitally assessing constructs like impulsivity and anger, consistently identified as key risk factors for suicidal behavior (Moore et al., 2023; Caro-Cañizares et al., 2024; Lee et al., 2024), underscores the potential of mobile applications to facilitate timely and efficient risk assessments. While lower correlations were observed in some subscales—particularly those assessing nuanced components of anger regulation and certain protective beliefs against suicide—this does not diminish the potential utility of digital sliders, especially considering their brevity, accessibility, and ease of implementation.
The broader relevance of telemedicine has become undeniable, especially during the COVID-19 crisis. The pandemic not only challenged the capacity of healthcare systems, with a reported 90% of countries experiencing disruptions in essential health services (World Health Organization, 2021), but also profoundly reshaped how care is delivered and received. Many individuals refrained from seeking care for non-COVID-related issues (Moynihan et al., 2021), negatively affecting public health outcomes. The pandemic’s psychological impact is well documented: there has been a marked increase in the prevalence of mental disorders (Santomauro et al., 2021; Winkler et al., 2020), worsened outcomes for individuals with pre-existing psychiatric conditions (Neelam et al., 2021), and heightened suicide risk (Dubé et al., 2021; John et al., 2021). Some have even described this as a parallel pandemic of mental health (Patten et al., 2021) or predicted that mental illness will represent the next global health crisis (Ornell et al., 2021).
In this context, the integration of new technologies into clinical practice has transitioned from a complementary approach to a necessary evolution in care delivery. International healthcare systems rapidly pivoted from in-person consultations to virtual modalities (Wang et al., 2016), reinforcing the need for tools that are compatible with remote assessment. Accurate and timely identification of individuals at risk is paramount for effective prevention strategies. Traditional methods of psychological assessment, though well-established, can sometimes be lengthy, resource-intensive, or less engaging, particularly for younger, digitally native populations (Marciano & Saboor, 2023).
The present study sought to explore whether simplified, slider-format questions administered via a mobile app could serve as psychometrically equivalent and valid alternatives to traditional psychometric instruments in assessing suicide-related dimensions. The existing literature largely supports the digitalization of self-report measures. Rutherford’s meta-analysis (Rutherford et al., 2016) concluded that paper-based and electronic formats can be used interchangeably under appropriate conditions. Other researchers, while more cautious, recognize the advantages of digital adaptation, though they advise against assuming full psychometric equivalence without prior validation (Alfonsson et al., 2014; Barrigón et al., 2017; Gwaltney et al., 2008).
Slider questions provide a practical and highly intuitive format for widespread use across digital platforms, such as mobile phones and tablets. Their continuous visual nature offers a more nuanced response scale than discrete options, eliminating explicit numerical choices and facilitating a direct drag-and-drop interaction common in modern digital interfaces (Roster et al., 2015).
These features, combined with their inherent brevity, enhance user engagement and allow for broader reach, especially in underserved or geographically isolated populations (Melia et al., 2020). Unlike lengthy standardized scales, slider items can be completed quickly and easily, offering a feasible solution for both large-scale screening and ongoing patient monitoring.
Furthermore, the integration of digital tools, such as mobile applications, into mental healthcare delivery has gained significant traction, particularly in the context of suicide prevention. Evidence suggests that web-based and mobile interventions can play a vital role in various aspects of suicide prevention, including delivering psychoeducation, providing crisis support, enhancing coping skills, facilitating self-monitoring of mood and suicidal ideation, and improving access to care for underserved populations (Hilty et al., 2022; Lindsay et al., 2024; Olié et al., 2021; Areán et al., 2021). For instance, apps offering immediate access to helplines or safety planning tools have shown promise in acute crisis situations, while those incorporating cognitive behavioral therapy (CBT) or dialectical behavior therapy (DBT) elements can foster long-term resilience and skill development (Schäfer et al., 2024). While promising, a systematic review of mobile applications for depression and suicide prevention revealed that only a small fraction incorporated evidence-based strategies to address suicidal behavior (Torous & Roberts, 2017), highlighting a critical gap. Our study addresses this by specifically validating a novel, user-friendly assessment format that can enhance the utility and applicability of these technologies in mental health assessment and proactive suicide prevention.

Future Directions

Beyond the current findings, future research should explore more advanced psychometric properties and clinical applications of slider-based assessments. Specifically, assessing whether the psychometric equivalence and reliability of these scales vary among individuals with differing levels of suicidal ideation would be a highly valuable next step. Such subgroup analyses could reveal important nuances in the performance of these digital tools across different risk profiles, further enhancing their precision and clinical utility in targeted suicide prevention efforts. Additionally, longitudinal studies are needed to evaluate the test–retest reliability of slider items over time and their sensitivity to change following interventions, providing further evidence for their dynamic assessment capabilities. The feasibility of integrating such tools into clinical workflows warrants further exploration, particularly in primary care, university health services, and other first-line support environments.

5. Conclusions

In conclusion, this study provides compelling evidence for the psychometric equivalence and utility of slider-format questions integrated into a mobile app for assessing key dimensions related to suicide risk. This novel approach offers a highly intuitive and engaging method for data collection, potentially enhancing user compliance and data quality in self-report assessments. While these simplified tools should not replace comprehensive clinical evaluations, they hold promise for broad applications in early screening, symptom monitoring, and follow-up in mental health contexts. Their digital format aligns well with contemporary telemedicine practices and may help overcome structural and social barriers to care. The primary contribution of this research lies in validating a unique, user-friendly digital assessment format that goes beyond traditional Likert scales, offering a continuous and visually interactive response mechanism. This innovation has significant implications for advancing the field of digital mental health, particularly in suicide prevention, by facilitating rapid, sensitive, and accessible screening and monitoring of risk factors. Our findings support the integration of such innovative digital tools into comprehensive suicide prevention strategies, paving the way for more dynamic and personalized interventions. Continued research is needed to evaluate the clinical utility and diagnostic performance of slider-based assessments across diverse populations and settings.

6. Strengths and Limitations

One of the key strengths of this study lies in its innovative use of slider-format items within a mobile application to assess complex psychological constructs associated with suicide risk. The digital nature of the tool offers advantages in terms of cost-efficiency, accessibility, and scalability, making it well-suited for large-scale implementation and routine screening. Moreover, the inclusion of a young university population—typically comfortable with digital platforms—enhances the ecological validity of the method. A key novelty of this study lies in its comprehensive validation of a broad range of suicide-risk factors using the innovative slider format delivered through a dedicated mental health application (AuxiliApp).
However, this study is not without limitations. First, the sample consisted exclusively of university students, limiting the generalizability of the findings to broader or clinical populations. While this population is highly relevant given the rising rates of mental health concerns and suicide risk in young adults, it is also characterized by a higher level of education and digital literacy, which may have contributed to the observed high usability and acceptance of the mobile application. Consequently, the generalizability of our findings to broader or more diverse populations, including individuals with lower educational attainment, older adults, or those with limited technological proficiency, cannot be assumed. Future research should aim to replicate these findings in more heterogeneous populations to establish the broader applicability of slider-based assessment formats in diverse clinical and general settings. Second, while correlations between slider and traditional items were statistically significant, some remained in the low range, particularly in constructs related to anger control and moral or familial reasons for living. Additionally, the study did not assess predictive validity or compare diagnostic performance, nor did it establish specific clinical cutoffs or diagnostic thresholds for the novel slider format. The current 0–10 scale for slider items, while intuitive, lacks the direct interpretative or diagnostic capability of traditional scales with established severity categories. Finally, inverse wording in some slider items may have introduced interpretive variability.

Author Contributions

Conceptualization, L.G. and J.S.R.; Methodology, M.Z.P.S.; Software, P.M.-G.; Validation, P.M.-G., M.Z.P.S. and D.d.-l.-V.-S.; Formal Analysis, D.d.-l.-V.-S. and P.M.-G.; Investigation, J.S.R. and J.G.; Resources, P.A.S. and L.G.; Data Curation, A.A.-C.; Writing—Original Draft Preparation, M.Z.P.S.; Writing—Review and Editing, M.Z.P.S., D.d.-l.-V.-S., S.S.-G. and A.A.-C.; Visualization, S.S.-G. and A.A.-C.; Supervision, M.Z.P.S.; Project Administration, L.G. and J.S.R.; Funding Acquisition, L.G. All authors have read and agreed to the published version of the manuscript.

Funding

Sergio Sanz-Gómez work is funded by the VI-PPITUS.

Institutional Review Board Statement

The study was conducted according to the guidelines of the Declaration of Helsinki, and approved by the Research Ethics Committee (CEI) of the Virgen Macarena—Virgen del Rocío University Hospitals (Approval number: 20175291893; Date: 29 May 2017).

Informed Consent Statement

Informed consent was obtained from all participants involved in the study. Written informed consent was provided electronically upon entry into the study application, and signing the consent form was a prerequisite for participation. All participants provided informed consent to take part in the study anonymously, without any financial or academic compensation, through the same application used for participation.

Data Availability Statement

The data supporting the findings of this study are available from the corresponding author upon reasonable request.

Acknowledgments

We would like to thank the University of Seville, the University of Oviedo, and the Spanish Foundation of Psychiatry and Mental Health (Fundación Española de Psiquiatría y Salud Mental) for their support.

Conflicts of Interest

Author Pedro Moreno Gea is Chief Editor of Psiquiatria. The remaining authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest. The sponsors had no role in the design, execution, interpretation, or writing of the study.

Abbreviations

The following abbreviations are used in this manuscript:
BDI-IIBeck Depression Inventory-II
BISBarratt Impulsiveness Scale
CC BYCreative Commons Attribution license
COVID-19Coronavirus Disease 2019
GHQ-12General Health Questionnaire-12
IDS-CInventory of Depressive Symptomatology—Clinician-rated
INEInstituto Nacional de Estadística
mHealthMobile Health (salud móvil)
NTNew technologies
PANSSPositive and Negative Syndrome Scale
PHQ-9Patient Health Questionnaire-9
QISD-SR 16Questionnaire for Impulsive and Self-Destructive Behaviors—Self-Report, 16 items
RFLReasons for Living Inventory
SPSSStatistical Package for the Social Sciences
STAXI-2State-Trait Anger Expression Inventory-2
UCLAUniversity of California, Los Angeles (en “UCLA Loneliness Scale”)
VASVisual Analog Scale
VI-PPITUSVI Plan Propio de Investigación y Transferencia de la Universidad de Sevilla
WHOWorld Health Organization

References

  1. Alasaarela, L., Hakko, H., Riala, K., & Riipinen, P. (2017). Association of self-reported impulsivity to nonsuicidal self-injury, suicidality, and mortality in adolescent psychiatric inpatients. Journal of Nervous and Mental Disease, 205(5), 340–345. [Google Scholar] [CrossRef]
  2. Alemu, Y., Chen, H., Duan, C., Caulley, D., Arriaga, R. I., & Sezgin, E. (2023). Detecting Clinically Relevant Emotional Distress and Functional Impairment in Children and Adolescents: Protocol for an Automated Speech Analysis Algorithm Development Study. JMIR Research Protocols, 12, e46970. [Google Scholar] [CrossRef] [PubMed]
  3. Alfonsson, S., Maathz, P., & Hursti, T. (2014). Interformat reliability of digital psychiatric self-report questionnaires: A systematic review. Journal of Medical Internet Research, 16(12), e268. [Google Scholar] [CrossRef] [PubMed]
  4. Areán, P., Pratap, A., Hsin, H., Huppert, T. K., E Hendricks, K., Heagerty, P. J., Cohen, T., Bagge, C., & Comtois, K. A. (2021). Perceived utility and characterization of personal google search histories to detect data patterns proximal to a suicide attempt in individuals who previously attempted suicide: Pilot cohort study. Journal of Medical Internet Research, 23(5), e27918. [Google Scholar] [CrossRef] [PubMed]
  5. Arsenault-Lapierre, G., Kim, C. D., & Turecki, G. (2004). Psychiatric diagnoses in 3275 suicides: A meta-analysis. BMC Psychiatry, 4, 37. [Google Scholar] [CrossRef]
  6. Auerbach, R. P., Stewart, J. G., & Johnson, S. L. (2017). Impulsivity and suicidality in adolescents inpatients. Journal of Abnormal Child Psychology, 45(1), 91–103. [Google Scholar] [CrossRef]
  7. Baños-Chaparro, J., & Ramos-Vera, C. (2020). Validez e invarianza según sexo y edad de la Escala Paykel de Ideación Suicida en adolescentes peruanos. Interacciones, 6(1), e225. [Google Scholar] [CrossRef]
  8. Barrigón, M. L., Rico-Romano, A. M., Ruiz-Gomez, M., Delgado-Gomez, D., Barahona, I., Aroca, F., & Baca-García, E. (2017). Estudio comparativo de los formatos en lápiz y papel y electrónicos de los cuestionarios GHQ-12, WHO-5 y PHQ-9. Revista de Psiquiatría y Salud Mental, 10(3), 160–167. [Google Scholar] [CrossRef]
  9. Beck, A. T., Ward, C. H., Mendelson, M., Mock, J., & Erbaugh, J. (1960). An inventory for measuring depression. Archives of General Psychiatry, 4(6), 561–571. [Google Scholar] [CrossRef]
  10. Beck, T., Brown, G., Berchick, J., Stewart, L., Steer, A., Ed, D., & Ph, D. (1990). Relationship between hopelessness and ultimate suicide: A replication with psychiatric outpatients. American Journal of Psychiatry, 147, 190–195. [Google Scholar] [CrossRef]
  11. Bobes, J., González, M. P., Saiz, P. A., & Bousoño, M. (1996). Índice europeo de severidad de la adicción: EuropASI. Versión española. Actas de la IV Reunión Interregional de Psiquiatría, 1996, 201–218. [Google Scholar]
  12. Bobes García, J., Badia Llach, X., Luque, A., García, M., González Rodríguez, M. P., Dal-Ré Saavedra, R., & Grupo de Validación en Español de Cuestionarios de Evaluación de la Fobia Social. (1999). Validación de las versiones en español de los cuestionarios liebowitz social anxiety scale, social anxiety and distress scale y sheehan disability inventory para la evaluación de la fobia social. Medicina Clínica, 112(14), 530–538. [Google Scholar]
  13. Caro-Cañizares, I., Brenlla, M., Carballo, J., Santos, M., Guija, J., & Giner, L. (2024). Suicidal behaviour and stressful life events: The Mediating role of the impulsivity-aggression-hostility triad through psychological autopsy. Psicothema, 36(4), 380–388. [Google Scholar] [CrossRef]
  14. Chamorro, J., Bernardi, S., Potenza, M. N., Grant, J. E., Marsh, R., Wang, S., & Blanco, C. (2012). Impulsivity in the general population: A national study. Journal of Psychiatric Research, 46(8), 994–1001. [Google Scholar] [CrossRef]
  15. Chen, J. I., Osman, A., Freedenthal, S. L., & Gutierrez, P. M. (2020). An examination of the psychometric properties of the reasons for living inventory within a male veteran clinical sample. Archives of Suicide Research, 24(Suppl. S1), 204–230. [Google Scholar] [CrossRef]
  16. Cohen, J., Cohen, P., West, S. G., & Aiken, L. S. (2003). Applied multiple regression/correlation analysis for the behavioral sciences (3rd ed.). Lawrence Erlbaum Associates Publishers. [Google Scholar]
  17. Cole, A. B., Littlefield, A. K., Gauthier, J. M., & Bagge, C. L. (2019). Impulsivity facets and perceived likelihood of future suicide attempt among patients who recently attempted suicide. Journal of Affective Disorders, 257, 195–199. [Google Scholar] [CrossRef] [PubMed]
  18. Costanza, A., Rothen, S., Achab, S., Thorens, G., Baertschi, M., Weber, K., Canuto, A., Richard-Lepouriel, H., Perroud, N., & Zullino, D. (2020). Impulsivity and impulsivity-related endophenotypes in suicidal patients with substance use disorders: An exploratory study. International Journal of Mental Health and Addiction, 19, 1729–1744. [Google Scholar] [CrossRef]
  19. Critchfield, K. L., Levy, K. N., & Clarkin, J. F. (2004). The relationship between impulsivity, aggression, and impulsive-aggression in borderline personality disorder: An empirical analysis of self-report measures. Journal of Personality Disorders, 18(6), 555–570. [Google Scholar] [CrossRef]
  20. Dalca, I. M., McGirr, A., Renaud, J., & Turecki, G. (2013). Gender-specific suicide risk factors: A case-control study of individuals with major depressive disorder. Journal of Clinical Psychiatry, 74(12), 1209–1215. [Google Scholar] [CrossRef]
  21. Daniel, S. S., Goldston, D. B., Erkanli, A., Franklin, J. C., & Mayfield, A. M. (2009). Trait anger, anger expression, and suicide attempts among adolescents and young adults: A prospective study. Journal of Clinical Child and Adolescent Psychology, 38(5), 661–671. [Google Scholar] [CrossRef]
  22. Dillon, K. H., Van Voorhees, E. E., Dennis, P. A., Glenn, J. J., Wilks, C. R., Morland, L. A., Beckham, J. C., & Elbogen, E. B. (2020). Anger mediates the relationship between posttraumatic stress disorder and suicidal ideation in veterans. Journal of Affective Disorders, 269, 117–124. [Google Scholar] [CrossRef] [PubMed]
  23. Dubé, J. P., Smith, M. M., Sherry, S. B., Hewitt, P. L., & Stewart, S. H. (2021). Suicide behaviors during the COVID-19 pandemic: A meta-analysis of 54 studies. Psychiatry Research, 301, 113998. [Google Scholar] [CrossRef] [PubMed]
  24. Ernst, M., Klein, E. M., Beutel, M. E., & Brähler, E. (2021). Gender-specific associations of loneliness and suicidal ideation in a representative population sample: Young, lonely men are particularly at risk. Journal of Affective Disorders, 294, 63–70. [Google Scholar] [CrossRef] [PubMed]
  25. Esposito, C., Spirito, A., Boergers, J., & Donaldson, D. (2003). Affective, behavioral, and cognitive functioning in adolescents with multiple suicide attempts. Suicide and Life-Threatening Behavior, 33(4), 389–399. [Google Scholar] [CrossRef]
  26. Evren, C., Cinar, O., Evren, B., & Celik, S. (2011). History of suicide attempt in male substance-dependent inpatients and relationship to borderline personality features, anger, hostility and aggression. Psychiatry Research, 190(1), 126–131. [Google Scholar] [CrossRef]
  27. Faurholt-Jepsen, M., Munkholm, K., Frost, M., Bardram, J. E., & Kessing, L. V. (2016). Electronic self-monitoring of mood using IT platforms in adult patients with bipolar disorder: A systematic review of the validity and evidence. BMC Psychiatry, 16(1), 7. [Google Scholar] [CrossRef]
  28. Ferrando, L., Bobes, J., Gibert, M., Soto, M., & Soto, O. (1998). M.I.N.I. mini international neuropsychiatric interview. Versión en español 5.0.0.DSM-IV. Instituto IAP. [Google Scholar]
  29. Fonseca-Pedrero, E., Inchausti, F., Pérez-Gutiérrez, L., Aritio Solana, R., Ortuño-Sierra, J., Sánchez-García, M. A., Lucas-Molina, B., Domínguez, C., Foncea, D., Espinosa, V., Gorría, A., Urbiola-Merina, E., Fernández, M., Merina Díaz, C., Gutiérrez, C., Aures, M., Campos, M. S., & Pérez de Albéniz Iturriaga, A. (2018). Ideación suicida en una muestra representativa de adolescentes españoles. Revista de Psiquiatría y Salud Mental, 11(2), 76–85. [Google Scholar] [CrossRef]
  30. García-Batista, Z. E., Guerra-Peña, K., Cano-Vindel, A., Herrera-Martínez, S. X., Flores-Kanter, P. E., & Medrano, L. A. (2018). Evidencias de validez y fiabilidad de las Puntuaciones del STAXI-2 para población general y hospitalaria: Estudio con una muestra de adultos de República Dominicana. Suma Psicológica, 25(1), 21–29. [Google Scholar] [CrossRef]
  31. Giegling, I., Olgiati, P., Hartmann, A., Calati, R., Möller, H., Rujescu, D., & Serretti, A. (2009). Personality and attempted suicide. Analysis of anger, aggression and impulsivity. Journal of Psychiatric Research, 43(16), 1262–1271. [Google Scholar] [CrossRef]
  32. Green, K. L., Brown, G. K., Jager-Hyman, S., Cha, J., Steer, R. A., & Beck, A. T. (2015). The predictive validity of the beck depression inventory suicide item. The Journal of Clinical Psychiatry, 76(12), 1683–1686. [Google Scholar] [CrossRef]
  33. Grupo Español de Trabajo para la Evaluación por Estrés Postraumático. (2000). Evaluación de las propiedades psicométricas de la versión española de cinco cuestionarios para la evaluación del trastorno de estrés postraumático. Actas Españolas de Psiquiatría, 28(4), 207–218. [Google Scholar]
  34. Guilford, J. P. (1956). Fundamental statistics in psychology and education (3rd ed.). McGraw-Hill. [Google Scholar]
  35. Gwaltney, C. J., Shields, A. L., & Shiffman, S. (2008). Equivalence of electronic and paper-and-pencil administration of patient-reported outcome measures: A meta-analytic review. Value in Health, 11(2), 322–333. [Google Scholar] [CrossRef]
  36. Hamza, C. A., & Willoughby, T. (2019). Impulsivity and nonsuicidal self-injury: A longitudinal examination among emerging adults. Journal of Adolescence, 75, 37–46. [Google Scholar] [CrossRef] [PubMed]
  37. Hamza, C. A., Willoughby, T., & Heffer, T. (2015). Impulsivity and nonsuicidal self-injury: A review and meta-analysis. Clinical Psychology Review, 38, 13–24. [Google Scholar] [CrossRef]
  38. Harriss, L., & Hawton, K. (2005). Suicidal intent in deliberate self-harm and the risk of suicide: The predictive power of the suicide intent scale. Journal of Affective Disorders, 86(2–3), 225–233. [Google Scholar] [CrossRef]
  39. Hawkins, K. A., Hames, J. L., Ribeiro, J. D., Silva, C., Joiner, T. E., & Cougle, J. R. (2014). An examination of the relationship between anger and suicide risk through the lens of the interpersonal theory of suicide. Journal of Psychiatric Research, 50(1), 59–65. [Google Scholar] [CrossRef] [PubMed]
  40. Heidari, P., Broadbear, J. H., Brown, R., Dharwadkar, N. P., & Rao, S. (2023). Mental health support for and telehealth use by Australians living with borderline personality disorder during the onset of the COVID-19 pandemic: A national study. Digital Health, 9, 20552076231169824. [Google Scholar] [CrossRef]
  41. Herpertz, S., Steinmeyer, S. M., Marx, D., Oidtmann, A., & Sass, H. (1995). The significance of aggression and impulsivitiy for self-mutilative behavior. Pharmacopsychiatry, 28(Suppl. S2), 64–72. [Google Scholar] [CrossRef]
  42. Hilty, D. M., Armstrong, C. M., A Smout, S., Crawford, A., Maheu, M. M., Drude, K. P., Chan, S., Yellowlees, P. M., & Krupinski, E. A. (2022). Findings and guidelines on provider technology, fatigue, and well-being: Scoping review. Journal of Medical Internet Research, 24(5), e34451. [Google Scholar] [CrossRef]
  43. Holden, R. R., Mehta, K., Cunningham, E. J., & McLeod, L. D. (2001). Development and preliminary validation of a scale of psychache. Canadian Journal of Behavioural Science, 33(4), 224–232. [Google Scholar] [CrossRef]
  44. Horesh, N., Rolnick, T., Iancu, I., Dannon, P., Lepkifker, E., Apter, A., & Kotler, M. (1997). Anger, impulsivity and suicide risk. Psychotherapy and Psychosomatics, 66(2), 92–96. [Google Scholar] [CrossRef] [PubMed]
  45. John, A., Eyles, E., Webb, R. T., Okolie, C., Schmidt, L., Arensman, E., Hawton, K., O’Connor, R. C., Kapur, N., Moran, P., O’Neill, S., McGuinness, L. A., Olorisade, B. K., Dekel, D., Macleod-Hall, C., Cheng, H. Y., Higgins, J. P. T., & Gunnell, D. (2021). The impact of the COVID-19 pandemic on self-harm and suicidal behaviour: Update of living systematic review. F1000Research, 9, 1–44. [Google Scholar] [CrossRef] [PubMed]
  46. Killgore, W. D., Cloonan, S. A., Taylor, E. C., Miller, M. A., & Dailey, N. S. (2020). Three months of loneliness during the COVID-19 lockdown. Psychiatry Research, 293, 1–2. [Google Scholar] [CrossRef]
  47. Kotler, M., Iancu, I., Efroni, R., & Amir, M. (2001). Anger, impulsivity, social support, and suicide risk in patients with posttraumatic stress disorder. The Journal of Nervous and Mental Disease, 189(3), 162–167. [Google Scholar] [CrossRef] [PubMed]
  48. Lee, Y., Gilbert, J., Waldman, L., Zarate, C., & Ballard, E. (2024). Potential association between suicide risk, aggression, impulsivity, and the somatosensory system. Social Cognitive and Affective Neuroscience, 19(1), 7. [Google Scholar] [CrossRef]
  49. Lin, L., & Zhang, J. (2017). Impulsivity, mental disorder, and suicide in rural China. Archives of Suicide Research, 21(1), 73–82. [Google Scholar] [CrossRef]
  50. Lindsay, J. A. B., McGowan, N. M., Henning, T., Harriss, E., & Saunders, K. E. A. (2024). Digital interventions for symptoms of borderline personality disorder: Systematic review and meta-analysis. Journal of Medical Internet Research, 26, e54941. [Google Scholar] [CrossRef]
  51. Linehan, M. M., Goodstein, J. L., Nielsen, S. L., & Chiles, J. A. (1983). Reasons for staying alive when you are thinking of killing yourself: The brief reasons for living inventory. Journal of Consulting and Clinical Psychology, 51(2), 276–286. [Google Scholar] [CrossRef]
  52. Liu, R., Trout, Z., Hernandez, E., Cheek, S., & Gerlus, N. (2017). A behavioral and cognitive neuroscience perspective on impulsivity, suicide, and non-suicidal self-injury: Meta-analysis and recommendations for future research. Neuroscience & Biobehavioral Reviews, 83, 440–450. [Google Scholar]
  53. Maino, M. d. l. P., Morales, S., Echávarri, O., Barros, J., García, A., Moya, C., Szmulewicz, T., Fischman, R., Núñez, C., & Tomicic, A. (2019). Suicide risk configuration system in a clustered clinical sample: A generalized linear model obtained through the LASSO technique. Revista Brasileira de Psiquiatria, 41(2), 112–121. [Google Scholar] [CrossRef]
  54. Marciano, L., & Saboor, S. (2023). Reinventing mental health care in youth through mobile approaches: Current status and future steps. Frontiers in Psychology, 14, 1126015. [Google Scholar] [CrossRef] [PubMed]
  55. Martínez-Loredo, V., Fernández-Hermida, J. R., Fernández-Artamendi, S., Carballo, J. L., & García-Rodríguez, O. (2015). Spanish adaptation and validation of the Barratt Impulsiveness Scale for early adolescents (BIS-11-A). International Journal of Clinical and Health Psychology, 15(3), 274–282. [Google Scholar] [CrossRef]
  56. Melia, R., Francis, K., Hickey, E., Bogue, J., Duggan, J., O’Sullivan, M., & Young, K. (2020). Mobile health technology interventions for suicide prevention: Systematic review. JMIR MHealth and UHealth, 8(1), e12516. [Google Scholar] [CrossRef] [PubMed]
  57. Mercer, D., Douglass, A. B., & Links, P. S. (2009). Meta-analyses of mood stabilizers, antidepressants and antipsychotics in the treatment of borderline personality disorder: Effectiveness for depression and anger symptoms. Journal of Personality Disorders, 23(2), 156–174. [Google Scholar] [CrossRef]
  58. Miguel-Tobal, J., Cano-Vindel, A., Casado-Morales, M., & Spielberger, C. (2001). Inventario de expresión de la Ira estado-rasgo, S.T.A.X.I.-2./state-trait anger expression inventory. STAXI-2. TEA Ediciones. [Google Scholar]
  59. Moore, F., Allott, C., & O’Connor, R. (2023). Impulsivity, aggression, and impulsive aggression in suicidality. Personality and Individual Differences, 202, 111971. [Google Scholar] [CrossRef]
  60. Moynihan, R., Sanders, S., Michaleff, Z. A., Scott, A. M., Clark, J., To, E. J., Jones, M., Kitchener, E., Fox, M., Johansson, M., Lang, E., Duggan, A., Scott, I., & Albarqouni, L. (2021). Impact of COVID-19 pandemic on utilisation of healthcare services: A systematic review. BMJ Open, 11(3), e045343. [Google Scholar] [CrossRef] [PubMed]
  61. Neelam, K., Duddu, V., Anyim, N., Neelam, J., & Lewis, S. (2021). Pandemics and pre-existing mental illness: A systematic review and meta-analysis. Brain, Behavior, and Immunity—Health, 10, 100177. [Google Scholar] [CrossRef]
  62. Nock, M. K., Green, J. G., Hwang, I., McLaughlin, K. A., Sampson, N. A., Zaslavsky, A. M., & Kessler, R. C. (2013). Prevalence, correlates and treatments of lifetime suicidal behavior among adolescents: Results from the national comorbidity survey replication—Adolescente supplement (NCS-A). JAMA Psychiatry, 70(3), 300–310. [Google Scholar] [CrossRef]
  63. Olié, E., Dubois, J., Benramdane, M., Guillaume, S., & Courtet, P. (2021). Psychological state of a sample of patients with mood disorders during the first French COVID-19 lockdown. Scientific Reports, 11(1), 23711. [Google Scholar] [CrossRef]
  64. Oquendo, M. A., Cia, E., Graver, R., Mora, M., Montalvan, V., & Mann, J. (2000). Spanish adaptation of the reasons for living inventory. Hispanic Journal of Behavioral Sciences, 22(3), 369–381. [Google Scholar] [CrossRef]
  65. Ordóñez-Carrasco, J. L., Cuadrado Guirado, I., & Rojas Tejada, A. (2022). Escala de dolor psicológico: Adaptación de la Psychache Scale al español en jóvenes adultos. Revista de Psiquiatría y Salud Mental, 15(3), 196–204. [Google Scholar] [CrossRef]
  66. Ornell, F., Borelli, W. V., Benzano, D., Schuch, J. B., Moura, H. F., Sordi, A. O., Kessler, F. H. P., Scherer, J. N., & von Diemen, L. (2021). The next pandemic: Impact of COVID-19 in mental healthcare assistance in a nationwide epidemiological study. The Lancet Regional Health—Americas, 4, 100061. [Google Scholar] [CrossRef] [PubMed]
  67. Painuly, N., Sharan, P., & Mattoo, S. K. (2007). Antecedents, concomitants and consequences of anger attacks in depression. Psychiatry Research, 153(1), 39–45. [Google Scholar] [CrossRef]
  68. Palmier-Claus, J. E., Ainsworth, J., Machin, M., Barrowclough, C., Dunn, G., Barkus, E., Rogers, A., Wykes, T., Kapur, S., Buchan, I., Salter, E., & Lewis, S. W. (2012). The feasibility and validity of ambulatory self-report of psychotic symptoms using a smartphone software application. BMC Psychiatry, 12(1), 172. [Google Scholar] [CrossRef] [PubMed]
  69. Park, Y. J., Ryu, H., Han, K. S., Kwon, J. H., Kim, H. K., Kang, H. C., Yoon, J. W., Cheon, S. H., & Shin, H. (2010). Anger, anger expression, and suicidal ideation in Korean adolescents. Archives of Psychiatric Nursing, 24(3), 168–177. [Google Scholar] [CrossRef] [PubMed]
  70. Patten, S. B., Kutcher, S., Streiner, D., Gratzer, D., Kurdyak, P., & Yatham, L. (2021). Population mental health and COVID-19: Why do we know so little? Canadian Journal of Psychiatry, 66(9), 782–784. [Google Scholar] [CrossRef]
  71. Patton, J. H., Stanford, M. S., & Barratt, E. S. (1995). Factor structure of the Barratt impulsiveness scale. Journal of Clinical Psychology, 51(6), 768–774. [Google Scholar] [CrossRef]
  72. Paz García-Portilla, M., Alejandra Sáiz, P., Díaz-Mesa, E. M., Fonseca, E., Arrojo, M., Sierra, P., Sarramea, F., Sánchez, E., Manuel Goikolea, J., Balanzá, V., Benabarre, A., & Bobes, J. (2009). Psychometric performance of the Oviedo sleep questionnaire in patients with severe mental disorder. Revista de Psiquiatría y Salud Mental (English Edition), 2(4), 169–177. [Google Scholar] [CrossRef]
  73. Reger, M. A., Stanley, I. H., & Joiner, T. E. (2020). Suicide mortality and coronavirus disease 2019—A perfect storm. JAMA Psychiatry, 77(11), 1093–1094. [Google Scholar] [CrossRef]
  74. Rogers, M. L., Kelliher-Rabon, J., Hagan, C. R., Hirsch, J. K., & Joiner, T. E. (2017). Negative emotions in veterans relate to suicide risk through feelings of perceived burdensomeness and thwarted belongingness. Journal of Affective Disorders, 208, 15–21. [Google Scholar] [CrossRef]
  75. Roster, C. A., Lucianetti, L., & Albaum, G. (2015). Exploring slider vs. categorical response formats in web-based surveys. Journal of Research Practice, 11(1), 1. [Google Scholar]
  76. Rozek, D. C., Crawford, J. N., LoSavio, S. T., Myers, U. S., Dabovich, P., Warnecke, A., Smith, N. B., & Bryan, C. J. (2021). The protective role of reasons for living on suicidal cognitions for military affiliated individuals with a positive PTSD screen in primary care settings. Journal of Affective Disorders, 292, 424–429. [Google Scholar] [CrossRef] [PubMed]
  77. Rueda-Jaimes, G. E., Castro-Rueda, V. A., Rangel-Martínez-Villalba, A. M., Moreno-Quijano, C., Martinez-Salazar, G. A., & Camacho, P. A. (2018). Validation of the beck hopelessness scale in patients with suicide risk. Revista de Psiquiatría y Salud Mental, 11(2), 86–93. [Google Scholar] [CrossRef]
  78. Russell, D. (1996). UCLA loneliness scale (version 3): Reliability, validity and factor structure. Journal of Personality Assessment, 66(42), 3–4. [Google Scholar] [CrossRef]
  79. Rutherford, C., Costa, D., Mercieca-Bebber, R., Rice, H., Gabb, L., & King, M. (2016). Mode of administration does not cause bias in patient-reported outcome results: A meta-analysis. Quality of Life Research, 25(3), 559–574. [Google Scholar] [CrossRef] [PubMed]
  80. Santomauro, D. F., Mantilla Herrera, A. M., Shadid, J., Zheng, P., Ashbaugh, C., Pigott, D. M., Abbafati, C., Adolph, C., Amlag, J. O., Aravkin, A. Y., Bang-Jensen, B. L., Bertolacci, G. J., Bloom, S. S., Castellano, R., Castro, E., Chakrabarti, S., Chattopadhyay, J., Cogen, R. M., Collins, J. K., … Ferrari, A. J. (2021). Global prevalence and burden of depressive and anxiety disorders in 204 countries and territories in 2020 due to the COVID-19 pandemic. The Lancet, 398(10312), 1700–1712. [Google Scholar] [CrossRef] [PubMed]
  81. Sanz, J., Perdigón, A. L., & Vázquez, C. (2003). Adaptación española del Inventario para la Depresión de Beck-II (BDI-II): 2. Propiedades psicométricas en población general. Clínica y Salud, 14(3), 249–280. [Google Scholar]
  82. Sánchez-Teruel, D., Robles-Bello, M. A., & Camacho-Conde, J. A. (2020). Validity of the Spanish version of the herth hope index and the beck hopelessness scale in people who have attempted suicide. Actas Españolas de Psiquiatría, 48(4), 163–168. [Google Scholar]
  83. Schäfer, S. K., von Boros, L., Schaubruch, L. M., Kunzler, A. M., Lindner, S., Koehler, F., Werner, T., Zappalà, F., Helmreich, I., Wessa, M., Lieb, K., & Tüscher, O. (2024). Digital interventions to promote psychological resilience: A systematic review and meta-analysis. Npj Digital Medicine, 7, 1–12. [Google Scholar] [CrossRef]
  84. Simeon, D., Stanley, B., Frances, A., Mann, J. J., Winchel, R., & Stanley, M. (1992). Self-mutilation in personality disorders: Psychological and biological correlates. American Journal of Psychiatry, 149, 221–226. [Google Scholar] [CrossRef]
  85. Spielberger, C. D., Gorsuch, R. L., Lushene, R. E., Vagg, P. R., & Jacobs, G. A. (1983). Manual for the state-trait anxiety inventory (form Y). Consulting Psychologists Press. [Google Scholar]
  86. Stefansson, J., Nordström, P., & Jokinen, J. (2012). Suicide intent scale in the prediction of suicide. Journal of Affective Disorders, 136(1–2), 167–171. [Google Scholar] [CrossRef]
  87. Stringer, B., Van Meijel, B., Eikelenbooma, M., Koekkoek, B., Licht, C. M. M., Ad Kerkhof, J. E. M., Penninx, B. W. J. H., & Beekman, A. T. E. (2013). Recurrent suicide attempts in patients with depressive and anxiety disorders: The role of borderline personality traits. Journal of Affective Disorders, 151(1), 23–30. [Google Scholar] [CrossRef]
  88. Sueki, H. (2022). Relationship between beck hopelessness scale and suicidal ideation: A short-term longitudinal study. Death Studies, 46(2), 467–472. [Google Scholar] [CrossRef]
  89. Sun, L., Li, H., Zhang, J., & Wu, Q. (2015). Psychological strains and suicide intent: Results from a psychological autopsy study with Chinese rural young suicides. International Journal of Social Psychiatry, 61(7), 677–683. [Google Scholar] [CrossRef]
  90. Swann, A., Lijffijt, M., O’Brien, B., & Mathew, S. (2020). Impulsivity and suicidal behavior. In Recent advances in research on impulsivity and impulsive behaviors. Current Topics in Behavioral Neurosciences. Springer. [Google Scholar] [CrossRef]
  91. Torous, J., & Roberts, L. W. (2017). The ethical use of mobile health technology in clinical psychiatry. Journal of Nervous and Mental Disease, 205(1), 4–8. [Google Scholar] [CrossRef]
  92. Troister, T., D’Agata, M. T., & Holden, R. R. (2015). Suicide risk screening: Comparing the beck depression inventory-II, beck hopelessness scale, and psychache scale in undergraduates. Psychological Assessment, 27(4), 1500–1506. [Google Scholar] [CrossRef]
  93. Troister, T., & Holden, R. R. (2012). A two-year prospective study of psychache and its relationship to suicidality among high-risk undergraduates. Journal of Clinical Psychology, 68(9), 1019–1027. [Google Scholar] [CrossRef]
  94. Troister, T., & Holden, R. R. (2013). Factorial differentiation among depression, hopelessness, and psychache in statistically predicting suicidality. Measurement and Evaluation in Counseling and Development, 46(1), 50–63. [Google Scholar] [CrossRef]
  95. Turecki, G., Brent, D. A., Gunnell, D., O’Connor, R. C., Oquendo, M. A., Pirkis, J., & Stanley, B. H. (2019). Suicide and suicide risk. Nature Reviews Disease Primers, 5(1), 1–12. [Google Scholar] [CrossRef]
  96. Vázquez Morejón, A. J., & Jiménez García-Bóveda, R. (1994). RULS: Escala de soledad UCLA revisada. Fiabilidad y validez de una versión española. Revista de Psicología de la Salud, 6(1), 46–55. [Google Scholar]
  97. Velarde-Mayol, C., Fragua-Gil, S., & García-de-Cecilia, J. M. (2016). Validación de la escala de soledad de UCLA y perfil social en la población anciana que vive sola. Medicina de Familia. SEMERGEN, 42(3), 177–183. [Google Scholar] [CrossRef]
  98. Wang, H., Naghavi, M., Allen, C., Barber, R. M., Carter, A., Casey, D. C., Charlson, F. J., Chen, A. Z., Coates, M. M., Coggeshall, M., Dandona, L., Dicker, D. J., Erskine, H. E., Haagsma, J. A., Fitzmaurice, C., Foreman, K., Forouzanfar, M. H., Fraser, M. S., Fullman, N., … Zuhlke, L. J. (2016). Global, regional, and national life expectancy, all-cause mortality, and cause-specific mortality for 249 causes of death, 1980–2015: A systematic analysis for the global burden of disease study 2015. The Lancet, 388(10053), 1459–1544. [Google Scholar] [CrossRef] [PubMed]
  99. Wilks, C. R., Morland, L. A., Dillon, K. H., Mackintosh, M. A., Blakey, S. M., Wagner, H. R., & Elbogen, E. B. (2019). Anger, social support, and suicide risk in U.S. military veterans. Journal of Psychiatric Research, 109, 139–144. [Google Scholar] [CrossRef] [PubMed]
  100. Winkler, P., Formanek, T., Mlada, K., Kagstrom, A., Mohrova, Z., Mohr, P., & Csemy, L. (2020). Increase in prevalence of current mental disorders in the context of COVID-19: Analysis of repeated nationwide cross-sectional surveys. Epidemiology and Psychiatric Sciences, 29, e173. [Google Scholar] [CrossRef] [PubMed]
  101. World Health Organization. (2021). COVID-19 continues to disrupt essential health services in 90% of countries. Available online: https://www.who.int/news/item/23-04-2021-covid-19-continues-to-disrupt-essential-health-services-in-90-of-countries (accessed on 20 December 2024).
  102. Zalsman, G., Hawton, K., Wasserman, D., van Heeringen, K., Arensman, E., Sarchiapone, M., Carli, V., Höschl, C., Barzilay, R., Balazs, J., Purebl, G., Kahn, J. P., Sáiz, P. A., Lipsicas, C. B., Bobes, J., Cozman, D., Hegerl, U., & Zohar, J. (2016). Suicide prevention strategies revisited: 10-year systematic review. The Lancet Psychiatry, 3(7), 646–659. [Google Scholar] [CrossRef]
  103. Zhang, J., & Jia, C. X. (2007). Validating a short version of the suicide intent scale in China. Omega: Journal of Death and Dying, 55(4), 255–265. [Google Scholar] [CrossRef]
Figure 1. Main menu of the AuxiliApp web version.
Figure 1. Main menu of the AuxiliApp web version.
Behavsci 15 00868 g001
Table 1. Summary of results from traditional format and electronic slider format.
Table 1. Summary of results from traditional format and electronic slider format.
ScaleSlider QuestionNTraditional Format Mean
(Min–Max)
Slider Format Mean
(Min–Max)
Pearson’s rp-Value
* Beck Depression InventoryHow is your mood?565.268
(0–32)
7.197
(0–10)
−0.541<0.001
Psychache ScaleHow much are you suffering?26522.694
(13–64)
2.385
(0–9)
0.598<0.001
PaykelDo you have suicidal thoughts?2230.973
(0–5)
0.883
(0–10)
0.503<0.001
STAXI-2—State AngerDo you feel angry?27018.622
(15–50)
1.541
(0–8)
0.459<0.001
STAXI-2—Trait AngerDo you get angry easily?27021.152
(10–37)
4.037
(0–10)
0.558<0.001
STAXI-2—Anger Expression-OutDo you express your anger?27012.296
(6–23)
4.852
(0–10)
0.292<0.001
STAXI-2—Anger Expression-InDo you keep your anger to yourself?27012.456
(6–22)
3.889
(0–10)
0.489<0.001
STAXI-2—External Anger ControlDo you remain calm?27017.900
(6–24)
5.756
(0–10)
0.354<0.001
STAXI-2—Internal Anger ControlDo you count to ten before expressing your anger?27014.463
(6–24)
3.118
(0–10)
0.380<0.001
UCLA Loneliness ScaleHow lonely do you feel?24912.076
(0–58)
2.531
(0–10)
0.582<0.001
* BIS—Cognitive/AttentionalDo you find it easy to concentrate?27212.658
(2–28)
6.224
(0–10)
−0.581<0.001
* BIS—Non-PlanningDo you finish what you start?27214.158
(2–40)
7.404
(0–10)
−0.445<0.001
BIS—MotorHow impulsive are you?27214.856
(2–39)
5.353
(0–10)
0.426<0.001
* RFL—Survival and CopingDo you have a desire to live?27419.467
(0–118)
9.310
(0–10)
−0.589<0.001
* RFL—Family-RelatedDoes your family motivate you to live?27411.912
(0–50)
9.164
(0–10)
−0.382<0.001
* RFL—Fear of SuicideAre you afraid of suicide?27422.580
(0–35)
5.967
(0–10)
−0.283<0.001
* RFL—Fear of DisapprovalAre you concerned about what people would think if you died by suicide?27410.117
(0–15)
3.817
(0–10)
−0.455<0.001
RFL—Moral ObjectionsDo you think suicide is wrong?27413.496
(0–20)
7.256
(0–10)
−0.359<0.001
Note: * The slider question is inversely worded. N = number of participants with complete data for each variable. BDI-II: Beck Depression Inventory-II, Paykel: Paykel Suicidal Ideation Scale, STAXI-2: State-Trait Anger Expression Inventory-2, UCLA: University of California, Los Angeles, BIS: Barratt Impulsiveness Scale, RFL: Reasons For Living Inventory, Min-Max: Minimum-Maximum.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Sosa, M.Z.P.; de-la-Vega-Sánchez, D.; Sanz-Gómez, S.; Alacreu-Crespo, A.; Moreno-Gea, P.; Saiz, P.A.; Seoane Rey, J.; Giner, J.; Giner, L. Concurrent Validity of Digital Measures of Psychological Dimensions Associated with Suicidality Using AuxiliApp. Behav. Sci. 2025, 15, 868. https://doi.org/10.3390/bs15070868

AMA Style

Sosa MZP, de-la-Vega-Sánchez D, Sanz-Gómez S, Alacreu-Crespo A, Moreno-Gea P, Saiz PA, Seoane Rey J, Giner J, Giner L. Concurrent Validity of Digital Measures of Psychological Dimensions Associated with Suicidality Using AuxiliApp. Behavioral Sciences. 2025; 15(7):868. https://doi.org/10.3390/bs15070868

Chicago/Turabian Style

Sosa, Miguel Zacarías Pérez, Diego de-la-Vega-Sánchez, Sergio Sanz-Gómez, Adrián Alacreu-Crespo, Pedro Moreno-Gea, Pilar A. Saiz, Julio Seoane Rey, José Giner, and Lucas Giner. 2025. "Concurrent Validity of Digital Measures of Psychological Dimensions Associated with Suicidality Using AuxiliApp" Behavioral Sciences 15, no. 7: 868. https://doi.org/10.3390/bs15070868

APA Style

Sosa, M. Z. P., de-la-Vega-Sánchez, D., Sanz-Gómez, S., Alacreu-Crespo, A., Moreno-Gea, P., Saiz, P. A., Seoane Rey, J., Giner, J., & Giner, L. (2025). Concurrent Validity of Digital Measures of Psychological Dimensions Associated with Suicidality Using AuxiliApp. Behavioral Sciences, 15(7), 868. https://doi.org/10.3390/bs15070868

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop