Next Article in Journal
Associations between Housing Factors and Respiratory Symptoms in Two Saskatchewan First Nations Communities
Previous Article in Journal
The Impact of Dietary Knowledge on Health: Evidence from the China Health and Nutrition Survey
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Review

Brief Mental Health Disorder Screening Questionnaires and Use with Public Safety Personnel: A Review

1
Anxiety and Illness Behaviours Laboratory, Department of Psychology, University of Regina, Regina, SK S4S 0A2, Canada
2
Wayfound Mental Health Group, Calgary, AB T2R 1J5, Canada
3
Departments of Psychiatry and Psychology, Queen’s University, Kingston, ON N2L 3C5, Canada
4
Faculty of Science, Thompson Rivers University, Kamloops, BC V2C 0C8, Canada
*
Author to whom correspondence should be addressed.
Int. J. Environ. Res. Public Health 2021, 18(7), 3743; https://doi.org/10.3390/ijerph18073743
Submission received: 11 March 2021 / Revised: 31 March 2021 / Accepted: 2 April 2021 / Published: 3 April 2021
(This article belongs to the Section Mental Health)

Abstract

:
Brief mental health disorder screening questionnaires (SQs) are used by psychiatrists, physicians, researchers, psychologists, and other mental health professionals and may provide an efficient method to guide clinicians to query symptom areas requiring further assessment. For example, annual screening has been used to help identify military personnel who may need help. Nearly half (44.5%) of Canadian public safety personnel (PSP) screen positive for one or more mental health disorder(s); as such, regular mental health screenings for PSP may be a valuable way to support mental health. The following review was conducted to (1) identify existing brief mental health disorder SQs; (2) review empirical evidence of the validity of identified SQs; (3) identify SQs validated within PSP populations; and (4) recommend appropriately validated brief screening questionnaires for five common mental health disorders (i.e., generalized anxiety disorder (GAD), major depressive depression (MDD), panic disorder, posttraumatic stress disorder, alcohol use disorder). After reviewing the psychometric properties of the identified brief screening questionnaires, we recommend the following four brief screening tools for use with PSP: the Patient Health Questionnaire-4 (screening for MDD and GAD), the Brief Panic Disorder Symptom Screen—Self-Report, the Short-Form Posttraumatic Checklist-5, and the Alcohol Use Disorders Identification Test-Consumption.

1. Introduction

A recent study by Carleton et al. [1] evidenced significant mental health disorder symptoms among public safety personnel (PSP). PSP include, but are not limited to, border services officers, correctional workers, firefighters, paramedics, police officers, and public safety communicators [2]. Nearly half (44.5%) of Canadian PSP screened positive for one or more mental health disorder(s) [1], a rate more than four times that of the general population (10.1%) [3]. Five mental health disorder symptom profiles were the most concerning, as rates surpassed those found in the general Canadian population: symptoms of alcohol use disorder (5.9% of PSP screened positive), anxiety (18.6% of PSP screened positive), depression (26.4% of PSP screened positive), panic disorder (8.9% of PSP screened positive), and posttraumatic stress disorder (23.2% of PSP screened positive) [1]. Such high rates of mental health disorder symptoms in PSP could be related to their frequent exposures to potentially psychologically traumatic events (PPTE) as part of their job duties [4].
Early identification of PSP with distressing symptoms could lead to earlier identification of mental health disorders [5,6,7], faster access to treatment, and better outcomes [8]. Screening questionnaires are a common way to identify those with mental health disorder symptoms. Screening questionnaires are generally brief, focused on only one or a few conditions, and can be self-administered, administered by a clinician, or administered by a specially trained assistant [9]. Screening questionnaires cannot provide a definitive diagnosis of a mental health disorder but are designed to help clinicians more efficiently identify symptoms indicative of mental health disorders requiring further assessment [9] and to help increase diagnostic consistency [10]. Third-party payers (e.g., Worker’s Compensation, insurance companies) may also require evidence of symptom changes as part of progress reporting obligations. Screening tools may be particularly beneficial for supporting rapid differential diagnostic efforts [6] for disorders such as alcohol use disorder (AUD) [5], major depressive disorder (MDD) [6], and posttraumatic stress disorder (PTSD) [7].
Regular screening may help PSP more quickly access care, but has the potential to be time consuming and costly [11]. A full battery of tools used to measure common mental disorder symptoms in PSP includes the Alcohol Use Disorders Identification Test (AUDIT) [12], the Generalized Anxiety Disorder Scale 7 (GAD-7) [13], the Patient Health Questionnaire 9 (PHQ-9) [14], the Panic Disorder Severity Scale-Self-Report (PDSS-SR) [15], and the Posttraumatic Checklist for DSM-5 (PCL-5) [16]. The AUDIT is a 10-item scale that takes approximately 2 to 4 min to complete [17]. The GAD-7 has 7 items and takes approximately 3 min to complete [18]. The PHQ-9 is a 9-item scale that takes approximately 3 min to complete [19]. The PDSS-SR is a 7-item scale that takes approximately 3 min to complete (based on the length of time it takes to complete the PHQ-9 and GAD-7, we estimate ~3 min to complete) and the PCL-5 is a 20-item scale that takes approximately 5–10 min to complete [20]. In total, a full battery of tools could take up to 20 min to complete. Respondents may also perceive longer self-report measures as a barrier to screening, especially if given five measures to complete at one time. In any case, a recent review of mandatory psychological screening suggests that benefits from frequent screening include reduced stigma and barriers for accessing mental health care; self-identifying mental health concerns; and identifying and highlighting available mental health treatments and services [21]. To our knowledge, there has yet to be a literature review identifying validated, reliable, very short screening tools with useful sensitivity and specificity for PSP.

Objectives

The current study was designed to address the following objectives: (1) identify existing brief mental health disorder screening questionnaires; (2) review empirical evidence of the validity of identified screening questionnaires; (3) identify screening questionnaires validated within PSP populations; and (4) provide recommendations for appropriate and validated brief screening questionnaires for PSP.

2. Materials and Methods

The current literature review was conducted between September and December 2019 and was designed to identify brief mental health disorder screening questionnaires that may be used to support PSP. The focus was on identifying validated questionnaires that screen for one or more mental disorders identified as prominent for PSP (i.e., depression, anxiety, PTSD, panic disorder, and alcohol use disorder) [1] using the lowest possible number of items (e.g., PHQ-4, which includes two items related to major depressive disorder and two items related to generalized anxiety disorder, rather than the PHQ-9 and GAD-7).

2.1. Search Strategy

The review was based on search results from several databases—specifically, PsycARTICLES (Ovid), PsycInfo (Ovid), Web of Science, and Google Scholar. An initial search was conducted using the following search terms: brief psychology screening instruments, mental disorder screening, short form of mental disorder measures, psychological symptom questionnaires, short symptom measures, depression symptom measures, anxiety symptom measures, alcohol symptom measures, substance use symptom measures, and post-trauma symptom measures. Variations and combinations of the search terms were used to follow up on preliminary searches and identify additional questionnaires. Publications written in a language other than English, as well as dissertations and books in any language, were excluded. Brief tools that did not screen for at least one of the five major disorders (i.e., alcohol use disorder, anxiety, depression, panic disorder, and PTSD) were also not included. Validation papers identified for each brief screening questionnaire were located using Google Scholar. A list of brief screening questionnaires that were validated in clinical or general populations was then compiled.
A subsequent search was conducted to explore the use of the identified questionnaires among PSP. Databases used for the subsequent search included PsycInfo (Ovid) and Google Scholar. Abbreviations for previously identified brief screening questionnaires were used as PsycInfo search terms. The abbreviations included were as follows: 90 to 120 Day Post-Deployment Psychological Short Screen, ADD, ASSIST, CID-S, CIDI-SC, MHI-5, K6, MCS-12, M.I.N.I., M-3, PHQ-4, PAS, WSQ, AUDIT-C, Brief PSS, PADIS, PHQ-2, PC-PTSD-5, PCL-C-SF, and SPRINT. PSP job titles (i.e., police, firefighter, paramedic, corrections officer, public safety personnel, and first responder) were paired with each of the brief screening questionnaire abbreviations in order to identify studies using the screening questionnaires with PSP participants. Finally, a search was conducted to identify associated extant research specifically validating each tool for use with PSP.

2.2. Data Analysis

Psychometric properties for each questionnaire were reported in terms of sensitivity (i.e., proportion of true cases detected) and specificity (i.e., proportion of true non-cases correctly classified as non-cases) of screening questionnaires, as well as positive likelihood ratios (i.e., the odds that a positive test result would be expected in a patient with the associated diagnosis), positive predictive values (PPV, i.e., percentage of positive screens that are accurate), negative predictive values (NPV, i.e., percentage of negative screens that are accurate), and receiver operating characteristic (ROC) curves. ROC curves indicate sensitivity and specificity of possible cut-off scores, and the area under the ROC curve (AUC) indicates the diagnostic power of the questionnaire in discriminating between those with and without the diagnosis of interest [22]. AUC statistics range from 0.5 and 1.0. A value of 0.5 indicates that the questionnaire is performing at a chance level in discriminating between those with and without the diagnosis of interest and 1.0 indicates perfect discrimination. Swets [23] has suggested that values between 0.50 and 0.70 represent low accuracy, 0.70 and 0.90 indicate a useful screening questionnaire, and 0.90 or higher indicate a highly accurate screening questionnaire. In addition, internal consistency (i.e., Cronbach’s α) and interrater reliability of the questionnaires were reported when available. The following sections first review brief screening questionnaires for multiple symptoms, reporting on available validation data among PSP, followed by brief screening questionnaires for single-disorder symptoms, again noting if the measure has been validated in a PSP population.

3. Results

3.1. Multiple Symptom Screening Questionnaires

3.1.1. The 90 to 120 Day Post-Deployment Psychological Short Screen

The United States Army Medical Research Unit-Europe developed a screening questionnaire to provide soldiers with an easy means to self-identify mental health issues and receive counseling within 90 to 120 days post-deployment. The 90 to 120 Day Post-Deployment Psychological Short Screen [24] is a 15-item screening questionnaire for five areas: traumatic stress (4 items), depression (4 items), relationship problems (2 items), alcohol problems (2 items), and anger problems (3 items). Researchers assessed the criterion validity of the 90 to 120 Day Post-Deployment Psychological Short Screen in comparison to the Mini-International Neuropsychiatric Interview (M.I.N.I.) [10]. For the traumatic stress items, a cut-off value of ≥3 positive responses was recommended (sensitivity = 0.46; specificity = 0.97). For the relationship problems items, a positive score on both items was recommended (sensitivity = 0.40 to 0.82; specificity = 0.89 to 0.92). For the anger problems items, soldiers who endorse “sometimes,” “often,” or “very often” on any two of the three items was recommended as a cut-off (sensitivity = 0.59; specificity = 0.91). For the depression items, a cut-off value of ≥ 2 positive responses was recommended (sensitivity = 0.50 to 0.53; specificity = 0.94 to 0.96). For the alcohol problems items, a positive score on both items was recommended (sensitivity = 0.33; specificity = 0.94; see Table 1). The 90 to 120 Day Post-Deployment Psychological Short Screen appears to be a psychometrically-sound screening questionnaire for traumatic stress, relationship problems, anger problems, depression, and alcohol problems [24].

3.1.2. Anxiety and Depression Detector (ADD)

The ADD is a 5-item self-report screening questionnaire for identifying primary care patients with anxiety and depression [25]. The ADD is used to screen for symptoms of panic disorder (PD), PTSD, social phobia (SP), generalized anxiety disorder (GAD), and major depressive disorder (MDD) over the past three months. The ADD has been tested with approximately 800 primary care patients [25]. Split-half item analyses of a randomly selected half of the sample were conducted to narrow down better-performing items in the initial questionnaire. Split-half item sensitivity ranged from 0.49 to 1.00 and specificity from 0.48 to 0.81 when compared to a computerized version of the Composite International Diagnostic Interview (CIDI) [44] assessing for Diagnostic and Statistical Manual of Mental Disorders 4th edition (DSM-IV) [45]. Cross-validation of the better-performing items in the second half of the sample resulted in sensitivities ranging from 0.62 to 1.00 and specificities ranging from 0.56 to 0.83 (see Table 1). When a “Yes” answer to any of the screening questions was used in predicting any diagnosis, the sensitivities ranged from 0.92 to 0.96 across the two versions and specificities ranged from 0.57 to 0.82. The ADD appears to be a psychometrically-sound screening questionnaire for PD, PTSD, SP, GAD, and MDD among primary care patients [25]. The conducted search did not identify any studies in which the ADD was used specifically with PSP populations.

3.1.3. Alcohol, Smoking, and Substance Involvement Screening Test-Version 2 (ASSIST-2)

The ASSIST-2 is an 8-item self-report screening questionnaire that investigates frequency of use and associated problems for tobacco, alcohol, cannabis, cocaine, amphetamine-type stimulants (ATS), inhalants, sedatives, hallucinogens, opioids, and other drugs in the past three months [26]. Researchers demonstrated concurrent validity of the ASSIST-2 with measures of addiction (r = 0.76 to 0.88 for alcohol, cannabis, cocaine, amphetamines, sedatives, and opioids), dependence (r = 0.59), disordered alcohol use (r = 0.82), and tolerance (r = 0.78) [26]. Construct validity was established by assessing for significant correlations between ASSIST-2 scores and measures of risk factors for the development of substance use problems (r = 0.48 to 0.76). In addition, the ASSIST-2 items assessing dependence and abuse were significantly correlated with M.I.N.I. [10] scores for dependence (r = 0.76) and abuse (r = 0.75) [26].
Discriminant validity for the ASSIST-2 was evaluated by assessing the effectiveness for significantly discriminating between substance use, abuse, and dependence (p ≤ 0.001) [26]. ROC analyses were also used to establish cut-off scores with suitable specificities (0.50 for sedative abuse/dependency, to 0.96 for opioid use/abuse) and sensitivities (0.54 for sedative abuse/dependency to 0.97 for amphetamine use/abuse; see Table 1). Cut-off scores are as follows: total substance involvement (use/abuse = 14.5; abuse/dependence = 28.5), alcohol (use/abuse = 5.5.; abuse/dependence = 10.5), cannabis (use/abuse = 1.5; abuse/dependence = 10.5), cocaine (use/abuse = 0.5; abuse/dependence = 8.5), amphetamines (use/abuse = 0.5; abuse/dependence = 11.5), sedatives (use/abuse = 9.5; abuse/dependence = 10.5), opioids (use/abuse = 0.5; abuse/dependence = 14.5) [26]. The ASSIST-2 appears to have similar specificity, sensitivity, and AUC in several languages (e.g., French, Spanish) [46,47], for different ages (e.g., adolescents) [48], and for diverse cultures (e.g., Pacific People of New Zealand) [49]. The ASSIST-2 appears to be a psychometrically-sound screening questionnaire for identifying substance use among individuals who use several substances in varying degrees [26]. The conducted search did not identify any studies in which the ASSIST-2 was specifically used with PSP populations.

3.1.4. Composite International Diagnostic-Screener (CID-S)

The CID-S is a 12-item self-report screening questionnaire for somatoform, anxiety, depressive and other affective, and substance use disorders (SUDs). The CID-S was developed based on the core diagnostic questions from the full CIDI [44] for the assessment of DSM-IV [45] and International Classification of Diseases (ICD-10) [50] diagnoses [27]. Researchers tested the CID-S in comparison to the full-scale version using a random sample of 1095 participants. Overall sensitivity for the CID-S was 0.85 (0.79 for alcohol use/dependence to 1.00 for PD; see Table 1), and the overall NPV was 0.92 (range = 0.96 for SD to, 1.00 for mania) for any current diagnosis (12-month DSM-IV diagnosis). The CID-S appears to be a psychometrically-sound screening questionnaire for identifying DSM-IV [45] and ICD-10 [50] diagnoses [27]. The conducted search did not identify any studies in which the CID-S was specifically used with PSP populations.

3.1.5. Composite International Diagnostic Interview Screening Scale (CIDI-SC)

The CIDI-SC is a 9- to 38-item screening questionnaire for DSM-IV major depressive episode (MDE), GAD, PD, and bipolar disorder. There are nine core questions and up to 38 follow-up questions, depending on responses. Researchers have assessed the CIDI-SC for diagnostic accuracy based on the Structured Clinical Interview for DSM-IV Diagnoses (SCID-IV) [51]. Results demonstrated excellent concordance (based on AUC) between CIDI-SC and SCID-IV diagnoses for MDE (0.93), GAD (0.88), PD (0.90), and bipolar disorder (0.97). In addition, PPV ranged from 48.2% (GAD) to 73.7% (bipolar disorder). Sensitivity ranged from 0.68 to 0.80 and specificity from 0.90 to 0.99 (see Table 1) [51]. The CIDI-SC appears to be a psychometrically-sound screening questionnaire for mood and anxiety disorders [28]. The conducted search did not identify any studies in which the CIDI-SC was specifically used with PSP populations.

3.1.6. Five-Item Mental Health Inventory (MHI-5)

The MHI-5 [29] is a 5-item self-report screening questionnaire for affective and anxiety disorders developed from the original 38-item version [52]. There are three items measuring depressive symptoms and psychological well-being, and two items measuring anxiety symptoms [29]. Researchers compared accuracy of the MHI-5 with the measures of mental health, somatic symptoms, and general health [29]. The MHI-5 detected depressive disorders (AUC = 0.78), anxiety disorders (AUC = 0.74), and any diagnosable disorder (AUC = 0.79) [29]. Other researchers [30] also compared the diagnostic accuracy of the MHI-5 with a computerized version of the CIDI [53] in detecting past month diagnoses based on the DSM-III-R [54]. Different cut-off scores were recommended depending on the use of the measures [30]. There have been three cut-off scores calculated: (1) the maximum sum of sensitivity and specificity; (2) the costs of a false negative are fifty times higher than the costs of a false positive; and (3) the costs of a false negative are five times higher than the costs of a false positive [30]. The cut-off score for major depression and/or dysthymia using the first two methods was 74, but was 54 using the third method [30]; therefore, attention should be paid to scoring method when using or reviewing results from the MHI-5.
In adults, the MHI-5 AUC scores have been high for mood/affective disorders (any = 0.88; MDD = 0.92; dysthymia = 0.91; bipolar disorder = 0.88), anxiety disorders (any = 0.71; GAD = 0.90; PD = 0.87; agoraphobia = 0.80; SP = 0.77; simple phobia = 0.69; obsessive compulsive disorder (OCD) = 0.93; see Table 1) [30,31]. Researchers have found evidence that the sensitivity and specificity of the MHI-5 in comparison with SCID-IV [51] diagnoses was inadequate for somatoform and SUDs (AUC of 0.65 to 0.66), especially in cases without comorbid anxiety or mood disorder diagnoses [31]. The MHI-5 appears to be a psychometrically-sound screening questionnaire for mood and anxiety disorders [30]. The conducted search did not identify any studies in which the MHI-5 was specifically used with PSP populations.

3.1.7. Kessler Psychological Distress K6 Screening Scale (K6)

The K6 is a 6-item self-report screening questionnaire for serious mental illness (SMI) based on the DSM-IV [45]. The K6 was created based on general population analyses in 14 countries with the WHO Mental Health Survey Initiatives to estimate SMI population prevalence [32]. SMI is defined as an individual experiencing at least one 12-month DSM disorder (excluding substance use disorder) that causes “serious impairment” [32]. The K6 requires respondents to rate how often they felt “nervous,” “hopeless,” “restless or fidgety,” “so depressed that nothing could cheer you up,” “that everything was an effort,” and “worthless over the past month and in the worst month in the past 12 months.” The K6 has good concordance with clinical diagnoses of SMI in a random sample of the general United States population [55,56]. The K6 can detect moderate SMI with a cut-off score greater than five (AUC = 0.82, specificity = 0.75, sensitivity = 0.760 [57]. The K6 AUC for identifying individuals with SMI in the past month ranges from 0.76 to 0.89 across a nationally representative World Mental Health survey of 14 countries (i.e., Nigeria, South Africa, Brazil, Colombia, Mexico, United States, India, Japan, New Zealand, Beijing, Shanghai, Shenzhen, Bulgaria, Romania, Ukraine, Lebanon; see Table 1) [32]. The K6 performs as well as a longer 10-item version [32] and has been translated and validated for Arabic [58] and Korean [59]. The K6 appears to be a psychometrically-sound screening questionnaire for SMI, but is not designed for specific diagnoses [32]. The K6 has been used with PSP populations (i.e., Canadian police officers and volunteer Australian firefighters; see Table 1) [33,34]; however, the psychometric properties were not well reported in these studies. Janzen et al. [33] reported only internal consistency (Cronbach’s α = 0.81) and Milligan-Saville et al. [34] did not report psychometric statistics.

3.1.8. Mental Health Component Scale (MCS-12)

The MCS-12 [35] is a 12-item self-report screening questionnaire based on the 12-item Short-Form Health Survey [60]. The MCS-12 is used to screen for depression and anxiety disorders in the general population. Specifically, the MCS-12 assesses self-reported psychological symptoms and limitations due to mental health over the past 4 weeks [61]. The MCS-12 sensitivity for depression, anxiety disorders (i.e., PD, agoraphobia, SP, GAD, OCD, PTSD), and any common mental disorder was tested relative to other brief screening questionnaires [35] and using diagnoses based on the CIDI [44]. The MCS-12 AUC scores were good for depression (0.92), anxiety disorders (0.83), and any common mental disorder (0.86; see Table 1) [35]. The cut-off scores for detecting depression or any anxiety disorder are reported in Table 1 [35]. The MCS-12 appears to be a psychometrically-sound screening questionnaire for mood and anxiety disorders [35]. The conducted search did not identify any studies in which the MCS-12 was specifically used with PSP populations.

3.1.9. Mini-International Neuropsychiatric Interview (M.I.N.I.) Screen

The M.I.N.I. Screen [10] is a 21-item dimensional self-report screening questionnaire for MDD (2- items), dysthymia (1-item), suicidality (1-item), mania (2 items), PD (2- items), SP (1-item), OCD (2 items), PTSD (3 items), alcohol abuse (1-item), substance abuse (1-item), eating disorders (4 items), and GAD (1-item), based on DSM-IV [45] and ICD-10 [50] criteria. The M.I.N.I. Screen is a subset of M.I.N.I. items and does not appear to be used without the full M.I.N.I., which has substantial support as a diagnostic tool [10,62]. The clinician-rated M.I.N.I. sensitivity scores range from 0.45 (current drug dependence) to 0.96 (MDD), with PPV from 43% (current simple phobia) to 90% (anorexia; see Table 1). The patient-rated M.I.N.I. sensitivity scores range from 0.39 (current drug dependence) to 0.89 (alcohol dependence), with PPV from 11% (dysthymia) to 75% (MDD and anorexia) [10]. Concordance between the clinician-rated M.I.N.I. and SCID diagnoses ranged from ϰ values of 0.43 (current drug dependence) to 0.90 (anorexia nervosa) [10]. Concordance between the clinician-rated M.I.N.I. and CIDI diagnoses ranged from ϰ values of 0.36 (GAD) to 0.82 (alcohol dependence) [10]. Interrater reliability of the clinician-rated M.I.N.I. ranged from ϰ values of 0.79 (current mania) to 1.00 (MDD, OCD, current alcohol dependence, eating disorders; see Table 1) [10]. Test–retest reliability of the clinician-rated M.I.N.I. ranged from ϰ values of 0.35 (current mania) to 1.00 (bulimia; see Table 1) [10]. The M.I.N.I. appears to be a psychometrically-sound questionnaire for assessing DSM-IV [45] and ICD-10 [50] diagnostic criteria in less time than the SCID-III-R or CIDI [10]. The M.I.N.I. has been used as a diagnostic screening questionnaire in a study testing the efficacy of a cognitive behavioural intervention among PSP; however, psychometric properties of the M.I.N.I in this sample were not reported (see Table 1) [36].

3.1.10. My Mood Monitor (M-3) Checklist

The M-3 Checklist is 27-item self-report screening questionnaire for current (i.e., past 2 weeks) MDD (7 items), GAD (2 items), PD (2 items), social anxiety disorder (SAD; 1-item), OCD (3 items), PTSD (4 items), lifetime bipolar disorder (4 items), and general functional impairment (4 items) [37]. The M-3 Checklist sensitivity ranges from 0.82 (anxiety module) to 0.88 (bipolar disorder and PTSD), and specificity ranged from 0.70 (bipolar disorder) to 0.80 (MDD) when compared to the M.I.N.I. (see Table 1) [37]. The M-3 Checklist appears to be a psychometrically-sound screening questionnaire for multiple diagnoses and takes less than 5 min to complete [37]. The conducted search did not identify any studies in which the M-3 Checklist was specifically used with PSP populations.

3.1.11. Patient Health Questionnaire-4 (PHQ-4)

The PHQ-4 [39] is a 4-item self-report screening questionnaire for depression and anxiety symptoms experienced in the past 2 weeks, consisting of the PHQ-2 (2 core criteria for depression) [63] and the GAD-2 (2 core criteria for GAD) [64]. Construct validity of severity scores of the PHQ-4 was measured in comparison to mean number of disability days and physician visits, and demonstrated a strong incremental relationship [39,65]. The PHQ-2 AUC score for any anxiety disorder is 0.78 and ranges from 0.75 (PD), to 0.81 (GAD) and the GAD-2 AUC scores for any anxiety disorder is 0.84 and ranges from to 0.80 (PTSD), to 0.91 (GAD) [39]. The total PHQ-4 AUC scores range from 0.79 (MDD) to 0.84 (GAD) [38]. Internal consistencies of the PHQ-4 (α = 0.81), PHQ-2 (α = 0.76), and GAD-2 (α = 0.84) were acceptable [38]. Cut-off scores of ≥ 3 for each of the PHQ-2 and GAD-2 scores of the PHQ-4 appear to identify probable cases of depression or anxiety [63,66]. The PHQ-4 appears to have good test–retest reliability (ϰ = 0.69–0.81) [38]. The PHQ-4 appears to be a psychometrically-sound screening questionnaire for mood and anxiety disorders [39,65]. The PHQ-4 has been used in a sample of police officers as part of an investigation of the relationship between job demands and the development of emotional exhaustion, depression, and anxiety; however, the only measure of reliability reported from the policing sample was Cronbach’s α [40].

3.1.12. Posttraumatic Adjustment Scale (PAS)

The PAS is a 10-item self-report screening questionnaire for patients at high risk for PTSD and/or depression during hospitalization following a traumatic injury [41]. The PAS items were derived from predictor variables (e.g., prior trauma, emotional response during trauma, coping self-efficacy) with moderate to high effect sizes in the PTSD vulnerability literature [41]. The PAS has a 5-factor solution and each factor has 2 items (i.e., Factor 1 = Acute Stress Response; Factor 2 = Prior Social Support; Factor 3 = Prior Psychiatric/Trauma History; Factor 4 = Self-Efficacy; and Factor 5 = Perceived Threat/Pain). Using data from trauma centre patients, the PAS has a sensitivity of 0.82 and specificity of 0.84 for PTSD, and sensitivity of 0.72 and specificity of 0.75 for MDE (see Table 1) [41]. The risk for PTSD is calculated by summing all 10 items and a score of 16 or higher represents high risk for later development of PTSD [41]. The risk for MDE is calculated by summing 5 of the 10 items and a score of 4 or above on these items represents high risk for later development of MDE [41]. The PAS appears to be a psychometrically-sound screening questionnaire for risk of PTSD and MDE [41]. The conducted search did not identify any studies in which the PAS was specifically used with PSP populations.

3.1.13. Web Screening Questionnaire (WSQ)

The Web Screening Questionnaire (WSQ) is a 15-item online dimensional self-report screening questionnaire for depressive disorder, alcohol abuse/dependence, GAD, PTSD, SP, PD, agoraphobia, specific phobia, and OCD. The WSQ sensitivity ranged from 0.72 (SP) to 1.00 (agoraphobia) and specificity from 0.44 (PD) to 0.77 (PD with agoraphobia; see Table 1) when using the CIDI [44] as a reference [42]. PPV ranged from 11% (PTSD) to 51% (any depressive disorder), while NPV ranged from 87% (specific phobia) to 100% (agoraphobia) [42]. The WSQ appears successful for identifying true negatives but may be susceptible to false positives [42]. Recent research [43] found specificity for depressive disorders, anxiety disorders, and alcohol abuse/dependence ranged from 0.89 to 0.97, with the exception of PTSD (0.52) and specific phobia (0.73) when using the M.I.N.I.-Plus [10] as a reference measure for DSM-IV-TR diagnoses [67]. Sensitivity ranged from 0.67 to 1.00, with the exception of depressive disorder (0.56) and alcohol abuse/dependence (0.56; see Table 1), and NPVs were high in the general population (greater than 87%), but PPVs were low (2–33%) [43]. The WSQ appears to be a psychometrically-sound screening questionnaire for depressive or anxiety disorders, but the WSQ is susceptible to many false positives [42,43]. The conducted search did not identify any studies in which the WSQ was specifically used with PSP populations.

3.2. Single-Disorder Symptom Questionnaires

3.2.1. Alcohol Use Disorders Identification Test-Consumption (AUDIT-C)

The AUDIT-C is a 3-item questionnaire that was first validated for identification of alcohol misuse in Veterans Affairs (VA) outpatients [68]. Researchers validated the AUDIT-C in comparison to the full AUDIT [12] and other measures of problematic alcohol use [68]. The AUDIT-C performed better than the full AUDIT in terms of AUC (p = 0.03); however, the full AUDIT had a higher AUC for detecting alcohol abuse and/or dependence (p < 0.001) [68]. Researchers demonstrated an optimal scoring cut-off of ≥3, for a total of 12 points for identifying alcohol abuse/dependence (sensitivity = 0.90; specificity = 0.45; see Table 2) and heavy drinking (sensitivity = 0.98; specificity = 0.56) [68]. The AUDIT-C has also been validated within the three main ethnic demographic categories (African American [AA], Caucasian [C], and Hispanic [H]) in the United States with similar results (AA: sensitivity = 0.67–0.76; specificity = 0.92–0.93; AUC = 0.90–0.95; C: sensitivity = 0.70–0.95; specificity = 0.91–0.89; AUC = 0.86–0.95; H: sensitivity = 0.85; specificity = 0.84–0.88; AUC = 0.91–0.93) [69]. Further, the Korean language version of AUDIT-C has been validated with a sample of PSP [70]. Using a total cut-off score of 7.5 (sensitivity = 0.82; specificity = 0.80) to identify any alcohol use disorder and a cut-off score of 8.5 (sensitivity = 0.86; specificity = 0.86) to identify those with alcohol dependence, the Korean AUDIT-C appears to be a valid screening tool for PSP [70]. The AUDIT-C has also been used in numerous studies of PSP mental health, with internal consistency ranging from 0.67 to 0.81 when analyzed [71,72,73,74]. The AUDIT-C appears to be a psychometrically-sound screening questionnaire for alcohol abuse or dependence and heavy drinking [68].

3.2.2. Brief Panic Disorder Severity Scale-Self Report (Brief PDSS-SR)

The PDSS-SR is a 2-item self-report measure for assessing panic disorder symptoms [75]. The items were chosen from the original Panic Disorder Severity Scale-Self Report [15] after examining factor structure, sensitivity to change, and clinical representativeness. The 2-item scale showed good psychometric properties (ωC = 0.74) and at the optimal cut-off score of >3, AUC was 0.82 (sensitivity = 0.85; specificity = 0.66) [75]. The scale has not yet been validated in other languages or cultures. The conducted search did not identify any studies in which the Brief PSS was specifically used with PSP populations.

3.2.3. Brief PTSD Screen (Brief PSS)

The Brief PSS [76] is a 3-item self-report screening questionnaire derived from the 17-item PTSD Symptom Scale (PSS) [84,85]. The Brief PSS is used to screen for PTSD in clients with SMI (e.g., schizophrenia, MDD, bipolar disorder). The Brief PSS appears to have good internal consistency (α = 0.81), correlates highly with the 17-item PSS (r = 0.93), and has a demonstrated AUC score of 0.96 [76]. A cut-off score of ≥3 can be used to screen for PTSD (sensitivity = 0.94; specificity = 0.85; see Table 2). The Brief PSS appears to be a psychometrically-sound brief screening questionnaire for PTSD among individuals with SMI [76]. The conducted search did not identify any studies in which the Brief PSS was specifically used with PSP populations.

3.2.4. Panic Disorder Screener (PADIS)

The PADIS is a 4-item self-report screening questionnaire for PD [77]. The PADIS appears to have good internal consistency (α = 0.86) and was able to distinguish individuals with PD from those without [77] based on the M.I.N.I. [10]. A cut-off score of 4 or higher distinguished panic cases from non-cases (specificity = 0.84; sensitivity = 0.77; AUC = 0.87; see Table 2; 77). The PADIS had lower PPV (25%) but excellent NPV (98%). Every one-point increase in PADIS total score is associated with a 68.6% increase in the odds of meeting clinical criteria for PD [77]. The PADIS appears to be a psychometrically-sound screening questionnaire for PD [77]. The conducted search did not identify any studies in which the PADIS was specifically used with PSP populations.

3.2.5. The Patient Health Questionnaire-2 (PHQ-2)

The PHQ-2 [63] is a self-report screening questionnaire for MDD consisting of the first two items of the PHQ-9 [14]. The PHQ-2 is used to screen for the core symptoms of MDD over the past two weeks. PHQ-2 scores of ≥3 as a cut-off result in sensitivity of 0.83 and specificity of 0.92 for detecting MDD (see Table 2) [63]. Researchers identified PHQ-2 cut-off score of 3 as the optimal cut-point for screening for MDD [63]; however, a recent meta-analysis of 21 validation studies suggested a cut-off score of ≥2 may be better, resulting in pooled sensitivity of 0.91 and specificity of 0.70, compared to pooled sensitivity of 0.76 and specificity of 0.87 for a cut-off score of ≥3 [86]. The PHQ-2 has been used in one study investigating the relationships between police officer wellness and safety; however, no psychometric properties or validation of the PHQ-2 were reported [73]. The PHQ-2 appears to be a psychometrically-sound screening questionnaire for MDD [63,66].

3.2.6. Primary Care Posttraumatic Stress Disorder Screen (PC-PTSD-5)

The PC-PTSD-5 is a 4-item primary care screening questionnaire that has been updated from the original version (PC-PTSD) [87] to reflect DSM-5 criteria [88] for PTSD [78]. The original PC-PTSD was used to screen for symptoms of re-experiencing, numbing, avoidance, and hyperarousal and had been validated in a Department of VA primary care population [87]. Criterion validity of the PC-PTSD-5 was assessed in a Veteran primary care sample [78] for diagnostic accuracy in comparison to the M.I.N.I. [10]. AUC for the PC-PTSD-5 was 0.94 and the optimally sensitive cut-off score was 3 (sensitivity = 0.95; specificity = 0.85; see Table 2). The PC-PTSD-5 has also been validated in a Korean population of clinical and nonclinical participants [89]. The Korean version showed good internal consistency (α = 0.87) and a cut-off score of 3 resulted in optimal psychometrics (AUC = 0.90; sensitivity = 0.91; specificity = 0.78) [89]. The PC-PTSD-5 appears to be a psychometrically-sound screening questionnaire for PTSD [78].

3.2.7. Short-Form Posttraumatic Checklist-5 (Short-Form PCL-5)

The Short-Form PCL-5 is a 4-item screening questionnaire created by taking items from the original 20-item PCL-5 [16]. The Short-Form PCL-5 was created by examining 160 combinations of between one and eight questions taken from the original PCL-5 [79]. Combinations of the questions were examined with data collected from a large military sample (n = 8917). Psychometric properties, along with predictive values of scores on the PCL-5, were examined and a 4-item version with the ability to predict PCL-5 scores of 28 or greater was chosen. The Short-Form PCL-5 was then validated in another large military sample (n = 11,728) and showed good psychometric properties (AUC = 0.93; sensitivity = 0.99; specificity = 0.88). The scale has not yet been validated in other languages or cultures.

3.2.8. Short Forms of PTSD Checklist (PCL-C-SF)

Lang and Stein [81] developed the PCL-C-SF, a 2-item, 3-item, 4-item, and 6-item version of the PCL-C [90] to assess for PTSD symptoms in a VA population. The full PCL-C was administered to two samples of primary care VA clients, and sub-samples were contacted for a follow-up interview using the CIDI [91]. The shorter versions of the PCL-C were created using corrected item-total correlations, selecting the items with the highest correlations with the total, as well as items with the highest correlations with the total for each DSM-IV [45] diagnostic criteria cluster. Across the two samples, the 2-item version of the PCL-C resulted in an AUC of 0.73 to 0.88, with a cut-off score of 4 (sensitivity = 0.80 to 0.96; specificity = 0.58 to 0.65) [81]. The 3-item version resulted in an AUC of 0.78 to 0.86, with a cut-off score of 5 (sensitivity = 0.90 to 1.00; specificity = 0.51 to 0.60) [81]. The 4-item version resulted in an AUC of 0.82 to 0.86, with a cut-off score of 8 (sensitivity = 0.80 to 0.83; specificity = 0.68 to 0.70) [81]. The 6-item version resulted in an AUC of 0.84 to 0.89 with a cut-off score of 14 (sensitivity = 0.80 to 0.92; specificity = 0.72 to 0.76; see Table 2); accordingly, Lang and Stein [81] recommend either the 2-item or 6-item version, depending on how much specificity can be sacrificed for a given population (i.e., the more items, the greater specificity). The PCL-C-SF questionnaires have been further validated in VA populations seeking SUD treatment [82]. The 2-item version in the VA SUD sample resulted in an AUC of 0.81, with a cut-off score of 4 (sensitivity = 0.82; specificity = 0.73) [82]. The 3-item version resulted in an AUC of 0.84, with a cut-off score of 6 (sensitivity = 0.78; specificity = 0.72) [82]. The 4-item version resulted in an AUC of 0.85, with a cut-off score of 9 (sensitivity = 0.71; specificity = 0.86) [82]. The 6-item version resulted in an AUC of 0.84, with a cut-off score of 12 (sensitivity = 0.75; specificity = 0.76) [82]. The 4-item version with a cut-off score of 9 is recommended for VA SUD samples [82]. The PCL-C-SF 6-item version has also been used in a PSP sample (paramedics, police, and firefighters) with good internal consistency (α = 0.88) [80]. The PCL-C-SF questionnaires appear to be psychometrically-sound measures for screening PTSD [81].

3.2.9. Short Posttraumatic Stress Disorder Rating Interview (SPRINT)

The SPRINT is an 8-item self-report screening questionnaire for PTSD and related aspects of somatic concerns, stress vulnerability, and functional impairment [83]. The SPRINT consists of 4 items related to the four PTSD symptom clusters (i.e., intrusion, avoidance, numbing, hyperarousal) and 4 items related to somatic distress, distress due to stressful events, interference with work, daily activities, and relationships [83]. Researchers compared the SPRINT to the M.I.N.I. [10] to assess diagnostic accuracy among outpatients participating in a clinical trial of PTSD and a random sample [83]. Cut-off scores of 14–17 in victims of trauma were associated with 96% diagnostic accuracy. Across both samples, a cut-off score of 14 resulted in sensitivity of 0.95 and specificity of 0.96 (see Table 2) [83]. Similar results were found in the Korean version of the SPRINT (a cut-off score of 15 resulted in sensitivity of 0.91 and a specificity of 0.93) and the Korean SPRINT showed good internal consistency (α = 0.86) [92]. The SPRINT appears to be a psychometrically-sound screening questionnaire for PTSD [83]. The conducted search did not identify any studies in which the SPRINT was specifically used with PSP populations.

4. Discussion

The reported rates of mental health conditions in Canadian PSP [1] has highlighted the need to find accurate and efficient means of assessing mental disorder symptoms in a timely fashion. Anecdotal feedback has identified the necessity for mental health screening instruments be easy to access, face valid, and concise. The practice of encouraging PSP to complete annual mental health assessments (often called “safeguard assessments”) has become increasingly common, especially as epidemiologic rates of posttraumatic stress injuries and occupational stress injuries in PSP have been increasingly understood [93,94]. Unfortunately, the resource demand for such assessments is often excessive for individual PSP organizations, leading to inconsistent adoption of the safeguard assessment process and limiting its utility. Without regular information regarding the mental health of front-line personnel, PSP organizations may be challenged to implement a consistent and universal mental health strategy, potentially leaving PSP at greater risk of psychological decline [95]. Thus, it is important to develop a mental health screening process that reflects the resource and funding challenges often faced by PSP departments.
Development of a short-form screening battery that assesses for symptoms commonly experienced by PSP could be a means of standardizing mental health assessment for PSP departments, thereby addressing the resource demand problem. Based on the current review, we recommend using the short-form screening battery outlined in Table 3 to screen for symptoms of depression, anxiety, panic disorder, PTSD, and alcohol use. The recommended battery was chosen based on psychometric properties of each scale, validation of the long form or brief form with PSP populations, accessibility of scales for use in clinical and research settings, and the estimated time to complete all measures (~5 min).

4.1. Limitations

The review was conducted and the search completed in 2019. Some of the presented screening tools (e.g., PC-PTSD-5, SPRINT) may have since been used or validated with PSP populations. Further, the current study was not a structured review, which means there is a possibility that some uncommon brief screening questionnaires were incidentally excluded in the results.

4.2. Conclusions and Directions for Future Research

There are several brief mental disorder screening questionnaires that have been diversely validated in general and clinical populations; nevertheless, there appears to be very few validation studies regarding screening tool use with PSP, and a paucity of questionnaires designed specifically for PSP. Future researchers focused on developing one or more brief mental health disorder screening questionnaires for PSP will also have to carefully balance sensitivity, specificity, relative severity, and symptom cataloguing. Further, the diagnostic accuracy, symptom severity, and symptom profiling available from general or military population data may not generalize to PSP because of their vocational experiences [4,96,97,98]. As such, future researchers should evaluate the generalizability of current screening measures for PSP who appear to be at heightened risk for developing mental disorder symptoms.

Author Contributions

All authors made substantial contributions consistent with the International Committee of Medical Journal Editors. The details describing the contributions are present below alphabetically by last name. G.S.A., R.N.C., and D.G. were involved in the conceptualization and application for funding. Initial design for the current article was a collaborative effort based on the following contributors, each of whom was responsible for overseeing their area-specific domains, all of whom reviewed, revised as necessary, and approved the final design in its entirety: G.S.A., R.N.C., D.G., and S.K. Data collection via literature search was conducted by S.K., with assistance from R.E.S. Write up for the current article was a collaborate effort primarily driven by S.K. and R.E.S. Clinical recommendations for screening were made by M.M. and A.M.S.; however, ALL authors reviewed the document and provided detailed feedback that was ultimately integrated into the submitted manuscript. All authors also approved the submitted version of the manuscript.

Funding

The author(s) disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: G.S. Anderson received funding for this project through a Canadian Institutes of Health Research (CIHR) Catalyst Grant (FRN: 162525). R. Nicholas Carleton’s research is supported by the Canadian Institutes of Health Research (CIHR) by a New Investigator Salary Award. This research was also supported in part by a CIHR Catalyst Grant (FRN: 162545).

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Acknowledgments

The authors would like to acknowledge the contributions of Helen Dragatsi, Grants Development Program Director, Justice Institute of British Columbia for her work on preparing the funding application.

Conflicts of Interest

No potential conflicts of interest were reported by the authors.

References

  1. Carleton, R.N.; Afifi, T.O.; Turner, S.; Taillieu, T.; Duranceau, S.; LeBouthillier, D.M.; Sareen, J.; Ricciardelli, R.; MacPhee, R.S.; Groll, D.; et al. Mental disorder symptoms among public safety personnel in Canada. Can. J. Psychiatry 2018, 63, 54–64. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  2. Canadian Institute for Public Safety Research and Treatment. Glossary of Terms: A Shared Understanding of the Common Terms Used to Describe Psychological Trauma (Version 2.0). 2019. Available online: https://www.cipsrt-icrtsp.ca/en/resources/glossary-of-terms (accessed on 31 March 2021).
  3. Statistics Canada. Canadian Community Health Survey: Mental health. 2012. Available online: https://www150.statcan.gc.ca/n1/en/daily-quotidien/130918/dq130918a-eng.pdf?st=xSmPUeux (accessed on 12 December 2020).
  4. Carleton, R.N.; Afifi, T.O.; Taillieu, T.; Turner, S.; Krakauer, R.L.; Anderson, G.S.; MacPhee, R.S.; Ricciardelli, R.; Cramm, H.A.; Groll, D.; et al. Exposures to potentially traumatic events among public safety personnel in Canada. Can. J. Behav. Sci. 2019, 51, 37–52. [Google Scholar] [CrossRef]
  5. Anderson, P.; Bendtsen, P.; Spak, F.; Reynolds, J.; Drummond, C.; Segura, L.; Keurhorst, M.N.; Palacio-Viera, J.; Wojnar, M.; Parkinson, K.; et al. Improving the delivery of brief interventions for heavy drinking in primary health care: Outcome results of the Optimizing Delivery of Health Care Intervention (ODHIN) five-country cluster randomized factorial trial. Addiction 2016, 111, 1935–1945. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  6. Mitchell, A.J.; Coyne, J.C. Do ultra-short screening instruments accurately detect depression in primary care? A pooled analysis and meta-analysis of 22 studies. Br. J. Gen. Pract. 2007, 57, 144–151. [Google Scholar]
  7. Spoont, M.; Arbisi, P.; Fu, S.; Greer, N.; Kehle-Forbes, S.; Meis, L.; Rutks, I.; Wilt, T.J. Screening for Posttraumatic Stress Disorder (PTSD) in Primary Care: A Systematic Review; Project No. 09-009; VA-ESP: Washington, DC, USA, 2013; pp. 1–67. [Google Scholar]
  8. O’Donnell, M.L.; Bryant, R.A.; Creamer, M.; Carty, J. Mental health following traumatic injury: Toward a health system model of early psychological intervention. Clin. Psychol. Rev. 2008, 28, 387–406. [Google Scholar] [CrossRef]
  9. Zimmerman, M. To screen or not to screen: Conceptual issues in screening for psychiatric disorders in psychiatric patients with a focus on the performance of the Psychiatric Diagnostic Screening Questionnaire. Int. J. Ment. Health Addict. 2008, 6, 53–63. [Google Scholar] [CrossRef]
  10. Sheehan, D.V.; Lecrubier, Y.; Sheehan, K.H.; Amorim, P.; Janavs, J.; Weiller, E.; Hergueta, T.; Baker, R.; Dunbar, G.C. The Mini-International Neuropsychiatric Interview (M.I.N.I.): The development and validation of a structured diagnostic psychiatric interview for DSM-IV and ICD-10. J. Clin. Psychiatry 1998, 59, 22–33. [Google Scholar]
  11. Tehrani, N.; Hesketh, I. The role of psychological screening for emergency service responders. Int. J. Emerg. Serv. 2019, 8, 4–19. [Google Scholar] [CrossRef]
  12. Bradley, K.A.; Bush, K.; McDonnell, M.B.; Malone, T.; Fihn, S.D. Screening for problem drinking: Comparison of CAGE and AUDIT. J. Gen. Intern. Med. 1998, 13, 379–388. [Google Scholar] [CrossRef]
  13. Spitzer, R.L.; Kroenke, K.; Williams, J.B.; Löwe, B. A brief measure for assessing generalized anxiety disorder: The GAD-7. Arch. Intern. Med. 2006, 166, 1092–1097. [Google Scholar] [CrossRef] [Green Version]
  14. Kroenke, K.; Spitzer, R.L.; Williams, J.B. The PHQ-9: Validity of a brief depression severity measure. J. Gen. Intern. Med. 2001, 16, 606–613. [Google Scholar] [CrossRef]
  15. Shear, M.K.; Brown, T.A.; Barlow, D.H.; Money, R.; Sholomskas, D.E.; Woods, S.W.; Gorman, J.M.; Papp, L.A. Multicenter collaborative panic disorder severity scale. Am. J. Psychiatry 2001, 154, 1571–1575. [Google Scholar] [CrossRef]
  16. Weathers, F.W.; Litz, B.T.; Keane, T.M.; Palmieri, P.A.; Marx, B.P.; Schnurr, P.P. The PTSD Checklist for DSM-5 (PCL-5). Scale Available from the National Center for PTSD. Available online: www.ptsd.va.gov (accessed on 12 December 2020).
  17. Babor, T.F.; Higgins-Biddle, J.C.; Saunders, J.B.; Monteiro, M.G. The Alcohol Use Disorders Identification Test: Guidelines for Use in Primary Care, 2nd ed.; World Health Organization: Geneva, Switzerland, 2001; pp. 1–41. [Google Scholar]
  18. Oncology Nursing Society. Generalized Anxiety Disorder 7-Item Scale: English. Available online: https://www.ons.org/assessment-tools/generalized-anxiety-disorder-7-item-scale-gad-7-english (accessed on 6 January 2021).
  19. Oncology Nursing Society. The Patient Health Questionnaire 9 (PHQ9): English. Available online: https://www.ons.org/assessment-tools/patient-health-questionnaire-phq9-english (accessed on 6 January 2021).
  20. National Centre for PTSD. PTSD Checklist for DSM-5 (PCL-5). Available online: https://www.ptsd.va.gov/professional/assessment/adult-sr/ptsd-checklist.asp (accessed on 29 January 2021).
  21. Castro, C.A. The US framework for understanding, preventing, and caring for the mental health needs of service members who served in combat in Afghanistan and Iraq: A brief review of the issues and the research. Eur. J. Psychotraumatol. 2014, 5, 24713. [Google Scholar] [CrossRef] [Green Version]
  22. Hanley, J.A.; McNeil, B.J. The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology 1982, 143, 29–36. [Google Scholar] [CrossRef] [Green Version]
  23. Swets, J.A. Measuring the accuracy of diagnostic systems. Science 1988, 240, 1285–1292. [Google Scholar] [CrossRef] [Green Version]
  24. Bliese, P.; Wright, K.; Adler, A.; Thomas, J. Validation of the 90 to 120 Day Post-Deployment Psychological Short Screen; Report No. 2004-002; US Army Medical Research Unit—Europe: Heidelberg, Germany, 2004; pp. 1–16. [Google Scholar]
  25. Means-Christensen, A.J.; Sherbourne, C.D.; Roy-Byrne, P.P.; Craske, M.G.; Stein, M.B. Using five questions to screen for five common mental disorders in primary care: Diagnostic accuracy of the Anxiety and Depression Detector. Gen. Hosp. Psychiatry 2006, 28, 108–118. [Google Scholar] [CrossRef]
  26. Humeniuk, R.; Ali, R.; Babor, T.F.; Farrell, M.; Formigoni, M.L.; Jittiwutikarn, J.; de Lacerda, R.B.; Ling, W.; Marsden, J.; Monteiro, M.; et al. Validation of the alcohol, smoking and substance involvement screening test (ASSIST). Addiction 2008, 103, 1039–1047. [Google Scholar] [CrossRef]
  27. Wittchen, H.U.; Höfler, M.; Gander, F.; Pfister, H.; Storz, S.; Üstün, B.; Müller, R.C.; Kessler, R.C. Screening for mental disorders: Performance of the Composite International Diagnostic—Screener (CID-S). Int. J. Methods Psychiatr. Res. 1999, 8, 5970. [Google Scholar] [CrossRef]
  28. Kessler, R.C.; Calabrese, J.R.; Farley, P.A.; Gruber, M.J.; Jewell, M.A.; Katon, W.; Keck, P.E.; Nirenberg, A.A.; Sampson, N.A.; Shear, M.K.; et al. Composite International Diagnostic Interview screening scales for DSM-IV anxiety and mood disorders. Psychol. Med. 2013, 43, 1625–1637. [Google Scholar] [CrossRef]
  29. Berwick, D.M.; Murphy, J.M.; Goldman, P.A.; Ware, J.E.; Barsky, A.J.; Weinstein, M.C. Performance of a five-item mental health screening test. Med. Care 1991, 29, 169–176. [Google Scholar] [CrossRef]
  30. Cuijpers, P.; Smits, N.; Donker, T.; Have, M.T.; de Graaf, R. Screening for mood and anxiety disorders with the five-item, the three-item, and the two-item Mental Health Inventory. Psychiatry Res. 2009, 168, 250–255. [Google Scholar] [CrossRef]
  31. Rumpf, H.-J.; Meyer, C.; Hapke, U.; John, U. Screening for mental health: Validity of the MHI-5 using DSM-IV Axis I psychiatric disorders as gold standard. Psychiatry Res. 2001, 105, 243–253. [Google Scholar] [CrossRef]
  32. Kessler, R.C.; Green, J.G.; Gruber, M.J.; Sampson, N.A.; Bromet, E.; Cuitan, M.; Furukawa, T.A.; Gureje, O.; Hinkov, H.; Hu, C.-Y.; et al. Screening for serious mental illness in the general population with the K6 screening scale: Results from the WHO World Mental Health (WMH) survey initiative. Int. J. Methods Psychiatr. Res. 2010, 19, 4–22. [Google Scholar] [CrossRef] [Green Version]
  33. Janzen, B.L.; Muhajarine, N.; Zhu, T.; Kelly, I.W. Effort-reward imbalance, overcommitment, and psychological distress in Canadian police officers. Psychol. Rep. 2007, 100, 525–530. [Google Scholar] [CrossRef]
  34. Milligan-Saville, J.; Choi, I.; Deady, M.; Scott, P.; Tan, L.; Calvo, R.A.; Bryant, R.A.; Clozier, N.; Harvey, S.B. The impact of trauma exposure on the development of PTSD and psychological distress in a volunteer fire service. Psychiatry Res. 2018, 270, 1110–1115. [Google Scholar] [CrossRef]
  35. Gill, S.C.; Butterworth, P.; Rodgers, B.; Mackinnon, A. Validity of the mental health component scale of the 12-item short-form health survey (MCS-12) as measure of common mental disorders in the general population. Psychiatry Res. 2007, 152, 63–71. [Google Scholar] [CrossRef]
  36. Bryant, R.A.; Kenny, L.; Rawson, N.; Cahill, C.; Joscelyne, A.; Garber, B.; Tockar, J.; Dawson, K.; Nickerson, A. Efficacy of exposure-based cognitive behaviour therapy for posttraumatic stress disorder in emergency service personnel: A randomised clinical trial. Psychol. Med. 2019, 49, 1565–1573. [Google Scholar] [CrossRef]
  37. Gaynes, B.N.; DeVeaugh-Geiss, J.; Weir, S.; Gu, H.; MacPherson, C.; Schulberg, H.C.; Culpepper, L.; Rubinow, D.R. Feasibility and diagnostic validity of the M-3 Checklist: A brief, self-rated screen for depressive, bipolar, anxiety, and posttraumatic stress disorders in primary care. Ann. Fam. Med. 2010, 8, 160–169. [Google Scholar] [CrossRef] [Green Version]
  38. Khubchandani, J.; Brey, R.; Kotecki, J.; Kleinfelder, J.; Anderson, J. The psychometric properties of PHQ-4 Depression and Anxiety Screening Scale among college students. Arch. Psychiatr. Nurs. 2016, 30, 457–462. [Google Scholar] [CrossRef]
  39. Kroenke, K.; Spitzer, R.L.; Williams, J.; Löwe, B. An ultra-brief screening scale for anxiety and depression: The PHQ-4. Psychosomatics 2009, 50, 613–621. [Google Scholar] [CrossRef]
  40. Santa Maria, A.; Wörfel, F.; Wolter, C.; Burkhard, G.; Rotter, M.; Stark, S.; Kleiber, D.; Renneberg, B. The role of job demands and job resources in the development of emotional exhaustion, depression, and anxiety among police officers. Police Q. 2018, 21, 109–134. [Google Scholar] [CrossRef] [Green Version]
  41. O’Donnell, M.L.; Creamer, M.C.; Parslow, R.; Elliott, P.; Holmes, A.C.N.; Ellen, S.; Judson, R.; McFarlane, A.C.; Silove, D.; Bryant, R.A. A predictive screening index for posttraumatic stress disorder and depression following traumatic injury. J. Consult. Clin. Psychol. 2008, 76, 923–932. [Google Scholar] [CrossRef] [PubMed]
  42. Donker, T.; van Straten, A.; Marks, I.; Cuijpers, P. A brief web-based screening questionnaire for common mental disorders: Development and validation. J. Med. Internet Res. 2009, 11, e19. [Google Scholar] [CrossRef] [PubMed]
  43. Meuldijk, D.; Giltay, E.J.; Carlier, I.V.; Van Vliet, I.M.; Van Hemert, A.M.; Zitman, F.G. A Validation Study of the Web Screening Questionnaire (WSQ) Compared with the Mini-International Neuropsychiatric Interview-Plus (MINI-Plus). JMIR Ment. Health 2017, 4, e35. [Google Scholar] [CrossRef] [Green Version]
  44. World Health Organization. Composite International Diagnostic Interview (CIDI); Version 2.1; World Health Organization: Geneva, Switzerland, 1997. [Google Scholar]
  45. American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders, 4th ed.; American Psychiatric Association: Washington, DC, USA, 1994; ISBN 0890420629. [Google Scholar]
  46. Khan, R.; Chatton, A.; Thorens, G.; Achab, S.; Nallet, A.; Broers, B.; Calzada, G.; Poznyak, V.; Zullino, D.; Khazaal, Y. Validation of the French version of the Alcohol, Smoking, and Substance Involvement Screening Test (ASSIST) in the elderly. Subst. Abus. Treat. Prev. Policy 2012, 7, 14. [Google Scholar] [CrossRef]
  47. Valladolid, G.R.; Martinez-Raga, J.; Martinez-Gras, I.; Alfaro, G.P.; de La Cruz Bértolo, J.; Barba, R.J.; Sánchez-Junco, A.R.; Montejo, J.Z. Validation of the Spanish version of the Alcohol, Smoking, and Substance Involvement Screening Test (ASSIST). Psicothema 2014, 26, 180–185. [Google Scholar] [CrossRef]
  48. Gryczynski, J.; Kelly, S.M.; Mitchell, S.G.; Kirk, A.; O’Grady, K.E.; Schwartz, R.P. Validation and performance of the Alcohol, Smoking, and Substance Involvement Screening Test (ASSIST) among adolescent primary care patients. Addiction 2014, 110, 240–247. [Google Scholar] [CrossRef] [Green Version]
  49. Newcombe, D.; Tanielu-Stowers, H.; McDermott, R.; Stephen, J.; Nosa, V. The validation of the Alcohol, Smoking, Substance Involvement Screening Test (ASSIST) amongst Pacific people in New Zealand. N. Z. J. Psychol. 2016, 45, 30–39. [Google Scholar]
  50. World Health Organization. International Classification of Diseases 10th Revision; World Health Organization: Geneva, Switzerland, 1991. [Google Scholar]
  51. First, M.B.; Spitzer, R.L.; Gibbon, M.; Williams, J.B.W. Structural Clinical Interview for DSM-IV Axis Disorders (SCID-IV); Biometrics Research Department, New York State Psychiatric Institute: New York, NY, USA, 1997. [Google Scholar]
  52. Ware, J.E.; Johnston, S.A.; Davies-Avery, A.; Brook, R.H. Conceptualization and Measurement of Health for Adults in the Health Insurance Experiment, Mental Health; The Rand Corporation: Santa Monica, CA, USA, 1979; Volume 3, ISBN 0833001612. [Google Scholar]
  53. World Health Organization. Composite International Diagnostic Interview (CIDI); Version 1.0; World Health Organization: Geneva, Switzerland, 1990. [Google Scholar]
  54. American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders, 3rd ed.; American Psychiatric Association: Washington, DC, USA, 1987; ISBN 978-0890420195. [Google Scholar]
  55. Kessler, R.C.; Andrews, G.; Colpe, L.J.; Hiripi, E.; Mroczek, D.K.; Normand, S.L.; Walters, E.E.; Zaslavsky, A.M. Short screening scales to monitor population prevalences and trends in non-specific psychological distress. Psychol. Med. 2002, 32, 959–976. [Google Scholar] [CrossRef]
  56. Kessler, R.C.; Barker, P.R.; Colpe, L.J.; Epstein, J.F.; Gfroerer, J.C.; Hiripi, E.; Howes, M.J.; Normand, S.L.; Manderscheid, R.W.; Walters, E.E.; et al. Screening for serious mental illness in the general population. Arch. Gen. Psychiatry 2003, 60, 184–189. [Google Scholar] [CrossRef]
  57. Prochaska, J.J.; Sung, H.-Y.; Max, W.; Shi, Y.; Ong, M. Validity study of the K6 scale as a measure of moderate mental health distress based on mental health treatment need and utilization. Int. J. Methods Psychiatr. Res. 2012, 21, 88–97. [Google Scholar] [CrossRef]
  58. Easton, S.D.; Safadi, N.S.; Wang, Y.; Hasson, R.G. The Kessler Psychological Distress Scale: Translation and validation of an Arabic version. Health Qual. Life Outcomes 2017, 15, 215. [Google Scholar] [CrossRef] [Green Version]
  59. Won, M.J.; Hae, L.S. Validation of the K6/K10 Scales of psychological distress and their optimal cutoff scores for older Koreans. Int. J. Aging Hum. Dev. 2015, 80, 264–282. [Google Scholar] [CrossRef]
  60. Ware, J.E.; Kosinski, M.; Keller, S.D. A 12-Item Short-Form Health Survey: Construction of scales and preliminary tests of reliability and validity. Med. Care 1996, 34, 220–233. [Google Scholar] [CrossRef] [Green Version]
  61. Ware, J.E.; Sherbourne, C.D. The MOS Short-Form Health Survey (SF-36): I. Conceptual framework and item selection. Med. Care 1992, 30, 473–483. [Google Scholar] [CrossRef]
  62. Spitzer, R.L.; First, M.B.; Gibbon, M.; Williams, J.B.W. Structured Clinical Interview for DSM-III-R; American Psychiatric Press: Washington, DC, USA, 1990. [Google Scholar]
  63. Kroenke, K.; Spitzer, R.L.; Williams, J.B. The Patient Health Questionnaire-2: Validity of a two-item depression screener. Med. Care 2003, 41, 1284–1292. [Google Scholar] [CrossRef]
  64. Kroenke, K.; Spitzer, R.L.; Williams, J.B.W.; Monahan, P.O.; Löwe, B. Anxiety disorders in primary care: Prevalence, impairment, comorbidity, and detection. Ann. Intern. Med. 2007, 146, 317–325. [Google Scholar] [CrossRef]
  65. Löwe, B.; Wahl, I.; Rose, M.; Spitzer, C.; Glaesmer, H.; Wingenfeld, K.; Schneider, A.; Brahler, E. A 4-item measure of depression and anxiety: Validation and standardization of the Patient Health Questionnaire-4 (PHQ-4) in the general population. J. Affect. Disord. 2010, 122, 86–95. [Google Scholar] [CrossRef]
  66. Löwe, B.; Kroenke, K.; Gräfe, K. Detecting and monitoring depression with a two-item questionnaire (PHQ-2). J. Psychosom. Res. 2005, 58, 163–171. [Google Scholar] [CrossRef]
  67. American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders, 4th ed.; American Psychiatric Association: Washington, DC, USA, 2000; ISBN 0890420254. [Google Scholar]
  68. Bush, K.R.; Kivlahan, D.R.; McDonell, M.B.; Fihn, S.D.; Bradley, K.A. The AUDIT alcohol consumption questions (AUDIT-C): An effective brief screening test for problem drinking. Arch. Intern. Med. 1998, 158, 1789–1795. [Google Scholar] [CrossRef] [Green Version]
  69. Frank, D.; DeBenedetti, A.F.; Volk, R.J.; Williams, E.C.; Kivlahan, D.R.; Bradley, K.A. Effectiveness of the AUDIT-C as a screening test for alcohol misuse in three race/ethnic groups. J. Gen. Intern. Med. 2008, 23, 781–787. [Google Scholar] [CrossRef] [Green Version]
  70. Jeong, H.S.; Park, S.; Lim, S.M.; Ma, J.; Kang, I.; Kim, J.; Kim, E.-J.; Choi, Y.J.; Lim, J.-H.; Chung, Y.-A.; et al. Psychometric properties of the Alcohol Use Disorders Identification Test-Consumption (AUDIT-C) in public first responders. Subst. Use Misuse 2017, 52, 1069–1075. [Google Scholar] [CrossRef]
  71. Gallyer, A.J.; Dougherty, S.P.; Gai, A.R.; Stanley, I.H.; Hom, M.A.; Rogers, M.L.; Duffy, M.E.; Buchman-Schmitt, J.M.; Spencer-Thomas, S.; Joiner, T.E. Problematic alcohol use and suicidal ideation among firefighters: A multi-study investigation of the explanatory roles of perceived burdensomeness and thwarted belongingness. J. Affect. Disord. 2018, 238, 281–288. [Google Scholar] [CrossRef]
  72. Hom, M.A.; Stanley, I.H.; Spencer-Thomas, S.; Joiner, T.E. Exposure to suicide and suicide bereavement among women firefighters: Associated suicidality and psychiatric symptoms. J. Clin. Psychol. 2018, 74, 2219–2237. [Google Scholar] [CrossRef]
  73. Mumford, E.A.; Taylor, B.G.; Kubu, B. Law enforcement officer safety and wellness. Police Q. 2015, 18, 111–133. [Google Scholar] [CrossRef]
  74. Stanley, I.H.; Boffa, J.W.; Hom, M.A.; Kimbrel, N.A.; Joiner, T.E. Differences in psychiatric symptoms and barriers to mental health care between volunteer and career firefighters. Psychiatry Res. 2017, 247, 236–242. [Google Scholar] [CrossRef] [Green Version]
  75. Forsell, E.; Kraepelien, M.; Blom, K.; Isacsson, N.; Jernelöv, S.; Svanborg, C.; Rosén, A.; Kaldo, V. Development of a very brief scale for detecting and measuring panic disorder using two items from the Panic Disorder Severity Scale-Self Report. J. Affect. Disord. 2019, 257, 615–622. [Google Scholar] [CrossRef]
  76. O’Hare, T.; Shen, C.; Sherrer, M. Validation of a brief PTSD scale for clients with severe mental illnesses. Res. Soc. Work Pract. 2012, 22, 420–427. [Google Scholar] [CrossRef]
  77. Batterham, P.J.; Mackinnon, A.J.; Christensen, H. The Panic Disorder Screener (PADIS): Development of an accurate and brief population screening tool. Psychiatry Res. 2015, 228, 72–76. [Google Scholar] [CrossRef]
  78. Prins, A.; Bovin, M.J.; Smolenski, D.; Marx, B.P.; Kimerling, R.; Jenskins-Guarnieri, M.A.; Kaloupek, D.G.; Schnurr, P.P.; Pless Kaiser, A.; Leyva, Y.E.; et al. The primary care PTSD screen for DSM-5 (PC-PTSD-5): Development and evaluation within a veteran primary care sample. J. Gen. Intern. Med. 2016, 31, 1206–1211. [Google Scholar] [CrossRef] [PubMed]
  79. Zuromski, K.L.; Ustun, B.; Hwang, I.; Keane, T.M.; Marx, B.P.; Stein, M.B.; Ursano, R.J.; Kessler, R.C. Developing an optimal short-form of the PTSD Checklist for DSM-5 (PCL-5). Depress. Anxiety 2019, 36, 790–800. [Google Scholar] [CrossRef] [PubMed]
  80. Herr, D.J.; Buchanan, E.M. Generativity and other buffers of death awareness in first responders. Anxiety Stress Coping 2020, 33, 193–206. [Google Scholar] [CrossRef] [PubMed]
  81. Lang, A.J.; Stein, M.B. An abbreviated PTSD checklist for use as a screening instrument in primary care. Behav. Res. Ther. 2005, 43, 585–594. [Google Scholar] [CrossRef] [PubMed]
  82. Tiet, Q.Q.; Schutte, K.K.; Leyva, Y.E. Diagnostic accuracy of brief PTSD screening instruments in military veterans. J. Subst. Abus. Treat. 2013, 45, 134–142. [Google Scholar] [CrossRef]
  83. Connor, K.M.; Davidson, J.R.T. SPRINT: A brief global assessment of post- traumatic stress disorder. Int. Clin. Psychopharmacol. 2001, 16, 279–284. [Google Scholar] [CrossRef]
  84. Foa, E.B.; Cashman, L.; Jaycox, L.; Perry, K. The validation of a self-report measure of posttraumatic stress disorder: The Posttraumatic Diagnostic Scale. Psychol. Assess. 1997, 9, 445–451. [Google Scholar] [CrossRef]
  85. Foa, E.B.; Tolin, D.F. Comparison of the PTSD Symptom Scale-Interview Version and the clinician-administered PTSD scale. J. Trauma. Stress 2000, 13, 181–191. [Google Scholar] [CrossRef]
  86. Manea, L.; Gilbody, S.; Hewitt, C.; North, A.; Plummer, F.; Richardson, R.; Thombs, B.D.; Williams, B.; McMillan, D. Identifying depression with the PHQ-2: A diagnostic meta-analysis. J. Affect. Disord. 2016, 202, 382–395. [Google Scholar] [CrossRef]
  87. Prins, A.; Ouimette, P.; Kimerling, R.; Cameron, R.P.; Hugelshofer, D.D.; Shaw-Hegwer, J.; Thrailkill, A.; Gusman, F.D.; Sheikh, J.I. The primary care PTSD screen (PC-PTSD): Development and operating characteristics. Prim. Care Psychiatry 2003, 9, 9–14. [Google Scholar] [CrossRef]
  88. American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders, 5th ed.; American Psychiatric Association: Washington, DC, USA, 2013; ISBN 9780890425558. [Google Scholar]
  89. Jung, Y.-E.; Kim, D.; Kim, W.-H.; Roh, D.; Chae, J.-H.; Park, J.E. A brief screening tool for PTSD: Validation of the Korean version of the Primary Care PTSD Screen for DSM-5 (K-PC-PTSD-5). J. Korean Med. Sci. 2018, 33, e338. [Google Scholar] [CrossRef]
  90. Weathers, F.W.; Litz, B.T.; Huska, J.A.; Keane, T.M. The PTSD Checklist-Civilian Version (PCL-C); National Center for PTSD: Boston, MA, USA, 1994. [Google Scholar]
  91. World Health Organization. Composite International Diagnostic Interview (CIDI); Core Version 2.1; World Health Organization: Geneva, Switzerland, 1998. [Google Scholar]
  92. Kim, T.-S.; Chung, M.Y.; Kim, W.; Koo, Y.J.; Ryu, S.G.; Kim, E.-J.; Woo, J.-M.; Kim, T.-H.; Yang, J.-C.; Choi, K.-S.; et al. Psychometric properties of the Korean version of the Short Posttraumatic Stress Disorder Rating Interview (K-SPRINT). Psychiatry Clin. Neurosci. 2008, 62, 34–39. [Google Scholar] [CrossRef]
  93. Krause, M. History and evolution of the FBI’s undercover safeguard program. Consult. Psychol. J. Pract. Res. 2009, 61, 5–13. [Google Scholar] [CrossRef]
  94. Marin, A. “In the Line of Duty”: Investigation into How the Ontario Provincial Police and the Ministry of Community Safety and Correctional Services have Addressed Operational Stress Injuries Affecting Police Officers; Ombudsman Ontario: Toronto, ON, Canada, 2012; pp. 1–158. [Google Scholar]
  95. Patterson, G.T.; Chung, I.W.; Swan, P.W. Stress management interventions for police officers and recruits: A meta-analysis. J. Exp. Criminol. 2014, 10, 487–513. [Google Scholar] [CrossRef]
  96. Carleton, R.N.; Afifi, T.O.; Taillieu, T.; Turner, S.; Mason, J.E.; Ricciardelli, R.; McCreary, D.R.; Vaughan, A.D.; Anderson, G.S.; Krakauer, R.L.; et al. Assessing the relative impact of diverse stressors among public safety personnel. Int. J. Environ. Res. Public Health 2020, 17, 1234. [Google Scholar] [CrossRef] [Green Version]
  97. Ricciardelli, R.; Carleton, R.N.; Cramm, H.; Groll, D. Qualitatively unpacking Canadian public safety personnel experiences of trauma and their wellbeing: Physical manifestations, psychological implications, and fatalistic attitudes. Can. J. Criminol. Crim. Justice 2018, 60, 566–577. [Google Scholar] [CrossRef]
  98. Ricciardelli, R.; Carleton, R.N.; Mooney, T.; Cramm, H. “Playing the system”: Structural factors potentiating mental health stigma, challenging awareness, and creating barriers to care for Canadian public safety personnel. Health 2020, 24, 259–278. [Google Scholar] [CrossRef]
Table 1. Features and Empirical Evidence of Brief Mental Disorder Screening Questionnaires (Multiple Disorder Symptom Questionnaires).
Table 1. Features and Empirical Evidence of Brief Mental Disorder Screening Questionnaires (Multiple Disorder Symptom Questionnaires).
Screening
Questionnaire
FeaturesMental Disorders ScreenedCut-Off ScoresStudy/Validation SamplePsychometric Properties
Symptom(s)SensitivitySpecificityAUCCronbach’s αAdditional
Reliability
90 to 120 Day Post-Deployment Psychological Short Screen15 items

Combination of Yes/No response options and Likert type scales (various response options)
Symptoms related to a potentially traumatic stressor


Depression






Relationship Problems

Alcohol Problems

Anger Problems
≥3 Yes responses




≥2 positive
responses (More than Half the Days or
Nearly Every Day)

2 Yes responses

2 Yes responses

Sometimes–Very Often
1578 US soldiers post-deployment and 356 soldiers pre-deployment in the United States [24]

Psychologically
Traumatic Stress

Depression

Relationship Problems

Alcohol Problems

Anger Problems


0.46



0.50–0.53

0.40–0.82


0.33


0.59


0.97



0.94–0.96

0.89–0.92


0.94


0.91
Not
reported
Not
reported
Not
reported
Anxiety and
Depression
Detector (ADD)
5 items

Yes/No response option
PD

PTSD

SP

GAD

MDD
N/A801 primary care patients
in the United States [25]
PD

PTSD

SP

GAD

MDD
0.92

0.62

0.69

1.00

0.85
0.74

0.83

0.76

0.56

0.73
Not reportedNot reportedNot reported
Alcohol, Smoking, and Substance Involvement Screening Test (ASSIST)8 items

Yes/No qualifier response option for substance involvement (SI)

5-point Likert type scale for frequency of use (Never–Daily/Almost Daily)
Total Use/Abuse

Total Abuse/Dependence

Alcohol Use/Abuse

Alcohol Abuse/Dependence

Cannabis Use/Abuse

Cannabis Abuse/Dependence

Cocaine Use/Abuse

Cocaine Abuse/Dependence

Amphetamine Type Stimulant Use/Abuse

Amphetamine Type Stimulant Abuse/Dependence

Sedative Use/Abuse

Sedative Abuse/Dependence

Opioid Use/Abuse

Opioid Abuse/Dependence
14.5

28.5


5.5

10.5


1.5

10.5


0.5

8.5


0.5


11.5



9.5

10.5


0.5

14.5
1047 participants (697 primary health care patients; 350 patients attending specialized drug treatment facilities) across multiple sites (Australia, Brazil, India, Thailand, United Kingdom, United States, Zimbabwe) [26]Total Use/Abuse

Total Abuse/Dependence


Alcohol Use/Abuse

Alcohol Abuse/Dependence


Cannabis Use/Abuse

Cannabis Abuse/Dependence

Cocaine Use/Abuse

Cocaine Abuse/Dependence

Amphetamine Type Stimulant Use/Abuse

Amphetamine Type Stimulant Abuse/Dependence

Sedative Use/Abuse

Sedative Abuse/Dependence

Opioid Use/Abuse

Opioid Abuse/Dependence
0.80


0.73



0.83


0.67



0.91


0.57



0.92


0.70


0.97



0.72




0.94


0.54


0.94


0.76
0.71


0.66



0.79


0.60



0.90


0.61



0.94


0.77


0.87



0.68




0.91


0.50


0.96


0.65
0.84


0.73



0.87


0.70



0.96


0.62



0.95


0.84


0.96



0.77




0.96


0.45


0.97


0.74
Total SI
0.89

Tobacco Specific SI
0.80

Alcohol Specific SI
0.84




Cannabis Specific SI
0.86




Cocaine SI
0.93




Ampheta-mine Type Stimulant Specific SI
0.94




Sedative Specific SI
0.89






Opioid Specific SI
0.94
Not reported
Composite International Diagnostic-Screener (CID-S)12 items

Yes/No response option
SD

PD

GAD

SP

Agoraphobia

Specific Phobia

Depressive Disorders

Hypomania

Mania

AUD

Prescription Drug Disorders

Other Illicit Substance Disorders
N/ARandom sample of 1095 participants [27]SD

PD

GAD

SP

Agoraphobia

Specific Phobia

MDD

Mania

Alcohol Dependence/Abuse

Any Substance Disorder
0.80

1.00

0.91

0.92

0.83

0.92

0.84

1.00

0.79



1.00
0.48

0.47

0.46

0.46

0.48

0.49

0.48

0.46

0.47



0.46
Not reportedNot reportedTest–retest ϰ
0.64–0.92
Composite International Diagnostic Interview Screening Scale (CIDI-SC)9 preliminary
38 total items

Yes/No response option
MDD

GAD

PD

BPD
N/A3058 patients from primary care offices in the United States [28]
MDE

GAD

PD

BPD

0.80

0.68

0.76

0.74

0.90

0.94

0.94

0.99

0.93

0.88

0.90

0.97
Not reportedCohen’s ϰ
0.65

0.52

0.62

0.73
Five-Item Mental Health Inventory (MHI-5)5 items

6-point Likert type scale (All of the Time–None of the Time)
MDD

Dysthymia

BPD

GAD

PD

Agoraphobia

SP

Simple Phobia

OCD
Not reported213 individuals newly enrolled in the Harvard Community Health Plan in the United States [29]Any Affective Disorder

Anxiety Disorders

MDD
Not reportedNot reported0.78


0.74


0.89
Not reportedNot reported
Maximum sensitivity and specificity

MDD and Dysthymia
74

GAD
62

PD
70

OCD
78
Random sample of 7076 participants in the Netherlands [30]Any Mood Disorder

MDD

Dysthymia

BPD

Any Anxiety Disorder

GAD

PD

Agoraphobia

SP

Simple Phobia

OCD
0.90











0.74

0.78







1.00
0.80











0.89

0.83







0.78
0.92


0.93

0.91

0.88

0.73


0.90

0.87

0.80

0.77

0.69

0.93
0.83Not reported
4-week DSM-IV diagnoses

Mood Disorders
≤60

Anxiety Disorders
≤70

SDs
≤60

SUDs
≤70
Random sample of 4075 in Germany [31]


Mood Disorders

Anxiety Disorders

SDs

SUDs



0.83


0.73


0.43

0.67



0.78


0.60


0.78

0.58



0.88


0.71


0.65

0.66
0.74Not reported
The Kessler Psychological Distress K6 Screening Scale (K6)6 items

5-point Likert type scale (None of the Time–All of the Time)
Broad screener for serious mental illness (SMI)Probable Mental Disorder
13 to 24

Moderate Mental Disorder
5
Nationally representative adult samples totaling 41,770 across multiple sites (Brazil, Bulgaria, Colombia, India, Japan, Lebanon. Mexico. New Zealand. Nigeria
People’s Republic of China, People’s Republic of China Shenzhen, Romania. South Africa, Ukraine
United States) [32]
SMINot reportedNot reported0.76
to
0.86
Not reportedNot reported
Not reported78 police officers in Canada [33]Psychological DistressNot reportedNot reportedNot reported0.81Not reported
Not reported459 volunteer firefighters in Australia [34]Not reportedNot reportedNot reportedNot reportedNot reportedNot reported
The Mental Health Component Scale (MCS-12)12 items

Yes/No response options and varying item length scaled responses per question

Score range of 0
to 100 (lower scores reflect poorer mental health).
Broad screener for psychological symptoms and limitationsDepression
≤45

Any Anxiety Disorder
≤50

Any Common Mental Disorder
≤50

Severe Psychological Impairment
≤36
National Survey of Mental Health and Wellbeing 10,504 in Australia [35]Depression

Anxiety Disorders

Any common mental disorder
0.87

0.81


0.84
0.83

0.73


0.74
0.92

0.83


0.86
Not reportedNot reported
Mini-International Neuropsychiatric Interview (M.I.N.I.)21 preliminary items

Yes/No response options with optional clinician/researcher rater inquiries
MDD

Dysthymia

Suicidality

Mania

PD

Agoraphobia

SP

Specific Phobia

OCD

GAD

Alcohol Dependence

Alcohol Abuse

Drug Dependence

Drug Abuse

Psychotic Disorder

Anorexia Nervosa

PTSD

APD
N/A636 adult sample across the United States and France [10]

MDD



Dysthymia


Current Mania

Lifetime Mania

Current PD

Lifetime PD

Current Agoraphobia

Lifetime Agoraphobia

Current SP

Lifetime SP

Current Simple Phobia

Lifetime Simple Phobia

GAD

OCD



Current Psychotic Disorder

Lifetime Psychotic Disorder

Current Alcohol Dependence

Current Drug Dependence

Lifetime Drug Dependence

Anorexia

Bulimia

PTSD


0.96



0.67


0.82

0.81

0.84

0.88

0.85


0.82


0.81

0.81

0.78


0.70


0.91

0.62



0.84





0.88



0.80



0.45


0.77


0.90

0.92

0.85


0.88



0.99


0.95

0.94

0.93

0.93

0.88


0.92


0.86

0.90

0.90


0.93


0.86

0.98



0.89





0.92



0.95



0.96


0.92


1.00

0.99

0.96
Not reportedNot reportedInterrater/Test–retest ϰ
1.00/0.87


Not reported

0.79/0.35

0.89/0.63

0.92/0.68

0.97/0.79

0.97/0.73


0.92/0.81


0.94/0.65

0.88/0.68

0.88/0.63


0.88/0.52


0.98/0.78

1.00/0.85



0.81/0.77





0.90./0.83



1.00/0.86



0.91/0.96


0.94/0.86


1.00/0.78

1.00/1.00

0.95/0.73
N/A100 emergency service personnel (police, firefighters, paramedics) in Australia [36]Not reportedNot reportedNot reportedNot reportedNot reportedNot reported
My Mood Monitor (M-3) Checklist27 items

5-point Likert type scale (Not at All–Most of the Time
MDD

BPD

GAD

PD

SAD

OCD

PTSD

General Functional Impairment
≥5

≥2

≥3

Not reported

Not reported

Not reported

≥2


647 primary care seeking adults in the United States [37]
MDD

BPD

Anxiety Disorders

PTSD

Any Psychiatric Disorder

0.84

0.88

0.82


0.88

0.83

0.80

0.78

0.78


0.76

0.76
Not reportedNot reportedNot reported
Patient Health Questionnaire for Depression and Anxiety (PHQ-4)4 items

4-point Likert type scale (Not at All–Nearly Every Day)
MDD

GAD
Not reported934 undergraduate students from a Midwestern university in the United States [38]

GAD


MDD
Not reportedNot reported

0.84


0.79

GAD-2
0.84

PHQ-2
0.76

PHQ-4
0.81
Test–retest
ϰ
0.69–0.81
≥3 PHQ-2 (probable cases of MDD)

≥3 GAD-2 (probable cases of GAD)
2149 patients from 15 primary care clinics in the United States [39]

GAD

PD

SAD

PTSD



GAD

PD

SAD

PTSD
Not reportedNot reportedGAD-2

0.91

0.85

0.83

0.80

PHQ-2

0.81

0.75

0.78

0.77
GAD-2
0.82


PHQ-2
0.75

PHQ-4
0.85
Not reported
843 police officers in Germany [40]MDD

GAD
Not reportedNot reportedNot reported0.79Not reported
Posttraumatic Adjustment Scale (PAS)10 items

5-point Likert type scale (Not at All–Totally)
PTSD

MDE
≥16

≥4
527 hospitalized injury patients in Australia [41]PTSD

MDE
0.82

0.72
0.84

0.75
0.84

0.73
Not reportedNot reported
Web Screening Questionnaire (WSQ)15 items

Combination of Yes/No response options and Likert type scales (various response options)
MDD

GAD

PTSD

SP

PD

Agoraphobia

Specific Phobia

OCD

Alcohol Abuse/Dependence
MDD
Q1 ≥ 5 and
Q2 = 1

GAD
Q3 ≥ 2

PD
Q4 ≥ 1

PD with Agoraphobia
Q4 ≥ 1 and
Q5 = 1

Agoraphobia
Q5 = 1

Specific Phobia
Q6 or Q7 = 1

SP
Q8 = 1 and
Q9 = 1

PTSD
Q10 = 1 or
Q11 = 1

OCD
Q12 ≥ 1

Alcohol Abuse/Dependence
Q 13 ≥ 2 and
Q14 ≥ 3

Suicide
Q15 = 3 (exclusion)
502 online participants in the Netherlands [42]
MDD

GAD

SP

PD

PD with Agoraphobia

Agoraphobia

Specific Phobia


OCD

PTSD

Alcohol Abuse/Dependence

0.85

0.93

0.72

0.90

0.86


1.00

0.80


0.80

0.83

0.83

0.59

0.45

0.73

0.44

0.77


0.63

0.47


0.69

0.47

0.72

0.72

0.78

0.72

0.76

0.82


0.81

Not reported

0.81

0.65

0.77
Not reportedNot reported
Not reported1292 adults (1117 general population, 175 psychiatric outpatients) in the Netherlands [43]MDD

PD

PD with Agoraphobia

Agoraphobia

SP

Specific Phobia

GAD

PTSD

OCD

Alcohol Abuse/Dependence
0.58

1.00

0.90


0.81

0.79

1.00

0.66

0.79

0.67

0.56
0.94

0.89

0.97


0.95

0.93

0.73

0.90

0.52

0.91

0.93
0.83

0.98

0.99


0.80

0.95

0.93

0.89

0.86

0.82

0.82
Not reportedNot reported
Note. PD = panic disorder; PTSD = posttraumatic stress disorder; SP = social phobia; GAD = generalized anxiety disorder; MDD = major depressive disorder; MDE = major depressive episode; SD = somatoform disorder; AUD = alcohol used disorder; BPD = bipolar disorder; SUD = substance use disorder; APD = antisocial personality disorder; SAD = social anxiety disorder; AUC = area under the receiver operating characteristic (ROC) curve (i.e., the diagnostic power of the questionnaire in discriminating between those with and without the diagnosis of interest); sensitivity = the proportion of true cases detected by the questionnaire; specificity = the proportion of true non-cases correctly classified as non-cases by the questionnaire; RCT = randomized control trial; CBT = cognitive behaviour therapy; ϰ = Kappa co-efficient.
Table 2. Features and Empirical Evidence of Brief Mental Disorder Screening Questionnaires (Single-Disorder Symptom Questionnaires).
Table 2. Features and Empirical Evidence of Brief Mental Disorder Screening Questionnaires (Single-Disorder Symptom Questionnaires).
Screening QuestionnaireFeaturesMental Disorders ScreenedCut-Off ScoresStudy/Validation SamplePsychometric Properties
SymptomsSensitivitySpecificityAUCCronbach’s αAdditional
Reliability
Alcohol Use Disorders Identification Test-Consumption (AUDIT-C)3 items

5-point Likert type scale of alcohol consumption (Never/0 Drinks–6 or More Times a Week/10 or More Drinks)
Alcohol Abuse/Dependence

Heavy Drinking
≥3 for sensitivity

≥4 for specificity
243 VA general medical clinic patients in the United States [68]Alcohol Abuse/Dependence

Heavy Drinking

0.90



0.98

0.45



0.56

0.79



0.89
Not reportedNot reported
Alcohol misuse
≥4 for males and ≥3 for females
944 firefighters in the United States [71]Alcohol Abuse/Dependence and
Heavy Drinking
Not reportedNot reportedNot reported0.80Not reported
Not reported266 women firefighters in the United States [72]Alcohol Abuse/Dependence and
Heavy Drinking
Not reportedNot reportedNot reported0.67Not reported
Any AUD
≥7.5

Alcohol Dependence
≥8.5
222 public first responders in South Korea [70]
Any AUD

Alcohol Dependence
0.82

0.86
0.80

0.86
Not reportedNot reportedTest–retest
ICC
0.91
Alcohol misuse
≥4 for males and ≥3 for females
184 police officers in the United States [73]Not reportedNot reportedNot reportedNot reportedNot reportedNot reported
Not reported321 career firefighters
204 volunteer firefighters in the United States [74]
Alcohol Abuse/Dependence and
Heavy Drinking
Not reportedNot reportedNot reported0.81Not reported
Brief Panic Disorder Severity—Self Report (Brief PDSS-SR)2 itemsPD>35103 clients with PD, SAD, or MDD [75]PD0.850.660.82Not reportedωC = 0.74
Brief PTSD Screen (Brief PSS)3 items

4-point
Likert type scale (Not at All–Five or More Times per Week/Very Much)
PTSD comorbid with severe mental illness (SMI)≥3220 clients with a SMI diagnosis in the United States [76]PTSD0.940.850.960.81Not reported
Panic Disorder Screener (PADIS)4 items

Q1
5-point Likert type scale for number of panic episodes (None–11 or more)
Q1 response of 0 does not require completion of remaining items

Q 2-4
4-point Likert type scale (Never–All of the Time)
PD≥412,336 young adults in Australia [77]PD0.770.840.870.86Not reported
Patient Health Questionnaire-22 items

4-point Likert type scale (Not at All–Nearly Every Day)
MDD≥36000 patients in primary care and obstetrics-gynecology clinics in the United States [63]MDD0.830.920.93Not reportedNot reported
Not reported184 police officers in the United States [73]Not reportedNot reportedNot reportedNot reportedNot reportedNot reported
Primary Care Posttraumatic Stress Disorder screen (PC-PTSD-5)5 items

Yes/No response options
PTSD≥3 Yes398 VA primary care clients in the United States [78]PTSD0.950.850.94Not reportedNot reported
Short-Form PCL-54 items

5-point Likert type scale (Not at All–Extremely)
PTSDNot reported8917 active duty military to select items; 11728 for validation [79]PTSD0.990.880.93Not reportedNot reported
Short Forms of PTSD Checklist (PCL-C-SF)2 items
to
6 items

5-point Likert type scale (Not at All–Extremely)
PTSD6 items986 first responders (police, firefighters, paramedics) [80]PTSDNot reportedNot reportedNot reported0.88Not reported
2 items
≥4

6 items
≥14
221 VA primary care female patients
154 VA primary care patients in the United States [81]
PTSD2-item version
0.80–0.96

6-item version
0.80–0.92
2-item version
0.58–0.65

6-item version
0.72–0.86
2-item version
0.73–0.88

6-item version
0.84–0.89
Not reportedNot reported
4 items
≥9
Primary care VA patients seeking treatment
in SUD specialty treatment (158) and general mental health treatment (242) [82]
PTSD2-item version
0.72

4-item version
0.65

6-item version
0.75
2-item version
0.73

4-item version
0.90

6-item version
0.78
2-item version
0.81

4-item version
0.85

6-item version
0.84
Not reportedNot reported
Short Posttraumatic Stress Disorder Rating Interview (SPRINT)8 items

5-point Likert type scale (Not at All–Very Much)
PTSD and related symptoms14 to 1783 outpatients in clinical trial of PTSD and
630 randomly selected participants in the United States [83]
PTSD and related symptomsTotal sample
0.95

Clinical sample
0.62
Total sample
0.96

Clinical sample
0.94
Not reported0.78–0.88Test–retest
ICC
0.78

Interrater
ICC
1.00
Note. PD = panic disorder; PTSD = posttraumatic stress disorder; GAD = generalized anxiety disorder; MDD = major depressive disorder; MDE = major depressive episode; SD = somatoform disorder; AUD = alcohol used disorder; SUD = substance use disorder; SAD = social anxiety disorder; VA = veterans affairs; AUC = area under the receiver operating characteristic (ROC) curve (i.e., the diagnostic power of the questionnaire in discriminating between those with and without the diagnosis of interest); sensitivity = the proportion of true cases detected by the questionnaire; specificity = the proportion of true non-cases correctly classified as non-cases by the questionnaire; ICC = intraclass correlation coefficient.
Table 3. Recommended short-form screening battery for PSP.
Table 3. Recommended short-form screening battery for PSP.
Domain(s)Recommended MeasureNumber of Items
Depression and AnxietyPHQ-4 [39]4
Panic DisorderBrief PDSS-SR [75]2
PTSDShort-Form PCL-5 [79]4
Alcohol Use DisorderAUDIT-C [68]3
Estimated time to complete5 min
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Shields, R.E.; Korol, S.; Carleton, R.N.; McElheran, M.; Stelnicki, A.M.; Groll, D.; Anderson, G.S. Brief Mental Health Disorder Screening Questionnaires and Use with Public Safety Personnel: A Review. Int. J. Environ. Res. Public Health 2021, 18, 3743. https://doi.org/10.3390/ijerph18073743

AMA Style

Shields RE, Korol S, Carleton RN, McElheran M, Stelnicki AM, Groll D, Anderson GS. Brief Mental Health Disorder Screening Questionnaires and Use with Public Safety Personnel: A Review. International Journal of Environmental Research and Public Health. 2021; 18(7):3743. https://doi.org/10.3390/ijerph18073743

Chicago/Turabian Style

Shields, Robyn E., Stephanie Korol, R. Nicholas Carleton, Megan McElheran, Andrea M. Stelnicki, Dianne Groll, and Gregory S. Anderson. 2021. "Brief Mental Health Disorder Screening Questionnaires and Use with Public Safety Personnel: A Review" International Journal of Environmental Research and Public Health 18, no. 7: 3743. https://doi.org/10.3390/ijerph18073743

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop