Next Article in Journal / Special Issue
Sheet Barrier and Intubating Stylet
Previous Article in Journal / Special Issue
COVID-19 and Romantic Relationships
 
 
Search for Articles:
Title / Keyword
Author / Affiliation / Email
Journal
Article Type
 
 
Advanced Search
 
Section
Special Issue
Volume
Issue
Number
Page
 
Journals
Encyclopedia
Volume 1
Issue 4
10.3390/encyclopedia1040080
encyclopedia-logo
Submit to this Journal Review for this Journal Propose a Special Issue
► Article Menu

Article Menu

share Share announcement Help format_quote Cite question_answer Discuss in SciProfiles thumb_up
...
Endorse textsms
...
Comment
first_page
settings
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Entry

Digital Mental Health Amid COVID-19

by
Luke Balcombe
* and
Diego De Leo
Australian Institute for Suicide Research and Prevention, Department of Applied Psychology, Griffith University, Messines Ridge Road, Mount Gravatt, QLD 4122, Australia
*
Author to whom correspondence should be addressed.
Encyclopedia 2021, 1(4), 1047-1057; https://doi.org/10.3390/encyclopedia1040080
Submission received: 13 July 2021 / Revised: 4 October 2021 / Accepted: 13 October 2021 / Published: 20 October 2021
(This article belongs to the Collection Encyclopedia of COVID-19)
Versions Notes

Definition

:
Digital Mental Health is information and communication technology used in mental health services delivered or boosted through the Internet and related technologies, smartphone and wearable technologies as well as immersive solutions (e.g., Virtual Reality and video games). It is predominantly used as self-help services or with the assistance of a (para-)professional and/or artificial intelligence for the provision of mental health promotion as well as mental ill-health identification, prevention and intervention.

1. Introduction

1.1. Evolution of Digital Mental Health

Mental healthcare resources have been inundated during the economic and biopsychosocial recovery from COVID-19 [1,2]. Although in use since the early 2000s, an opportunity has arisen for digital mental health to fill unmet needs [3,4,5] and answer calls to improve the quality of and accessibility to mental health care [6,7,8]. It was already on a trajectory to regular practice, but COVID-19 added to demand outstripping supply of mental healthcare resources making a review of digital mental health more urgent. There has been a marked rise in the use of online self-help and telehealth interventions [9,10,11,12]. Systematic reviews found telehealth to be an effective and acceptable form of service delivery at least in the short term [13]. More generally, there are calls for higher levels of evidence, ongoing evaluation, and effective embedment [9,14,15,16]. A rapid meta-review found telehealth, internet-based, and app-based mobile digital interventions are well-placed to mitigate psychosocial consequences at the population level with good quality evidence on usability, safety, acceptance/satisfaction, and effectiveness [17]. Mixed levels of evidence were noted: lacking for apps having successful retention strategies; limited for mental health promotion; and lack of preliminary evidence for the long-term effects, process quality, and cost-effectiveness of digital interventions [17]. This integrative review synthesizes evidence from Scopus, ScienceDirect, CrossRef and Google Scholar searches of the challenges, systemic and practical issues, new progress, ongoing problems, and approaches of digital mental health as well as a focus on young people.

1.2. Challenges of Digital Mental Health

There is a need for rapidly deploying and efficiently integrating effective and evaluated digital solutions for users at individual, organizational, and governmental levels [6,18,19,20]. However, there are hindering issues in enacting a hybrid model of care e.g., the quality of digital mental health solutions needs to be better discerned and there is a need for more studies with vulnerable and at-risk populations [18]. Two systematic reviews and meta-analyses examined the effectiveness of digital mental health interventions. The first, for young adults with depression or substance misuse in low-income and middle-income countries, found moderate effectiveness when compared with control interventions [21]. The second, for anxiety and depression in perinatal patients in high-income countries, found nonspecialist providers may be effective in delivering counseling interventions [22]. However, only two online interventions were included. Further studies are required for digital intervention implementation processes to inform the optimal delivery and scale-up of these services.
There are a range of digital mental health interventions available for various mental health needs and conditions, from substance abuse recovery to suicide prevention [23]. Stronger evidence and new models of care will be necessary for higher accessibility, equity, and successful clinical implementation [5,20,24,25]. Predictive technologies (e.g., real-time machine learning algorithms) are useful for monitoring but should be deployed carefully as decision support tools [20,25,26]. On an operations level, there is the issue of integrating technology into mental health care delivery for diverse populations. The European Commission addressed organizational barriers (e.g., interoperability, and technical and legal issues) through a consortium action plan that also prioritized digital mental health research to target the most prevalent mental health problems and disorders [27]. Users need assistance to make informed decisions around the efficacy of digital mental health tools [13] as well as the intervention characteristics (e.g., convenience, suitability, reliability, user-friendliness, presentation, organizational integration, and cost). The adoption of digital tools has been hindered at the organizational and policy level—user-friendly workflows, decision models and protocols have been offered as solutions [19,28]. Suitable information, training, infrastructure, clinical guidelines, and policies may counter excessive information/workloads, ambiguous policies, mixed implementation, and a struggle to maintain systems [19,20].

2. Synthesis

2.1. Systemic and Practical Issues

A main barrier to equity in digital mental health interventions is that some people do not have access or skills to use digital resources [28]. There are inequities in affordable access to digital technologies for Indigenous people in Australia (63% have access to internet at home) which has a detrimental effect on cultural, social and mental health outcomes [29]. Recent efforts to implement and integrate digital mental health interventions into the United States (US) healthcare system may be helpful in reducing mental health care inequities in rural communities [30]. However, there is a lack of studies demonstrating sustainable improvements in symptoms and global functioning from specialized early intervention services [31]. Considerations other than equity include engagement, ethics, security, adaptability, and technicality [25,32]. There were mostly contextual issues noted in recent studies. An automated randomized controlled trial of an online peer-support program (Big White Wall) versus web-based information for self-management of anxiety and depression suggested a personal approach for participant engagement to explain the benefits of this novel intervention [33]. It was proposed that user engagement and satisfaction with a digital platform (Thought Spot) be related to content relevance, ease of learning, and available features [34]. The effectiveness of a digital platform with virtual coaches for cognitive behavior therapy (CBT) was explored in a qualitative study—it was important to find ways for users to be drawn to and then consistently engaged with the digital platform [35].
It was established before the current pandemic that stand-alone app-based treatments have increased affordability [36,37,38] but require simpler and stronger reimbursement systems [39]. ICare is an example of an adjunct online screening and intervention platform model whereby “partners will examine and compare the feasibility, acceptance, efficacy and (cost-)effectiveness, reach, and dissemination of the included online interventions” ([27], p.1). Recent adaptations of telehealth fee and reimbursement structures have yet to be evaluated for affordability. A theoretical model was applied in a patient-centered framework—using apps from the US and United Kingdom (UK) as examples—to produce country-specific estimates of the economic value of clinical improvement [40]. The new framework was proposed to help drive research priorities for digital health by explaining the factors that influence the economic value [40]. Studies have yet to establish models of mental healthcare system (cost-)effectiveness and improvement from integrating digital mental health, e.g., cohort longitudinal studies that examine scalable screening and tracking tools delivered in a hybrid model of care. Finding a balance between scalability and fidelity was noted to be important in the proposed empirical testing of a paraprofessional (peer-to-peer) digital mental health support model [41].

2.2. New Progress

Digital mental health interventions are assisting the facilitation of therapy, prediction, and prevention of mental ill-health [37,38,42,43,44]. The COVID-19 pandemic heightened the need to counter the medical and socio-economic effects of mental ill-health via deployment of assistive, preventative, and therapeutic solutions (e.g., internet-based data collection tools, digital platforms and apps) [13,20,45,46]. A multimethod study developed a co-designed freely available resource guide that builds on existing evidence on digital mental health tools [46]. There were safety, comfort, and flexibility noted for telehealth experiences during COVID-19, although face-to-face service delivery was still preferred [47]. There is a great opportunity for digital and data-driven tools to become prominent (e.g., machine learning algorithms and artificial intelligence (AI) platforms, the Internet of Things (IoT), digital phenotyping, and immersive solutions such as virtual reality (VR)) [25]. The resources required to guide the selection, implementation, and evaluation of machine learning algorithms and artificial intelligence (AI) platforms are available online for public use [48]. Guided adoption and integration of digital tools with clinical practice is not known to have been effectively studied.
Rapid psychological screening and tracking showed promise during COVID-19 through digital phenotyping of a telehealth platform service coupled with analysis by machine learning trained models [46]. A longitudinal observational study verified the acceptability and effectiveness of AI therapy for anxiety and depression [49]. A systematic review of the effectiveness and acceptance of technology-based psychological interventions in people with diagnosed depression found mostly positive impacts from stand-alone interventions, blended treatments, or in collaborative care trials [50]. An extensive trial of the clinical and (cost-)effectiveness of blended therapy (integration of Internet and mobile-based interventions into routine psychotherapy) is aiming for a rigorous healthcare services approach that innovates service provision while exploring mechanisms of change [51]. Technology Enabled Clinical Care (TECC) was proposed in a protocol for a longitudinal cohort study of smartphone-augmented mental health treatment primarily targeting changes in mood, anxiety, and stress [52]. The use of TECC in a System Dynamics Model may improve mental health and suicide outcomes by using technology infrastructure to quickly direct to the right mode of care as patients navigate primary and secondary mental healthcare services [53]. An informatics infrastructure (an extension of electronic health records) has advanced personalized decision-making in psychiatric care through standardized data acquisition and data access (transfer, storage, and export of clinical data) [54]. This development provides the opportunity for future studies to apply and validate real-time predictive modelling.

2.3. Ongoing Problems

Digital mental health implementation in clinical settings requires thoughtfulness and preparedness [55], along with a higher understanding of technical and medical standards, in order to increase effectiveness, validation, and user-centered design as well as to counter ethical concerns [20]. Stakeholders need an adequate infrastructure and skills-base [25,56] as well as ethical guidance in the development, deployment, and management of digital mental health solutions [20,56]. The paradoxical efforts to advance evidence and implementation of digital mental health led to the suggestion for simulation-based research [57]. Explainable Artificial Intelligence (XAI) research with predictive technologies [58] emphasized its potential to encapsulate improvement of safety and efficacy standards through stewardship and responsible innovation [25]. A narrative review on the therapeutic alliance in digital mental health interventions for those with serious mental illnesses (particularly on the psychotic spectrum or bipolar disorder) found a better understanding of human-computer interaction is required in evidence-based studies that facilitate responsible outcomes from a three-tiered approach (patient/user, mental health care practitioner, and machine) [59]. TECC is promising with regards to systematically coordinating and delivering appropriate mental health services [60]. The use of machine learning methods for statistically predicting suicide has been cautioned [61,62]. Engagement with the individual patient/user with regards to their specific problems and circumstances is preferred because the usefulness of machine learning in clinical settings is limited by an ongoing lack of information on model building, uncertain accuracy [63,64,65], clinical evaluation [28]. Integration of novel models of care and support for digital infrastructure/personnel require further research [25,41,59].

2.4. Approaches

Digital mental health services are available online (via desktops, mobile devices, and apps), including through web chat and peer support forums as well as by phone (e.g., calls or texts), to provide crisis support, psychotherapy, counseling, psychological treatments, health promotion, education, and prevention as well as support for recovery. A systematic review of digital mental health interventions developed for mental health practitioners during COVID-19 identified social media platforms, e-learning content, online resources, and mobile applications in 11 eligible studies [66]. However, there was a low level of empirical evaluation of these interventions (27%). Challenges and limitations related to the adoption of the reported interventions were common (55%) and greater heterogeneity is required given 45% of interventions were specific to China. A narrative review of digital psychotherapy found evidence of effectiveness for depression and anxiety disorders, of mild-to-moderate severity, from multiple randomized controlled trials and a large meta-analysis [67]. An online survey of the use of digital information and communication technologies in psychological counseling before and during a COVID-19 lockdown found overall positivity in the use of technologies and web-based interventions, with most practitioners noting approximately the same client involvement/adherence rates [68]. Interestingly, there was only a slight rise in the use of some tools (i.e., video conference, social networks, and virtual rooms), and slightly less use of others (i.e., telephone calls, emails, audio conferences, online intervention platforms, smartphone/tablet apps, online forums, and chats) [68].
A systematic review found digital interventions or counseling based on communications technologies to be as effective as face-to-face sessions [69]. Similar with traditional therapy and counseling settings, quality assurance issues that require escalation may be resolved by governing agencies or professional associations [70]. Furthermore, therapists and counselors should have computer skills and online communication competencies and should follow ethics, bylaws, rules/regulations, technological malfunction procedures and crisis procedures. A rapid review on the effectiveness of digital mental health interventions for individuals with an associated chronic disease (mental and/or physical) found web-based interventions and email had the most reports of improvement but further analyses were required before making stronger recommendations on the relevance for youth [71]. The potential for digital technologies to change clinical research and treatment is developing and a special applicability to young people experiencing mental health problems has been proposed [72]. The internet, as an information source and help-seeking promoter, as well as smartphone and wearable technologies are among promising tools. There is growing support for these approaches to be augmented in routine care especially among young people.

2.5. Digital Mental Health for Young People

Young people were the third most represented population identified in a rapid scoping review of digital mental health among at-risk groups in Asia-Pacific during COVID-19 [73]. A German longitudinal study on the mental health and coping behavior of university students before and after the onset of COVID-19 found the pandemic had a moderate overall effect [74]. A protocol for impact evaluation of an Australian digital mental health model of care for youth (headspace) outlined that there are ongoing poor mental health outcomes for young people (12–25 years of age) [75]. The Asian Pacific, German, and Australian studies found vulnerable subgroups among youth may be at high risk of negative mental health impacts. Accessibility via devices, such as smartphones and high-speed Internet, and technological literacy were noted as challenges facing Asian Pacific children and youth [73]. Significant subgroups of American youth (particularly those who live in low-income and rural areas) are also experiencing marginalization because of inadequate access to the Internet, resulting in a gap during COVID-19 which is widening pediatric mental health differences [76]. Stigmatizing attitudes, accessibility, and affordability issues are experienced by Australian youth in non-urban areas, resulting in higher self-harm, suicidal ideation, and suicide attempt rates [75]. The German study found an accumulation of negative issues (i.e., preexisting stress, anxiety, depression, overexertion, and burnout) and suggested identifying those at risk to promote mental health in significant subgroups [74].
Research on digital solutions in clinical settings proposed young people as a transformative population for mental health treatment [5]. A survey of clinicians and youth mental health service users (aged 12–25) with regards to the rapid implementation of telehealth during COVID-19 found young people were the most positively satisfied and open to its continued use [77]. The digital solutions evidence base is limited to reviews, workshops, position papers, pilot studies, trials and protocols. A scoping review of online preventive interventions for youth with emerging mental health issues noted the high incidence of common evidence-based therapies and medium incidence of a blended approach (supported by a human) [78]. The review mentioned the most common psychological symptoms and disorders in youth are heightened stress, depression, anxiety, and psychosis. The most common intervention is CBT. There were a wide range of adherence rates to digital interventions (between 27.9 and 98%). The results indicated general effectiveness, usability, and acceptability of online indicated preventive interventions for a wide range of mental health complaints, and positive mental health promotion (e.g., well-being and resilience). Future research was recommended for co-design of clinical trials based on the clinical staging model with a focus on transdiagnostic mechanisms, instruments for emerging or subclinical mental health symptoms as well as a government-backed structure for financial compensation of innovation and development.
A systematic overview of meta-analyses and systematic reviews found digital mental health interventions for young people have reasonably positive effects [79]. The evidence of effectiveness was mostly found on anxiety and depression, and to a lesser extent on stress—the main concerns are evidence-based treatment content or in-person elements that may improve engagement [79]. Only a small proportion of digital platforms are evidence-based—more needs to be known about the (cost-)effectiveness of the type of service provided, target subpopulation, and the current standard of care [79]. A systematic review also concluded there needs to be higher understanding of the (cost-)effectiveness of digital psychological interventions [80]. A randomized controlled trial is currently partly evaluating the (cost-)effectiveness of a digital alcohol moderation intervention (web app based on motivational interviewing and CBT) which was added to an existing depression treatment for young adults [81].
Innovative technologies are increasingly being used in studies on the mental health of young people. A case report on young adults with a psychotic illness found digital phenotyping via tracking on a smartphone app is a feasible way to monitor and detect patient status [82]. A proof-of-concept study with university students found early evidence that there is benefit in deploying a digital healthy-coping intervention via a chatbot for their higher levels of psychological distress [83]. There was preliminary evidence of efficacy for digital psychological interventions via games and virtual reality (VR) in children and young people [84]. A longitudinal approach to development and design as well as greater heterogeneity are required for studies evaluating digital psychological interventions [85]. A systematic review of the use of commercial off-the-shelf video games found there is efficacy for reducing stress and anxiety [86]. Video game genres included exergames, casual video games, action games, action-adventure games, and augmented reality games used on various gaming platforms, including consoles, PCs, smartphones, mobile consoles, and virtual reality systems [86]. An editorial on child and adolescent learnings of the current pandemic recommended future research designs to consider the strategic use of technology and remote learning in new educational approaches for diverse populations as well as to explain the factors that predict and improve resilience during adversity [87].
The scientific framework, methodology, and digital mental health implementation strategies for young people are marked by significant challenges including engagement, retention, fidelity, lack of personalization, and cognitive load [88]. A protocol for an evaluation study on the effectiveness of education and training of youth mental health care clinicians established that the adoption and optimization of technical solutions are integral for use in standard clinical practice [89]. The feasibility, acceptability, and initial safety profile of an online mental health service for improving help-seeking and mental health symptoms among students found: administrative barriers to uptake; time constraints for school staff to help; high drop-out rates in a series of modules; and uncertainty about improvements in help-seeking behavior and symptoms [90]. A systematic review of ethical concerns for digital mental health for young people found there is a need for better online security and data privacy as well as improved guidelines and legislation [20].

3. Conclusions and Prospects

Digital mental health is in its adolescence but there is efficacy for digital interventions at the population level. The novelty of the genre is unravelling amid COVID-19. It provides advantages for some populations: increased accessibility, acceptability, affordability, and availability of care, equity, autonomy and serviceability as well as an improved understanding of mental health. However, it is important to have in mind the disadvantages: concerns with efficacy, insufficient validation of technology, user engagement and retention issues, data security and privacy, marginalization (especially of the underserved and the unserved), and a lack of organizational readiness as well as over reliance on technology and clinical support. More needs to be known about the psychological symptoms and disorders for which it is effective. So far, the evidence of effectiveness is on common disorders (i.e., mild to moderate anxiety and depression) as well as stress. It is not yet established if some mental disorders can present more difficulties than others. Digital interventions for those with serious mental ill-health (on the psychotic spectrum and bipolar disorder) and chronic mental health conditions demonstrated significant promise despite being less established than for common disorders. Video conferences, social networks, telephone calls, and emails are common digital tools used amid COVID-19; audio conferences, smartphone/tablet apps, online intervention platforms and chats were used to a lesser extent. Clinical practitioners may use digital mental health guides; furthermore, trials are underway with TECC to help achieve faster and better quality care. Young people are a discerning population for research because of their increased use of online clinical support services. Despite the challenges of providing ethical, effective, accessible, and equitable care, digital mental health is delivering innovative ways of serving those who are isolated, lonely, and at-risk of stress, anxiety, and depression. Further research is required for reliable, valid, and replicable models of care above and beyond what is established for telehealth, digital platforms, and apps. AI technologies (especially machine learning and predictive analytics), smartphone, and wearable technologies as well as immersive solutions (VR and video games) are noteworthy prospects.

Author Contributions

Conceptualization, L.B.; investigation, L.B., writing—original draft preparation, L.B.; writing—review and editing, L.B. and D.D.L.; supervision, D.D.L.; project administration, L.B. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Conflicts of Interest

The authors declare no conflict of interest.

Entry Link on the Encyclopedia Platform

https://encyclopedia.pub/16293.

References

  1. Pirkis, J.; John, A.; Shin, S.; DelPozo-Banos, M.; Arya, V.; Analuisa-Aguilar, P.; Appleby, L.; Arensman, E.; Bantjes, J.; Baran, A.; et al. Suicide trends in the early months of the COVID-19 pandemic: An interrupted time-series analysis of preliminary data from 21 countries. Lancet Psychiatry 2021, 8, 579–588. [Google Scholar] [CrossRef]
  2. Rettie, H.; Daniels, J. Coping and tolerance of uncertainty: Predictors and mediators of mental health during the COVID-19 pandemic. Am. Psychol. 2021, 76, 427–437. [Google Scholar] [CrossRef]
  3. Torous, J.; Keshavan, M. COVID-19, mobile health and serious mental illness. Schizophr. Res. 2020, 218, 36–37. [Google Scholar] [CrossRef]
  4. Balcombe, L.; De Leo, D. An Integrated Blueprint for Digital Mental Health Services Amidst COVID-19. JMIR Ment. Health 2020, 7, e21718. [Google Scholar] [CrossRef] [PubMed]
  5. Gleeson, J.F.M.; Riper, H.; Alvarez-Jimenez, M. Editorial: Transforming Youth Mental Health Treatment Through Digital Technology. Front. Psychiatry 2020, 11, 606433. [Google Scholar] [CrossRef] [PubMed]
  6. Saxena, S.; Thornicroft, G.; Knapp, M.; Whiteford, H. Resources for mental health: Scarcity, inequity, and inefficiency. Lancet 2007, 370, 878–889. [Google Scholar] [CrossRef]
  7. Whittle, E.L.; Fisher, K.R.; Reppermund, S.; Lenroot, R.; Trollor, J. Barriers and Enablers to Accessing Mental Health Services for People with Intellectual Disability: A Scoping Review. J. Ment. Health Res. Intellect. Disabil. 2018, 11, 69–102. [Google Scholar] [CrossRef]
  8. Rudd, B.N.; Beidas, R.S. Digital Mental Health: The Answer to the Global Mental Health Crisis? JMIR Ment. Health 2020, 7, e18472. [Google Scholar] [CrossRef] [PubMed]
  9. Torous, J.; Myrick, K.J.; Rauseo-Ricupero, N.; Firth, J. Digital Mental Health and COVID-19: Using Technology Today to Accelerate the Curve on Access and Quality Tomorrow. JMIR Ment. Health 2020, 7, e18848. [Google Scholar] [CrossRef] [PubMed]
  10. Guinart, D.; Marcy, P.; Hauser, M.; Dwyer, M.; Kane, J.M. Patient Attitudes Toward Telepsychiatry During the COVID-19 Pandemic: A Nationwide, Multisite Survey. JMIR Ment. Health 2020, 7, e24761. [Google Scholar] [CrossRef] [PubMed]
  11. Guinart, D.; Marcy, P.; Hauser, M.; Dwyer, M.; Kane, J.M. Mental Health Care Providers’ Attitudes Toward Telepsychiatry: A Systemwide, Multisite Survey During the COVID-19 Pandemic. Psychiatr. Serv. 2021, 72, 704–707. [Google Scholar] [CrossRef]
  12. The Lancet Digital Health Digital tools for mental health in a crisis. Lancet Digit. Health 2021, 3, e204. [CrossRef]
  13. Barnett, P.; Goulding, L.; Casetta, C.; Jordan, H.; Sheridan-Rains, L.; Steare, T.; Williams, J.; Wood, L.; Gaughran, F.; Johnson, S. Implementation of Telemental Health Services Before COVID-19: Rapid Umbrella Review of Systematic Reviews. J. Med Internet Res. 2021, 23, e26492. [Google Scholar] [CrossRef] [PubMed]
  14. Whelan, P.; Stockton-Powdrell, C.; Jardine, J.; Sainsbury, J. Comment on “Digital Mental Health and COVID-19: Using Technology Today to Accelerate the Curve on Access and Quality Tomorrow”: A UK Perspective. JMIR Ment. Health 2020, 7, e19547. [Google Scholar] [CrossRef] [PubMed]
  15. Wind, T.R.; Rijkeboer, M.; Andersson, G.; Riper, H. The COVID-19 pandemic: The ‘black swan’ for mental health care and a turning point for e-health. Internet Interv. 2020, 20, 100317. [Google Scholar] [CrossRef] [PubMed]
  16. Sorkin, D.H.; Janio, E.A.; Eikey, E.V.; Schneider, M.; Davis, K.; Schueller, S.M.; Stadnick, N.A.; Zheng, K.; Neary, M.; Safani, D.; et al. Rise in Use of Digital Mental Health Tools and Technologies in the United States During the COVID-19 Pandemic: Survey Study. J. Med. Internet Res. 2021, 23, e26994. [Google Scholar] [CrossRef]
  17. Rauschenberg, C.; Schick, A.; Hirjak, D.; Seidler, A.; Pätzold, I.; Apfelbacher, C.; Riedel-Heller, S.G.; Reininghaus, U. Digital interventions to mitigate the negative impact of the COVID-19 pandemic on public mental health: A rapid meta-review. PsyArXiv 2020. [Google Scholar] [CrossRef]
  18. Balcombe, L.; De Leo, D. Psychological Screening and Tracking of Athletes and Digital Mental Health Solutions in a Hybrid Model of Care: Mini Review. JMIR Form. Res. 2020, 4, e22755. [Google Scholar] [CrossRef]
  19. Ganapathy, A.; Clough, B.A.; Casey, L.M. Organizational and Policy Barriers to the Use of Digital Mental Health by Mental Health Professionals. Telemed. e-Health 2021. [Google Scholar] [CrossRef]
  20. Wies, B.; Landers, C.; Ienca, M. Digital Mental Health for Young People: A Scoping Review of Ethical Promises and Challenges. Front. Digit. Health 2021, 3, 697072. [Google Scholar] [CrossRef]
  21. Fu, Z.; Burger, H.; Arjadi, R.; Bockting, C.L.H. Effectiveness of digital psychological interventions for mental health problems in low-income and middle-income countries: A systematic review and meta-analysis. Lancet Psychiatry 2020, 7, 851–864. [Google Scholar] [CrossRef]
  22. Singla, D.R.; Lawson, A.; Kohrt, B.A.; Jung, J.W.; Meng, Z.; Ratjen, C.; Zahedi, N.; Dennis, C.-L.; Patel, V. Implementation and Effectiveness of Nonspecialist-Delivered Interventions for Perinatal Mental Health in High-Income Countries. JAMA Psychiatry 2021, 78, 498. [Google Scholar] [CrossRef] [PubMed]
  23. Kozelka, E.E.; Jenkins, J.H.; Carpenter-Song, E. Advancing Health Equity in Digital Mental Health: Lessons From Medical Anthropology for Global Mental Health. JMIR Ment. Health 2021, 8, e28555. [Google Scholar] [CrossRef] [PubMed]
  24. Mohr, D.C.; Lyon, A.R.; Lattie, E.G.; Reddy, M.; Schueller, S.M. Accelerating Digital Mental Health Research From Early Design and Creation to Successful Implementation and Sustainment. J. Med. Internet Res. 2017, 19, e153. [Google Scholar] [CrossRef] [PubMed]
  25. Balcombe, L.; De Leo, D. Digital Mental Health Challenges and the Horizon Ahead for Solutions. JMIR Ment. Health 2021, 8, e26811. [Google Scholar] [CrossRef]
  26. Schueller, S.M. Grand Challenges in Human Factors and Digital Health. Front. Digit. Health 2021, 3. [Google Scholar] [CrossRef]
  27. Jacobi, C. Special issue internet interventions: Editorial “integrating technology into mental health care delivery in Europe (ICare)”. Internet Interv. 2019, 16, 1–4. [Google Scholar] [CrossRef]
  28. Bucci, S.; Berry, N.; Morris, R.; Berry, K.; Haddock, G.; Lewis, S.; Edge, D. “They Are Not Hard-to-Reach Clients. We Have Just Got Hard-to-Reach Services.” Staff Views of Digital Health Tools in Specialist Mental Health Services. Front. Psychiatry 2019, 10, 344. [Google Scholar] [CrossRef]
  29. Walker, R.; Usher, K.; Jackson, D.; Reid, C.; Hopkins, K.; Shepherd, C.; Smallwood, R.; Marriott, R. Connection to. Addressing Digital Inequities in Supporting the Well-Being of Young Indigenous Australians in the Wake of COVID-19. Int. J. Environ. Res. Public Health 2021, 18, 2141. [Google Scholar] [CrossRef]
  30. Graham, A.K.; Weissman, R.S.; Mohr, D.C. Resolving Key Barriers to Advancing Mental Health Equity in Rural Communities Using Digital Mental Health Interventions. JAMA Health Forum 2021, 2, e211149. [Google Scholar] [CrossRef]
  31. Lal, S.; Gleeson, J.; Rivard, L.; D’Alfonso, S.; Joober, R.; Malla, A.; Alvarez-Jimenez, M. Adaptation of a Digital Health Innovation to Prevent Relapse and Support Recovery in Youth Receiving Services for First-Episode Psychosis: Results From the Horyzons-Canada Phase 1 Study. JMIR Form. Res. 2020, 4, e19887. [Google Scholar] [CrossRef] [PubMed]
  32. Borghouts, J.; Eikey, E.; Mark, G.; De Leon, C.; Schueller, S.M.; Schneider, M.; Stadnick, N.; Zheng, K.; Mukamel, D.; Sorkin, D.H. Barriers to and Facilitators of User Engagement with Digital Mental Health Interventions: Systematic Review. J. Med. Internet Res. 2021, 23, e24387. [Google Scholar] [CrossRef]
  33. Morriss, R.; Kaylor-Hughes, C.; Rawsthorne, M.; Coulson, N.; Simpson, S.; Guo, B.; James, M.; Lathe, J.; Moran, P.; Tata, L.; et al. A direct to public peer support programme (Big White Wall) versus web-based information to aid self-management of depression and anxiety (The REBOOT study): Results and challenges of an automated randomised controlled trial. (Preprint). J. Med. Internet Res. 2020, 23, e23487. [Google Scholar] [CrossRef] [PubMed]
  34. Shi, J.; Lo, B.; Wong, H.W.; Hollenberg, E.; Sanches, M.; Abi-Jaoudé, A.; Chaim, G.; Cleverley, K.; Henderson, J.; Johnson, A.; et al. Assessing the usability and user engagement of Thought Spot—A digital mental health help-seeking solution for transition-aged youth. Internet Interv. 2021, 24, 100386. [Google Scholar] [CrossRef] [PubMed]
  35. Venning, A.; Herd, M.C.; Oswald, T.K.; Razmi, S.; Glover, F.; Hawke, T.; Quartermain, V.; Redpath, P. Exploring the acceptability of a digital mental health platform incorporating a virtual coach: The good, the bad, and the opportunities. Health Inform. J. 2021, 27, 146045822199487. [Google Scholar] [CrossRef] [PubMed]
  36. Allen, N.B.; Nelson, B.W.; Brent, D.; Auerbach, R.P. Short-term prediction of suicidal thoughts and behaviors in adolescents: Can recent developments in technology and computational science provide a breakthrough? J. Affect. Disord. 2019, 250, 163–169. [Google Scholar] [CrossRef]
  37. Doraiswamy, P.M.; London, E.; Varnum, P.; Harvey, B.; Saxena, S.; Tottman, S.; Campbell, S.P.; Ibanez, A.F.; Manji, H.; Al Olama, M.A.A.S.; et al. Empowering 8 Billion Minds: Enabling Better Mental Health for All via the Ethical Adoption of Technologies. NAM Perspect. 2019. [Google Scholar] [CrossRef]
  38. Heinsch, M.; Geddes, J.; Sampson, D.; Brosnan, C.; Hunt, S.; Wells, H.; Kay-Lambkin, F. Disclosure of suicidal thoughts during an e-mental health intervention: Relational ethics meets actor-network theory. Ethic Behav. 2021, 31, 151–170. [Google Scholar] [CrossRef]
  39. Powell, A.C.; Bowman, M.B.; Harbin, H.T. Reimbursement of Apps for Mental Health: Findings from Interviews. JMIR Ment. Health 2019, 6, e14724. [Google Scholar] [CrossRef]
  40. Powell, A.; Torous, J. A Patient-Centered Framework for Measuring the Economic Value of the Clinical Benefits of Digital Health Apps: Theoretical Modeling. JMIR Ment. Health 2020, 7, e18812. [Google Scholar] [CrossRef]
  41. Rosenberg, B.M.; Kodish, T.; Cohen, Z.D.; Gong-Guy, E.; Craske, M.G. Design and Implementation of a Novel Peer-to-Peer Coaching Program to Support Digital Mental Health. JMIR Ment. Health 2021. preprint. [Google Scholar] [CrossRef]
  42. Rice, S.; Robinson, J.; Bendall, S.; Hetrick, S.; Cox, G.; Bailey, E.; Gleeson, J.F.; Alvarez-Jimenez, M. Online and Social Media Suicide Prevention Interventions for Young People: A Focus on Implementation and Moderation. J. Can. Acad. Child Adolesc. Psychiatry = J. l’Acad. Can. Psychiatr. l’enfant l’adolesc. 2016, 25, 80–86. [Google Scholar]
  43. D’Alfonso, S.; Phillips, J.; Valentine, L.; Gleeson, J.; Alvarez-Jimenez, M. Moderated Online Social Therapy: Viewpoint on the Ethics and Design Principles of a Web-Based Therapy System. JMIR Ment. Health 2019, 6, e14866. [Google Scholar] [CrossRef] [PubMed]
  44. Iorfino, F.; Cross, S.P.; Davenport, T.; Carpenter, J.S.; Scott, E.; Shiran, S.; Hickie, I.B. A Digital Platform Designed for Youth Mental Health Services to Deliver Personalized and Measurement-Based Care. Front. Psychiatry 2019, 10, 595. [Google Scholar] [CrossRef] [PubMed]
  45. van Agteren, J.; Bartholomaeus, J.; Fassnacht, D.B.; Iasiello, M.; Ali, K.; Lo, L.; Kyrios, M. Using Internet-Based Psychological Measurement to Capture the Deteriorating Community Mental Health Profile During COVID-19: Observational Study. JMIR Ment. Health 2020, 7, e20696. [Google Scholar] [CrossRef] [PubMed]
  46. Hull, T.D.; Levine, J.; Bantilan, N.; Desai, A.N.; Majumder, M.S. Analyzing Digital Evidence from a Telemental Health Platform to Assess Complex Psychological Responses to the COVID-19 Pandemic: Content Analysis of Text Messages. JMIR Form. Res. 2021, 5, e26190. [Google Scholar] [CrossRef]
  47. Venville, A.; O’Connor, S.; Roeschlein, H.; Ennals, P.; McLoughlan, G.; Thomas, N. Mental health service user and worker experience of psychosocial support via telehealth through the COVID-19 pandemic: A qualitative study (Preprint). JMIR Ment. Health 2021, 8, 29671. [Google Scholar] [CrossRef]
  48. Strudwick, G.; McLay, D.; Lo, B.; Shin, H.D.; Currie, L.; Thomson, N.; Maillet, É.; Strong, V.; Miller, A.; Shen, N.; et al. Development of a Resource Guide to Support the Engagement of Mental Health Providers and Patients with Digital Health Tools: Multimethod Study. J. Med. Internet Res. 2021, 23, e25773. [Google Scholar] [CrossRef]
  49. Mehta, A.; Niles, A.N.; Vargas, J.H.; Marafon, T.; Couto, D.D.; Gross, J.J. Acceptability and Effectiveness of Artificial Intelligence Therapy for Anxiety and Depression (Youper): Longitudinal Observational Study. J. Med. Internet Res. 2021, 23, e26771. [Google Scholar] [CrossRef]
  50. Köhnen, M.; Dreier, M.; Seeralan, T.; Kriston, L.; Härter, M.; Baumeister, H.; Liebherz, S. Evidence on Technology-Based Psychological Interventions in Diagnosed Depression: Systematic Review. JMIR Ment. Health 2021, 8, e21700. [Google Scholar] [CrossRef]
  51. Baumeister, H.; Bauereiss, N.; Zarski, A.-C.; Braun, L.; Buntrock, C.; Hoherz, C.; Idrees, A.R.; Kraft, R.; Meyer, P.; Nguyen, T.B.D.; et al. Clinical and Cost-Effectiveness of PSYCHOnlineTHERAPY: Study Protocol of a Multicenter Blended Outpatient Psychotherapy Cluster Randomized Controlled Trial for Patients with Depressive and Anxiety Disorders. Front. Psychiatry 2021, 12, 660534. [Google Scholar] [CrossRef]
  52. Rauseo-Ricupero, N.; Torous, J. Technology Enabled Clinical Care (TECC): Protocol for a Prospective Longitudinal Cohort Study of Smartphone-Augmented Mental Health Treatment. JMIR Res. Protoc. 2021, 10, e23771. [Google Scholar] [CrossRef]
  53. Iorfino, F.; Occhipinti, J.-A.; Skinner, A.; Davenport, T.; Rowe, S.; Prodan, A.; Sturgess, J.; Hickie, I.B. The Impact of Technology-Enabled Care Coordination in a Complex Mental Health System: A Local System Dynamics Model. J. Med. Internet Res. 2021, 23, e25331. [Google Scholar] [CrossRef]
  54. Blitz, R.; Storck, M.; Baune, B.T.; Dugas, M.; Opel, N. Design and Implementation of an Informatics Infrastructure for Standardized Data Acquisition, Transfer, Storage, and Export in Psychiatric Clinical Routine: Feasibility Study. JMIR Ment. Health 2021, 8, e26681. [Google Scholar] [CrossRef] [PubMed]
  55. de Redon, E.; Centi, A. Realities of conducting digital health research: Challenges to consider. Digit. Health 2019, 5, 205520761986946. [Google Scholar] [CrossRef]
  56. Martinez-Martin, N.; Dasgupta, I.; Carter, A.; Chandler, J.A.; Kellmeyer, P.; Kreitmair, K.; Weiss, A.; Cabrera, L.Y. Ethics of Digital Mental Health During COVID-19: Crisis and Opportunities. JMIR Ment. Health 2020, 7, e23776. [Google Scholar] [CrossRef]
  57. Guo, C.; Ashrafian, H.; Ghafur, S.; Fontana, G.; Gardner, C.; Prime, M. Challenges for the evaluation of digital health solutions—A call for innovative evidence generation approaches. NPJ Digit. Med. 2020, 3, 1–14. [Google Scholar] [CrossRef] [PubMed]
  58. Arrieta, A.B.; Díaz-Rodríguez, N.; Del Ser, J.; Bennetot, A.; Tabik, S.; Barbado, A.; Garcia, S.; Gil-Lopez, S.; Molina, D.; Benjamins, R.; et al. Explainable Artificial Intelligence (XAI): Concepts, taxonomies, opportunities and challenges toward responsible AI. Inf. Fusion 2020, 58, 82–115. [Google Scholar] [CrossRef]
  59. Tremain, H.; McEnery, C.; Fletcher, K.; Murray, G. The Therapeutic Alliance in Digital Mental Health Interventions for Serious Mental Illnesses: Narrative Review. JMIR Ment. Health 2020, 7, e17204. [Google Scholar] [CrossRef]
  60. Chekroud, A.M.; Bondar, J.; Delgadillo, J.; Doherty, G.; Wasil, A.; Fokkema, M.; Cohen, Z.; Belgrave, D.; DeRubeis, R.; Iniesta, R.; et al. The promise of machine learning in predicting treatment outcomes in psychiatry. World Psychiatry 2021, 20, 154–170. [Google Scholar] [CrossRef]
  61. Mulder, R.; Newton-Howes, G.; Coid, J.W. The futility of risk prediction in psychiatry. Br. J. Psychiatry 2016, 209, 271–272. [Google Scholar] [CrossRef] [PubMed]
  62. Chan, M.K.Y.; Bhatti, H.; Meader, N.; Stockton, S.; Evans, J.; O’Connor, R.C.; Kapur, N.; Kendall, T. Predicting suicide following self-harm: Systematic review of risk factors and risk scales. Br. J. Psychiatry 2016, 209, 277–283. [Google Scholar] [CrossRef] [PubMed]
  63. Shatte, A.B.R.; Hutchinson, D.M.; Teague, S.J. Machine learning in mental health: A scoping review of methods and applications. Psychol. Med. 2019, 49, 1426–1448. [Google Scholar] [CrossRef] [PubMed]
  64. Moon, S.J.; Hwang, J.; Kana, R.; Torous, J.; Kim, J.W. Accuracy of Machine Learning Algorithms for the Diagnosis of Autism Spectrum Disorder: Systematic Review and Meta-Analysis of Brain Magnetic Resonance Imaging Studies. JMIR Ment. Health 2019, 6, e14108. [Google Scholar] [CrossRef]
  65. Graham, S.; Depp, C.; Lee, E.E.; Nebeker, C.; Tu, X.; Kim, H.-C.; Jeste, D.V. Artificial Intelligence for Mental Health and Mental Illnesses: An Overview. Curr. Psychiatry Rep. 2019, 21, 116. [Google Scholar] [CrossRef]
  66. Drissi, N.; Ouhbi, S.; Marques, G.; Díez, I.D.L.T.; Ghogho, M.; Idrissi, M.A.J. A Systematic Literature Review on e-Mental Health Solutions to Assist Health Care Workers during COVID-19. Telemed. e-Health 2021, 27, 594–602. [Google Scholar] [CrossRef]
  67. Weightman, M. Digital psychotherapy as an effective and timely treatment option for depression and anxiety disorders: Implications for rural and remote practice. J. Int. Med. Res. 2020, 48, 030006052092868. [Google Scholar] [CrossRef]
  68. Dores, A.R.; Geraldo, A.; Carvalho, I.P.; Barbosa, F. The Use of New Digital Information and Communication Technologies in Psychological Counseling during the COVID-19 Pandemic. Int. J. Environ. Res. Public Health 2020, 17, 7663. [Google Scholar] [CrossRef]
  69. Machado, D.D.B.; Laskoski, P.B.; Severo, C.T.; Bassols, A.M.; Sfoggia, A.; Kowacs, C.; Krieger, D.V.; Torres, M.B.; Gastaud, M.B.; Wellausen, R.S.; et al. A Psychodynamic Perspective on a Systematic Review of Online Psychotherapy for Adults. Br. J. Psychother. 2016, 32, 79–108. [Google Scholar] [CrossRef]
  70. Dores, A.R.; Silva, R.A.; Crepulja, M.L.; Franciskovic, T.; Stevanovic, A. Ethical Aspects of the E-Tools / E-consulting with Focus on Differences from Classic Settings. In Therapy 2.0, Guidelines for Advisors, Counsellors and Therapists on the Utilization of Online Interventions. Available online: https://www.ecounselling4youth.eu/online-material/courses/files/guidelines_en.pdf (accessed on 1 October 2021).
  71. Sasseville, M.; LeBlanc, A.; Boucher, M.; Dugas, M.; Mbemba, G.; Tchuente, J.; Chouinard, M.-C.; Beaulieu, M.; Beaudet, N.; Skidmore, B.; et al. Digital health interventions for the management of mental health in people with chronic diseases: A rapid review. BMJ Open 2021, 11, e044437. [Google Scholar] [CrossRef] [PubMed]
  72. Cotter, J.; Bucci, S. E-mental health for young people. Youth Mental Health 2020, 125–138. [Google Scholar] [CrossRef]
  73. Murphy, J.K.; Khan, A.; Sun, Q.; Minas, H.; Hatcher, S.; Ng, C.H.; Withers, M.; Greenshaw, A.; Michalak, E.E.; Chakraborty, P.A.; et al. Needs, gaps and opportunities for standard and e-mental health care among at-risk populations in the Asia Pacific in the context of COVID-19: A rapid scoping review. Int. J. Equity Health 2021, 20, 1–22. [Google Scholar] [CrossRef] [PubMed]
  74. Voltmer, E.; Köslich-Strumann, S.; Walther, A.; Kasem, M.; Obst, K.; Kötter, T. The impact of the COVID-19 pandemic on stress, mental health and coping behavior in German University students—A longitudinal study before and after the onset of the pandemic. BMC Public Health 2021, 21, 1–15. [Google Scholar] [CrossRef] [PubMed]
  75. Piper, S.; Davenport, T.A.; LaMonica, H.; Ottavio, A.; Iorfino, F.; Cheng, V.W.S.; Cross, S.; Lee, G.Y.; Scott, E.; Hickie, I.B. Implementing a digital health model of care in Australian youth mental health services: Protocol for impact evaluation. BMC Health Serv. Res. 2021, 21, 1–9. [Google Scholar] [CrossRef] [PubMed]
  76. Smith-East, M.; Starks, S. COVID-19 and Mental Health Care Delivery: A Digital Divide Exists for Youth With Inadequate Access to the Internet. J. Am. Acad. Child Adolesc. Psychiatry 2021, 60, 798–800. [Google Scholar] [CrossRef] [PubMed]
  77. Nicholas, J.; Bell, I.H.; Thompson, A.; Valentine, L.; Simsir, P.; Sheppard, H.; Adams, S. Implementation lessons from the transition to telehealth during COVID-19: A survey of clinicians and young people from youth mental health services. Psychiatry Res. 2021, 299, 113848. [Google Scholar] [CrossRef]
  78. van Doorn, M.; Nijhuis, L.A.; Egeler, M.D.; Daams, J.G.; Popma, A.; van Amelsvoort, T.; McEnery, C.; Gleeson, J.F.; Öry, F.G.; Avis, K.A.; et al. Online Indicated Preventive Mental Health Interventions for Youth: A Scoping Review. Front. Psychiatry 2021, 12, 580843. [Google Scholar] [CrossRef]
  79. Lehtimaki, S.; Martic, J.; Wahl, B.; Foster, K.T.; Schwalbe, N. Evidence on Digital Mental Health Interventions for Adolescents and Young People: Systematic Overview. JMIR Ment. Health 2021, 8, e25847. [Google Scholar] [CrossRef]
  80. Bertuzzi, V.; Semonella, M.; Bruno, D.; Manna, C.; Edbrook-Childs, J.; Giusti, E.; Castelnuovo, G.; Pietrabissa, G. Psychological Support Interventions for Healthcare Providers and Informal Caregivers during the COVID-19 Pandemic: A Systematic Review of the Literature. Int. J. Environ. Res. Public Health 2021, 18, 6939. [Google Scholar] [CrossRef]
  81. Schouten, M.J.E.; Dekker, J.J.M.; de Bruijn, T.Q.; Ebert, D.D.; Koomen, L.M.; Kosterman, S.L.A.; Riper, H.; Schaub, M.P.; Goudriaan, A.E.; Blankers, M. Effectiveness of a digital alcohol moderation intervention as an add-on to depression treatment for young adults: Study protocol of a multicentre pragmatic randomized controlled trial. BMC Psychiatry 2021, 21, 1–16. [Google Scholar] [CrossRef] [PubMed]
  82. Wisniewski, H.; Henson, P.; Torous, J. Using a Smartphone App to Identify Clinically Relevant Behavior Trends via Symptom Report, Cognition Scores, and Exercise Levels: A Case Series. Front. Psychiatry 2019, 10, 652. [Google Scholar] [CrossRef] [PubMed]
  83. Gabrielli, S.; Rizzi, S.; Bassi, G.; Carbone, S.; Maimone, R.; Marchesoni, M.; Forti, S. Engagement and Effectiveness of a Healthy Coping Intervention via Chatbot for university students: Proof-of-concept study during the COVID-19 pandemic (Preprint). JMIR mHealth uHealth 2021, 9, e27965. [Google Scholar] [CrossRef]
  84. Halldorsson, B.; Hill, C.; Waite, P.; Partridge, K.; Freeman, D.; Creswell, C. Annual Research Review: Immersive virtual reality and digital applied gaming interventions for the treatment of mental health problems in children and young people: The need for rigorous treatment development and clinical evaluation. J. Child Psychol. Psychiatry 2021, 62, 584–605. [Google Scholar] [CrossRef] [PubMed]
  85. Davies, E.B.; Bergin, A.D. Commentary: Let’s get digital: A commentary on Halldorsson et al.’s call for more rigorous development and evaluation of immersive digital interventions for children and young people’s mental health. J. Child Psychol. Psychiatry 2021, 62, 606–609. [Google Scholar] [CrossRef] [PubMed]
  86. Pallavicini, F.; Pepe, A.; Mantovani, F. Commercial Off-The-Shelves Video Games for Reducing Stress and Anxiety: A PRISMA Systematic Review (Preprint). JMIR Ment. Health 2021, 8, 28150. [Google Scholar] [CrossRef] [PubMed]
  87. Biel, M.G.; Hamrah, O. Editorial: Learning from the Pandemic: “Building Back Better” Through Research on Risk and Resilience with Diverse Populations. J. Am. Acad. Child Adolesc. Psychiatry 2021, 60, 445–447. [Google Scholar] [CrossRef] [PubMed]
  88. Scholten, H.; Granic, I. Use of the Principles of Design Thinking to Address Limitations of Digital Mental Health Interventions for Youth: Viewpoint. J. Med. Internet Res. 2019, 21, e11528. [Google Scholar] [CrossRef]
  89. Dohnt, H.C.; Dowling, M.J.; Davenport, T.A.; Lee, G.; Cross, S.P.; Scott, E.M.; Song, Y.J.C.; Hamilton, B.; Hockey, S.J.; Rohleder, C.; et al. Supporting Clinicians to Use Technology to Deliver Highly Personalized and Measurement-Based Mental Health Care to Young People: Protocol for an Evaluation Study. JMIR Res. Protoc. 2021, 10, e24697. [Google Scholar] [CrossRef]
  90. O’Dea, B.; King, C.; Subotic-Kerry, M.; Achilles, M.R.; Cockayne, N.; Christensen, H. Smooth Sailing: A Pilot Study of an Online, School-Based, Mental Health Service for Depression and Anxiety. Front. Psychiatry 2019, 10, 574. [Google Scholar] [CrossRef]
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Balcombe, L.; De Leo, D. Digital Mental Health Amid COVID-19. Encyclopedia 2021, 1, 1047-1057. https://doi.org/10.3390/encyclopedia1040080

AMA Style

Balcombe L, De Leo D. Digital Mental Health Amid COVID-19. Encyclopedia. 2021; 1(4):1047-1057. https://doi.org/10.3390/encyclopedia1040080

Chicago/Turabian Style

Balcombe, Luke, and Diego De Leo. 2021. "Digital Mental Health Amid COVID-19" Encyclopedia 1, no. 4: 1047-1057. https://doi.org/10.3390/encyclopedia1040080

APA Style

Balcombe, L., & De Leo, D. (2021). Digital Mental Health Amid COVID-19. Encyclopedia, 1(4), 1047-1057. https://doi.org/10.3390/encyclopedia1040080

Article Metrics

Back to TopTop