Next Article in Journal
The Removal of Tetracycline from Aqueous Solutions Using Peanut Shell Biochars Prepared at Different Pyrolysis Temperatures
Previous Article in Journal
Entrepreneurial Potential and Agribusiness Desirability among Youths in South Kivu, Democratic Republic of the Congo
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Determinants of Intentions to Use Digital Mental Healthcare Content among University Students, Faculty, and Staff: Motivation, Perceived Usefulness, Perceived Ease of Use, and Parasocial Interaction with AI Chatbot

1
HY Digital Healthcare Center, Hanyang University, Seoul 04763, Republic of Korea
2
Department of Cognitive Sciences, School of Intelligence, Hanyang University, Seoul 04763, Republic of Korea
3
Graduate School of Public Policy, Hanyang University, Seoul 04763, Republic of Korea
*
Author to whom correspondence should be addressed.
Sustainability 2023, 15(1), 872; https://doi.org/10.3390/su15010872
Submission received: 18 October 2022 / Revised: 19 December 2022 / Accepted: 31 December 2022 / Published: 3 January 2023
(This article belongs to the Section Health, Well-Being and Sustainability)

Abstract

:
Depression is a worldwide health issue to which various physical, psychological, and social health problems are attributable. To address the issue through the promotion of digital mental healthcare content use, this study examines factors influencing people’s intentions to use the content, guided by the technology acceptance model and uses and gratifications theory. A total of 278 students and faculty/staff members at a Korean university tried using a digital mental healthcare content (e.g., artificial intelligence chatbot content) called MyMentalPocket and completed a survey questionnaire associated with their perceptions of the content. Participants’ depression levels, perceived usefulness, and parasocial interactions emerged as significant and positive factors influencing people’s intentions to use MyMentalPocket. Female gender, younger age, and specific motives for depression-related digital technology use (i.e., communication and emotional support, information- and guidance-seeking, and habitual entertainment-seeking motives) emerged as significant and positive factors influencing parasocial interactions. Parasocial interactions and perceived ease of use emerged as significant and positive factors influencing perceived usefulness. The findings from this study imply the utility of AI chatbots as a way to help people, especially females and younger people with depression and interpersonal difficulties, to utilize and benefit from digital mental healthcare content for depression management.

1. Introduction

Depression is a critical public health issue across the world [1]. Among Organisation for Economic Co-operation and Development countries, the highest prevalence of depression is observed in South Korea. Approximately four out of 10 South Koreans are at risk for negative physical (e.g., sleep disturbance), psychological (e.g., suicidal ideation), and social (e.g., difficulty in interpersonal functioning) consequences of depression [2,3]. Very few of them (less than 5%), however, report using mental healthcare services [4]. Preventable economic loss at the national level is attributable to depression, accounting for healthcare costs of $152 million [5] and $122 billion in gross domestic product [6]. Digital mental healthcare content (e.g., app-based mental health treatment programs) [7] shows promise in addressing the depression crisis in South Korea. The content can be used at a minimal cost, with less stigma associated with mental healthcare, and in timesaving and less space-constrained manners [8,9,10]. In addition, there is evidence that the content helps reduce depressive symptoms [7,11,12,13,14]. Furthermore, people with depression who voluntarily and independently use the content report better progress in depression management than those receiving healthcare provider-supported interventions [7,15]. These reports suggest there is a need to examine factors that motivate people’s use of digital mental healthcare content [16] in order to gain insights into the design of interventions that promote their voluntary and continuous use of the content and increase therapeutic effects. To do so, this study applies the technology acceptance model (TAM) [17,18] and uses and gratifications theory (UGT) [19] to examine factors that may influence people’s adoption and use of digital mental healthcare content.
TAM, focusing on determinants of people’s technology acceptance, is a logical theoretical framework that helps understand people’s acceptance of digital mental healthcare content. TAM describes that people’s technology use is influenced by their intentions to use the technology, and motivational factors influence the intentions [20]. Perceived usefulness—one of the motivational factors—is defined as the extent to which people find a technology to be a facilitator of their work [17], and perceived usefulness positively influences intentions to use mobile health (mHealth) apps [21]. Schuller et al. [22] describe that the acceptance of mHealth apps is not a simple process for people in need of mental healthcare. It involves careful reviews and comparisons of multiple apps, identifying the features they seek, and, in turn, determining whether or not to use a specific app. People might become willing to use digital mental healthcare content when they think its features provide relative advantages that could supplement or substitute their current strategies for depression management [23].
Perceived ease of use—another factor that influences intentions to use a technology—is defined as the extent to which people think a technology is not a struggle to use [17], and perceived ease of use is positively related to intentions to use mHealth apps [24]. People have described that their intentions to use mental health apps depend on perceived ease of use, i.e., feeling at ease navigating and using them as part of their daily lives [25,26]. Depression is represented by cognitive difficulties, such as poor concentration and executive functions [3,27,28], that might hinder people from flexibly using mHealth apps, such as having difficulty in responding to errors or in using features not responsive when touching or scrolling up and down a screen. It suggests that in deciding on the acceptance of digital mental healthcare content, perceived ease of use might be more important to people with depression, when compared to the general population, whose interest in and willingness to use technology would be otherwise discouraged. Existing studies have also indicated that the perceived ease of use positively influences perceived usefulness [29,30,31], suggesting that perceived ease of use might be the first stepping stone for people in learning about the value of integrating digital mental healthcare content into their depression management.
UGT, along with TAM, helps understand people’s acceptance of technologies. UGT focuses on people’s instrumental (more active, purposive, and media content-focused) and ritualized (less active and less focused on the content) needs, i.e., motives for using specific media [32,33,34], such as health-related information (instrumental) or something to pass time (ritualized) that people seek on YouTube [35]. Existing studies have reported barriers to mental healthcare, such as people’s perceived stigma surrounding help-seeking behavior, time constraints, and costs [36,37]. In contrast, in one study conducted in South Korea, mental health literacy (e.g., being able to know how to receive mental healthcare) and social support (e.g., informational, emotional, appraisal, tangible) [38] were found to be facilitators of mental healthcare, helping mitigate the stigma, improving attitudes toward help-seeking behavior, and, thereby, increasing the levels of help-seeking intentions [39]. These reports suggest that understanding people’s motives—such as addressing specific barriers to or seeking facilitators of mental healthcare—could help understand their acceptance levels of digital mental healthcare content. Additionally, people would find the content helping meet their specific needs to be useful, thus motives could also help explain perceived usefulness [40].
In addition to people’s motives for media use, UGT describes people’s affective involvement with media content or parasocial interactions. Parasocial interactions refer to a friendship in which media characters become imaginary friends with or guides to media users [41,42,43], and intimate parasocial interactions positively influence intentions to use electronic health (eHealth) technology as a channel to continue the interactions [44]. Parasocial interactions are an indicator of depressive symptoms for those with relational difficulties [45]. People with depression are willing to take the lead in making decisions on depression management [46], but due to the relational difficulties and stigma associated with mental healthcare, they might feel comfortable working on depression management online [47] and with strangers who do not know them well [48] (those other than family members, friends, and healthcare providers).
An artificial intelligence (AI) chatbot could possibly be a positive stranger or parasocial interactor, for example, with which people can communicate about and receive support for depression management at their convenience without acquaintance and commitment as prerequisites (e.g., setting up and attending appointments for in-person treatment sessions on a regular basis). The sociability of AI chatbots might enhance such potentially positive perceptions, considering previous reports that parasocial interactions with sociable AI chatbots positively influence users’ satisfaction with and active use of the website where the chatbots are present [49]. The sociability of AI chatbots might especially matter to people with depression, sensitive to misleading negative feedback [50], in deciding whether to continue collaboration with the chatbots on symptom management. Taken together, people might become willing to use digital mental healthcare content when they find an AI chatbot there to be friendly and helpful and make them feel listened to and understood in depression management.
Parasocial interactions could also help explain heightened perceived usefulness. One study, for example, suggests that parasocial interactions with a shopping medium lead people to positively evaluate the product the medium recommends [51]. In addition, another study identified a positive relationship between parasocial interactions in online travel communities and community users’ satisfaction with travel [52]. These reports suggest that people who consider an AI chatbot their friend, advocate, or guide in managing depression might find the digital mental healthcare content it provides to be caring, supportive, and persuasive.
In addition, specific motives for media use could help explain why people would engage in parasocial interactions. For instance, in one study on social media, expressive information-seeking and companionship motives were positively related to parasocial interactions—a positive predictor of a sense of community—among Instagram users [53]. On the other hand, for people with information needs, parasocial interactions with TV characters might be a source from which they obtain guidance and advice [54]. In addition, people might engage in parasocial interactions because of interesting and entertaining content provided by media characters such as YouTube unboxers [55] and tourism vloggers [56]. Considering these reports, people might differ in the extent to which they engage in parasocial interactions, for example, with an AI chatbot, depending on whether or not it helps meet their specific needs associated with depression management.

Research Questions and Hypotheses

In understanding factors motivating people’s acceptance of digital mental healthcare content, five hypotheses and three research questions stemmed from the literature review. This study hypothesized that perceived usefulness will be positively related to intentions to use digital mental healthcare content (H1); perceived ease of use will be positively related to intentions to use digital mental healthcare content (H2); perceived ease of use will be positively related to perceived usefulness (H3); parasocial interactions will be positively related to intentions to use MyMentalPocket (H4) and parasocial interactions will be positively related to perceived usefulness (H5).
In addition, this study explored what people’s motives are for depression-related digital technology use (e.g., websites, smartphone apps) (RQ1); what specific motives for depression-related digital technology use are related to perceived usefulness (RQ2) and what specific motives for depression-related digital technology use are related to parasocial interactions (RQ3). Table S1 provides a summary of the literature review.

2. Methods

2.1. Participants and Procedures

This study was conducted at a Korean university after obtaining the university’s institutional review board approval. The study focused on surveying students, faculty, and staff members. The existing report indicated the prevalence of depression within this population, with approximately three out of 10 students, faculty, and staff members reporting severe levels of stress and depression [36]. Undergraduates/graduate students and faculty/staff members aged 18 to 65 years and throughout the university facilities (e.g., library) were introduced to the purpose of the study and asked to complete a survey questionnaire written in Korean. Participants were informed that the survey was voluntary and anonymous. Participants were informed that they could give consent to take part in the study by voluntarily submitting their questionnaire. Participants were informed that they can withdraw their consent anytime and that their survey data would be removed immediately after the withdrawal. Since the survey was anonymous, each participant was provided with their questionnaire number to be used, instead of any identifying information, to contact the researchers and withdraw from the study (i.e., requesting the removal of survey data to which the questionnaire number is linked).
The survey began with measuring participants’ demographic variables and motives for depression-related digital technology use (e.g., websites, and smartphone apps). Next, using a smartphone, a personal computer (PC), or a tablet PC, participants were asked to try using “MyMentalPocket,” digital mental healthcare content that the HY Digital Healthcare Center at Hanyang University, South Korea, is taking the lead in developing as part of the South Korea Ministry of Science and ICT-funded research on digital content for personalized depression management [57,58]. MyMentalPocket provides features such as “Pocky,” an AI chatbot showing empathy for users, guiding them through depression management, and suggesting wellness games designed to help diagnose depression and its indicators including cognitive control and sensitivity to positive/negative social feedback (see Figure 1) [57].
Then the survey measured the perceived usefulness of MyMentalPocket, perceived ease of use, parasocial interactions, and intentions to use MyMentalPocket (see Table S2). The survey took approximately 20 min to complete. A gift card was offered to participants who completed the survey.

2.2. Measurements

The following TAM and UGT variables were measured on a 5-point Likert-type scale (from 1 = strongly disagree to 5 = strongly agree). To create each variable scale for data analysis, each variable item score was summed and averaged. In addition, Cronbach’s alpha, a reliability indicator of each variable scale, was checked.
Motives for depression-related digital technology use. Before trying to use the MyMentalPocket features, the participants’ current/future motives for depression-related digital technology use (e.g., websites, smartphone apps) were measured using items adapted from previous research [35,59,60,61]. Participants reported the extent to which they agree with thirty-six items describing various reasons for (needs associated with) using specific websites or smartphone apps, such as “to get information or advice to manage depression”.
Perceived usefulness. Perceived usefulness was measured using items adapted from Davis’s [17] study. Participants reported the extent to which they agree with eight items such as “I would find MyMentalPocket useful for depression care”. A perceived usefulness scale reflected an acceptable internal consistency (M = 3.54, SD = 0.78, α = 0.91), and higher scale scores indicated higher levels of perceived usefulness.
Perceived ease of use. Perceived ease of use was measured using items adapted from Davis’s [17] study. Participants reported the extent to which they agree with five items such as “I find MyMentalPocket to be easy to use”. A perceived ease of use scale reflected an acceptable internal consistency (M = 4.07, SD = 0.77, α = 0.93), and higher scale scores indicated higher levels of perceived ease of use.
Parasocial interactions. Parasocial interactions with Pocky, the AI chatbot, were measured using items adapted from the Working Alliance Inventory-Short Revised scale [62] and its Korean version [63], and Rubin et al.’s [43] study. Participants reported the extent to which they agree with nine items such as “Pocky makes me feel comfortable, as if I am with friends,” “Pocky and I collaborate on setting goals for depression management,” and “Pocky and I are working toward mutually agreed upon goals for depression management”. A parasocial interaction scale reflected an acceptable internal consistency (M = 3.27, SD = 0.86, α = 0.93), and higher scale scores indicated higher levels of parasocial interactions.
Intentions to use MyMentalPocket. Intentions to use MyMentalPocket were measured using items adapted from previous research [64,65,66]. Participants reported the extent to which they agree with six items such as “I intend to use MyMentalPocket in the future”. An intentions scale reflected an acceptable internal consistency (M = 3.03, SD = 0.96, α = 0.95), and higher scale scores indicated higher levels of intentions.
Control variables. Demographic variables, such as age and gender, have been associated with people’s technology acceptance [67,68,69]. In addition, it was found that people’s depression levels influence people’s depression management, such as their preference for treatment options and help-seeking intentions [47]. This study controlled the possible effects of these variables on the potential determinants of people’s intentions to use MyMentalPocket (i.e., TAM and UGT variables). People’s depression levels were measured using items from a Korean version [70] of the Patient Health Questionnaire-9 (PHQ-9), a validated depression screening tool [71,72]. On a 4-point Likert-type scale (from 0 = not at all to 3 = nearly every day), participants marked their agreement on nine items such as “little interest or pleasure in doing things”. Item scores were summed for data analysis, and higher scores indicated more severe levels of depression [71].

2.3. Data Analysis

The data were analyzed using SPSS 27 (IBM Inc., USA). An exploratory factor analysis was performed to answer RQ1, identifying people’s motives for depression-related digital technology use. Pearson product-moment correlation along with hierarchical multiple regression analyses were performed to test H1-5 and answer RQ2-3, ascertaining relationships between the motives, perceived usefulness, perceived ease of use, parasocial interactions, and intentions to use MyMentalPocket.

3. Results

3.1. Participant Characteristics

The sample for this study consisted of 278 students (92%, 256/278) and faculty and staff members (8%, 22/278). The sample size needed for this study was calculated using G*Power [73]: n = 195 when f2 = 0.066 (calculated based on the findings from existing TAM literature) [74], α = 0.05, and Power = 90%. Considering Park and Goering’s [35] reports on people’s experience with health-related social media use with a potential attrition rate of up to 30% (those with no experience), the sample size of 278 was deemed appropriate for this study.
Of the 278 participants, 50% (139/278) were female and 50% (139/278) were male, and participants’ age ranged from 18 to 63 years (M = 23, SD = 5.11). The majority (82%, 227/276) were undergraduates, i.e., first-year (16%, 45/276), sophomore (21%, 58/276), junior (20%, 56/276), senior (25%, 68/276), and otherwise (18%, 49/276) reported a Bachelor’s degree or higher education levels. The majority (92%, 255/278) reported PHQ-9 scores that ranged from 1 (minimal) to 21 (severe) and indicated having mild levels of depression on average (M = 5.25, SD = 3.58) [70].

3.2. Motives for Depression-Related Digital Technology Use

RQ1 was to identify people’s motives for depression-related digital technology use. An exploratory factor analysis—with principal component analysis and varimax rotation methods—was performed. This study considered three or more items with an eigenvalue of 1.00 or higher, primary loadings of 0.60 or higher, and secondary loadings of less than 0.40 [58], as a factor reflecting a motive for depression-related digital technology use. Four motives—three instrumental motives (communication and emotional support, information- and guidance-seeking, habitual entertainment-seeking motives) and one ritualized motive (escape motive)—were identified (see Table S3), explaining 54.03% of the total variance.
The communication and emotional support motive, the first motive, explained 25.49% of the total variance and comprised eight items (e.g., “because I want to feel listened to, understood, and cared for”) describing people using specific websites or smartphone apps to talk to someone about their experiences and concerns with depression, feeling listened to, understood, and supported in depression management. The information- and guidance-seeking motive, the second motive, explained 16.09% of the total variance and comprised seven items (e.g., “to get what I need to manage depression”) describing people using specific websites or smartphone apps to obtain information or guidance easily and for free, helping them learn about new, varied, or entertaining ways to understand and cope with depression. The habitual entertainment-seeking motive, the third motive, explained 8.06% of the total variance and comprised six items (e.g., “to have fun”) describing people using specific websites or smartphone apps because of the convenience the technologies provide in getting entertaining content to pass time. The escape motive, the fourth motive, explained 4.40% of the total variance and comprised three items (e.g., “to get away from pressures and responsibilities”) describing people using specific websites or smartphone apps as a temporary means of forgetting about things (e.g., school, work) they feel pressed or burdened with. Each motive’s item scores were summed and averaged to create a communication and emotional support motive scale (M = 2.88, SD = 0.87, α = 0.87), an information- and guidance-seeking motive scale (M = 3.52, SD = 0.84, α = 0.89), a habitual entertainment-seeking motive scale (M = 3.05, SD = 0.98, α = 0.86), and an escape motive scale (M = 3.45, SD = 1.01, α = 0.80). Higher scale scores for each motive indicated stronger levels of the motive. The Cronbach’s alpha for each motive scale reflected an acceptable internal consistency.

3.3. Factors Influencing Intentions to Use MyMentalPocket

Pearson product-moment correlation along with hierarchical regression analyses was conducted for H1, H2, and H4. The bivariate relationships among the variables were found using two-tailed Pearson product-moment correlations, and the relationships between parasocial interactions and intentions to use MyMentalPocket (r = 0.76, p < 0.001) and perceived usefulness and the intentions (r = 0.73, p < 0.001) emerged as the strongest correlations (see Table S4, Figures S1 and S2).
Hierarchical regression analyses were conducted to confirm factors that explain intentions to use MyMentalPocket (see Table 1). Multicollinearity tests revealed that there is no multicollinearity (tolerance values > 0.10 and variance inflation factor values < 10) [75,76] among the variables.
Demographic variables entered the first step explained 6% of the variance in the intentions, with female gender (β = 0.14, p < 0.05) and younger age (β = –0.19, p < 0.01) being significant factors: R = 0.25, R2 = 0.06, F(3, 237) = 5.12, p < 0.01. The motives for depression-related digital technology use added on the second step explained an additional 8% of the variance in the intentions, with the information- and guidance-seeking motive (β = 0.15, p < 0.05) being a significant factor: R = 0.38, R2 = 0.14, F(7, 233) = 5.46, p < 0.001. Perceived usefulness, perceived ease of use, and parasocial interactions added on the third step explained an additional 52% of the variance in the intentions: R = 0.81, R2 = 0.66, F(10, 230) = 43.82, p < 0.001. At this point, participants’ gender (β = 0.03, p = 0.53) and age (β = –0.02, p = 0.65) were no longer significant factors, whereas depression levels (β = 0.10, p < 0.05), perceived usefulness (β = 0.37, p < 0.001), and parasocial interactions (β = 0.46, p < 0.001) appeared to be significant factors influencing the intentions (see Figure 2). Therefore, H1 and H4 were supported, but H2 was not supported.

3.4. Factors Influencing Intentions to Perceived Usefulness

Pearson product-moment correlation along with hierarchical regression analyses were conducted for H3, H5, and RQ2. The bivariate relationships among the variables were found using two-tailed Pearson product-moment correlations (see Table S4). Hierarchical regression analyses were conducted to confirm factors that explain perceived usefulness (see Table 2). Multicollinearity tests revealed that there is no multicollinearity among the variables.
Demographic variables entered the first step explained 5% of the variance in perceived usefulness, with participants’ age (β = –0.19, p < 0.01) being a significant factor: R = 0.23, R2 = 0.05, F(3, 238) = 4.24, p < 0.01. The motives for depression-related digital technology use added on the second step explained an additional 7% of the variance in perceived usefulness, with the information- and guidance-seeking motive (β = 0.21, p < 0.01) being a significant factor: R = 0.35, R2 = 0.12, F(7, 234) = 4.52, p < 0.001. Perceived ease of use and parasocial interactions added on the third step explained an additional 45% of the variance in perceived usefulness: R = 0.75, R2 = 0.57, F(9, 232) = 33.55, p < 0.001. At this point, the participant’s age (β = –0.02, p = 0.66) and information- and guidance-seeking motive (β = 0.09, p = 0.09) were no longer significant factors, and the perceived ease of use (β = 0.22, p < 0.001) and parasocial interactions (β = 0.64, p < 0.001) appeared to be significant factors influencing perceived usefulness (see Figure 2). Therefore, H3 and H5 were supported. Regarding RQ2, when entering perceived ease of use and parasocial interactions, the motives for depression-related digital technology use did not appear to significantly influence perceived usefulness.

3.5. Factors Influencing Intentions to Parasocial Interactions

Pearson product-moment correlation along with hierarchical regression analyses were conducted for RQ3. The bivariate relationships among the variables were found using two-tailed Pearson product-moment correlations (see Table S4). Hierarchical regression analyses were conducted to confirm factors that explain parasocial interactions (see Table 3). Multicollinearity tests revealed that there is no multicollinearity among the variables.
Demographic variables entered in the first step explained 8% of the variance in parasocial interactions, with female gender (β = 0.19, p < 0.01) and younger age (β = –0.18, p < 0.01) being significant factors: R = 0.29, R2 = 0.08, F(3, 239) = 7.02, p < 0.001. The motives for depression-related digital technology use added on the second step explained an additional 10% of the variance in parasocial interactions, with the communication and emotional support motive (β = 0.16, p < 0.05), the information- and guidance-seeking motive (β = 0.14, p < 0.05), and the habitual entertainment-seeking motive (β = 0.22, p < 0.01) being significant factors: R = 0.43, R2 = 0.18, F(7, 235) = 7.51, p < 0.001. In conclusion, regarding RQ3, the communication and emotional support motive, the information- and guidance-seeking motive, and the habitual entertainment-seeking motive, along with participants’ gender and age, appeared to significantly influence parasocial interactions (see Figure 2).
Based on the results from hierarchical regression analyses, additional mediation analyses were performed to confirm if participants’ intentions to use MyMentalPocket and its determinants (i.e., participants’ age, gender, communication and emotional support motive, information- and guidance-seeking motive, habitual entertainment-seeking motive, and perceived ease of use) are mediated by parasocial interactions and perceived usefulness. The analyses were performed using Hayes’s PROCESS macro using the bootstrapping method [77,78,79,80] and guided by Baron and Kenny’s suggestions, such as checking decreased or no effects of independent variables on dependent variables when a mediator intervenes in the relationship [81]. The analyses confirmed the mediating effects of parasocial interactions and perceived usefulness for the pathways in Table 4, showing that the indirect effects are significant with no zero included in the bootstrap confidence intervals [77].

4. Discussion

Integrating TAM with UGT, this study examined factors that matter to people in accepting digital mental healthcare content called MyMentalPocket. The findings from this study indicate that people’s intentions to use specific digital mental healthcare content could be better understood by focusing on the factors such as people’s motives for depression-related digital technology use, perceived usefulness, perceived ease of use, and parasocial interactions with an AI chatbot.
People’s depression levels, perceived usefulness, and parasocial interactions were positively related to intentions to use MyMentalPocket. It has been indicated that people with depression experience interpersonal difficulties [3] and might think positively about computer-based and non-face-to-face depression treatments [47]. In addition, Pitardi et al.’s [82] study argued that people might feel less embarrassed to talk with chatbots about sensitive topics, compared to human agents. Along with these reports, the findings from this study suggest that people with higher levels of depression are more likely to use digital mental healthcare content features, such as Pocky, the AI chatbot of MyMentalPocket because they think their interpersonal difficulties in help-seeking (e.g., stigma) would be mitigated.
Consistent with existing studies that have explained people’s intentions to use a technology with perceived usefulness [21,83] and parasocial interactions [44], the findings from this study suggest that people who find digital mental healthcare content to be useful (perceived usefulness) and who think an AI chatbot to be their friend, advocate, and guide and the chatbot helps depression management (parasocial interactions) become willing to use the content. To reach a clearer picture of the ways that people experience perceived usefulness and parasocial interactions, this study identified people’s motives for depression-related digital technology use and their roles in influencing perceived usefulness and parasocial interactions. Confirming the findings from UGT literature suggesting that there are motives for people to use a specific technology or medium [33,36,40,55,61,84,85], this study identified the communication and emotional support motive, the information- and guidance-seeking motive, the habitual entertainment-seeking motive, and the escape motive, which are the reasons behind people’s digital technology use in the context of depression.
Participants’ information- and guidance-seeking, communication and emotional support, and habitual entertainment-seeking motives were positively related to parasocial interactions. In turn, parasocial interactions, along with perceived ease of use, were positively related to perceived usefulness. Being mental health literate and receiving emotional support have been reported as critical to reducing depressive symptoms [39,86]. Additionally, entertaining content (e.g., photonovels, videos, games) has helped cope with mental health issues, such as increasing knowledge about depression treatment [87], improving mental health literacy [88], and promoting help-seeking behaviors [89]. In addition, entertaining content might be further helpful for people with depression in distracting themselves from the stressful reality and in mitigating depressive symptoms [15,90,91]. Taken together, the findings from this study suggest that AI chatbots such as Pocky—designed to provide convenient access to information and guidance to help people understand and manage depression, a communication channel where they make their voices heard and receive emotional support, and entertaining content (e.g., wellness games) helping them stay away from and better cope with depressive experiences—might play important roles in motivating people to use and benefit from digital mental healthcare content.
In addition, females and younger people were likely to report higher levels of parasocial interactions than males and older people. Beyond existing reports that females and younger people report higher levels of eHealth literacy and are more actively adopting digital health technologies [92,93,94], it has been reported that females with depression heavily use a smartphone [95]. In addition, feeling listened to is an important part of communication for women in mental healthcare [96]. Considering these reports, the findings from this study suggest the utility of AI chatbots, such as Pocky, communicating with users in an empathetic way via smartphone, as a way to reach out to and help females and younger people understand and manage depression. On average, participants in this study agreed that MyMentalPocket is easy to use, and such perceived ease of use was found to positively affect perceived usefulness. These findings confirm the positive relationship between perceived ease of use and perceived usefulness reported by existing literature [29]. Additionally, it suggests that finding the use of digital mental healthcare content to be effortless might be important to people with depression, especially those suffering from cognitive difficulties [3,27,28] in determining whether or not they proceed to explore and confirm the usefulness of the content.
The findings from this study could inform the design of studies to improve and promote digital mental healthcare content. The findings from this study imply that improving people’s parasocial interactions with an AI chatbot is expected to increase their levels of perceived usefulness and intentions to use digital mental healthcare content. Therfore, it is important that future researchers examine and reflect the following elements in updating and advancing the chatbot and improving the parasocial interactions: specific types of information and entertaining content people want the chatbot to provide or suggest (in meeting their information and entertainment-seeking needs) or specific characteristics of the chatbot they think would make them feel listened to and supported in depression management (in meeting their communication and emotional support needs), such as specific words and human-likeness that have influenced people’s positive perceptions of AI chatbots and voice assistants (e.g., satisfaction, intentions to use) [48,97,98].
In addition, the findings from this study imply that improving people’s perceived ease of use is also important to promote perceived usefulness and intentions to use digital mental healthcare content. Existing literature suggests that design features might influence perceived ease of use [29]. Specifically, mental health app users have shown that they prefer design features, such as the layout of an app, that are simple and self-explanatory, font sizes that are easy to read and understand, and colors that draw attention [99,100]. Considering these reports, it is suggested that future research works with people with depression in designing and updating the layout of digital mental healthcare content in ways they prefer and feel comfortable navigating and using the content. Once the content has been updated focusing on improving people’s levels of parasocial interactions, perceived usefulness, and perceived ease of use, future research could assess the improvement by employing a pretest-posttest design that compares scores (e.g., mean values) on these variables before and after the updates. Once the improvement has been observed, providing people with training—from which they can learn about the utility of the content and have hands-on experience with it—could motivate them to use the content, targeting (increasing the levels of) determinants of intentions to use the content [101,102]. Such training opportunities might be especially helpful to people whose primary motive for depression-related technology use is the escape motive (e.g., those who might have used a website or a smartphone app in distracting themselves from school or work but have not paid attention to or assessed the utility or personal relevance of the content it provides) [35]. Similar to Kim’s [54] study revealing a positive correlation between people’s ritualized motive (passing time) and instrumental motive (entertainment), in this study, participants’ ritualized motive (escape) was positively and strongly correlated with instrumental motives (entertainment motive and communication and emotional support motive)—which in turn positively affect parasocial interactions, perceived usefulness, and intentions to use digital mental healthcare content—suggesting that people with the escape motive might also have entertainment, communication, and emotional support needs for depression management. If that is the case, they might become motivated to use digital mental healthcare content through training opportunities, directing their attention to and helping them learn about the content, such as AI chatbots, that might help meet their entertainment, communication, and emotional support needs.
There are some limitations of this study that warrant attention in future research. First, this study was conducted with a convenience sample within the context of the university, helping us understand the adoption and use of digital mental healthcare content within the university population. People’s experiences with depression, however, vary across different contexts, such as occupations, organizations, and cultures [103,104], and the findings from this study should not be generalized to other contexts. For example, university students who struggle with the stress of academic performance and job application [105] and military personnel who experience stress from missions and poor morale [106] might differ in their experiences with depression and coping practices. It is recommended that future research explore how people differ in their perceptions and acceptance of mental healthcare services, such as digital mental healthcare content, in coping with depression. One suggestion is that future researchers analyze data collected at the national level, such as Health Information National Trends Survey [107,108], to understand digital healthcare content use (e.g., smartphone apps) among people with depression across demographic groups.
Second, this study utilized standardized measures and identified common motives for depression-related digital technology use across the university population. However, it remains unexplored how people within this population differ in their most important motives and the type of digital mental healthcare content they would find most useful, depending on demographic characteristics, such as status, i.e., student or faculty/staff. Meeks et al.’s [36] study on mental healthcare within the university population indicated that students and faculty/staff members differ in barriers to mental healthcare and coping practices. The study revealed that students report being concerned with the stigma and its outcomes (e.g., being treated as an incapable social outcast) as their barriers to mental healthcare and prefer coping with depression by keeping a diary or relying on entertaining content (e.g., music, movies), whereas faculty/staff report low levels of perceived severity of depression symptoms and low levels of trust in healthcare providers as their barriers and prefer self-management of the symptoms using books or apps [36]. Considering these reports, when compared to faculty/staff, communication and emotional support and habitual entertainment-seeking motives might be stronger for students, and they might find digital mental healthcare content features helping them make sense of and manage depression in a confidential manner (without feeling self-conscious or stigmatized) and with entertaining content (e.g., wellness games) to be useful. In contrast, information- and guidance-seeking motives would be stronger for faculty/staff, and they might find the content to be useful when it guides them through how to self-manage depression in their daily lives. Taken together, targeted participant recruitment and qualitative approaches are suggested for future research in understanding specific demographic group members’ struggles related to depression management in depth and developing digital mental healthcare content that addresses those struggles, and, thereby, helping empower them in mental healthcare.
Third, this study was cross-sectional and thus did not keep track of people’s continuous use of digital mental healthcare content nor did it explore factors that might influence their continuous use. Saad et al.’s [10] literature review revealed high dropout rates among mental healthcare technology users, and people’s intentions to use a technology are not always and unconditionally related to continuous technology use [109,110,111]. To promote not only the initiation but the continuance of digital mental healthcare content use, there is the need for longitudinal research that assesses a relationship between intentions to use the content and continuous use, as well as factors—such as peer and coach support [112], incentives and reminders [113], and personalized content [114]—that might moderate the relationship.

5. Conclusions

In conclusion, through the application of TAM and UGT, this study confirms the factors that might lead people to adopt the use of digital mental healthcare content. People with needs for communication and emotional support, information and guidance, and entertaining content (i.e., motives) were likely to report parasocial interactions, which lead to perceived usefulness and intentions to use the content. Females and younger people were more likely to engage in parasocial interactions, implying the important roles of AI chatbots in supporting them in depression management. The limitations of this study could be addressed by engaging in targeted recruitment and employing a longitudinal design, providing a clearer blueprint for tailoring digital mental healthcare content and designing interventions to support people in depression management through voluntary and continuous use of the content.

Supplementary Materials

The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/su15010872/s1, Table S1. Summary of literature review; Table S2. Measurement items for TAM and UGT variables; Table S3. Motives for depression-related digital technology use; Table S4. Pearson product-moment correlations among the variables; Figure S1. Bivariate relationship between parasocial interactions (PSI) and intentions to use (IU); Figure S2. Bivariate relationship between perceived usefulness (PU) and intentions to use (IU).

Author Contributions

Conceptualization, D.Y.P. and H.K.; Methodology, H.K.; Project administration, D.Y.P.; Investigation, D.Y.P.; Formal analysis, D.Y.P.; Writing—original draft, D.Y.P.; Writing—review and editing, H.K.; Validation, H.K.; Visualization, D.Y.P. and H.K.; Supervision, H.K. All authors have read and agreed to the published version of the manuscript.

Funding

This research was supported by the Bio & Medical Technology Development Program of the National Research Foundation (NRF) & funded by the Korean government (MSIT) (NRF-2021M3A9E4080780).

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of Helsinki, and the protocol was approved by the Institutional Review Board of Hanyang University (protocol code #HYUIRB-202206-009).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The data presented in this study are available on request from the corresponding author. The data are not publicly available due to privacy restrictions.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. World Health Organization. The Impact of COVID-19 on Mental, Neurological and Substance Use Services: Results of a Rapid Assessment. 2020. Available online: https://www.who.int/publications/i/item/978924012455 (accessed on 6 October 2022).
  2. Organisation for Economic Co-Operation and Development. Tackling the Mental Health Impact of the COVID-19 Crisis: An Integrated, Whole-of-Society Response. 2021. Available online: https://www.oecd.org/coronavirus/policy-responses/tackling-the-mental-health-impact-of-the-covid-19-crisis-an-integrated-whole-of-society-response-0ccafa0b/ (accessed on 6 October 2022).
  3. World Health Organization. Depression. 2021. Available online: https://www.who.int/news-room/fact-sheets/detail/depression (accessed on 6 October 2022).
  4. Park, S.J.; Kim, S.Y.; Lee, E.-S.; Park, S. Associations among employment status, health behaviors, and mental health in a representative sample of South Koreans. Int. J. Environ. Res. Public Health 2020, 17, 2456. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  5. Chang, S.M.; Hong, J.P.; Cho, M.J. Economic burden of depression in South Korea. Soc. Psychiatry Psychiatr. Epidemiol. 2012, 47, 683–689. [Google Scholar] [CrossRef] [PubMed]
  6. Zomer, E.; Rhee, Y.; Liew, D.; Ademi, Z. The health and productivity burden of depression in South Korea. Appl. Health Econ. Health Policy 2021, 19, 941–951. [Google Scholar] [CrossRef] [PubMed]
  7. Ranta, K. The Impact of User Acceptance in the Efficacy of Digital Therapeutics. Master’s Thesis, University of Jyväskylä, Jyväskylä, Finland, 2019. [Google Scholar]
  8. Leung, R.; Hastings, J.F.; Keefe, R.H.; Brownstein-Evans, C.; Chan, K.T.; Mullick, R. Building mobile apps for underrepresented mental health care consumers: A grounded theory approach. Soc. Work Ment. Health 2016, 14, 625–636. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  9. Lord, S.E.; Campbell, A.N.C.; Brunette, M.F.; Cubillos, L.; Bartels, S.M.; Torrey, W.C.; Olson, A.L.; Chapman, S.H.; Batsis, J.A.; Polsky, D.; et al. Workshop on implementation science and digital therapeutics for behavioral health. JMIR Ment. Health 2021, 8, e17662. [Google Scholar] [CrossRef] [PubMed]
  10. Saad, A.; Bruno, D.; Camara, B.; D’Agostino, J.; Bolea-Alamanac, B. Self-directed technology-based therapeutic methods for adult patients receiving mental health services: Systematic review. JMIR Ment. Health 2021, 8, e27404. [Google Scholar] [CrossRef]
  11. Beevers, C.G.; Pearson, R.; Hoffman, J.S.; Foulser, A.A.; Shumake, J.; Meyer, B. Effectiveness of an internet intervention (Deprexis) for depression in a united states adult sample: A parallel-group pragmatic randomized controlled trial. J. Consult. Clin. Psychol. 2017, 85, 367–380. [Google Scholar] [CrossRef]
  12. Economides, M.; Ranta, K.; Nazander, A.; Hilgert, O.; Goldin, P.R.; Raevuori, A.; Forman-Hoffman, V. Long-term outcomes of a therapist-supported, smartphone-based intervention for elevated symptoms of depression and anxiety: Quasiexperimental, pre-postintervention study. JMIR mHealth uHealth 2019, 7, e14284. [Google Scholar] [CrossRef]
  13. Stratton, E.; Lampit, A.; Choi, I.; Malmberg Gavelin, H.; Aji, M.; Taylor, J.; Calvo, R.A.; Harvey, S.B.; Glozier, N. Trends in effectiveness of organizational eHealth interventions in addressing employee mental health: Systematic review and meta-analysis. J. Med. Internet Res. 2022, 24, e37776. [Google Scholar] [CrossRef]
  14. Twomey, C.; O’Reilly, G.; Bültmann, O.; Meyer, B. Effectiveness of a tailored, integrative Internet intervention (deprexis) for depression: Updated meta-analysis. PLoS ONE 2020, 15, e0228100. [Google Scholar] [CrossRef]
  15. Li, J.; Theng, Y.-L.; Foo, S. Game-based digital interventions for depression therapy: A systematic review and meta-analysis. Cyberpsychol. Behav. Soc. Netw. 2014, 17, 519–527. [Google Scholar] [CrossRef] [Green Version]
  16. Twomey, C.; O’Reilly, G.; Byrne, M.; Bury, M.; White, A.; Kissane, S.; McMahon, A.; Clancy, N. A randomized controlled trial of the computerized CBT programme, MoodGYM, for public mental health service users waiting for interventions. Br. J. Clin. Psychol. 2014, 53, 433–450. [Google Scholar] [CrossRef]
  17. Davis, F.D. Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS Q. Manag. Inf. Syst. 1989, 13, 319–339. [Google Scholar] [CrossRef] [Green Version]
  18. Davis, F.D.; Venkatesh, V. A critical assessment of potential measurement biases in the technology acceptance model: Three experiments. Int. J. Hum. Comput. Stud. 1996, 45, 19–45. [Google Scholar] [CrossRef] [Green Version]
  19. Katz, E.; Blumler, J.G.; Gurevitch, M. Uses and gratifications research. Public Opin. Q. 1973, 37, 509–523. [Google Scholar] [CrossRef]
  20. Venkatesh, V.; Davis, F.D. A theoretical extension of the technology acceptance model: Four longitudinal field studies. Manag. Sci. 2000, 46, 186–204. [Google Scholar] [CrossRef] [Green Version]
  21. Palos-Sanchez, P.; Saura, J.R.; Rios Martin, M.A.; Aguayo Camacho, M. Toward a better understanding of the intention to use mHealth apps: Exploratory study. JMIR mHealth uHealth 2021, 9, e27021. [Google Scholar] [CrossRef]
  22. Schueller, S.M.; Neary, M.; O’Loughlin, K.; Adkins, E.C. Discovery of and interest in health apps among those with mental health needs: Survey and focus group study. J. Med. Internet Res. 2018, 20, e10141. [Google Scholar] [CrossRef]
  23. Grindrod, K.A.; Li, M.; Gates, A. Evaluating user perceptions of mobile medication management applications with older adults: A usability study. JMIR mHealth uHealth 2014, 2, e11. [Google Scholar] [CrossRef]
  24. Cajita, M.I.; Hodgson, N.A.; Budhathoki, C.; Han, H.-R. Intention to use mHealth in older adults with heart failure. J. Cardiovasc. Nurs. 2017, 32, E1–E7. [Google Scholar] [CrossRef]
  25. Povey, J.; Mills, P.P.J.R.; Dingwall, K.M.; Lowell, A.; Singer, J.; Rotumah, D.; Bennett-Levy, J.; Nagel, T. Acceptability of mental health apps for Aboriginal and Torres Strait Islander Australians: A qualitative study. J. Med. Internet Res. 2016, 18, e65. [Google Scholar] [CrossRef] [PubMed]
  26. Chan, A.H.Y.; Honey, M.L.L. User perceptions of mobile digital apps for mental health: Acceptability and usability—An integrative review. J. Psychiatr. Ment. Health Nurs. 2022, 29, 147–168. [Google Scholar] [CrossRef] [PubMed]
  27. Keller, A.S.; Leikauf, J.E.; Holt-Gosselin, B.; Staveland, B.R.; Williams, L.M. Paying attention to attention in depression. Transl. Psychiatry 2019, 9, 279. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  28. Zuckerman, H.; Pan, Z.; Park, C.; Brietzke, E.; Musial, N.; Shariq, A.S.; Iacobucci, M.; Yim, S.J.; Lui, L.M.W.; Rong, C.; et al. Recognition and treatment of cognitive dysfunction in major depressive disorder. Front. Psychiatry 2018, 9, 655. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  29. Lazard, A.J.; Watkins, I.; Mackert, M.S.; Xie, B.; Stephens, K.K.; Shalev, H. Design simplicity influences patient portal use: The role of aesthetic evaluations for technology acceptance. J. Am. Med. Inform. Assoc. JAMIA 2016, 23, e157–e161. [Google Scholar] [CrossRef] [Green Version]
  30. Lee, J.; Lee, D.; Park, Y.; Lee, S.; Ha, T. Autonomous vehicles can be shared, but a feeling of ownership is important: Examination of the influential factors for intention to use autonomous vehicles. Transp. Res. C: Emerg. Technol. 2019, 107, 411–422. [Google Scholar] [CrossRef]
  31. Liao, Y.K.; Wu, W.Y.; Le, T.Q.; Phung, T.T.T. The integration of the technology acceptance model and value-based adoption model to study the adoption of e-learning: The moderating role of e-WOM. Sustainability 2022, 14, 815. [Google Scholar] [CrossRef]
  32. Rubin, A.M.; Haridakis, P.M.; Hullman, G.A.; Sun, S.; Chikombero, P.M.; Pornsakulvanich, V. Television exposure not predictive of terrorism fear. Newsp. Res. J. 2003, 24, 128–145. [Google Scholar] [CrossRef]
  33. Rubin, A.M.; Step, M.M. Viewing television talk shows. Commun. Res. Rep. 1997, 14, 106–115. [Google Scholar] [CrossRef]
  34. Rubin, A.M.; Perse, E.M. Audience activity and television news gratifications. Commun. Res. 1987, 14, 58–84. [Google Scholar] [CrossRef]
  35. Park, D.Y.; Goering, E.M. The health-related uses and gratifications of YouTube: Motive, cognitive involvement, online activity, and sense of empowerment. J. Consum. Health Internet 2016, 20, 52–70. [Google Scholar] [CrossRef] [Green Version]
  36. Meeks, K.; Peak, A.S.; Dreihaus, A. Depression, anxiety, and stress among students, faculty, and staff. J. Am. Coll. Health 2021. [Google Scholar] [CrossRef]
  37. Yzer, M.; Gilasevitch, J. Beliefs underlying stress reduction and depression help-seeking among college students: An elicitation study. J. Am. Coll. Health 2019, 67, 153–160. [Google Scholar] [CrossRef]
  38. Goldsmith, D.J. Communicating Social Support; Cambridge University Press: New York, NY, USA, 2004. [Google Scholar] [CrossRef]
  39. Kim, E.J.; Yu, J.H.; Kim, E.Y. Pathways linking mental health literacy to professional help-seeking intentions in Korean college students. J. Psychiatr. Ment. Health Nurs. 2020, 27, 393–405. [Google Scholar] [CrossRef]
  40. Joo, J.; Sang, Y. Exploring Koreans’ smartphone usage: An integrated model of the technology acceptance model and uses and gratifications theory. Comput. Hum. Behav. 2013, 29, 2512–2518. [Google Scholar] [CrossRef]
  41. Horton, D.; Richard Wohl, R. Mass communication and para-social interaction. Psychiatry 1956, 19, 215–229. [Google Scholar] [CrossRef]
  42. Rubin, A.M.; Perse, E.M. Audience activity and soap opera involvement a uses and effects investigation. Hum. Commun. Res. 1987, 14, 246–268. [Google Scholar] [CrossRef]
  43. Rubin, A.M.; Perse, E.M.; Powell, R.A. Loneliness, parasocial interaction, and local television news viewing. Hum. Commun. Res. 1985, 12, 155–180. [Google Scholar] [CrossRef]
  44. Sokolova, K.; Perez, C. You follow fitness influencers on YouTube. But do you actually exercise? How parasocial relationships, and watching fitness influencers, relate to intentions to exercise. J. Retail. Consum. Serv. 2021, 58, 102276. [Google Scholar] [CrossRef]
  45. Bernhold, Q.S.; Metzger, M. Older Adults’ Parasocial relationships with favorite television characters and depressive symptoms. Health Commun. 2018, 35, 168–179. [Google Scholar] [CrossRef]
  46. Matthews, E.B.; Savoy, M.; Paranjape, A.; Washington, D.; Hackney, T.; Galis, D.; Zisman-Ilani, Y. Shared decision making in primary care based depression treatment: Communication and decision-making preferences among an underserved patient population. Front. Psychiatry 2021, 12, 681165. [Google Scholar] [CrossRef] [PubMed]
  47. Do, R.; Park, J.-R.; Lee, S.-Y.; Cho, M.-J.; Kim, J.-S.; Shin, M.-S. Adolescents’ attitudes and intentions toward help-seeking and computer-based treatment for depression. Psychiatry Investig. 2019, 16, 728–736. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  48. Peter, J.; Valkenburg, P.M.; Schouten, A.P. Characteristics and motives of adolescents talking with strangers on the Internet. Cyberpsychol. Behav. 2006, 9, 526–530. [Google Scholar] [CrossRef] [PubMed]
  49. Tsai, W.-H.S.; Liu, Y.; Chuan, C.-H. How chatbots’ social presence communication enhances consumer engagement: The mediating role of parasocial interaction and dialogue. J. Res. Interact. Mark. 2021, 15, 460–482. [Google Scholar] [CrossRef]
  50. Tavares, J.V.T.; Clark, L.; Furey, M.L.; Williams, G.B.; Sahakian, B.J.; Drevets, W.C. Neural basis of abnormal response to negative feedback in unmedicated mood disorders. NeuroImage 2008, 42, 1118–1126. [Google Scholar] [CrossRef] [Green Version]
  51. Whang, C.; Im, H. “I like your suggestion!” the role of humanlikeness and parasocial relationship on the website versus voice shopper’s perception of recommendations. Psychol. Mark. 2020, 38, 581–595. [Google Scholar] [CrossRef]
  52. Choi, S.; Kim, I.; Cha, K.; Suh, Y.-K.; Kim, K.-H. Travelers’ parasocial interactions in online travel communities. J. Travel Tour. Mark. 2019, 36, 888–904. [Google Scholar] [CrossRef]
  53. Blight, M.G.; Ruppel, E.K.; Schoenbauer, K.V. Sense of community on twitter and instagram: Exploring the roles of motives and parasocial relationships. Cyberpsychol. Behav. Soc. Netw. 2017, 20, 314–319. [Google Scholar] [CrossRef]
  54. Tsay, M.; Bodine, B.M. Exploring parasocial interaction in college students as a multidimensional construct: Do personality, interpersonal need, and television motive predict their relationships with media characters? Psychol. Pop. Media Cult. 2012, 1, 185–200. [Google Scholar] [CrossRef]
  55. Kim, H. Unpacking unboxing video-viewing motivations: The uses and gratifications perspective and the mediating role of parasocial interaction on purchase intent. J. Interact. Advert. 2020, 20, 196–208. [Google Scholar] [CrossRef]
  56. Zhao, C.; Shen, H.; Zhang, Y. The study on the impact of short video tourism vloggers at social media platform on online sharing intention. Front. Psychol. 2022, 13, 905002. [Google Scholar] [CrossRef]
  57. MyMentalPocket. Available online: https://mymentalpocket.com/ (accessed on 6 October 2022).
  58. Yonhap News Agency. S. Korea to Research Digital Treatment for Depression Amid Pandemic. 2021. Available online: https://en.yna.co.kr/view/AEN20210715001100320 (accessed on 6 October 2022).
  59. Papacharissi, Z.; Rubin, A.M. Predictors of internet use. J. Broadcast. Electron. Media 2000, 44, 175–196. [Google Scholar] [CrossRef]
  60. Rubin, A.M. An examination of television viewing motivations. Commun. Res. 1981, 8, 141–165. [Google Scholar] [CrossRef]
  61. Rubin, R.B.; Perse, E.M.; Barbato, C.A. Conceptualization and measurement of interpersonal communication motives. Hum. Commun. Res. 1988, 14, 602–628. [Google Scholar] [CrossRef]
  62. Hatcher, R.L.; Gillaspy, J.A. Development and validation of a revised short version of the working alliance inventory. Psychother. Res. 2006, 16, 12–25. [Google Scholar] [CrossRef]
  63. Yeum, J.-Y.; Hong, S.-C.; Jeong, J.-H.; Kim, T.-W.; Um, Y.-H.; Kim, S.-M.; Seo, H.-J. The reliability and validity of the Korean version of Working Alliance Inventory-Short Revised (WAI-SR-K). Anxiety Mood 2017, 13, 132–140. [Google Scholar] [CrossRef]
  64. Furneaux; Wade. An exploration of organizational level information systems discontinuance intentions. MIS Q. Manag. Inf. Syst. 2011, 35, 573. [Google Scholar] [CrossRef]
  65. Oliveira, T.; Thomas, M.; Baptista, G.; Campos, F. Mobile Payment: Understanding the determinants of customer adoption and intention to recommend the technology. Comput. Hum. Behav. 2016, 61, 404–414. [Google Scholar] [CrossRef]
  66. Venkatesh, V.; Morris, M.G.; Davis, G.B.; Davis, F.D. User acceptance of information technology: Toward a unified view. MIS Q.: Manag. Inf. Syst. 2003, 27, 425–478. [Google Scholar] [CrossRef]
  67. Torous, J.; Lipschitz, J.; Ng, M.; Firth, J. Dropout rates in clinical trials of smartphone apps for depressive symptoms: A systematic review and meta-analysis. J. Affect. Disord. 2020, 263, 413–419. [Google Scholar] [CrossRef]
  68. Porter, C.E.; Donthu, N. Using the technology acceptance model to explain how attitudes determine internet usage: The role of perceived access barriers and demographics. J. Bus. Res. 2006, 59, 999–1007. [Google Scholar] [CrossRef]
  69. Zhong, Y.; Oh, S.; Moon, H.C. Service transformation under industry 4.0: Investigating acceptance of facial recognition payment through an extended technology acceptance model. Technol. Soc. 2021, 64, 101515. [Google Scholar] [CrossRef]
  70. An, J.-Y.; Seo, E.-R.; Lim, K.-H.; Shin, J.H.; Kim, J.B. Standardization of the Korean version of screening tool for depression (Patient Health Questionnaire-9, PHQ-9). J. Korean Soc. Biol. Ther. Psychiatry 2013, 19, 47–56. [Google Scholar] [CrossRef] [Green Version]
  71. Kroenke, K.; Spitzer, R.L.; Williams, J.B.W. The PHQ-9: Validity of a brief depression severity measure. J. Gen. Intern. Med. 2001, 16, 606–613. [Google Scholar] [CrossRef] [PubMed]
  72. Costantini, L.; Pasquarella, C.; Odone, A.; Colucci, M.E.; Costanza, A.; Serafini, G.; Aguglia, A.; Murri, M.B.; Brakoulias, V.; Amore, M.; et al. Screening for depression in primary care with Patient Health Questionnaire-9 (PHQ-9): A systematic review. J. Affect. Disord. 2021, 279, 473–483. [Google Scholar] [CrossRef]
  73. Faul, F.; Erdfelder, E.; Buchner, A.; Lang, A.-G. Statistical power analyses using G*Power 3.1: Tests for correlation and regression analyses. Behav. Res. Methods 2009, 41, 1149–1160. [Google Scholar] [CrossRef] [Green Version]
  74. Dogruel, L.; Joeckel, S.; Bowman, N.D. The use and acceptance of new media entertainment technology by elderly users: Development of an expanded technology acceptance model. Behav. Inf. Technol. 2015, 34, 1052–1063. [Google Scholar] [CrossRef]
  75. Cohen, J.; Cohen, P.; West, S.G.; Aiken, L.S. Applied Multiple Regression/Correlation Analysis for the Behavioral Sciences, 3rd ed.; Lawrence Erlbaum Associates, Inc.: Mahwah, NJ, USA, 2003. [Google Scholar]
  76. Thompson, S.; O’Hair, H.D. Advice-giving and the management of uncertainty for cancer survivors. Health Commun. 2008, 23, 340–348. [Google Scholar] [CrossRef]
  77. Hayes, A.F. Introduction to Mediation, Moderation, and Conditional Process Analysis: A Regression-Based Approach, 3rd ed.; Guilford Publications: New York, NY, USA, 2022. [Google Scholar]
  78. Kerr, B.; D’Angelo, J.D.; Diaz-Caballero, A.; Moreno, M.A. College student problematic internet use and digital communication medium used with parents: Cross-sectional study. JMIR Pediatr. Parent. 2020, 3, e17165. [Google Scholar] [CrossRef]
  79. Litman, L.; Rosen, Z.; Spierer, D.; Weinberger-Litman, S.; Goldschein, A.; Robinson, J. Mobile exercise apps and increased leisure time exercise activity: A moderated mediation analysis of the role of self-efficacy and barriers. J. Med. Internet Res. 2015, 17, e4142. [Google Scholar] [CrossRef]
  80. Sousa, C.V.; Fernandez, A.; Hwang, J.; Lu, A.S. The effect of narrative on physical activity via immersion during active video game play in children: Mediation analysis. J. Med. Internet Res. 2020, 22, e17994. [Google Scholar] [CrossRef]
  81. Baron, R.M.; Kenny, D.A. The moderator-mediator variable distinction in social psychological research: Conceptual, strategic, and statistical considerations. J. Pers. Soc. Psychol. 1986, 51, 1173–1182. [Google Scholar] [CrossRef]
  82. Pitardi, V.; Wirtz, J.; Paluch, S.; Kunz, W.H. Service robots, agency and embarrassing service encounters. J. Serv. Manag. 2022, 33, 389–414. [Google Scholar] [CrossRef]
  83. Sun, H.; Gu, C. Understanding determinants of end-user’s continuance intention on fitness wearable technology. Int. J. Hum.-Comput. Interact. 2022. [Google Scholar] [CrossRef]
  84. Rubin, A.M. Television uses and gratifications: The interactions of viewing patterns and motivations. J. Broadcast. 1983, 27, 37–51. [Google Scholar] [CrossRef]
  85. Rubin, A.M. Uses of daytime television soap operas by college students. J. Broadcast. Electron. Media 1985, 29, 241–258. [Google Scholar] [CrossRef]
  86. Brinker, J.; Cheruvu, V.K. Social and emotional support as a protective factor against current depression among individuals with adverse childhood experiences. Prev. Med. Rep. 2017, 5, 127–133. [Google Scholar] [CrossRef]
  87. Cabassa, L.J.; Oh, H.; Humensky, J.L.; Unger, J.B.; Molina, G.B.; Baron, M. Comparing the impact on latinos of a depression brochure and an entertainment-education depression fotonovela. Psychiatr. Serv. 2015, 66, 313–316. [Google Scholar] [CrossRef] [Green Version]
  88. Gonzalez, F.; Benuto, L.T. ¡Yo no Estoy Loca! a behavioral health telenovela style entertainment education video: Increasing mental health literacy among Latinas. Community Ment. Health J. 2022, 58, 850–861. [Google Scholar] [CrossRef]
  89. Dixon De Silva, L.E. Entertainment Education for Depression in Latin Adults: Testing Mediators and Moderators of a Culture-Centric Narrative Intervention to Promote Help-Seeking Behavior. Ph.D. Dissertation, University of California, Los Angeles, CA, USA, 2021. [Google Scholar]
  90. Kim, Y.; Hong, S.; Choi, M. Effects of serious games on depression in older adults: Systematic review and meta-analysis of randomized controlled trials. J. Med. Internet Res. 2022, 24, e37753. [Google Scholar] [CrossRef]
  91. Ruiz, M.; Moreno, M.; Girela-Serrano, B.; Díaz-Oliván, I.; Muñoz, L.J.; González-Garrido, C.; Porras-Segovia, A. Winning the game against depression: A systematic review of video games for the treatment of depressive disorders. Curr. Psychiatry Rep. 2022, 24, 23–35. [Google Scholar] [CrossRef] [PubMed]
  92. Carroll, J.K.; Moorhead, A.; Bond, R.; LeBlanc, W.G.; Petrella, R.J.; Fiscella, K. Who uses mobile phone health apps and does use matter? A secondary data analytics approach. J. Med. Internet Res. 2017, 19, e125. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  93. Kontos, E.; Blake, K.D.; Chou, W.-Y.S.; Prestin, A. Predictors of eHealth usage: Insights on the digital divide from the Health Information National Trends Survey 2012. J. Med. Internet Res. 2014, 16, e172. [Google Scholar] [CrossRef] [PubMed]
  94. Tennant, B.; Stellefson, M.; Dodd, V.; Chaney, B.; Chaney, D.; Paige, S.; Alber, J. eHealth literacy and Web 2.0 health information seeking behaviors among baby boomers and older adults. J. Med. Internet Res. 2015, 17, e70. [Google Scholar] [CrossRef]
  95. Chen, B.; Liu, F.; Ding, S.; Ying, X.; Wang, L.; Wen, Y. Gender differences in factors associated with smartphone addiction: A cross-sectional study among medical college students. BMC Psychiatry 2017, 17, 341. [Google Scholar] [CrossRef] [Green Version]
  96. Emslie, C.; Ridge, D.; Ziebland, S.; Hunt, K. Exploring men’s and women’s experiences of depression and engagement with health professionals: More similarities than differences? A qualitative interview study. BMC Fam. Pract. 2007, 8, 43. [Google Scholar] [CrossRef] [Green Version]
  97. Moradbakhti, L.; Schreibelmayr, S.; Mara, M. Do men have no need for “feminist” artificial intelligence? Agentic and gendered voice assistants in the light of basic psychological needs. Front. Psychol. 2022, 13, 855091. [Google Scholar] [CrossRef]
  98. Toader, D.-C.; Boca, G.; Toader, R.; Măcelaru, M.; Toader, C.; Ighian, D.; Rădulescu, A.T. The effect of social presence and chatbot errors on trust. Sustainability 2020, 12, 256. [Google Scholar] [CrossRef] [Green Version]
  99. Fuller-Tyszkiewicz, M.; Richardson, B.; Klein, B.; Skouteris, H.; Christensen, H.; Austin, D.; Castle, D.; Mihalopoulos, C.; O’Donnell, R.; Arulkadacham, L.; et al. A mobile app–based intervention for depression: End-user and expert usability testing study. JMIR Ment. Health 2018, 5, e54. [Google Scholar] [CrossRef] [Green Version]
  100. Goodwin, J.; Cummins, J.; Behan, L.; O’Brien, S.M. Development of a mental health smartphone app: Perspectives of mental health service users. J. Ment. Health 2016, 25, 434–440. [Google Scholar] [CrossRef]
  101. Park, D.Y.; Goering, E.M.; Head, K.J.; Bartlett Ellis, R.J. Implications for training on smartphone medication reminder app use by adults with chronic conditions: Pilot study applying the technology acceptance model. JMIR Form. Res. 2017, 1, e5. [Google Scholar] [CrossRef] [Green Version]
  102. Park, D.Y. A Theory-Based mHealth Intervention to Improve Medication Adherence by Adults with Chronic Conditions: Technology Acceptance Model-Based Smartphone Medication Reminder App Training Session. Ph.D. dissertation, Indiana University, Bloomington, IN, USA.
  103. Lee, S.; Jeon, Y.; Yoon, M.-S. Dual mediating effects of changes in daily life and anxiety on the relationship between occupation and depression in Korea during the COVID-19 pandemic. BMC Public Health 2022, 22, 1492. [Google Scholar] [CrossRef]
  104. Turvey, C.L.; Jogerst, G.; Kim, M.Y.; Frolova, E. Cultural differences in depression-related stigma in late-life: A comparison between the USA, Russia, and South Korea. Int. Psychogeriatr. 2012, 24, 1642–1647. [Google Scholar] [CrossRef]
  105. Park, K.H.; Kim, H.; Kim, J. Moderating effect of mindfulness on the influence of stress on depression according to the level of stress among university students in South Korea. Int. J. Environ. Res. Public Health 2020, 17, 6634. [Google Scholar] [CrossRef]
  106. Pflanz, S.E.; Ogle, A.D. Job stress, depression, work performance, and perceptions of supervisors in military personnel. Mil. Med. 2006, 171, 861–865. [Google Scholar] [CrossRef] [Green Version]
  107. Onyeaka, H.; Firth, J.; Enemuo, V.; Muoghalu, C.; Naslund, J.; Baiden, P.; Torous, J. Exploring the association between electronic wearable device use and levels of physical activity among individuals with depression and anxiety: A population level study. Front. Digit. Health 2021, 3, 707900. [Google Scholar] [CrossRef]
  108. Onyeaka, H.; Firth, J.; Kessler, R.C.; Lovell, K.; Torous, J. Use of smartphones, mobile apps and wearables for health promotion by people with anxiety or depression: An analysis of a nationally representative survey data. Psychiatry Res. 2021, 304, 114120. [Google Scholar] [CrossRef]
  109. Ajzen, I. From intentions to actions: A theory of planned behavior. In Action Control: From Cognition to Behavior; Kuhl, J., Beckmann, J., Eds.; Springer-Verlag: Berlin/Heidelberg, Germany, 1985; pp. 11–39. [Google Scholar]
  110. Klein, R. Internet-based patient-physician electronic communication applications: Patient acceptance and trust. E-Serv. J. 2007, 5, 27–52. [Google Scholar] [CrossRef]
  111. Sicotte, C.; Taylor, L.; Tamblyn, R. Predicting the use of electronic prescribing among early adopters in primary care. Can. Fam. Physician 2013, 59, e312–e321. [Google Scholar]
  112. Amagai, S.; Pila, S.; Kaat, A.J.; Nowinski, C.J.; Gershon, R.C. Challenges in participant engagement and retention using mobile health apps: Literature review. J. Med. Internet Res. 2022, 24, e35120. [Google Scholar] [CrossRef]
  113. Daniore, P.; Nittas, V.; von Wyl, V. Enrollment and retention of participants in remote digital health studies: A scoping review and framework proposal. J. Med. Internet Res. 2022, 24, e39910. [Google Scholar] [CrossRef] [PubMed]
  114. Wang, T.; Wang, W.; Liang, J.; Nuo, M.; Wen, Q.; Wei, W.; Han, H.; Lei, J. Identifying major impact factors affecting the continuance intention of mHealth: A systematic review and multi-subgroup meta-analysis. Npj Digit. Med. 2022, 5, 145. [Google Scholar] [CrossRef] [PubMed]
Figure 1. Screenshot of MyMentalPocket (left: Pocky, the AI chatbot; right: wellness game content).
Figure 1. Screenshot of MyMentalPocket (left: Pocky, the AI chatbot; right: wellness game content).
Sustainability 15 00872 g001
Figure 2. Results of hierarchical regression analyses.
Figure 2. Results of hierarchical regression analyses.
Sustainability 15 00872 g002
Table 1. Regression models explaining intentions to use MyMentalPocket.
Table 1. Regression models explaining intentions to use MyMentalPocket.
Intentions to Use
VariableStep 1Step 2Step 3
Gender0.14 *0.14 *0.03
Age−0.19 **−0.17 **−0.02
Depression0.040.080.10 *
Communication and emotional support motive 0.140.06
Information- and guidance-seeking motive 0.15 *−0.01
Habitual entertainment-seeking motive 0.14−0.01
Escape motive 0.010.02
Perceived usefulness 0.37 ***
Perceived ease of use 0.06
Parasocial interactions 0.46 ***
R20.060.140.66
R2 0.08 ***0.52 ***
Note. * p < 0.05. ** p < 0.01. *** p < 0.001.
Table 2. Regression models explaining perceived usefulness.
Table 2. Regression models explaining perceived usefulness.
Perceived Usefulness
VariableStep 1Step 2Step 3
Gender0.090.08−0.06
Age−0.19 **−0.18 **−0.02
Depression−0.06−0.030.00
Communication and emotional support motive 0.05−0.01
Information- and guidance-seeking motive 0.21 **0.09
Habitual entertainment-seeking motive 0.11−0.04
Escape motive 0.010.01
Perceived ease of use 0.22 ***
Parasocial interactions 0.64 ***
R20.050.120.57
R2 0.07 **0.45 ***
Note. ** p < 0.01. *** p < 0.001.
Table 3. Regression models explaining parasocial interactions.
Table 3. Regression models explaining parasocial interactions.
Parasocial Interactions
VariableStep 1Step 2
Gender0.19 **0.18 **
Age−0.18 **−0.16 **
Depression−0.08−0.03
Communication and emotional support motive 0.16 *
Information- and guidance-seeking motive 0.14 *
Habitual entertainment-seeking motive 0.22 **
Escape motive −0.04
R20.080.18
R2 0.10 ***
Note. * p < 0.05. ** p < 0.01. *** p < 0.001.
Table 4. Results of mediation analyses.
Table 4. Results of mediation analyses.
PathwaysIndirect EffectBoot SEBoot LLCIBoot ULCI
PEOU PU IU0.380.060.260.50
CES PSI PU IU0.070.020.030.12
IGS PSI PU IU0.070.020.020.12
HES PSI PU IU0.070.020.030.11
GEN PSI PU IU0.090.030.030.17
AGE PSI PU IU–0.010.00–0.02–0.01
Note. CES = Communication and Emotional Support Motive. GEN = Gender. HES = Habitual Entertainment-Seeking Motive. IGS = Information- and Guidance-Seeking Motive. IU = Intentions to Use. PEOU = Perceived Ease of Use. PSI = Parasocial Interactions. PU = Perceived Usefulness.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Park, D.Y.; Kim, H. Determinants of Intentions to Use Digital Mental Healthcare Content among University Students, Faculty, and Staff: Motivation, Perceived Usefulness, Perceived Ease of Use, and Parasocial Interaction with AI Chatbot. Sustainability 2023, 15, 872. https://doi.org/10.3390/su15010872

AMA Style

Park DY, Kim H. Determinants of Intentions to Use Digital Mental Healthcare Content among University Students, Faculty, and Staff: Motivation, Perceived Usefulness, Perceived Ease of Use, and Parasocial Interaction with AI Chatbot. Sustainability. 2023; 15(1):872. https://doi.org/10.3390/su15010872

Chicago/Turabian Style

Park, Daniel Y., and Hyungsook Kim. 2023. "Determinants of Intentions to Use Digital Mental Healthcare Content among University Students, Faculty, and Staff: Motivation, Perceived Usefulness, Perceived Ease of Use, and Parasocial Interaction with AI Chatbot" Sustainability 15, no. 1: 872. https://doi.org/10.3390/su15010872

APA Style

Park, D. Y., & Kim, H. (2023). Determinants of Intentions to Use Digital Mental Healthcare Content among University Students, Faculty, and Staff: Motivation, Perceived Usefulness, Perceived Ease of Use, and Parasocial Interaction with AI Chatbot. Sustainability, 15(1), 872. https://doi.org/10.3390/su15010872

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop