Development of an Empathy-Centric Counseling Chatbot System Capable of Sentimental Dialogue Analysis
Abstract
:1. Introduction
2. Literature Review
2.1. Psychotherapy
2.2. Immersive Technology: AR/VR
2.3. Related Chatbot Applications
3. Methodology
3.1. Module 1: Questionnaire Design
3.2. Module 2: Empathy-Centric Counseling Chatbot
3.2.1. Empathy-Centric Psychological Knowledge
3.2.2. Chatbot Technology and Implementation
3.2.3. Issues and Sentiments of Questions’ Classification
- Define problem
- Build dataset
- Train model
- Evaluate model
3.3. Module 3: Avatar-Based Chatroom Joined by a Counselor and Student(s)
3.4. System Verification
4. System Architecture and Case Demonstration
5. Data Analysis and Discussion
5.1. Questionnaire Result
5.2. Discussion of Experiment Outcome
6. Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Conflicts of Interest
References
- Cohen, M. Student Guide to Surviving Stress and Anxiety in College & Beyond. Available online: https://www.learnpsychology.org/student-stress-anxiety-guide/ (accessed on 10 May 2021).
- Ye, Y.X.; Dai, Y.J.; Xie, B.T.; Jian, D.K. Survey of Life Changes and Mood during the COVID-19 Epidemic. Available online: http://www.etmh.org/CustomPage/HtmlEditorPage.aspx?MId=1346&ML=3 (accessed on 20 May 2021).
- Lin, A.P.; Trappey, C.V.; Luan, C.-C.; Trappey, A.J.; Tu, K.L. A Test Platform for Managing School Stress Using a Virtual Reality Group Chatbot Counseling System. Appl. Sci. 2021, 11, 9071. [Google Scholar] [CrossRef]
- APA. Different Approaches to Psychotherapy. Available online: https://www.apa.org/topics/psychotherapy/approaches (accessed on 8 November 2021).
- Summers, R.F.; Barber, J.P. Psychodynamic Therapy: A Guide to Evidence-Based Practice; Guilford Press: New York, NY, USA, 2010. [Google Scholar]
- Wolpe, J. The Practice of Behavior Therapy; Pergamon Press: Oxford, UK, 1990. [Google Scholar]
- Beck, A.T.; Weishaar, M. Cognitive therapy. In Comprehensive Handbook of Cognitive Therapy; Springer: Berlin/Heidelberg, Germany, 1989; pp. 21–36. [Google Scholar]
- Raskin, N.J.; Rogers, C.R. Person-Centered Therapy; American Psychological Association: Washington, DC, USA, 2005. [Google Scholar]
- Craske, M.G.; Meuret, A.E.; Ritz, T.; Treanor, M.; Dour, H.J. Treatment for anhedonia: A neuroscience driven approach. Depress. Anxiety 2016, 33, 927–938. [Google Scholar] [CrossRef] [PubMed]
- Byrd, D.R.; McKinney, K.J. Individual, Interpersonal, and Institutional Level Factors Associated With the Mental Health of College Students. J. Am. Coll. Health 2012, 60, 185–193. [Google Scholar] [CrossRef] [PubMed]
- Diener, E.; Emmons, R.A.; Larsen, R.J.; Griffin, S. The satisfaction with life scale. J. Personal. Assess. 1985, 49, 71–75. [Google Scholar] [CrossRef]
- Feldt, R.C. Development of a brief measure of college stress: The college student stress scale. Psychol. Rep. 2008, 102, 855–860. [Google Scholar] [CrossRef]
- Weinstein, L.; Laverghetta, A. College student stress and satisfaction with life. Coll. Stud. J. 2009, 43, 1161–1162. [Google Scholar]
- Karyotaki, E.; Cuijpers, P.; Albor, Y.; Alonso, J.; Auerbach, R.P.; Bantjes, J.; Bruffaerts, R.; Ebert, D.D.; Hasking, P.; Kiekens, G. Sources of stress and their associations with mental disorders among college students: Results of the world health organization world mental health surveys international college student initiative. Front. Psychol. 2020, 11, 1759. [Google Scholar] [CrossRef]
- Tonacci, A.; Dellabate, A.; Dieni, A.; Bachi, L.; Sansone, F.; Conte, R.; Billeci, L. Can Machine Learning Predict Stress Reduction Based on Wearable Sensors’ Data Following Relaxation at Workplace? A Pilot Study. Processes 2020, 8, 448. [Google Scholar] [CrossRef]
- Ratanasiripong, P.; Sverduk, K.; Prince, J.; Hayashino, D. Biofeedback and counseling for stress and anxiety among college students. J. Coll. Stud. Dev. 2012, 53, 742–749. [Google Scholar] [CrossRef]
- Wyner, D.R. Pilot study of a university counseling center stress management program employing mindfulness and compassion-based relaxation training with biofeedback. Biofeedback 2015, 43, 121–128. [Google Scholar] [CrossRef]
- Milligan, C.K. Yoga for stress management program as a complementary alternative counseling resource in a university counseling center. J. Coll. Couns. 2006, 9, 181–187. [Google Scholar] [CrossRef]
- Lee, D.; Olson, E.A.; Locke, B.; Michelson, S.T.; Odes, E. The effects of college counseling services on academic performance and retention. J. Coll. Stud. Dev. 2009, 50, 305–319. [Google Scholar] [CrossRef]
- Wilson, S.B.; Mason, T.W.; Ewing, M.J. Evaluating the impact of receiving university-based counseling services on student retention. J. Couns. Psychol. 1997, 44, 316. [Google Scholar] [CrossRef]
- Persky, S. Employing immersive virtual environments for innovative experiments in health care communication. Patient Educ. Couns. 2011, 82, 313–317. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Zhang, Q.; Karunanithi, M.; Kang, C. Immersive Augmented Reality (I Am Real)—Remote Clinical Consultation. In Proceedings of the 2019 IEEE EMBS International Conference on Biomedical & Health Informatics (BHI), Chicago, IL, USA, 19–22 May 2019; pp. 1–4. [Google Scholar] [CrossRef]
- Trappey, A.; Trappey, C.V.; Chang, C.-M.; Tsai, M.-C.; Kuo, R.R.; Lin, A.P. Virtual reality exposure therapy for driving phobia disorder (2): System refinement and verification. Appl. Sci. 2021, 11, 347. [Google Scholar] [CrossRef]
- Czech, O.; Wrzeciono, A.; Rutkowska, A.; Guzik, A.; Kiper, P.; Rutkowski, S. Virtual Reality Interventions for Needle-Related Procedural Pain, Fear and Anxiety—A Systematic Review and Meta-Analysis. J. Clin. Med. 2021, 10, 3248. [Google Scholar] [CrossRef]
- Piech, J.; Czernicki, K. Virtual Reality Rehabilitation and Exergames—Physical and Psychological Impact on Fall Prevention among the Elderly—A Literature Review. Appl. Sci. 2021, 11, 4098. [Google Scholar] [CrossRef]
- Darcy, A.; Daniels, J.; Salinger, D.; Wicks, P.; Robinson, A. Evidence of Human-Level Bonds Established With a Digital Conversational Agent: Cross-sectional, Retrospective Observational Study. JMIR Form. Res. 2021, 5, e27868. [Google Scholar] [CrossRef]
- Fitzpatrick, K.K.; Darcy, A.; Vierhile, M. Delivering Cognitive Behavior Therapy to Young Adults With Symptoms of Depression and Anxiety Using a Fully Automated Conversational Agent (Woebot): A Randomized Controlled Trial. JMIR Ment. Health 2017, 4, e19. [Google Scholar] [CrossRef]
- Minjeong, K. A Study of Chatbot Personality based on the Purposes of Chatbot. J. Korea Contents Assoc. 2018, 18, 319–329. [Google Scholar]
- Yin, J.; Chen, Z.; Zhou, K.; Yu, C. A Deep Learning Based Chatbot for Campus Psychological Therapy. arXiv 2019, arXiv:1910.06707. [Google Scholar]
- Tsaramirsis, G.; Buhari, S.M.; Al-Shammari, K.O.; Ghazi, S.; Nazmudeen, M.S.; Tsaramirsis, K. Towards simulation of the classroom learning experience: Virtual reality approach. In Proceedings of the 2016 3rd International Conference on Computing for Sustainable Global Development (INDIACom), New Delhi, India, 16–18 March 2016; pp. 1343–1346. [Google Scholar]
- Stanica, I.; Dascalu, M.; Bodea, C.N.; Moldoveanu, A.D.B. VR Job Interview Simulator: Where Virtual Reality Meets Artificial Intelligence for Education. In Proceedings of the 2018 Zooming Innovation in Consumer Technologies Conference (ZINC), Novi Sad, Serbia, 30–31 May 2018; pp. 9–12. [Google Scholar]
- Department of Health, The Government of the Hong Kong Administrative Region. Psychosocial Health. Available online: https://www.studenthealth.gov.hk/tc_chi/health/health_ph/health_ph_stress.html (accessed on 21 April 2022).
- Schneiderman, N.; Ironson, G.; Siegel, S.D. Stress and health: Psychological, behavioral, and biological determinants. Annu. Rev. Clin. Psychol. 2005, 1, 607–628. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Scott, S.B.; Graham-Engeland, J.E.; Engeland, C.G.; Smyth, J.M.; Almeida, D.M.; Katz, M.J.; Lipton, R.B.; Mogle, J.A.; Munoz, E.; Ram, N.; et al. The Effects of Stress on Cognitive Aging, Physiology and Emotion (ESCAPE) Project. BMC Psychiatry 2015, 15, 146. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Marks, H. Stress Symptoms. Available online: https://www.webmd.com/balance/stress-management/stress-symptoms-effects_of-stress-on-the-body (accessed on 21 April 2022).
- Fan, H.-C. Explanation of Fan’s Stress Scale. Wu-Nan Book Inc. (Publisher): Taipei, Taiwan. Available online: http://ocw.lib.ntnu.edu.tw/course/view.php?id=276 (accessed on 21 April 2022).
- Friedman, W.J. Types of Stress and Their Symptoms. Available online: https://www.mentalhelp.net/blogs/types-of-stress-and-their-symptoms/ (accessed on 21 April 2022).
- QuestionPro. 18 Student Stress Survey Questions For Questionnaire + Template. Available online: https://www.questionpro.com/survey-templates/student-stress/ (accessed on 13 April 2021).
- Corey, G. Theories and Practice of Counseling & Psychotherapy, 10th ed.; Brooks/Cole: Salt Lake City, UT, USA, 2020. [Google Scholar]
- Ho, P.C.-C.; Lin, Y.-H. Theory and Practice of Counseling and Psychotherapy; Wu-Nan Book Inc. (Publisher): Tappei, Taiwan, 2013. [Google Scholar]
- Cloud Computing Services. Available online: https://cloud.google.com/ (accessed on 19 April 2022).
- Automatic Speech Recognition. Available online: https://cloud.google.com/speech-to-text (accessed on 19 April 2022).
- Lifelike Speech Synthesis. Available online: https://cloud.google.com/text-to-speech (accessed on 19 April 2022).
- RASA. Available online: https://rasa.com/ (accessed on 19 April 2022).
- Industrial-Strength Natural Language Processing IN PYTHON. Available online: https://spacy.io/ (accessed on 19 April 2022).
- CounselChat. Available online: https://counselchat.com/ (accessed on 28 November 2021).
- Bertagnolli, N. Counsel Chat: Bootstrapping High-Quality Therapy Data. Available online: https://towardsdatascience.com/counsel-chat-bootstrapping-high-quality-therapy-data-971b419f33da (accessed on 8 August 2021).
- NRC Word-Emotion Association Lexicon. Available online: https://saifmohammad.com/WebPages/NRC-Emotion-Lexicon.htm (accessed on 8 August 2021).
- Khodarahimi, S.; Rasti, A.; Khajehie, M.; Sattar, R. Students’ Mental Health: Personal and University Determinants. Online Submiss. 2009, 6, 31–38. [Google Scholar]
- Pekrun, R.; Goetz, T.; Perry, R.P. Achievement Emotions Questionnaire (AEQ). User’s Manual; Unpublished Manuscript; University of Munich: Munich, Germany, 2005. [Google Scholar]
- Russell, J.A. A circumplex model of affect. J. Personal. Soc. Psychol. 1980, 39, 1161. [Google Scholar] [CrossRef]
- Liu, Z.; Xu, A.; Guo, Y.; Mahmud, J.; Liu, H.; Akkiraju, R. Seemo: A Computational Approach to See Emotions. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, Montreal, QC, Canada, 21–27 April 2018; pp. 1–12. [Google Scholar] [CrossRef]
- Iacobucci, D.; Posavac, S.S.; Kardes, F.R.; Schneider, M.J.; Popovich, D.L. The median split: Robust, refined, and revived. J. Consum. Psychol. 2015, 25, 690–704. [Google Scholar] [CrossRef]
- Chen, P.-H. Effectiveness of Counseling Skill Training and Relationships Amon Level of Counseling Skill, Helpee’s Self-engagement and Counseling Outcome. Bull. Educ. Psychol. 1991, 24, 117–143. [Google Scholar]
- Orlinsky, D.E.; Howard, K.J. Process and outcome in psychotherapy. In Handbook of Psychotherapy and Behavior Change; John Wiley & Sons, Inc: Hoboken, NJ, USA, 1986. [Google Scholar]
- Barlow, D. Anxiety and Its Disorders: The Nature and Treatment of Anxiety and Panic, 2nd ed.; Guilford Press: New York, NY, USA, 2002. [Google Scholar]
- Lorenz, T.K. Predictors and impact of psychotherapy side effects in young adults. Couns. Psychother. Res. 2021, 21, 237–243. [Google Scholar] [CrossRef]
- Iacovelli, A.M.; Johnson, C. Disclosure through face-to-face and instant messaging modalities: Psychological and physiological effects. J. Soc. Clin. Psychol. 2012, 31, 225–250. [Google Scholar] [CrossRef]
- Kim, H.C.; Cha, M.C.; Ji, Y.G. The Impact of an Agent’s Voice in Psychological Counseling: Session Evaluation and Counselor Rating. Appl. Sci. 2021, 11, 2893. [Google Scholar] [CrossRef]
- Spek, V.; Nyklíček, I.; Cuijpers, P.; Pop, V. Predictors of outcome of group and internet-based cognitive behavior therapy. J. Affect. Disord. 2008, 105, 137–145. [Google Scholar] [CrossRef] [PubMed]
Referred Studies | Types of Sentiments in Descriptive Terms |
---|---|
NRC [48] | Anger, anticipation, disgust, fear, joy, sadness, surprise, trust. |
PANAS [49] | Distress, upset, hostile, irritable, scared, jittery, afraid, ashamed, guilty, nervous. |
AEQ [50] | Anger, anxiety, hopelessness, shame, and boredom |
Our research | Anger, anxiety (fear, scared, jittery, nervous), hopelessness, shame, upset (sadness), distress, guilty, boredom, indifference |
Attributes | Variables | # of Participants | Percentage | Mean | S.D. | Min | Max |
---|---|---|---|---|---|---|---|
Age | - | 34 | 100.00 | 22.76 | 1.5775 | 20 | 26 |
Sex | Male | 17 | 50.00 | ||||
Female | 17 | 50.00 | |||||
Year | Undergraduate (2nd) | 2 | 5.88 | ||||
Undergraduate (3rd) | 2 | 5.88 | |||||
Undergraduate (4th) | 6 | 17.65 | |||||
Graduate (1st) | 14 | 41.18 | |||||
Graduate (2nd) | 7 | 20.59 | |||||
Doctorate | 3 | 8.82 | |||||
Major/Department | Industrial engineering | 25 | 73.53 | ||||
Technology management | 2 | 5.88 | |||||
Chemical engineering | 1 | 2.94 | |||||
Electronics | 1 | 2.94 | |||||
Economics | 1 | 2.94 | |||||
Engineering sys science | 1 | 2.94 | |||||
Early childhood education | 1 | 2.94 | |||||
Computer science | 1 | 2.94 | |||||
Others | 1 | 2.94 | |||||
Stress level | 6 | 17 | 50.00 | ||||
7 | 16 | 47.06 | |||||
8 | 2 | 5.88 |
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations. |
© 2022 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Trappey, A.J.C.; Lin, A.P.C.; Hsu, K.Y.K.; Trappey, C.V.; Tu, K.L.K. Development of an Empathy-Centric Counseling Chatbot System Capable of Sentimental Dialogue Analysis. Processes 2022, 10, 930. https://doi.org/10.3390/pr10050930
Trappey AJC, Lin APC, Hsu KYK, Trappey CV, Tu KLK. Development of an Empathy-Centric Counseling Chatbot System Capable of Sentimental Dialogue Analysis. Processes. 2022; 10(5):930. https://doi.org/10.3390/pr10050930
Chicago/Turabian StyleTrappey, Amy J. C., Aislyn P. C. Lin, Kevin Y. K. Hsu, Charles V. Trappey, and Kevin L. K. Tu. 2022. "Development of an Empathy-Centric Counseling Chatbot System Capable of Sentimental Dialogue Analysis" Processes 10, no. 5: 930. https://doi.org/10.3390/pr10050930