Next Article in Journal
The Implementation of the Physical Unclonable Function in a Field-Programmable Gate Array for Enhancing Hardware Security
Previous Article in Journal
Educational Effectiveness of Using Big Data Based and Its Evaluation with Cluster Analysis and Qualification Framework in Financial Services and Management
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Proceeding Paper

vFerryman: An Artificial Intelligence-Driven Personalized Companion Providing Calming Visuals and Social Interaction for Emotional Well-Being †

Graduate Institute of Networking and Multimedia, National Taiwan University, Taipei 10617, Taiwan
Presented at the 2024 IEEE 6th Eurasia Conference on IoT, Communication and Engineering, Yunlin, Taiwan, 15–17 November 2024.
Eng. Proc. 2025, 92(1), 22; https://doi.org/10.3390/engproc2025092022
Published: 26 April 2025
(This article belongs to the Proceedings of 2024 IEEE 6th Eurasia Conference on IoT, Communication and Engineering)

Abstract

:
As awareness of mental health issues grows, there is an increasing demand for innovative tools that provide personalized emotional support. By introducing vFerryman, an AI-driven companion system was designed to enhance emotional well-being in this study. The system integrates advanced natural language processing and machine learning technologies into the CrewAI framework. Multiple AI agents were used to deliver personalized, real-time emotional responses. By utilizing large language model operations (LLMOps), vFerryman optimizes the performance of large language models to dynamically adapt to users’ emotional feedback. A key feature of the system is its calming aquarium module, which offers a soothing visual environment to alleviate stress and anxiety. Additionally, vFerryman includes a social interaction platform that fosters emotional connections and shared experiences among users. The effectiveness of vFerryman in improving emotional well-being and facilitating social interaction was evaluated while identifying areas for further technical enhancement and practical applications in emotional support systems.

1. Introduction

Recent research has demonstrated the effectiveness of AI-driven chatbots in supporting emotional self-management and mental health interventions [1]. Drawing from this foundation, the vFerryman system is inspired by the metaphor from the movie See You Tomorrow: “Life’s struggles can be likened to a boat, constantly rising and falling with the tides. The ferryman’s role is to guide you to solid ground, helping you navigate through the turbulence” [2]. vFerryman is designed to function as an “emotional ferryman”, providing a reliable and comforting presence that guides users through emotional turbulence and help them find balance and stability. To achieve this, vFerryman integrates advanced technologies, including large language model operations (LLMOps), to efficiently manage and optimize the large language models (LLMs) that drive personalized user interactions. This enables the system to dynamically adjust its responses in real time based on emotional feedback. Additionally, vFerryman leverages a CrewAI framework, which seamlessly integrates multiple AI agents, each responsible for distinct emotional support functions, building upon recent advances in AI-driven chatbot platforms [3,4,5]. This multi-agent approach allows the system to provide a holistic emotional care experience, addressing various aspects of a user’s emotional state and preferences.
The system integrates a calming virtual aquarium and a secure social platform to foster emotional connections and create a supportive space for users to share their experiences. These features encourage community engagement and mutual support, contributing to emotional well-being. By incorporating AI-driven techniques, vFerryman enhances personalized care, improving user engagement and the effectiveness of emotional support. With AI technologies playing a growing role in mental health applications, they enable adaptive interventions and customized emotional assistance [6,7,8,9,10,11,12,13]. Building on these advancements, vFerryman improves its responsiveness and interaction, creating a more adaptive and intelligent support system.

2. vFerryman System

vFerryman is a multifunctional emotional support system developed to address diverse mental health needs through advanced AI technologies. The system incorporates modules that work collaboratively to provide comprehensive emotional support while cultivating a nurturing community environment. Each module contributes uniquely to the system’s overall functionality, creating a cohesive and holistic experience for users.
At the center of the vFerryman system is an intelligent emotional support engine that utilizes sophisticated natural language processing (NLP) and machine learning (ML) techniques to deliver a highly personalized and adaptive user experience. By employing semantic analysis and sentiment detection, the NLP component generates contextually appropriate emotional responses. Simultaneously, methodologies from LLMOps optimize LLMs for real-time interactions [14,15,16,17], enabling the system to dynamically adjust based on user feedback and significantly enhance its empathetic capabilities. The ML component continuously refines the system’s responses by learning from user interactions, allowing for proactive emotional care. Moreover, techniques in prompt engineering improve response accuracy, ensuring that interactions remain relevant and empathetic. Within the CrewAI framework, multiple AI agents collaborate to deliver comprehensive emotional support [18,19,20], ultimately enhancing user engagement and overall well-being.
In addition to the emotional support engine, the vFerryman system features two innovative modules specifically designed to promote emotional well-being: the therapeutic aquarium module and the social interaction platform. The therapeutic aquarium module simulates calming aquatic environments, incorporating digital representations of water, marine life, and natural sounds. Interacting with these virtual elements effectively alleviates stress and anxiety. Users can personalize their experiences by selecting from various scenes and sounds, which enhances the calming effects and supports effective stress management. Meanwhile, the social interaction platform module provides a secure space for users to connect with others facing similar emotional challenges. This platform allows for anonymous sharing and interactions under real identities, fostering trust and empathy among users. It supports various forms of engagement, including group discussions and peer networks, to reduce feelings of isolation and cultivate a supportive community essential for emotional health. The design of these agents follows recent developments in agent architecture and user-task coordination frameworks [21,22,23]. The components collectively provide a comprehensive approach to mental health support, integrating soothing sensory experiences with meaningful social interactions.
The vFerryman system integrates its modules to provide a unified user experience through multimodal interactions, enabling real-time communication for continuous analysis and autonomous responses to user needs. By implementing LLMOps methodologies, the system enhances the adaptability of LLMs, while the CrewAI framework facilitates effective coordination among AI agents, each responsible for different components of emotional support. This integration allows the system to dynamically respond to users’ evolving emotional states. As illustrated in Figure 1, the intuitive user interface ensures accessibility for all users, combining advanced AI capabilities with a user-friendly design to improve overall satisfaction.

3. Conclusions

vFerryman, an AI-driven emotional support system, demonstrates significant potential for improving emotional well-being and fostering positive social interactions by integrating NLP, ML, LLMOps, a therapeutic aquarium, and a social interaction platform. The CrewAI framework enables real-time collaboration among AI agents, allowing the system to adapt dynamically to users’ emotional states and evolving needs. However, challenges remain in optimizing the system to accommodate users from diverse linguistic and cultural backgrounds. Long-term studies are required to confirm its effectiveness and ensure that it meets the diverse needs of its users.

4. Future Outlook

Future enhancements to vFerryman will focus on improving emotion recognition, expanding language adaptability, integrating healthcare-related technologies, and optimizing scalability to enhance its role in emotional support. Enhancing multimodal emotion analysis will enable more responsive and adaptive interactions. Expanding language processing and cultural adaptation will improve accessibility, ensuring a more inclusive experience for diverse users. To support scalability and efficiency, implementing DataOps methodologies and utilizing MLflow for optimization will refine resource allocation and system performance, maintaining stability under varying conditions. These advancements will further establish vFerryman as a versatile and adaptive digital companion, contributing to personalized mental health support in evolving digital environments.

Funding

This research received no external funding.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

The data are not publicly available due to course-related restrictions.

Acknowledgments

This paper is based on further research from the final project prototype developed in the ‘Virtual Human and Telepresence’ course offered by the College of Electrical Engineering and Computer Science, NTU.

Conflicts of Interest

The author declares no conflict of interest.

References

  1. Martinengo, L.; Lum, E.; Car, J. Evaluation of chatbot-delivered interventions for self-management of depression: Content analysis. J. Affect. Disord. 2022, 319, 598–607. [Google Scholar] [CrossRef] [PubMed]
  2. Zhang, J.J. See You Tomorrow [Film]; Alibaba Pictures: Shanghai, China, 2016. [Google Scholar]
  3. Amazon. Amazon Sumerian. Amazon Web Services. Available online: https://aws.amazon.com/sumerian/ (accessed on 13 November 2024).
  4. Babylon.js. Welcome to Babylon.js 5.0. Available online: https://www.babylonjs.com/ (accessed on 13 November 2024).
  5. Aggarwal, A.; Tam, C.C.; Wu, D.; Li, X.; Qiao, S. Artificial intelligence–based chatbots for promoting health behavioral changes: Systematic review. J. Med. Internet Res. 2023, 25, e40789. [Google Scholar] [CrossRef] [PubMed]
  6. Boucher, E.M.; Harake, N.R.; Ward, H.E.; Stoeckl, S.E.; Vargas, J.; Minkel, J.; Zilca, R. Artificially intelligent chatbots in digital mental health interventions: A review. Expert Rev. Med. Devices 2021, 18 (Suppl. 1), 37–49. [Google Scholar] [CrossRef] [PubMed]
  7. Omarov, B.; Narynov, S.; Zhumanov, Z. Artificial Intelligence-Enabled Chatbots in Mental Health: A Systematic Review. Comput. Mater. Contin. 2023, 74, 5105–5122. [Google Scholar] [CrossRef]
  8. Bhatt, S. Digital Mental Health: Role of Artificial Intelligence in Psychotherapy. Ann. Neurosci. 2024. [Google Scholar] [CrossRef] [PubMed]
  9. Gutierrez, G.; Stephenson, C.; Eadie, J.; Asadpour, K.; Alavi, N. Examining the role of AI technology in online mental healthcare: Opportunities, challenges, and implications, a mixed-methods review. Front. Psychiatry 2024, 15, 1356773. [Google Scholar] [CrossRef] [PubMed]
  10. Minerva, F.; Giubilini, A. Is AI the future of mental healthcare? Topoi 2023, 42, 809–817. [Google Scholar] [CrossRef] [PubMed]
  11. Gamble, A. Artificial intelligence and mobile apps for mental healthcare: A social informatics perspective. Aslib J. Inf. Manag. 2020, 72, 509–523. [Google Scholar] [CrossRef]
  12. Brown, J.E.; Halpern, J. AI chatbots cannot replace human interactions in the pursuit of more inclusive mental healthcare. SSM-Mental Health 2021, 1, 100017. [Google Scholar] [CrossRef]
  13. Dakanalis, A.; Wiederhold, B.K.; Riva, G. Artificial intelligence: A game-changer for mental health care. Cyberpsychol. Behav. Soc. Netw. 2024, 27, 100–104. [Google Scholar] [CrossRef] [PubMed]
  14. Chen, T. Challenges and Opportunities in Integrating LLMs into Continuous Integration/Continuous Deployment (CI/CD) Pipelines. In Proceedings of the 2024 5th International Seminar on Artificial Intelligence, Networking and Information Technology (AINIT), Nanjing, China, 29–31 March 2024; pp. 364–367. [Google Scholar]
  15. Huang, K.; Manral, V.; Wang, W. From LLMOps to DevSecOps for GenAI. In Generative AI Security: Theories and Practices; Springer Nature: Cham, Switzerland, 2024; pp. 241–269. [Google Scholar]
  16. Diaz-De-Arcaya, J.; López-De-Armentia, J.; Miñón, R.; Ojanguren, I.L.; Torre-Bastida, A.I. Large Language Model Operations (LLMOps): Definition, Challenges, and Lifecycle Management. In Proceedings of the 2024 9th International Conference on Smart and Sustainable Technologies (SpliTech), Bol and Split, Croatia, 25–28 June 2024; pp. 1–4. [Google Scholar]
  17. Shi, C.; Liang, P.; Wu, Y.; Zhan, T.; Jin, Z. Maximizing User Experience with LLMOps-Driven Personalized Recommendation Systems. arXiv 2024, arXiv:2404.00903. [Google Scholar] [CrossRef]
  18. Berti, A.; Maatallah, M.; Jessen, U.; Sroka, M.; Ghannouchi, S.A. Re-Thinking Process Mining in the AI-Based Agents Era. arXiv 2024, arXiv:2408.07720. [Google Scholar]
  19. Pradas Gomez, A.; Panarotto, M.; Isaksson, O. Evaluation of Different Large Language Model Agent Frameworks for Design Engineering Tasks. In DS 130: Proceedings of NordDesign 2024, Reykjavik, Iceland, 12–14 August 2024; Chalmers University of Technology: Göteborg, Sweden, 2024; pp. 693–702. [Google Scholar]
  20. Liu, Z.; Yao, W.; Zhang, J.; Yang, L.; Liu, Z.; Tan, J.; Savarese, S. AgentLite: A Lightweight Library for Building and Advancing Task-Oriented LLM Agent System. arXiv 2024, arXiv:2402.15538. [Google Scholar]
  21. Wray, R.E.; Kirk, J.R.; Laird, J.E. Eliciting Problem Specifications via Large Language Models. arXiv 2024, arXiv:2405.12147. [Google Scholar]
  22. Liu, Y.; Lo, S.K.; Lu, Q.; Zhu, L.; Zhao, D.; Xu, X.; Whittle, J. Agent Design Pattern Catalogue: A Collection of Architectural Patterns for Foundation Model Based Agents. arXiv 2024, arXiv:2405.10467. [Google Scholar] [CrossRef]
  23. Wang, W.J.; Lain, W.D.; Wang, Y.S. Empowering IT Maintenance with Human-AI Collaboration for Cloud Native. In Proceedings of the 2024 IEEE 4th International Conference on Electronic Communications, Internet of Things and Big Data (ICEIB), Taipei, Taiwan, 19–21 April 2024; pp. 80–82. [Google Scholar]
Figure 1. AI companion and calming aquarium interface.
Figure 1. AI companion and calming aquarium interface.
Engproc 92 00022 g001
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Wang, W.-J. vFerryman: An Artificial Intelligence-Driven Personalized Companion Providing Calming Visuals and Social Interaction for Emotional Well-Being. Eng. Proc. 2025, 92, 22. https://doi.org/10.3390/engproc2025092022

AMA Style

Wang W-J. vFerryman: An Artificial Intelligence-Driven Personalized Companion Providing Calming Visuals and Social Interaction for Emotional Well-Being. Engineering Proceedings. 2025; 92(1):22. https://doi.org/10.3390/engproc2025092022

Chicago/Turabian Style

Wang, Wei-Ji. 2025. "vFerryman: An Artificial Intelligence-Driven Personalized Companion Providing Calming Visuals and Social Interaction for Emotional Well-Being" Engineering Proceedings 92, no. 1: 22. https://doi.org/10.3390/engproc2025092022

APA Style

Wang, W.-J. (2025). vFerryman: An Artificial Intelligence-Driven Personalized Companion Providing Calming Visuals and Social Interaction for Emotional Well-Being. Engineering Proceedings, 92(1), 22. https://doi.org/10.3390/engproc2025092022

Article Metrics

Back to TopTop