Sentiment and Storytelling: What Affect User Experience and Communication Effectiveness in Virtual Environments?
Abstract
:1. Introduction
2. Theoretical Background
2.1. Experience Economy Theory
2.2. UX Theory and Effectiveness of Communication in IVEs
2.3. Sentiment Analysis in IVEs
2.4. Research Hypotheses
3. Materials and Methods
3.1. Stimuli
3.2. Procedure
3.3. Data Processing
4. Results
4.1. Randomization Check
4.2. Results of the Sentiment Analysis
4.3. Overall Results of UX and Communication Effectiveness
5. Discussion
6. Conclusions, Limitations, Implications, and Future Work
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Conflicts of Interest
References
- Ahn, Sun Joo, Jeremy N. Bailenson, and Dooyeon Park. 2014. Short- and Long-Term Effects of Embodied Experiences in Immersive Virtual Environments on Environmental Locus of Control and Behavior. Computers in Human Behavior 39: 235–45. [Google Scholar] [CrossRef]
- Azarby, Sahand, and Arthur Rice. 2022. Understanding the Effects of Virtual Reality System Usage on Spatial Perception: The Potential Impacts of Immersive Virtual Reality on Spatial Design Decisions. Sustainability 14: 10326. [Google Scholar] [CrossRef]
- Baños, Rosa María, Cristina Botella, Azucena Garcia-Palacios, Helena Villa, Concepción Perpiñá, and Mariano Alcaniz. 2000. Presence and Reality Judgment in Virtual Environments: A Unitary Construct? Cyberpsychology and Behavior 3: 327–35. [Google Scholar] [CrossRef]
- Baños, Rosa María, Cristina Botella, Isabel Rubió, Soledad Quero, Azucena García-Palacios, and Mariano Alcañiz. 2008. Presence and Emotions in Virtual Environments: The Influence of Stereoscopy. Cyberpsychology and Behavior 11: 1–8. [Google Scholar] [CrossRef]
- Barbot, Baptiste, and James C. Kaufman. 2020. What Makes Immersive Virtual Reality the Ultimate Empathy Machine? Discerning the Underlying Mechanisms of Change. Computers in Human Behavior 111: 106431. [Google Scholar] [CrossRef]
- Barreda-Ángeles, Miguel, Sara Aleix-Guillaume, and Alexandre Pereda-Banõs. 2020. An ‘Empathy Machine’ or a ‘Just-for-the-Fun-of-It’ Machine? Effects of Immersion in Nonfiction 360-Video Stories on Empathy and Enjoyment. Cyberpsychology, Behavior, and Social Networking 23: 683–88. [Google Scholar] [CrossRef]
- Bekele, Mafkereseb Kassahun, and Erik Champion. 2019. A Comparison of Immersive Realities and Interaction Methods: Cultural Learning in Virtual Heritage. Frontiers in Robotics and AI 6: 91. [Google Scholar] [CrossRef]
- Boyle, Elizabeth A., Thomas M. Connolly, Thomas Hainey, and James M. Boyle. 2012. Engagement in Digital Entertainment Games: A Systematic Review. Computers in Human Behavior 28: 771–80. [Google Scholar] [CrossRef]
- Burdea, Grigore C., and Philippe Coiffet. 2003. Virtual Reality Technology. Hoboken: John Wiley & Sons. [Google Scholar]
- Busselle, Rick, and Helena Bilandzic. 2009. Measuring Narrative Engagement. Media Psychology 12: 321–47. [Google Scholar] [CrossRef]
- Chung, Chung Joo, Yoonjae Nam, and Michael A. Stefanone. 2012. Exploring Online News Credibility: The Relative Influence of Traditional and Technological Factors. Journal of Computer-Mediated Communication 17: 171–86. [Google Scholar] [CrossRef]
- Csikszentmihalyi, Mihaly. 1990. Flow: The Psychology of Optimal Experience. New York: Harper & Row. [Google Scholar]
- Davis, Mark H. 1983. Measuring Individual Differences in Empathy: Evidence for a Multidimensional Approach. Journal of Personality and Social Psychology 44: 113–26. [Google Scholar] [CrossRef]
- de la Peña, Nonny, Peggy Weil, Joan Llobera, Elias Giannopoulos, Ausiás Pomés, Bernhard Spanlang, Doron Friedman, Maria V. Sanchez-Vives, and Mel Slater. 2010. Immersive Journalism: Immersive Virtual Reality for the First-Person Experience of News. Presence: Teleoperators and Virtual Environments 19: 291–301. [Google Scholar] [CrossRef]
- De Luca, Valerio, Giorgia Marcantonio, Maria Cristina Barba, and Lucio Tommaso De Paolis. 2022. A Virtual Tour for the Promotion of Tourism of the City of Bari. Information 13: 339. [Google Scholar] [CrossRef]
- Felnhofer, Anna, Oswald D. Kothgassner, Mareike Schmidt, Anna Katharina Heinzle, Leon Beutl, Helmut Hlavacs, and Ilse Kryspin-Exner. 2015. Is Virtual Reality Emotionally Arousing? Investigating Five Emotion Inducing Virtual Park Scenarios. International Journal of Human Computer Studies 82: 48–56. [Google Scholar] [CrossRef]
- Giotis, Georgios, and Evangelia Papadionysiou. 2022. The Role of Managerial and Technological Innovations in the Tourism Industry: A Review of the Empirical Literature. Sustainability (Switzerland) 14: 5182. [Google Scholar] [CrossRef]
- Green, Melanie C., Timothy C. Brock, and Geoff F. Kaufman. 2004. Understanding Media Enjoyment: The Role of Transportation into Narrative Worlds. Communication Theory 14: 311–27. [Google Scholar] [CrossRef]
- Hassan, Robert. 2020. Digitality, Virtual Reality and the “Empathy Machine”. Digital Journalism 8: 195–212. [Google Scholar] [CrossRef]
- Hendriks Vettehen, Paul, Daan Wiltink, Maite Huiskamp, Gabi Schaap, and Paul Ketelaar. 2019. Taking the Full View: How Viewers Respond to 360-Degree Video News. Computers in Human Behavior 91: 24–32. [Google Scholar] [CrossRef]
- Hermida, Alfred, and Neil Thurman. 2008. A Clash of Cultures: The Integration of User-Generated Content within Professional Journalistic Frameworks at British Newspaper Websites. Journalism Practice 2: 343–56. [Google Scholar] [CrossRef]
- Herrera Damas, Susana, and María José Benítez de Gracia. 2022. Immersive Journalism: Advantages, Disadvantages and Challenges from the Perspective of Experts. Journalism and Media 3: 330–47. [Google Scholar] [CrossRef]
- Hosany, Sameer, and Mark Witham. 2010. Dimensions of Cruisers’ Experiences, Satisfaction, and Intention to Recommend. Journal of Travel Research 49: 351–64. [Google Scholar] [CrossRef]
- Jennett, Charlene, Anna L. Cox, Paul Cairns, Samira Dhoparee, Andrew Epps, Tim Tijs, and Alison Walton. 2008. Measuring and Defining the Experience of Immersion in Games. International Journal of Human Computer Studies 66: 641–61. [Google Scholar] [CrossRef]
- Johnson, Daniel, Madison Klarkowski, Kellie Vella, Cody Phillips, Mitchell McEwan, and Christopher N. Watling. 2018. Greater Rewards in Videogames Lead to More Presence, Enjoyment and Effort. Computers in Human Behavior 87: 66–74. [Google Scholar] [CrossRef]
- Jung, Timothy, M. Claudia tom Dieck, Natasha Moorhouse, and Dario tom Dieck. 2017. Tourists’ Experience of Virtual Reality Applications. Paper presented at 2017 IEEE International Conference on Consumer Electronics (ICCE), Las Vegas, NV, USA, January 8–10; pp. 208–10. [Google Scholar]
- Kang, Seok, Erin O’Brien, Arturo Villarreal, Wansoo Lee, and Chad Mahood. 2019. Immersive Journalism and Telepresence. Digital Journalism 7: 294–313. [Google Scholar] [CrossRef]
- Kleemans, Mariska, Paul Hendriks Vettehen, Rob Eisinga, and Johannes W. J. Beentjes. 2014. Enjoyment of Arousing Television News: The Role of Age and Sensation Seeking. Communications 39: 89–99. [Google Scholar] [CrossRef]
- Lang, Annie, John Newhagen, and Byron Reeves. 1996. Negative Video as Structure: Emotion, Attention, Capacity, and Memory. Journal of Broadcasting & Electronic Media 40: 460–77. [Google Scholar] [CrossRef]
- Laws, Ana. 2017. Can Immersive Journalism Enhance Empathy? Digital Journalism 8: 213–28. [Google Scholar] [CrossRef]
- Leung, Shing-On. 2011. A Comparison of Psychometric Properties and Normality in 4-, 5-, 6-, and 11-Point Likert Scales. Journal of Social Service Research 37: 412–21. [Google Scholar] [CrossRef]
- Lin, James Jeng Weei, Henry B. L. Duh, Donald E. Parker, Habib Abi-Rached, and Thomas A. Furness. 2002. Effects of Field of View on Presence, Enjoyment, Memory, and Simulator Sickness in a Virtual Environment. Paper presented at Proceedings IEEE Virtual Reality, Orlando, FL, USA, March 24–28; pp. 164–71. [Google Scholar] [CrossRef]
- Meijer, Irene Costera. 2012. Valuable Journalism: A Search for Quality from the Vantage Point of the User. Journalism 14: 754–70. [Google Scholar] [CrossRef]
- Nakamura, Jeanne, and Mihaly Csikszentmihalyi. 2014. The Concept of Flow BT - Flow and the Foundations of Positive Psychology: The Collected Works of Mihaly Csikszentmihalyi. Edited by Mihaly Csikszentmihalyi. Dordrecht: Springer, pp. 239–63. [Google Scholar] [CrossRef]
- Nicovich, Stef G., Gregory W. Boller, and T. Bettina Cornwell. 2005. Experienced Presence within Computer-Mediated Communications: Initial Explorations on the Effects of Gender with Respect to Empathy and Immersion. Journal of Computer-Mediated Communication 10: JCMC1023. [Google Scholar] [CrossRef]
- Novak, Thomas P., Donna L. Hoffman, and Yiu Fai Yung. 2000. Measuring the Customer Experience in Online Environments: A Structural Modeling Approach. Marketing Science 19: 22–42. [Google Scholar] [CrossRef]
- Oncioiu, Ionica, and Iustin Priescu. 2022. The Use of Virtual Reality in Tourism Destinations as a Tool to Develop Tourist Behavior Perspective. Sustainability 14: 4191. [Google Scholar] [CrossRef]
- Pine, B. Joseph, Joseph Pine, and James H Gilmore. 1999. The Experience Economy: Work Is Theatre & Every Business a Stage. Boston: Harvard Business Press. [Google Scholar]
- Pull, Charles B. 2008. Recent Trends in the Study of Specific Phobias. Current Opinion in Psychiatry 21: 43–50. [Google Scholar] [CrossRef] [PubMed]
- Puschmann, Cornelius, and Alison Powell. 2018. Turning Words into Consumer Preferences: How Sentiment Analysis Is Framed in Research and the News Media. Social Media + Society 4: 2056305118797724. [Google Scholar] [CrossRef]
- Raimondi, Tommaso, Claudio Saragosa, and Iacopo Bernetti. 2022. The Combination of Serious Gaming and Immersive Virtual Reality through the Constructivist Approach: An Application to Teaching Architecture. Education Sciences 12: 536. [Google Scholar]
- Rameshbhai, Chaudhary Jashubhai, and Joy Paulose. 2019. Opinion Mining on Newspaper Headlines Using SVM and NLP. International Journal of Electrical and Computer Engineering 9: 2152–63. [Google Scholar] [CrossRef]
- Schutte, Nicola S., and Emma J. Stilinović. 2017. Facilitating Empathy through Virtual Reality. Motivation and Emotion 41: 708–12. [Google Scholar] [CrossRef]
- Sherry, John L. 2004. Flow and Media Enjoyment. Communication Theory 14: 328–47. [Google Scholar] [CrossRef]
- Shin, Donghee. 2018. Empathy and Embodied Experience in Virtual Environment: To What Extent Can Virtual Reality Stimulate Empathy and Embodied Experience? Computers in Human Behavior 78: 64–73. [Google Scholar] [CrossRef]
- Slater, Mel, and Maria V. Sanchez-Vives. 2016. Enhancing Our Lives with Immersive Virtual Reality. Frontiers in Robotics and AI 3: 74. [Google Scholar] [CrossRef]
- Slater, Mel, Martin Usoh, and Anthony Steed. 1994. Depth of Presence in Virtual Environments. Presence: Teleoperators and Virtual Environments 3: 130–44. [Google Scholar] [CrossRef]
- Socher, Richard, Alex Perelygin, Jean Y. Wu, Jason Chuang, Christopher D. Manning, Andrew Y. Ng, and Christopher Potts. 2013. Recursive Deep Models for Semantic Compositionality over a Sentiment Treebank. Paper presented at the EMNLP 2013—2013 Conference on Empirical Methods in Natural Language Processing, Seattle, WA, USA, October 18–21; pp. 1631–42. [Google Scholar]
- Steed, Anthony, Ye Pan, Zillah Watson, and Mel Slater. 2018. “We Wait”-The Impact of Character Responsiveness and Self Embodiment on Presence and Interest in an Immersive News Experience. Frontiers Robotics AI 5: 112. [Google Scholar] [CrossRef]
- Steuer, Jonathan. 1992. Defining Virtual Reality: Dimensions Determining Telepresence. Journal of Communication 42: 73–93. [Google Scholar] [CrossRef]
- Stupart, Richard. 2021. Tired, Hungry, and on Deadline: Affect and Emotion in the Practice of Conflict Journalism. Journalism Studies 22: 1574–89. [Google Scholar] [CrossRef]
- Sundar, S. Shyam, Jin Kang, and Danielle Oprean. 2017. Being There in the Midst of the Story: How Immersive Journalism Affects Our Perceptions and Cognitions. Cyberpsychology, Behavior, and Social Networking 20: 672–82. [Google Scholar] [CrossRef] [PubMed]
- Susindar, Sahinya, Mahnoosh Sadeghi, Lea Huntington, Andrew Singer, and Thomas K. Ferris. 2019. The Feeling Is Real: Emotion Elicitation in Virtual Reality. Proceedings of the Human Factors and Ergonomics Society Annual Meeting 63: 252–56. [Google Scholar] [CrossRef]
- Theodoropoulos, Anastasios, and Angeliki Antoniou. 2022. VR Games in Cultural Heritage: A Systematic Review of the Emerging Fields of Virtual Reality and Culture Games. Applied Sciences 12: 8476. [Google Scholar]
- Van Damme, Kristin, Anissa All, Lieven De Marez, and Sarah Van Leuven. 2019. 360° Video Journalism: Experimental Study on the Effect of Immersion on News Experience and Distant Suffering. Journalism Studies 20: 2053–76. [Google Scholar] [CrossRef]
- Vorderer, Peter, Werner Wirth, Feliz Ribeiro Gouveia, Frank Biocca, Timo Saari, Lutz Jäncke, Saskia Böcking, Holger Schramm, Andre Gysbers, Tilo Hartmann, and et al. 2004. MEC Spatial Presence Questionnaire (MEC-SPQ). Short Documentation and Instructions for Application. Report to the European Community, Project Presence: MEC (IST-2001-37661). Available online: https://www.researchgate.net/publication/318531435_MEC_spatial_presence_questionnaire_MEC-SPQ_Short_documentation_and_instructions_for_application (accessed on 1 April 2022).
- Webster, Jane, Linda Klebe Trevino, and Lisa Ryan. 1993. The Dimensionality and Correlates of Flow in Human-Computer Interactions. Computers in Human Behavior 9: 411–26. [Google Scholar] [CrossRef]
- Weibel, David, and Bartholomäus Wissmath. 2011. Immersion in Computer Games: The Role of Spatial Presence and Flow. International Journal of Computer Games Technology 2011: 282345. [Google Scholar] [CrossRef]
- Yang, Shuran, and Wenxiang Zhang. 2022. Presence and Flow in the Context of Virtual Reality Storytelling: What Influences Enjoyment in Virtual Environments? Cyberpsychology, Behavior, and Social Networking 25: 101–9. [Google Scholar] [CrossRef] [PubMed]
- Yeo, N. L., M. P. White, I. Alcock, R. Garside, S. G. Dean, A. J. Smalley, and B. Gatersleben. 2020. What Is the Best Way of Delivering Virtual Nature for Improving Mood? An Experimental Comparison of High Definition TV, 360° Video, and Computer Generated Virtual Reality. Journal of Environmental Psychology 72: 101500. [Google Scholar] [CrossRef] [PubMed]
“The Displaced” | “Under the Cracked Sky” | |||||||
---|---|---|---|---|---|---|---|---|
2D | 360 | VR | Total | 2D | 360 | VR | Total | |
Gender | ||||||||
Female | 52.38% | 55% | 50% | 52.46% | 52.17% | 50% | 51.02% | 51.06% |
Male | 47.62% | 45% | 50% | 47.54% | 47.83% | 50% | 48.98% | 48.94% |
Age | ||||||||
18–20 | 4.76% | 0% | 2.5% | 2.46% | 0% | 2.17% | 4.08% | 2.13% |
20–25 | 16.67% | 20% | 30% | 22.13% | 6.52% | 10.87% | 14.29% | 10.64% |
26–30 | 64.29% | 40% | 45% | 50% | 56.52% | 45.65% | 61.22% | 54.61% |
31–35 | 14.29% | 35% | 15% | 21.31% | 19.57% | 21.74% | 10.2% | 17.02% |
>35 | 0% | 5% | 7.50% | 4.1% | 17.39% | 19.57% | 10.2% | 15.6% |
VR experience | ||||||||
Never | 52.38% | 50% | 45% | 49.18% | 43.48% | 45.65% | 40.82% | 43.26% |
1–5 times | 35.71% | 35% | 40% | 36.89% | 36.96% | 45.65% | 46.94% | 43.26% |
>5 times | 11.91% | 15% | 15% | 13.93% | 19.57% | 8.7% | 12.24% | 13.48% |
Total | N = 42 | N = 40 | N = 40 | N = 122 | N = 46 | N = 46 | N = 49 | N = 141 |
Anger | Anticipation | Disgust | Fear | Joy | Sadness | Surprise | Trust | |
---|---|---|---|---|---|---|---|---|
Video 1 | 8.06% | 12.90% | 4.84% | 29.03% | 11.29% | 11.29% | 8.06% | 14.52% |
Video 2 | 2.90% | 20.29% | 2.90% | 7.97% | 16.67% | 10.87% | 7.97% | 30.43% |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2022 by the author. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Yang, S. Sentiment and Storytelling: What Affect User Experience and Communication Effectiveness in Virtual Environments? Journal. Media 2023, 4, 30-41. https://doi.org/10.3390/journalmedia4010003
Yang S. Sentiment and Storytelling: What Affect User Experience and Communication Effectiveness in Virtual Environments? Journalism and Media. 2023; 4(1):30-41. https://doi.org/10.3390/journalmedia4010003
Chicago/Turabian StyleYang, Shuran. 2023. "Sentiment and Storytelling: What Affect User Experience and Communication Effectiveness in Virtual Environments?" Journalism and Media 4, no. 1: 30-41. https://doi.org/10.3390/journalmedia4010003
APA StyleYang, S. (2023). Sentiment and Storytelling: What Affect User Experience and Communication Effectiveness in Virtual Environments? Journalism and Media, 4(1), 30-41. https://doi.org/10.3390/journalmedia4010003