Analysis and Definition of Data Flows Generated by Bio Stimuli in the Design of Interactive Immersive Environments †
1
LabRP, Psychosocial Rehabilitation Laboratory, School of Allied Health Technologies, Polytechnic Institute of Porto, 4200-072 Porto, Portugal
2
LabRP, Psychosocial Rehabilitation Laboratory, School of Media Arts and Design, Polytechnic Institute of Porto, 4200-072 Porto, Portugal
3
CITIC-Research Center of Information and Communication Technologies, University of A Coruña, 15071 A Coruña, Spain
*
Author to whom correspondence should be addressed.
†
Presented at the 3rd XoveTIC Congress, A Coruña, Spain, 8–9 October 2020.
Proceedings 2020, 54(1), 26; https://doi.org/10.3390/proceedings2020054026
Published: 20 August 2020
(This article belongs to the Proceedings of 3rd XoveTIC Conference)
Abstract
:This work focuses on interactivity as one of the essential factors for creating immersive environments, particularly interactivity that generates involuntary responses over which the user does not have conscious control. A dynamic and adaptive model was designed to analyze and define the data flow generated by bio stimuli for the design of interactive immersive environments.
1. Introduction
Immersive environments provide impactful experiences that generate different types of emotions. The more immersive the environment, the greater influence it will have on the user's perception of their involvement with that environment, creating a sense of realism and a sense of presence in it. The feeling of immersion is caused by a set of factors. Interactivity is based on the emission of stimuli, which can be of different types, inducing responses by the user. In the process of the interactivity of an immersive system, stimuli intend to trigger responses.
Responses to stimuli can be voluntary, when the user is aware of the response they intend to give and choose to respond to the stimulus in a certain way, or involuntary when the user does not control the response. However, self-control of a person's biological status can be developed with time and experience [1]. This biofeedback process can control physiological factors such as heart rate and brain waves, among others [1].
One of the three core areas of affective computing that provide relevant methods and techniques to affective design is related with emotion sensing and recognition [2]. The concept of affective feedback relates the concepts of affective computing and biofeedback, and its application in immersive environments intends that the use of biofeedback mechanisms in the system will influence the user experience [1].
2. Objectives
The objective of this work is to design a dynamic and adaptive model to analyze and define the data flow generated by bio stimuli for the design of interactive immersive environments.
- Identify the bio-response inducing stimuli sent by the system.
- Detect, analyze, and classify the response by the user using biofeedback mechanisms.
- Convert the obtained values into a scale and relate them to inducing stimuli.
- Use the values obtained by the biofeedback to redefine the system parameters and emit new stimuli.
3. Methods
Immersive environments are designed to affect the user; exposure causes involuntary reactions, such as changes in the heart and respiratory rate and changes in the electrical brain activity and eye movements. These reactions can be captured in real time by biofeedback devices capable of identifying these changes and measuring their intensity. The real-time data obtained on the user's physiological aspects allows us to determine how the stimuli affect them (Figure 1). On the other hand, when the user receives information in real time about a certain aspect of his physiology, they can determine how their mental changes can influence their state.
To optimize the user experience, an emotionally adaptive system continuously adapts its stimulus to the user’s emotional state, through the measurement of their emotional data [3]. To incorporate the effects of stimuli on the interactivity process, the system first processes the unimodal data separately and then merges them [4] in order to interpret the user's response and use that response to generate new stimuli.
The perception and externalization of emotions can occur voluntarily and involuntarily. The participant can feel one thing and convey that they felt another. The use of multimodal data increases the reliability of the system by detecting different sources of biological signals [5].
The introduction of biofeedback systems in the design of a simple immersive environment transform it into an Emotionally Adaptive Immersive Environment, where the user experience can be optimized through the continuously adaptation of stimuli to the user emotional state. The quantity and intensity of the stimuli are determined through an adaptive affective algorithm which collects, interprets, and converts the user's physiological data.
To explore the potential of interactivity in immersive environments, the simple stimulus-response model must evolve into a dynamic and adaptive model. This model incorporates a set of cycles between stimuli and responses.
The system emits stimuli that trigger physiological reactions; the data generated by these reactions is sent and interpreted by the algorithm, which identifies the type and intensity of the emotion created by the stimulus. The affective algorithm adapts the system's responsiveness through mapping between the data obtained, considering the type and intensity of the stimuli, with the appropriate response to each situation, selecting new stimuli to emit and grading the respective intensity.
4. Discussion/Conclusions
Since interactivity is an important factor in the construction of immersive environments, the design of a dynamic and adaptive model to analyze and define the data flow generated by bio stimuli is fundamental for the conceptualization of the system.
The Emotionally Adaptive Immersive Environment through an affective algorithm can use the Not Intentional Mode Strategy (NIMS), based on randomness in the stimulus management process, or the Intentional Mode Strategy (IMS), which automatically generates stimuli according to pre-defined objectives, but it also allows the Controlled Mode Strategy (CMS) through the intervention of a supervisor who controls the system during user exposure to the immersive system.
Author Contributions
Conceptualization, P.V.G.; methodology, P.V.G. and A.M.; validation, P.V.G., J.D., and J.A.; investigation, P.V.G.; writing—original draft preparation, P.V.G.; writing—review and editing, P.V.G.; visualization, P.V.G and J.D.; supervision, A.M. and e.J.P.; project administration, P.V.G.
Funding
This research received no external funding.
Acknowledgments
This research was carried out and used the equipment of the Psychosocial Rehabilitation Laboratory (LabRp) of the Research Center in Rehabilitation of the School of Allied Health Technologies, Polytechnic Institute of Porto.
Conflicts of Interest
The authors declare no conflict of interest.
References
- Bersak, D.; McDarby, G.; Augenblick, N.; McDarby, P.; McDonnell, D.; McDonald, B.; Karkun, R. Intelligent biofeedback using an immersive competitive environment. In Online Proceedings for the Designing Ubiquitous Computing Games Workshop, Ubicomp 2001, Atlanta GA, September 2001. [Google Scholar]
- Hudlicka, E. Affective computing for game design. In Proceedings of the 4th International North American Conference on Intelligent Games and Simulation, Montreal, QB, Canada, 13–15 August 2008; pp. 5–12. [Google Scholar]
- Tijs, T.; Brokken, D.; Ijsselsteijn, W. Creating an emotionally adaptive game. In International Conference on Entertainment Computing; Springer: Berlin, Heidelberg, Germany, 2008; Volume 5309, pp. 122–133. [Google Scholar]
- Poria, S.; Cambria, E.; Bajpai, R.; Hussain, A. A review of affective computing: From unimodal analysis to multimodal fusion. Inf. Fusion 2017, 37, 98–125. [Google Scholar] [CrossRef]
- Gomes, P.V.; Marques, A.; Pereira, J.; Correia, A.; Donga, J.; Sá, V.J. E-emotion capsule: As artes digitais na criação de emoções. In Proceedings of the 9th International Conference on Digital and Interactive Arts (ARTECH 2019). Association for Computing Machinery, New York, NY, USA. Article 86 1–4. [CrossRef]
Figure 1.
Behavioral change during continuous exposure to stimuli generated in immersive environments.
Figure 1.
Behavioral change during continuous exposure to stimuli generated in immersive environments.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations. |
© 2020 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
MDPI and ACS Style
Gomes, P.V.; Donga, J.; Marques, A.; Azevedo, J.; Pereira, J. Analysis and Definition of Data Flows Generated by Bio Stimuli in the Design of Interactive Immersive Environments. Proceedings 2020, 54, 26. https://doi.org/10.3390/proceedings2020054026
AMA Style
Gomes PV, Donga J, Marques A, Azevedo J, Pereira J. Analysis and Definition of Data Flows Generated by Bio Stimuli in the Design of Interactive Immersive Environments. Proceedings. 2020; 54(1):26. https://doi.org/10.3390/proceedings2020054026
Chicago/Turabian StyleGomes, Paulo Veloso, João Donga, António Marques, João Azevedo, and Javier Pereira. 2020. "Analysis and Definition of Data Flows Generated by Bio Stimuli in the Design of Interactive Immersive Environments" Proceedings 54, no. 1: 26. https://doi.org/10.3390/proceedings2020054026
APA StyleGomes, P. V., Donga, J., Marques, A., Azevedo, J., & Pereira, J. (2020). Analysis and Definition of Data Flows Generated by Bio Stimuli in the Design of Interactive Immersive Environments. Proceedings, 54(1), 26. https://doi.org/10.3390/proceedings2020054026
