Next Article in Journal
Compaction Quality Inspection and Uniformity Analysis of Soil-Rock Mixed Subgrade
Next Article in Special Issue
Climate Distress: A Review of Current Psychological Research and Practice
Previous Article in Journal
Mobile Phone Data Feature Denoising for Expressway Traffic State Estimation
Previous Article in Special Issue
Climate Change as Liminal Experience—The Psychosocial Relevance of a Phenomenological Approach
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

The Efficacy of Virtual Reality in Climate Change Education Increases with Amount of Body Movement and Message Specificity

by
Anna C. M. Queiroz
1,*,
Géraldine Fauville
2,
Adina T. Abeles
1,
Aaron Levett
3 and
Jeremy N. Bailenson
1
1
Department of Communication, Stanford University, Stanford, CA 94305, USA
2
Department of Education, Communication and Learning, University of Gothenburg, 40530 Gothenburg, Sweden
3
Department of Computer Science, Stanford University, Stanford, CA 94305, USA
*
Author to whom correspondence should be addressed.
Sustainability 2023, 15(7), 5814; https://doi.org/10.3390/su15075814
Submission received: 7 February 2023 / Revised: 16 March 2023 / Accepted: 18 March 2023 / Published: 27 March 2023
(This article belongs to the Special Issue The Psychology of Sustainability: Expanding the Scope)

Abstract

:
Climate change impacts are felt globally, and the impacts are increasing in severity and intensity. Developing new interventions to encourage behaviors that address climate change is crucial. This pre-registered field study investigated how the design of a virtual reality (VR) experience about ocean acidification could impact participants’ learning, behavior, and perceptions about climate change through the manipulation of the experience message framing, the sex of voice-over and the pace of the experience, and the amount of participants’ body movement. The study was run in 17 locations such as museums, aquariums, and arcades in the U.S., Canada, the U.K., and Denmark. The amount of body movement was a causal mechanism, eliciting higher feelings of self-efficacy while hindering learning. Moreover, linking the VR narrative about ocean acidification linguistically to climate change impaired learning compared to a message framing that did not make the connection. As participants learned more about the experience, they perceived the risks associated with ocean acidification as higher, and they were more likely to engage in pro-climate behavior. The results shed light on the mechanisms behind how VR can teach about ocean acidification and influence climate change behavior.

1. Introduction

Climate change is fueling the increase in frequency and intensity of extreme events such as heat waves, storms, wildfires, and droughts [1,2]. While human activity and the resultant emissions are responsible for the increased carbon dioxide concentrations in the atmosphere that lead to global warming and climate change [3,4], the ocean has mitigated atmospheric concentrations by absorbing an estimated 40% of carbon dioxide emissions since the Industrial Revolution [5]. This absorption, however, has led to decreasing ocean water pH, a process referred to as ocean acidification (OA), resulting in a disruption of the seawater chemistry which impacts, among others, shell-forming marine organisms and the ecosystems that depend on them [6,7,8]. Even with a growing scientific understanding of the scale of the problem, most people are not familiar with ocean acidification and have not experienced its adverse effects on marine life, making it harder to understand and less likely that people would take steps to address the issue [9].
Human actions can also both reduce the future effects of climate change through mitigation behaviors and prepare for the unavoidable impacts through adaptive behaviors. Interventions can encourage climate change-related behaviors, such as learning more about climate change, demanding policy action, and preparing one’s home for flooding or wildfires. Broadly, we refer to these behaviors as climate change actions, and there have been multiple studies on understanding and increasing climate change actions among various populations [10,11,12,13,14].
Work on climate change puts forth several frameworks that seek to explain the factors impacting one’s climate change behavior, such as the social amplification of risk framework [11,13], the protective action decision model [12], and the protection motivation theory [10]. To better identify the factors that motivate climate change behavior, van Valkengoed and Steg [14] conducted a meta-analysis of 106 papers, including all these frameworks. They identified 13 main factors, including trust in government, risk perception, climate change belief, knowledge, and outcome efficacy. The authors highlighted the need to explore how the factors interrelate and jointly influence behavior, and to investigate the mediation effect risk perception can have between learning and climate change behavior.
Although research on climate change behavior is vast, a recent meta-analysis on behavioral interventions to promote household action on climate change showed small and short-term effects [15], pointing out the need for new forms of interventions [16]. In the last decade, there has been a significant increase in the adoption of virtual reality (VR) in several contexts, such as schools, libraries, museums, and informal learning programs, with at least 10 million VR headsets sold in 2021 [17]. This technology allows new ways of communication, perception, and interaction with content, leveraging the power of communication mainly through its capacity to trigger emotions [18]. This affordance, coupled with the endless simulation possibilities, and strict ability to control the experience and to record users’ verbal and nonverbal behavior (such as body movement and gaze shift), has led to several researchers using VR in climate-related education [19] and human behavior research [20].
Although much remains to be discovered about the potential role VR can play in broad climate change education and behaviors, recent media and design comparison studies have shown the benefits of using VR instead of computer monitors in some of the factors identified by van Valkengoed and Steg [14], such as knowledge [21,22,23,24], risk perception [25], involvement with nature [25], positive and negative affect [26], pro-environmental behavior [19,27,28], trust [29], and factors related to learning, such as self-efficacy toward science [22,30,31].
Beyond the general effect of using VR as a medium, it is crucial to delve deeper and understand the interaction between specific design elements and the mechanisms through which VR could impact the factors motivating climate change behaviors, such as learning and risk perception. Learning about climate change is complex [32]. It involves dealing with a large amount of abstract information, connecting different subjects, such as chemistry, geography, mathematics, and biology, and ultimately, trusting in the information received [32,33].
The Cognitive Load Theory [34] explicates three cognitive demands that are involved in learning processes: extraneous cognitive load (processing information not relevant to the learning goals), intrinsic cognitive load (processing information relevant to the learning goals), and germane cognitive load (learner’s effort to construct schemas about the information being processed). Stimulus-rich multimedia environments often require greater cognitive effort to process visual, auditory, and textual information, impeding learning [35,36]. Hence, multimedia environments should reduce extraneous cognitive load to avoid unnecessary cognitive overload impacting information processing [34,37].
One principle shown to reduce processing load and improve attention and learning is segmenting the message into meaningful blocks [38,39,40]. Adding pauses to segment a VR experience could, however, break the feeling of presence, i.e., the phenomenon of behaving and feeling as being in the virtual environment [41]. While Ahn and colleagues [42] found that segmentation had little effect on presence or information recall, Mayer and colleagues [43] reviewed 13 media comparison studies and concluded that more than pauses, adding generative learning activities or asking questions during pauses in the delivery of VR lessons can enhance learning outcomes. Hence, we hypothesized that participants in conditions where the content is segmented, by adding pauses between scenes to reflect on the content, will score higher for learning than participants in non-segmented conditions (H1). Since breaking the experience flow can harm the feeling of presence in VR, we hypothesized that participants in non-segmented conditions will score higher for presence than participants in segmented conditions (H2). Moreover, we investigated the effects of segmentation on factors motivating climate change behavior through the following research question (RQ1): What are the impacts of segmenting content on behavior, risk perception, concern, causes, and beliefs about increased carbon dioxide emissions, and self-efficacy?
Recent studies using VR to teach OA have shown that users’ movement in VR underlies the media effects on knowledge gains [21] and self-efficacy toward learning [22]. Research from multiple backgrounds has demonstrated that body movement is essential in learning [44,45,46,47,48,49,50], creating social and psychological attachments to the environment [51], and inducing attitude and behavior change [52]. Markowitz and colleagues [21] suggest that moving in a virtual space meaningful to the learning activity helps participants elaborate and understand the consequences of climate change, leading to learning gains. Moreover, because the brain is constantly making predictions about body movement and the environment [53,54], the motor and visual exploration of the environment in VR can increase the sense of agency (i.e., the feeling of being in control of one’s own actions and environmental outcomes [55]), which in turn influences self-efficacy towards learning [22,56]. Because of that and the unique VR affordances, allowing users to walk around and move during the experience, we designed the current study to compare the effects on climate change learning and behavior of having the experience seated versus standing up, being able to walk around. In this sense, we hypothesized that participants having a standing-up experience that allows them to walk around will score higher for learning, behavior, risk perception, concern, causes, and beliefs about increased carbon dioxide emissions, presence, self-efficacy, and trust than participants in seated conditions (H3).
The processes involved in learning about climate change can be influenced not only by the pedagogy of the experience but also by non-verbal aspects of the information [57]. For example, studies have shown that when exposed to new information, we are constantly reasoning about the informant’s characteristics (such as physical appearance, voice, and gestures) and the implications of the information received [33]. When receiving information from a computer, particularly in rich media environments such as animations and VR experiences, reasoning about the informant becomes more complex, as the informant is not a person but a computer-simulated environment, and the human characteristics that we used to reason about the source of information are absent or transformed. These aspects influence how much we trust and learn the information.
Research on human–computer interaction has demonstrated that the impact of the sex of the computer’s voice (male or female) is influenced by the gender of the participants themselves [58,59,60] and gender stereotypes [61]. Some studies have shown that participants trusted information more when it was received from a male compared to a female voice-over [62,63]. Moreover, Khashe and colleagues [64] argued that adults might be more inclined toward pro-environmental requests made by a female computer voice, while Liu [65] did not find a difference between human voice-over sex on changing participants’ climate change beliefs. Hence, we hypothesized that participants in conditions with a female voice-over will score higher for learning than participants in male-voiced conditions (H4); that participants’ reported self-efficacy comparing female-voiced and male-voiced conditions will be gender-dependent, with women scoring higher than males in female-voiced conditions and vice versa (H5); and that participants in male-voiced conditions will score higher for trust than participants in female-voiced conditions (H5). To investigate the effects of voice-over sex on the other factors influencing climate change behavior and learning, we posed the following research question: What are the impacts of the sex of the voice-over on risk perception, concern, causes, and beliefs about increased carbon dioxide emissions (RQ2) and on presence (RQ3)?
In addition, the way individuals engage with climate change depends on the framing of the issue at stake (i.e., how the message emphasizes aspects of the information and resonates with the audience’s knowledge and values) [66,67,68,69,70,71]. Although a loss-framed message might trigger a greater intention to act upon environmental issues [72], this framing may be moderated by the degree of uncertainty associated with climate change. Morton and colleagues [69] showed that a loss-framed message coupled with high uncertainty reduced pro-environmental intentions. In contrast, high uncertainty coupled with a gain-framed message yielded greater positive pro-environmental intentions. Investigating framing in VR, Ahn and colleagues [73] found that growing a virtual tree (gain framing) was more effective in promoting pro-environmental behavior than cutting down a virtual tree (loss framing). On the one hand, focusing on the process of OA instead of climate change could reduce the complexity of the topic being learned, positively influencing how participants feel able to learn (self-efficacy). However, on the other hand, it taps into unfamiliar concepts that could make it more difficult to learn, and negatively influence self-efficacy [74]. Moreover, the term climate change has been extensively linked with negative outcomes by the media, resulting in a negative valence associated with the term [75]. Hence, to investigate the effects of message framing on self-efficacy, we posed RQ4: What is the impact of message framing on self-efficacy?
Finally, political opinions have been shown to influence how climate change messages are interpreted, with a conservative political view being more correlated with casting doubts on messages framed as climate change than neutral messages [76,77]. Cooke and Kim [78] have shown that when OA is explained in connection to climate change, people tend to politicize the message, mainly because of their unfamiliarity with OA and lack of connection with the ocean. The process of misinterpreting scientific information to fit it to their political and psychological biases is called motivated reasoning, which, in the case of climate change, is stronger among politically conservative individuals [79]. In terms of learning, Guilbeault and colleagues [80] found that polarizing the message significantly reduced social learning. We then hypothesized that compared to participants in an ocean acidification framing condition, participants in a climate change framing condition reporting a more liberal political view will score higher for behavior, risk perception, trust, learning, concern, causes, and beliefs about increased carbon dioxide emissions than participants reporting more conservative political views (H7).
Given the multifaceted aspect of climate change learning and behavior and increasing VR use to depict environmental issues, it is crucial to understand better how the design of the VR experience relates to climate change learning and behaviors. In this context, this study’s objective is threefold: (a) understand how the design of the VR experience can influence some of the factors indicated in the literature as influencing climate change behavior (namely risk perception, trust, beliefs, concern about the ocean, and knowledge; RQ1: segmentation effects and RQ2: voice-over effects) and other aspects related to climate change behavior in VR, such as presence (RQ3: voice-over effects) and self-efficacy toward science learning (RQ4: message framing effects); (b) identify the relationship between body movement in VR, learning, and self-efficacy towards science learning; and (c) explore how knowledge, beliefs, risk perception, and trust relate to climate change behavior and each other after a VR experience about OA (RQ5 and RQ6). Hence, we manipulated design elements in VR that the literature indicated could impact these factors, namely movement, framing, voice-over, and segmentation. The hypotheses and research questions were pre-registered (https://osf.io/5rkmb, accessed on 17 March 2023). Visual representations of the data recording procedure, VR equipment used, and conditions are shown in Figure 1.

2. Materials and Methods

2.1. Developing Remote Data Collection

This study was run in schools, universities, museums, aquariums, VR arcades, libraries, and foundations from 17 locations across the U.S., the U.K., Canada, and Denmark. The Institutional Review Board approved the procedures and materials. Participants were students or visitors that voluntarily joined the study. Docents on each study site informed the participants about the study procedures. They also helped participants use the VR equipment and go through the assigned version of the Stanford Ocean Acidification Experience (SOAE). Participants that gave consent had their data collected and recorded in real time on an online spreadsheet. The system collected data on participants’ assigned condition, location, answers to questionnaires, headset and hand controller orientation (yaw, pitch, roll), headset and hand controller translation (x, y, z coordinates), button clicks, and experience length. Every 0.25 s, these data were snapshotted and stored in program memory, periodically flushed to a Google Sheet with the unique participant ID via the Google Sheets API [81]. Once current in-memory data were successfully written to the spreadsheet, they would be cleared from local program memory. In the case of a failed write (e.g., temporary network connection failure), the data whose write failed would be preserved in the local program memory and included in future write attempts. In the rare instance of network failure without restoration by the end of the experience, such that either no data or incomplete data were written to the participant’s Google Sheet, the participant’s data were excluded from the analysis. Similarly, if the participant did not complete the study for any reason, their data were excluded from the analysis. In total, 127 out of 432 participants’ data were excluded due to incomplete data. Because conditions were randomly assigned, docents would not know if the participant would need a chair or not (seated or standing conditions) until the experience had already begun. As a result, some study sites would restart the experience if they did not have a chair available at that time, or for museum visitors who did not feel comfortable sitting, which would be registered as incomplete data. This remote data collection method was also used to record which of the conditions the user was randomly assigned. In addition, it was used to record specific user behavior, including their responses to the pre- and post-tests and their physical interactions with the VR experience (e.g., “touching” the exhaust pipe in the opening city scene).

2.2. Stanford Ocean Acidification Experience (SOAE) Versions

SOAE is an eight-minute-long, interactive computer graphics piece that teaches about OA’s causes, processes, and outcomes. Through the experience, participants observe firsthand the effects of ocean acidification on the ocean. They watch cars’ exhaust pipes releasing carbon dioxide molecules (Figure 2A), push a molecule, watching it flying to the sky, and watch a carbon dioxide molecule react with a water molecule to create a carbonic acid molecule (Figure 2B). They then embody a scientist and measure the health of a coral reef by counting and placing flags beside sea snails (Figure 2C). Finally, they experience the consequent degradation of a rocky reef and its marine life (Figure 2D). The original experience is available at https://stanfordvr.com/soae/ (accessed on 17 March 2023).
Sixteen versions of SOAE were created, combining the manipulation variables: movement, segmentation, framing, and narration. For the movement manipulation, participants in the standing conditions walked around a four-square-meter area and used hand controllers to perform interactive tasks and receive haptic feedback (hand controllers’ vibration). In the seated condition, all those activities occurred, except the participant remained seated and used virtual lasers to interact with distant virtual objects. In the segmented condition, we included three-second pauses after some passages and 20 s pauses between four different content blocks. During the 20 s pauses, participants were prompted to think about what they had just learned in that block while the screen turned black. To manipulate the framing of the message, in the climate change condition, the experience title was “Ocean Acidification, a Climate Change Problem”, and the narration mentioned climate change a couple of times during the experience. In the OA framing condition, the title was “Ocean Acidification, a Carbon Dioxide Emission Problem”, and the narration did not link OA to climate change. For the voice-over manipulation, we created versions of SOAE narrated by a woman and a man. The experience was piloted with university students, who provided qualitative feedback about the experience and the length of the pauses in the segmented versions of the experience that influenced the final study design.

2.3. Measuring Subjective Variables

Participants answered pre- and post-tests while in VR, using the hand controllers to choose options or input values. All participants answered the same questions. The pre-test included demographic questions (age, gender, race/ethnicity, education level, VR use frequency), how well the participant understood English, and how much they believed they knew about OA. After answering the pre-test, participants were randomly assigned to one of the conditions. After that, they answered the post-test, also in VR. It included eight questions to measure learning (adapted from the International Ocean Literacy Survey [82]) and one question to measure each of the following: concern about the health of the ocean, causes of OA, the severity of OA (risk perception), beliefs about increased carbon dioxide emissions in the atmosphere, self-efficacy towards science learning, how much they believed knowing about OA, presence, and trust in the information they received during the experience. These questions were developed in consultation with marine and social scientists engaged in climate change research. As a measure of climate change behavior, they were asked to read and then decide whether or not to sign a petition to support investments in research about OA mitigation strategies. We used this measure to indicate engagement with climate change and support for meaningful measures to address OA. Participants could use the hand controller to handwrite in VR and sign the petition. Finally, they were asked to select where they placed themselves on a political spectrum from left/liberal to right/conservative. The questionnaires were piloted with participants of a national climate change event, who gave feedback on their understanding of the questions, the length of the questionnaire, and the link between the question and the construct being investigated. Questions and their respective coding are shown in Table 1. A composite of the learning questionnaire was created by averaging the eight learning questions’ scores.

2.4. Measuring Movement

Participants’ orientation (yaw, pitch, roll), head translation (x, y, z), and controller translation (x, y, z) were tracked and recorded throughout the experience every 0.25 s. Movement data were cleaned and processed using Python, Pandas, and NumPy. We followed the methods of Li and colleagues [83] for movement analysis in VR. Using the headset and hand controllers’ x, y, and z coordinates, we calculated the total amounts of translation, normalized them per second, and calculated head and hands’ yaw, pitch, and roll standard deviation. Figure 3 shows visual representations of yaw, pitch, roll, and translation.

2.5. Statistics

We estimated parameters from several linear mixed-effects models to test the pre-registered hypotheses, investigate the research questions, and run exploratory analyses. All models included the random effects of location, included all manipulation variables as predictors, and controlled for gender, age, VR use, English proficiency, political view, and education. We estimated parameters from generalized linear mixed models predicting behavior (signing or not signing a petition supporting investment in OA research). The analyses were carried out in R Studio software. We used the “lmerTest” [84] package to run the regressions; this package reports Satterthwaite approximations for degrees of freedom and p-values. Linear mixed-effects models were inspected for the assumptions of linearity, homoscedasticity, normality of residuals’ distribution, and independence using the package “sjPlot” [85]. Additionally, models were tested for multicollinearity, using the package “car” [86] to measure the variance inflation factor (VIF) of each variable in the model. No multicollinearity of concern was found (VIF < 5) [87]. We used the package “effectsize” [88] to calculate effect sizes. For linear mixed-effects models, partial eta squared (η2 p) with a 90% confidence interval (CI) [89] was computed using Sums-of-Squares [88]. For generalized mixed-effects models (models predicting climate change behavior) and ordinal logistic regressions (models predicting causes attributed to OA), standard coefficients were reported along with 95% CIs. Our testing of research questions and hypotheses did not involve interactions. For example, to investigate the voice-over gender effects on the variables of interest, we ran LMER models predicting the dependent variable of interest from the manipulated variable “voice-over sex” (predictor). The predictor always had two factors (in this case, male (n = 149) and female voice-over (n = 156)). The models were controlled for the other manipulations and their factors and participants’ demographics and included the random effects of location. Hence, we did not test all of the two-, three- and four-way interactions.
Finally, we ran mediation analyses using the package “mediation”, reporting nonparametric bootstrap confidence intervals with the percentile method to investigate the relationships between the factors motivating climate change behavior. A priori power analyses including linear mixed-effects models with two tails, alpha probability error of 0.05, H1 ρ2 (rho squared) of 0.115 [90], H0 ρ2 of 0, 15 predictors (predictor with two factors, controlling for the other three manipulation variables with two factors each, and seven demographic variables), and 95% power showed a lower critical R2 of 0.025 and upper critical R2 of 0.10 and indicated a sample size of 260. A type 2 ANOVA was run on the LMER models’ output to generate type 2 sums of squares ANOVA tables of fixed effects. A priori power analysis of the ANOVA tests, including Cohen’s f = 0.20, alpha probability error of 0.05, two groups, and 95%, showed a sample size of 328.

2.6. Participants

A total of 305 complete and valid responses were included in the data analysis. Participants’ mean age was 23.83 years (SD = 13.71, min = 11, max = 73), and their demographics are shown in Table 2.

3. Results

Means and standard deviations of the subjective measures per manipulated variable are shown in Table 3. Table 4 shows the correlations between the variables. A summary of the pre-registered hypotheses and research questions along with the corresponding data analyses and conclusions is shown in Appendix A.
Segmenting the experience did not influence the outcomes (RQ1). No differences between the segmented and non-segmented conditions were found for the subjective measures investigated (learning (F (1, 276) = 0.28, p = 0.599, η2 p < 0.01, 90% CI [0.00, 0.00]); self-efficacy (F (1, 292) = 0.04, p = 0.845, η2 p < 0.01, 90% CI [0.00, 0.01]); presence (F (1, 292) = 0.04, p = 0.837, η2 p < 0.01, 90% CI [0.00, 0.01]); concern (F (1, 287) = 0.01, p = 0.941, η2 p < 0.01, 90% CI [0.00, 0.02]); risk perception (F (1, 292) = 0.01, p = 0.935, η2 p < 0.01, 90% CI [0.00, 0.00]); trust (F (1, 290) = 0.25, p = 0.614, η2 p < 0.01, 90% CI [0.00, 0.02]); beliefs (F (1, 292) = 1.69, p = 0.194, η2 p < 0.01, 90% CI [0.00, 0.03]); behavior (χ2(1) = 0.691, p = 0.406, std. coef = 0.30, 95% CI [−0.42, 1.02])).
Male voice-over elicited higher feelings of presence but did not influence factors motivating climate change behavior (RQ2 and RQ3). Participants in the male voice-over conditions reported feeling more present than participants in the female voice-over conditions (F (1, 292) = 4.61, p = 0.033, η2 p = 0.02, 90% CI [0.00, 0.05]). No difference between the narration conditions was found for the factors motivating climate change behavior (risk perception (F (1, 292) = 0.53, p = 0.466, η2 p < 0.01, 90% CI [0.00, 0.02]); trust (F (1, 289) = 0.68, p = 0.409, η2 p < 0.01, 90% CI [0.00, 0.02]); beliefs (F (1, 292) = 1.11, p = 0.294, η2 p < 0.01, 90% CI [0.00, 0.02]); behavior (χ2(1) = 0.924, p = 0.336, std. coef = −0.36, 95% CI [−1.08, 0.37])).
The framing of the experience did not influence self-efficacy (RQ4), but focusing the message on OA yielded higher learning than linking it to climate change. There was no significant difference between the framing conditions for self-efficacy (F (1, 292) = 0.01, p = 0.938, η2 p < 0.01, 90% CI [0.00, 0.00]). Participants in the OA framing conditions scored significantly higher for learning than participants in the climate change framing conditions (F (1, 278) = 7.37, p = 0.007, η2 p = 0.03, 90% CI [0.00, 0.06]). The mean scores per question assessing learning, per framing condition, are shown in Figure 4.
Learning was positively associated with participants’ risk perception, concern, self-efficacy, causes, and beliefs about OA (RQ5). Results of the linear mixed-effects models including learning as a predictor showed significant effects of learning on risk perception (F (1, 292) = 8.49, p < 0.01, η2 p = 0.03, 90% CI [0.01, 0.07]), concern about the ocean (F (1, 255) = 16.49, p < 0.001, η2 p = 0.06, 90% CI [0.06, 0.11]), self-efficacy towards science (F (1, 292) = 6.68, p = 0.010, η2 p = 0.02, 90% CI [0.00, 0.06]), causes of OA (estimate = 2.37, p = 0.006, std. coef = 0.53, 95% CI [0.15, 0.91]), and beliefs about OA (F (1, 292) = 27.15, p < 0.001, η2 p = 0.09, 90% CI [0.04, 0.14]). No direct effects of learning were found on climate change behavior (χ2(1) = 0.587, p = 0.444, std. coef = 0.15, 95% CI [−0.23, 0.54]), presence (F (1, 244) = 2.05, p = 0.154, η2 p < 0.01, 90% CI [0.00, 0.04]), and trust (F (1, 259) = 3.28, p = 0.071, η2 p = 0.01, 90% CI [0.00, 0.04]).
Learning about OA indirectly influenced climate change behavior via risk perception (RQ6). To test van Valkengoed and Steg’s (2019) suggestion that learning would indirectly influence behavior via risk perception, we ran a causal mediation analysis including behavior as an outcome, learning as a predictor, risk perception as a mediator, and political view, English proficiency, and education as covariates. Results showed that risk perception fully mediated the relationship between learning and behavior (ACME = 0.10, p = 0.002, 95% CI [0.03, 0.19]; ADE = 0.12, p = 0.378, 95% CI [−0.13, 0.36]; Total Effect = 0.219, p = 0.104, 95% CI [−0.04, 0.45]).
Trust in the information received in the VR experience indirectly influenced behavior via risk perception. To test van Valkengoed and Steg’s (2019) suggestion that risk perception would mediate the relationship between trust and behavior, we ran a causal mediation analysis, including behavior as an outcome, trust in the information as a predictor, and risk perception as a mediator. Political views, English proficiency, and education were included as covariates. Results showed that risk perception fully mediated the relationship between trust and behavior (ACME = 0.03, p = 0.016, 95% CI [0.01, 0.06]; ADE = 0.06, p = 0.056, 95% CI [−0.01, 0.13]; Total Effect = 0.096, p = 0.004, 95% CI [0.03, 0.16]).
When experiencing VR seated, head yaw positively affected learning, while hands’ pitch and yaw hindered learning. The regressions predicting learning from the head and hand movements in seated conditions showed positive effects of head yaw on learning (F (1, 88) = 5.10, p = 0.026, η2 p = 0.05, 90% CI [0.00, 0.15]) and negative effects of hands’ pitch and yaw on learning (pitch: F (1, 88) = 5.06, p = 0.027, η2 p = 0.05, 90% CI [0.00, 0.15]; yaw: F (1, 88) = 4.40, p = 0.039, η2 p = 0.05, 90% CI [0.00, 0.14]). No effects were found in the standing conditions (head yaw: F (1, 202) = 1.19, p = 0.276 η2 p < 0.01, 90% CI [0.00, 0.04]; hand pitch: F (1, 197) = 0.03, p = 0.855, η2 p < 0.01, 90% CI [0.00, 0.00]; hand yaw: F (1, 197) = 0.01, p = 0.908, η2 p < 0.01, 90% CI [0.00, 0.01]).
Head translation increased self-efficacy but hindered learning. Pearson’s correlation between head translation and self-efficacy was positive (r = 0.20, t(302) = 3.54, p < 0.001), while it was negative between head translation and learning (r = −0.24, t(303) = −4.36, p < 0.001). Two causal mediation analyses were run, the first including self-efficacy as an outcome, movement conditions as a predictor, and head translation as a mediator. The second one included the same predictor and mediators but had learning as an outcome. In both models, head translation showed a significant and full mediation effect: in the model predicting self-efficacy, it was positive (ACME = 0.232, p = 0.036; ADE = 0.128, p = 0.440; Total effect = 0.361, p < 0.001), and in the model predicting learning, it was negative (ACME = −0.087, p < 0.001; ADE = 0.011, p = 0.800; Total effect = −0.076, p < 0.001). Scatter plots showing the relationships between head translation and self-efficacy and head translation and learning are shown in Figure 5.

4. Discussion

This study investigated how VR design can influence learning and factors motivating climate change behavior. We pre-registered and tested hypotheses and research questions formulated based on the cognitive load theory of educational multimedia design, embodied cognition, human–computer interaction, climate change behavior, message framing, and motivated reasoning when communicating climate change. Because using VR to investigate human behavior related to climate change is a relatively young area of research, we also ran several exploratory analyses to investigate the relationship between the factors motivating climate change behavior after a VR experience about OA, and the effects of body movement on those factors. Our main finding is that walking around during a VR experience caused a paradox, eliciting higher feelings of self-efficacy while hindering learning. Moreover, linking the experience narrative to climate change impaired learning compared to language that did not make the direct link. Exploring the relationship between knowledge and behavior, we found that learning alone was not enough to impact behavior, but this impact was mediated through risk perception. Likewise, trust in the information indirectly influenced behavior via risk perception, i.e., the more the participants trusted the message, the more they were willing to engage in climate change behavior.
Because one of the unique features of VR is allowing users to walk around and interact with digital content, and movement and gesturing [46,47,48] have significant effects on learning, VR can benefit from embodied cognition compared to other media [21,45,52]. However, our study showed that experiencing VR seated was better for learning than walking around and that hand movement impaired learning when having a seated experience. Although the experience was designed to encourage meaningful movement, participants could have engaged in non-meaningful movements, such as walking around when not prompted to, impeding learning. This finding indicates that interactive simulations in VR may encourage interactions that are not meaningful, even if not intended to, leading to increased extraneous cognitive load and less learning [36,37]. The inconsistent findings between VR and computer monitors for conceptual learning found in the literature [43,91,92] may be driven by the influence of movements unrelated to the learning task in VR. Hence, future studies could experimentally test this hypothesis or meta-analyze previous studies, targeting the relationship between the body movements elicited by the experiences, the learning task, and learning outcomes.
Our data also showed that body movement in VR created a paradox: more walking during the experience led to less learning and higher self-efficacy. Previous studies have shown, through subjective measures, that sense of agency mediated the difference in self-efficacy in media comparison studies [22]. This study is the first to use actual movement data to investigate the relationship between movement in VR and self-efficacy. Our data confirmed previous speculations that movement in VR could be the mechanism for increasing self-efficacy [22,93]. As the human brain is constantly making predictions about the environment, a possible explanation is that as more the participants explored the VR environment, the more predictions they made, and more often the predictions were confirmed, which contributed to increasing the sense of agency and self-efficacy [53,54,55,94]. Moreover, our study indicates that movements in VR have a greater impact on learning and self-efficacy than adding pauses to the experience. We replicated Ahn and colleagues’ findings [42], showing that adding pauses to reduce the possible cognitive load from the narrative did not influence presence or learning. We expanded this investigation by finding that content segmentation in VR had no effects on the factors motivating climate change behavior, suggesting that this could be a neutral strategy to reduce the amount of information at once in interventions heavy on content.
We also found that linking the VR narrative to “climate change”, a phrase that has become politicized [78], negatively affected learning compared to a neutral framing. Connecting it to a politicized term could lead people to associate the experience with a political experience and reduce trust, which could have reduced learning. Or, perhaps, the connection of the concept of climate change to feelings of overwhelm and anxiety [95] could elicit defensive psychological processes that could impair learning [74,95,96]. Moreover, our learning questions focused on OA, not climate change. That could have facilitated recall for participants in the OA conditions. In light of Lakoff and Johnson’s work [97] on metaphorical concepts and the human conceptual system, Dickinson and colleagues [74] suggest that when communicating about climate change, the message should form cognitive bridges to familiar concepts and prior experiences. In this sense, the OA framing could also have helped participants create bridges between the knowledge needed to understand the OA process. In contrast, the climate change framing may have facilitated connections to the broad concept of climate change instead of OA.
Our study also contributes to the research on political views and climate change [78,98,99], bringing empirical evidence of the relationship between political views and factors motivating behavior. Although our data show that political views did not directly influence behavior or knowledge, they influenced three factors motivating behavior indicated by van Valkengoed and Steg [14] as the most impactful ones: trust, risk perceptions, and beliefs. Participants with a liberal view reported higher trust, risk perception, and beliefs in climate change than more conservative participants, which is aligned with studies showing a positive correlation between liberal views and climate change acceptance [99,100,101,102,103]. Still, there was no significant difference between the degree to which conservatives and liberals engaged in climate change behavior, which is counter to other studies indicating that Democrats (liberal) are significantly more likely to have pro-climate attitudes and behaviors [102]. Although we do not have data to test this, one possibility is that the VR experience could have positively influenced conservatives concerning climate change behavior, which would result in the observed similarities between the two groups in terms of behavior after the experience. Although this study did not investigate how political views moderate the effect of VR on climate change behaviors, a future study can explore this.
Finally, our data indicate empirical evidence for van Valkengoed and Steng’s theoretical hypotheses that risk perception would mediate the relationships between knowledge and behavior and between trust and behavior [14]. Because VR can simulate future scenarios and trigger emotions, it can bring the often invisible but significant long-term climate change effects psychologically close, contributing to a better understanding of the risks of not acting on climate change. This way, VR could support climate change behavior by enhancing risk perception, and future studies should investigate this potential.

Limitations

Although this study was carefully crafted in consultation with experts in VR, psychology, climate change communication, marine biology, social sciences, and statistics, there are some limitations. First, this is a field study with multiple locations. Some locations were museums and aquariums with external noise and passersby around the VR experience. To reduce the influence of locations’ variation on the results, we controlled our models for the random effects of location. In addition, we used single-item measures to assess subjective measures other than learning. This decision was made after piloting the questionnaire on paper and the VR experience with the embedded questionnaire. During the pilots, participants often complained about the length of the questionnaire and the effort taken to answer it. To avoid having participants in VR for extended periods (that could cause discomfort) and increase the chance of participants answering all the questions, we followed [104] and the research of Allen and colleagues [105] on single-item assessment. The authors argue that single-item measures save respondents’ time and can be as valid as multiple items; hence, they should be used when time is a constraint, for example, when participants are volunteering in a museum.

5. Conclusions and Future Directions

The increase in climate change-related events and losses urges for effective and scalable interventions. Virtual reality has shown promising results in communicating climate change and enhancing pro-environmental behaviors. This study investigated how VR design can influence learning and factors motivating climate change behavior related to ocean acidification. We found that body movement and message framing affected learning and that risk perception mediated the relationship between learning and behavior. Our data showed that moving around during the VR experience increased participants’ feelings of self-efficacy but hindered learning, compared to having a seated experience. In addition, not connecting ocean acidification directly to climate change enhanced learning compared to a framing that explicitly made that connection. Finally, we found that learning and trust indirectly influenced climate change behavior via risk perception.
Given the complexity of learning about ocean acidification and climate change, more studies are needed to uncover the relationship between interaction in VR, learning, and climate change behavior. Future studies should explore multiple exposures and long-term effects of VR experiences on climate change learning and behaviors. They should also explore if having several VR experiences would influence unintended movement in VR, and how that would influence learning. Moreover, it is important to investigate how including segmentations that present an overview of what is being learned during the experience (as opposed to our silent segmentations) would influence learning. Finally, future studies should compare the effects of answering questions in VR with answering them on paper or on a computer on learning and subjective measures. With the fast advances in VR design and interactions, and the possibility to customize the experiences, future studies should also investigate how building personalized climate-related experiences can influence engagement and climate change behaviors.

Author Contributions

Conceptualization: A.C.M.Q., G.F., A.T.A. and J.N.B.; methodology: all authors; software: A.L.; validation: all authors; formal analysis: A.C.M.Q. and A.T.A.; investigation: all authors; resources: A.C.M.Q., G.F. and J.N.B.; data curation: A.C.M.Q., A.T.A. and A.L.; writing—original draft preparation: A.C.M.Q. and A.L.; writing—review and editing: all authors; visualization: A.C.M.Q.; supervision: J.N.B.; project administration: A.C.M.Q., G.F. and J.N.B.; funding acquisition: A.C.M.Q., G.F. and J.N.B. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by National Science Foundation (Award # 1907050) and Knut och Alice Wallenbergs Stiftelse (#20170440).

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of Helsinki and approved by the Institutional Review Board (or Ethics Committee) of Stanford University for studies involving humans.

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

Data will be available after publication at https://osf.io/phxar.

Acknowledgments

We thank the Stanford Accelerator for Learning, Tobin J. Asher, Shawnee Baughman, Krain Chen, Chris Dede, Aaleyah Lewis, Cairo Mo, Emily E. O’Neal, Andrew J. Pollack, Andrew L. Ying, the Museum at Prairiefire, Pacific Whale Foundation, St Joseph Academy, Boise School District (Idaho), VRKade, Marin’s Community School, XR Libraries, Churchill County High School, Monterey County Free Libraries, Barberton High School, Kent Denver School, University of Southampton, Maritime Museum & Aquarium, and Harvard University for their assistance in this study.

Conflicts of Interest

The authors declare no conflict of interest.

Appendix A

Table A1. Pre-registered hypotheses, data analysis results, and conclusions.
Table A1. Pre-registered hypotheses, data analysis results, and conclusions.
HypothesisSubhypothesisTest Statistic, Significance Level (Uncorrected), Effect Size, and Confidence IntervalResultConclusion
H1: Participants in segmented conditions will score higher for learning than participants in non-segmented conditions. F (1, 276) = 0.276
p = 0.599
η2 p < 0.001
[0.00, 0.02]
Not supportedThere was no significant difference in learning between having pauses or not during the experience.
H2: Participants in non-segmented conditions will score higher for presence than participants in segmented conditions. F (1, 292) = 0.042
p = 0.837
η2 p < 0.001
[0.00, 0.01]
Not supportedAdding pauses to the experience did not significantly influence participants’ feelings of presence.
H3: Participants in standing conditions will score higher for learning, behavior, concern, risk perception, causes, beliefs about increased carbon dioxide emissions, presence, self-efficacy, and trust than participants in seated conditions.(a) learningF (1, 289) = 0.210
p = 0.647
η2 p < 0.001
[0.00, 0.01]
Not supportedHaving a standing VR experience elicited higher feelings of presence and self-efficacy than having a seated VR experience.
(b) behaviorχ2(1) = 0.857
p = 0.354
Std. coef = −0.46
[−1.44, 0.51]
Not supported
(c) concernF (1, 223) = 0.065
p = 0.798
η2 p < 0.001
[0.00, 0.01]
Not supported
(d) risk perceptionF (1, 292) = 0.485
p = 0.487
η2 p < 0.01
[0.00, 0.02]
Not supported
(e) causesEstimate = 0.455
p = 0.347
Std. coef = 0.46
[−0.50, 1.41]
Not supported
(f) beliefs about increased carbon dioxide emissionsF (1, 292) = 0.003
p = 0.986
η2 p < 0.001
[0.00, 0.00]
Not supported
(g) presenceF (1, 292) = 4.541
p = 0.034
η2 p = 0.02
[0.00, 0.05]
Supported
(h) self-efficacyF (1, 292) = 12.540
p < 0.001
η2 p = 0.04
[0.01, 0.08]
Supported
(i) trustF (1, 143) = 1.632
p ≤ 0.203
η2 p = 0.01
[0.00, 0.06]
Not supported
H4: Participants in female-voiced conditions will score higher for learning than participants in male-voiced conditions. F (1, 275) = 0.004
p = 0.952
η2 p < 0.001
[0.00, 0.00]
Not supportedThe sex of the voice-over did not influence learning.
H5: Results for self-efficacy comparing female-voiced and male-voiced conditions will be gender-dependent, with females scoring higher than males in female-voiced conditions and vice versa.(a) women will score higher than men for self-efficacy in female-voiced narration conditionsF (1, 147) = 10.45
p = 0.001
η2 p = 0.07
[0.02, 0.14]
Not supportedMen scored higher for self-efficacy toward science than women, regardless of the sex of the voice-over.
(b) men will score higher than women for self-efficacy in male-voiced narration conditionsF (1, 143) = 9.261
p = 0.002
η2 p = 0.06
[0.01, 0.13]
Supported
H6: Participants in male-voiced conditions will score higher for trust than participants in female-voiced conditions. F (1, 289) = 0.526
p = 0.469
η2 p < 0.001
[0.00, 0.02]
Not supportedThe gender of the voice-over had no significant effect on how much participants trusted the information received.
H7: Participants in climate change framing conditions who score higher in the political spectrum (i.e., left/liberal) will score higher for learning, behavior, concern, risk perception, causes, beliefs about increased carbon dioxide emissions, and trust than participants that score lower in the political spectrum (i.e., right/conservative).(a) behaviorχ2(1) = 0.270
p = 0.869
Std. coef = 0.04
[−0.41, 0.50]
Not supportedParticipants with a tendency for a left/liberal political view scored higher for their risk perception, concern, and beliefs about OA and how much they trusted the information received than participants with a right/conservative political view.
(b) concernF (1, 149) = 5.044
p = 0.026
η2 p = 0.03
[0.00, 0.09]
Supported
(c) risk perceptionF (1, 150) = 22.533
p < 0.001
η2 p = 0.13
[0.06, 0.22]
Supported
(d) causesEstimate = 0.576
p = 0.007
Std. coef = 0.76
[0.21, 1.32]
Supported
(e) beliefsF (1, 150) = 4.756
p = 0.031
η2 p = 0.03
[0.00, 0.09]
Supported
(f) learningF (1, 146) = 0.103
p = 0.749
η2 p < 0.001
[0.00, 0.02]
Not supported
(g) trustF (1, 148) = 5.453
p = 0.021
η2 p = 0.04
[0.00, 0.10]
Supported
Note: We ran linear mixed-effects models to predict learning, concern, risk perception, beliefs about increased carbon dioxide emissions, presence, self-efficacy, and trust. For those models, partial eta squared (η2 p) with a 90% confidence interval (CI) was computed using sums of squares. For generalized mixed-effects models (models predicting climate change behavior) and ordinal logistic regressions (models predicting causes attributed to OA), standard coefficients were reported along with 95% CIs.

References

  1. Heating up. Nat. Clim. Chang. 2022, 12, 693. [CrossRef]
  2. Masson-Delmotte, V.; Zhai, P.; Pirani, A.; Connors, S.L.; Péan, C.; Berger, S.; Caud, N.; Chen, Y.; Goldfarb, L.; Gomis, M.I.; et al. (Eds.) IPCC Summary for Policymakers. In Climate Change 2021: The Physical Science Basis. Contribution of Working Group I to the Sixth Assessment Report of the Intergovernmental Panel on Climate Change; Cambridge University Press: Cambridge, UK, 2021; pp. 3–32. [Google Scholar]
  3. Burger, F.A.; Terhaar, J.; Frölicher, T.L. Compound Marine Heatwaves and Ocean Acidity Extremes. Nat. Commun. 2022, 13, 4722. [Google Scholar] [CrossRef] [PubMed]
  4. King, A.D.; Peel, J.; Ziehn, T.; Bowen, K.J.; McClelland, H.L.O.; McMichael, C.; Nicholls, Z.R.J.; Sniderman, J.M.K. Preparing for a Post-Net-Zero World. Nat. Clim. Chang. 2022, 12, 775–777. [Google Scholar] [CrossRef]
  5. McKinley, G.A.; Fay, A.R.; Eddebbar, Y.A.; Gloege, L.; Lovenduski, N.S. External Forcing Explains Recent Decadal Variability of the Ocean Carbon Sink. AGU Adv. 2020, 1, e2019AV000149. [Google Scholar] [CrossRef]
  6. Doney, S.C.; Fabry, V.J.; Feely, R.A.; Kleypas, J.A. Ocean Acidification: The Other CO2 Problem. Ann. Rev. Mar. Sci. 2009, 1, 169–192. [Google Scholar] [CrossRef] [Green Version]
  7. Doney, S.C.; Busch, D.S.; Cooley, S.R.; Kroeker, K.J. The Impacts of Ocean Acidification on Marine Ecosystems and Reliant Human Communities. Annu. Rev. Environ. Resour. 2020, 45, 83–112. [Google Scholar] [CrossRef]
  8. Goldenberg, S.U.; Nagelkerken, I.; Ferreira, C.M.; Ullah, H.; Connell, S.D. Boosted Food Web Productivity through Ocean Acidification Collapses under Warming. Glob. Chang. Biol. 2017, 23, 4177–4184. [Google Scholar] [CrossRef]
  9. Guest, H.; Lotze, H.K.; Wallace, D. Youth and the Sea: Ocean Literacy in Nova Scotia, Canada. Mar. Policy 2015, 58, 98–107. [Google Scholar] [CrossRef]
  10. Grothmann, T.; Patt, A. Adaptive Capacity and Human Cognition: The Process of Individual Adaptation to Climate Change. Glob. Environ. Chang. 2005, 15, 199–213. [Google Scholar] [CrossRef]
  11. Kasperson, R.E.; Renn, O.; Slovic, P.; Brown, H.S.; Emel, J.; Goble, R.; Kasperson, J.X.; Ratick, S. The Social Amplification of Risk: A Conceptual Framework. Risk Anal. 1988, 8, 177–187. [Google Scholar] [CrossRef] [Green Version]
  12. Lindell, M.K.; Perry, R.W. The Protective Action Decision Model: Theoretical Modifications and Additional Evidence. Risk Anal. 2012, 32, 616–632. [Google Scholar] [CrossRef]
  13. Renn, O. The Social Amplification/Attenuation of Risk Framework: Application to Climate Change. WIREs Clim. Chang. 2011, 2, 154–169. [Google Scholar] [CrossRef]
  14. van Valkengoed, A.M.; Steg, L. Meta-Analyses of Factors Motivating Climate Change Adaptation Behaviour. Nat. Clim. Chang. 2019, 9, 158–163. [Google Scholar] [CrossRef] [Green Version]
  15. Nisa, C.F.; Bélanger, J.J.; Schumpe, B.M.; Faller, D.G. Meta-Analysis of Randomised Controlled Trials Testing Behavioural Interventions to Promote Household Action on Climate Change. Nat. Commun. 2019, 10, 4545. [Google Scholar] [CrossRef] [Green Version]
  16. Nielsen, K.S.; Marteau, T.M.; Bauer, J.M.; Bradbury, R.B.; Broad, S.; Burgess, G.; Burgman, M.; Byerly, H.; Clayton, S.; Espelosin, D.; et al. Biodiversity Conservation as a Promising Frontier for Behavioural Science. Nat. Hum. Behav. 2021, 5, 550–556. [Google Scholar] [CrossRef]
  17. Mickle, T.; Chen, B.X. Apple Starts Connecting the Dots for Its next Big Thing. The New York Times, 26 June 2022. [Google Scholar]
  18. Bailenson, J.N. Experience on Demand: What Virtual Reality Is, How It Works, and What It Can Do, 1st ed.; W.W. Norton & Company: New York, NY, USA, 2018; ISBN 0393253694. [Google Scholar]
  19. Fauville, G.; Queiroz, A.C.M.; Bailenson, J.N. Chapter 5 - Virtual Reality as a Promising Tool to Promote Climate Change Awareness. In Technology and Health: Promoting Attitude and Behavior Change; Academic Press: Cambridge, MA, USA, 2020; pp. 91–108. ISBN 9780128169582. [Google Scholar] [CrossRef]
  20. Box-Steffensmeier, J.M.; Burgess, J.; Corbetta, M.; Crawford, K.; Duflo, E.; Fogarty, L.; Gopnik, A.; Hanafi, S.; Herrero, M.; Hong, Y.; et al. The Future of Human Behaviour Research. Nat. Hum. Behav. 2022, 6, 15–24. [Google Scholar] [CrossRef]
  21. Markowitz, D.M.; Laha, R.; Perone, B.P.; Pea, R.D.; Bailenson, J.N. Immersive Virtual Reality Field Trips Facilitate Learning about Climate Change. Front. Psychol. 2018, 9, 2364. [Google Scholar] [CrossRef]
  22. Queiroz, A.C.M.; Fauville, G.; Herrera, F.; da Leme, M.I.d.S.; Bailenson, J.N. Do Students Learn Better with Immersive Virtual Reality Videos Than Conventional Videos? A Comparison of Media Effects with Middle School Girls. Technol. Mind Behav. 2022, 3, 82. [Google Scholar] [CrossRef]
  23. Mirauda, D.; Capece, N.; Erra, U. Sustainable Water Management: Virtual Reality Training for Open-Channel Flow Monitoring. Sustainability 2020, 12, 757. [Google Scholar] [CrossRef] [Green Version]
  24. Makransky, G.; Mayer, R.E. Benefits of Taking a Virtual Field Trip in Immersive Virtual Reality: Evidence for the Immersion Principle in Multimedia Learning. Educ. Psychol. Rev. 2022, 34, 1771–1798. [Google Scholar] [CrossRef]
  25. Ahn, S.J.; Bostick, J.; Ogle, E.; Nowak, K.L.; McGillicuddy, K.T.; Bailenson, J.N. Experiencing Nature: Embodying Animals in Immersive Virtual Environments Increases Inclusion of Nature in Self and Involvement with Nature. J. Comput. Commun. 2016, 21, 399–419. [Google Scholar] [CrossRef]
  26. Nelson, K.M.; Anggraini, E.; Schlüter, A. Virtual Reality as a Tool for Environmental Conservation and Fundraising. PLoS ONE 2020, 15, e0223631. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  27. Fonseca, D.; Kraus, M. A Comparison of Head-Mounted and Hand-Held Displays for 360° Videos with Focus on Attitude and Behavior Change. In Proceedings of the Academic Mindtrek 2016—Proceedings of the 20th International Academic Mindtrek Conference, Tampere, Finland, 17–18 October 2016; pp. 287–296. [Google Scholar]
  28. Plechatá, A.; Morton, T.; Perez-Cueto, F.J.A.; Makransky, G. A Randomized Trial Testing the Effectiveness of Virtual Reality as a Tool for Pro-Environmental Dietary Change. Sci. Rep. 2022, 12, 14315. [Google Scholar] [CrossRef] [PubMed]
  29. Sundar, S.S.; Kang, J.; Oprean, D. Being There in the Midst of the Story: How Immersive Journalism Affects Our Perceptions and Cognitions. Cyberpsychol. Behav. Soc. Netw. 2017, 20, 672–682. [Google Scholar] [CrossRef] [PubMed]
  30. Lo, S.-C.; Tsai, H.-H. Design of 3D Virtual Reality in the Metaverse for Environmental Conservation Education Based on Cognitive Theory. Sensors 2022, 22, 8329. [Google Scholar] [CrossRef]
  31. Plechatá, A.; Morton, T.; Perez-Cueto, F.J.A.; Makransky, G. Why Just Experience the Future When You Can Change It: Virtual Reality Can Increase Pro-Environmental Food Choices Through Self-Efficacy. Technol. Mind Behav. 2022, 3. [Google Scholar] [CrossRef]
  32. Monroe, M.C.; Plate, R.R.; Oxarart, A.; Bowers, A.; Chaves, W.A. Identifying Effective Climate Change Education Strategies: A Systematic Review of the Research. Environ. Educ. Res. 2019, 25, 791–812. [Google Scholar] [CrossRef]
  33. Landrum, A.R.; Eaves, B.S.; Shafto, P. Learning to Trust and Trusting to Learn: A Theoretical Framework. Trends Cogn. Sci. 2015, 19, 109–111. [Google Scholar] [CrossRef]
  34. Sweller, J. Implications of Cognitive Load Theory for Multimedia Learning. Camb. Handb. Multimed. Learn. 2005, 3, 19–30. [Google Scholar] [CrossRef]
  35. Mayer, R.E.; Colvin Clark, R. Instructional Strategies for Receptive Learning Environments. In Handbook of Improving Performance in the Workplace; Wiley: New York, NY, USA, 2009; Volume 1–3, pp. 298–328. [Google Scholar]
  36. Clark, R.C.; Mayer, R.E. Learning by Viewing versus Learning by Doing: Evidence-Based Guidelines for Principled Learning Environments. Perform. Improv. 2008, 47, 5–13. [Google Scholar] [CrossRef]
  37. Mayer, R.E.; Moreno, R. Nine Ways to Reduce Cognitive Load in Multimedia Learning. Educ. Psychol. 2003, 38, 43–52. [Google Scholar] [CrossRef] [Green Version]
  38. Nelson, B.C.; Erlandson, B.E. Managing Cognitive Load in Educational Multi-User Virtual Environments: Reflection on Design Practice. Educ. Technol. Res. Dev. 2008, 56, 619–641. [Google Scholar] [CrossRef]
  39. Parong, J.; Mayer, R.E. Learning Science in Immersive Virtual Reality. J. Educ. Psychol. 2018, 110, 785–797. [Google Scholar] [CrossRef]
  40. Wang, Y.; Wang, F.; Mayer, R.E.; Hu, X.; Gong, S. Benefits of Prompting Students to Generate Summaries during Pauses in Segmented Multimedia Lessons. J. Comput. Assist. Learn. 2023. [Google Scholar] [CrossRef]
  41. Sanchez-Vives, M.V.; Slater, M. From Presence to Consciousness through Virtual Reality. Nat. Rev. Neurosci. 2005, 6, 332. [Google Scholar] [CrossRef]
  42. Ahn, S.J.; Nowak, K.L.; Bailenson, J.N. Unintended Consequences of Spatial Presence on Learning in Virtual Reality. Comput. Educ. 2022, 186, 104532. [Google Scholar] [CrossRef]
  43. Mayer, R.E.; Makransky, G.; Parong, J. The Promise and Pitfalls of Learning in Immersive Virtual Reality. Int. J. Human Comput. Interact. 2022. [Google Scholar] [CrossRef]
  44. Barsalou, L.W. Grounded Cognition. Annu. Rev. Psychol. 2008, 59, 617–645. [Google Scholar] [CrossRef] [Green Version]
  45. Glenberg, A.M. Embodiment as a Unifying Perspective for Psychology. WIREs Cogn. Sci. 2010, 1, 586–596. [Google Scholar] [CrossRef]
  46. Goldin-Meadow, S. Hearing Gesture; Harvard University Press: Cambridge, MA, USA, 2003; ISBN 9780674010727. [Google Scholar]
  47. Goldin-Meadow, S.; Cook, S.W.; Mitchell, Z.A. Gesturing Gives Children New Ideas About Math. Psychol. Sci. 2009, 20, 267–272. [Google Scholar] [CrossRef] [Green Version]
  48. Hostetter, A.B.; Alibali, M.W. Visible Embodiment: Gestures as Simulated Action. Psychon. Bull. Rev. 2008, 15, 495–514. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  49. Niedenthal, P.M.; Barsalou, L.W.; Winkielman, P.; Krauth-Gruber, S.; Ric, F. Embodiment in Attitudes, Social Perception, and Emotion. Personal. Soc. Psychol. Rev. 2005, 9, 184–211. [Google Scholar] [CrossRef] [PubMed]
  50. Stern, E. Embodied Cognition: A Grasp on Human Thinking. Nature 2015, 524, 158–159. [Google Scholar] [CrossRef] [Green Version]
  51. Clark, A. An Embodied Cognitive Science? Trends Cogn. Sci. 1999, 3, 345–351. [Google Scholar] [CrossRef] [PubMed]
  52. Kilteni, K.; Groten, R.; Slater, M. The Sense of Embodiment in Virtual Reality. Presence Teleoperators Virtual Environ. 2012, 21, 373–387. [Google Scholar] [CrossRef] [Green Version]
  53. David, N.; Newen, A.; Vogeley, K. The “Sense of Agency” and Its Underlying Cognitive and Neural Mechanisms. Conscious. Cogn. 2008, 17, 523–534. [Google Scholar] [CrossRef]
  54. Wahlheim, C.N.; Eisenberg, M.L.; Stawarczyk, D.; Zacks, J.M. Understanding Everyday Events: Predictive-Looking Errors Drive Memory Updating. Psychol. Sci. 2022, 33, 765–781. [Google Scholar] [CrossRef]
  55. Roselli, C.; Ciardo, F.; De Tommaso, D.; Wykowska, A. Human-Likeness and Attribution of Intentionality Predict Vicarious Sense of Agency over Humanoid Robot Actions. Sci. Rep. 2022, 12, 13845. [Google Scholar] [CrossRef]
  56. Bandura, A. Self-Efficacy in Changing Societies; Cambridge University Press: Cambridge, MA, USA, 1995. [Google Scholar]
  57. Moser, S.C. Communicating Climate Change: History, Challenges, Process and Future Directions. Wiley Interdiscip. Rev. Clim. Chang. 2010, 1, 31–53. [Google Scholar] [CrossRef]
  58. Crowelly, C.R.; Villanoy, M.; Scheutzz, M.; Schermerhornz, P. Gendered Voice and Robot Entities: Perceptions and Reactions of Male and Female Subjects. In Proceedings of the 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems, St. Louis, MO, USA, 10–15 October 2009; pp. 3735–3741. [Google Scholar]
  59. Ghazali, A.S.; Ham, J.; Barakova, E.I.; Markopoulos, P. Effects of Robot Facial Characteristics and Gender in Persuasive Human-Robot Interaction. Front. Robot. AI 2018, 5, 73. [Google Scholar] [CrossRef] [Green Version]
  60. Sandygulova, A.; O’Hare, G.M.P. Age- and Gender-Based Differences in Children’s Interactions with a Gender-Matching Robot. Int. J. Soc. Robot. 2018, 10, 687–700. [Google Scholar] [CrossRef]
  61. Nass, C.; Moon, Y.; Green, N. Are Machines Gender Neutral? Gender-Stereotypic Responses to Computers With Voices. J. Appl. Soc. Psychol. 1997, 27, 864–876. [Google Scholar] [CrossRef]
  62. Lee, E.J.; Nass, C.; Brave, S. Can Computer-Generated Speech Have Gender? An Experimental Test of Gender Stereotype. In Proceedings of the CHI ’00 Extended Abstracts on Human Factors in Computing Systems, The Hague, The Netherlands, 1–6 April 2000; Association for Computing Machinery: New York, NY, USA, 2000; pp. 289–290. [Google Scholar]
  63. Nass, C.; Moon, Y. Machines and Mindlessness: Social Responses to Computers. J. Soc. Issues 2000, 56, 81–103. [Google Scholar] [CrossRef]
  64. Khashe, S.; Lucas, G.; Becerik-Gerber, B.; Gratch, J. Buildings with Persona: Towards Effective Building-Occupant Communication. Comput. Human Behav. 2017, 75, 607–618. [Google Scholar] [CrossRef]
  65. Liu, S.R. Gendered Science Communication: The Role of Speaker Gender & Pitch in Perceived Credibility and Persuasion of Climate Science. Doctoral Dissertation, University of Pennsylvania, Philadelphia, PA, USA, 2022. [Google Scholar]
  66. Entman, R.M. Framing: Toward Clarification of a Fractured Paradigm. J. Commun. 1993, 43, 51–58. [Google Scholar] [CrossRef]
  67. Nisbet, M.C. Communicating Climate Change: Why Frames Matter for Public Engagement. Environ. Sci. Policy Sustain. Dev. 2009, 51, 12–23. [Google Scholar] [CrossRef]
  68. Boykoff, M.T. Who Speaks for the Climate?: Making Sense of Media Reporting on Climate Change; Cambridge University Press: Cambridge, UK, 2011. [Google Scholar]
  69. Morton, T.A.; Rabinovich, A.; Marshall, D.; Bretschneider, P. The Future That May (or May Not) Come: How Framing Changes Responses to Uncertainty in Climate Change Communications. Glob. Environ. Chang. 2011, 21, 103–109. [Google Scholar] [CrossRef]
  70. Whitmarsh, L.; Xenias, D.; Jones, C.R. Framing Effects on Public Support for Carbon Capture and Storage. Palgrave Commun. 2019, 5, 17. [Google Scholar] [CrossRef] [Green Version]
  71. Eslen-Ziya, H. Humour and Sarcasm: Expressions of Global Warming on Twitter. Humanit. Soc. Sci. Commun. 2022, 9, 240. [Google Scholar] [CrossRef]
  72. Davis, J.J. The Effects of Message Framing on Response to Environmental Communications. J. Mass Commun. Q. 1995, 72, 285–299. [Google Scholar] [CrossRef]
  73. Ahn, S.J.; Fox, J.; Dale, K.R.; Avant, J.A. Framing Virtual Experiences: Effects on Environmental Efficacy and Behavior Over Time. Commun. Res. 2015, 42, 839–863. [Google Scholar] [CrossRef]
  74. Dickinson, J.L.; Crain, R.; Yalowitz, S.; Cherry, T.M. How Framing Climate Change Influences Citizen Scientists’ Intentions to Do Something About It. J. Environ. Educ. 2013, 44, 145–158. [Google Scholar] [CrossRef]
  75. Diamond, E.; Urbanski, K. The Impact of Message Valence on Climate Change Attitudes: A Longitudinal Experiment. Environ. Commun. 2022, 16, 1046–1058. [Google Scholar] [CrossRef]
  76. Bain, P.G.; Hornsey, M.J.; Bongiorno, R.; Jeffries, C. Promoting Pro-Environmental Action in Climate Change Deniers. Nat. Clim. Chang. 2012, 2, 600–603. [Google Scholar] [CrossRef]
  77. Audretsch, D.B.; Feldman, M.P. R&D Spillovers and the Geography of Innovation and Production. Am. Econ. Rev. 1996, 86, 630–640. [Google Scholar]
  78. Cooke, S.L.; Kim, S.C. Exploring the “Evil Twin of Global Warming”: Public Understanding of Ocean Acidification in the United States. Sci. Commun. 2019, 41, 66–89. [Google Scholar] [CrossRef]
  79. Kahan, D.M. Ideology, Motivated Reasoning, and Cognitive Reflection: An Experimental Study. Judgm. Decis. Mak. 2012, 8, 407–424. [Google Scholar] [CrossRef]
  80. Guilbeault, D.; Becker, J.; Centola, D. Social Learning and Partisan Bias in the Interpretation of Climate Trends. Proc. Natl. Acad. Sci. USA 2018, 115, 9714–9719. [Google Scholar] [CrossRef] [Green Version]
  81. Google Google Sheets API Overview. Available online: https://developers.google.com/sheets/api (accessed on 10 March 2023).
  82. Fauville, G.; Strang, C.; Cannady, M.A.; Chen, Y.-F. Development of the International Ocean Literacy Survey: Measuring Knowledge across the World. Environ. Educ. Res. 2019, 25, 238–263. [Google Scholar] [CrossRef] [Green Version]
  83. Li, B.J.; Bailenson, J.N.; Pines, A.; Greenleaf, W.J.; Williams, L.M. A Public Database of Immersive VR Videos with Corresponding Ratings of Arousal, Valence, and Correlations between Head Movements and Self Report Measures. Front. Psychol. 2017, 8, 2116. [Google Scholar] [CrossRef]
  84. Kuznetsova, A.; Brockhoff, P.B.; Christensen, R.H.B. Package ‘Lmertest’. R Packag. Version 2015, 2, 734. [Google Scholar]
  85. Lüdecke, D.; Lüdecke, M.D. Package ‘SjPlot’. R Packag. Version 2015, 1. [Google Scholar]
  86. Fox, J.; Weisberg, S.; Adler, D.; Bates, D.; Baud-Bovy, G.; Ellison, S.; Firth, D.; Friendly, M.; Gorjanc, G.; Graves, S.; et al. Package ‘Car’. Vienna R Found. Stat. Comput. 2012, 16. [Google Scholar]
  87. Vatcheva, K.P.; Lee, M.; McCormick, J.B.; Rahbar, M.H. Multicollinearity in Regression Analyses Conducted in Epidemiologic Studies. Epidemiology 2016, 6, 227. [Google Scholar] [CrossRef] [Green Version]
  88. Ben-Shachar, M.S.; Lüdecke, D.; Makowski, D. Effectsize: Estimation of Effect Size Indices and Standardized Parameters. J. Open Source Softw. 2020, 5, 2815. [Google Scholar] [CrossRef]
  89. Lakens, D. Calculating and Reporting Effect Sizes to Facilitate Cumulative Science: A Practical Primer for t-Tests and ANOVAs. Front. Psychol. 2013, 4, 863. [Google Scholar] [CrossRef] [Green Version]
  90. Villena-Taranilla, R.; Tirado-Olivares, S.; Cózar-Gutiérrez, R.; González-Calero, J.A. Effects of Virtual Reality on Learning Outcomes in K-6 Education: A Meta-Analysis. Educ. Res. Rev. 2022, 35, 100434. [Google Scholar] [CrossRef]
  91. Jensen, L.; Konradsen, F. A Review of the Use of Virtual Reality Head-Mounted Displays in Education and Training. Educ. Inf. Technol. 2018, 23, 1515–1529. [Google Scholar] [CrossRef] [Green Version]
  92. Queiroz, A.C.M.; Tori, R.; Moreira, N.A.; da Silva Leme, M.I. Using HMD-Based Immersive Virtual Environments in Primary/K-12 Education. Commun. Comput. Inf. Syst. 2018, 840, 160–173. [Google Scholar]
  93. Makransky, G.; Petersen, G.B. The Cognitive Affective Model of Immersive Learning (CAMIL): A Theoretical Research-Based Model of Learning in Immersive Virtual Reality. Educ. Psychol. Rev. 2021, 33, 937–958. [Google Scholar] [CrossRef]
  94. Heilbron, M.; Armeni, K.; Schoffelen, J.-M.; Hagoort, P.; de Lange, F.P. A Hierarchy of Linguistic Predictions during Natural Language Comprehension. Proc. Natl. Acad. Sci. USA 2022, 119, e2201968119. [Google Scholar] [CrossRef]
  95. Dickinson, J.L. The People Paradox: Self-Esteem Striving, Immortality Ideologies, and Human Response to Climate Change. Ecol. Soc. 2009, 14, 34. [Google Scholar] [CrossRef] [Green Version]
  96. Pyszczynski, T.; Greenberg, J.; Solomon, S. A Dual-Process Model of Defense against Conscious and Unconscious Death-Related Thoughts: An Extension of Terror Management Theory. Psychol. Rev. 1999, 106, 835–845. [Google Scholar] [CrossRef] [PubMed]
  97. Lakoff, G.; Johnson, M. The Metaphorical Structure of the Human Conceptual System. Cogn. Sci. 1980, 4, 195–208. [Google Scholar] [CrossRef]
  98. Krange, O.; Kaltenborn, B.P.; Hultman, M. “Don’t Confuse Me with Facts”—How Right Wing Populism Affects Trust in Agencies Advocating Anthropogenic Climate Change as a Reality. Humanit. Soc. Sci. Commun. 2021, 8, 255. [Google Scholar] [CrossRef]
  99. Sparkman, G.; Geiger, N.; Weber, E.U. Americans Experience a False Social Reality by Underestimating Popular Climate Policy Support by Nearly Half. Nat. Commun. 2022, 13, 4779. [Google Scholar] [CrossRef]
  100. Abeles, A.T.; Howe, L.C.; Krosnick, J.A.; MacInnis, B. Perception of Public Opinion on Global Warming and the Role of Opinion Deviance. J. Environ. Psychol. 2019, 63, 118–129. [Google Scholar] [CrossRef]
  101. Ehret, P.J.; Van Boven, L.; Sherman, D.K. Partisan Barriers to Bipartisanship: Understanding Climate Policy Polarization. Soc. Psychol. Personal. Sci. 2018, 9, 308–318. [Google Scholar] [CrossRef] [Green Version]
  102. McCright, A.M. Political Orientation Moderates Americans’ Beliefs and Concern about Climate Change. Clim. Chang. 2011, 104, 243–253. [Google Scholar] [CrossRef]
  103. McCright, A.M.; Dunlap, R.E. The Politicization of Climate Change and Polarization in the American Public’s Views of Global Warming, 2001–2010. Sociol. Q. 2011, 52, 155–194. [Google Scholar] [CrossRef]
  104. Bergkvist, L. Appropriate Use of Single-Item Measures Is Here to Stay. Mark. Lett. 2015, 26, 245–255. [Google Scholar] [CrossRef]
  105. Allen, M.S.; Iliescu, D.; Greiff, S. Single Item Measures in Psychological Science: A Call to Action. Eur. J. Psychol. Assess. 2022, 38, 1–5. [Google Scholar] [CrossRef]
Figure 1. Study setup and conditions. (A) Data recording procedure: participants’ subjective and movement data were recorded in real time to an online spreadsheet using the Google Sheets API and then accessed through the researcher’s computer. (B) Equipment used in the study: (1) HTC Vive headset, (2) hand controllers, (3) headphones. (C) Combinations of the manipulation variables in a 2x2x2x2 design. Colored cells show the presence of the manipulation: movement (seated vs. standing), experience segmentation (non-segmented vs. segmented), voice-over (male vs. female), and framing (climate change vs. OA).
Figure 1. Study setup and conditions. (A) Data recording procedure: participants’ subjective and movement data were recorded in real time to an online spreadsheet using the Google Sheets API and then accessed through the researcher’s computer. (B) Equipment used in the study: (1) HTC Vive headset, (2) hand controllers, (3) headphones. (C) Combinations of the manipulation variables in a 2x2x2x2 design. Colored cells show the presence of the manipulation: movement (seated vs. standing), experience segmentation (non-segmented vs. segmented), voice-over (male vs. female), and framing (climate change vs. OA).
Sustainability 15 05814 g001
Figure 2. The Stanford Ocean Acidification Experience images. (A) Visualizing carbon dioxide molecules spilled by vehicle exhaust pipes. (B) Representation of the chemical reaction between carbon dioxide and water to create a carbonic acid molecule. (C) Flags used to count sea snails in a healthy coral reef. (D) Unhealthy coral reef.
Figure 2. The Stanford Ocean Acidification Experience images. (A) Visualizing carbon dioxide molecules spilled by vehicle exhaust pipes. (B) Representation of the chemical reaction between carbon dioxide and water to create a carbonic acid molecule. (C) Flags used to count sea snails in a healthy coral reef. (D) Unhealthy coral reef.
Sustainability 15 05814 g002
Figure 3. Body movements: yaw, pitch, roll, and translation.
Figure 3. Body movements: yaw, pitch, roll, and translation.
Sustainability 15 05814 g003
Figure 4. Learning scores per framing condition. Questions’ wording is shown in Table 1.
Figure 4. Learning scores per framing condition. Questions’ wording is shown in Table 1.
Sustainability 15 05814 g004
Figure 5. Visual representations of the relationships between head translation and learning and head translation and self-efficacy. The blue line shows a linear regression between the variables.
Figure 5. Visual representations of the relationships between head translation and learning and head translation and self-efficacy. The blue line shows a linear regression between the variables.
Sustainability 15 05814 g005
Table 1. Subjective measures’ questions.
Table 1. Subjective measures’ questions.
VariableQuestionCoding
Learning1. The ocean absorbs and stores which of the following from the atmosphere?0 (incorrect) or 1 (correct)
Learning2. Which of the following causes ocean acidification?0 (incorrect) or 1 (correct)
Learning3. Which of the following is a result of human-caused carbon dioxide emissions?0 (incorrect) or 1 (correct)
Learning4. Clams, oysters, and other marine organisms use the carbon dissolved in the ocean to:0 (incorrect) or 1 (correct)
Learning5. The formula for carbonic acid is:0 (incorrect) or 1 (correct)
Learning6. Which human activity contributes a significant amount to greenhouse gas emissions?0 (incorrect) or 1 (correct)
Learning7. What can scientists observe in the rocky reef off the coast of Naples, Italy?0 (incorrect) or 1 (correct)
Learning8. How does ocean acidification impact all shelled species?0 (incorrect) or 1 (correct)
Subjective knowledgeAfter this experience, how much, if anything, would you say you know about ocean acidification?5-point Likert scale: 1 (nothing) to 5 (a great deal)
ConcernHow concerned, if at all, are you about the health of the ocean?5-point Likert scale: 1 (not at all) to 5 (extremely)
Risk perceptionHow serious of a problem do you think the increased amount of carbon dioxide in the atmosphere is for the health of the ocean?5-point Likert scale: 1 (not at all) to 5 (extremely)
BeliefsDo you think the amount of carbon dioxide in the atmosphere has been going up over the past 100 years, or do you think this has not been happening?4-point Likert scale: 1 (definitely not) to 4 (definitely yes)
CausesThe increased amount of carbon dioxide in the atmosphere was caused:Ordinal response: (1) mostly by natural causes; (2) about equally by things people did and natural causes; (3) mostly by things people did.
Self-efficacyHow confident are you that you can understand most complex material in science courses?5-point Likert scale: 1 (not at all) to 5 (extremely)
PresenceTo what extent did you feel you were really inside the virtual world?5-point Likert scale: 1 (not at all) to 5 (very strongly)
TrustHow much do you trust the information that you got from this virtual reality experience?5-point Likert scale: 1 (not at all) to 5 (completely)
Political viewSome people talk about politics in terms of left, center, and right. On a left–right scale from 0 to 6, with 0 indicating extreme left (or extreme liberal) and 6 indicating extreme right (or extreme conservative), where would you place yourself?From 1 (extreme right/conservative) to 7 (extreme left/liberal)
PetitionPeople have started the following petition to ask the international community to take action to combat ocean acidification. Please read the petition. You will then have an opportunity to sign it.
Tell the United Nations: It Is Time to Address Ocean Acidification
Dear Secretary General Guterres,
Right now, the ocean absorbs about a quarter of all carbon dioxide emissions, and this carbon dioxide changes the chemistry of the ocean. Without intervention, the ocean’s acidity level is expected to more than double by 2100. This will negatively impact shellfish, coral reefs, and all the people and organisms around the globe that depend on them. It is time for the United Nations to take meaningful steps to address ocean acidification.
With scientific and technological advancements we, as a global community, can address this pressing issue. Please dedicate significant funding to support an international research agenda that aims to address and understand the threats we face from ocean acidification.
You can sign this petition in the space below by holding down the trigger button. Signing this petition is completely optional, and your decision to sign or not sign will not affect your ability to continue participation in the research. Finally, your name will not be collected by us or connected with any of your survey responses.
0 (not signed) or 1 (signed)
Table 2. Participants’ location, gender, and race.
Table 2. Participants’ location, gender, and race.
Countryn = 305Gendern = 305Racen = 305
U.S.262 (85.9%)Woman171 (56%)Afro-American16 (5.2%)
Denmark20 (6.6%)Man132 (43.3%)Chinese15 (4.9%)
Canada16 (5.2%)Other2 (0.7%)Filipino3 (1.0%)
U.K.7 (2.3%) Hispanic/Latinx11 (3.6%)
Indian10 (3.3%)
Japanese3 (1.0%)
Korean4 (1.3%)
Mexican11 (3.6%)
Middle Eastern10 (3.3%)
Native American7 (2.3%)
Southeast Asian15 (4.9%)
White176 (58%)
More than one7 (2.3%)
Decline to answer8 (2.6%)
Unknown9 (3.0%)
Table 3. Means and standard deviations of subjective measures per manipulated variable.
Table 3. Means and standard deviations of subjective measures per manipulated variable.
SegmentationMovementVoice-OverFraming
VariablesNon-Segmented
(n = 140)
Segmented
(n = 165)
Seated
(n = 92)
Standing
(n = 213)
Female
(n = 156)
Male
(n = 149)
Climate Change
(n = 159)
Ocean Acidification
(n = 146)
MSDMSDMSDMSDMSDMSDMSDMSD
Learning0.770.210.790.230.830.180.760.230.770.230.790.220.760.230.800.21
Self-efficacy3.340.933.341.003.090.953.450.963.300.923.381.023.330.983.350.96
Behavior0.810.390.840.370.910.280.790.410.840.370.820.390.860.350.800.40
Presence3.760.873.800.913.580.923.870.863.700.903.870.883.750.883.810.91
Trust4.130.784.100.784.010.724.160.804.100.764.120.804.120.814.100.74
Concern3.960.903.980.884.000.853.960.913.940.874.010.914.030.903.900.88
Risk perception4.370.704.390.764.460.624.350.784.380.704.380.774.410.714.350.76
Beliefs3.660.543.740.523.730.473.690.563.660.583.750.463.730.523.680.54
Note: M and SD are used to represent mean and standard deviation, respectively. Variable ranges: learning (0–1), self-efficacy (1–5), behavior (0–1), presence (1–5), trust (1–5), concern (1–5), risk perception (1–5), beliefs (1–4).
Table 4. Means, standard deviations, and correlations with confidence intervals.
Table 4. Means, standard deviations, and correlations with confidence intervals.
VariableMSD12345678
1. Knowledge0.780.22
2. Self-efficacy3.340.970.14 *
[0.02, 0.24]
3. Presence3.780.890.010.18 **
[−0.10, 0.12][0.07, 0.28]
4. Trust4.110.780.110.23 **0.25 **
[−0.00, 0.22][0.12, 0.33][0.15, 0.36]
5. Concern3.970.890.32 **0.21 **0.29 **0.30 **
[0.21, 0.41][0.10, 0.32][0.18, 0.39][0.19, 0.40]
6. Risk perception4.380.740.27 **0.20 **0.18 **0.40 **0.58 **
[0.16, 0.37][0.09, 0.30][0.07, 0.29][0.30, 0.49][0.50, 0.65]
7. Beliefs3.700.530.36 **0.16 **0.12 *0.26 **0.39 **0.48 **
[0.26, 0.46][0.05, 0.27][0.00, 0.22][0.16, 0.37][0.29, 0.48][0.38, 0.56]
8. Behavior0.830.380.14 *−0.07−0.000.21 **0.21 **0.25 **0.21 **
[0.03, 0.25][−0.04, 0.18][−0.12, 0.11][0.10, 0.32][0.10, 0.32][0.14, 0.35][0.10, 0.31]
9. Political view4.391.260.23 **−0.10−0.12 *0.090.19 **0.31 **0.22 **0.14 *
[0.12, 0.33][−0.21, 0.01][−0.23, −0.00][−0.02, 0.20][0.08, 0.30][0.20, 0.41][0.11, 0.33][0.03, 0.25]
Note: M and SD are used to represent mean and standard deviation, respectively. Values in square brackets indicate the 95% confidence interval for each correlation. * indicates p < 0.05. ** indicates p < 0.01. Columns numbered 1–8 refer to the corresponding variables listed in the first column (e.g., 5 refers to 5. Concern).
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Queiroz, A.C.M.; Fauville, G.; Abeles, A.T.; Levett, A.; Bailenson, J.N. The Efficacy of Virtual Reality in Climate Change Education Increases with Amount of Body Movement and Message Specificity. Sustainability 2023, 15, 5814. https://doi.org/10.3390/su15075814

AMA Style

Queiroz ACM, Fauville G, Abeles AT, Levett A, Bailenson JN. The Efficacy of Virtual Reality in Climate Change Education Increases with Amount of Body Movement and Message Specificity. Sustainability. 2023; 15(7):5814. https://doi.org/10.3390/su15075814

Chicago/Turabian Style

Queiroz, Anna C. M., Géraldine Fauville, Adina T. Abeles, Aaron Levett, and Jeremy N. Bailenson. 2023. "The Efficacy of Virtual Reality in Climate Change Education Increases with Amount of Body Movement and Message Specificity" Sustainability 15, no. 7: 5814. https://doi.org/10.3390/su15075814

APA Style

Queiroz, A. C. M., Fauville, G., Abeles, A. T., Levett, A., & Bailenson, J. N. (2023). The Efficacy of Virtual Reality in Climate Change Education Increases with Amount of Body Movement and Message Specificity. Sustainability, 15(7), 5814. https://doi.org/10.3390/su15075814

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop