University Students’ Emotions When Using E-Portfolios in Virtual Education Environments

: This paper is based on a study that aims to understand the emotions students feel when they use the e-portfolio to manage their learning and assessment. The sample was composed of 358 students, and the instrument used was an ad hoc questionnaire. The students were asked to indicate the degree to which they experienced a set of emotions when using the e-portfolio. From the results obtained, it can be concluded that positive emotions are foremost and above average, ranked as follows from strongest to weakest: freedom, motivation, curiosity, and inquiry. The students evaluated negative emotions (disorientation and waste of time) as experienced less strongly. The results point out that younger students feel more comfortable with the use of technologies and speciﬁcally with the e-portfolio. In addition, men experienced the emotion “freedom” more than women. On the other hand, students in the third year of their respective degree programs experienced “freedom”, “curiosity”, and “inquiry” when using the e-portfolio to manage their learning. A clear relationship thus exists between emotions, motivation, and e-portfolio use, which appears to conﬁrm that work in virtual contexts with this strategy stimulates student motivation. students during the use of e-portfolios in learning. The results show that positive emotions are foremost and above average, ranked as follows from strongest to weakest: freedom, motivation, curiosity, and inquiry. According to our study, the students responded that they experienced negative


Introduction
We live in a world where constant change and adaptation have altered our way of seeing society, the world, and our interactions. The COVID-19 pandemic is having an especially powerful impact on education, particularly in methodological strategies and their practical implications for university classrooms.
Higher education institutions worldwide are having to shift from classroom to online teaching environments in a very short time. This change is a challenge for teachers, who must find new teaching methodologies to make teaching and learning processes flexible while fostering autonomous work and strengthening students' commitment to their own learning process [1]. Information and communication technologies (ICTs) are a key element in facing this challenge to construct environments that facilitate communication and the exchange of learning experiences between teachers and students [2]. Now is a good time for faculties to begin the process of reflecting on the methodological change involved in developing university teaching that fosters the use of virtual environments in combination with classroom spaces to maximize the benefit of both [3,4]. Such methods must also seek flexible, dynamic, autonomous learning experiences in which students participate actively.
To achieve this goal, this article focuses on one experience, in which the digital portfolio or e-portfolio is used as a learning and assessment tool.

Theoretical Framework
Among various definitions, the portfolio has been defined as "an organized compilation of documents or artifacts that can be used to demonstrate knowledge, skills, values and/or achievements which contains a commentary or exegesis to explain the relevance, The emotions analyzed in this study are both positive (freedom, motivation, curiosity, and inquiry) and negative (disorientation and waste of time). These six emotions are used in similar studies performed in contexts of higher education similar to ours (Table 1). Table 1. Emotions analyzed in the study.

Most Prominent Emotions Research
Negative Disorientation
According to this classification, positive emotions are those that ensure well-being, but the act of classifying emotions into positive and negative does not imply that they are "good" and "bad": both positive and negative emotions are important in people's behavior [42]. Taking an evolutionary perspective, Robert Plutchik asserts that states of feeling tend to be followed by impulses to action: emotion is a chain of events and part of a social regulation process [43]. Some emotions incite us to act, while others paralyze us [42].
These studies (Table 1) show that the main emotions experienced during the use of different methodological strategies tend more toward a level of emotional well-being rather than of ill-being [36,37]. In these studies, affective states such as happiness, excitement, pleasure, and pride (considered affective states of motivation) predominate [29]. There is also a deep positive feeling of anticipation and enthusiasm when students participate in teaching-learning activities [39]. The studies also show that indirect learning activities (less similar to real situations) and interactive activities (in teams) are associated with lower levels of anxiety [29,39].
As a whole, the existing research suggests that positive emotional experiences play an important role in shaping academic performance and can have a considerable impact on students' cognition, behavior, and, ultimately, success in the academic realm [9,13].
The emotional dimension has been shown to be a very important factor in teachinglearning processes. In fact, with regard to e-learning and distance learning, and especially interesting line of study has been opened on the emotional relation to new learning tools and content [44][45][46]. This new line of research focuses on resistance, attitudes, and emotions related to the use of technologies as a learning resource. More research is needed, however, on the wide variety of emotions that arise and the relations between them.
To advance knowledge in this field, this study analyzes the different emotions students experience in preparing an e-portfolio in a virtual teaching and learning environment.
The objectives of this study are: (a) to describe the emotions the students experience; (b) to determine the differences according to the participants' sociodemographic, academic, and relational variables: age, sex, academic year, degree program, course in which they were enrolled, and subject; and (c) to analyze the possible relationships between the variables studied.
This article enables us to find out what emotions are experienced by students during the use of the e-portfolio and to discover their interrelations. The aim is thus to better understand the learning processes that are developed with the aid of e-portfolios, thereby contributing to the improvement of their implementation as a didactic strategy.

Materials and Methods
The study presented here adopted a descriptive-exploratory design with a crosssectional, quantitative focus. This design and method were chosen due to the study's use of a survey as the data collection instrument to approximate reality in an objective and generalizable way [47].

Participants
The sample was selected using nonprobability convenience sampling [48]. Participants were accessed through the classroom in which the experience with e-portfolios occurred.
The sample was composed of 358 students enrolled in different subjects during the academic years 2018/2019 and 2019/2020, in undergraduate degree programs at the University of Granada (Spain) in Primary Education, Early Childhood Education, Social Education, Pedagogy, and Speech Therapy. The sample was significant, with a sampling error of less than 3% [49]. Table 1 presents all of the sociodemographic and academic data in the sample.

Study Design and Instruments
The instrument used was an ad hoc questionnaire [50,51]. The emotions analyzed were both positive (freedom, motivation, curiosity, and inquiry) and negative (disorientation and waste of time), as explained in the introduction.
The students were asked to indicate the degree to which they experienced the emotions proposed when using the e-portfolio. They recorded their responses on the following Likert scale: 1 "Not at all", 2 "A little", 3 "Somewhat", 4 "Quite a lot", and 5 "A lot". Version of questionnaire can be found in Appendix A. The instrument used was subjected to validity testing through exploratory factor analysis (EFA) to determine the scale's goodness of fit and validity [52]. Confirmatory factor analysis (CFA) established the validity and reliability of the model fit [53].
The model obtained through the EFA produced two factors that explained 71% of the variance. Psychometric properties with values of NNFI (non-normed fit index) (0.986), CFI (comparative fit index) (0.996), GFI (goodness of fit index) (0.998), AGFI (adjusted goodness of fit index) (0.993), and RMSEA (root mean square error of approximation) (0.043) indicated an excellent fit and an acceptable model. CFA confirmed the factor structure obtained, producing the values for the RMSEA (0.039), SRMR (standardized root mean squared residual) (0.032), CFI (0.972), and TLI (Tucker-Lewis index) (0.948). The consistency of the two factors may be considered as highly reliable for values of 0.950 for Factor 1 (positive emotions) and 0.892 for Factor 2 (negative emotions). The results obtained indicate that the instrument used was highly valid and reliable for determining the emotions the students experienced when using ICT methodologies such as the e-portfolio [54][55][56].

Procedure
To ensure that the research was reliable and responsible, the study followed the ethical guidelines established by the research team's university (no. 192/CEIH/2020). The study was performed in the following phases. First, the researchers determined the sample needed to perform the study. A meeting was then held with the professors teaching the undergraduate courses to obtain access to the sample. The professors provided the team permission to perform the study, enabling the researchers to select the sample and create and complete the instrument with the participants' informed consent.
In the second phase, the researchers informed the students of the study goals and assured them that their participation would be voluntary and anonymous. The researchers also explained the procedure for accessing the online questionnaire, located on the University of Granada's PRADO platform. Students who wished to complete the questionnaire had one week to do so. Figure 1 shows the procedure followed in this study.

Data Analysis
The statistical package IBM SPSS version 24 was used for the data analysis, as it was appropriate for the study objectives. The packages Factor Analysis version 10.10.01 and CFA [57] (M-PLUS) were used to validate the instrument employed [38]. First, to achieve the objectives, descriptive (mean and standard deviation) and frequency analyses were performed to characterize the sample. Second, the sample was tested for normality and homogeneity. The results indicated that we should proceed to the nonparametric statistic because Kolmogorov-Smirnov's test obtained results below 0.05. Third, to examine the comparisons between groups, we performed the Mann-Whitney u test for the variables age, sex, and academic year, and the Kruskal-Wallis test for the variables degree program, year in degree program, course, and subject. The goal was to define which groups showed significant differences between each other according to the variables studied. Finally, we calculated the Spearman nonparametric rank correlation to determine the relationship between the different emotions the students experienced. Table 3 presents the descriptive results for the different emotions the students experienced while using the e-portfolio. As the data show, the emotions the students experienced were mostly positive. The students responded that they experienced "some" emotions, such as freedom (3.91), motivation (3.63), curiosity (3.80), and inquiry (3.73) while using the e-portfolio for their learning. They also experienced disorientation (2.78) and waste of time (2.07) but to a lesser extent. We found statistically significant differences based on age in the students' experience of both positive and negative emotions (Table 4). Students aged 23 or older experienced a greater sensation of "waste of time" (Z = −2.73, p < 0.05). Although both groups experienced "some" feeling of "curiosity", students aged 18-22 were the primary group indicating this feeling (Z = −2.02, p < 0.05). Regarding sex (Table 5), statistically significant differences were only obtained for the feeling of "freedom" (Z = −2.71, p < 0.05). The men stated that they experienced considerably more freedom than the women when using the e-portfolio to manage their learning. If we examine the academic year during which the students were enrolled at the time of the survey, we find statistically significant differences in all emotions except "motivation" ( Table 6). Students enrolled in the academic year 2018-2019 experienced more "freedom" (Z = −2.24, p < 0.05), "curiosity" (Z = −2.71, p < 0.05), and "inquiry" (Z = −2.17, p < 0.05) from use of the e-portfolio to manage their learning than the students registered in 2019-2020. The students registered in 2019-2020, in contrast, indicated that they were more disoriented (Z = −2.78, p < 0.05) and considered the use of the e-portfolio as a "waste of time" (Z = −2.14, p < 0.05). When applying an independence hypothesis test between belonging to one of the degree programs (Primary Education, Early Childhood Education, Social Education, Pedagogy, and Speech Therapy) and experiencing emotions when using the e-portfolio (Table 7), we observed statistically significant differences in the feelings of "curiosity" (χ2 = 12.404, p < 0.05) and "inquiry" (χ2 = 10.586, p < 0.05). Students in the degree program of Pedagogy indicated that they felt more "curiosity" (4.05) and "inquiry" (3.98) when using the e-portfolio to manage their learning than did students in the other degree programs. The results by academic year (see Table 8) show the following differences in positive emotions: "freedom" (χ2 = 7.852 p < 0.05), "curiosity" (χ2 = 11.236, p < 0.05), and "inquiry" (χ2 = 14.269, p < 0.05). Students in the third year of their respective degree programs experienced primarily emotions such as "freedom" (4.20), "curiosity" (4.13), and "research" (4.16) when using the e-portfolio to manage their learning. The results for the subjects in which the e-portfolio was applied as a teachinglearning strategy (Table 9) show differences in negative emotions, such as "disorientation" (χ2 = 25.956, p < 0.05) and "waste of time" (χ2 = 27.147, p < 0.05), and in positive emotions, such as "freedom" (χ2 = 17.788, p < 0.05) and "motivation" (χ2 = 16.510, p < 0.05). Students in "School and Classroom Organization in Early Childhood Education" experienced greater disorientation (3.29), followed by students in "General Didactics" (3.04). We observe lower levels of positive feeling among students in "Optimization of Development and Workplace Risk Prevention". The e-portfolio was most strongly felt to be a "waste of time" by students in "School and Classroom Organization in Early Childhood Education" (2.82), followed by students in "Didactics of Early Childhood Education" (2.36) and, to a lesser extent, students in "Employability, Training, and Work Placement" (1.67). The positive feeling of "freedom" was experienced primarily by students in "Employability, Training, and Work Placement" (4.27), followed by those in "Didactic-Technological Resources Applied to Ed." (4.09) and "Optimization of Development and Workplace Risk Prevention" (4.09). The least emotion was felt by students in "School and Classroom Organization in Early Childhood Education" (3.49). Motivation was experienced primarily by students in "Employability, Training, and Work Placement" (3.94). The least motivation was felt by the students in "School Context and Speech Therapy".
The findings thus show that as students' experience of emotions such as "motivation" and "curiosity" increase, their feeling of "inquiry" in using the e-portfolio to manage their learning also increases.

Discussion
According to the theoretical background, the e-portfolio increases students' participation in their learning in a systematic and organized way [58]. Moreover, this involvement encourages continuous and systematized reflection, making students aware of their starting point, their planning, the establishment and modification of goals, the learning process, and the evaluation of the final product. Although this whole process is guided and planned by the teacher [59], sharing the responsibility for learning with the students can generate different emotions in them. However, the use of e-portfolios does not entail the direct construction of knowledge.
This article seeks to show the emotions that students feel in their learning processes because, according to the literature, this could have some implications for their performance. In fact, recent studies suggest that one of the main differences between successful and unsuccessful students lies in their ability to regulate emotions [60].
Our study describes the emotions experienced by students during the use of eportfolios in learning. The results show that positive emotions are foremost and above average, ranked as follows from strongest to weakest: freedom, motivation, curiosity, and inquiry. According to our study, the students responded that they experienced negative emotions (disorientation and waste of time) less strongly. These results agree with those obtained by Rebollo et al. [39], who also find a greater presence and variety of positive than negative emotions associated with online learning.
The emotion of "freedom" that students experience to a major degree can show that students are comfortable in their role as knowledge builders through the e-portfolio. This feeling implies that students are in a position to control their learning and are free to handle their own reflection processes. The e-portfolio also provides a significant environment for continuing to perform the cyclical process of self-regulation: forethought, performance, and self-reflection [61,62].
Furthermore, the digital media used in the e-portfolio can vary greatly. Choice of one medium or another depends on the learning context. Teachers can even encourage students to look for new tools that allow them to document their own evidence of their learning. That is, the teacher may include only a digital medium in which students can record their evidence (e.g., a blog) or save their documents or other evidence on the cloud through different tools, increasing this feeling of freedom. In the latter case, students can explore and discover for themselves the best way to represent their work and illustrate their learning outcomes [63].
Most students stated that building the e-portfolio was not a "waste of time". The e-portfolio is a useful tool both for the teacher and their teaching and for the student and their learning. It is therefore a medium that brings together reflection and collaboration from both teacher and student [63].
By age, students 23 or older in our study experienced the e-portfolio as a "waste of time", in contrast to the 18-22 age group, which experienced primarily "curiosity". According to these results, we could conclude that the influence of age is similar to that predicted by the factors generating the digital gap incompetence in ICT use [64][65][66]. Based on this gap, younger students would feel more comfortable with the use of technologies and specifically with the e-portfolio.
The variable identifying sex also showed significant differences in the emotion "freedom" in the results of our study. Men experienced this emotion to a greater extent than women, perhaps due to men's greater consumption of technologies and the different use each sex makes of them (sex gap) [67].
By academic year, the data obtained indicate that the students enrolled in 2018/2019 experienced freedom, curiosity, and inquiry, whereas the students enrolled in 2019/2020 expressed greater disorientation and waste of time. These results may be related to the results on degree programs and year in each program.
Our results show that the students in the degree program of Pedagogy expressed having experienced more curiosity and inquiry than students in the other degree programs.
Regarding the year in the degree program, students in the third year of their respective degree programs experienced "freedom", "curiosity", and "inquiry" when using the portfolio to manage their learning. These results agree with the research on the selfregulation of learning as a prerequisite for distance learning, which requires more use of self-regulated learning strategies as mediators for academic achievement (to tackle tasks). In light of our results, we can affirm that the students in the last years of their program, as well as students in the degree program of Pedagogy, show greater use of these strategies, encouraging more autonomous work (and strategies in which they must self-regulate their learning). We also found differences in the experience of both negative and positive emotions according to subject. We can therefore confirm that the subject studied and the approach to using e-portfolios can also be decisive factors in the results and emotions of this methodology (appropriate teaching strategies) as a learning tool (acquisition of knowledge).
Emotions play a fundamental role in knowledge acquisition, which involves cognitive, emotional, and social processes [26,28,68]. A clear relationship thus exists between emotions, motivation, and e-portfolio use, thus confirming that work in virtual contexts stimulates motivation in students. Our results reveal that motivation is the second-mostmentioned emotion [69].
The correlation analysis showed statistically significant associations, both positive (direct) and negative (inverse), in the students' experience of emotions when using the e-portfolio.
Among other objectives, the e-portfolio pursues the goal of making students protagonists and participants in their own learning. As we mentioned in the introduction, there is clear evidence in the literature of the link between the use of the e-portfolio and students' capacity for self-regulation. [63]. The positive emotions show a suitable correlation of "inquiry" to "motivation" and "curiosity". Analysis of the negative associations showed a moderate correlation between the pairs "motivation" and "disorientation", "motivation" and "waste of time", "curiosity" and "freedom", and "inquiry" and "freedom".
Emotions are present in each of the learning experiences, exerting either a positive (motivating) or negative (hindering) influence [70]. The study demonstrates that as students' experience of emotions such as "motivation" and "curiosity" increases, so does their experience of "inquiry" when using the e-portfolio to manage their learning. Motivation causes willingness to acquire new knowledge and skills based on interest and passion for technology [12,71].
Students will be more motivated to learn when they experience positive emotions [72]. Furthermore, research has shown that negative emotional states arising from the feelings of disorientation and waste of time have a direct negative influence on learning results [33]. However, we were unable to establish this relationship using our results.
Nevertheless, we can confirm the positive correlation of inquiry with motivation and curiosity, which can increase academic performance and optimization of the learning process. Other studies highlight this relationship, such as that by Elizondo, Rodríguez, and Rodríguez [73].
Emotions influence the intrinsic motivation to learn, which is based on interest and curiosity in learning, as well as extrinsic motivation to achieve positive results or avoid negative ones. Pekrun [74] describes these emotions as "achievement emotions" because they involve academic goals. Both positive and negative emotions can activate or deactivate motivation, whether during the activity or in the results. This finding leads us to advocate for the incorporation of new methodological approaches that bid primarily for strengthening the student's intrinsic motivation [75].
It is therefore necessary to pay more attention to the emotions that develop in class in order to improve students' motivation and engagement in learning, and thus, ultimately, their academic results [76].

Conclusions
This research was carried out as a part of a study of the emotions that students feel when they work with the e-portfolio. We started from the assumption that knowing students' emotional states during the teaching-learning process can help the teacher to improve this process. From the results obtained, it can be concluded that (first objective) positive emotions are foremost and above average, ranked as follows from strongest to weakest: freedom, motivation, curiosity, and inquiry. The students evaluated negative emotions (disorientation and waste of time) as experienced less strongly. The use of the e-portfolio as a didactic strategy therefore helps to provide focus to tasks, and it is perceived as a useful strategy for learning by the students.
According to the second objective, by age, students who were 23 or older experienced the e-portfolio as a "waste of time". This finding contrasts with the results for the 18-22 age group, which experienced primarily "curiosity". The variable identifying sex also showed significant differences in "freedom". Men experienced this emotion to a greater extent than women. By academic year, the students enrolled in 2018/2019 experienced freedom, curiosity, and inquiry, whereas the students enrolled in 2019/2020 expressed greater disorientation and waste of time. The students in the degree program in Pedagogy expressed that they had experienced more curiosity and inquiry than students in the other degree programs. As to year in degree program, students in the third year of their respective degree programs experienced "freedom", "curiosity", and "inquiry" when using the e-portfolio to manage their learning.
Finally, in accordance with the third objective, correlation analysis showed statistically significant associations, both positive (direct) and negative (inverse), in the students' experience of emotions when using the e-portfolio. The study demonstrates that, as students' experience of emotions such as "motivation" and "curiosity" increases, their experiences of "inquiry" also increases when they use the e-portfolio to manage their own learning.
The research presented here has some limitations. For example, there has been no comparison of the results obtained with groups in which a regular portfolio was used. Such a contrast would enable an analysis of the real impact of technology in the motivation students to perceive in the process of portfolio building. In addition, these students could be contrasted with a group in which a traditional methodology other than the portfolio was used. Furthermore, the field of Social Sciences has limitations in the development of research studies, which is related to sample size. In this regard, the present study used a specific sample of students, which initially enabled the validation of the instrument created. Although its results cannot be generalized, they can serve as the basis for future research using random samples of the population as the starting point. However, since the data are unbalanced and have no element of randomization, the results of the inferential study are tenuous.
The emotional dimension has been shown to be a very important factor in teachinglearning processes. Based on this study, future lines of research could include: comparing the emotions experienced by students with their academic performance to determine whether emotions influence learning; studying emotions in virtual learning processes by combining quantitative and qualitative techniques; contrasting the emotions experienced by students and teachers, or even deepening the study according to the different academic years. Institutional Review Board Statement: The study was conducted according to the guidelines of the Declaration of Helsinki, and approved by the Ethic Committee of University of Granada (protocol code no. 192/CEIH/2020 date 09 October 2020).

Informed Consent Statement:
Informed consent was obtained from all subjects involved in the study.

Data Availability Statement:
The data presented in this study are available on request from the corresponding author.

Conflicts of Interest:
The authors declare no conflict of interest.