1. Introduction
The novel coronavirus SARS-CoV-2, known as COVID-19, is a disease that outburst from Hubei Province of China to the world at the beginning of 2020. The World Health Organization (WHO) declared a global health emergency for containment of this disease on 30 January 2020 [
1]. By 23 March 2020, there were approximately 353,000 positive cases and more than 15,000 deaths globally [
2]. According to [
3], approximately 138 countries closed up their schools by March, which instantaneously affected about 80% of students worldwide.
As a result, alternatives to onsite learning were necessary [
4]. In the U.S., remote online learning was initially a major alternative since March 2020. With the improvement of the COVID-19 situation and the opening of college campuses to students since the winter semester 2020, three alternative learning modes emerged: in-person, hybrid, and remote.
In-person learning allows the richest teacher-student and student-student interactions, but the uncertainty of COVID-19 spreading and insufficient social distancing in classrooms may cause certain levels of anxiety and depression to students. Remote learning is considered the safest mode, but the lack of in-person interaction between teacher-student and student-student may lead to loneliness, even anxiety, or depression. Hybrid, as a tradeoff between safety concern and in-person interaction, might provide the best learning mode for college students, but most colleges and universities were not able to support it due to insufficient on-campus resources.
In fact, due to the different sanitation conditions of the college, the combinations of learning modes and places were complicated. For example, some private colleges allowed students to stay on campus to learn in-person, but students were not allowed to go outside the campus once they were admitted to the campus. They needed to run weekly COVID-19 testing in order to stay on campus. Some colleges, such as Harvard, allowed students to stay on-campus but study remotely. Students also need to be tested weekly to ensure the safety of the dorm. Some public colleges, such as The City University of New York (CUNY), only allowed students to study remotely. The campus was completely closed.
To react to remote learning, some students chose to stay on campus, while others chose to live off-campus with friends. When students stay on campus, they could still have some levels of in-person interactions with peers outside the classroom. When students live off-campus with friends, they avoided an intense dorm environment and thus, reduced the risk to be affected by COVID-19.
The complicated learning system was indeed a challenge for both students and faculty, since neither of them was familiarized with remote learning. It had strong effects on student’s learning experience and mental health: whether a student chose to stay on-campus or learning from home, many of them had experienced the different extent of mental health problems. For example, college life requires student interaction, but the social distancing during COVID-19 limits the chance of getting face-to-face contact, which causes anxiety for students. While both students and faculty learned to adapt themselves for the changes during COVID-19, it is crucial to investigate college students’ learning experience one year after the outbreak of COVID-19. Will students still demonstrate similar levels of depression and anxiety at the beginning of COVID-19 [
5,
6]?
The objective of this study was to discover college students’ learning experience and, in particular, perception of the learning community, satisfaction level, hindrance that they had encountered, and mental health, including their anxiety and depression level, one year after the outburst of COVID-19.
The rest of the paper is organized in the following way. In the literature review, related research on remote learning and mental health issues are reviewed. In the method, research questions, participant information, procedure, survey design, and data analysis plan are explained. In the results, it starts with the results of demographic information and reliability analysis, followed by descriptive analyses of survey responses corresponding to five research questions, and inferential analyses of impacts of students’ grade (freshman, sophomore, junior, senior), gender, ethnicity, family income, learning mode, and learning location on their learning experience and mental health. In the discussion, five themes out of our results were elaborated. Finally, the conclusion section summarized major findings, limitation of the study, and future research.
3. Method
3.1. Research Questions
This study addressed following five research questions:
RQ1: What was college students’ overall learning process during COVID-19?
RQ2: What was the impact of COVID-19 on college students’ mental health?
RQ3: What was college students’ perception of the learning community during COVID-19?
RQ4: What was college students’ perception of student support during COVID-19?
RQ5: What were the benefits and barriers of taking a course remotely in COVID-19?
3.2. Participant
Upon xxx IRB approval, a total of 62 participants were recruited online from Amazon Mechanical Turk (Mturk), a virtual crowdsourcing marketplace in January 2021. The screening criteria was any college student currently studying in the U.S., and each participant obtained $1 from Mturk after their completion was verified.
Initially, we planned to recruit participants from a college campus. However, due to COVID-19, it was difficult to recruit enough participants on campus. We then decided to use Mturk to disseminate the survey to recruit participants.
3.3. Procedure
First, an online survey was developed in Google Form, an online survey platform.
Second, an online job—Human Intelligence Task (HIT) for completing the above survey was created at Amazon Mechanical Turk in the first week of January 2021. Participants were given up to 30 min to complete it.
Third, a $1 participation fee was awarded if the Mturk ID was matched between the one participant offered on Google Form and the one Mturk provided on the completion list. When participants filled out the survey repeatedly, the most recent response was taken, and all previous ones were discarded.
Fourth, the HIT of survey completion was reposted five days after the first round of dissemination. In the first round, 42 valid responses were received in three days, but the number of participants did not increase in the following days. By reposting the same HIT in Mturk, the survey job appeared on the top list. It brought an additional 32 participants. It was interesting to note that quite a few responses (12) in the second round were the same participants in the first round. Thus, a saturation in this participant pool was probably reached, and a total of 62 valid responses were obtained. Though we would have liked to receive more responses, we decided to stop the recruitment process three days after our second round of dissemination.
3.4. Survey Design
In this study, we investigated the learning experience of college students a year after the starting of school closure. The College Student Learning Experience Survey was developed based on Online Learning Experience Questionnaire [
10], Well-Being Index (WHO-5) [
5], Generalized Anxiety Disorder scale (GAD-7) [
6], and the Course Experience Questionnaire (CEQ) [
13].
The questionnaire consists of 42 items, including 6 items related to demographic information (age, gender, ethnicity, family income, learning mode, learning location), and 36 items of five major constructs corresponding to our five research questions (RQ).
Table 1 showed the detailed mapping of RQ, survey constructs, survey questions and survey sources.
3.5. Data Analysis
First, descriptive analysis (count and percentage) of demographic information were conducted. Second, reliability analysis was reported for all survey constructs. Third, descriptive analysis (mean and percentage) on survey response was conducted for each corresponding research question. Finally, to understand whether students’ grade (freshman, sophomore, junior, senior), gender, ethnicity, family income, learning mode, and learning location have impacts on their learning experience, inferential analyses of ANOVA were conducted.
4. Results
In the following, the demographic results and reliability results of all survey constructs will be reported first. Then, survey results corresponding to five research questions, are presented. To understand the impacts of demographic variables on their learning experience, inferential analyses were conducted.
4.1. Demographic Results
Table 2 showed the result of demographic information with 62 respondents. First, the majority of our participants were seniors (53%) and juniors (23%). Second, more male (60%) than female (39%) participated in the study. Third, the family income of majority participants (63%) were towards the lower end (under
$50,000), while 28% were middle-income (
$50,001–
$100,000) and 10% were high-income (
$100,001–
$200,000). Fourth, surprisingly, Asian (66%) and White (23%) made up the majority of our sample. Fifth, in terms of learning mode, almost half of the participants chose remote learning (45%), followed by in-person (36%), and hybrid learning (19%). Finally, in terms of learning location, most of the participants (52%) prefer studying from home, 37% prefer staying on campus, and the rest (11%) prefer staying off-campus with friends.
4.2. Reliability Results
First, the reliability tests of five survey constructs were conducted. All five constructs reached an acceptable reliability (Cronbach’s Alpha > 0.70). Then the mean and standard deviation of each construct were reported in
Table 3.
4.3. Survey Results
In the following, the aggregated results corresponding to above five research questions were presented in terms of college students’ overall learning experience, mental health, perception of the learning community, perception of student support, and benefits and challenges/barriers.
On the Overall Learning Experience scale, the higher the response values are, the more positive students’ overall learning process are. As shown on
Figure 1, the average scores of all five questions were at a high level (around 3.98–4.19 on the 5-likert scale), which indicated an overall positive learning process. In particular, top three items were: the face-to-face resource sessions were valuable when supplemented with online learning (mean = 4.19); the student was able to work through the subject materials at their own paces (mean = 4.16); the student was encouraged to take responsibility for their own learning (mean = 4.15).
On the anxiety scale of GAD-7, the higher the response values are, the higher levels of mental problems are. As shown on
Figure 2, the average scores of all seven questions were in low level (1.21–1.37 on 4-likert scale). A summered score (ranging 0–21) of 10 or greater represents a reasonable cut point for identifying cases of anxiety [
5]. In our data, 55% of respondents demonstrated anxiety (
Table 4).
On the depression scale of WHO-5, the higher the response values are, the better mental conditions are. As shown on
Figure 3, the average scores of all five questions were in mid-to-high level (3.11–3.40 out of 6-likert scale), which indicated that the participants were inclined to a good mental health condition.
A summed score (ranging 0–25) below 13 indicates depression [
5]. In our data, only 37% of respondents demonstrated depression, while the majority of respondents were free of depression (
Table 5).
Overall, no depression was present in our data. A large percentage (63%) of participants showed lower levels of depression than the cutoff value, and the average depression score indicated no depression. However, more than half (55%) of our participants demonstrated higher level of anxiety than the cutoff value, even though the average anxiety score indicated no anxiety.
On the Learning Community scale, the higher the response values, the better the feeling toward the learning community. As shown on
Figure 4, the average scores of all above five questions were in high level (3.79–3.98 on 5-likert scale), which indicated that the participants were feeling well with their learning community.
On the Student Support scale, the higher the response values are, the better student support are perceived. As shown on
Figure 5, the average scores of all five questions were in high level (3.76–4.11 on 5-likert scale), which indicated that the respondents perceived sufficient student support.
On the Satisfaction scale, the higher the response values are, the higher level of students’ satisfaction are. As shown on
Figure 6, the average scores of all above five questions were in high level (3.73-4.15 on 5-likert scale), which indicated that the participants were satisfied with their learning experience.
This scale was a checkbox question.
Figure 7 showed that online learning challenges students encountered included: inadequate opportunities to discuss with teachers (56%), lack of opportunities to study with their classmates (40%), inadequate opportunity for peer support (39%), difficulty to apply concepts taught in the subject (27%), and lack of confidence in handling difficult task with online learning mode (13%).
4.4. Inferential Analysis Results
To understand whether students’ grade (freshman, sophomore, junior, senior), gender, ethnicity, family income, learning mode, and learning location have impacts on their learning experience, inferential analyses of ANOVA have been conducted.
Results showed that no main effects of grade, gender, and ethnicity on all five survey constructs: learning process, mental health, learning community, student support, and satisfaction (p > 0.05). However, family income, learning mode, and learning location demonstrated significant effects.
First, the main effect of family income was significant on the perception of the learning community (F (4,56) = 3.01, p < 0.05). Students from high-income group (75 k–100 k) (mean = 3.30, std = 0.62) perceived significantly worse about the learning community than students from low-income groups (<25 k: mean = 4.10, std = 0.66; 25 k–50 k: mean = 4.11, std = 0.63).
Second, the main effect of learning mode was significant for anxiety (F (2,59) = 9.81, p < 0.01), but no significant differences for depression (p > 0.05). Anxiety was highest for the learning mode of in-person (mean = 12.55, std = 4.74), followed by remote (mean = 8.39, std = 5.89), and hybrid (mean = 4.17, std = 5.18). Posthoc Tukey of all three pairs comparisons were significant (p < 0.05).
Third, similar to the result of learning mode, the main effect of learning location was significant for anxiety (F (2,59) = 3.44, p < 0.05), but no significant differences for depression (p > 0.05). Posthoc Tukey of anxiety comparison showed that the on-campus group (mean = 11.52, std = 5.46) showed significantly higher levels of anxiety than the home group (mean = 7.31, std = 6.10) (p < 0.05). The off-campus group (mean = 8.86, std = 6.12) showed no differences between both on-campus and home groups.
In addition, the main effect of learning location was significant on the perception of student support (F (2,59) = 3.02, p = 0.06). Posthoc Tukey showed that the on-campus group (mean = 4.01, std = 0.44) perceived higher levels of student support than the off-campus group (mean = 3.37, std = 1.07) (p < 0.05).
5. Discussion
Our results provided rich information to the proposed research questions. Students’ overall learning experience was found to be positive in this study. Students were in a good health condition in general. There was no presence of depression in our data, even though more than half of the students demonstrated anxiety. In addition, students felt that they belonged to their learning community. The students’ support was found to be strong and adequate, and most of them were satisfied with their remote learning in COVID-19. Major benefits students perceived, related to remote learning, were the convenience to use online learning methods, and the easy accessibility to learning materials.
In the following, four major themes identified from our results will be discussed.
5.1. Socioeconomic Impact on Learning Community
Our inferential analysis showed that there were no main effects of grade, gender, ethnicity, and learning mode on five survey constructs. However, family annual income had a significant impact on a student’s perception of the learning community. It is interesting that the students from low income families perceived more belonging to the learning community than those from high income families. This might be due to the likelihood that the students from low-income families received less restriction from their parents, so they were able to contact their friends in-person, while the students from high income families were more strictly prohibited to have face-to-face contact with their friends during COVID-19. Although the in-person interaction during COVID-19 did not necessarily benefit these students’ physical health, it probably helped them to have better participation in their learning community in comparison to those high-income students who were constrained at home.
5.2. Optimal Learning Location and Learning Mode
Our results revealed that the learning location has an impact on students’ learning experience. Specifically, the students who chose to study on-campus perceived better student support than those who were off-campus with friends. It is understandable that both academic resources (such as lab materials, abundant library in-print collection), technical resources (such as stable campus network, site accessible software, high-end computers), as well as other services (such as health, psychological counseling, career service events) are more accessible on-campus than off-campus. Surprisingly, the impact of learning location on mental health was opposite to our prediction. Initially, we assumed that students at home might feel isolated from their peers, thus exhibiting a higher level of anxiety than on-campus students. However, students in the on-campus group, in fact, showed higher levels of anxiety than the home group. A possible explanation is on-campus students, at the time, had to follow very strict social distancing and other related policies. There were many ambiguities in those evolving policies. Students constantly worried that they may be deported home if they violated those strict rules. Therefore on-campus students actually showed much a higher level of anxiety than home students. The off-campus group student stayed with their friends while taking courses online. It was considered the best choice at the time. However, the small sample size of that condition in our data did not allow us to draw any conclusive statements here. A future study with bigger sample size of this condition is warranted.
In addition, our results showed that the learning mode has an impact on students’ mental health. In particular, hybrid students had the lowest anxiety level, and in-person students had the highest anxiety level. Remote students had a level of anxiety between in-person and remote students. The high level of anxiety from the in-person student group might be due to the likelihood that students were afraid of in-person infection of COVID-19. The first vaccine shots were given on 14 December 2021 in the U.S. When we collected data for this study in January 2021, only a very small portion of frontline workers and health care workers were vaccinated. The majority of college students were unvaccinated at that time. Although these in-person students got better support in learning, the peak of COVID-19 infection right after Christmas and New Year holidays in the U.S. might make them fear the possible virus spread out in-person. Remote learning was the safest learning mode in terms of possible COVID-19 infection. They did not have to worry about getting infected and social distancing. However, it lacks in-person interaction and social support. Therefore, the hybrid group was shown as the optimal learning mode in our study. On the one hand, the hybrid students got sufficient student support from the campus interactions. On the other hand, they did not have to worry much about keeping social distancing and infection too much, so they presented the lowest anxiety level.
5.3. Improved Mental Health
Studies similar to ours were conducted last year at the beginning of COVID-19. Compared to their findings [
5,
6,
24], college students showed improved mental health in our study. In the spring 2020, when many universities in the U.S. closed their campuses due to the emergency of COVID-19, they were unprepared for the sudden shift to online teaching and learning. The campus network infrastructure was weak for heavy use, the grading policy had not yet been revised to adapt the new learning method, and psychological and material support to students were inadequate [
7]. College students worried about the efficiency of remote learning [
11]. Students reported negative impacts of remote learning on their mental health including high levels of stress, anxiety, and depression [
5,
6,
24]. However, one year after the outbreak of COVID-19, the college students demonstrated positive overall learning experience, improved mental health, high levels of satisfaction, and student support in our study. The prevalence of depression dropped from 48.3% [
5] to 37%. This positive shift is a good indication of students’ successful adaption to remote learning as well as an overall improvement in university responses to COVID-19. Nevertheless, 55% of students still had prevalence of anxiety in our study. Thus, this evidenced that infectious diseases like COVID-19 may have an immense influence on youth mental health. While students coped with their depression pretty well, universities should continue to develop effective interventions for their anxiety. With the wide vaccine implementation on the way, we expect that students’ anxiety will significantly drop in the future.
5.4. Overall Positve Learning Experience
As shown in the Results section (
Figure 1,
Figure 4,
Figure 5 and
Figure 6), students in our study reported an overall positive learning experience, including high perception of learning community, sufficient student support, and high level of satisfaction with their learning experience.
This finding is consistent with other similar studies. In Gonzalez et al. [
25], they reported a significant positive effect of the COVID-19 confinement on students’ performance in Spain. They found that students adapted their learning strategies to a more continuous habit during COVID-19, and led to an improved learning efficiency, and better grades (improved learning performance). In another study at Pakistan [
26], a positive relationship between technology acceptance and eLearning during COVID-19 was reported. An increased online learning adaptation was due to broader options to learn new things, which was provided by online technologies for both students and teachers.
5.5. Barriers for Online Learning
Despite that the students were satisfied with their communication with classmates and teachers, most students reported the inadequate opportunities to interact with both teachers and peers was still the major challenge and barrier to their online learning. Another challenge and barrier were the lack of confidence in dealing with difficult tasks in online learning, in which the weak network infrastructure and lack of equipment (such as iPad or laptop) were, in particular, out of the student’s control.
The inadequate interaction problem in online learning is not new. In fact, a similar study [
9] on online learning before COVID-19 showed similar findings. In that study, students who were unfamiliar with the online learning environment rejected using it as their study method. Four factors were identified for barriers to online learning: lack of face-to-face interaction, inadequate opportunity of real-time group discussion, low-efficiency, and causing anxiety [
9]. Due to the innovative online learning technology and policy, the efficiency had been improved, and only 13% of students in our study felt uncomfortable to handle tasks with an online learning method. However, the inadequate interaction problem still remains. It is found, in our study, that 40% and 56% of the participants felt the lack of interaction between classmate and teacher, respectively. In fact, the inaccessible interaction of online learning mode is one of the major shortcomings that should be improved in the future.
6. Conclusions
In summary, our study found that students′ learning experience during COVID-19 was positive. They were in a fair mental health condition. Students reported good belonging to their learning community and sufficient student support. Most students were satisfied with remote learning, and no serious barriers were found except inadequate interactions between students and teachers, and between students.
In terms of college student’s mental health, the hybrid model was shown to be the optimum learning option even one year after the outbreak of infectious COVID-19. It suggested that the colleges should consider encouraging hybrid learning, instead of other learning options, when on-site safety was not ensured. On-campus in-person learning is not always the best learning mode, as the majority of us thought.
6.1. Limitation
Due to the quarantine situation, we were unable to access students from campuses. Alternatively, we recruited our participants on an online survey platform. Even after several rounds of posting and reposting, the sample reached a saturation, in which the same participants responded to our solicitation. We were not able to grow our sample size as we liked. In addition, the variety of racial groups was limited with most participants being Asians (66%) and white (23%).
6.2. Future Research
In pursuit of more precise and reliable results, a larger sample size, and a broader racial group, is crucial in future research. Comparison between private and public colleges, small liberal art colleges, and comprehensive universities will expand our findings to a broader context, and different coping strategies might be identified for different settings. Finally, with wide implementation of COVID-19 vaccines and their effectiveness in coping with the disease, we expect great improvements in college students’ mental health and learning experience in the near future.