1. Introduction and Background
It is essential that undergraduate instructors embed academic support activities within their courses to enable students to learn effective study behaviors, practice using metacognitive strategies to monitor and modify learning activities, and practice effective examination-taking strategies before the students compete in high-stakes examinations in their classes. Referring students to tutoring programs, writing centers, and learning centers located somewhere on a college campus after the student has received a failing first major examination grade may be too late. Student retention research has identified that the most prevalent decision time for students to drop out of college is within the first 6 weeks of their first academic term [
1,
2,
3]. The 6-week mark of the academic term correlates in many first-year classes with the first major examination [
1].
Instructors can form a vital partnership with the campus learning assistance programs and other services to support student persistence toward graduation. With little hope of increased funding for existing academic support programs, the campus must add new partners to support student success. Student achievement and persistence to graduation are everyone’s responsibility. This includes faculty members, student services, academic advisement, learning assistance centers, and others at the institution [
1,
2,
3,
4,
5,
6,
7,
8,
9]. The classroom instructor can help accomplish this through simple and no-cost/low-cost enhancements to the course curriculum.
This research study focused on actions that a classroom history instructor took to assist students in earning higher grades on their first major examination of the academic term. It was hoped that the students would also employ the newly acquired strategies in other courses to help increase their ability to learn more, be effective and efficient, and earn higher grades. One of the authors of this study had been involved with promoting peer assistance programs for adoption at other institutions. He had often wondered how he would conduct a first-year college course and seek to integrate the learning and metacognitive strategies into it rather than simply referring students to walk across the college campus to seek help. He received the opportunity to test his hypothesis when he was recruited for a tenure-track position at a university where he would have responsibility for teaching two introductory history courses each academic term. The total annual enrollment of students in the history course ranged from 140 to 300. The history course fulfilled several graduation requirements and attracted students from a wide range of academic majors from across the institution. More information about the history course is provided below and later in this article.
The setting for this study was a first-year global history course at a large research-intensive university with selective admissions. Even with a highly selective admissions process, university leaders and faculty members were concerned with unacceptable rates of low grades and course withdrawals. An entering student who earned a cumulative grade point mean below 2.0 on a 4.0 scale would be placed on academic probation at this institution. A consecutive academic term of a similar below 2.0 grade point mean would result in academic dismissal from the institution. Admission to academically rigorous programs such as Science, Technology, Engineering, and Mathematics (STEM) requires a cumulative student grade point mean above 3.5. Earning low grades in just a few courses could result in loss of the opportunity to pursue such academic programs.
The institution provided some tutoring and writing center services for students if they were able to navigate an unfamiliar environment to locate them. In addition to the challenge of locating the tutoring services was the students’ lack of time. Because of the high tuition at the institution, many students worked two and sometimes three part-time jobs to pay for college. Many enrolled in the history classes were first-generation college students from historically underrepresented and under-resourced backgrounds. Self-destructive and self-sabotaging behaviors resulted from the students feeling like imposters who did not deserve to be enrolled at the institution [
10]. The institution prohibited offering developmental-level courses or study strategy courses, which could have better prepared students for the academic rigor of the course.
A major pedagogical approach selected by the instructor of the history course for this study was Universal Design for Learning (UDL) [
11,
12,
13,
14,
15]. UDL posited that small changes could be made in the curriculum to make it more accessible for most or all students enrolled in the course. Rather than assuming new students could navigate a huge and unfamiliar college campus to locate supportive resources, the decision was made by the course instructor to make changes in the approach and the curriculum. One of the coauthors of this research study has written previously on the comprehensive changes made in the curriculum of his history course following UDL principles [
16,
17,
18].
1.1. Literature Review
A review of the professional literature provides a context for this history course and discussion of the results from this research study. The following topics were examined for relevant research studies: student retention and persistence to graduation, Universal Design for Learning, cognition and metacognition, constructivism, and a sustainable ecosystem for student retention and graduation. Each of these topics guided curricular choices by the instructor for embedding academic support into the course.
1.1.1. Student Retention and Persistence to Graduation
The landmark researcher regarding college student departure before completing a degree was Vincent Tinto [
1,
2]. It was his research that identified that the most likely time for a student to withdraw from college was at the end of 6 weeks of their first term. Tinto’s research identified six themes leading to early withdrawal from college: (a) difficulty with the adjustment from secondary school to college; (b) difficulty with their new day-to-day schedule that was less structured than secondary school; (c) difficulty making connections between what they understand and the new academic content presented by the instructor, which resulted in cognitive incongruence; (d) heightened sense of social isolation in comparison with their previous lives in secondary school; (e) high financial need due to living expenses and college tuition, books, and fees; and (f) social groups in their previous communities that encouraged dropping out of college and returning back [
1]. Failure to deeply integrate into the new learning environment made it easier for the student to drop out.
Four of these themes help explain academic behaviors and outcomes for new college students. The first theme of having difficulty adjusting to the academic rigor of college can result from a lack of successful learning strategies needed for more challenging course material. The second theme of having daily difficulty can manifest with the quick pace of many college courses with reading assignments, daily quizzes, and voluntary class attendance. Experiencing incongruence can become commonplace if the student is unable to independently make connections between what they already know with the new course content of class lectures, reading assignments, which may not be discussed by the course instructor, and other class experiences. The final theme of social isolation can be experienced if the student fails to seek out other students in the course to study the course material and prepare for the examination. As described earlier, all of these themes can lead to developing a sense of imposter syndrome, which can lead students to falsely assume that they do not belong in college, even for those who were successful in secondary school [
10].
In addition to the decision to drop out of the institution at this critical period in the academic term is dropping the course and switching academic majors to a less academically demanding one [
19]. This has been especially troubling with students initially committed to a Science, Technology, Engineering, and Mathematics (STEM) major persisting at the institution but transferring to another subject area. The diminishing number of STEM students in the pipeline for graduation is troubling. Particularly at risk are women and students of color.
Tinto’s focus on frontloading academic support for new students into the first 6 weeks of the course led the instructor to encourage student metacognitive behaviors before the first exam. Decades of experience of the course instructor had confirmed this need since attempting to remediate students who failed the first exam often results in course withdrawals. Understanding the need for changes early in the academic term led the history instructor to pursue new pedagogies. As indicated earlier, UDL was an important model to emulate in the course [
11,
12,
13,
14,
15].
1.1.2. Universal Design for Learning
Universal Design for Learning (UDL) is an educational framework based on research in the learning sciences, including cognitive neuroscience that guides the development of flexible learning environments to accommodate individual learning differences [
11,
12,
13,
14,
15]. Recognizing that the way individuals learn can be unique, the UDL framework creates a curriculum that provides multiple means of representation to give learners various ways of acquiring information and knowledge, multiple means of expression to provide learners alternatives for demonstrating what they know, and multiple means of engagement to tap into learners’ interests, challenge them appropriately, and motivate them to learn [
11,
13,
14]. Several other researchers have updated UDL to make the learning process more inclusive for students of color [
12,
15].
UDL was a helpful guide for the inclusion of new cognitive learning activities into the course. The next step was the inclusion of metacognitive learning activities where students would monitor their academic behaviors and select appropriate learning activities depending upon the nature of the academic task. That is the next topic in this review of the professional literature.
1.1.3. Cognitive Strategies and Metacognitive Strategies
Cognitive strategies are actions and mental activities to gain new information [
20]. Examples include memorization of facts, reflecting on previous class lectures, repeating the problem-solving process, self-monitoring their learning strategies, and summarizing an assigned reading selection [
21]. Studies indicate that students who applied strategies for learning had a better performance than students who did not apply them to the same degree [
22,
23]. Metacognitive strategies reflect upon various cognitive strategies and strategically select the ones based on the learning situation most likely to yield the highest mastery [
24,
25]. A common term to concisely describe this is ‘thinking about thinking’ [
26]. Employing metacognitive learning practices has been associated with higher academic performance from elementary through postsecondary education [
9]. Examples of these metacognitive actions include (a) self-awareness of strengths and weaknesses as a learner; (b) planning how to approach a learning task; (c) selecting a particular learning activity or strategy for a specific learning task; and (d) self-correcting in response to a self-assessment of progress towards completing a learning task successfully. Another term sometimes used for metacognition is mindfulness [
27] when the student reflects on the learning task and carefully selects the most appropriate learning strategy. Careful attention is continuously exercised with the learning task to make necessary changes [
28]. An additional term that is often synonymous with metacognition is self-regulated learning [
29].
Several research studies reported using “exam wrappers” to increase students’ metacognitive awareness of their examination skills [
30,
31,
32,
33,
34]. A highly cited reference to this approach described its use in multiple academic disciplines [
33]. The authors identified several keys for effective use of this exam reflection approach: embedding into the course material and the associated exam, being explicit about the usefulness of the activity, and encouraging the students to take time for this small amount of time, which can yield high results with increased exam scores. This approach applied to a nursing course by providing activities that assisted students in reviewing their performance on a nursing exam with feedback concerning their choices and gave them time to reflect on how to make more effective exam preparations for the next time [
34]. Other researchers extended the use of these exam reflections in computer science [
30], psychology [
31], and Food Science and Human Nutrition [
32].
Some institutions have approached the issue of developing metacognitive learning strategies through activities that occurred outside the classroom. Many campus learning centers offer study skill workshops or academic courses on applied metacognition. A frequently cited researcher in this area is McGuire [
35]. Her books have been used to inspire such activities. Another approach to an outside-of-course approach is Supplemental Instruction (SI) [
36]. The early report of the SI model shares how a study group is attached to a course with a historically high rate of D, F, W, F, and I grades. Most often, this is a voluntary participation study group for students in a course. These outside-of-classroom activities do not require time or planning by the course instructor.
Thus far in this literature review, the focus has been on acquisition and practice with learning strategies and metacognitive strategies. The next section is focused on the use of active learning activities within the classroom. A classical learning theory that guides some of these activities is constructivism.
1.1.4. Constructivism
The Constructivist Theory was groundbreaking in understanding how children and young adults learn. Jean Piaget formulated it as a leader of developmental psychology [
37,
38,
39]. His theory emphasized the learner’s active role in constructing knowledge through interactions with their environment. According to Piaget, children and young people are not passive recipients of information but active agents who construct their understanding of the world through a series of states. Several of Piaget’s theory concepts are highly relevant to this research study. First, schemas are the basic building blocks of knowledge. They are mental structures used by young people to organize and interpret their experiences. Schemas evolve and become more complex as individuals interact with their environment. This interaction with the environment includes two complementary processes: assimilation and accommodation. Assimilation is when new information is incorporated into existing schemas, while accommodation modifies existing schemas to fit newly gained information [
37,
38,
39].
A critique of Piaget’s theory has been its application to college-aged students as it has primarily been applied to younger children. Another criticism was his research was based upon Western, middle-class children, limiting its generalizability to other cultures and socioeconomic backgrounds. Other researchers have since validated the theory with field tests with other young people in other cultures [
38].
This theory inspired a number of classroom activities by the students. These included a student-constructed examination preparation website, a course content review podcast, history event videos, guided classroom discussions, history simulations, and more. The theory-guided activities meant that students must engage independently and in small groups to create knowledge about new history topics and display skills in demonstration of mastery.
The final topic to explore in this brief review of the professional literature is an emerging one of colleges developing a multi-faceted support system for all students to achieve high mastery of challenging content material as evidenced with their grades and to complete their academic program of study.
1.1.5. Improved Student Retention Involves the Entire Campus
It is essential for the entire college to be part of the support system for students to achieve higher academic performance and persistence to graduation. The literature supports that a sustainable learning environment requires an ecosystem that supports students via instructors; student services such as advising, counseling, new student orientation, and health services; and other parts of the campus. For example, not surprisingly, Tinto’s research has led the way with this comprehensive approach [
1,
2]. Astin’s landmark study on factors that influenced student outcomes identified more than 100 variables that can influence the students [
40]. A short list of researchers who have identified evidence-based strategies to support student development include Burke [
41], Habley et al. [
42], and Braxton et al. [
43]. Faculty members are not alone as being essential for the ecosystem supporting student success. Unsurprisingly, a complex and sustainable learning environment is required to support student development through their stages of life. One foundational approach to supporting student success is through educators’ practice of scaffolding learners’ use of metacognitive strategies in their courses.
This study investigated learners’ use of metacognitive strategies and their exam performance. The primary aim of this study was to investigate the difference, if any, in mean scores on the first major exam between students who reported completing specific metacognitive strategies and those who reported not completing them. The following research question guides this study: what is the difference, if any, in mean scores on the first major exam between students who applied metacognitive strategies and those who did not?
3. Results
The results of data analyses on the primary research question are reported using frequencies and two-sample T-tests. To examine the metacognitive strategies and the first major exam performance, researchers asked survey questions about students’ self-reported activities prior to and during the exam. Frequencies and the results of the two-sample t-test are reported.
3.1. Descriptive Statistics
The descriptive statistics provide a view of the data that informs the characteristics of the participants through the frequencies of which they reported preparing for the first major examination of the academic term. The results of the questions about behaviors related to examination preparation include the use of resources, completion of assigned readings and audio files, student activities during the class sessions, examination preparation activities, hours spent on preparing for the exam, and the number of class periods missed prior to the exam. The frequencies of examination preparation resources are reported in
Table 2. Nearly all students (f = 114, 94%) who completed the survey used the online exam study guide website constructed by students in the course. Approximately half of the students listened to one or more of the previous class lectures (f = 65, 54%), listened to the online exam review session by the instructor (f = 63, 52%), and listened to the unit course podcast one or more times (f = 61, 50%). Fewer participants reported to have studied with other students in the class just before the exam (f = 14, 12%), studied with other students in the class weekly (f = 4, 3%), and going to the campus tutoring or writing center (f = 3, 2%).
Based on the frequency chart (
Table 2), students overwhelmingly favored using the online exam study guide website as a resource for preparing for the examination. Students preferred working individually to prepare for the examination given that listening again to previous class lectures, listening to the online exam review session by the instructor, and listening to the podcast were more frequently reported than studying with other students or seeking help through tutoring or the writing center.
Table 3 presents the frequencies for the completion of assigned readings and audio files, which were part of their ungraded homework. Only one-third of the students surveyed (f = 40, 33%) reread assigned material or listened to the audio files again before the exam. However, over half of the students read or listened to them before class (f = 80, 66%), read or listened to them at least once before the exam (f = 67, 55%), and took written notes about the assigned readings and audio files (f = 62, 51%).
When thinking about student behaviors related to the assigned readings and audio files, the frequency chart (
Table 3 shows that most students read or listened to the material before class. The next most frequent behavior reported by students was reading or listening to the material before the exam. Nearly the same number of students also took written notes. A much smaller number of students reread or listened to the material again before the exam.
Table 4 presents the frequencies of class session activities. Most students participated in all five of the in-class activities. Most frequently reported, during class, students wrote additional comments about the material presented in the lecture (f = 103, 85%). Many students printed or downloaded the lecture slides (f = 95, 79%), participated in small group discussions (f = 91, 75%), wrote supplemental lecture notes (f = 87, 72%), and reread the lecture notes before the exam (f = 83, 69%).
Table 5 presents the frequencies for the examination preparation activities. Just over half of the students surveyed created outlines for each of the potential essay questions (f = 63, 52%). Fewer students practiced writing answers to the essay questions (f = 52, 43%) or tried to predict multiple-choice questions based on the lecture notes and assigned readings (f = 49, 40%).
The frequencies of hours spent preparing for the exam are shown in
Table 6. Most students spent 4 to 6 h preparing for the exam (f = 41, 34%). An almost equal number of students spent 1 to 3 h (f = 23, 19%), 7 to 9 h (f = 27, 22%), or over 10 h (f = 28, 23%). Only one student reported to have spent less than 1 h preparing for the exam (f = 1, 1%).
The frequencies of class periods missed for any reason before the exam are displayed in
Table 7. Overwhelmingly, students reported not missing any class periods before the exam (f = 71, 59%). If students missed a class period before the exam, then most frequently it was only one class (f = 24, 20%) or two classes (f = 14, 12%). Fewer students reported missing three or more classes (f = 12, 10%).
Table 8 shows the frequency of student activities during the exam. Most frequently, students reported that they looked back at the vocabulary and multiple-choice questions when answering the essay questions (f = 82, 68%). Many students made a brief outline before writing (f = 79, 65%). Some students also marked up the exam questions by underlining or circling keywords to make it easier to understand (f = 68, 56%).
Data Conditions
Prior to conducting independent samples T-tests on the data, four data conditions were examined. While participants in the sample were not randomly selected, the demographics in
Table 1 show that the sample is reasonably representative of the population demographics. Given that the sample size is sufficiently large (N > 30), the Central Limit Theorem applies to the sampling distribution and researchers can assume a normal distribution. The samples are independent of one another given that students were categorized as either having completed or not completed an activity. When comparing the two groups, the standard deviations were examined to determine the similarity of variances. From this information, researchers were able to determine that data conditions were met prior to running independent samples
t-tests in SPSS.
3.2. Independent Samples t-Test
A two-sample
t-test was conducted to examine the differences in mean scores on the first major exam between one group of students who completed metacognitive strategies and one group who did not. Our hypothesis was that the population mean score of students who completed the activities (μ1) would be greater than the population mean score of students who did not complete the strategy (μ2). Thus, the alternative hypothesis was Ha: μ1 − μ2 > 0, (α = 0.05). Of the 22 behaviors measured on the survey, five were found to be statistically and practically significant. See
Table 9 for a summary of the results of the independent samples
t-test.
Results indicated that there was a statistically significant difference in mean scores on the first exam between the group of students who read or listened to assigned readings and audio files before they were discussed during class and the group of students who did not (Item 4a), t(118) = 1.856, p = 0.033, d = 0.35. The results also indicated that there was a statistically significant difference in the mean exam scores between the group of students who frequently participated in small group discussions at the table during class session activities and the group who did not (Item 5d), t(118) = 2.287, p = 0.012, d = 0.47. Item 6a was found to have the highest statistical and practical significance. The mean exam scores for the group of students who created outlines for each of the potential essay questions while preparing for the exam were higher than the group who did not, t(118) = 3.940, p < 0.001, d = 0.73. There was a statistically significant difference in the mean exam scores between the group of students who made a brief outline of the essay question before beginning to write while taking the exam and the group who did not, t(118) = 1.685, p = 0.0475, d = 0.33. Finally, Item 4b. Read or listened to assigned readings and audio files at least once before the exam narrowly missed statistical significance at the 0.05 level, t(118) = 1.635, p = 0.0525, d = 0.30.
4. Discussion
This study investigated metacognitive strategies and exam performance. Four behaviors emerged as statistically significant, or in the case of one behavior, nearly statistically significant: (a) read or listened to the assigned readings and audio files before they were discussed during the class session; (b) frequently were actively engaged in brief small group discussions at designated times during class sessions; (c) created outlines for each potential essay question before the examination; and (d) made an outline of their written response to the examination essay question before they began to write©.
These behaviors by the group of students who earned higher grades on the first major examination in the course have been previously identified as best practices for examination preparation in the professional literature [
33,
34]. Multiple exposures to academic content are linked with higher retention and understanding rates [
8,
33]. Active learning in the classroom is frequently cited by UDL as a key component of increased engagement and learning [
11,
12,
13,
14,
15]. Constructing outlines of potential essay questions requires students to construct their potential responses before the examination and enhance their deeper understanding of the subject material [
28,
29,
30,
31,
32]. Creating outlines of potential responses to an essay question during the exam requires the deployment of metacognitive thinking before beginning the writing activity [
33].
It was surprising that some of the frequently chosen behaviors by students were not statistically significant: (a) listened to the course exam review podcast, (b) listened to a recording of a class session an additional time or after they had missed class, and (c) participated in an online exam review session with the course instructor or listened to a recording of that event before the exam. Anecdotal evidence from some students in the class reported they were satisfied that the class sessions were recorded for them if they missed class. This was especially noted by student–athletes who missed class sessions for scheduled athletic events.
Few students reported they studied with other classmates outside of class sessions or used the free campus tutor program or the writing center. It is speculated the low rate of participation in these activities is due to the complicated and intense work schedules of students who were enrolled full-time, worked one or more part-time jobs, and often commuted to the college campus. Also, it may be due to some students preferring to study independently rather than working in collaborative study groups outside of class [
14]. An additional research study will report data gathered from the same students through the instrument (Exhibit A) to study the potential impact on the final course grade. Perhaps additional exposure to the exam preparation activities will have a higher influence on the final course grade.
Speculation about the lack of statistical significance of listening to the podcast, viewing recorded class sessions, and participating in the online instructor-led exam review session could be the lack of significant student interaction while listening or viewing the online event. The course instructor needs to reflect on how to increase the relevance of the podcast and increase student interaction during the online review session. As stated above, another research study in this history course will repeat this research design by examining the final course grade. Perhaps the results will differ.
While students cannot change their past academic performance, they have free will to choose academic behaviors during college. In this research study, five behaviors were identified that were statistically significant. It required action by the course instructor and the students for those behaviors to occur or be enhanced.
4.1. Implications
The results from this study confirm previous research on the influence of high-yield, low-effort strategies to improve student examination scores [
33,
34]. Students can work individually and in groups to prepare for major course examinations. With guidance from the instructor regarding constructing their podcasts and the exam review website, they can use their own words to make sense of challenging course material. Student engagement is increased and is more easily integrated into their thinking through the voices of other students.
The post-examination survey (Exhibit A) was reported by students in the history course as highly satisfactory for providing recommendations for study strategies by the students who earned the highest marks. The course instructor categorized the responses from the students between those who earned an A or B grade and those who earned a C or below. The instructor provided a summary to the students within a week of the exam through a class handout and posting it to the course website. Rather than the instructor exhorting students to adopt particular behaviors, students compared their behavior to what the students who earned A or B grades did. Students informed themselves with better study behaviors.
Instructors can make examination preparation easier by being more transparent with students regarding expectations and nuances of language. Both identifying key vocabulary terms and providing concise definitions of them can help students to comprehend and remember them more efficiently. Rather than making a mystery of potential major exam essay questions, they could be identified in advance. Without providing the answer, the instructor could identify all the key parts of the question and clarify the expectations for a comprehensive response. Sometimes the error by students on examinations is their imprecise reading of the question rather than incomplete prior knowledge needed for higher marks regarding the multiple-choice, vocabulary, and essay questions. The instructor could also use a detailed rubric for grading them, which is provided to the students afterwards. For the instructor of this study, complaints from students regarding the grading of essay questions dropped to nearly zero after implementing the detailed grading rubric.
Recent learning technology advancements make it easier to implement many of the activities used by the instructor in this research study. Course Management Systems (CMSs) often provide many tools for students to work collaboratively in producing exam preparation resources. Google Workspace provides similar tools for creating YouTube videos, collaboratively constructed webpages, and more. One-button creation of podcasts is free and easy through Spotify. Finally, providing some more time during class for more small group discussions can help students to put into their own words what is being learned and increase their comprehension of challenging academic content.
4.2. Recommendations for Further Research
Replication of research studies is a recommended action with any previous research study. The current approach by the course instructor with embedded metacognitive learning activities, an active learning classroom, recommended examination strategies, and student-created exam preparation resources such as the exam website and the podcast could be repeated. The new studies could occur in other academic disciplines at the lower-division or upper-division undergraduate or graduate level. The studies could occur at various institutional sizes, types, and student demographics.
Different approaches could be taken to prepare students for success on course assessments. Alternative means for assessing student decisions could be through individual or small group interviews to understand student decision-making processes for examination preparation more deeply. Effective faculty development programs could be created and assessed regarding the effectiveness of curricular transformation and improved achievement and persistence by students, especially those from disadvantaged and historically underrepresented populations.
4.3. Limitations
There are several limitations for this research study. The following are some of them. This study was conducted at one institution in one history course taught by one instructor. It is possible a wider range of academic subjects and a wider range of instructors could have different results. Second, all students were in the lower division of the undergraduate curriculum. It is possible that a different experience would result with upper-division undergraduate or graduate students. The third is that the study depended upon perceptual recall, which reflected their interpretations, judgments, and potential bias in students self-reporting their study behaviors. By its nature, this research is subject to the limitations of the self-reported data of the survey. We did not conduct individual or small group interviews with the students. These limitations can guide replication research studies to confirm these results and probe more deeply into student intentions and actions regarding metacognitive strategies.