Active Learning: Subtypes, Intra-Exam Comparison, and Student Survey in an Undergraduate Biology Course

: Active learning improves undergraduate STEM course comprehension; however, student comprehension using di ﬀ erent active learning methods and student perception of active learning have not been fully explored. We analyze ten semesters (six years) of an undergraduate biology course (honors and non-honors sections) to understand student comprehension and student satisfaction using a variety of active learning methods. First, we describe and introduce active learning subtypes. Second, we explore the e ﬃ cacy of active learning subtypes. Third, we compare student comprehension between course material taught with active learning or lecturing within a course. Finally, we determine student satisfaction with active learning using a survey. We divide active learning into ﬁve subtypes based on established learning taxonomies and student engagement. We explore subtype comprehension e ﬃ cacy (median % correct) compared to lecture learning (median 92% correct): Recognition (100%), Reﬂective (100%), Exchanging (94.1%), Constructive (93.8%), and Analytical (93.3%). A bivariate random intercept model adjusted by honors shows improved exam performance in subsequent exams and better course material comprehension when taught using active learning compared to lecture learning (2.2% versus 1.2%). The student survey reveals a positive trend over six years of teaching in the Perceived Individual Utility component of active learning ( tau = 0.21, p = 0.014), but not for the other components (General Theoretical Utility, and Team Situation). We apply our ﬁndings to the COVID-19 pandemic and suggest active learning adaptations for newly modiﬁed online courses. Overall, our results suggest active learning subtypes may be useful for di ﬀ erentiating student comprehension, provide additional evidence that active learning is more beneﬁcial to student comprehension, and show that student perceptions of active learning are positively changing.


Activity Description Subtype Category
Flipped classroom lecture(s) Pre-recorded videos (pptx and mp4 files with voice-over) that students watch outside of the classroom on their own. These at-home videos were paired with an on-line recall quiz, which was always due prior to the start of class.

Recognition
Journal Article Peer-reviewed articles students independently read outside of class and they are related to lecture topic (guidelines given on what to read/appreciate); questions regarding the reading were included in an on-line quiz due by class time.

Recognition
Ethical Dilemmas Class-wide discussion about ambiguous medical scenarios presented by FCC. Exchanging Student Thought Notecards Students' anonymous, individual responses to in-class questions that are exchanged with others to read and discuss in class. Exchanging

Thought-filled Responses
Short online posts or in-class responses students write that are not directly related to course material. As an example, students would read a descriptive essay of a physician caring for a terminal cancer patient and they would then reflect and respond to any aspect of the storyline.

Reflective
Computer-based Corners, Kahoot! Plickers, and Jeopardy Team-based question games where each group has limited time to read and answer a question. In Corners, the team gives their answer on a class forum in Sakai. In Kahoot! the team uses the internet to respond. In Plickers, a cell-phone reads and reveals the team's anonymous answer. In Jeopardy, the team responds with laminated placards and they kept their own score.

Constructive Basic Science Workshops
A series of questions (multiple choice and short answer) that address the chemical or scientific components of the class material and usually ending by including some medical application.

Analytical Clinical Case Studies
Worksheets with medical scenarios and the group will be asked to diagnose the patient, order the necessary tests, recommend proper therapy, or describe the biological origin and expected disease progression. Students are encouraged to research online to help find the answers.

Role Play
Each member in the group acts according to a pre-assigned medical role (i.e., a patient, spouse/partner, nurse, medical student, doctor, specialist). As each person is queued, information is gathered and students order the necessary tests, recommend proper therapy, make diagnosis, or describe the biological origin and expected disease progression. Students are encouraged to research online to help find the answers and complete a limited History & Physical Report.
Instructor integration and understanding of active learning in their course varies [2]. Active learning is usually perceived as a dichotomous force in the classroom-either a professor teaches with it or not; however, an entire course may incorporate only some of the course material through active learning methods [7,26,27]. We reason that, if part of your teaching involves active learning and may vary from other instructors, we should develop an active learning statement grounded on your own teaching experiences. For the basis of our study, (i) we define active learning as an interactive teaching method that calls upon students to discover the subject material through student-based activities.
(ii) Active learning requires the expression of ideas and opinions in small groups that ultimately blend into an entire class discussion; thus, it ignites students' innate curiosity. (iii) Active learning activities strengthen team-based skills of collaboration, conversation, cooperation, and collegiality. (iv) Active learning engages all types of students with each other and the instructor, promoting the disintegration of racial, socioeconomic, and intelligence boundaries.
In addition to F.C.C.'s active learning, his personal interaction heightened many aspects of the classroom. First, he organized 4-5 class events a semester, including dinners, lunches, and potlucks. Second, F.C.C. established trust with his students by sharing his vulnerabilities, such as his life in the presence of Parkinson's disease and his blog, ("Journey with Parkinson's") [28]. By engaging students in a non-academic environment and sharing a personal life health event, he was attempting to strengthen inter-student relationships with the hope of improving overall classroom engagement for the students.
This research was conducted under the guidelines of UNC IRB Study 19-02137.

Exam Information
Exams were a combination of multiple choice (A-E), matching, true-false, and free-response questions and were given three times a semester varying in length from 47 questions to 64. Only the multiple choice, matching, and true-false response sections for each exam were used in the analyses. Each semester exam covered the same course material as the previous year, maintaining exam continuity; however, the same exam questions were not used in subsequent semesters. Exams were scored using the University Scantron system.

Defining and Describing Active Learning Subtypes
To define active learning subtypes, we researched and mirrored the methodology of learning. Each teaching approach used in active learning is categorized into a subtype, and the subtypes reflect Bloom's Taxonomy of Learning [29][30][31][32][33]. The taxonomy establishes a hierarchical aspect to learning, which we integrated into the active learning subtypes. Other research, like the Interactive, Constructive, Active, and Passive, or ICAP framework from 2014, has developed progressive levels of learning, but includes passive learning, i.e., non-active learning components as part of the framework [34]. Defining subtypes for levels of active learning is an attempt to both mimic and complement the traditional hierarchical structure of learning levels found in Bloom's Revised Taxonomy of Learning [29][30][31][32][33].

Active Learning Subtype Analysis
The proportion correct by each active learning subtype (Analytical, Constructive, Exchanging, Recognition, or Reflective) was scored for each student and exam. A Kruskal-Wallis rank test [35] was performed to detect an overall difference in the proportion correct among active learning subtypes. We chose a non-parametric rank test because scores were ordered and score distributions appeared to be non-normal and skewed. Following a significant result, a Dwass-Steel-Critchlow-Fligner test [36] was applied to make nonparametric, two-sided, pairwise comparisons between all subtypes. This test was chosen because it controls family-wise error when performing multiple comparisons.

Intra-Exam Analysis
We use a bivariate random intercept model to analyze student comprehension in course material taught through active learning or lecture learning. This multilevel model is appropriate for longitudinal data and/or repeated measures. Furthermore, because we are interested in two outcomes simultaneously-active learning comprehension and lecture learning comprehension-this method allows a flexible correlation structure among the two outcomes (instead of assuming independence). The proportion correct on active learning and lecture learning questions for each student (for each exam) were used as the two outcomes of interest. Our data have dependency (1) between lecture learning and active learning comprehension within any student and (2) among exams 1-3. The random effects and error terms are allowed to be correlated, time was defined using exam number, and we controlled for honors. Random effects include student-specific random intercepts and unstructured covariance matrices were used. All ten courses were combined with 1428 total observations (three exams per student).

Survey Description
In 2012, we adapted a previously developed student survey on team-based learning to gain student feedback on active learning in the course [37]. The active learning survey was voluntary, anonymous, electronic, and consisted of 15 statements and an open-ended comment section. It was sent to the students at the end of the semester of both honors and non-honors sections. Students were asked to rate the extent to which they agreed or disagreed about active learning integration on a 1-5 Likert scale (1 strongly disagree, 5 strongly agree). We placed the 15 survey statements onto three distinct components: Perceived Individual Utility (7 statements), General Theoretical Utility (4 statements), and Team Situation (4 statements).

Survey Analysis
To determine the overall satisfaction of the students with the different components of Active Learning in the classroom, the median response score was calculated for each of the three survey components for each semester: Perceived Individual Utility, General Theoretical Utility, and Team Situation. Statement 3 was reverse scored to be in favor of active learning. The non-parametric Mann-Kendall trend test [38] was used to detect if a significant monotonic time trend across the three surveyed components existed: Perceived Individual Utility, General Theoretical Utility, and Team Situation. We could condense the six years' data and observe summary statistics for each survey component to understand student perception; however, we chose to evaluate student perception of active learning dependent on time. If the actual data are independent and identically distributed, then each year we expect similar scores on the survey. Alternatively, if the actual data are independent and follow a monotonic trend, then each year we expect the scores to change generally in one-direction-either increasing or decreasing. This test was unadjusted for honors because of the limited data and power. To control the family-wise error rate, the p-value threshold was adjusted using the Holm-Bonferroni procedure [39]; the statistical significance threshold for the first comparison was at 0.017, for the second at 0.025, and for the third at 0.050.

Active Learning Subtypes
We divided active learning into five subtypes, similar to the hierarchical components in Bloom's Revised Taxonomy on Learning: Recognition, Exchanging, Reflective, Constructive, and Analytical. These subtypes are presented from least to most advanced level of interaction, respectively. Three types of knowledge govern the foundation for these active learning subtypes; namely, Technical Understanding (the knowledge of terminology, facts, and recall) includes the Recognition subtype. Theoretical Understanding (the knowledge of reasoning and feelings) incorporates the Exchanging and Reflective subtypes. Systematic Understanding (the knowledge of applying principles to synthesize answers and to diagnose problems) contains both Constructive and Analytical subtypes (

Active Learning Subtype Evaluation Results
A priori subtyping active learning (described in detail above) allowed us to explore if different subtypes have varying efficacy in student comprehension. A Kruskal-Wallis (or Wilcoxon) test [35,40] was performed to detect if an overall difference in student comprehension among the five active learning subtypes exists. The results strongly suggested at least one subtype differs in comprehension (p < 0.0001). To detect which subtype(s) they were, this analysis was followed by pairwise comparisons using the Dwass-Steel-Critchlow-Fligner Test [36]. Of the ten-paired comparisons between subtypes, eight of them were significant, even after adjusting the critical value for multiple comparisons (Table 3, Figure 2). This provides strong evidence to believe the active learning subtypes used in the course vary in comprehension efficacy. Specifically, our results show Observational and Reflective active learning subtypes have better comprehension (both with a median 100% correct) than Exchanging (94.1%), which is better than Constructive (93.8%), which is better than Analytical (93.3%). For comparison, overall lecture learning had a mean of 89.3% and a median of 92% correct. Recognition is the least interactive and is defined by independent student thinking with minimal communication/discussion with other students. Typically, this subtype requires student initiation and commitment to learning.
Exchanging requires students to independently consider the subject material in a similar application, communicate their thoughts, and discuss and listen to other students' ideas to complete their conceptualization.
Reflective combines an academic and personal component by evoking an emotional response or emphasizing student inclusion. It challenges students to consider their level of subject comprehension and deepens their feeling of importance in the classroom.
Constructive requires the discussion and comparison of course material with other students to arrive at an answer. Students are collaborating, recalling and applying the material, learning from each other, asking questions, and refining their understanding of subject material.
Analytical is the most advanced level of active learning that requires deep critical thinking; application of knowledge to the new subject material, research, and extensive group discussion/collaboration. Teaching others, while not employed in this course, also falls into this subtype. This subtype can be defined by student discovery and tends to consume the most time.

Active Learning Subtype Evaluation Results
A priori subtyping active learning (described in detail above) allowed us to explore if different subtypes have varying efficacy in student comprehension. A Kruskal-Wallis (or Wilcoxon) test [35,40] was performed to detect if an overall difference in student comprehension among the five active learning subtypes exists. The results strongly suggested at least one subtype differs in comprehension (p < 0.0001). To detect which subtype(s) they were, this analysis was followed by pairwise comparisons using the Dwass-Steel-Critchlow-Fligner Test [36]. Of the ten-paired comparisons between subtypes, eight of them were significant, even after adjusting the critical value for multiple comparisons (Table 3, Figure 2). This provides strong evidence to believe the active learning subtypes used in the course vary in comprehension efficacy. Specifically, our results show Recognition and Reflective active learning subtypes have better comprehension (both with a median 100% correct) than Exchanging (94.1%), which is better than Constructive (93.8%), which is better than Analytical (93.3%). For comparison, overall lecture learning had a mean of 89.3% and a median of 92% correct.

Intra-exam Analysis Results
The bivariate random intercept model showed slightly improved comprehension on course material taught with active learning compared to lecture learning within a course. Compared to the previous exam, students would score an average 2.2% higher on the active learning component and

Intra-Exam Analysis Results
The bivariate random intercept model showed slightly improved comprehension on course material taught with active learning compared to lecture learning within a course. Compared to the previous exam, students would score an average 2.2% higher on the active learning component and only 1.2% higher on the lecture learning component. This corresponds to a mean difference of 1.1% [confidence interval (CI) of 0.66-1.57%] on active learning course components for future exams. Interestingly, students are expected to do marginally worse on the first exam's active learning component than in the lecture learning component. The covariance between active learning and lecture learning random intercepts is positive and estimated to be 29.3 (2.3 SE) (Table 4). Therefore, the average levels of the two exam scores are correlated. We were unable to detect a difference by honors course sections; the total number of honors students analyzed only totaled 91, whereas the non-honors sections had a total of 385 students. The improvement in non-honors sections is relatively small and detailed in the Discussion. The inference plot displays the average comprehension improvement in exams (Figure 3). the average levels of the two exam scores are correlated. We were unable to detect a difference by honors course sections; the total number of honors students analyzed only totaled 91, whereas the non-honors sections had a total of 385 students. The improvement in non-honors sections is relatively small and detailed in the Discussion. The inference plot displays the average comprehension improvement in exams ( Figure 3).

Active Learning Survey Results
The survey responses were skewed towards favoring active learning and the course structure for almost all survey statements (Tables 5 and 6). Contrary to the mostly positive reaction to active learning, student responses from survey statement three show most students think they learn better by lectures than active learning regardless of year or honors, which confirms previous research [25]. Students perceived active learning as individually useful for them in the course; median scores range from 4.06-4.43 for Perceived Individual Utility, meaning students agree to strongly agree that active learning helped them learn the material in the course. Students perceived active learning as generally

Active Learning Survey Results
The survey responses were skewed towards favoring active learning and the course structure for almost all survey statements (Tables 5 and 6). Contrary to the mostly positive reaction to active Educ. Sci. 2020, 10, 185 9 of 15 learning, student responses from survey statement three show most students think they learn better by lectures than active learning regardless of year or honors, which confirms previous research [25]. Students perceived active learning as individually useful for them in the course; median scores range from 4.06-4.43 for Perceived Individual Utility, meaning students agree to strongly agree that active learning helped them learn the material in the course. Students perceived active learning as generally useful for classroom settings; median scores range from 4.40-4.80 for General Theoretical Utility, meaning students tend to strongly agree active learning helps the learning process in courses. A finding of the survey was the perception of quality teamwork during their active learning experience; median scores range from 4.62-4.85 for Team Situation, meaning students tend to strongly agree their team worked well in active learning activities. The open-ended portion of the survey shows students' favorite course activities included the Clinical Case Studies (Analytical subtype), Role Play (Analytical subtype), and Medical Jeopardy (Constructive subtype).  became increasingly more comfortable and satisfied with active learning in the classroom (Figure 4). The minimum survey score was a rating of 3.69 (some agreement in 2012), and the maximum score was 4.19 (moderate to strong agreement in 2016). This indicates the student perception of active learning's benefit to their learning improved from some agreement to moderate or strong agreement.

Discussion
We described five subtype categories of active learning. We used these subtype categories to compare student comprehension across the active learning methods. Our study provides evidence that teaching with distinctive active learning subtypes results in different degrees of student comprehension. We were able to determine that Recognition and Reflective active learning methods resulted in the best comprehension, which includes activities like at-home lectures and reading papers (Recognition) or at-home reading and in-class ethical discussions (Reflective). Recognition provides the ability to repeat and relearn the subject material at a students' own discretion and pace. We hypothesize that students' ability to control and tailor their learning experience allows improved subject comprehension. Reflective activities, like ethical discussions, provoke an emotional response, which may facilitate student comprehension of the material. Importantly, all five active learning subtypes used at-home lectures, and all subtypes demonstrated better student comprehension compared to traditional lecture learning. From this finding, we urge instructors to provide "take-home" learning options (like flipped classroom lectures) so that students can control more aspects of the course learning. We further suggest instructors use a diverse range of teaching methods to maintain student interest but be cognizant of the integrated active learning activity's efficacy (Table 8). Table 8. Active learning topic, method description, and subtype.

Course Topic
Active Learning Subtype Active Learning Module Description

Unit 1 Hemoglobin Structure and Function Constructive
A short at-home lecture followed by in-class, small group activities: basic science workshop, multiple choice questions on hemoglobin answered by scratch-off forms, and a short answer patient clinical case.

Iron-deficiency Anemia Recognition
A short at-home lecture and paper to read "Mechanisms of Mammalian Iron Homeostasis". This was followed by followed by in-class multiple choice questions using scratch-off forms in small groups.

Sickle Cell Anemia Analytical
A short at-home lecture and paper to read, "Sickle-cell Disease". This was followed by small groups completing a clinical case study medical form. Unit 2

Neutrophils and Acute Inflammation Constructive
A short at-home lecture followed by in-class, small group computer based game "Corners". Each group discussed and answered nine questions.

Lymphocytes and Lymphatics
Analytical A short at-home lecture followed by in-class small groups researching and completing three brief clinical case study medical forms.

Monocytes
Recognition A short at-home lecture and brief in-class review.

Overview of Leukemia and Cancer Analytical
A short at-home lecture followed by in-class, small group role play. Groups completed a History and Physical form and present their case to the class.

Lymphomas Constructive
A short at-home lecture followed by in-class, small group "Cancer Jeopardy" game. Each group discussed/responded by displaying color-coded cards. Unit 3

HIV Disease / AIDS Virology Reflective
A short at-home lecture and review article to read, "Mechanisms of Disease: Where does HIV Live?" This was followed by an in-class, written thought response notecard exchange among students and short class-discussion.

HIV Disease / AIDS Therapy Exchanging
A short at-home lecture and PubMed biography search on HIV Disease. This was followed by in-class, group presentations on students' findings, and ethical dilemmas were presented in class by exchanging and discussing student notecard responses.

Platelet Disorders Analytical
A short at-home lecture followed by in-class, small group role play. Groups completed a History and Physical form and present their case to the class.

Venous Thrombosis Recognition
A short at-home lecture followed by an in-class short lecture and group multiple choice questions answered by scratch-off forms.

Atherosclerosis
Exchanging A short at-home lecture followed by student notecard exchange and computer based game "Kahoot!" R = Recognition, E = Exchanging, C = Constructive, F = Reflective, A = Analytical.
Teachers were required to adapt their course structure using an online Zoom-like format in response to the COVID-19 pandemic. F.C.C. taught and modified the course in the spring 2020 semester. Even in light of the online format, students reported enjoying active learning group sessions (personal communication, data not provided). We recommend that teachers (1) use online break-out rooms, but keep the same students in each group; (2) alternatively, the students were also asked to meet on their own time as groups using Zoom, and (3) we recommend that teachers remind the students to turn on their sound and videos in these groups. The students formed collegial bonds and re-established team-building relations during the pressing times. It was clear that most of the students reacted positively to re-joining their groups. Furthermore, as mentioned earlier, Recognition (such as at-home lectures and reading papers) was the most beneficial to students' comprehension. We believe this insight could encourage and normalize at-home learning and working opportunities for students and the workforce. While the COVID-19 pandemic was not directly studied and has its own challenges, take-home options allow people to control and customize their working and learning environment.
We then estimated and compared student comprehension of active learning topics and didactic lecturing topics within a course. We provide evidence that active learning improves course material comprehension on later exams. This study estimates a student will score better on future exams taught with active learning techniques compared to material taught through lecturing on average. The bivariate random intercept method captures the dependencies between repeated observations and decomposes the exam variability into student-level and observation-level variance. Therefore, we have evidence to believe that within a student course, material comprehension improves with active learning methods. Using the same professor to teach both groups (active learning and traditional lecture formats) removed the teacher as an additional variable in this comparison [41,42].
Both the honors and non-honors sections contain high-performing senior undergraduates, and the results may be different if the course contained less-experienced undergraduate students. We would like to emphasize that the value of active learning extends beyond exam comprehension, which was analyzed here. Active learning provides diversity in students' learning experience and acceptance of students from varying backgrounds. Many undergraduate students are pursuing science-related majors that will ultimately lead to careers in a variety of professional health fields, public service, education, or in basic/applied/pharmaceutical/government research. Active learning emphasizes team-based skills, which are essential skills to possess to successfully navigate in any of the aforementioned fields.
We provide evidence that student comprehension within a course varies between active learning and lecture learning, but our reported difference, 0.66-1.57% mean improvement, is smaller than previously reported improvement. STEM courses comparing active and lecture teaching methods show an average 6% in improvement, which compares comprehension across entire courses [43,44]. Our reported result is clinically small yet statistically significant, and we hypothesize that a different, interacting relationship may exist. Does an instructor who uses active learning not only improve comprehension on the material taught with active learning but also improve comprehension on material taught through lecture learning?
If this relationship exists, this suggests students' overall exam score will improve with blended teaching methods (both active and lecture learning methods). Therefore, the observable difference between lecture learning comprehension and active learning comprehension will decrease in blended learning environments; however, the overall comprehension will be improved. This interacting relationship will be critical to fully understand student learning when active learning methods are merged with lecture learning in the same course.
We present findings from a 15-statement survey on active learning given to students, which shows an increasing trend in student acceptance of active learning methods in the classroom. The survey data exposes an important aspect of students' self-reported learning experience. Students in this biology course tend to enjoy the diversity in teaching styles, respond positively to active learning, and are satisfied to very satisfied with active learning. Our results show an increasing trend for students' Perceived Individual Utility of active learning over the years 2012 to 2018. The cause of this trend is undeterminable and could be attributed to many interacting scenarios, such as the increased student familiarity with active learning or improved teaching by the professor. These results are beneficial to instructors because not only are students learning better with active learning, but students' perceptions of active learning are positively shifting to encourage its use in the classroom.
The limitations of this paper include the inability to control for age, gender, ethnicity, and other potential extraneous variables in analyses, which may confound results in this observational setting. We did not have demographic information; however, we believe using data to the best of their ability is a strength in this study. Thus, even if we could get information about a student's gender, age, etc., from the registrar's office, they would be "aggregate" variables (i.e., 49% female). Aggregate variables, like census-derived variables, hold limited information and are typically removed in statistical analyses. Additionally, our analysis looks at comprehension based on exam performance, but does not look at long-term comprehension, which is known to vary based on the original teaching method [45]. The students were typically high-performing and upper-level biology majors at UNC-CH, and our results may only be applicable to a similar classroom composition. Another limitation is the clustering of exam scores, making differences small, which may be due to excluding essay-type exam questions in analyses. Biology-based Teaching Assistants to help manage the course were not available to make this possible. Importantly, our results agree with previous reports describing an increase in comprehension comparing active learning to lecture learning, but our results evaluate the improvement within a course using both lecture and active learning methods.

Conclusions
The traditional method for teaching science courses at the University level is through lecturing where students are passively listening to the instructor [19]. By contrast, active learning methods are engaging to students and emphasize that learners have an integral role in in their own learning [19]. We know from the foundational studies of Bloom and associates and the many stellar educators who have modified Bloom's Taxonomy of Learning, that learning is a complex process [29][30][31][32][33] and that students learn, store, process, and recall information differently in an individual manner [24]. Our study was focused on the description and use of active learning subtypes to complement this complex, individual learning process. Figure 5 shows an overview of the five active learning subtypes next to the description of the six aspects of learning in Bloom's Revised Taxonomy, which provided the groundwork and model for this research.
available to make this possible. Importantly, our results agree with previous reports describing an increase in comprehension comparing active learning to lecture learning, but our results evaluate the improvement within a course using both lecture and active learning methods.

Conclusions
The traditional method for teaching science courses at the University level is through lecturing where students are passively listening to the instructor [19]. By contrast, active learning methods are engaging to students and emphasize that learners have an integral role in in their own learning [19]. We know from the foundational studies of Bloom and associates and the many stellar educators who have modified Bloom's Taxonomy of Learning, that learning is a complex process [29][30][31][32][33] and that students learn, store, process, and recall information differently in an individual manner [24]. Our study was focused on the description and use of active learning subtypes to complement this complex, individual learning process. Figure 5 shows an overview of the five active learning subtypes next to the description of the six aspects of learning in Bloom's Revised Taxonomy, which provided the groundwork and model for this research.
Our results imply that the use of active learning subtypes strengthens the educational value of active learning methods for new course development and assessment. Further research is needed to complete an understanding of active learning and its benefits regarding comprehension, especially long-term knowledge, the difference between honors and non-honors sections, and the potential interacting relationship using both active and lecture learning methods in a blended teaching style. Finally, we hope the positive trend in student acceptance of active learning will improve further and that researchers continue to evaluate students' perceptions on active learning as it becomes more integrated into students' educational experience.  Our results imply that the use of active learning subtypes strengthens the educational value of active learning methods for new course development and assessment. Further research is needed to complete an understanding of active learning and its benefits regarding comprehension, especially long-term knowledge, the difference between honors and non-honors sections, and the potential interacting relationship using both active and lecture learning methods in a blended teaching style. Finally, we hope the positive trend in student acceptance of active learning will improve further and that researchers continue to evaluate students' perceptions on active learning as it becomes more integrated into students' educational experience.