1. Introduction
1.1. Designing Education Innovation
The spread of the novel coronavirus at the start of 2020 shocked higher education across the world. To keep people apart and ensure the sustainability of learning, governments implemented social distancing and self-isolation measures, which emptied campuses, causing students and faculty to work from home. This pandemic provoked a rapid shift to emergency forms of online learning among major education systems, institutions, faculty, and students.
This crisis is one of the largest shocks to higher education in living memory. Occurring at the peak of globalization, it may be the largest ever. Even after just a few months, the world’s most eminent higher education scholars and leaders recognize that universities are likely to be impacted so dramatically that they will be fundamentally different after the pandemic [
1,
2]. Every facet of higher education has been touched, from student wellbeing and characteristics, to campuses and global research, to faculty characteristics and work, to university funding and policy. The economic implications will ricochet for years, perhaps even signaling a new era for higher education and the communities that it serves.
Such a shock drives an unprecedented need to investigate the nature of higher education. These developments call for urgent and expansive research. To this end, a comprehensive institution-wide program of higher education policy research was launched in early February 2020 at one of China’s leading universities. Broadly, this research sought to unpack what had happened, what was going on, and what lessons could be gleaned to guide post-pandemic innovation. An array of methods was involved, including a census of students and of faculty, analysis of policy documents and practices, production of institutional case studies, study of learning analytics and platforms, and interviews with university leaders. This paper reports key results from the student and faculty censuses and leader interviews. It documents one of the largest education transformations to ensure education sustainability at a prestigious global university.
It is important to stress at the outset that this research was about university education and people first and foremost, and only secondly about online technology. This is important because, despite ongoing interest in technology, it is people and institutions that make education successful, not computers. Technology can play an important enabling role, although it is most successful when it is directed by academic leaders rather than by technical or commercial interests [
3,
4]. Indeed, the maturation of EdTech has meant that, particularly in the last five years, technology has started focusing on education rather than the other way around [
5]. Rather than focusing on technology, contemporary academic leaders have started leveraging a range of different platforms and education experts to enable students and teachers to engage in more productive forms of higher education.
1.2. The University Case
The research focuses on the case of a leading Chinese university. Over the last two decades, this university has grown into one of the world’s most prestigious universities [
6]. It is gated, highly intensive, residential, and research productive. It is a high-tech university, although hitherto without formal online education.
In late January 2020, it became apparent to the university leaders that a novel coronavirus was likely to impact normal university operations in the coming months. At a university-wide academic leadership meeting, it was decided that the university would become the first of the world’s most prestigious universities to evacuate the campus and shift all coursework education online. The intent, broadly, was to implement emergency online learning to ensure safety and progress the upcoming semester as usual. In early February, days after nearly all students and faculty left for the Spring Festival holiday, the academic leaders gave the ‘first formal online class’ to more than 50,000 students and 10,000 faculty and staff. Faculty, staff and students, many with no formal online education experience, were given two weeks to prepare. In the following months, almost 2700 faculty delivered 4000 online courses to 25,000 students spread across every time zone and continent. It is important to qualify that top-quality online education has matured markedly in recent years, as just noted, and that much of what is referred to in this paper is better referred to as ‘emergency online education’.
This university did not spring into formal emergency online education in a vacuum, without resources or without an eye to the future. As a premier technical university, it plays a huge role in creating, designing and distributing education technology. Its global ranking in computer science is among the highest in the world [
7]. It is located in the heart of the world’s biggest multi-billion-dollar EdTech ecosystem [
8].The university is a pioneer in education technology in China, having developed global online and mobile learning platforms with innovative pedagogical and business models. Its engagement in education technology encompasses teaching and learning, basic and applied research, innovation, social service, and entrepreneurial spin-offs. So, while much formal education at the university remained very traditionally campus-based, it was already very technologically infused.
This paper reports on single-institution research, but this research and its contributions are notable for many reasons. Given the timing of the shock and academic calendar, the university appears to have been the first of the world’s major research universities with a diversified curriculum to shift into emergency online learning. It is likely the first time that one of the world’s most prestigious, gated, and residential universities has shuttered the campus and shifted education entirely online. Beyond a small selection of distance education institutions, China has had few formal policies regarding formal online university education. The highly stratified nature of the Chinese university system means that the university plays an important signaling and service function, both for education experimentation and for propagating education resources. Looking beyond China, this was the first time that a major higher education system in Asia embraced emergency online learning as part of formal education provision. Unlike other prestigious universities, particularly in Anglospheric countries, while highly tech-savvy, the faculty and students have little experience of online education. Given the elite STEM-emphasis of the university’s programs, placing much emphasis on creative discovery and collaboration, a great deal of education involved informal, individualized, ‘high-touch’, and global forms of education. Finally, and not least, the university has made several global commitments to sustainability in all its forms, from academic focus and functions, to campus operations, to research and partnerships. This research helped ascertain the viability of transformed operations.
1.3. Research Perspectives and Questions
The research commenced with university-wide planning, the formation of leadership and advisory structures, and the specification of detailed administration arrangements. The technical work involved environmental scanning and conceptual design, instrument development and validation, population specification and enumeration, fieldwork and quality monitoring, and analysis and reporting.
The overarching aim of the research was to identify the nature of the education transformation and to identify its implications for the future of high-quality and blended higher education. The specific objectives were to generate advice for university leaders, bridge research into quality assurance and online education, and contribute evidence to assist with post-pandemic policy formation. Three research questions were specified:
- (a)
What were foundation education experiences, qualities, and achievements?
- (b)
What are the experiences, qualities, and achievements of emergency online education?
- (c)
What can be learned about design scenarios for the sustainability of future higher education?
Theory helps make sense of changing phenomena, particularly during crises. As suits much policy and institutional research, an early design decision was made to be theoretically eclectic, pragmatic, and agile. This large study integrates existing research in fields like education evaluation, online learning, education quality, foresight analysis, student experience, learning outcomes, education technology, academic work roles and practices, university leadership, and management information. Cantwell, Coates and King [
9] and Hazelkorn, Coates and McCormick [
10] present the nature and diversity of the conceptual perspectives engaged.
3. Results
3.1. Quantitative Results
Data from the censuses were cleaned and merged, derivative and composite variables were created, and weights were calculated. Item-level missing data was minimal and was treated on a listwise basis. A sampling analysis was conducted, which compared numbers for population, sample, raw responses, and weighted responses. Both weighted and unweighted mean estimates were compared, and the differences were barely notable at two decimal places. Nonetheless, weighting was used to ensure accuracy.
A range of statistical analyses were conducted for the censuses. These included process controls for data integrity and validation checks, psychometric modelling to compile derivative and composite variables and prepare data for analysis, and multilevel longitudinal modelling to give full articulation of complex covariance structures.
In response to the first two research questions, a series of comparisons were conducted between time periods and participation groups to present quantitative results from the student and faculty censuses.
3.1.1. Difference across Time Periods
Student and faculty perceptions regarding online learning are different. In order to emphasize the variation of education experience, quality, and outcomes, new variables were generated for students and faculty by subtracting the mean scores for each composite in the fall semester 2019 from those of the spring semester 2020.
Figure 2 and
Figure 3 showed the mean difference of composite scores of student and faculty between the two semesters. It revealed that the faculty reported improved education quality, learning experience, personal development experience, and online learning experience under the new situation.
However, students’ opinions of outcomes, quality, and experience are mainly negative. Notably, faculty and students both agreed that the experience of collaboration has been damaged because of the pure online education mode. This suggests that even though it seems like social media and networks make people more connected than ever before, collaborative activities during learning and teaching are irreplaceable.
Following the research architecture (
Figure 1), comparisons were made across groups, time periods, and for a number of demographic and contextual factors. For instance, gender, location, study year level, IT equipment quality, to name a few. Mean/average and standard deviation scores were produced for both focus areas and composition scales (
Table 1) and for items in each time period (Fall 2019 and Spring 2020).
3.1.2. Students Perception of Online vs. Campus-Based Education
MANOVA was conducted to explore the effect of demographic and contextual factors on the composite scales, aiming to discover significant factors that influence online education experience, quality, and outcomes for students. Students’ perception seemed to be non-sensitive to the location where their learning happened. Economic area and rural/urban factors did not show significant effect on education experience, quality, and outcomes. Economic area refers to five major provincial groupings in China [
15]. Gender and academic field were not significant factors. There were statistically significant differences in students’ perception of education between the two semesters, based on their study year level, GPA quartile, and IT equipment quality. Thus, a series of follow-up univariate ANOVAs were performed to determine how the independent variables affect each of the dependent variables. GPA has a very strong influence on the difference between the two semesters’ education quality and outcomes but not on experience. Study year level and IT equipment quality showed a positive significant effect on experience, quality, and outcomes.
Tukey’s HSD post hoc analyses were conducted to further explore the mechanism between each level within the independent variables. It was found that although perceptions of experience, quality, and outcomes were reasonably consistent across levels of study, there was a significant dip for senior-year undergraduates and master’s students. Multiple comparison results showed a significant lower mean score for fourth year undergraduates and first year master’s students on the experience, quality, and outcomes difference between the two semesters compared with other grades (
Figure 4).
GPA quartiles were provided by the academic affairs office and used to categorize students into four levels. Students who reported a GPA in the second highest quartile tended to report worse education experiences. Students in the highest quartile reported lower scores for quality and outcomes (
Figure 5).
IT equipment quality influenced students’ experiences, perceptions of quality, and outcomes significantly. It is reasonable that poor and fair IT quality correlates to worse perception of online education versus on-campus education.
3.1.3. Faculty Perception of Online vs. Campus-Based Education
Similar to student data, MANOVA was also performed to explore the difference in education experience and quality between the two semesters from the faculty’s perspective (
Table 2). Economic area and rural/urban factors did not significantly affect faculty education experience and quality. This might because most faculty were in urban areas. Gender and birth year did not show significant effect on faculty experience and quality. IT experience did not make a difference to the faculty as it did for the students. This may be because most teachers were located in urban area therefore secured adequate IT experience during educational activities.
Academic field showed a significant effect on teachers’ perceived experience and quality in terms of online versus campus-based teaching. This may suggest that learning strategies may not differ from one discipline to another too much, although it is not the same story for teaching. Disciplines were categorized into five major categories, including Engineering (E); Science; Humanities, Arts, and Social Science (HASS); Medical and Health Sciences; and the interdisciplinary department of Shenzhen International Graduate School. There are four subcategories each under Engineering and HASS, making a total of 11 categories. A follow-up univariate ANOVA and Tukey’s HSD post hoc test were performed to further explore the relationship between academic field and semester differences for teaching experience and quality, as shown in
Table 3. As mentioned in
Section 3.1.1 in
Figure 2 and
Figure 3, the overall faculty perceived experience and quality were improved in the spring semester 2020. The post hoc results revealed that engineering fields improved more than HASS fields. Faculty in information technology reported significantly higher quality during online rather than face-to-face teaching, while for management under HASS the estimated marginal mean is relatively low (
Figure 6). The nature of these two disciplines may be the reason of the discrepancy. Online teaching is more adaptive to information technology when teachers share course materials and evaluate students’ learning achievements. However, for HASS fields, interaction is crucial between teacher and student, as well as between students. As mentioned in
Figure 2, collaboration and socialization are constrained when people can only communicate online.
Work start year significantly affects faculty’s perceived teaching quality between the two semesters but not perceptions of their experience. Two thresholds were set based on national policies. The first was 1998 when China started to expand college enrollment. More teachers were recruited into universities and colleges than ever before. The second threshold was the year 2015. Early in the following year, the Double First-Class initiative was first proposed to improve the overall education quality of top Chinese universities [
16]. Both policies deeply influenced faculty employment. Faculty hired between 1998 and 2015 reported a significantly larger difference in quality between Fall 2019 and Spring 2020 than the post-1998 (Mean difference = 0.0556,
p = 0.001) and post-2016 cohorts (Mean difference = 0.0202,
p = 0.001).
Overall, the census results convey that students and faculty gave similar reports for online and campus-based education experiences, with the exceptions that interpersonal and enriching experiences were lower, and faculty participation in pedagogical development was higher. Further, students and faculty gave the same quality rating to online and campus education, except that faculty reported a much higher increase in online education experiences, confidence with online education, and providing student support. Importantly, students reported the same outcomes for online and campus education, with the exception of social outcomes, which were lower.
3.2. Qualitative Results
Qualitative data from the student and faculty censuses and from the leader interviews was coded and analyzed thematically. These results regarding experience, quality, and outcomes were reflected in the university leaders’ observations. The thirteen leaders commented that:
“The second week of online teaching is much better than the first week. Some teachers also said when chatting that he felt strange at the first class, because it turns out that these teachers are not used to sitting in front of the computer and lecturing in front of the students for many years. So am I. In order to adapt to this teaching mode, I have created a similar simulated teaching environment. I set up a whiteboard. I also attempt to communicate with the students, poke them to answer questions, coordinate discussions and through the rain classroom. Now it seems that I have entered into a good status.”
(L4)
“At present, more than 80% of the students report that the effect of online teaching is better than offline teaching. The reason may be that online teaching increases interaction, and each student dares to speak through the bullet screen. The teacher has a selective comment on the speech.”
(L7)
“Some offline interactive activity such as weekly group meetings can be held online. Students who are going abroad or even graduates can participate into the meeting to share their experience and insights.”
(L3)
The census quantitative results were augmented by many thousands of qualitative responses received in Chinese and English from the leaders, students, and faculty, which were coded thematically according to the research architecture in
Figure 1. These reveal much about specific areas such as support, curriculum, teaching, assessment, and enrichment.
Support is an important part of people’s education experiences.
Figure 1 reports that students perceived similar levels of support, though faculty saw emergency online education as involving greater levels of support. The qualitative data helped tease out the different support needs between online compared with intensive campus-based education. For instance, online education requires providing IT help to students to ensure they can study at home; expanding communication and support to students; increasing opportunities for informal interaction with other students; establishing forms of assessment that reward student engagement; training students in how to learn independently online; ensuring that students can access materials, including library materials; providing different and increased opportunities for gathering and acting on feedback; adding additional online careers and psychological counselling supports; and opening greater options for informal communication with faculty and staff.
Obvious curriculum implications arise from a shift to emergency online education. The quantitative results, however, do not reveal meaningful differences regarding curriculum, perhaps due to the existing extensive use of technology in campus teaching. In their qualitative response, students and faculty highlighted the availability of open courseware to facilitate supplementary learning, adapting curriculums to online formats, and making use of internet resources, as well as eliminating redundant materials, eliminating courses and curriculum that are not suitable for online delivery, reducing didactic presentations and opening opportunities for more flexible and self-paced learning, and shifting to experimental classes online using virtual reality. Regarding curriculum and learning resources, the academic leaders observed that:
“We also have hands-on experimental classes. These courses cannot be organized online. Although the virtual experiment can be applied, it is a supplement, not a substitute for hands-on class. So the online teaching is not suitable for all courses.”
(L6)
“The main disadvantage of online teaching is that it is not face-to-face. “Face-to-face” can not only close the distance, but also provide emotional communication. For example, for anxious students, face-to-face counseling and question-answering are very necessary. Currently, a lot of students are facing learning maladjustment, which is the challenge caused by online teaching.”
(L7)
“There is a lot of feedback from students: the lack of paper-based courseware and teaching materials; lack of real classroom environment; lack of peer discussion.”
(L9)
The results reveal much about teaching in general and teaching online. The quantitative results reveal that faculty invested substantially more time in learning about teaching and student support, as well as in preparation and actual teaching. Students and faculty made many observations about teaching in the qualitative response, noting, for instance, that: online coaches could be provided to augment formal lectures, there is a need to ensure that faculty are trained and competent online teachers, there is a need to adapt teaching styles and techniques for online provision, teachers and students should be trained in various facets of online education such as active communication and time management, faculty can make sophisticated use of recording and videoing to enhance and expand education delivery, there is scope to engage and support a wider range of external and visiting scholars in the teaching process, teaching should be highly interactive and focus on communication rather than content delivery, and classes should be ‘flipped’ such that materials are provided before class, and online classes are focused on interaction. Regarding teaching, the leaders noted that:
“We really worry about the quality of teaching for international students, as they do not interact much online and we do not know how to initiate their motivation.”
(L2)
“Students’ self-discipline affects the efficiency of online education. Self-discipline is out of our control. If students do not find what teachers are saying interesting, they may just leave the platform open and do their own work.”
(L9)
While this study was conducted before the main end-of-semester assessments, many courses had already passed through mid-semester assessments. The census results indicated that students saw various forms of assessment and similar contribution as being challenged during emergency online education, although such concern was not evident among the faculty. Students and faculty recommended that there should be more regular homework and feedback to help scaffold and give momentum, that there is a need to develop specialized online assessment tools, that students required greater monitoring and explicit feedback, that collaborative groupwork could enhance student interaction as well as moderate participation and contribution, that distance learning calls would benefit from the adoption of more formative rather than summative forms of assessment, and that emerging techniques and methods could be used to enhance assessment. Observations from the leader interviews about student assessment included that:
“Examinations are such a serious thing that they even have some legal effect. How will we organize the midterm and final? How to guarantee the fairness of that? If the fairness cannot be guaranteed, the teaching order will face challenge.”
(L7)
“After the second week of this semester, the president immediately focused on scientific research and student graduation. If the work of graduation is not done well, the impact is larger. Although our university had planned to remove the publication requirement for students’ graduation, the official documents were never issued. But this is the point at which the university has to deal with this as soon as possible. This involves breakthrough and establishment. Why the university has not issued the documents is that it means “breakthrough”, but we also need “establishment”. Recently, a whole-process quality document is designed in response to the establishment.”
(L13)
University is about far more than formal discipline-based learning, which is why the research tapped into a broad notion of education. It focused on formal coursework teaching and learning, and stretched further to embrace, for instance, research experiences, social and interpersonal activities outside classes, clubs, cultural activities and sports, student support in both academic and daily administrative stuff, and career/professional development.
Table 1 and
Figure 3 convey that it is this broader facet of university study which suffers with emergency online education. The students and faculty identified that more thorough re-engineering would be required by bringing more external and international experts into the teaching process, opening access to a range of courses so that students can augment their formal learning with additional inquiry, enlarging the volume of credits/courses that a student can participate in to diversify a program of study, giving clearer recognition to private study so that time with others can be invested in broader enriching experiences, and providing more fun and social online and careers-related interactions.
4. Discussion
This paper has analyzed research revealing that to ensure sustainability, in just a few months leaders, students, staff, and faculty at a major university transformed a prestigious residential research university with limited formal fully online education into what is perhaps the world’s most prestigious and programmatically diverse online universities. This transformation, sparked by the viral epidemic, has revealed much about education and the future of universities. By way of conclusion, in response to the third research question, it is helpful to articulate broad insights into the future of university education and associated areas for development.
Most basically, the findings hasten the formation of blended forms of university education. This situation has been bolstered by the global reliance on online emergency learning to deliver core education services. Systems, experiences, and expectations have been quickly forged and will almost surely yield widespread and enduring changes for higher education. It is not possible nor seemingly desirable to ‘go back’ from much that has been experienced. Seemingly, online learning has indeed grown beyond smart acronyms and joined mainstream education [
17,
18,
19]. Education systems across Asia will almost certainly place more emphasis on formal online education. Such a move holds global consequences, with Asia being the world’s biggest time zone for higher education. New regulatory policies and cross-border agreements will be required. Countries will need to negotiate new rules with physical institutions such as campus-based universities, including bolstering the already flourishing emergence of life-long learning.
To ensure sustainability, this broad transformation signals a need for many more specific facets of education reform. It is helpful to spell out specific developments, all of which have already been the product of widescale validation and discussion [
2].
The results pertaining to student support convey the need to establish and activate new arrangements that address administrative, academic, and personal problems. The research findings confirm that online teaching platforms, tools and equipment should be basic and low-profile instead of advanced and luxurious, so that everyone can afford and access them without discrimination. Universities will need to ensure that students and faculty have IT equipment that furnishes them with a high-quality experience. As online learning requires more specialized student support, there is a need to create more teaching assistant positions and enhance training to ensure high-quality support for faculty and students. More ambitiously, different kinds of ‘academic success professionals’ who focus persistently on student success by integrating student support, academic administration, and individualized learning are likely required. Learning alone in a room with a computer, even with videoconferencing, is a very different social and personal experience to learning in-person with peers. Students must be even more active and collaborative, self-directed and supported [
20]. To enhance education equity and achievement, students will need academic skills training on how to succeed in blended education environments so that they can regulate and enrich their learning.
The findings convey that with shifts to online education, universities should ensure that relevant curriculum materials are adapted for online delivery by drawing on progress made by large education service firms and engaging ‘professional education engineers’ in curriculum reviews and quality verifications. More fundamentally, as part of this research it was proposed that the shock could well lead universities across China, Asia, and the world to consider the nature of the course and look at sharing courses and recognizing credits to maximize student and institutional benefit. This kind of transformation is already reflected in shifts towards micro-credentials, lifelong learning, and open courseware, and it would be accelerated if propelled by leading research universities [
21,
22]. Universities and faculty can design core education services that shift information dissemination online and magnify the social, interpersonal, and enriching facets of campus education.
Teaching stands out as an area for reform. Online teaching has to be much more programmed than campus-based provision, requiring specific training of faculty. Faculty will need support to grow into this new environment through training in pedagogy, building relationships with teaching support staff, learning how to exploit software to enhance academic productivity and success, and adapting to greater transparency. The findings convey that to enhance teaching, universities should design and provide an exciting array of professional development for faculty, and teaching faculty are encouraged to complete training in online education that enhances basic teaching techniques, looks at the elements of student success, and discusses problems and workarounds.
Assessment remains an area in need of substantial educational reform. Results from this research affirmed that universities must urgently investigate the development of sophisticated and productive online assessment education technology [
23,
24]. Universities will need to make substantial investments in bringing to scale robust solutions for assessing student learning, finally integrating academic leadership, assessment methodology, and education technology.
Shifting formal learning online carries basic consequences for the broader enriching facets of university education. Online learning was more supportive of individual needs than social study. Clearly, campus-, field- and travel-based forms of education and exchange are hindered with emergency online education. Nonetheless, the study affirmed that online provision can be used to make formal learning more flexible, diversify formal learning, and open access to additional enrichment experiences.
Underpinning such education reform is needed to improve management and assurance of quality. It is disturbing that even after two decades of growth, very little is known about the quality of online education, and little if any management information is available [
19]. Governments and quality assurance agencies remain rightly uncertain, and hence skeptical, about the characteristics, quality, and contribution of learning online [
25]. Novel forms of quality governance are required to ensure success when IT is added to education practice [
26]. Universities will need to routinely collect large volumes of data on education, requiring the formation of new theories, new analytical and reporting techniques, and new strategies for helping people interpret patterns and identify consequences. University quality assurance and enhancement must change to take account of changes in education such as greater scale, online communication, contemporary platforms and data, and new forms of collaboration.
Research on this scale generates results and findings with many implications. In addition to responding to the research questions, the infrastructure, methods, results, and outcomes developed through this research make broader contributions. The research gives guidance on how to blend online and campus education in productive ways. It clarifies quality and productivity indicators for technologically distributed education at prestigious research universities. It has produced data collection instruments for ongoing quality monitoring. Importantly, it has established baseline data for ongoing evaluation and continuous improvement. Combined, these implications cement a need for increased research into online education, engaging research not only into online technologies but also exploring basic questions about quality and standards, basic characteristics, and social and emotional implications.
Overall, this research shows that education technology can be readily deployed in highly sustainable and productive ways that extend traditional university boundaries and engage a much larger and more diverse range of people in purposeful academic activities. The formation of blended education communities carries the potential to reshape international patterns of study, assure the sustainability of learning, expand global partnerships, make major contributions to life-long learning, re-parcel learning into smaller resources, reshape the way achievement is recognized, and spawn new kinds of credentials. Clearly, these insights are just summary observations from a very large, rapid, and ambitious research project. It is essential that ongoing research is conducted to monitor progress and generate insights that can help create and guide future university transformation.