Factors Driving BIM Learning Performance: Research on China’s Sixth National BIM Graduation Design Innovation Competition of Colleges and Universities

: With the popularization and rise in BIM technology usage, BIM education for undergraduate students in architecture, engineering, and construction (AEC) related disciplines has emerged as a priority. This study assesses the BIM learning outcomes of students participating in the National BIM Graduation Design Innovation Competition of Colleges and Universities. In total, 2777 valid questionnaire responses were obtained for this study. The Cronbach’s alpha coefﬁcient method and principal component factor analysis method were used to verify the reliability of the data set (Cron-bach’s alpha = 0.962, KMO = 0.965). The t -test (ANOVA) was used to verify that gender, school type, major, grade, study duration and use BIM related software, as well as other demographic attributes, displayed signiﬁcant inter-group differences. Seven common factors affecting BIM learning performance were obtained by exploratory factor analysis: (1) ability of the instructor, (2) school (college) atmosphere, (3) teamwork, (4) individual ability, (5) understanding of BIM industry applications, (6) social environment incentives, and (7) achievement demand. Finally, the results of an ordered logistic regression revealed that the demographic attributes of participants, the comprehensive ability of the instructor, teamwork, individual ability, and achievement demand signiﬁcantly affects BIM learning performance. Based on these ﬁndings, this paper puts forward suggestions for improving BIM learning performance and provides theoretical support for BIM education and learning in AEC related undergraduate majors.


Introduction
As a major digital technology used by the AEC industry [1], building information modeling (BIM) has emerged as the main focus of professional learning in AEC-related higher education [2]. BIM learning has become the foundation for the sustainable development of the AEC industry. BIM learning supports the sustainable application of BIM technology across the stages of design, procurement, manufacturing, construction, operation, and maintenance [3]. Although scholars have made great progress in BIM research, with BIM technology now even widely used in Financial Investment Projects [4], nevertheless, there remains a disconnection between theoretical education and engineering practice in BIM learning [5].
College and university discipline competitions are based on classroom teaching where competition is used to stimulate student's abilities, such as combining theory with practice, independent thinking and teamwork [6]. Discipline competition can cultivate students' practical innovation ability and promote the all-round development of college students, which has become an important part of practical teaching [7]. Discipline competition is not only an important means of talent training in universities, but also an important basis by which employers select graduates [8]. Thus, college students respond by showing great interests in discipline competitions. At present, there are a large number of BIM related discipline competitions being held in China, as well as in other countries. These include: the Annual Brilliance Competition for Infrastructure, the Excellence in BIM Competition for the Global Engineering and Construction Industry, the Hong Kong International BIM Competition, the Building SMART International Competition, the China National Competitions, the National College BIM Graduation Design Innovation Competition, the China Construction Engineering BIM Competition, the Transportation BIM Engineering Innovation Award, the Innovation Cup Building Information Model Application Design Competition, the You-lu Cup National BIM Technology Competition, the Municipal Cup BIM Application Skills Competition, among others. Moreover, BIM-related competitions are sponsored by enterprises and industry associations across various provinces and cities in China. The organizers of discipline competitions usually partner with enterprises. Students not only enhance their BIM skills as demanded by the requirements of the competition, but also leverage their career development after employability [9].
Nationally, across China, graduation design is a compulsory course of AEC-related education, which is the main link between theoretical education and engineering practice. It is formulated to help students smoothly transition from school education to professional practice after graduation [5]. BIM technology is sits at the core of the future sustainable development of the AEC industry. Therefore, it is crucial to identify the driving factors of BIM learning outcomes and extract those mechanisms that augment BIM learning performance. Consequently, this study investigates the sixth National BIM Graduation Design Innovation Competition of Colleges and Universities (sixth NBGDIC) as a representative vehicle for unpacking the driving factors that accelerate BIM learning. To this end, exploratory factor analysis and ordered logistic regression of returned questionnaire survey results are used.

BIM and Related Technologies
Building information modeling (BIM) and virtual reality (VR) have attracted increasing attention within the AEC industry over recent years. Virtual reality allows simulation of dangerous, expensive or hard-to-reach environments. It can improve the learning process and motivate students to develop the skills they need to succeed and innovate [10]. Alizadehsalehi, S., et al. argues that VR technology in the AEC industry makes it easier for students to understand digital data in BIM [11]. In addition, Wang, L., et al. suggests that BIM can be integrated with other digital technologies or platforms, such as 3D printing, drones, mixed reality and laser scanning [2]. Digital twins (DT) can use both real-time and historical data to simulate the future state of an asset and predict the consequences of maintenance operations [12]. Many researchers try to use BIM as a basis to develop the DT of a building, for either existing buildings or those in the design stage [13]. The combination of extended reality (XR) and BIM provides interactive renderings, spatial coordination, and virtual models, and provides many benefits that can improve the performance of AEC projects, including time, cost, quality, and safety. This integration is useful not only during the design and construction phases, but also during maintenance [13]. In the AEC industry, XR technology that simulates a building project in a multidimensional digital model and presents multiple aspects of the project can be of great help at all stages of a project [14].

Factors Impacting BIM Learning Performance
A systematic examination of existing literature reveals the current, known factors influencing discipline competition outcomes, and these include the demographic attributes of participants, social environment incentives, level of team cooperation, ability of instruc-tor, among others [15,16]. This study develops this knowledge to in an effort to establish the influencing factors impacting the BIM learning performance of AEC undergraduates.
Obviously, the individual idiosyncratic characteristics of participants are the key determinates of learning performance. Previous studies have found that individual ability (thinking, reasoning and task execution) and achievement demand (motivation, attitude or belief) significantly affect students' learning performance [16,17]. Individual thinking mode, reasoning, and task execution ability can affect and assist individuals to deal with the problem of multilateral cooperation between multiple tasks [18], thus significantly affecting the final learning outcomes of learners [19]. However, individual ability is not the only driving factor of learning performance [20]. Peiró, J.M., et al. (2020) found that the learners' perception of the importance of the learning task significantly affects learning motivation, attitude and belief, and thus consequently affects ultimate learning performance [21]. Over the duration of a discipline competition, students will draw on their personal store of knowledge and practical ability, yet incentivization through awards and honors can also leverage motivation, which in turn can be expected to impact final learning performance.
In addition to the learner's personal characteristics, the instructors' comprehensive ability will also significantly affect the students' learning performance, good teachers can improve the students' learning scores to varying degrees [22]. Some studies have shown that the important factors affecting the learning quality of college students include the professional ability [23,24], daily guidance behavior [25], and the effectiveness of guidance [26] of the instructors. Teams participating in the BIM Graduation Design Innovation Competition need to complete the work with the help of the instructors. The competition process involves theoretical knowledge and practical operation. Therefore, the instructors are important for BIM learning performance.
"Teamwork" refers to a method of cooperating with a group of people to achieve a goal through interdependent actions and mutual accountability. Effective teamwork requires individual self-efficacy, proper communication among members, and acceptance of suggestions and instructions from leaders and others [27]. Studies have found that team size and communication frequency between team members have a significant effect on team work performance [28]. The National BIM Graduation Design Innovation Competition is a blend of project construction cost, engineering management, building material supply, and so on, which needs students from different majors cooperating with each other and apply different software to complete the solution design, digital construction design, 3D digital model reconstruction, writing reports, and so on. Thus, team members need to communicate effectively and work in close collaboration.
Social environment incentive refers to the incentive effect generated by the social system, production relations, and social relations between people in a specific period and a specific region [6]. External objective factors such as the rigid requirements of schools for students to participate in discipline competitions and the influence of the group they are in, as well as motivational factors such as school rewards and class awards and excellence evaluation, may have a great influence on student' learning performance [29]. For example, as time goes on, individuals will be influenced by the team, and the goals of individuals and groups will gradually converge [30]. At the same time, performance-based rewards have a positive effect on individual performance [31], and rewards can be used as an effective management tool to improve people's work performance [32].
School is the main platform for education and teaching activities, and the impact of school education and teaching on the students' learning performance is particularly important [33]. School atmosphere is a comprehensive reflection of the school environment variable, which not only refers to the physical environment in school (such as construction, lighting, and so on), but also to the individual measurement of school experience, including the organizational level, the teaching level, interpersonal relationship, culture, values, and other aspects [34,35]. The school atmosphere exerts a subtle influence on students, which is directly related to the students' academic achievements and future development [36]. A good learning atmosphere not only includes reasonable curriculum planning, positive teaching atmosphere, perfect hardware facilities, but also includes the emphasis given by the school to students' extracurricular activities and taking an active part in competitions.
Research shows that college students have a higher understanding of the industry and better academic performance, and they have a higher probability of finding an ideal job [37]. Therefore, if students have a clearer understanding of their ideal employment after graduation, they will be encouraged to spend more time working towards it. BIM implementation strategies are increasingly driving the use of this technology in the AEC industry worldwide, and Chinese Government agencies have deployed a number of strategies aimed at promoting the development and adoption of BIM [38]. Since 2011, The Ministry of Housing and Urban-Rural Development of China has updated the BIM technology promotion policy annually. In December 2016, the Unified Standard for the Application of Building Information Model approved by the Ministry of Housing and Urban-Rural Development was the first national standard for the application of BIM in China, which had a critical impact on the development of BIM technology in China. From 2017, a series of policies and standard documents issued by the State Council and the Ministry of Transport has also promoted the sustainable development of BIM technology. These policy documents targeted specific projects on the adoption of BIM, and provide technical guidance for the application of BIM across all national engineering endeavors. In 2018, policies and guidelines on BIM implementation were again updated. The construction industry has thus transitioned from traditional construction practices to BIM-based practice. The more students know regarding the application of the BIM within industry, the more they can be expected to be motivated to master BIM technology and in so doing, cultivate the furtherance of BIM uptake across the AEC industry.

Questionnaire Design
Based on the previous research and the tracking investigation of the sixth NBGDIC, the questionnaire design of this study mainly includes two parts: Part I: basic demographic information of the participants, including gender, age, team name, school, major, grade, years of using BIM-related software, the degree of correlation between this competition and their graduation design, and so on; Part II: BIM learning performance driving factor scale. A five-point Likert scale was used to measure the degree of conformity between each observation variable and the contestant [39][40][41][42][43]. Points 1 to 5 indicated "completely inconsistent", "basically inconsistent", "general", "relatively consistent" and "completely consistent", respectively. The measurement scale of the questionnaire is mainly derived from relevant literature and combined with interviews with competitors. Seven predictors, including individual ability, achievement demand, instructor quality, teamwork, social environment incentive, school (college) atmosphere, and understanding of BIM industry application, were constructed, and 44 corresponding measurement items were designed.

Date Collection
The purpose of the sixth NBGDIC is to promote the BIM application skills for AEC related students. The sixth NBGDIC provides a new way for the application and exploration of BIM technology in colleges and universities, provides ideas for opening BIM-related courses and subject research, and improves the employment rate and employment quality of students. The participating teams of the sixth NBGDIC will upload their work through the Internet according to the registration items. The uploading time is from March 2020 to April 2020. The competition contains seven modules: (A) BIM modeling application, (B) BIM cost management, (C) BIM-based digital construction organization design, (D) BIM-based 5D construction management, (E) structural design based on BIM+ assembly, (F) innovation module, including intelligent construction and management innovation, (G) architectural decoration virtual design. This competition sets up four awards: first prize, second prize, third prize and excellence award. This research questionnaires, as the feedback of the participating students' experience, were issued to the competition system by the sponsor Glodon Company Limited on 8 May 2020. After a month of follow-up investigation, 2790 questionnaires were finally collected, and questionnaires with missing data were eliminated. Finally, 2777 valid questionnaires were collected with an effective recovery rate of 99.53%. The results of the competitors were published on the official website (http://gxbs.glodonedu.com/ (accessed on 30 May 2020)) in late June 2020. In this study, the maximum value of the results for each team was taken as their BIM learning performance, which was assigned as "no winning = 0", "excellence award = 1", "third prize = 2", "second prize = 3", and "first prize = 4".

Data Analysis Method
The SPSS24.0 software was used to analyze the survey data. The Cronbach's alpha coefficient method was used to test the internal consistency of questionnaires data, principal component factor analysis was used to test the structural validity of questionnaires data, and the t-test or ANOVA was used to check the inter-group differences of data. Exploratory factor analysis was conducted on the 44 driving factors of BIM learning performance by maximum variance method. Finally, the BIM competition results are taken as BIM learning performance and the influence of the aforementioned factors based on BIM learning performance is explored by ordered logistics regression [44].

Data Description
In this study, 2777 valid questionnaires were collected, there were 1582 male contestants and 1195 female contestants. The age group ranged from 19 to 24 years old (n = 2713, accounting for 96.7%). Juniors (n = 1007, 36.3%) and seniors (n = 1340, 48.3%) accounted for more than 70% of the total competitors. The participants came from 330 colleges and universities, among them, 134 were research-oriented colleges/universities, accounting for 4.8%, 2041 were application-oriented colleges/universities, accounting for 73.5%, and 588 were applied research-oriented colleges/universities, accounting for 21.2% (the distribution of the sample colleges/universities are shown in Figure 1). According to different majors of competitors accounting for more than 1%, the competitors were divided into seven categories, including construction management (n = 973, accounting for 35.0%), engineering cost (n = 851, accounting for 30.6%), civil engineering (n = 529, accounting for 19.0%), water supply and drainage science and engineering (n = 71, accounting for 2.6%), building environment and energy application engineering (n = 63, 2.3%), building electrical and intelligent engineering (n = 51, 1.8%), and others (n = 239, 8.6%); the majority of participants have learned and used BIM-related software for no more than 5 years, and those who have used BIM for 2 years are the most (n = 937, accounting for 33.7%). More than 50% of the participants thought that the sixth NBGDIC was related to their graduation designs (n = 1414, accounting for 50.9%); the details of the participants are shown in Table 1. than 50% of the participants thought that the sixth NBGDIC was related to their graduation designs (n = 1414, accounting for 50.9%); the details of the participants are shown in Table 1.

Reliability and Validity Test
Generally, the Cronbach's alpha is greater than 0.8, which indicates an excellent internal consistency of data, which fulfills the requirements for further analysis. The results of the data analysis in this study show that the Cronbach's alpha coefficient is 0.962 and the number of items is 44, indicating that the data have good reliability. Meanwhile, the KMO value of the study data is 0.965, which is greater than the critical value of 0.5, and the significance probability of the Bartlett sphericity test is 0, indicating that the data are suitable for factor analysis.

Difference Analysis between Groups
Results show that the maximum average score of the contestants is 3.07 ± 1.291, among which 39.4% are above the average score, and 60.6% are below the average score, in which males are (3.1 ± 1.3) and females are (3.0 ± 1.3). The applied research colleges/universities (3.2 ± 1.3) received the highest score, students majoring in building electrical and intelligent engineering received the highest score of (3.3 ± 1.2), and freshmen received the lowest score of (2.5 ± 1.4). Participants who have studied and used BIM-related software for more than 3 years have the highest score (3.3 ± 1.3), and no significant difference exists among the relevant degree of this competition and their graduation design. The difference analysis results of the BIM learning performance between groups are shown in Table 2.

Exploratory Factor Analysis
In this study, the dimension reduction was conducted on 44 BIM learning driving factor items. In the exploratory factor analysis process, the method of maximum variance was used for factor rotation, which made each factor load change to the two extremes of larger or smaller, and the items with the maximum rotation load of less than 0.4 were deleted. Results show that there were seven common factors with eigenvalues greater than 1, and the total variance explanatory variance was 73.022%. The common factors of the seven dimensions are 1 = the comprehensive ability of instructor, 2 = school atmosphere, 3 = team collaboration, 4 = participants' personal ability, 5 = understanding of BIM industry application, 6 = social environment incentive, and 7 = achievement demand. The specific results of each factor load are shown in Table 3.

Ordered Logistic Regression
In this study, ordered logistic regression was used to explore the influence of the above factors on BIM learning performance based on the sixth NBGDIC. The results show that among the seven common factors, four common factors significantly affected the BIM learning performance, which were the comprehensive ability of instructor (p = 0.002 < 0.1), team collaboration (p = 0 < 0.1), participants' personal ability (p = 0.001 < 0.1), and achievement needs (p = 0.066 < 0.01); Moreover, the gender, type of school, type of major and time of learning and using BIM-related software all have a significant effect on the BIM learning performance; however, the college/university atmosphere, participants' understanding of BIM industry application, social environment incentive, and the correlation between this competition and their graduation design have no significant effect. The detailed results of the ordered logistic regression are shown in Table 4. Correlation function: fractional logarithm. A set this parameter to zero because it is redundant.

Effects of Demographic Variables
The time of the participants' learning and use of BIM-related software has a significantly positive effect on their BIM learning performance (β = 0.071, p = 0.049). BIM provides a collaboration platform to support collaboration between different business fields [39], in which competitors need to spend energy and time to learn the operation of BIM software. However, accumulating scientific knowledge can improve innovation performance. Therefore, continuous accumulation of BIM-related software learning and operation is the guarantee to improve BIM learning performance. The BIM learning performance of male students was significantly higher than that of female students (β = 0.159, p = 0.029). BIM learning involves professional theories and software operation practices related to construction. Existing studies show that male students are more in demand in the construction industry, and male students are more suitable to engage in construction-related jobs from the perspective of construction enterprises [45]. The BIM learning performance of students from different types of schools is significantly different between groups. The BIM learning performance of students from research-oriented colleges/universities (3.1 ± 1.3) and application colleges/universities (3.0 ± 1.4) is lower than that of students from applied research colleges/universities (3.2 ± 1.3). According to the results of the ordered logistic regression, taking the BIM learning performance of students in applied research universities as the reference, the BIM learning performance coefficients of students in both research and application universities are significantly negative. Therefore, the BIM learning performance of students in applied research colleges/universities is relatively better. BIM learning requires not only a professional theoretical basis, but also practical ability, which is consistent with the educational orientation of "practical application + theoretical research" in applied research universities [46]. There are also significant differences in the BIM learning performance of students across different majors. The scores, from high to low, are building electrical and intelligence (3.3 ± 1.2), building environment and energy application engineering (3.2 ± 1.5), civil engineering (3.2 ± 1.3), engineering cost (3.1 ± 1.3), water supply and drainage science and engineering (3.1 ± 1.2), engineering management (3.0 ± 1.3), and others (2.8 ± 1.3). The results of the ordered logistic regression show that the majors of higher education students significantly affect the BIM learning performance. With the continuous promotion and practical application of BIM technology, BIM technology has been widely known by practitioners in the construction industry, and BIM technology education has also been implanted into the talent training programs of AEC-related majors [47]. In addition, the diversification and complexity of building functions also require the cooperation of multiple professionals to complete the implementation of BIM technology [48]. Therefore, from the analysis of BIM learning performance, students majoring in new technology and construction have better BIM learning performance, but the comprehensive application of BIM technology should be completed in collaboration with multiple majors to realize the effective collaborative management of BIM.

Effects of Common Factors
The above results show that in the sixth NBGDIC, four common factors have significantly positive effects on the BIM learning performance, and the effect degree from large to small is as follows: team collaboration, individual ability, the comprehensive ability of instructor and achievement demand. First, team collaboration is significantly and positively correlated with BIM learning performance (β = 0.191, p = 0.000), indicating that the degree of cooperation between team members will significantly improve BIM learning performance. David W Johnson (1993), an American education scholar, found that "cooperative learning is the most important and most successful in more than ten years" [49]. Cooperative learning has been widely used in teaching reform in many countries and regions in the world. Cooperative learning can improve students' learning performance to the greatest extent [50]. As the frequency and quality of team members' communication improves, so does team work performance [51]. The NBGDIC is a multi-disciplinary cross-integration competition, which requires team members to have a high degree of cohesion and cooperation. Each member should perform a good job in their own professional field and everyone should communicate effectively and work together to complete the competition. Therefore, the degree of team collaboration becomes the most significant factor affecting BIM learning performance. The individual ability of participants significantly affects BIM learning performance (β = 0.122, p = 0.001), which becomes the second most influential factor after team collaboration. Studies have shown that students' self-learning ability and professional foundation significantly affects professional learning performance [52]. Instructor's comprehensive ability also have significant positive effect on BIM learning performance (β = 0.107, p = 0.002). According to the measurement indicators of instructors' comprehensive ability, BIM learning performance can be significantly improved by encouragement, affirmation, effective suggestions and in-depth guidance from instructors. Existing studies have also shown that the harmonious relationship between instructors and students may play an important role in promoting the students' development and affects the students' systematic mastery of certain knowledge [53]. The results of this study show that participants' achievement requirement have a significant positive effect on their BIM learning performance (β = 0.063, p = 0.066). Existing studies show that the learners' perception of the importance of learning tasks and their interest in learning tasks may significantly affect their learning motivation, attitude, and belief, thus affecting their learning performance [21], which is consistent with our research results.

Conclusions and Recommendations
This is the first study to take the participants of the Sixth National BIM Graduation Design Innovation Competition of Colleges and Universities as the object of investigation, and to undertake a research design, data collection, and data analysis on the influencing factors of BIM learning performance within such a context. Over the month following the event a questionnaire survey was sent out to participants and a total of 2777 valid responses were returned for analysis. Seven common factors affecting BIM learning performance were extracted using exploratory factor analysis, while an ordered logistic regression was used to ascertain the influence of the derived driving factors on BIM learning outcomes. Findings provide theoretical support for an in-depth understanding of BIM learning drivers, while also offering insights into ways and means by which BIM education in Chinese colleges and universities can be further enhanced. These are: (1) Strengthen the fundamental professional knowledge and sustainable learning ability of college students majoring in AEC related disciplines; (2) Provide real-time attention to the developmental trends of BIM in industry and translate these into the BIM learning environment, which in turn will improve students' incentives, willingness and interest in mastering BIM; (3) Encourage students of multiple majors in AEC related disciplines to cooperate and learn BIM, and create reasonable divisions of labor while sharing skills according to professional backgrounds; (4) Improve the comprehensive ability of BIM instructors in all aspects of BIM, including in competencies such as team liaison, the technical features of BIM, and BIM as a management tool, combined with a systematic understanding of the developmental trends of BIM in the AEC industry; (5) Undergraduate AEC related majors should implant BIM theory and application into current 'talent training' programs across the full duration of the four-year learning process in colleges and universities.
While significant research advancements have been offered in this paper, there are limitations. These may be taken up in subsequent research work: (1) This is the first study on BIM learning performance undertaken with regard to the annual NBGDIC competitions. However, the impact students' various majors have on BIM learning outcomes, while anticipated to exert some influence, was not investigated. (2) In conducting the survey, it was discovered that extant research has paid scant attention to the application of BIM technology in colleges and universities.
The anticipated next related research step will be to examine how to fully combine BIM education with university education, promote and publicize BIM education in colleges and universities, promote BIM as a legitimate, independent professional course in colleges and universities, and conduct in-depth research on the development of cooperative ties regarding BIM between universities and industry. Institutional Review Board Statement: The study was approved by Department of Construction Management, Chengdu University of Technology.
Informed Consent Statement: Informed consent was obtained from all subjects involved in the study.

Data Availability Statement:
The data are available from the corresponding author upon reasonable request.