Next Article in Journal
Novel COVID-19 Outbreak and Global Uncertainty in the Top-10 Affected Countries: Evidence from Wavelet Coherence Approach
Previous Article in Journal
You Say Tough, I Say Hope: An Effect of CEO Regulatory Focus on Corporate Social Performance under Challenging Market Conditions
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Research on the Influence of E-Learning Quality on the Intention to Continue E-Learning: Evidence from SEM and fsQCA

Department of Education Information Technology, Faculty of Education, East China Normal University, Shanghai 200062, China
*
Author to whom correspondence should be addressed.
Sustainability 2023, 15(6), 5557; https://doi.org/10.3390/su15065557
Submission received: 19 February 2023 / Revised: 13 March 2023 / Accepted: 17 March 2023 / Published: 22 March 2023

Abstract

:
This study explores how Chinese college students perceive the quality of e-learning and its impact on their adoption of online learning. The study develops an impact model of e-learning quality on continuous learning intention based on the stimulus-organism-response framework, technology acceptance model, and information system success model. The model is validated using a structural equation model (SEM) and fuzzy set qualitative comparative analysis (fsQCA) with data collected from 253 college students at a university in Eastern China. The SEM analysis shows that perceived ease of use and perceived usefulness positively influence e-learning continuance intention, while system quality and personalization have a positive impact on perceived ease of use, and learning community positively impacts perceived usefulness. The fsQCA analysis shows that college students’ willingness to continue e-learning is not solely dependent on a single factor of e-learning service quality but is also influenced by the interaction between various factors. Therefore, e-learning providers should take into account both external stimuli and internal perception factors when designing e-learning services. The findings of this study have practical implications for improving e-learning quality and enhancing the online learning experience. E-learning providers should consider the importance of system quality, personalization, and learning community in improving perceived ease of use and usefulness, which in turn can increase students’ intention to continue e-learning. The study also highlights the importance of considering the interaction between various factors that influence e-learning adoption rather than relying solely on individual factors.

1. Introduction

Over the last two decades, e-learning has become increasingly popular in higher education due to its flexibility, convenience, and cost-effectiveness [1,2,3]. E-learning platforms offer numerous benefits, such as self-paced learning, personalized instruction, and easy access to learning resources [4,5,6,7,8]. However, some students struggle to maintain their engagement and motivation to continue using these platforms, which poses a significant challenge in e-learning adoption and usage [9,10]. The high dropout rate of e-learning in China, for example, is as high as 15–40% [9]. Therefore, it is essential to understand the factors that influence students’ intention to continue using e-learning platforms to enhance their learning experience and improve the quality of higher education.
This study aims to investigate the factors that affect college students’ intention to continue using e-learning platforms. Previous studies have identified various factors that influence e-learning adoption and usage, such as system quality, information quality, service quality, instructor quality, learning community, personalization, perceived ease of use, perceived usefulness, and more e.g., [11,12,13,14,15,16,17,18,19,20,21]. However, the relationship between the configuration path composed of these factors and the intention of college students to continue using e-learning platforms is still unclear.
To address this research gap, this study will examine the impact of these factors on college students’ intention to continue using e-learning platforms. The theoretical framework of the stimulation-organism-response (S-O-R) framework, technology acceptance model, and Delone and Mclean information system success model will guide the research design. By investigating the factors that affect college students’ intention to continue using e-learning platforms, this study aims to provide insights into the design and development of e-learning services to enhance student engagement and motivation in e-learning.
The remainder of this paper is organized as follows: Section 2 reviews the relevant literature. In Section 3, the research model and hypothesis will be presented. Section 4 will describe the data collection process. Section 5 will present the empirical results of the data analysis. Section 6 will be a discussion of the results, followed by the conclusion in Section 7.

2. Literature Review

2.1. E-Learning Quality

Grönroos [22] pointed out that service quality depends on the gap between the service perceived by users and the service expected by users. The research believes that e-learning is a knowledge service relying on information and communications technology. Its quality is defined as the gap between the user’s psychological expectation before accepting e-learning services and the user’s real and actual experience in receiving services.
Previous research on the quality of e-learning has focused on the learner’s subjective perspective to explore the main factors that affect students’ perception of e-learning quality. Some studies suggest that system quality, information quality, and service quality are the key factors that determine the success of e-learning [13,23,24,25,26]. Lee [17] found that students’ perception of online support learning service quality is a significant predictor of online learning acceptance and student satisfaction through surveys of Korean and American students. Chen and Kuo [27] explored adult learners’ perceptions of e-learning service quality in a commercial environment and they classified e-learning service quality into learning interface, learning community, content, and personalization four dimensions. Wu and Lin’s [28] study showed that factors such as “Curriculum development”, “Evaluation”, “Guidance and tracking”, “Instructional design”, and “Teaching materials” can have a significant impact on the quality of e-learning services. Uppal et al. [6] developed an ELQ model to measure college students’ perception of e-learning service quality and found that “Assurance”, “Responsiveness”, “Tangibility”, “Course Website”, and “Learning Content” were positively correlated with students’ perception of online learning service quality. According to a survey of Vietnamese college students, the influencing factors of online learning service quality are mainly composed of e-learning system quality, e-learning instructor and course materials quality, and e-learning administrative and support service quality [20]. Almushasha and Nassuora [29] conducted an empirical study on 189 learners in Jordanian universities and found that the quality of e-learning services focused on five dimensions: interface design, reliability, responsiveness, trust, and personalization.

2.2. S-O-R (Stimulus-Organism-Response) Framework

The S-O-R (stimulus-organism-response) framework, as the fundamental viewpoint of neo-behaviorist psychology, was developed from the classic S-R (stimulus-response) theory. The “stimulus-response” theory was put forward by John Watson. He believed that psychology should be a way to seek and control behavior, and he described individual behavior as a learned response to external stimuli. Mehrabian and Russell [30] proposed the SOR model, which incorporated the concept of the organism (O) between stimulus (S) and response (R), which aimed to better reflect the cognitive and emotional state of behavior before the response. They emphasized the impact of internal mechanisms on human psychology and behavior. According to the S-O-R model, external stimuli will affect the individual’s cognitive and emotional mechanisms and drive them to act accordingly [31].
In recent years, some scholars have introduced the S-O-R theory into e-learning research and confirmed the rationality of analyzing the behavioral intention of online learners based on the S-O-R model. Zhao et al. [32] believed that the technical environment characteristics of the MOOC system, such as interactivity, media richness, and sociability, would impact students’ intention to continue participating in MOOC courses. Bi [33] surveyed senior high school students who purchased online courses at off-campus tutoring agencies and found that the higher the learner’s perception of teacher support, the stronger their social and psychological resilience in school and the more active they were in participating in online collaborations study. Through research, Yang et al. [34] found that perceived closeness, perceived control, and peer referents positively impact the self-efficacy and well-being of students, making learners more actively participate in e-learning. Yang et al.’s [35] research pointed out that the higher the degree of learning engagement of mobile learners, the stronger their intention to continue learning.

2.3. Technology Acceptance Model

The information technology acceptance model (TAM) was proposed by Davis [36] and has been widely used in research on users’ adoption of information technology or information system. Based on the rational behavior theory, the TAM model focuses on explaining the individual’s attitude and intention to use a specific information system and believes that two main factors determine the individual’s intention to use a system: perceived usefulness and perceived ease of use. Perceived usefulness reflects the extent to which individuals think using a specific system will improve job performance and perceived ease of use reflects the degree to which individuals believe it is easy to use a particular system.
Many researchers have studied learners’ e-learning intentions based on the TAM model. Lee et al.’s [15] research suggested that perceived usefulness and playfulness have a stronger relationship with the intention to use e-learning than with perceived ease of use. Based on the information system success model, technology acceptance model, and self-efficacy theory, Li et al. [37] developed a theoretical framework for the behavioral intention of reusable e-learning systems and found that the service quality, course quality, perceived usefulness, perceived ease of use, and self-efficacy of e-learning have a direct impact on users’ behavioral intention to reuse. Chang and Tung [38] found that compatibility, perceived usefulness, perceived ease of use, perceived systems quality, and computer self-efficacy were crucial factors influencing students’ behavioral intentions to use e-learning course websites.

2.4. The Delone and McLean Model of Information Systems Success

In the early stage of information system research, scholars mainly explained the reasons for users’ adoption of information systems from the perspective of technology acceptance. Still, they lacked adequate tools to measure the success of information systems. Delone and McLean [39] created the information system success model (D&M model) based on analyzing and summarizing the literature on information system success in authoritative information system journals from 1981 to 1987. Delone and McLean [40] improved the D&M model based on absorbing and summarizing the relevant research in the past ten years and put forward the second-generation D&M model. Compared with the first-generation D&M model, the updated D&M model introduces the critical factor of service quality and believes that system quality, information quality, and service quality will affect users’ intention to use the system and satisfaction, affecting net benefits.
Lin [13] and Chen [41] introduced the D&M model when studying the success of e-learning systems, which confirmed the feasibility of the D&M model in explaining users’ perception of e-learning quality. Freeze [42] used the D&M model to examine the success of e-learning systems. The study shows that system and information quality significantly positively affect user satisfaction and system usage. Efiloğlu Kurt [43] examined an e-learning system based on student perceptions using the D&M model. He found that system quality significantly impacts both system usage and user satisfaction, while information quality only significantly impacts user satisfaction. Wang et al. [23] and Holsapple and Lee [44] successively adjusted and modified the D&M model based on summarizing the previous research results, which lead to the development of a research model for evaluating e-learning success from the perspective of learners, and pointed out that the quality of e-learning systems, information quality, and service quality are the decisive factors affecting users’ e-learning adoption and satisfaction.

3. Research Model and Hypotheses

3.1. Research Model

Although the TAM model and D&M model have been widely used and verified as the most influential models in the research of information system adoption, they are not designed and developed for the subdivision field of e-learning. Some scholars have built a hybrid model of TAM and D&M to research e-learning user behavior. For example, Mohammadi [45] analyzed the main factors affecting college students’ use of e-learning platforms by establishing the integration model of TAM and D&M. His research showed that e-learning systems and information quality are the key factors determining college students’ intention to continue e-learning. Ngo et al. [46] assessed the impact of e-learning on students’ learning outcomes by integrating the TAM and D&M models. The study found that students perceived learning outcomes were affected by learning assistance, community-building assistance, and perceived motivation.
To sum up, building a hybrid model by integrating TAM and D&M models is an essential direction for the current research on the sustainability of e-learning. This study uses the S-O-R theory as the research framework. It integrates TAM and D&M models, while taking the characteristic factors of e-learning service quality as stimulus variables, in addition to taking perceived usefulness and perceived ease of use as cognitive and emotional responses that affect individuals in order to explore the internal mechanism between e-learning service quality and users’ e-learning sustainability. The research model is shown in Figure 1.
Stimulus variables are various factors that lead to psychological and behavioral changes when learners accept other factors in e-learning services. This study refers to the D&M model and related research on e-learning quality and believes that in the e-learning environment, the external stimulation received by users mainly comes from the related factors of e-learning quality. This paper divides these factors into six dimensions: system quality (SQ), information quality (IQ), service quality (SQ), instructor quality (InQ), learning community (LC), and personalization (PER). Organism variables refer to the cognitive process that learners are stimulated by factors related to e-learning quality, which mainly includes two dimensions: perceived ease of use (PEU) and perceived usefulness (PU).

3.2. Hypotheses

This study hypothesized that online learners can produce higher perceived usefulness and perceived ease of use (O) in e-learning through their perception of e-learning quality (S) and then form their online continuous learning intention (R).
Consequently, this study proposes the following research hypotheses:
Hypothesis 1 (H1).
SQ positively influences the PEU of e-learning.
Hypothesis 2 (H2).
PER positively influences the PEU of e-learning.
Hypothesis 3 (H3).
IQ positively influences the PU of e-learning.
Hypothesis 4 (H4).
SeQ positively influences the PU of e-learning.
Hypothesis 5 (H5).
InQ positively influences the PU of e-learning.
Hypothesis 6 (H6).
LC positively influences the PU of e-learning.
Hypothesis 7 (H7).
PEU positively influences the PU of e-learning.
Hypothesis 8 (H8).
PEU positively influences the CI of e-learning.
Hypothesis 9 (H9).
PU positively influences the CI of e-learning.

4. Data Collection

The questionnaire designed for web-based learning systems was developed with an extensive review of the literature related to the IS Success model, technology acceptance model, and e-learning [12,17,26,27,36,47,48]. The survey questionnaire uses the Likert 5-point scale to assess the degree of uniformity of the respondents to the measurement items (1 means significantly disagree, 5 means very agree). The study distributed electronic questionnaires to 289 undergraduate and graduate students in a university in Eastern China, and 253 valid questionnaires were recovered. The demographic characteristics of the respondents are shown in Table 1.
The study tested the reliability and validity of the scale data, and the results are shown in Table 2 and Table 3. According to the test results, Cronbach’s alpha coefficient for each factor is higher than 0.8, which means the scale has good reliability. The AVE values of each factor are higher than 0.5, and the CR values are higher than 0.7, which means that the scale has good convergent validity. Meanwhile, the AVE square root values of each factor were higher than the correlation coefficients of the factor with other factors, which indicated that the scale had good discriminant validity.

5. Empirical Results

5.1. Structural Model Analysis

The goodness-of-fit analysis of the measurement model using AMOS 24.0 software (as shown in Table 4) revealed that the values of the fit indicators were within the appropriate criteria, indicating that the model’s fit in this study was good. The results showed that the hypotheses were supported, except for H3, H4, and H5, which did not satisfy the significance criteria, as shown in Figure 2. First, system quality (β = 0.188, p < 0.05) and personalization (β = 0.691, p < 0.001) had a significant positive effect on perceived usefulness, which supported H1 and H2; second, the learning community (β = 0.251, p < 0.05) had a significant positive impact on perceived usefulness, which supported H6; third, perceived ease of use (β = 0.370, p < 0.001) had a significant positive effect on perceived usefulness, which supported H7; finally, perceived ease of use (β = 0.127, p < 0.05) and perceived usefulness (β = 0.778, p < 0.001) had a significant positive effect on the intention to continue learning online, and H8 and H9 were supported.

5.2. Fuzzy-Set Qualitative Comparative Analysis

Before carrying out the qualitative comparative analysis of fuzzy sets, it is necessary to calibrate the questionnaire data and convert Likert scores into fuzzy membership scores. For the calibration of scale data, the calibration process is generally performed using the direct calibration method. Some studies used 5 (full membership), 3 (crossover point), and 1 (full non-membership) as anchors to calibrate the Likert 5-point scale to conform to the original meaning of the questionnaire as much as possible [49,50]. However, when self-report questionnaires involve personal behaviors, emotions, and subjective intentions, respondents tend to be more inclined to engage in positive self-reporting due to social desirability, which often leads to the skewed distribution of questionnaire data [51]. Thus, this study uses the 95% quantile of each condition as the threshold of full membership, the 5% quantile as the threshold of full non-membership, and the 50% quantile as the crossover point [52]. Following Fiss [53], this study adds 0.001 to the column condition with a fuzzy membership score of 0.5 to ensure that no cases are deleted when calculating the fuzzy set.
Although conditional configuration analysis is the core of fsQCA, it is necessary to check whether the conditions meet the criteria of the necessary conditions before this. “Necessary condition” means that the condition must exist in the condition configuration that causes the result to occur. The relationship between the result set and the subset of conditions can be evaluated by analyzing the necessity of the condition. The research uses fsQCA software to analyze the necessity of a single condition variable and obtained two critical indicators of the consistency and coverage of each condition, as shown in Table 5. It is generally considered that the criterion for determining the necessary condition is that the consistency of the condition reaches more than 0.9 [54]. Thus, we can see that personalization (consistency ≈ 0.9) is a necessary condition leading to a high level of continuous e-learning intention.
When analyzing the conditional configuration paths that lead to a high level of continuous e-learning intention, considering that the sample is greater than 200, the minimum case frequency threshold is set to 3. Moreover, the raw consistency threshold is set to 0.8 and the PRI consistency threshold is set to 0.75, the truth table is constructed, and the standard analysis is performed in order to output the complex, intermediate, and parsimonious solutions. This study follows the previous fsQCA research convention of considering conditions that appear in both parsimonious and intermediate solutions as core conditions and conditions that appear only in intermediate solutions as peripheral conditions. The output of the two condition configurations is shown in Table 6.
The sufficiency analysis results show that the consistency of each configuration presented in the table is higher than 0.9, the consistency of the overall solution is 0.969, and the coverage of the overall solution is 0.623, which indicates that the research results have strong explanatory power. The common core conditions of solution 1 and solution 2 are information quality, learning community, personalization, perceived ease of use, and perceived usefulness. In S1 (SQ*IQ*SeQ*LC*PER*PEU*PU), the presence of system quality and service quality are peripheral conditions. In S2 (IQ*SeQ*InQ*LC*PER*PEU*PU), the presence of service quality and instructor quality are peripheral conditions. Comparing the two conditional configurations, the system quality in S1 and the instructor quality in S2 have an alternative relationship.

6. Discussion

The results indicate that both external stimuli factors and internal perception factors influence the continuous use intention of e-learning platforms among college students. External stimuli factors include system quality, information quality, service quality, instructor quality, learning community, and personalization. Meanwhile, internal perception factors refer to perceived ease of use and perceived usefulness. This finding represents an expansion of prior studies that have explored the various factors that can impact a student’s willingness to adopt and utilize e-learning platforms e.g., [15,16,17,21,26,55,56]. By understanding these factors, e-learning service providers may create more engaging and effective learning experiences that ultimately improve student learning outcomes.
Furthermore, the study confirms that perceived ease of use and perceived usefulness positively impact the intention to continue using e-learning platforms, and that perceived ease of use also positively influences perceived usefulness [15,21,45,57,58]. Thus, e-learning service providers should strive to create intuitive and user-friendly platforms that offer seamless and engaging learning experiences for students. The results also highlight that system quality and personalization positively impact perceived ease of use. Therefore, e-learning service providers should design platforms that align with college students’ user interface preferences, offer clear navigation functions, ensure stable and smooth operation, and have strong interaction and management features [44,59,60]. Additionally, they should offer personalized learning options and support that enable students to select their own learning content and customize their learning pace and progress [27,29,61].
Moreover, this study found that the learning community dimension positively impacts the perceived usefulness of e-learning. This finding aligns with previous studies that have shown the positive impact of learning communities on students’ motivation and engagement in online learning [2,5]. To improve the learning community dimension, e-learning service providers should enhance the functions of e-learning discussion, sharing, and answering subject questions [46]. They should also expand the communication channels of e-learning communities through social software tools and encourage members to share their e-learning experiences and exchange knowledge [62].
Finally, the fuzzy set qualitative comparative analysis showed that the current generation of college students’ intention to continue e-learning is not solely due to their perception of a single e-learning service quality factor but also due to the interaction between various factors. This finding highlights the importance of considering multiple factors when developing e-learning services. It suggests that e-learning providers should not only focus on external stimuli factors such as system quality, information quality, service quality, instructor quality, learning community, and personalization but also on internal perception factors such as perceived ease of use and perceived usefulness. By considering both external and internal factors, e-learning providers can create a more comprehensive and effective e-learning service that meets the needs and expectations of their users.
In conclusion, this study provides insights into the factors that influence the continuous use intention of e-learning platforms among college students. The findings suggest that e-learning service providers should consider external stimuli factors and internal perception factors when designing and developing e-learning services. Additionally, they should provide personalized learning options and support for students, improve the functions of e-learning discussion, and expand the communication channels of e-learning communities. These findings have significant implications for the development and implementation of e-learning platforms in higher education.

7. Conclusions

This paper adopted the stimulus-organism-response perspective of new behaviorism psychology and integrated the technology acceptance model and DeLone and McLean information systems success model to explore the decisive factors of college students’ willingness to adopt e-learning continuously. This paper emphasized the importance of e-learning quality in continuous learning intention, which not only expanded the application field of the model but also referenced the significance of the adoption of information systems in other fields, such as e-commerce and e-government. Furthermore, the study used hybrid methods to investigate the complex role of various antecedents, enriching the theoretical results of online learning adoption research. The structural equation model is used to analyze the influencing factors and action paths of the e-learning platform’s continuous use intention, while the fsQCA method identifies the antecedent condition configuration that triggers high continuous e-learning platform use intention. This study found that system quality and personalization had a significant positive impact on perceived ease of use, that the learning community had a significant positive effect on perceived usefulness, and that perceived ease of use and perceived usefulness had a positive effect on the intention to continue using the e-learning platform. The results of the fsQCA analysis showed that both S1 (SQ*IQ*SeQ*LC*PER*PEU*PU) and S2 (IQ*SeQ*InQ*LC*PER*PEU*PU) condition configurations can achieve the high continuous use intention of e-learning platform users.

7.1. Implications for Practitioners

The findings of this study have several practical implications for e-learning service providers. First, they should focus on developing platforms that are user-friendly and easy to navigate, with clear and concise content, robust and reliable system operations, and personalized learning options. Second, they should create a strong sense of community among learners by promoting active participation and collaboration, offering opportunities for feedback and communication, and providing forums for sharing knowledge and experiences. Third, e-learning providers should consider both external and internal factors in developing their services, taking into account students’ preferences, needs, and expectations.

7.2. Limitations and Future Work

This study’s limited focus on college students as the research objects may not fully represent the diverse needs and experiences of different user groups, such as adult learners, K-12 students, and professional learners. Additionally, this study’s lack of multi-level coverage of colleges and universities across the country may limit the generalizability of the findings to different educational contexts. Therefore, future research should aim to include a diverse range of user groups, such as K-12 students, adult learners, and professional learners, to ensure that the findings are representative and applicable to various educational contexts. Moreover, educational contexts vary significantly, and their unique features may affect how students perceive and use e-learning platforms. Thus, future studies should aim to include a range of educational institutions, such as community colleges, four-year colleges and universities, and research institutions, to gain a more comprehensive understanding of the factors that impact the continuous use intention of e-learning platforms across different educational contexts. By doing so, researchers can better identify the unique needs and challenges of various educational settings and develop more effective strategies to support continuous e-learning platform use.

Author Contributions

Conceptualization, H.Z.; methodology, H.Z.; software, H.Z. and Y.Q.; validation, Z.W. and Y.W.; formal analysis, H.Z. and Y.Q.; investigation, H.Z. and Y.Q.; resources, Y.W.; data curation, Y.W. and H.Z.; writing—original draft preparation, H.Z.; writing—review and editing, Y.W. and Z.W.; supervision, Y.W.; project administration, Y.W.; funding acquisition, Y.W. All authors have read and agreed to the published version of the manuscript.

Funding

This research was supported by the National Social Science Foundation of China (grant number 21&ZD238) and the Humanity and Social Science Foundation of the Ministry of Education of China (grant number 20YJA880057).

Institutional Review Board Statement

Ethical review and approval for this study was waived due to the fact that the research solely involved the collection of anonymous data through online questionnaires, with no potential for harm or risk to participants. As a result, the institutional review board deemed it unnecessary to review the study. The recruitment process adhered to the principles of voluntary and informed consent, and the participants’ privacy and rights were protected to the fullest extent possible. Additionally, there was no conflict of interest between the research content and the results obtained. All data collected will be presented in an aggregate form only and will remain completely anonymous, with no identifiable personal information being disclosed.

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The data that support the findings of this study are available on request from the corresponding author. The data are not publicly available due to privacy or ethical restrictions.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Beqiri, M.S.; Chase, N.M.; Bishka, A. Online Course Delivery: An Empirical Investigation of Factors Affecting Student Satisfaction. J. Educ. Bus. 2009, 85, 95–100. [Google Scholar] [CrossRef]
  2. Wu, B. Identifying the influential factors of knowledge sharing in e-learning 2.0 systems. Int. J. Enterp. Inf. Syst. 2016, 12, 85–102. [Google Scholar] [CrossRef] [Green Version]
  3. Mishra, L.; Gupta, T.; Shree, A. Online teaching-learning in higher education during lockdown period of COVID-19 pandemic. Int. J. Educ. Res. Open 2020, 1, 100012. [Google Scholar] [CrossRef] [PubMed]
  4. Capper, J. E-learning growth and promise for the developing world. TechKnowLogia 2001, 2, 7–10. [Google Scholar]
  5. Bouhnik, D.; Marcus, T. Interaction in distance-learning courses. J. Am. Soc. Inf. Sci. Technol. 2006, 57, 299–305. [Google Scholar] [CrossRef]
  6. Uppal, M.A.; Ali, S.; Gulliver, S.R. Factors determining e-learning service quality. Br. J. Educ. Technol. 2018, 49, 412–426. [Google Scholar] [CrossRef]
  7. Pham, L.; Williamson, S.; Berry, R. Student perceptions of e-learning service quality, e-satisfaction, and e-loyalty. Int. J. Enterp. Inf. Syst. 2018, 14, 19–40. [Google Scholar] [CrossRef]
  8. Wang, Y.; Liu, X.; Zhang, Z. An overview of e-learning in China: History, challenges and opportunities. Res. Comp. Int. Educ. 2018, 13, 195–210. [Google Scholar] [CrossRef] [Green Version]
  9. Tan, M.; Shao, P. Prediction of student dropout in e-Learning program through the use of machine learning method. Int. J. Emerg. Technol. Learn. 2015, 10, 11–17. [Google Scholar] [CrossRef]
  10. Zhou, Y.; Zhao, J.; Zhang, J. Prediction of learners’ dropout in E-learning based on the unusual behaviors. Interact. Learn. Environ. 2020, 28, 1–25. [Google Scholar] [CrossRef]
  11. Roca, J.C.; Chiu, C.-M.; Martínez, F.J. Understanding e-learning continuance intention: An extension of the Technology Acceptance Model. Int. J. Hum.-Comput. Stud. 2006, 64, 683–696. [Google Scholar] [CrossRef] [Green Version]
  12. Chiu, C.-M.; Chang, H.-C. Examining the integrated influence of fairness and quality on learners’ satisfaction and Web-based learning continuance intention. Inf. Syst. J. 2007, 17, 271–287. [Google Scholar] [CrossRef]
  13. Lin, H.-F. Measuring Online Learning Systems Success: Applying the Updated DeLone and McLean Model. CyberPsychology Behav. 2007, 10, 817–820. [Google Scholar] [CrossRef]
  14. Wang, W.-T.; Wang, C.-C. An empirical study of instructor adoption of web-based learning systems. Comput. Educ. 2009, 53, 761–774. [Google Scholar] [CrossRef]
  15. Lee, B.-C.; Yoon, J.-O.; Lee, I. Learners’ acceptance of e-learning in South Korea: Theories and results. Comput. Educ. 2009, 53, 1320–1329. [Google Scholar] [CrossRef]
  16. Alenezi, A.R.; Abdul Karim, A.M.; Veloo, A. An empirical investigation into the role of enjoyment, computer anxiety, computer self-efficacy and internet experience in influencing the students’ intention to use e-learning: A case study from Saudi Arabian governmental universities. Turk. Online J. Educ. Technol. TOJET 2010, 9, 22–34. [Google Scholar]
  17. Lee, J.W. Online support service quality, online learning acceptance, and student satisfaction. Internet High. Educ. 2010, 13, 277–283. [Google Scholar] [CrossRef]
  18. Motaghian, H.; Hassanzadeh, A.; Moghadam, D.K. Factors affecting university instructors’ adoption of web-based learning systems: Case study of Iran. Comput. Educ. 2013, 61, 158–167. [Google Scholar] [CrossRef]
  19. Calisir, F.; Altin Gumussoy, C.; Bayraktaroglu, A.E.; Karaali, D. Predicting the intention to use a web-based learning system: Perceived content quality, anxiety, perceived system quality, image, and the technology acceptance model. Hum. Factors Ergon. Manuf. Serv. Ind. 2014, 24, 515–531. [Google Scholar] [CrossRef]
  20. Pham, L.; Limbu, Y.B.; Bui, T.K.; Nguyen, H.T.; Pham, H.T. Does e-learning service quality influence e-learning student satisfaction and loyalty? Evidence from Vietnam. Int. J. Educ. Technol. High. Educ. 2019, 16, 7. [Google Scholar] [CrossRef] [Green Version]
  21. Mailizar, M.; Burg, D.; Maulina, S. Examining university students’ behavioural intention to use e-learning during the COVID-19 pandemic: An extended TAM model. Educ. Inf. Technol. 2021, 26, 7057–7077. [Google Scholar] [CrossRef]
  22. Grönroos, C. A Service Quality Model and its Marketing Implications. Eur. J. Mark. 1984, 18, 36–44. [Google Scholar] [CrossRef]
  23. Wang, Y.-S.; Wang, H.-Y.; Shee, D.Y. Measuring e-learning systems success in an organizational context: Scale development and validation. Comput. Hum. Behav. 2007, 23, 1792–1808. [Google Scholar] [CrossRef]
  24. Lee-Post, A. e-Learning Success Model: An Information Systems Perspective. Electron. J. e-Learn. 2009, 7, 61–70. [Google Scholar] [CrossRef]
  25. Yengin, I.; Karahoca, A.; Karahoca, D. E-learning success model for instructors’ satisfactions in perspective of interaction and usability outcomes. Procedia Comput. Sci. 2011, 3, 1396–1403. [Google Scholar] [CrossRef] [Green Version]
  26. Yang, M.; Shao, Z.; Liu, Q.; Liu, C. Understanding the quality factors that influence the continuance intention of students toward participation in MOOCs. Educ. Technol. Res. Dev. 2017, 65, 1195–1214. [Google Scholar] [CrossRef]
  27. Chen, L.-H.; Kuo, Y.-F. Understanding e-learning service quality of a commercial bank by using Kano’s model. Total. Qual. Manag. Bus. Excel. 2011, 22, 99–116. [Google Scholar] [CrossRef]
  28. Wu, H.-Y.; Lin, H.-Y. A hybrid approach to develop an analytical model for enhancing the service quality of e-learning. Comput. Educ. 2012, 58, 1318–1338. [Google Scholar] [CrossRef]
  29. Almushasha, N.F.; Nassuora, A.B. Factors determining e-learning service quality in jordanian higher education environment. J. Appl. Sci. 2012, 12, 1474–1480. [Google Scholar] [CrossRef] [Green Version]
  30. Mehrabian, A.; Russell, J.A. An Approach to Environmental Psychology; The MIT Press: Cambridge, MA, USA, 1974. [Google Scholar]
  31. Zhang, K.Z.; Benyoucef, M. Consumer behavior in social commerce: A literature review. Decis. Support Syst. 2016, 86, 95–108. [Google Scholar] [CrossRef]
  32. Zhao, Y.; Wang, A.; Sun, Y. Technological environment, virtual experience, and MOOC continuance: A stimulus–organism–response perspective. Comput. Educ. 2019, 144, 103721. [Google Scholar] [CrossRef]
  33. Bi, L. The Impacts of Perceived Teacher Support on the Cooperative Learning Engagement for the K12 Internet Edu-cation in China: The Mediation Effect of Study Motivation. Doctoral Dissertation, Tunku Abdul Rahman University College, Kuala Lumpur, Malaysia, 2021. [Google Scholar] [CrossRef]
  34. Yang, J.; Peng, M.Y.-P.; Wong, S.; Chong, W. How E-Learning Environmental Stimuli Influence Determinates of Learning Engagement in the Context of COVID-19? SOR Model Perspective. Front. Psychol. 2021, 12, 584976. [Google Scholar] [CrossRef]
  35. Yang, S.; Zhou, S.; Cheng, X. Why do college students continue to use mobile learning? Learning involvement and self-determination theory. Br. J. Educ. Technol. 2019, 50, 626–637. [Google Scholar] [CrossRef]
  36. Davis, F.D. Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology. MIS Q. 1989, 13, 319–340. [Google Scholar] [CrossRef] [Green Version]
  37. Li, Y.; Duan, Y.; Fu, Z.; Alford, P. An empirical study on behavioural intention to reuse e-learning systems in rural China. Br. J. Educ. Technol. 2012, 43, 933–948. [Google Scholar] [CrossRef] [Green Version]
  38. Chang, S.-C.; Tung, F.-C. An empirical investigation of students’ behavioural intentions to use the online learning course websites. Br. J. Educ. Technol. 2008, 39, 71–83. [Google Scholar] [CrossRef]
  39. DeLone, W.H.; McLean, E.R. Information Systems Success: The Quest for the Dependent Variable. Inf. Syst. Res. 1992, 3, 60–95. [Google Scholar] [CrossRef] [Green Version]
  40. Delone, W.H.; McLean, E.R. The DeLone and McLean Model of Information Systems Success: A Ten-Year Update. J. Manag. Inf. Syst. 2003, 19, 9–30. [Google Scholar] [CrossRef]
  41. Chen, H.-J. Linking employees’ e-learning system use to their overall job outcomes: An empirical study based on the IS success model. Comput. Educ. 2010, 55, 1628–1639. [Google Scholar] [CrossRef]
  42. Freeze, R.D.; Alshare, K.A.; Lane, P.L.; Wen, H.J. IS Success Model in E-Learning Context Based on Students’ Perceptions. J. Inf. Syst. Educ. 2010, 21, 173–184. Available online: https://www.learntechlib.org/p/108516/ (accessed on 15 October 2022).
  43. Efiloğlu Kurt, Ö. Examining an e-learning system through the lens of the information systems success model: Empirical evidence from Italy. Educ. Inf. Technol. 2018, 24, 1173–1184. [Google Scholar] [CrossRef]
  44. Holsapple, C.W.; Lee-Post, A. Defining, Assessing, and Promoting E-Learning Success: An Information Systems Perspective*. Decis. Sci. J. Innov. Educ. 2006, 4, 67–85. [Google Scholar] [CrossRef]
  45. Mohammadi, H. Investigating users’ perspectives on e-learning: An integration of TAM and IS success model. Comput. Hum. Behav. 2015, 45, 359–374. [Google Scholar] [CrossRef]
  46. Ngo, M.T.; Thach, K.S.R.; Nguyen, N.T. Effects of using E-learning system on learning outcomes of students in Can Tho University. Can Tho Univ. J. Sci. 2020, 12, 27–37. [Google Scholar] [CrossRef]
  47. La Rotta, D.; Usuga, O.C.; Clavijo, V. Perceived service quality factors in online higher education. Learn. Envi-Ronments Res. 2020, 23, 251–267. [Google Scholar] [CrossRef]
  48. Pham, L.; Kim, K.; Walker, B.; DeNardin, T.; Le, H. Development and Validation of an Instrument to Measure Student Perceived E-Learning Service Quality. Int. J. Enterp. Inf. Syst. 2019, 15, 15–42. [Google Scholar] [CrossRef]
  49. Poorkavoos, M.; Duan, Y.; Edwards, J.S.; Ramanathan, R. Identifying the configurational paths to innovation in SMEs: A fuzzy-set qualitative comparative analysis. J. Bus. Res. 2016, 69, 5843–5854. [Google Scholar] [CrossRef] [Green Version]
  50. Afonso, C.; Silva, G.M.; Gonçalves, H.M.; Duarte, M. The role of motivations and involvement in wine tourists’ intention to return: SEM and fsQCA findings. J. Bus. Res. 2018, 89, 313–321. [Google Scholar] [CrossRef]
  51. Braun, H.I.; Jackson, D.N.; Wiley, D.E. Socially desirable responding: The evolution of a construct. In The Role of Constructs in Psychological and Educational Measurement; Routledge: New York, NY, USA, 2001; pp. 61–84. [Google Scholar]
  52. Ragin, C.C. Redesigning Social Inquiry: Fuzzy Sets and beyond; University of Chicago Press: Chicago, IL, USA, 2009. [Google Scholar]
  53. Fiss, P.C. Building Better Causal Theories: A Fuzzy Set Approach to Typologies in Organization Research. Acad. Manag. J. 2011, 54, 393–420. [Google Scholar] [CrossRef] [Green Version]
  54. Ragin, C.C. Fuzzy-Set Social Science; University of Chicago Press: Chicago, IL, USA, 2000. [Google Scholar]
  55. Chiu, C.M.; Hsu, M.H.; Sun, S.Y.; Lin, T.C.; Sun, P.C. Usability, quality, value and e-learning continuance decisions. Comput. Educ. 2005, 45, 399–416. [Google Scholar] [CrossRef]
  56. Al-Fraihat, D.; Joy, M.; Masa’Deh, R.; Sinclair, J. Evaluating E-learning systems success: An empirical study. Comput. Hum. Behav. 2020, 102, 67–86. [Google Scholar] [CrossRef]
  57. Liaw, S.S.; Huang, H.M. Perceived satisfaction, perceived usefulness and interactive learning environments as predictors to self-regulation in e-learning environments. Comput. Educ. 2013, 60, 14–24. [Google Scholar] [CrossRef]
  58. Humida, T.; Al Mamun, H.; Keikhosrokiani, P. Predicting behavioral intention to use e-learning system: A case-study in Begum Rokeya University, Rangpur, Bangladesh. Educ. Inf. Technol. 2022, 27, 2241–2265. [Google Scholar] [CrossRef] [PubMed]
  59. Do, T.X.; Tran, H.T.L.; Le, T.T. Factors influencing the E-learning system usage during the COVID-19 pandemic in Vietnam. PLoS ONE 2022, 17, e0278109. [Google Scholar] [CrossRef] [PubMed]
  60. Martinez-Arguelles, M.J.; Callejo, M.B.; Farrero JM, C. Dimensions of perceived service quality in higher education virtual learning environments. Rev. U. Soc. Conoc. 2013, 10, 268. [Google Scholar]
  61. Baradaran, V.; Ghorbani, E. Development of Fuzzy Exploratory Factor Analysis for Designing an E-Learning Service Quality Assessment Model. Int. J. Fuzzy Syst. 2020, 22, 1772–1785. [Google Scholar] [CrossRef]
  62. Bernsteiner, R.; Ostermann, H.; Staudinger, R. Facilitating e-learning with social software: Attitudes and usage from the student’s point of view. Int. J. Web-Based Learn. Teach. Technol. (IJWLTT) 2008, 3, 16–33. [Google Scholar] [CrossRef] [Green Version]
Figure 1. Research model.
Figure 1. Research model.
Sustainability 15 05557 g001
Figure 2. Results of hypothesis testing. Note: ** p < 0.05, *** p < 0.001.
Figure 2. Results of hypothesis testing. Note: ** p < 0.05, *** p < 0.001.
Sustainability 15 05557 g002
Table 1. Profile of survey respondents (n = 253).
Table 1. Profile of survey respondents (n = 253).
MeasureItemsFrequencyPercentage
GenderMale5320.9
Female20079.1
EducationUndergraduate students18673.5
Master students6726.5
Hours of e-learning per weekLess than 0.5 h3815.0
0.5–1 h7128.1
1–3 h9035.6
3–5 h2911.5
5 h or more259.9
Table 2. Summary of measurement scales.
Table 2. Summary of measurement scales.
ConstructMeasureFactor LoadingReference Study
System quality AVE = 0.675 CR = 0.861 Alpha = 0.857
SQ1The user interface of the e-learning platform is well designed.0.766Chiu et al., 2007 [12]
SQ2The e-learning platform can quickly load all the text and graphics.0.865
SQ3The e-learning platform functions well all the time.0.830
Information quality AVE = 0.670 CR = 0.890 Alpha = 0.886
IQ1The content of the course materials provided by the e-learning platform is timely.0.776Chiu et al., 2007 [12]; Chen and Kuo, 2011 [27]
IQ2The e-learning platform provides content that exactly fits your needs.0.869
IQ3The e-learning platform provides sufficient content.0.816
IQ4The content of the course materials provided by the e-learning platform is easy to comprehend.0.810
Service quality AVE = 0.687 CR = 0.898 Alpha = 0.896
SeQ1The e-learning platform provides prompt responses to my request.0.875Yang et al., 2017 [26]
SeQ2The e-learning platform provides the right solution to my request.0.829
SeQ3The service provided in the e-learning platform attends to an individual’s personalized needs.0.785
SeQ4The service provided in the e-learning platform is reliable.0.823
Instructor quality AVE = 0.653 CR = 0.904 Alpha = 0.902
InQ1Instructors care about student learning.0.853La Rotta et al., 2020 [47]; Pham et al., 2019 [48]
InQ2Instructors manage to develop student interest in the subject.0.819
InQ3Instructors transmit their knowledge clearly.0.694
InQ4Instructors respond promptly to questions that students may have outside of class.0.829
InQ5Instructors provide an environment that encourages interactive participation.0.837
Learning community AVE = 0.742 CR = 0.920 Alpha = 0.918
LC1The e-learning platform makes it easy for you to discuss questions with other users.0.831Chen and Kuo, 2011 [27]
LC2The e-learning platform makes it easy for you to access the shared content from the learning community.0.885
LC3The e-learning platform makes it easy for you to discuss questions with experts.0.823
LC4The e-learning platform makes it easy for you to share what you learn with the learning community.0.903
Personalization AVE = 0.764 CR = 0.906 Alpha = 0906
PER1The e-learning platform enables you to choose what you want to learn.0.889Chen and Kuo, 2011 [27]
PER2The e-learning platform enables you to control your learning progress.0.868
PER3The e-learning platform records your learning progress and performance.0.864
Perceived ease of use AVE = 0.717 CR = 0.910 Alpha = 0.904
PEU1It is easy for me to skillfully use the e-learning platform.0.892Davis, 1989 [36]
PEU2Operating the e-learning platform does not need to consume too much brain power.0.838
PEU3Learning to operate the online system would be easy for me.0.906
PEU4I can quickly find the necessary learning resources on the e-learning platform.0.740
Perceived usefulness AVE = 0.749 CR = 0.922 Alpha = 0.922
PU1Using an e-learning platform would improve my academic performance.0.826Lee, 2010 [17]
PU2Using an e-learning platform enhances my effectiveness in accomplishing academic tasks.0.863
PU3Using an e-learning platform has enhanced my interest in accomplishing academic tasks.0.879
PU4I find e-learning platforms useful in my study completion.0.892
Continuance intention AVE = 0.695 CR = 0.919 Alpha = 0.918
CI1In the future, I have plans to insist on learning an online course.0.833Yang et al., 2017 [26]
CI2In the future, I plan to finish learning multiple online courses.0.857
CI3I would like to spend more time on e-learning in the future.0.850
CI4I am willing to use e-learning as a way to improve myself.0.832
CI5If I have difficulties in learning, I am still willing to turn to e-learning.0.793
Table 3. Discriminant validity analysis.
Table 3. Discriminant validity analysis.
SQIQSeQInQLCPERPEUPUCI
SQ0.821
IQ0.6120.819
SeQ0.530.7220.829
InQ0.4510.6490.7030.808
LC0.4350.6230.6270.7250.861
PER0.4440.6920.5410.5030.6030.874
PEU0.4730.610.5510.4580.5210.7150.847
PU0.4170.550.5260.5380.5810.5750.610.865
CI0.4210.5190.5030.4620.5320.5610.590.7880.834
Table 4. Results of measurement model fit statistics.
Table 4. Results of measurement model fit statistics.
Fit Indexχ²/dfRMSEARMRCFINFINNFITLIIFI
Recommended value<3<0.10<0.05>0.9>0.9>0.9>0.9>0.9
Observed Value2.1590.0680.0360.9170.8570.9080.9080.918
Table 5. Results of necessity analysis.
Table 5. Results of necessity analysis.
VariableHigh CILow CI
ConsistencyCoverageConsistencyCoverage
SQ0.7940.7720.5550.728
~SQ0.7200.5460.8260.843
IQ0.8280.7870.5490.704
~IQ0.6890.5310.8350.867
SeQ0.8510.7070.6010.671
~SeQ0.6040.5290.7370.870
InQ0.8090.7230.5530.666
~InQ0.6270.5100.7700.844
LC0.8570.7370.5830.675
~LC0.6220.5260.7720.879
PER0.8980.7440.6090.679
~PER0.6130.5380.7700.911
PEU0.8450.7960.5300.672
~PEU0.6520.5070.8380.879
PU0.8750.8020.5160.638
~PU0.6050.4810.8400.900
Note: ~ indicates the absence of the condition.
Table 6. Results of sufficiency analysis.
Table 6. Results of sufficiency analysis.
Solution (High CI)
ConfigurationS1S2
SQ
IQ
SeQ
InQ
LC
PER
PEU
PU
Raw coverage0.5880.598
Unique coverage0.0240.034
Consistency0.9750.969
Overall solution coverage0.623
Overall solution consistency0.969
Note: Black circles (●) indicate the presence of the peripheral condition, large black circles (⬤) indicate the presence of the core condition, and blank indicates that the presence or absence of the condition is insignificant.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Zheng, H.; Qian, Y.; Wang, Z.; Wu, Y. Research on the Influence of E-Learning Quality on the Intention to Continue E-Learning: Evidence from SEM and fsQCA. Sustainability 2023, 15, 5557. https://doi.org/10.3390/su15065557

AMA Style

Zheng H, Qian Y, Wang Z, Wu Y. Research on the Influence of E-Learning Quality on the Intention to Continue E-Learning: Evidence from SEM and fsQCA. Sustainability. 2023; 15(6):5557. https://doi.org/10.3390/su15065557

Chicago/Turabian Style

Zheng, Hao, Yu Qian, Zongran Wang, and Yonghe Wu. 2023. "Research on the Influence of E-Learning Quality on the Intention to Continue E-Learning: Evidence from SEM and fsQCA" Sustainability 15, no. 6: 5557. https://doi.org/10.3390/su15065557

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop