Next Article in Journal
Service Discovery Method Based on Knowledge Graph and Word2vec
Next Article in Special Issue
User-Generated Multimedia Content Impact on the Destination Choice: Five Dimensions of Consumer Experience
Previous Article in Journal
Electromagnetic Simulation Flow for Integrated Power Electronics Modules
Previous Article in Special Issue
Assessing the Effects of the COVID-19 Pandemic on M-Commerce Adoption: An Adapted UTAUT2 Approach
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

A Hybrid SEM-Neural Network Modeling of Quality of M-Commerce Services under the Impact of the COVID-19 Pandemic

Department of Statistics and Economic Informatics, University of Craiova, A.I. Cuza 13, 200585 Craiova, Romania
*
Author to whom correspondence should be addressed.
Electronics 2022, 11(16), 2499; https://doi.org/10.3390/electronics11162499
Submission received: 28 July 2022 / Revised: 9 August 2022 / Accepted: 9 August 2022 / Published: 10 August 2022
(This article belongs to the Special Issue Impact of COVID-19 on Multimedia Transformation)

Abstract

:
The research purpose is to contribute to the understanding of the COVID-19 pandemic impact on the intensification of commercial transactions on the mobile channel (m-commerce) and to identify the most significant factors that act on consumer behavior based on the development of a conceptual model to establish the influence of m-commerce service quality on customer satisfaction and loyalty. The data were collected through a survey addressed to customers who, during 2021–2022, made at least one purchase through m-commerce. The analysis was performed with SPSS Statistics and Amos software, using a hybrid approach: Structural Equation Modeling (SEM) and Artificial Neural Network (ANN). The research results confirm the hypotheses presented in this study. Both models identified the quality of services offered by m-commerce, satisfaction, and trust as determining factors for increasing consumer loyalty in virtual commerce. The novelty of this study consists of an interconnected analysis model of some variables specific to mobile commerce, which have not been used in this combination in the specialized literature. This research can be the basis of other research studies. In addition, it provides valuable results for the business environment (forecasts) and customers by obtaining improved, personalized, and secure commerce services.

1. Introduction

The COVID-19 pandemic has changed the world, dramatically affecting the activity of companies and consumers [1] and causing profound changes in how buyers interact with sellers [2]. Physical distancing has forced companies to adapt their way of relating to customers by redefining business processes [3]. Regardless of the degree of development of the countries’ economies, online shopping has become essential [4]. Consumers have been forced to change their purchasing behavior from physical stores to digital platforms in the short or perhaps long term [2,5,6]. The consumer can be considered a person or a group that intends to order or use goods, products, or services purchased primarily for personal, social, family, household, and similar needs, which are not directly related to entrepreneurial or business activities [6]. Thus, e-commerce has seen a new impetus, becoming a highly used channel that has increased its popularity [7,8] and companies will have to manage it properly and integrate it with a variety of other online and offline channels in the future [9], and, at the same time, identify the limits of e-commerce in the context of consumer protection [10].
From the beginning of the 21st century until 2020, e-commerce has developed steadily; the economic crises of 2000 and 2008 affected the e-economy domain the least, and after two–three years, the situation returned to pre-crisis conditions [11]. Once the pace of EC development stabilized, and the device used has become the distinguishing criterion: traditional e-commerce is associated with the use of a laptop or desktop, and m-commerce with the use of mobile devices. In the digital economy, e-commerce has become an essential tool, stimulating the competitiveness and innovation of companies in terms of how they promote their products and services while producing a transformation in people’s behavior and creating a new consumer profile [12].
Electronic commerce through digital technologies ensures the direct connection of business partners, increasing the attractiveness of the business environment but also new opportunities for consumers [13]. E-commerce represents a fundamental condition for business development and establishing optimal relationships with customers [14]. E-commerce can be defined as the economic activity of buying and selling products and services through online platforms [15].
Mobile commerce (m-commerce) refers to the use of portable wireless devices to conduct online transactions (buying and selling goods and services) [16,17].
In the context of the COVID-19 crisis, existing business models had to, in addition to maintaining traditional methods, change their strategy by turning to e-commerce platforms. Both quarantine and social isolation were key mental states that led more people to shop online, with online sales up 47% year-on-year [8].
One of the main aspects that supported the exponential growth of online product purchases was the need to ensure individual safety against coronavirus [18].
Isolation and social distancing have reduced people’s mobility in retail which has led to a shrinking of the market for non-essential products that are durable and ‘put-away’ [19]. Thus, the online consumption of goods and services increased while offline consumption decreased during the COVID-19 pandemic [20]. If, before the pandemic, online purchases were predominantly focused on electronic products and services and fashion products, during the pandemic they concentrated on health-related products, products necessary for working from home, and food products [21].
The most sought-after products were medicine, toiletries, disposable gloves, food and drink (e.g., canned goods), household appliances, toys, puzzles, picture books, exercise equipment, high-tech equipment, and articles of clothing [8,22]. At the same time, during the pandemic, and especially during the lockdown, there was a general increase in the online trade of food products [23,24], often due to the lack of alternatives, but is expected that the growth trend for the e-food sector will also be preserved in the post-COVID-19 period [25].
The main factors that influence consumer loyalty for e-commerce are the trust in the food products offered, the perceived value, and the attitude of the sellers towards their needs [26]. The pandemic has brought drastic changes to consumers’ planned and unplanned buying habits [2], changed the traditional schemas used by consumers to evaluate offers and make a choice, and affected the traditional way in which consumers relate to retailers [27].
The studies carried out on customer satisfaction regarding the use of e-commerce during the pandemic show that they are satisfied and will continue to look for this type of commerce in the future and the long term, which will produce a major change in technological, social, and economic transformation [28]. Even after COVID-19, significant changes in daily life and shopping behavior will remain, which amplifies the need for research on consumer behavior to understand what factors influence the use of e-commerce [29,30].
Although at the level of all states, in the last decades there have been continuous increases in electronic commerce (e-commerce) and especially in mobile commerce (m-commerce), which amplified during the COVID-19 pandemic. This fact has caused companies to become aware of the potential of this commercial channel [21]. In 2021, Romania recorded electronic sales worth EUR 14 billion, which represents almost half of the total achieved in Eastern Europe [31].
Consumers have become aware of the conveniences offered by using e-commerce in general [32] and mobile commerce in particular [21]. The benefits of m-commerce (availability, purchasing facilities in terms of time and space) give consumers a more user-friendly experience than e-commerce. Thus, customers began to orientate more and more towards this channel, and most e-commerce platforms adapted their content to be easier to use on mobile devices [14].
Although several studies have attempted to identify the determinants [33] that make consumers turn to m-commerce [34], there are also several uncertainties regarding the motivation of consumers to continue using m-commerce [35,36] and its development follows different trajectories depending on the country [37]. In this sense, m-commerce has a major influence on how companies interact with consumers, which makes the study of the quality of mobile shopping services extremely important. Therefore, the first objective of this study is to identify the significant factors that can lead to an increase in the quality of m-commerce services offered to consumers in Romania, thus influencing them to use the online purchase again.
After researching the specialized literature, I found that several studies analyze various models regarding the adoption of m-commerce [5,7,38]. At the same time, recent research focuses on the analysis of the impact of service quality on the future use of m-commerce and consumer loyalty in various countries or regions [35,39,40,41,42,43]. To ensure customer loyalty, m-commerce providers need to know the main factors that influence consumer satisfaction. Thus, another objective of this study is to build a conceptual model to identify the impact of the quality of electronic services on the behavior of m-commerce consumers in the example of Romanian consumers.
For the research, I used a hybrid approach, Structural Equation Modeling (SEM) and Artificial Neural Network (ANN), using SEM to test hypotheses regarding customer satisfaction with respect to the quality of m-commerce services and neural network analysis to identify the classification of significant determinants established in SEM, depending on their influence.
The results show that both models have identified that m-commerce service quality, satisfaction, and trust are the most important factors for increasing consumer loyalty in m-commerce. A significant result of the study is that by ANN, one can identify the degree to which the model’s factors compete to increase the quality of m-commerce services and companies can take timely action to improve them.
In addition to identifying the factors that influence consumers’ use of m-commerce, this paper contributes significantly to existing research on m-commerce adoption by developing a conceptual model on the impact of service quality on m-commerce consumer behavior. The conclusions of this study are significant for the business environment because companies can better understand and forecast consumer behavior, being able to organize their operations and marketing campaigns in such a way as to address the main identified factors, “satisfaction” and “trust”, for increasing customer loyalty. At the same time, this study can bring advantages to customers through the possibility of offering improved, personalized, and high-security m-commerce services and can be the basis of other research studies.
Compared to the studies in the specialized literature, this work offers original contributions through the conceptual model created to examine the impact of the COVID-19 epidemic on the increase in the quality of m-commerce services and also through the use of neural networks to determine the most significant factors that compete for the increase in customer loyalty.
The research was structured in five sections. Section 2 discusses the theoretical background and identifies the hypothesis on which the research model developed. Section 3 describes the sample and presents the research methodology used. Section 4 presents the results and their interpretations. The final section highlights the conclusions, explores the main theoretical and managerial implications of the research, and highlights the study’s main limitations and some possible future research directions.

2. Theoretical Background and Hypotheses Development

As a result of the COVID-19 pandemic, digital interactions with customers (sales, customer service, etc.) [43,44] have grown at a rapid pace, changing the outlook for e-commerce development, with the number of e-commerce buyers exceeding 3.4 billion [45]. According to statistics, by 2040, almost 95% of all purchases will be made through electronic commerce [46]. As for Romania, e-commerce activity reached the threshold of EUR 5.6 billion at the end of 2020, 30% more than in 2019, and at the end of 2021, it reached the threshold of EUR 6.2 billion, almost 10% more than in 2020 [47].
Given the widespread appeal of mobile devices and the constant development of wireless networks, m-commerce is rapidly growing in popularity and becoming essential in the daily life [48]. The mobile commerce channel (m-commerce) represents the future of online markets [49]. Through easy accessibility to customers, m-commerce applications extend the time available for searching [50].
The COVID-19 pandemic has changed the behavior towards virtual commerce [51,52], with customers increasingly migrating to m-commerce due to a multitude of factors [53,54]. Thus, for companies’ m-commerce channel transaction strategies to be successfully leveraged, they need to understand how to target customers’ perceptions of m-commerce and identify the factors that affect its use [55]. Customers’ shopping and payment preferences have changed [56]. They choose to buy while considering various factors: brand reputation, product quality, diversity, service quality, security, ease of use, and price competitiveness [27].

2.1. M-Commerce Apps

With the outbreak of the COVID-19 crisis, the purchasing behavior of consumers has changed and tend to rely more frequently on mobile applications [5,7,39]. It has led companies to prioritize their e-commerce transition to mobile platforms and adapt their websites for mobile commerce channel [57,58].
The creation of m-commerce websites has simplified the shopping experience [59] but also enhanced it by allowing consumers to browse multiple stores, obtain product information, and have the availability of purchasing from anywhere and at any time [60]. It is essential to ensure the quality of commercial applications from the user perspective (content, search, and navigation) to increase their credibility [61,62].
However, several problems may arise regarding the acceptance, adoption, and diffusion of m-commerce [63]. In this sense, the creation of successful m-commerce websites must start from the basic requirements for commercial smartphone applications [64] and provide benefits to users [65] while also considering their continuous improvement (increasing internet speed, expanding 5G and Wi-Fi networks, and increase accessibility and trust in mobile devices and applications) [66].
Customers rate the user experience of a website to assess the overall quality of an online store’s services. Users must perceive ease of use [67] and simple access [68].
The quality of e-services can be measured by website design, customer support services, security/privacy, and fulfillment [69]. At the same time, the quality of services offered by the website can be characterized by six elements: appearance, content, organization, interaction, focus on the client, and insurance [8].
For m-commerce applications, the content of the displayed information must attract users’ attention and be accessible from various devices [70,71]. Good organization of mobile applications can lead to increased quality and performance levels and provides users with easy and hassle-free access to application content [72].
The attractive appearance of an m-commerce application is one of the most important ways to attract new customers in the future [8,41,67]. Website design refers to all elements of the customer experience related to the website, including information quality, website aesthetics, purchase process, website convenience, product selection, price offers, website customization web, and system availability. Customers quantify m-commerce application design through aesthetic preferences [73] and information updates [8,67]. In this context, website design influences the perceived ease of use and influences customers’ attitudes and behavioral intentions, positively affecting the quality of electronic services [40]. At the same time, using the mobile commerce channel implies the need to adapt e-commerce applications for compatibility with mobile devices to fit their smaller screens [74].
Consumers tend to perceive visual appeal first. Such a perception can induce positive attitudes, making them effectively search, browse, and evaluate the products they want and need [41].
Usage behavior and customer satisfaction in m-commerce applications depend on customer trust in m-banking services [75,76,77]. Several types of research have been dedicated to identifying the factors that influence users to adopt and use m-banking [78,79,80,81] and their impact on customer satisfaction [79].
Appropriately designed commerce applications will help users find what they are looking for and successfully make transactions through mobile phones [70].
Studies indicate that perceived usefulness and ease of use, information and service quality, user interface, perceived risk, and security all have direct consequences on user attitude, satisfaction, and loyalty [58].
Based on the specialized literature that analyzed the factors that make the use of the Web a compelling experience for its users, we formulated the following hypothesis:
Hypothesis 1 (H1).
Mobile site design and content (DC) has a positive and significant effect on m-commerce service quality (MQ).

2.2. Customer Support for the M-Commerce

Several studies consider portability to be the greatest advantage of virtual commerce, as it allows consumers to access product information at anytime and anywhere, and to contact human or intelligent agents at any time, so that they can be properly informed [30,74]. With the mobile device, users can browse the products and can receive useful tips, contact details, information related to returns, and guarantees [30]. Customers are supported throughout the purchasing process (search, choice, purchase, and after-sales service) by the interactivity that suppliers offer them (active control, personalization, ubiquitous connectivity, connection, responsiveness, and synchronicity) [82]. Mobile devices have turned into personal assistants, helping customers access new information and instantly purchase digital content and various products and services [83]. As consumer attitudes in the online space are constantly changing, digital content is visited more carefully [84], and customers become more interactive in communication, seeking information to their questions at a certain time and place exactly as they wish, and spend much less time on transactions. Consumers have changed their passive role to an active one, which forces e-service providers to be proactive [85].
Based on these findings, the following hypotheses are formulated:
Hypothesis 2 (H2).
Customer support (CP) has a positive and significant effect on m-commerce service quality (MQ).

2.3. Security and Privacy in M-Commerce

Customer trust in m-commerce is determined by ensuring the security of purchases (implementation of procedures to ensure the transfer of information and the security of credit card payments) and the protection of confidentiality (confidentiality of shared information, i.e., not to use the buyer’s data for any purpose other than the one agreed with the buyer) [69,86].
Customers are always concerned about whether the website where they want to transact will protect them against fraud, so security has an important influence on the quality of m-commerce services [40]. Studies show that companies that carry out m-commerce activity are also very concerned about ensuring confidentiality when customers are not ready to disclose private data [68,87]. Thus, several factors have been identified that can influence the decisions of potential consumers to make their data available [73,87,88].
Considering the significant effect of security and privacy in the context of m-commerce, the following hypothesis is proposed:
Hypothesis 3 (H3).
Security/Privacy (SP) has a positive and significant effect on m-commerce service quality (MQ).

2.4. Fulfillment of the M-Commerce

Several analyses of consumer behavior during the COVID-19 pandemic [52,89] indicate that many changes have occurred. M-commerce applications have offered customers great convenience and comfort in purchasing products during the COVID-19 pandemic, and the correctness of product delivery (meeting the deadline, information on the order delivery status, correct sending and arrival at the destination in good condition of the products ordered) increase customers’ confidence in these services [21]. Ease of transaction and customer trust influences their behavioral intention to use mobile commerce [90,91,92,93]. Thus, customers’ perceptions of the benefits offered by virtual commerce, the post-purchase experience, and how the benefits are perceived compared to other channels positively influence customer attitudes in opting for m-commerce [36,94].
Since the delivery of e-services is critical to successful the consumer adoption of e-commerce, the following hypothesis is suggested:
Hypothesis 4 (H4).
Fulfilment (FF) has a positive and significant effect on m-commerce service quality (MQ).

2.5. M-Commerce Service Quality and Customer Satisfaction

Many researchers have studied the concept of e-service quality association with customer satisfaction and repurchase intentions. In the digital age, especially during the pandemic and post-pandemic period, it is essential for companies that want to take advantage of the great opportunities of virtual commerce to provide excellent customer service. At the same time, customer behavior significantly influences the quality of electronic services [40]. It is noted that social influence is a powerful tool for transforming customers’ attitudes [41].
Some research has explored the influence of mobile service quality on customer satisfaction and loyalty [8], finding a significant impact of m-commerce service quality on customer satisfaction that, in turn, has a positive impact on loyalty [43].
Consumers have various reasons (trust, social influence, mobility, involvement) for adopting a positive behavior towards m-commerce [85,95]. Thus, the specialized literature has paid particular attention to the examination of factors affecting customer satisfaction in mobile commerce [66,90,96]. Consumer satisfaction is essential to the business process because a satisfied online customer will buy again and recommend it to others [97]. Thus, one of the challenges faced by companies is how to improve online shopper satisfaction [98]. Online customer experience becomes a differentiator for securing a sustainable competitive advantage [99].
Various aspects of customer satisfaction elements (trust, social influence, perceived usefulness and enjoyment, mobility, ease of use, innovation, and engagement) have been analyzed [100]. By carrying out a thorough investigation of the quality of mobile services, the specialized literature confirmed the existence of a significant positive relationship between the quality of electronic services and customer satisfaction [40,69,101].
Thus, the following hypothesis is offered to investigate the effect of service quality on customer satisfaction in online shopping:
Hypothesis 5 (H5).
M-commerce service quality (MQ) has a positive and significant effect on Customer satisfaction (CS).

2.6. Customer Trust and Loyalty

The customer’s trust in m-commerce is given by the interest that the online store gives him through the quality of the services offered (how it is treated, compliance with standards, the opinions of other customers), having consequences on the attitude and behavioral intention [40,58].
In addition to changing consumer behavior and perception toward virtual commerce [77], the effects of the COVID-19 pandemic have strengthened consumer confidence in e-commerce through the quality of services obtained [27,53], leading to increased consumer satisfaction in virtual commerce [35]. At the same time, offering guarantees to customers significantly increases their level of the trust in m-commerce applications [29,102,103].
Several studies have identified that consumer trust significantly influences the customer’s behavioral intention to use mobile commerce [7,27,40,58,91,98,104,105], due to the quality of services offered [43,102,105,106].
Starting from the studied literature, the following hypothesis is issued:
Hypothesis 6 (H6).
M-commerce service quality (MQ) has a positive and significant effect on Customer trust (CT).
For online retailers, a major challenge is increasing customer loyalty [107], considering their satisfaction as a determining factor [40,43,99,108]. To ensure customer loyalty, suppliers must determine the main factors that influence consumer satisfaction in m-commerce [107].
Repurchase intention indicates the customer’s willingness to make another purchase from the same m-commerce application based on the quality of their previous experiences. Some studies have investigated the determinants of repurchase intention and satisfaction in the m-commerce experience [41]. Customer satisfaction increases loyalty to a brand or mobile shopping and prevents them from switching to competitors [101]. Thus, if customers are satisfied with the service provided, they will increase future intentions to use and purchase from the same supplier, so satisfaction influences the intention to repurchase [40,99].
Based on these findings, the following hypothesis is issued:
Hypothesis 7 (H7).
Customer satisfaction (CS) has a positive and significant effect on Customer loyalty (CL).
The literature has shown a continuous interest in research of the factors that influence customer loyalty [82,107]. A success factor to survive in a highly competitive electronic environment is for companies to provide customers with quality service [102] so that they trust and come back to be loyal to the company. When consumers have positive experiences with m-commerce applications, they are very likely to use them again in the future [41,93]. Thus, some studies have identified positive relationships between trust and loyalty [40,102,108]. Customer loyalty leads to an increased customer’s number without advertising expenses because loyal customers recommend the supplier to others [109].
Considering the significant effect of trust on consumer loyalty, the following hypothesis is proposed:
Hypothesis 8 (H8).
Customer trust (CT) has a positive and significant effect on Customer loyalty (CL).
Customer satisfaction depends on service quality [66,90,102]. At the same time, it has a positive impact on customer loyalty [41,93], making it a mediating variable between service quality and customer loyalty. Since a positive association was found between e-service quality and customer trust [40,69,101] on the one hand, and between customer trust and loyalty on the other [40,102,108], trust mediates the relationship between service quality and loyalty.
According to these findings, the hypothesis is issued:
Hypothesis 9 (H9).
Customer satisfaction (CS) and Customer trust (CT) mediates the relationship between m-commerce service quality (MQ) and Customer loyalty (CL) and at the same time m-commerce service quality (MQ) mediates the relationship between Mobile site design and content (DC), Customer support (CP), Security/Privacy (SP), Fulfillment (FF), and Customer loyalty (CL).

2.7. Conceptual Model Development

In accordance with the reviewed literature [40,43,69,101] and with the formulated hypotheses, we propose a conceptual model with eight builders: (1) Mobile site design and content (DC); (2) Customer support (CP); (3) Security/Privacy (SP); (4) Fulfillment (FF); (5) M-commerce service quality (MQ); (6) Customer satisfaction (CS); (7) Customer trust (CT); and (8) Customer loyalty (CL). The constructs, the number of items for each construct, and their corresponding coding are presented in Table 1. The model variables are divided into four latent exogenous (independent) and four latent endogenous (dependent) variables.
The links between the latent variables within the model are presented in Figure 1.

3. Methodology

3.1. Data Collection and Sample Characteristics

The research analyzes the extent to which the quality of m-commerce services influences consumer behavior. Thus, an empirical survey-based investigation was performed using a 15-question questionnaire. The questionnaire was intended for Romanian m-commerce consumers who are especially active on this trading channel.
At the beginning of 2022, there were 27.41 million cellular mobile connections in Romania, equivalent to 143.7% of the total population. This is because consumers may have more than one mobile connection (a connection for personal use, one for work), so the number of mobile connections significantly exceeds the population. It is worth noting that the number of mobile connections in Romania increased by one million between 2021 and 2022 (+3.9%) [110].
The survey was conducted in 2021 (third and fourth wave of the COVID-19 pandemic) and early 2022 (fifth wave of the COVID-19 pandemic). The sample to whom the survey addressed included only those users who made at least one commercial transaction via mobile phone during 2021–2022, given that in 2021 the majority of the Internet users in Romania used m-commerce applications [111]. Following a study by Zitech regarding the online shopping intention of Romanians in 2022, about 52% of the respondents estimate that they will make as many online purchases as in 2021, and 30% propose to make more online purchases [112].
The questionnaire included two parts. The first part consisted of seven questions regarding the respondents’ characteristics (sex, age, education, monthly income, employability, experience in m-commerce, and several transactions in m-commerce) (Table 2). The second part includes eight specific questions identified following the review of specialized literature. Based on the second category of questions, the measurement elements specific to the items and latent variables related to the proposed structural model were constituted (Table 1).
Responses were collected using a Likert scale that provides response categories on a scale from 1 to 5, where the response options were between “not at all = 1”, “very little = 2”, “average = 3”, “a lot = 4” and “very much = 5” [113].
Out of the 1000 questionnaires distributed to the respondents, 738 questionnaires were collected, of which 560 were valid, and the remaining 178 were incomplete or filled in incorrectly, resulting in a response rate of 56%. The margin of error corresponding to a 95% probability of guaranteeing the research results is +/−3.077%, which proves that the sample is representative (margin of error < 5%) [114].
An analysis of the respondents’ profiles indicates that in the sample there are more women (58.4%) compared to men (41.6%). In terms of age, the sample had the following structure: Generation Z: 18–25 (24.7%), Generation Y: 26–40 (43.4%), Generation X: 41–56 (20.8%), and over 56 years (11.1 %). For education level, respondents with a high school diploma represented 15.5% of the entire sample, followed by those with a university degree (77.9%) and remaining 6.6% of respondents had more than a bachelor’s degree. Due to the fact that in Romania there is no official socio-demographic data on the profile of the digital commerce consumer, the structure of the sample is similar to the official government statistics on e-commerce and mobile phone users [47]; thus, it can conclude that the sample represents the analyzed population.

3.2. SEM–ANN Data Analysis

This study employs a multi-analytical methodology by integrating Structural Equation Modeling (SEM) with the most powerful artificial intelligence technique, Artificial Neural Network (ANN) [35,38,66]. SEM is an advantageous data analysis method because it simultaneously evaluates measurement and structural models and may oversimplify the complexities of user opinion towards m-commerce platforms’ use. To overcome this limitation, we also approached the use of neural networks. The predicting performance of ANN is more powerful than statistical models, such as structural equation modeling and multiple linear regression [115].
To achieve the research objectives, the analysis of the collected data was carried out in two phases, combining structural equation modeling (SEM) with artificial neural network (ANN) analysis by using IBM SPSS Statistics and Amos v.26.0 software [116].
The first phase primarily consisted of processing the collected data in order to verify the correctness of the information provided by the respondents and to eliminate errors, ensuring the interactive validation of the data provided and implicitly of the questionnaire. Then, the reliability of each latent construct in the research model was tested. Secondly, the confirmative factor analysis was used to determine the fit and validity of the proposed model. Thirdly, the research hypotheses were tested using structural equation modeling (SEM) and the proposed structural model was validated.
In the second phase, by performing the neural network analysis, the intensity of the hypothetical relationships previously determined and confirmed by SEM was verified.

3.2.1. Structural Equation Modeling

As digital service quality measurement indicators and their influencing factors have abstract and multidimensional characteristics, they are difficult to measure directly. Thus, for the analysis of this complex system, the testing of research hypotheses and the relationships between variables are using SEM [38,55,66]. The proposed structural model consists of four independent variables and four dependent variables (Figure 1). All latent constructs were measured by means of several items based on the review of relevant studies (Table 1).
Using SEM, we are primarily concerned with whether the model produces an estimated population covariance matrix that is consistent with the sampled (observed) covariance matrix. Then, we proceed to the fitting of the model (through the statistics of the chi-square test and goodness-of-fit indices), the reliability of the indicators, the estimation of the parameters for each path in the model (the importance of each path in predicting the measure of the respective result is distinguished, i.e., an independent variable affects a specific dependent variable), and mediating or testing indirect effects (the independent variable affects the dependent variable through a mediating variable) [117].
x = Λ x ξ + δ
y = Λ y η + ε
The Equations (1) and (2) stipulate the relationship between the result latent variable η and the result observable variable y, and the relationship between the cause latent variable ξ and the cause observable variable x. Λ x is the relationship between the cause observable variable and the cause latent variable, and is the factor loading matrix of the cause observable variable on the cause latent variable. Λ y is the relationship between the result observable variable and the result latent variable, and is the factor loading matrix of the result observable variable on the result latent variable. δ is the error of the cause observable variable x; ε is the error of the result observable variable y. The structural model equation is set as follows:
η = β η + Γ ξ + ζ ,
where β is the coefficient matrix of the result latent variable η, and also the path coefficient matrix between the result latent variables; Γ is the coefficient matrix of the cause latent variable ξ , and also the path coefficient matrix of the cause latent variable to the corresponding endogenous latent variable; ζ is the residual term of the structural equation, which is the part failed to explain within the model.

3.2.2. ANN

ANN is applied to examine the complement and verify the SEM analysis and measure the effectiveness of independent factors on the dependent factor. From the category of artificial intelligence techniques, ANN is widely used, due to its efficiency in modeling complex relationships between inputs and outputs. ANN has higher prediction accuracy compared to SEM and does not require the formulation of hypotheses to be tested [35,38,66,118].
The type of neural network used was the multilayer perceptron model (MLP) because it is very flexible to be applied to the respective indicators analyzed in the paper and to learn the mapping from inputs to outputs and is compatible with regressions identified as the most appropriate for the data used. The MLP neural network model has an architecture of three main layers: an input, output, or hidden layer. For each neural network built, the activation functions justify: (1) for the hidden layer, the capacity and performance of the neural network; (2) for the output layer, the validity of the chosen regression model. The synaptic weight establishes for each neural network the amplitude of the connection between the nodes and the meaning of the relationship (direct or indirect) between the nodes. Using the additional parameter bias helps the built neural network architecture to best fit the analyzed data [119].

4. Empirical Findings and Discussion

4.1. Reliability and Validity Analysis

Before the actual analysis of the model, the degree of significance of the variables of the structural conceptual model is checked, namely, the reliability, validity, and internal consistency of the collected data are analyzed (Table 3).
First of all, the reliability of the internal consistency of the questionnaire was verified. For this, it was estimated the internal consistency of the items that were used to measure the latent variables by calculating Cronbach’s Alpha, composite reliability, and Dillon Golstein’s rho. In all of the cases, CA and CR values are greater than the threshold of 0.7 and AVE exceeded the critical value of 0.5, which means that the reliability criteria was met; that is, the exogenous variables in the model are statistically significant [120,121,122]. Very high reliability was obtained for most of the variables ((CA > 0.9: DC (0.922) and SP (0.919), or great (0.9 < CA > 0.8: CP (0.886); FF (0.866); MQ (0.826); and CS (0.824)).
Table 3 shows that there are no multicollinearity problems between exogenous variables in the model, because the values of the variation inflation factor (VIF) do not exceed the value of 5 [123].
In the next stage, the validity of the proposed model was tested and the fit was determined using confirmative factor analysis. Validity measures whether the variables in the model can really be expressed by the appropriate measurement elements.
Kaiser–Meyer–Olkin (KMO) Test and Bartlett’s Test of Sphericity are used for validity analysis. The validity of the model is higher as the measurement results are more consistent with the content to be measured. KMO Test is used to compare the relative size of the Pearson correlation coefficient and that of the original variables. The KMO value is between 0 and 1.
The correlation between the variables is stronger and more suitable for factor analysis as the value is closer to 1 [124]. Bartlett’s sphericity test is used to test whether the correlation matrix is an identity matrix, that is, whether each variable is independent, indicating that the data are not suitable for factor analysis. However, the lower the level of significance, the higher the likelihood of a significant relationship between the original variables. The test results of this study are shown in Table 4.
In Table 4, the KMO value is 0.803, indicating that the factor analysis effect is good. The value of Bartlett’s test of sphericity is 160.790. When the degree of freedom is 68, p < 0.05, reaching the significance level. Therefore, this study is suitable for factor analysis.
The Average Variance Extracted (AVE) indicator is used to test the discriminant validity of the model. Thus, the square root of the AVE in each construct is compared with its inter-construct correlation for all latent variables in the model and is observed to be higher, thus confirming the discriminant validity of the proposed model (Table 5) [125].

4.2. Model Fitting

The fitting effect of structural equation model indicates whether the interaction between variables exists. By testing the fitting effect of the model, the model is continuously optimized until the model with the best fitting effect is found. The used goodness-of-fit indices of structural equation model are: Ratio of chi-square to degree of freedom ( χ 2 df ); Goodness-of-Fit Index (GFI); Standardized root mean square residual (SRMR); Root Mean Square Error of Approximation (RMSEA); Normed Fit Index (NFI); Incremental Fit Index (IFI); and Comparative Fit Index (CFI).
After testing the model, it is found that it is necessary to exclude the factor “The mobile site contains all of the content as that on the regular site” (DC4) with the value of 0.417, because it does not meet the ideal standard of 0.5 [126].
The Modification Indices (MI) option in AMOS 26.0 software is used to find the path with the maximum MI value and add the path, that is, the initial model is modified once; then is running the AMOS 26.0 software to obtain the goodness-of-fit index value of the modified model to verify the fitting effect of the modified model.
The above steps are repeated until the value of the goodness-of-fit index of the modified model approaches or meets the requirements of the standard value.
According to the above method, the initial model is modified several times, and finally the optimal structural equation model is obtained, as shown in Figure 2.
The values of the goodness-of-fit indices of the modified structural equation model are shown in Table 6.
The most of the fit indices of the modified model have been improved. The fit degree of the model is relatively good and basically passes the test of goodness-of-fit. In other words, the correlation between variables in the modified structural equation model shown in Figure 2 does exist.

4.3. Analysis of Direct and Mediation Effects

The path coefficient and hypothesis testing results of the theoretical model are shown in Table 7.
According to the data in Table 7, the p values of the expected hypotheses H1-H8 are all less than 0.05, indicating that these hypotheses are supported by data.
Thus, we will analyze the direct effects between MQ and its predictors (DC, CP, SP, and FF), MQ and its successors CS and CT; CL and its predictors CS and CT.
From the analysis of the direct results, it is observed that DC has a positive and significant impact on the MQ (β = 0.269; p < 0.05). This result indicates that an improvement of m-commerce applications (content, design, security, ease of use), lead to an increase in the quality of services offered by these solutions. It is found that the impact of CP on MQ (β = 0.166; p < 0.05) is positive and statistically significant, which supports the positive role of customer support on the quality of m-commerce services.
At the same time, we observe a positive and statistically significant coefficient between SP and MQ (β = 0.365; p < 0.05), which suggests that security and information protection have a very important role in terms of the quality of services offered by m-commerce.
Similarly, it is found that FF has a significant and positive impact on MQ (β = 0.476; p < 0.05), which demonstrates the importance of optimizing the transaction process on the quality of the services offered by m-commerce.
Considering that MQ has a significant and direct impact on CS (β = 0.942; p < 0.05), we can say that the quality of m-commerce services is a decisive factor in customer satisfaction. Similarly, it turns out that MQ has a significant and positive impact on CT as well (β = 0.871; p < 0.05), which highlights the role that the quality of m-commerce services has in increasing customer trust. We observe that the impact of CS on CL (β = 0.651; p < 0.05) is positive and statistically significant, which supports the role that customer satisfaction has on their loyalty. From the analysis of the direct results, it follows that CT has a positive and significant impact on CL (β = 0.283; p < 0.05). This result indicates that customer trust influences their loyalty.
In addition to the analyzed direct relationships, in the proposed model, we identified and analyzed the mediating effect of MQ on the relationship between DC, CP, SP, FF and CS, CT, CL and the mediating effect of CS and CT, respectively, on the relationship between MQ and CL. Table 8 shows all the specific standardized effects (direct according to Table 7, indirect and total) and it is noted that the p-values of the structural relationships are all less than 0.05.
From the analysis of the results in Table 8, the following can be observed:
  • MQ has a mediating effect on CS through the four exogenous latent variables: DC (β = 0.254; p < 0.05), CP (β = 0.156; p < 0.05), SP (β = 0.344; p < 0.05), and FF (β = 0.448; p < 0.05);
  • MQ has a mediating effect on CT through the four exogenous latent variables DC (β = 0.234; p < 0.05), CP (β = 0.144; p < 0.05), SP (β = 0.318; p < 0.05), and FF (β = 0.414; p < 0.05);
  • MQ has a mediating effect on CL through the four exogenous latent variables DC (β = 0.231; p < 0.05), CP (β = 0.142; p < 0.05), SP (β = 0.313; p < 0.05), and FF (β = 0.409; p < 0.05), which generates an indirect positive impact on CS, CT, and CL;
  • CS and CT, respectively, mediate the effect between MQ and CL (β = 0.859; p < 0.05).

4.4. Artificial Neural Network Analyses

As discussed in the methodology section, Artificial Neural Network analysis is used in the second phase of the analysis. Significant hypothesized predictors are utilized as inputs to ANN to emphasize the relevant importance of each predictor’s variable. ANN produces more precise predictions compared to the SEM approaches [132].
For this study, the independent variables (DC, CP, SP, FF, MQ, CS, and CT) were the input layers (input neurons) of the ANN model. This means the number of input neurons (input layers) equal seven, which is the number of predictors. In construct, the output layer in the ANN model was the dependent variable, which is CL, as shown in Figure 3. This means the number of output neurons (output layers) equals one. Following recommendations given by [133], the hidden neurons (nodes) are automatically generated and activation function (Sigmoid Function) is utilized for both hidden and output layers. Furthermore, based on the recommendations from the above authors, the prediction accuracy of the trained network is measured using ten-fold cross-validation. To avoid overfitting, problem data is divided into two parts, from which 80% for training and 20% for testing.
The prediction accuracy of the ANN model was computed by the root mean square error (RMSE) for both the training (80%) and testing (20%) data sets (ten runs). The RMSE is calculated using Equation (4) [134], where SSE is the sum of squared error, and n is number of items.
RMSE = 1 n   ×   SSE
As shown in Table 9, the RMSE values for the training data set and the testing data set represent an accurate ANN model in taking the relationships between predictors and the output. According to [135] lower RMSE values represent higher predictive accuracy and better data fit.
The relative importance of each input predictor was computed in terms of normalized relative importance ranking (expressed as %) using sensitivity analysis as presented in Table 10 and Figure 4.
The results in Table 10 and Figure 4 show that all seven independent variables are important to all 10 neural networks. Based on the normalized variable importance, customer satisfaction is the most significant predictor of customer loyalty followed by customer trust, while customer support has a weaker influence followed by mobile site design and content.

5. Conclusions

The COVID-19 epidemic has changed where and how people buy goods and has accelerated structural changes in consumer preferences, which have affected consumption channels, how retailers interact with each other (business-to-business relationships), and how firms work with their direct suppliers, wholesalers, and distributors. The pandemic has disrupted the value chain and changed consumption patterns. With the appearance of the first cases of COVID-19 worldwide, the demand for processed/canned foods and pharmaceuticals increased substantially. In an environment where habits and practices have changed so quickly and are likely to continue to change, sales leaders need a clear view of what customers want and what steps their company can take to meet their needs. Traditional commerce (physical presence in the store without the need for the Internet) will remain essential in the future, but it will be possible to combine it through mobile applications with a mobile phone by scanning QR codes on product labels. The COVID-19 pandemic came to the aid of consumers by implementing various digital innovations at the level of companies but also at the level of communities to increase the quality of life and achieve sustainable development [136,137].

5.1. Theoretical Implications

The COVID-19 pandemic has affected the lives of consumers and their shopping patterns, so more and more people are choosing to do their shopping through m-commerce applications. This research was designed to investigate the impact of the quality of electronic services on the behavior of Romanian consumers under the conditions of the COVID-19 pandemic. The first objective of this study was to identify, for the period of the COVID-19 pandemic, the significant factors that can lead to an increase in the quality of electronic services offered to Romanian m-commerce customers to ensure loyalty and continuity of transactions on the mobile sales channel. Then, based on the specialized literature, we identified the most significant predictors of the quality of services offered to m-commerce consumers and developed a conceptual model for evaluating the impact of the quality of electronic services on the behavior of m-commerce consumers.
The research is based on the analysis of data collected following the empirical investigation carried out in 2021–2022, which included three waves of the COVID-19 pandemic, on a sample of 560 people. To carry out the research, we used a hybrid SEM–ANN approach, which is consistent with other studies [35,38,66,118]. After previously checking that the variables of the proposed structural model are reliable and valid, we created the most suitable model.
The results of hypothesis testing show consistency and convergence in assessing the extent to which the eight identified factors reinforce and contribute to a clearer understanding of the connections within the proposed model. The empirical results demonstrated that the impact of Mobile site design and content, Customer support, Security/Privacy, and Fulfillment on M-commerce service quality is positive and statistically significant, which supports the importance of implementing efficient, attractive, and secure m-commerce solutions in the conditions of vulnerability generated by the pandemic. These results demonstrate the validity of hypotheses H1–H4 and are supported by the findings of other studies [40,41,42,52,59,67,70,71,72,76,80].
At the same time, the results identify the significant role of m-commerce service quality, especially in the COVID-19 crisis, on consumer satisfaction and trust, demonstrating the validity of Hypotheses 5 and 6, being consistent with the results of other specialized studies [27,40,42,43,53,69,101,102,105,106].
The findings indicate that consumer satisfaction and trust have a significant impact on building their loyalty, which validates Hypotheses 7 and 8 and confirms the results of other studies [40,41,93,99,101]. Based on these findings, we can say that if customers are satisfied and trust the service offered, they will return to make new purchases.
Based on the analysis of direct and indirect effects, it is found that the most significant effect on loyalty is exerted by service quality (indirect effect), followed by satisfaction and trust (direct effects). The analysis of mediation effects confirms that in the optimized model (through indirect effects), m-commerce service quality, mobile site design and content, customer support, security/privacy, and fulfillment have a positive and significant impact on loyalty.
The results from both SEM and ANN show that satisfaction and trust are the most important factors for increasing consumer loyalty in virtual commerce, which is consistent with the findings of other researchers [35,38,66].
From the customers’ point of view, mobile applications used for business transactions provide them with a convenient way to search, order, locate, or transact through their smartphones anywhere and at any time.
This research contributes to the enrichment of specialized literature through the originality of the structural model that allowed the examination of the quality dimensions of m-commerce services and their impact on customer satisfaction and loyalty in the context of the COVID-19 pandemic. The research findings are robust and support the stability of the proposed conceptual model.
An important study result is identifying the degree to which the factors of the structural model compete to increase the quality of electronic services and thus companies can act punctually on their improvement. At the same time, the research results emphasize the need to increase the quality of services offered by m-commerce applications and ensure adequate security and privacy to increase customer trust in these applications and implicitly the satisfaction that leads to customer loyalty for a particular online store.

5.2. Practical Implications

In addition to theoretical implications, our study also reveals some practical implications. The study results provide a clear picture for companies that adopt this sales channel. Thus, to create and increase loyalty in m-commerce applications, it is necessary to provide quality services that ensure a high degree of security and confidentiality. The COVID-19 pandemic has led to a further increase in the popularity of mobile commerce, which challenges companies to constantly adapt to the needs of consumers, highlighting that businesses need fast and efficient ways to serve and communicate with their customers. The online market is complex, very dynamic, and competitive. In this sense, m-commerce offers new opportunities for companies, where they can increase the competitive advantages of the business. The findings of this study can provide managers with insight to better understand the factors that influence e-service quality and the importance of each to ensuring customer satisfaction and trust, which can lead to gaining customer loyalty. Thus, they can improve their online store service quality and make future strategies by combining with market trends.
Following the results of the research, companies that carry out transactions on the m-commerce channel can consider that to attract and maintain their customers, they must continuously develop the functionality of the application, have an attractive, easy design, offer advanced filtering tools and refinement while browsing and searching, and offer customers personalized offers to convince them to buy through the app and develop brand loyalty. At the same time, this study highlights that positive consumer attitudes towards m-commerce mobile applications lead to favorable brand behavioral outcomes and increased loyalty.

5.3. Limitations and Future Work

In addition to theoretical and practical contributions, this study also has limitations, which are worth studying and may suggest future research directions. First of all, this study has a sample formed only of consumers from Romania, which limits the generalization of the results obtained because the specific characteristics of the country and the culture, and the degree of digitalization can influence the quality of m-commerce services and implicitly the consumer behavior. Therefore, future research should conduct cross-country comparative analyzes to test the universality of the proposed model and verify whether this study’s findings hold for other countries.
Other limitations are determined by the way in which samples of respondents are formed and the type of information taken from the questionnaires. Future research could use smart algorithms that study e-market customers in order to assess the age, experience, and specific factors and to see if there are some differences between consumer samples that can be classified with respect to these characteristics.
Future research is intended to remove these limitations by combining the use of quantitative and qualitative methods. Potential future research directions could extend the analysis conducted in this study by using a quantitative and qualitative comparative analysis on clusters.

Author Contributions

Conceptualization, A.M. and G.S.; formal analysis, A.M. and G.S.; investigation, A.M. and G.S.; methodology, A.M. and G.S.; resources, A.M. and G.S.; software, A.M. and G.S.; validation, A.M. and G.S.; writing—original draft, A.M. and G.S. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Data Availability Statement

Not applicable.

Acknowledgments

The authors acknowledge the anonymous reviewers whose suggestions and comments helped improving the paper.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Donthu, N.; Gustafsson, A. Effects of COVID-19 on Business and Research. J. Bus. Res. 2020, 117, 284–289. [Google Scholar] [CrossRef] [PubMed]
  2. Sheth, J. Business of business is more than business: Managing during the Covid crisis. Ind. Mark. Manag. 2020, 88, 261–264. [Google Scholar] [CrossRef]
  3. Mangiò, F.; Pedeliento, G.; Andreini, D. Branding rhetoric in times of a global pandemic: A text-mining analysis. J. Advert. 2021, 50, 240–252. [Google Scholar] [CrossRef]
  4. Soto-Acosta, P. COVID-19 Pandemic: Shifting Digital Transformation to a High-Speed Gear. Inf. Syst. Manag. 2020, 37, 260–266. [Google Scholar] [CrossRef]
  5. Eger, L.; Komarkova, L.; Egerova, D.; Micik, M. The effect of COVID-19 on consumer shopping behaviour: Generational cohort perspective. J. Retail. Consum. Serv. 2021, 61, 102542. [Google Scholar] [CrossRef]
  6. Zwanka, R.J.; Buf, C. COVID-19 generation: A conceptual framework of the consumer behavioral shifts to be caused by the COVID-19 pandemic. J. Int. Consum. Mark. 2021, 33, 58–67. [Google Scholar] [CrossRef]
  7. Gao, X.; Shi, X.; Guo, H.; Liu, Y. To buy or not buy food online: The impact of the COVID-19 epidemic on the adoption of e-commerce in China. PLoS ONE 2020, 15, e0237900. [Google Scholar] [CrossRef]
  8. Bhatti, A.; Akram, H.; Basit, M.; Khan, U.; Syeda, N.; Bilal, M. E-commerce trends during COVID-19 Pandemic. Int. J. Future Gener. Commun. Netw. 2020, 13, 1449–1452. [Google Scholar]
  9. Belvedere, V.; Martinelli, E.M.; Tunisini, A. Getting the most from E-commerce in the context of omnichannel strategies. Ital. J. Mark. 2021, 331–349. [Google Scholar] [CrossRef]
  10. Peráček, T. E-commerce and its limits in the context of consumer protection: The case of the Slovak Republic. Jurid. Trib. 2022, 12, 35–50. [Google Scholar] [CrossRef]
  11. Savrul, M.; Kılıç, C. E-Commerce as an Alternative Strategy in Recovery from the Recession. Procedia Soc. Behav. Sci. 2011, 24, 247–259. [Google Scholar] [CrossRef] [Green Version]
  12. Coelho, L.D.S.; Oliveira, R.C.; Alméri, T.M. O crescimento do e-commerce e os problemas que o acompanham: A identificação da oportunidade de melhoria em uma rede de comercio eletrônico na visão do cliente. Rev. Adm. Cent. Univ. Sales. São Paulo—UNISAL 2013, 3, 63–85. [Google Scholar]
  13. Hajli, M.N. A study of the impact of social media on consumers. Int. J. Mark. Res. 2014, 56, 387–404. [Google Scholar] [CrossRef] [Green Version]
  14. Fouskas, K.; Pachni-Tsitiridou, O.; Chatziharistou, C. A Systematic Literature Review on E-Commerce Success Factors. In Strategic Innovative Marketing and Tourism; Kavoura, A., Kefallonitis, E., Theodoridis, P., Eds.; Springer: Cham, Switzerland, 2020; pp. 687–694. [Google Scholar] [CrossRef]
  15. Pantelimon, F.; Georgescu, T.; Posedaru, B. The impact of mobile e-commerce on GDP: A comparative analysis between Romania and Germany and how COVID-19 influences the ecommerce activity worldwide. Inform. Econ. 2020, 24, 27–41. [Google Scholar] [CrossRef]
  16. Njenga, A.K.; Litondo, K.; Omwansa, T. A Theoretical Review of Mobile Commerce Success Determinants. J. Inf. Eng. Appl. 2016, 6, 13–23. [Google Scholar] [CrossRef]
  17. Chau, N.T.; Deng, H. Critical Determinants for Mobile Commerce Adoption in Vietnamese SMEs: A Conceptual Framework. Procedia Comput. Sci. 2018, 138, 433–440. [Google Scholar] [CrossRef]
  18. Tran, L.T.T. Managing the effectiveness of e-commerce platforms in a pandemic. J. Retail. Consum. Serv. 2021, 58, 102287. [Google Scholar] [CrossRef]
  19. Baldwin, R.; Tomiura, E. Thinking ahead about the trade impact of COVID-19. In Economics in the Time of COVID-19; Baldwin, R., di Mauro, B.W., Eds.; Centre for Economic Policy Research: London, UK, 2020; pp. 59–71. Available online: https://www.econbiz.de/Record/thinking-ahead-about-the-trade-impact-of-covid-19-baldwin-richard/10012202286 (accessed on 12 May 2022).
  20. Watanabe, T.; Omori, Y. Online consumption during the COVID-19 crisis: Evidence from Japan. Covid Econ. 2020, 32, 208–241. [Google Scholar] [CrossRef]
  21. Sardjono, W.; Selviyanti, E.; Mukhlis, M.; Tohir, M. Global issues: Utilization of e-commerce and increased use of mobile commerce application as a result of the COVID-19 pandemic. J. Phys. Conf. Ser. 2021, 1832, 012024. [Google Scholar] [CrossRef]
  22. Andrienko, O. Ecommerce & Consumer Trends During Coronavirus. 2020. Available online: https://www.semrush.com/blog/ecommerce-covid-19/ (accessed on 11 June 2022).
  23. Dannenberg, P.; Fuchs, M.; Riedler, T.; Wiedemann, C. Digital transition by COVID-19 pandemic? The German food online retail. Tijdschr. Econ. Soc. Geogr. 2020, 111, 543–560. [Google Scholar] [CrossRef]
  24. Grashuis, J.; Skevas, T.; Segovia, M.S. Grocery shopping preferences during the COVID-19 pandemic. Sustainability 2020, 12, 5369. [Google Scholar] [CrossRef]
  25. Sernicola, F.; Maltese, I.; Gatta, V.; Iannaccone, G.; Marcucci, E. Impatto del lockdown sulla spesa degli italiani: Quale futuro per l’e-grocery? REPoT-Riv. Econ. Politica Trasp. 2020, 3, 1–13. [Google Scholar]
  26. Asti, W.P.; Handayani, P.W.; Azzahro, F. Influence of trust, perceived value, and attitude on customers’ repurchase intention for e-grocery. J. Food Prod. Mark. 2021, 27, 157–171. [Google Scholar] [CrossRef]
  27. Kim, S.S. Purchase Intention in the Online Open Market: Do Concerns for E-Commerce Really Matter? Sustainability 2020, 12, 773. [Google Scholar] [CrossRef] [Green Version]
  28. Veeragandham, M.; Patnaik, N.; Tiruvaipati, R.; Guruprasad, M. Consumer buying behavior towards E-Commerce during COVID-19. Int. J. Res. Eng. Sci. Manag. 2020, 3, 78–82. [Google Scholar] [CrossRef]
  29. Salem, M.A.; Nor, K.M. The effect of COVID-19 on consumer behaviour in Saudi Arabia: Switching from brick and mortar stores to E-Commerce. Int. J. Sci. Technol. Res. 2020, 9, 15–28. [Google Scholar]
  30. Anwar, A.; Thongpapanl, N.; Ashraf, A.R. Strategic imperatives of mobile commerce in developing countries: The influence of consumer innovativeness, ubiquity, perceived value, risk, and cost on usage. J. Strateg. Mark. 2020, 6, 722–742. [Google Scholar] [CrossRef]
  31. Ecommerce Europe. 2021 European E-Commerce Report. Available online: https://ecommerce-europe.eu/wp-content/uploads/2021/09/2021-European-E-commerce-Report-LIGHT-VERSION.pdf (accessed on 3 March 2022).
  32. Dumanska, I.; Hrytsyna, L.; Kharun, O.; Matviiets, O. E-commerce and M-commerce as Global Trends of International Trade Caused by the COVID-19 Pandemic. WSEAS Trans. Environ. Dev. 2021, 17, 386–397. [Google Scholar] [CrossRef]
  33. Sanz, L.F.; Pérez, J.G.; Martinez, C.A.; Misra, S. Analysis of Mobile Commerce in the SMEs of the European Union. Tech. Gaz. 2020, 27, 2062–2071. [Google Scholar] [CrossRef]
  34. Alaimo, L.S.; Fiore, M.; Galati, A. How the COVID-19 Pandemic Is Changing Online Food Shopping Human Behaviour in Italy. Sustainability 2020, 12, 9594. [Google Scholar] [CrossRef]
  35. Kalinić, Z.; Marinković, V.; Kalinić, L.; Liébana-Cabanillas, F. Neural network modeling of consumer satisfaction in mobile commerce: An empirical analysis. Expert Syst. Appl. 2021, 175, 114803. [Google Scholar] [CrossRef]
  36. Marinao-Artigas, E.; Barajas-Portas, K. Precedents of the satisfaction of mobile shoppers. A cross-country analysis. Electron. Commer. Res. Appl. 2020, 39, 100919. [Google Scholar] [CrossRef]
  37. Chehabeddine, M.; Tvaronavičienė, M. Securing regional development. Insights Into Reg. Dev. 2020, 2, 430–442. [Google Scholar] [CrossRef]
  38. Sharma, S.; Sharma, H.; Dwivedi, Y. A Hybrid SEM-Neural Network Model for Predicting Determinants of Mobile Payment Services. Inf. Syst. Manag. 2020, 36, 243–261. [Google Scholar] [CrossRef]
  39. Marinković, V.; Đorđević, A.; Kalinić, Z. The moderating effects of gender on customer satisfaction and continuance intention in mobile commerce: A UTAUT-based perspective. Technol. Anal. Strateg. Manag. 2020, 32, 306–318. [Google Scholar] [CrossRef]
  40. Rita, P.; Oliveira, T.; Farisa, A. The impact of e-service quality and customer satisfaction on customer behavior in online shopping. Heliyon 2019, 5, e02690. [Google Scholar] [CrossRef] [Green Version]
  41. Chopdar, P.K.; Balakrishnan, J. Consumers response towards mobile commerce applications: S-O-R approach. Int. J. Inf. Manag. 2020, 53, 102106. [Google Scholar] [CrossRef]
  42. Bhati, N.S. Validation of Customers’ Perceived E-Service Quality Determinants: A Study of Online Shoppers. In Proceedings of the International Conference on Sustainable Computing in Science, Technology and Management (SUSCOM), Amity University Rajasthan, Jaipur, India, 26–28 February 2019. [Google Scholar] [CrossRef]
  43. Omar, S.; Mohsen, K.; Tsimonis, G.; Oozeerally, A.; Hsu, J.H. M-commerce: The nexus between mobile shopping service quality and loyalty. J. Retail. Consum. Serv. 2021, 60, 102468. [Google Scholar] [CrossRef]
  44. Hasanat, M.W.; Hoque, A.; Shikha, F.A.; Anwar, M.; Hamid, A.B.A.; Tat, H.H. The impact of coronavirus (COVID-19) on E-Business in Malaysia. Asian J. Multidiscip. Stud. 2020, 3, 52–58. [Google Scholar]
  45. 99firms Statistics–Ecommerce Statistics. Available online: https://99firms.com/blog/ecommerce-statistics/ (accessed on 3 March 2022).
  46. Statista. Reports. Digital & Trends 2022. Available online: https://www.statista.com/studies-and-reports/digital-and-trend (accessed on 3 March 2022).
  47. GPeC Romanian E-Commerce 2021 Report. Available online: https://www.gpec.ro/blog/en/gpec-romanian-e-commerce-2021-report (accessed on 5 March 2022).
  48. Hossain, S.F.A.; Xi, Z.; Nurunnabi, M.; Hussain, K. Ubiquitous Role of Social Networking in Driving M-Commerce: Evaluating the Use of Mobile Phones for Online Shopping and Payment in the Context of Trust. SAGE Open 2020, 10, 2158244020939536. [Google Scholar] [CrossRef]
  49. Du, S.; Li, H. The Knowledge Mapping of Mobile Commerce Research: A Visual Analysis Based on I-Model. Sustainability 2019, 11, 1580. [Google Scholar] [CrossRef] [Green Version]
  50. Jain, N.; Tan, T. M-Commerce, Sales Concentration, and Inventory Management. Manuf. Serv. Oper. Manag. 2022. [Google Scholar] [CrossRef]
  51. Pollák, F.; Konečný, M.; Ščeulovs, D. Innovations in the Management of E-Commerce: Analysis of Customer Interactions during the COVID-19 Pandemic. Sustainability 2021, 13, 7986. [Google Scholar] [CrossRef]
  52. Gerlich, M. COVID-19 Induced Changes in Consumer Behavior. Open J. Bus. Manag. 2021, 9, 2425–2451. [Google Scholar] [CrossRef]
  53. Hodbod, A.; Hommes, C.; Huber, S.J.; Salle, I. The COVID-19 Consumption Game-Changer: Evidence from a Large-Scale Multi-Country Survey. Eur. Econ. Rev. 2021, 140, 103953. [Google Scholar] [CrossRef]
  54. Lim, W.; Sham, R.; Loi, A.M.; Shion, E.; Wong, B.Y. M-commerce adoption among youths in Malaysia: Dataset article. Data Brief 2022, 2, 108238. [Google Scholar] [CrossRef]
  55. Agarwal, R.; Mehrotra, A. SEM approach to understanding m-commerce use in a developing country. Int. J. Bus. Glob. 2021, 27, 403–423. [Google Scholar] [CrossRef]
  56. Williams, S.N.; Armitage, C.J.; Tampe, T.; Dienes, K. Public perceptions and experiences of social distancing and social isolation during the COVID-19 pandemic: A UK-based focus group study. BMJ Open 2020, 10, e039334. [Google Scholar] [CrossRef]
  57. Julsrud, D.T.E.; Krogstad, D.J.R. Is there enough trust for the smart city? exploring acceptance for use of mobile phone data in Oslo and Tallinn. Technol. Forecast. Soc. Chang. 2020, 161, 120314. [Google Scholar] [CrossRef]
  58. Sarkar, S.; Chauhan, S.; Khare, A. A meta-analysis of antecedents and consequences of trust in mobile commerce. Int. J. Inf. 2020, 50, 286–301. [Google Scholar] [CrossRef]
  59. AlSondos, I.; Salameh, A. The effect of system quality and service quality toward using m-commerce service, based on consumer perspective. Manag. Sci. Lett. 2020, 10, 2589–2596. [Google Scholar] [CrossRef]
  60. Soni, M.; Jain, K.; Kumar, B. Factors affecting the adoption of fashion mobile shopping applications. J. Glob. Fash. Mark. 2019, 10, 358–376. [Google Scholar] [CrossRef]
  61. Brusch, I.; Rappel, N. Exploring the acceptance of instant shopping–An empirical analysis of the determinants of user intention. J. Retail. Consum. Serv. 2020, 54, 101936. [Google Scholar] [CrossRef]
  62. Liu, D.; Li, M. Exploring new factors affecting purchase intention of mobile commerce: Trust and social benefit as mediators. Int. J. Mob. Commun. 2019, 17, 108–125. [Google Scholar] [CrossRef]
  63. Taneja, B. The Digital Edge for M-Commerce to Replace E-Commerce. In Emerging Challenges, Solutions, and Best Practices for Digital Enterprise Transformation; Kamaljeet, S., Ed.; IGI Global: Hershey, PA, USA, 2021; pp. 299–318. [Google Scholar] [CrossRef]
  64. Bahaddad, A.A. The Traditional Influence on Increasing Acceptance of Commercial Smartphone Applications in Specific Regions of the Arabic World. Complexity 2021, 2021, 4336772. [Google Scholar] [CrossRef]
  65. Chau, N.T.; Deng, H.; Tay, R. A Perception-Based Model for Mobile Commerce Adoption in Vietnamese Small and Medium-Sized Enterprises. J. Glob. Inf. Manag. 2021, 29, 44–67. [Google Scholar] [CrossRef]
  66. Vărzaru, A.A.; Bocean, C.G. A Two-Stage SEM–Artificial Neural Network Analysis of Mobile Commerce and Its Drivers. J. Theor. Appl. Electron. Commer. Res. 2021, 16, 127. [Google Scholar] [CrossRef]
  67. McLean, G.; Osei-Frimpong, K.; Al-Nabhani, K.; Marriott, H. Examining consumer attitudes towards retailers’ m-commerce mobile applications—An initial adoption vs. continuous use perspective. J. Bus. Res. 2020, 106, 139–157. [Google Scholar] [CrossRef]
  68. Shaw, N.; Sergueeva, K. The non-monetary benefits of mobile commerce: Extending UTAUT2 with perceived value. Int. J. Inf. Manag. 2019, 45, 44–55. [Google Scholar] [CrossRef]
  69. Blut, M. E-service quality: Development of a hierarchical model. J. Retail. 2016, 92, 500–517. [Google Scholar] [CrossRef] [Green Version]
  70. Gera, R.; Chadha, P.; Ahuja, V. Mobile shopping apps adoption: A systematic literature review. Int. J. Electron. Bus. 2021, 16, 239–261. [Google Scholar] [CrossRef]
  71. AlQahtani, Y.; Beloff, N.; White, M. A novel model of adoption of M-commerce in Saudi Arabia. In Proceedings of the 2020 Federated Conference on Computer Science and Information Systems, Sofia, Bulgaria, 6–9 September 2020; Volume 22, pp. 25–34. [Google Scholar] [CrossRef]
  72. Tan, M.L.; Prasanna, R.; Stock, K.; Doyle, E.E.; Leonard, G.; Johnston, D. Usability factors influencing the continuance intention of disaster apps: A mixed-methods study. Int. J. Disaster Risk Reduct. 2020, 50, 101874. [Google Scholar] [CrossRef]
  73. Xiao, L.; Lu, Q.; Guo, F. Mobile Personalized Recommendation Model Based on Privacy Concerns and Context Analysis for the Sustainable Development of M-commerce. Sustainability 2020, 12, 3036. [Google Scholar] [CrossRef] [Green Version]
  74. Hsieh, S.H.; Lee, C.T.; Tseng, T.H. Branded app atmospherics: Examining the effect of pleasure-arousal-dominance in brand relationship building. J. Retailing Consum. Serv. 2021, 60, 102482. [Google Scholar] [CrossRef]
  75. Singh, N.; Sinha, N.; Liébana-Cabanillas, F.J. Determining factors in the adoption and recommendation of mobile wallet services in India: Analysis of the effect of innovativeness, stress to use and social influence. Int. J. Inf. Manag. 2020, 50, 191–205. [Google Scholar] [CrossRef]
  76. Iskandar, M.; Hartoyo, H.; Hermadi, I. Analysis of Factors Affecting Behavioral Intention and Use of Behavioral of Mobile Banking Using Unified Theory of Acceptance and Use of Technology 2 Model Approach. Int. Rev. Manag. Mark. 2020, 10, 41. [Google Scholar] [CrossRef]
  77. Liébana-Cabanillas, F.; Singh, N.; Kalinic, Z.; Carvajal-Trujillo, E. Examining the determinants of continuance intention to use and the moderating effect of the gender and age of users of NFC mobile payments: A multi-analytical approach. Inf. Technol. Manag. 2021, 22, 133–161. [Google Scholar] [CrossRef]
  78. Moorthy, K.; Chun T’ing, L.; Chea Yee, K.; Wen Huey, A.; Joe In, L.; Chyi Feng, P.; Jia Yi, T. What Drives the Adoption of Mobile Payment? A Malaysian Perspective. Int. J. Fin. Econ. 2020, 25, 349–364. [Google Scholar] [CrossRef]
  79. Kar, A.K. What Affects Usage Satisfaction in Mobile Payments? Modelling User Generated Content to Develop the “Digital Service Usage Satisfaction Model”. Inf. Syst. Front. 2021, 23, 1341–1361. [Google Scholar] [CrossRef]
  80. Sarmah, R.; Dhiman, N.; Kanojia, H. Understanding intentions and actual use of mobile wallets by millennial: An extended TAM model perspective. J. Indian Bus. Res. 2021, 13, 361–381. [Google Scholar] [CrossRef]
  81. Hariguna, T.; Adiandari, A.M.; Ruangkanjanases, A. Assessing customer intention use of mobile money application and the antecedent of perceived value, economic trust and service trust. Int. J. Web Inf. Syst. 2020, 16, 331–345. [Google Scholar] [CrossRef]
  82. Alalwan, A.A.; Algharabat, R.S.; Baabdullah, A.M.; Rana, N.P.; Qasem, Z.; Dwivedi, Y.K. Examining the impact of mobile interactivity on customer engagement in the context of mobile shopping. J. Enterp. Inform. Manag. 2020, 33, 627–653. [Google Scholar] [CrossRef] [Green Version]
  83. Tan, S.M.; Liew, T.W. Multi-Chatbot or Single-Chatbot? The Effects of M-Commerce Chatbot Interface on Source Credibility, Social Presence, Trust, and Purchase Intention. Hum. Behav. Emerg. Technol. 2022, 2022, 2501538. [Google Scholar] [CrossRef]
  84. Pakurár, M.; Benedek, S.; Popp, J.; Magda, R.; Oláh, J. Trust or Doubt: Accuracy of Determining Factors for Supply Chain Performance. Pol. J. Manag. Stud. 2019, 19, 283–297. [Google Scholar] [CrossRef]
  85. Victor, V.; Thoppan, J.J.; Fekete-Farkas, M.; Grabara, J. Pricing strategies in the era of digitalisation and the perceived shift in consumer behaviour of youth in Poland. J. Int. Stud. 2019, 12, 74–91. [Google Scholar] [CrossRef]
  86. Javaria, K.; Masood, O.; Garcia, F. Strategies to manage the risks faced by consumers in developing e-commerce. Insights Into Reg. Dev. 2020, 2, 774–783. [Google Scholar] [CrossRef]
  87. Bandara, R.; Fernando, M.; Akter, S. Explicating the privacy paradox: A qualitative inquiry of online shopping consumers. J. Retail. Consum. Serv. 2020, 52, 101947. [Google Scholar] [CrossRef]
  88. Woźniak, J.; Zbuchea, A. Give or buy contexts and internet experience as a factor differentiating of readiness to provide different types of personal data in m-commerce. Entrep. Sustain. Cent. 2021, 8, 53–67. [Google Scholar] [CrossRef]
  89. Chmielarz, W.; Zborowski, M.; Jin, X.; Atasever, M.; Szpakowska, J. On a Comparative Analysis of Individual Customer Purchases on the Internet for Poland, Turkey and the People’s Republic of China at the Time of the COVID-19 Pandemic. Sustainability 2022, 14, 7366. [Google Scholar] [CrossRef]
  90. Dakduk, S.; Santalla-Banderali, Z.; Siqueira, J.R. Acceptance of mobile commerce in low-income consumers: Evidence from an emerging economy. Heliyon 2020, 6, e05451. [Google Scholar] [CrossRef]
  91. Akram, U.; Fülöp, M.T.; Tiron-Tudor, A.; Topor, D.I.; Căpușuneanu, S. Impact of Digitalization on Customers’ Well-Being in the Pandemic Period: Challenges and Opportunities for the Retail Industry. Int. J. Environ. Res. Public Health 2021, 18, 7533. [Google Scholar] [CrossRef] [PubMed]
  92. Choi, Y.J.; Park, J.W. Investigating factors influencing the behavioral intention of online duty-free shop users. Sustainability 2020, 12, 7108. [Google Scholar] [CrossRef]
  93. Sim, J.J.; Loh, S.H.; Wong, K.L.; Choong, C.K. Do We Need Trust Transfer Mechanisms? An M-Commerce Adoption Perspective. J. Theor. Appl. Electron. Commer. Res. 2021, 16, 2241–2262. [Google Scholar] [CrossRef]
  94. Yang, F.; Tang, J.; Men, J.; Zheng, X. Consumer perceived value and impulse buying behavior on mobile commerce: The moderating effect of social influence. J. Retail. Consum. Serv. 2021, 63, 102683. [Google Scholar] [CrossRef]
  95. Ngubelanga, A.; Duffett, R. Modeling Mobile Commerce Applications’ Antecedents of Customer Satisfaction among Millennials: An Extended TAM Perspective. Sustainability 2021, 13, 5973. [Google Scholar] [CrossRef]
  96. Koch, J.; Frommeyer, B.; Schewe, G. Online Shopping Motives during the COVID-19 Pandemic—Lessons from the Crisis. Sustainability 2020, 12, 10247. [Google Scholar] [CrossRef]
  97. Cabrera-Sánchez, J.P.; Ramos-de-Luna, I.; Carvajal-Trujillo, E.; Villarejo-Ramos, Á.F. Online Recommendation Systems: Factors Influencing Use in E-Commerce. Sustainability 2020, 12, 8888. [Google Scholar] [CrossRef]
  98. Cui, Y.; Mou, J.; Cohen, J.; Liu, Y.; Kurcz, K. Understanding consumer intentions toward cross-border m-commerce usage: A psychological distance and commitment-trust perspective. Electron. Commer. Res. Appl. 2020, 39, 100920. [Google Scholar] [CrossRef]
  99. Bhattacharya, A.; Srivastava, M.; Verma, S. Customer Experience in Online Shopping: A Structural Modeling Approach. J. Glob. Mark. 2018, 32, 3–16. [Google Scholar] [CrossRef]
  100. Barari, M.; Ross, M.; Surachartkumtonkun, J. Negative and positive customer shopping experience in an online context. J. Retail. Consum. Serv. 2020, 53, 101985. [Google Scholar] [CrossRef]
  101. Huang, E.Y.; Lin, S.W.; Fan, Y.C. M-S-QUAL: Mobile service quality measurement. Electron. Commer. Res. Appl. 2015, 14, 126–142. [Google Scholar] [CrossRef]
  102. Alotaibi, R.S. Understanding Customer Loyalty of M-Commerce Applications in Saudi Arabia. Int. Trans. J. Eng. Manag. Appl. Sci. Technol. 2021, 12, 1–12. [Google Scholar] [CrossRef]
  103. Perri, C.; Giglio, C.; Corvello, V. Smart users for smart technologies: Investigating the intention to adopt smart energy consumption behaviors. Technol. Forecast. Soc. Chang. 2020, 155, 119991. [Google Scholar] [CrossRef]
  104. Gull, H.; Saeed, S.; Iqbal, S.Z.; Bamarouf, Y.A.; Alqahtani, M.A.; Alabbad, D.A.; Saqib, M.; Qahtani, S.H.A.; Alamer, A. An empirical study of mobile commerce and customers security perception in Saudi Arabia. Electronics 2022, 11, 293. [Google Scholar] [CrossRef]
  105. Zhang, X.; Wang, T. Understanding Purchase Intention in O2O E-Commerce: The Effects of Trust Transfer and Online Contents. J. Theor. Appl. Electron. Commer. Res. 2021, 16, 101–115. [Google Scholar] [CrossRef]
  106. Al-Khalaf, E.; Choe, P. Increasing customer trust towards mobile commerce in a multicultural society: A case of Qatar. J. Internet Commer. 2020, 19, 32–61. [Google Scholar] [CrossRef]
  107. Herhausen, D.; Kleinlercherb, K.; Verhoef, P.C.; Emrichd, O.; Rudolphb, T. Loyalty Formation for Different Customer Journey Segments. J. Retail. 2019, 95, 9–29. [Google Scholar] [CrossRef]
  108. Prashar, S.; Verma, P. The Effects of Online Cues and Perceived Risk on Customer Loyalty: An Empirical Study Among Online Footwear Buyers in India. Inf. Resour. Manag. J. 2020, 33, 64–75. [Google Scholar] [CrossRef]
  109. Massoudi, A. Consumer Loyalty Indicator as Drivers to Satisfaction. J. Humanit. Soc. Sci. 2020, 4, 41–45. [Google Scholar] [CrossRef]
  110. Datareportal. Digital 2022: Romania. Available online: https://datareportal.com/reports/digital-2022-romania (accessed on 20 May 2022).
  111. Statista. Most Popular Mobile Applications Accessed in Romania in 2021, by Type. Available online: https://www.statista.com/statistics/1272847/romania-most-popular-mobile-apps-by-type/ (accessed on 17 May 2022).
  112. Ecomedia.ro. Studiu: 83% Dintre Romani Sunt Deranjati de Stereotipurile Din Reclamele Online. Available online: https://ecompedia.ro/83-dintre-romani-sunt-deranjati-de-stereotipurile-din-reclamele-online-studiu/ (accessed on 17 May 2022).
  113. Schaufeli, W.; Shimazu, A.; Taris, T. Being Driven to Work Excessively Hard the Evaluation of a Two-Factor Measure of Workaholism in the Netherlands and Japan. Cross-Cult. Res. 2009, 43, 320–348. [Google Scholar] [CrossRef] [Green Version]
  114. Khaled Fahim, N.; Negida, A. Sample Size Calculation Guide—Part 1: How to Calculate the Sample Size Based on the Prevalence Rate. Adv. J. Emerg. Med. 2018, 2, e50. [Google Scholar] [CrossRef] [PubMed]
  115. Cicha, K.; Rizun, M.; Rutecka, P.; Strzelecki, A. COVID-19 and higher education: First-year students’ expectations toward distance learning. Sustainability 2021, 13, 1889. [Google Scholar] [CrossRef]
  116. IBM SPSS Software. Available online: https://www.ibm.com/analytics/spss-statistics-software (accessed on 12 May 2022).
  117. Ajayi, L.B.; Adebayo, A.T. Structural Equation Model (SEM). Am. J. Humanit. Soc. Sci. Res. 2021, 5, 11–19. [Google Scholar]
  118. Vărzaru, A.A. Assessing Artificial Intelligence Technology Acceptance in Managerial Accounting. Electronics 2022, 11, 2256. [Google Scholar] [CrossRef]
  119. Mundt, M.; Johnson, W.R.; Potthast, W.; Markert, B.; Mian, A.; Alderson, J. A Comparison of Three Neural Network Approaches for Estimating Joint Angles and Moments from Inertial Measurement Units. Sensors 2021, 21, 4535. [Google Scholar] [CrossRef] [PubMed]
  120. Tenenhaus, M.; Vinzi, V.E.; Chatelin, Y.M.; Lauro, C. PLS Path Modeling. Comput. Stat. Data Anal. 2005, 48, 159–205. [Google Scholar] [CrossRef]
  121. Hair, J.F.; Ringle, C.M.; Sarstedt, M. PLS-SEM: Indeed a Silver Bullet. J. Mark. Theory Pract. 2011, 19, 139–151. [Google Scholar] [CrossRef]
  122. Verkijika, S.F. Factors influencing the adoption of mobile commerce applications in Cameroon. Telemat. Inform. 2018, 35, 1665–1674. [Google Scholar] [CrossRef]
  123. Hair, J.F.; Ringle, C.M.; Sarstedt, M. Partial Least Squares Structural Equation Modeling: Rigorous Applications, Better Results and Higher Acceptance. Long Range Plan. 2013, 46, 1–12. [Google Scholar] [CrossRef]
  124. George, D.; Mallery, P. SPSS for Windows Step by Step: A Simple Guide and Reference 17.0 Update, 10th ed.; Allyn & Bacon: Boston, MA, USA, 2009. [Google Scholar]
  125. Fornell, C.; Larcker, D.F. Evaluating structural equation models with unobservable variables and measurement error. J. Mark. Res. 1981, 18, 39–50. [Google Scholar] [CrossRef]
  126. Chin, W.W. How to write up and report PLS analyses. In Handbook of Partial Least Squares: Concepts, Methods and Applications; Vinzi, V.E., Chin, W.W., Henseler, J., Wang, H., Eds.; Springer: Berlin, Germany, 2010; pp. 655–690. [Google Scholar] [CrossRef]
  127. Ullman, J.B. Structural equation modelling. In Using Multivariate Statistics, 4th ed.; Tabachnick, B.G., Fidell, L.S., Eds.; Pearson Education: Boston, MA, USA, 2001. [Google Scholar]
  128. Hair, J.F.; Black, W.C.; Babin, B.J.; Anderson, R.E. Multivariate Data Analysis, 7th ed.; Pearson: New York, NY, USA, 2010. [Google Scholar]
  129. Hu, L.T.; Bentler, P.M. Cutoff Criteria for Fit Indexes in Covariance Structure Analysis: Conventional Criteria versus New Alternatives. Struct. Equ. Model. 1999, 6, 1–55. [Google Scholar] [CrossRef]
  130. Bollen, K.A. Structural Equations with Latent Variables; John Wiley and Sons, Inc.: New York, NY, USA, 1989. [Google Scholar] [CrossRef]
  131. Bentler, P.M. Comparative Fit Indexes in Structural Models. Psychol. Bull. 1990, 107, 238–246. [Google Scholar] [CrossRef] [PubMed]
  132. Leong, L.Y.; Hew, T.S.; Tan, G.W.H.; Ooi, K.B. Predicting the determinants of the NFC-enabled mobile credit card acceptance: A neural networks approach. Expert Syst. Appl. 2013, 40, 5604–5620. [Google Scholar] [CrossRef]
  133. Ooi, K.B.; Tan, G.W.H. Mobile technology acceptance model: An investigation using mobile users to explore smartphone credit card. Expert Syst. Appl. 2016, 59, 33–46. [Google Scholar] [CrossRef]
  134. Foo, P.Y.; Lee, V.H.; Tan, G.W.H.; Ooi, K.B. A gateway to realizing sustainability performance via green supply chain management practices: A PLS-ANN approach. Expert Syst. Appl. 2018, 107, 1–14. [Google Scholar] [CrossRef]
  135. Zabukovsek, S.S.; Kalinic, Z.; Bobek, S.; Tominc, P. SEM_ANN based research of factors’ impact on extended use of ERP systems. Cent. Eur. J. Oper. Res. 2018, 27, 703–735. [Google Scholar] [CrossRef]
  136. Žofčinová, V.; Čajková, A.; Král, R. Local Leader and the Labour Law Position in the Context of the Smart City Concept through the Optics of the EU. TalTech J. Eur. Stud. 2022, 12, 3–26. [Google Scholar] [CrossRef]
  137. Charaia, V.; Chochia, A.; Lashkhi, M. Promoting Fintech Financing for Sme In S. Caucasian And Baltic States, During The COVID-19 Global Pandemic. Bus. Manag. Econ. Eng. 2021, 19, 358–372. [Google Scholar] [CrossRef]
Figure 1. Description of the conceptual structural model.
Figure 1. Description of the conceptual structural model.
Electronics 11 02499 g001
Figure 2. SEM measurement model. Source: developed using SPSS Amos v.26.0.
Figure 2. SEM measurement model. Source: developed using SPSS Amos v.26.0.
Electronics 11 02499 g002
Figure 3. Neural Network Model. Source: Developed by the authors based on the data calculated with SPSS Statistics.
Figure 3. Neural Network Model. Source: Developed by the authors based on the data calculated with SPSS Statistics.
Electronics 11 02499 g003
Figure 4. Normalized importance. Source: Developed by the authors based on the data calculated with SPSS Statistics.
Figure 4. Normalized importance. Source: Developed by the authors based on the data calculated with SPSS Statistics.
Electronics 11 02499 g004
Table 1. Constructs, items, and coding for structural model.
Table 1. Constructs, items, and coding for structural model.
Latent VariablesConstructItemsCodingSource
Exogenous latent variablesMobile site design and content (DC)The content of the mobile site is conciseDC1[8,62,67,70,71,72]
The content of the mobile site is accurateDC2
The mobile site adequately meets my information needsDC3
The mobile site contains all of the content as that on the
regular site
DC4
The mobile site contains regularly updated contentDC5
The content provided is fully understandableDC6
The mobile site displays a visually pleasing designDC7[8,41,67,73]
The mobile site loads pages quicklyDC8[8,59,67,68]
The mobile site enables me to complete transactions quicklyDC9
It is easy to navigate to any area of the mobile siteDC10
The mobile site has no difficulties with making a payment onlineDC11[58,70,75,76,77,78,79,80,81]
Customer support (CP)The service agents are able to quickly resolve the
problem
CP1[30,74,82,83,84,85]
The service agents consistently provide useful adviceCP2
There is a dedicated online chat function on the mobile siteCP3
The mobile site offers the ability to speak to a live person if there is a problem.CP4
There is a telephone number available to reach the company CP5
The mobile site has a clear process for handling returns CP6
The mobile site provides me with convenient options for returning itemsCP7
The online shop offers a meaningful guaranteeCP8
Security/Privacy (SP)The mobile site has adequate security featuresSP1[36,40,68,69,73,87,88]
This mobile site protects information about my cardSP2
I trust the mobile site to keep my personal information safeSP3
It protects information about my mobile-shopping behaviorSP4
Fulfilment (FF)The product is delivered by the time promised by the companyFF1[21,52,89,90,91,92,93,94]
The mobile site suggests a time frame for when the item will be deliveredFF2
The mobile site sends out the correct itemsFF3
The ordered products arrived in good conditionFF4
The mobile site has accurate stock informationFF5
Endogenous latent variablesM-commerce service quality (MQ)Overall, my purchase experience with this mobile site is very good MQ1[40,41,42,43]
The overall quality of the services provided by this mobile site is very goodMQ2
My overall feelings toward this mobile site are very
satisfied
MQ3
Customer satisfaction (CS)My choice to purchase from the mobile site was wiseCS1[40,66,69,85,90,95,97,98,99,100,101]
The mobile site has met my expectations CS2
I did the right thing by choosing this mobile site CS3
The mobile site enabled a pleasant shopping experienceCS4
Customer trust (CT)This online shop is genuinely interested in customer’s welfareCT1[7,27,29,35,40,43,53,58,77,91,98,102,103,104,105,106]
If problems arise, one can expect to be treated fairly by this online shopCT2
I am happy with the standards by which this online shop is operatingCT3
You can believe the statements of this online shopCT4
Customer loyalty (CL)I will continue to use the mobile site to shop for new goods CL1[40,41,43,93,99,101,102,107,108,109]
I would recommend this mobile site to other people CL2
I will encourage people to purchase from this mobile siteCL3
This mobile site will be my preference when I shop againCL4
Table 2. Sample structure.
Table 2. Sample structure.
VariablesCategoryNumber (N)Percentage (%)
GenderFemale32758.39
Male23341.61
Age18–2513824.65
26–4024343.39
41–5611720.89
>566211.07
EducationHigh school diploma8715.54
Bachelor’s degree18933.75
Master’s degree24744.11
Ph.D. degree and above376.60
EmploymentFull time employment29753.04
Part time employment162.88
Student15427.50
Unemployment254.45
Retired376.60
Other315.53
Monthly incomeLess than EUR 400 11220.00
EUR 401–1000 21137.68
EUR 1001–150014325.54
EUR 1501–2000 7613.57
More than EUR 2001 183.21
M-shopping experienceLess than 12 months 529.29
1–2 years18933.75
2–3 years16329.11
More than 3 years15627.85
M-shopping: times purchased in 2021–20221–2223.93
3–4559.82
5–613624.29
More than 634761.96
Total560100
Table 3. The measurement model results.
Table 3. The measurement model results.
ConstructCACRDG rho AVESR AVEVIF
Mobile site design and content (DC)0.9220.8940.9150.7130.8441.490
Customer support (CP)0.8860.8660.9040.6560.8101.150
Security/Privacy (SP)0.9190.7740.7780.7400.8601.720
Fulfilment (FF)0.8660.8060.8490.6990.8361.910
M-commerce service quality (MQ)0.8260.7060.7540.6430.8023.126
Customer satisfaction (CS)0.8240.7640.8080.6570.8104.322
Customer trust (CT)0.7730.7600.8260.6280.7933.885
Customer loyalty (CL)0.8370.7630.8100.6540.809
Notes: Cronbach’s Alpha (CA); Composite Reliability (CR); Dillon Golstein’s rho (DG rho); Average Variance Extracted (AVE); Square root of AVE (SR AVE); Variance Inflation Factor (VIF).
Table 4. KMO and Bartlett’s Test.
Table 4. KMO and Bartlett’s Test.
Kaiser–Meyer–Olkin Test of Sampling Adequacy0.803
Bartlett’s Test of SphericityApprox. chi-square160.790
df68
Sig.0.000
Table 5. Fornell–Larcker Criterion Analysis for Discriminant Validity.
Table 5. Fornell–Larcker Criterion Analysis for Discriminant Validity.
DCCPSPFFMQCSCTCL
DC0.844
CP0.0710.810
SP0.2410.1150.860
FF0.3760.1690.3990.836
MQ0.6120.2070.7390.7180.802
CS0.4500.3870.4150.6370.7760.810
CT0.3440.3440.5290.6430.6750.7910.793
CL0.4720.2430.5040.6940.7910.8010.7900.809
Table 6. Fit summary of criteria and initial model.
Table 6. Fit summary of criteria and initial model.
Fit Indices χ 2 d f GFISRMRRMSEANFIIFICFI
Recommended value<2>0.90<0.08<0.06>0.90>0.90>0.90
Source[127][128][129][129][130][130][131]
Modified Model1.4680.9250.0730.0580.9160.9520.947
Table 7. Hypothesis (H) testing results.
Table 7. Hypothesis (H) testing results.
HypothesisPaths CorrelationPath Coeff. (β)pResults
H1Mobile site design and content (DC) → M-commerce service quality (MQ)0.269***Supported
H2Customer support (CP) → M-commerce service quality (MQ)0.166***Supported
H3Security/Privacy (SP) → M-commerce service quality (MQ)0.365***Supported
H4Fulfilment (FF) → M-commerce service quality (MQ)0.476***Supported
H5M-commerce service quality (MQ) → Customer satisfaction (CS)0.942***Supported
H6M-commerce service quality (MQ) → Customer trust (CT)0.871***Supported
H7Customer satisfaction (CS) → Customer loyalty (CL)0.651***Supported
H8Customer trust (CT) → Customer loyalty (CL)0.283***Supported
Note: *** p < 0.05. Covariances: (Group number 1—Default model).
Table 8. The standardized total, direct, and indirect effects registered between the variables of the structural equations modeling.
Table 8. The standardized total, direct, and indirect effects registered between the variables of the structural equations modeling.
DCCPSPFFMQCSCT
Standardized total effects
MQ0.2690.1660.3650.4760.0000.0000.000
CS0.2540.1560.3440.4480.9420.0000.000
CT0.2340.1440.3180.4140.8710.0000.000
CL0.2310.1420.3130.4090.8590.6510.283
Standardized direct effects
MQ0.2690.1660.3650.4760.0000.0000.000
CS0.0000.0000.0000.0000.9420.0000.000
CT0.0000.0000.0000.0000.8710.0000.000
CL0.0000.0000.0000.0000.0000.6510.283
Standardized indirect effects
MQ0.0000.0000.0000.0000.0000.0000.000
CS0.2540.1560.3440.4480.0000.0000.000
CT0.2340.1440.3180.4140.0000.0000.000
CL0.2310.1420.3130.4090.8590.0000.000
Table 9. RMSE values for the ANN model.
Table 9. RMSE values for the ANN model.
Input: DC, CP, SP, FF, MQ, CS, CT
Output: CL
Neural NetworkTraining Dataset
(80% of Data Sample 560, n = 448)
Testing Dataset
(20% of Data Sample 560, n = 112)
SSERMSESSERMSE
ANN10.1380.01760.1270.0337
ANN20.1330.01720.1240.0333
ANN30.1290.01700.1190.0326
ANN40.1260.01680.1130.0318
ANN50.1310.01710.1300.0341
ANN60.1270.01680.1320.0343
ANN70.1190.01630.1260.0335
ANN80.1180.01620.1320.0343
ANN90.1160.01610.1270.0337
ANN100.1100.01570.1040.0305
Mean0.0167Mean0.0332
Table 10. Normalized variable relative importance.
Table 10. Normalized variable relative importance.
Predictors
(Independent Variables)
Average Relative ImportanceNormalized Importance
(%)
Ranking
DC0.15446.27
CP0.17853.56
SP0.18555.65
FF0.25877.54
MQ0.3331001
CS0.30691.92
CT0.28685.93
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Mehedintu, A.; Soava, G. A Hybrid SEM-Neural Network Modeling of Quality of M-Commerce Services under the Impact of the COVID-19 Pandemic. Electronics 2022, 11, 2499. https://doi.org/10.3390/electronics11162499

AMA Style

Mehedintu A, Soava G. A Hybrid SEM-Neural Network Modeling of Quality of M-Commerce Services under the Impact of the COVID-19 Pandemic. Electronics. 2022; 11(16):2499. https://doi.org/10.3390/electronics11162499

Chicago/Turabian Style

Mehedintu, Anca, and Georgeta Soava. 2022. "A Hybrid SEM-Neural Network Modeling of Quality of M-Commerce Services under the Impact of the COVID-19 Pandemic" Electronics 11, no. 16: 2499. https://doi.org/10.3390/electronics11162499

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop