Next Article in Journal
The Association of Physical Activity and Sedentary Behaviors with Upper Respiratory Tract Infections and Sleep Duration in Preschool Children—Study Protocol
Next Article in Special Issue
Moving Beyond the Gym: A Content Analysis of YouTube as an Information Resource for Physical Literacy
Previous Article in Journal
Hydrogeochemical Characterization and Irrigation Quality Assessment of Shallow Groundwater in the Central-Western Guanzhong Basin, China
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Social Media-Based Health Management Systems and Sustained Health Engagement: TPB Perspective

1
The School of Management, Hefei University of Technology, Hefei 230009, China
2
The School of Informatics, Computing and Engineering, Bloomington, IN 47405-3907, USA
3
China Academy of Social Management & School of Sociology, Beijing Normal University, Beijing 100000, China
*
Author to whom correspondence should be addressed.
Int. J. Environ. Res. Public Health 2019, 16(9), 1495; https://doi.org/10.3390/ijerph16091495
Submission received: 18 March 2019 / Revised: 25 April 2019 / Accepted: 25 April 2019 / Published: 27 April 2019
(This article belongs to the Special Issue Exploring the Role of Social Media in Health Promotion)

Abstract

:
Background: With the popularity of mobile Internet and social networks, an increasing number of social media-based health management systems (SocialHMS) have emerged in recent years. These social media-based systems have been widely used in registration, payment, decision-making, chronic diseases management, health information and medical expenses inquiry, etc., and they greatly facilitate the convenience for people to obtain health services. Objective: This study aimed to investigate the factors influencing sustained health engagement of SocialHMS by combining the theory of planned behavior (TPB) with the big-five theory and the trust theory. Method: We completed an empirical analysis based on the 494 pieces of data collected from Anhui Medical University first affiliated hospital (AMU) in East China through structural equation modeling and SmartPLS (statistical analysis software). Results: Openness to new experience has a significantly positive influence on attitude (path coefficient = 0.671, t = 24.0571, R2 = 0.451), perceived behavioral control (path coefficient = 0.752, t = 32.2893, R2 = 0.565), and perceived risk (path coefficient = 0.651, t = 18.5940, R2 = 0.424), respectively. Attitude, perceived behavioral control, subjective norms, and trust have a significantly positive influence on sustained health engagement (path coefficients = 0.206, 0.305, 0.197, 0.183 respectively, t = 3.6684, 4.9158, 4.3414, and 3.3715, respectively). The explained variance of the above factors to the sustained health engagement of SocialHMS is 60.7% (R2 = 0.607). Perceived risk has a significantly negative influence on trust (path coefficient = 0.825, t = 46.9598, R2 = 0.681). Conclusions: Attitude, perceived behavioral control, subjective norm, and trust are the determinants that affect sustained health engagement. The users’ personality trait of openness to new experience and perceived risk were also found to be important factors for sustained health engagement. For hospital managers, there is the possibility to take appropriate measures based on users’ personality to further enhance the implementation and utilization of SocialHMS. As for system suppliers, they can provide the optimal design for SocialHMS so as to meet users’ needs.

1. Introduction

With the rapidly increasing development of mobile Internet and the popularity of social networks, an increasing number of social media-based health management systems (SocialHMS) have emerged in recent years [1]. These social media-based systems have been widely used in registration [2], payment, decision making, chronic diseases management, health information and medical expenses inquiry [3], etc., and they greatly facilitate the convenience for people to obtain health services [4,5]. WeChat is one of the most popular social media platforms in China. In the medical field, the application of WeChat can provide patients with functions such as inquiry, appointment, number taking, payment, etc. As long as they pay attention to the public account of the hospital, they can realize more convenient services in WeChat. For example, in terms of Anhui Provincial Hospital, patients can pay attention to the WeChat public number of the hospital, so that they can not only view the relevant information of doctors and experts in the department but also select an appropriate doctor to make an appointment according to their own symptoms and conditions. What is more, they can make use of other advantages of the public number, such as checking the hospital address and ride information, visiting the waiting team information, checking test results, paying online, and checking medical expenses. By using WeChat as a social media platform to develop a health management system, it is possible for patients to shorten the waiting time, appointment arrangement, registration, and examination in the treatment process, so that they can reasonably arrange the waiting and treatment time. When patients know their waiting time for medical treatment, they can arrange their daily affairs flexibly. With the continuous improvement of social media, the application development of social media-based health management system is constantly changing. In addition, the functions of such systems are getting closer and closer to becoming perfect, and the process is more convenient, and meanwhile, the service is more and more optimized. First, a social media-based health management system can realize the connection between patient information and hospital system data, so that data analysis can provide better personalized medical services for patients. For example, the patient can pay attention to the WeChat public number of the hospital and seek medical treatment through the public number before they come to the hospital. Second, information such as charges is transparent, and patients can obtain more information, which is conducive to reducing information asymmetry and improving the relationship between doctors and patients. Third, through a social media-based health management system, patients can actively participate in the system, increasing sustained health engagement [6]. Fourth, after collecting data through a social media-based health management system, analysis can be performed to rationally allocate medical resources and change the state of imbalance of existing medical resources. In short, the benefits of the application of social media-based health management systems are numerous, such as that: (1) They bring convenience to patients’ medical services; (2) they accelerates the transformation of the medical industry; and (3) they make medical services develop in the direction of intelligence, personalization, and autonomy. For instance, Le Zhang et al. proposed the implementation process and significance of developing a medical information service system based on the WeChat public platform. The system is mainly composed of micro-sites and micro-medical networks, which can provide static and dynamic information inquiry services, as well as appointment registration and consulting services. Through this system, patients can receive medical services on the mobile phone in real time, hence simplifying medical procedures and improving patient satisfaction [7]. Further, Haolin studied the performance of social media-based conversation agents in the quit smoking program. The results showed that the presence of social media-based health management systems significantly increased participants’ engagement and smoking cessation effectiveness [8]. What is more, Velasco et al. found that the social media-based mobile Internet health information exchange is regarded as an opportunity to improve public health supervision. On the basis of the traditional systems in which doctors and laboratories report infectious diseases to government agencies, infectious disease cases can be identified more quickly with the help of social media innovation. Social media-based health management systems could allow surveillance epidemiologists to identify potential public health threats, such as rare new diseases and early warning of epidemics [9]. Medical cyber-physical systems (MCPS), which present a new level of integrated intelligence that is characterized by interaction and coordination of computing processes with physical processes, can provide pregnant women with advanced medical care to achieve eugenics [10]. However, one problem of concern is that some patients lose interest in using it and cease using it. Several studies have indicated that users of hospital information systems (HIS) stop using a system after the system has been implemented and adopted by the healthcare organization [11]. Discontinuance wastes a large amount of quality improvement money spent on implementing the system [12]. More importantly, regarding social media-based health management systems (SocialHMS) as a continuous application is important because continuity is the prerequisite for the success of SocialHMS implementations. The significance of behavior continuity in achieving goals has been recognized for a long time in different contexts, including quality improvement [13] and organization success [14]. Thus, it becomes necessary to study factors influencing sustained health engagement and to understand how to use them to enhance the system use and benefits [15].
At present, most of the exiting studies in the area of SocialHMS are focused on the acceptance, development, and application of these systems [16]. In addition, most of the studies about information system (IS) continuance are focused on business-oriented IS such as corporate IS [17,18,19] and e-commerce [20]. Generalizing the outcomes of these studies to the HIS domain is not possible, given the dependence of factors influencing continuance on the context of IS use [21]. Under these circumstances, researchers have called for the study of continuance in the HIS context [22].
Theory of planned behavior (TPB) has been widely accepted as an effective model, which can explain the behavior intention. Further, it is the expansion of theory of reasoned action (TRA), which holds the opinion that any factor could indirectly influence use behavior through attitude and subjective norms [23]. However, the results of many studies show that user’s behavior intention does not always lead to actual behavior. Thus, TPB extends TRA by adding a new component, “perceived behavioral control” to cover nonvolitional behaviors for predicting behavioral intention and actual behavior [24]. According to TPB, individual behaviors can be explained by the behavioral intention which is influenced by attitude, subjective norms, and perceived behavioral control. Attitude towards behavior can reflect likes and dislikes, as well as affective feedbacks, such as whether an experience is pleasant or not [25]. Subjective norm refers to an individual’s perception of social pressure when taking some actions [26]. Perceived behavioral control could be further subdivided into external and internal control factors. Internal control factors refer to an individual’s ability, skill, emotion, the impulse of certain behaviors, etc. External control factors refer to the intervening degree of that environment and facilities for some certain behavior occurring [27]. However, TPB has been criticized for focusing on cognitive factors but ignoring the affect and identity [28].
In the area of social personality psychology, the big five personality types, which are also known as the five-factor model (FFM), have received wide interest and approval [29,30]. This model possesses a high degree of stability in examining cross-cultural phenomena like language benefited from its unique dimensions and levels. Two core issues have been settled in FFM: (1) Distinguishing individual difference and describing order; and (2) structure existing in the individual difference construct [31]. Five relatively stable factors of FFM have been discovered after evaluating and analyzing the experimental results and factors. They are: (1) Extrovert (voluble, confident, and energetic); (2) easy-going (kind, good-natured, cooperative); (3) reliable (cautious, responsible, organized); (4) emotionally stability (calm, non-jittery, good-tempered); and (5) elegant (wise, educated, independent-thinking). All these five factors are highly regarded as the big five, in which the latter has been confirmed by other social-personality psychologists in their strict inspections and studies [32]. From the factors of FFM, openness to experience may be associated with an individual’s behavior intention. The greater the openness of a user, the more willing and confident they are to try new things [33], which reflects an individual’s way of receiving information and processing tendencies.
Perceived risk originates from psychology and has been introduced to the marketing field [34]. It refers to an individual’s perceptions and cognition concerning various objective risks in one’s environment and emphasizes an individual’s experience obtained from intuitive judgment and subjective feeling, as these affect cognitions. Research has found that in certain scenarios, as a result of decision-making variables, behavior intention is related to the level of risk perception of decision makers [35,36].
To sum up, this study is to investigate the factors influencing continuous use of SocialHMS via the integrated research model which combines TPB with openness experience and perceived risk. The research model is presented in Figure 1. By taking account of numerous literature and actual conditions, we propose eight research hypotheses broken into three categories: (1) Openness to new experience; (2) theory of planned behavior; and (3) perceived risk and trust.

1.1. Openness to Experience

Openness to experience, which is from the NEO Personality Inventory (NEO-PI-R) scale defining FFM, is correlated with curiosity, broad-ranging interests, and open-mindedness [37]. Among the factors of FFM, openness to experience may be associated with an individual’s behavior intention because it is a reflection of the characteristics of those individuals who are more open to new ideas and experiences, and more willing and confident to try new things, which reflects an individual’s way of receiving information and processing tendencies. Further, it is a very important variable that can influence the individual’s behavior. Firstly, Lim and Lee found that openness of medical staff and active communication are important for nursing students in order to have a positive attitude toward complementary and alternative therapies [38]. Secondly, Bandura proposed his ternary interaction model that human motivation is generated by one’s behavior, cognitive style, and environment [39]. An individual will not only respond to the external environment, but also adopt some strategies to change the environment they are in. Hascher and Hagenauer examined that openness to experience can positively predict a teacher’s self-efficacy [40]. Hull and Booker’s model also consistently identified openness to experience as a significant contributor to teacher self-efficacy [41]. This research employs the self-efficacy model to evaluate patient performance and feedback on their effectiveness of the SocialHMS. In addition, some research found that the perceived behavioral control based on personal experience and expected blocks will also affect behavior [42]. Thirdly, in the process of using SocialHMS, the user may be confronted with various risks, some of which could be sensed while some could not; some could be exaggerated while some could be diminished. Existing research has shown that perceived risks of consumers from different groups have different impacts on purchase intention [43]. Based on the openness to experience, it is certain that a user with a high degree of openness is good at absorbing new experiences, being brave to take the challenge, and effectively using various strategies to cope with the changes when facing unknowns. Meanwhile, the user of this kind would actively search for innovation when tackling problems, and therefore, can adjust to new changes quickly. In this study, SocialHMS can be viewed as a kind of new experience. These social media-based systems are used in registration, payment, decision-making, chronic diseases management, health information and medical expenses inquiry, etc. A user with a high degree of openness is more willing and confident to accept and use SocialHMS, and they can adjust to the new changes quickly.
Thus, the following are three hypotheses related to openness to experience:
Hypothesis 1 (H1): 
Openness to new experience has a significant positive relationship with attitudes towards using the SocialHMS system.
Hypothesis 2 (H2): 
Openness to new experience has a significant positive relationship with perceived behavioral control over use of the SocialHMS system.
Hypothesis 3 (H3): 
Openness to new experience has a significant positive relationship with perceived risk of using the SocialHMS system.

1.2. Theory of Planned Behavior

Perceived behavioral control has been defined as the perceived difficulty of performing a behavior and points out that an individual’s behavior is restricted by his or her own ability to perform the behavior along with influences from the external environment. This reflects one’s cognition about the factors that can either promote or impede the action, thus affecting the possibility to conduct this action. Ajzen cited numerous studies supporting the correlation between the behavior intention and perceived behavior control [42]. He believed that a stronger perceived behavior control led to a stronger behavior intention. Lots of studies showed that perceived behavior control could predict the behavior intention, such as predicting the user’s intention of using the new software [44]. Perceived behavior control could coordinate the relationship between behavior intention and using behavior, thus exerting a direct influence on the behavior intention. Users’ confidence concerning the difficulty of using SocialHMS could influence the capability of controlling the information system, hence affecting their intention to use SocialHMS.
Attitude refers to an individual’s evaluation of personal behaviors. Attitude towards behavior is determined by the product function sum of belief and outcome evaluation. The attitude examined in this research is about the patients’ adaptation to SocialHMS and whether they gained pleasure from it. Healthcare researchers consider attitude as an important factor in determining the user behavior in adopting guidelines or in SocialHMS use. This is evident in influential models created to explain the user’s adoption of guidelines [45] and in attitude being the main predictor and guideline the use in healthcare studies [46,47]. Subjective norm refers to the individual’s perception of what he or she believed about others’ likelihood to sustain use of the SocialHMS [48]. Subjective norms could come from both internal and external avenues. Internal influence mainly refers to an influence that comes from friends, family, colleagues, leadership, etc., while external influence refers to mass media reports, the opinions of the experts but not individual information [49]. Venkatesh and Davis believed that when a social role wants an individual to perform a behavior, and when the social role can provide a corresponding reward or punishment, individuals tend to follow the social impact [50]. Research concerning this influence of social norms comes from examining users who are participating in virtual communities [51]. Bock and Zmud found that organizational climate forms subjective norms and strongly influences knowledge-sharing intentions among workers [52]. Further, the influence of this factor can be used to study the continuous use of IT systems. The use of SocialHMS can be regarded as a kind of social activity, and the users’ behavior toward using SocialHMS can be observed by a range of the group. What is more, behavior toward using SocialHMS may affect the public’s perception and evaluation of users. When both of the two points were perceived by users, it is likely that sustained health engagement will be affected.
Therefore, we proposed the following hypotheses:
Hypothesis 4 (H4): 
Attitude has a significant positive relationship with sustained health engagement.
Hypothesis 5 (H5): 
Subjective norms have a significant positive relationship with sustained health engagement.
Hypothesis 6 (H6): 
Perceived behavioral control has a significant positive relationship with sustained health engagement.

1.3. Perceived Risk and Trust

Perceived risk theory believes that as long as the output and outcome are uncertain, risk will be generated [53]. There are two uncertainties of every consequence in the decision to use SocialHMS. One is an uncertainty about the results (whether the results will satisfy their purpose), and the other is uncertainty about the failure of using the system. These uncertainties, when perceived by users, may create situations of risk. For example, some studies have shown that users will give up using the system if they perceive it as a threat to their professionalism [54]. Further, sense of privacy is the aspect of the form of perceived risk on the Internet environment, representing the worries and concerns over one’s exposure of privacy [55]. According to the special use environment of SocialHMS, the patient’s personal privacy information is sometimes recorded. Thus, the protection of privacy information will greatly affect patients’ perceived risk level of SocialHMS. This may then affect patients’ continuous use of the system.
Trust in our study refers to patients’ trust that SocialHMS could provide the service they needed. McKnight had shown that trust has an impact on the intention for continuous use [56]. Based on the earlier research results, trust has the following characteristic, risk. That is to say, trust itself represents the intention to take risks; therefore, our study sought to explore the indirect impact of trust on sustained health engagement through perceived risk.
Thus, we proposed the following hypotheses:
Hypothesis 7 (H7): 
Perceived risk has a significant negative relationship with the user trust in SocialHMS.
Hypothesis 8 (H8): 
The user trust in SocialHMS has a significant positive relationship with sustained health engagement.

2. Methodology

2.1. Toolkits

The structural equation model (SEM) matured in the 1980s and is a better method in social science research, remedying the shortcomings of traditional statistical methods [57]. Several advantages of SEM are listed as follows: (1) It can process multiple dependent variables at the same time; (2) it allows independent variables and dependent variables to contain measurement errors; (3) it simultaneously estimates factor structure and factor relationship. The measurement of the structural equation model mainly includes two major evaluations. The first is the evaluation of the measurement model, including the relationship between the observed variables and the latent variables (data reliability and validity analysis). The strength of the model’s interpretation of the latent variable is the R2 value. The second is the evaluation of the structural model. That is, the relationship between latent variables supports whether the model hypothesis is supported. The structural equation model is established by partial least squares (PLS), and the measurement quality (measurement model) and mutual relationship (structural model) are evaluated. Though the ordinary least squares method as the estimation technique, PLS performs an iterative factor analysis set and applies a bootstrap method to estimate the significance of the path (t value). It is a powerful method for analyzing complex models using smaller samples. SmartPLS is developed in Java and can run on any platform. It provides three choices of internal weight modes: Centroid weight, factor weight, and path weight. It can set the number of iterations, iteration precision, and missing value processing. Thus, in this study, we used SmartPLS to evaluate the measurement properties and tested the hypotheses. Note that SmartPLS is a statistical analysis software designed by the development team of Ring, Wende, and Will of the University of Hamburg, Germany in 2005.
The rationality and reliability of the questionnaire are reflected in the form of the scale. The rationality of the scale determines the reliability and availability of data collection. Therefore, before statistical analysis of the results of the questionnaire, the credibility of the data should be analyzed to ensure the availability of the data and the credibility of the interpretation of the model. Only when the credibility of the data is within the acceptable range are the data collection results of the questionnaire reasonable and reliable, and the value of further analysis and statistics available. Cronbach’s alpha reliability coefficient is used to measure the reliability analysis of the data. The higher the value, the higher the reliability of the table. It is generally accepted that a reliability coefficient above 0.7 is acceptable, and less than 0.7 indicates that the item of the scale needs to be adjusted [58]. Therefore, the threshold used herein is that the Cronbach’s alpha coefficient be greater than 0.7.
Validity analysis, also known as effectiveness analysis, is mainly to detect whether each measurement question accurately expresses the meaning of each research variable [59]. Accurate expression means high degree of agreement, and high degree of data validity. Regarding the analysis of data validity, this study conducted two aspects of analysis, one being the analysis of convergence validity and the other the analysis of differential validity. For convergence validity, this paper measured two aspects: (1) Composite reliability (CR); and (2) average variance extracted (AVE). In general, composite reliability is greater than 0.6, indicating that the inherent consistency of all measurement questions is higher. Average variance extracted (AVE) is greater than 0.5, indicating that the measurement questions can better reflect the characteristics of each research variable in the model [60]. For differential validity, the analysis can be performed by the square root of the AVE value. The data for the diagonal position are the square root of the mean variance extraction rate (AVE value) for each study variable. When the square root of the mean variance extraction rate (AVE value) of each measurement question is greater than the correlation coefficient between the variables [61], it indicates that there is a strong discriminant coefficient between the variables, that is, the difference between each measurement variable is better. In general, the larger the R2 value, the stronger the model’s interpretation of each latent variable.

2.2. Sample and Data Collection

Considering the large number of existing studies that have adopted online survey research methods to collect data, we followed a similar data collection method by designing a survey questionnaire to collect data. Measures for the seven variables in our research model were adapted from previous studies. We referred to the relevant research and looked at the variables as well as the relationships among them. Then, by consulting the item of each variable in literature and combining the characteristic of this study, we increased and modified the related question appropriately. Finally, we designed the questionnaire of this study. Our questionnaire adopts a Likert 7-grade scale ranging from 1 (Highly Disagree) to 7 (Highly Agree).
The data collection of this study was carried out in Anhui Medical University first affiliated hospital (AMU), which is a 3A hospital in East China. 3A represents the highest level of hospital in China. The hospital has implemented SocialHMS for 3 years and already has many users. All respondents had 2–3 years of experience using SocialHMS. Firstly, in order to ensure the structural integrity of the questionnaire [62], the English reference scale in the questionnaire was translated into Chinese by a professional translator. After the preliminary design of the questionnaire, in order to ensure the validity and reliability of the questionnaire, we implemented a pilot survey and collected 100 questionnaires in AMU Hospital in June 2014. According to the collected data from the preliminary survey and the advice of the respondents, we adjusted the questions that were difficult to understand. Then, we analyzed the reliability and validity of the data using SmartPLS2.0 and confirmed the good reliability and validity of the questionnaire. The effort to determine reliability is described further along in the data analysis section. Finally, we conducted a survey in the hospital from October 2014 to March 2015. In order to achieve a reasonable response rate, we granted small gifts such as pre-paid phone cards, brush pots, and a creative small fan to each respondent. Each item was valued at about ¥30, about $5. A total of 550 questionnaires were handed out, and we received 532 questionnaires, of which 494 were valid. The return rate was 96.7%, and the valid response rate was 92.9%.

3. Results

3.1. Analysis of Measurement Model

The acceptability of the measurement model was assessed by the reliability of individual items, internal consistency between items, the model’s convergent, and discriminant validity. Table 1 provides the descriptive statistics generated from the initial data, including the mean, standard deviation, and factor loading for each variable. Table 2 shows the Cronbach’s alpha, composite reliability, average variance extracted (AVE), and square root of the AVE, as well as the correlations between the constructs. It is generally accepted that a reliability coefficient above 0.7 is acceptable. Therefore, the threshold used here is that Cronbach’s alpha coefficient be greater than 0.7 [59]. As shown in Table 2, Cronbach’s alpha of the seven constructs are all above the recommended criterion of 0.70, ranging from 0.7188 (Subjective norm) to 0.8571 (trust), which shows that the measures are reliable and internally consistent. Further, convergent validity and discriminant validity tests can be conducted by using SmartPLS2.0.
Convergent validity is generally assessed by the loadings of all the items; composite reliability (CR), average extracted variance (AVE), and discriminant validity should be evaluated by examining whether AVEs are higher than the interconstruct correlations. As shown in Table 1, the loadings of all the items are above the threshold of 0.75, indicating that the observed variables have high convergent validity. Furthermore, there is a high correlation between the observed variables and their belonging structure variables. Composite reliability that achieved 0.70 or above means the scale has good reliability. In general, composite reliability is greater than 0.6 and average variance extracted (AVE) is greater than 0.5, indicating that the reliability of this model is good [60]. Table 2 shows composite reliability is above 0.70 for all the variables in this study. Moreover, Table 2 shows AVE in this study is above 0.50 throughout, which denotes that the latent variables have a convergence ability that is quite ideal. When the square root of the mean variance extraction rate (AVE value) of each measurement question is greater than the correlation coefficient between the variables, it indicates that the difference between each measurement variable is better [58]. Further, the square root of the latent variables AVE value is greater than the absolute value of the correlation coefficient among latent variables. Thus, the discriminant validity of latent variables has been readjusted to meet standard.
Therefore, the reliability of this study is good.

3.2. Analysis of Structural Model

Model fitting results are shown in Figure 2 and Table 3: The hypothesis of the impact of openness to experience personality trait on the attitude of use toward the SocialHMS (H1) is verified. In general, the t value is greater than 1.64, indicating that the hypothesis is supported [61]. Its path coefficient was 0.671 (t = 24.0571). Obviously, it reaches the significant level of 0.01, and the explained variance is 45.1%. The results show that the independence of the user’s personality has a positive, significant influence on perceived usefulness. The path coefficient of openness to experience to perceived behavioral control is 0.752 (t = 32.2893), and this also reaches the significant level of 0.01, with an explained variance of 56.5%. Therefore, openness to experience has a positive significant influence on perceived behavioral control, and (H2) is verified. The path coefficient of openness to experience to perceived risk is 0.651 (t = 18.5940), and this also reaches the significant level of 0.01. Because the path coefficient is negative, the negative correlation of openness to experience to perceived risk can be verified. Thus, hypothesis H3 was supported. H7, the hypothesis of perceived risk to trust has been verified, too. Its path coefficient is 0.825 (t = 46.9598), reaching the significant level of 0.01, and the explained variance is 68.1%. The path coefficient of attitude (H4), perceived behavioral control (H5), subjective norms (H6), and trust (H8) in the intention of sustained use of the SocialHMS were 0.206 (t = 3.6684), 0.305 (t = 4.9158), 0.197 (t = 4.3414) and 0.183 (t = 3.3715), respectively. Therefore, H4, H5, H6, and H8 are verified. H4, H5, H6, and H8 reach the significant level of 0.01. Hence, we drew a conclusion that the perceived risk has a significant influence on the sustained intention to use SocialHMS. The explained variance of the above factors to the sustained health engagement of SocialHMS is 60.7%.

4. Discussion

This paper studied the continuous use behavior of SocialHMS. As the experimental analysis results have shown, the 8 hypotheses proposed in the model have all been supported.
The analysis of H1, H2, and H3 showed that the openness to new experience personality trait has a significant positive impact on the attitude, perceived behavioral control, and perceived risk, thus improving sustained health engagement. The verified H4 and H5 show that the attitude and perceived behavioral control have a direct effect on sustained health engagement. The personality trait of openness to experience was a case in point. The greater the openness of a user, the more willing and confident they are to accept and use SocialHMS. Developers can improve SocialHMS based on the openness to experience and match the users through big data and cloud computing with each respective personality characteristic. System designers can improve the operation and function of SocialHMS. Then, system designers can design more humanized and more acceptable SocialHMS to enhance the user’s sustained health engagement. Over time, web designers should seek to improve user attitudes towards, and perceived behavioral control by the use of the SocialHMS, which is likely to increase user engagement.
The empirical results of H6 indicated that subjective norms have a positive effect on the user’s sustained health engagement. By enhancing the user’s subjective norms, through official promotion, advertising, word of mouth, and system promoters can improve patients’ positive cognition of the system [63], as well as effectively enhance the doctors’ sustained health engagement.
The supported H7 indicated that perceived risk has a significant negative relationship with user trust in SocialHMS. The supported H8 shows that user trust in SocialHMS has a significant positive relationship with sustained health engagement. The support for these two hypotheses indicates that the lower the risk in the SocialHMS users perceive, the more trust they place in the system, and the more sustained health engagement will result. From this perspective, hospitals could improve patients’ trust and strengthen their sustained health engagement through improving the SocialHMS safety features and strengthening patients’ privacy safeguards [64].

5. Conclusions

Three theories including TPB, the big-five trait theory, and risk and trust theory were introduced in this study so as to, on the one hand, examine the relationship between openness experience and sustained health engagement and, on the other hand, examine how perceived risk affects sustained health engagement in the context of social media-based health management systems (SocialHMS). Our results revealed that attitude, perceived behavioral control, subjective norm, and trust are the determinants that affect sustained health engagement. The users’ personality trait of openness to new experience and perceived risk were also found to be important factors for sustained health engagement. The results of this study integrate two research streams, IS and healthcare, to provide a holistic understanding of the sustained use of SocialHMS both by users and researchers. The research model is quite novel and combines the classic TPB model with both the big-five theory and risk and trust theory. This can be seen as an endeavor to extend the TPB model. In essence, the paper has provided a new perspective to the study of sustained health engagement, demonstrating the effect of personality (openness to new experience) on use of hospital systems [65]. It can also provide designers with a reference for system optimization [66], as well as for decision-making support for medical institutions [67], thus further improving the implementation of various intelligent technologies in hospitals. Designers can improve SocialHMS based on this personality perspective, and they can design more humanized and more acceptable hospital information systems to enhance the user’s sustained health engagement. Through official promotion, advertising, and word of mouth, hospitals can improve patients’ positive cognition of the system and effectively enhance doctors’ sustained health engagement by enhancing the user’s subjective norms. Hospitals could also improve patients’ trust and strengthen their sustained health engagement through improving the SocialHMS safety features and strengthening patients’ privacy safeguards.

Author Contributions

D.G. conceived the research; J.G. wrote the draft; S.Z., T.L., and B.L. collected the data and conducted data analysis; C.L. and W.L. provided some guiding suggestions and revised the paper.

Funding

This research is partially supported in the collection, analysis, and interpretation of data by the National Natural Science Foundation of China under Grant No. 71331002, 71771075, 71771077, 71573071, and 71601061.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. De Brún, A.; McAuliffe, E. Social Network Analysis as a Methodological Approach to Explore Health Systems: A Case Study Exploring Support among Senior Managers/Executives in a Hospital Network. Int. J. Environ. Res. Public Health 2018, 15, 511. [Google Scholar] [CrossRef] [PubMed]
  2. Khajeheian, D.; Colabi, A.M.; Shah, N.B.A.K.; Wan Mohamed Radzi, C.W.J.B.; Jenatabadi, H.S. Effect of Social Media on Child Obesity: Application of Structural Equation Modeling with the Taguchi Method. Int. J. Environ. Res. Public Health 2018, 15, 1343. [Google Scholar] [CrossRef] [PubMed]
  3. Marqués-Sánchez, P.; Muňoz-Doyague, M.F.; Martínez, Y.V.; Everett, M.; Serrano-Fuentes, N.; Van Bogaert, P.; Vassilev, I.; Reeves, D. The Importance of External Contacts in Job Performance: A Study in Healthcare Organizations Using Social Network Analysis. Int. J. Environ. Res. Public Health 2018, 15, 1345. [Google Scholar] [CrossRef]
  4. Mikkelsen, B.E.; Bloch, P.; Reinbach, H.C.; Buch-Andersen, T.; Winkle, L.L.; Toft, U.; Glumer, C.; Jensen, B.B.; Aagaaed-Hansen, J. Project SoL—A Community-Based, Multi-Component Health Promotion Intervention to Improve Healthy Eating and Physical Activity Practices among Danish Families with Young Children Part 2: Evaluation. Int. J. Environ. Res. Public Health 2018, 15, 1513. [Google Scholar] [CrossRef] [PubMed]
  5. Wu, H.; Wu, S.; Wu, H.; Xia, Q.; Li, N. Living Arrangements and Health-Related Quality of Life in Chinese Adolescents Who Migrate from Rural to Urban Schools: Mediating Effect of Social Support. Int. J. Environ. Res. Public Health 2017, 14, 1249. [Google Scholar] [CrossRef] [PubMed]
  6. Thomsen, M.S.; Nørrevang, O. A model for managing patient booking in a radiotherapy department with differentiated waiting times. Acta Oncol. 2009, 48, 251–258. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  7. Zhang, L.; Liu, Z.; Wu, S.; Wang, L.; Yang, G. Study on the medical information service system based on the WeChat platform. Chin. Med. Devices 2015, 30, 82–84. [Google Scholar]
  8. Wang, H.; Zhang, Q.; Ip, M.; Lau, J.T.F. Social media-based conversational agents for health management and interventions. Computer 2018, 51, 26–33. [Google Scholar] [CrossRef]
  9. Velasco, E.; Agheneza, T.; Denecke, K.; Kirchner, G.; Eckmanns, T. Social media and internet-based data in global systems for public health surveillance: A systematic review. Milbank Q. 2014, 92, 7–33. [Google Scholar] [CrossRef] [PubMed]
  10. Li, G.-C.; Chen, C.-L.; Chen, H.-C.; Lin, F.; Gu, C. Design of a secure and effective medical cyber-physical system for ubiquitous telemonitoring pregnancy. Concurr. Comput. 2018, 30, e4236. [Google Scholar] [CrossRef]
  11. Archer, N.; Cocosila, M. A Comparison of Physician Pre-Adoption and Adoption Views on Electronic Health Records in Canadian Medical Practices. J. Med. Internet Res. 2011, 13, e57. [Google Scholar] [CrossRef] [PubMed]
  12. Baker, A. Crossing the Quality Chasm: A New Health System for the 21st Century. BMJ 2011, 323, 1192. [Google Scholar] [CrossRef]
  13. Shortell, S.M.; O’Brien, J.L.; Carman, J.M.; Foster, R.W.; Hughes, E.F.; Boerstler, H.; O’Connor, E.J. Assessing the impact of continuous quality improvement/total quality management: Concept versus implementation. Health Serv. Res. 1995, 30, 377–401. [Google Scholar] [PubMed]
  14. March, J.G. Continuity and change in theories of organizational action. Adm. Sci. Q. 1996, 41, 278–287. [Google Scholar] [CrossRef]
  15. Otte, E.; Rousseau, R. Social network analysis: A powerful strategy, also for the information sciences. J. Inf. Sci. 2002, 28, 441–453. [Google Scholar] [CrossRef]
  16. Fareedi, A.A.; Hassan, S. The impact of social media networks on healthcare process knowledge management (using of semantic web platforms). In Proceedings of the 2014 14th International Conference on Control, Automation and Systems, Seoul, South Korea, 22–25 October 2014; IEEE: Piscatvi, NJ, USA, 2014. [Google Scholar] [CrossRef]
  17. Bhattacherjee, A. Understanding information systems continuance: An expectation-confirmation model. MIS Q. 2001, 25, 351–370. [Google Scholar] [CrossRef]
  18. Bhattacherjee, A.; Premkumar, G. Understanding Changes in Belief and Attitude toward Information Technology Usage: A Theoretical Model and Longitudinal Test. MIS Q. 2004, 28, 229–254. [Google Scholar] [CrossRef]
  19. Venkatesh, V.; Goyal, S. Expectation disconfirmation and technology adoption: Polynomial modeling and response surface analysis. MIS Q. 2010, 34, 281–303. [Google Scholar] [CrossRef]
  20. Pavlou, P.; Fygenson, M. Understanding and predicting electronic commerce adoption: An extension of the theory of planned behavior. MIS Q. 2006, 30, 115–143. [Google Scholar] [CrossRef]
  21. Venkatesh, V.; Thong, J.Y.L.; Chan, F.K.Y.; Hu, P.J.-H.; Brown, S.A. Extending the two-stage information systems continuance model: Incorporating UTAUT predictors and the role of context. Inf. Syst. J. 2011, 21, 527–555. [Google Scholar] [CrossRef]
  22. Sun, Y.; Jeyaraj, A. Information technology adoption and continuance: A longitudinal study of individuals’ behavioral intentions. Inf. Manag. 2013, 50, 457–465. [Google Scholar] [CrossRef]
  23. Fishbein, M. A theory of reasoned action: Some applications and implications. Nebr. Symp. Motiv. 1980, 27, 65. [Google Scholar]
  24. Ajzen, I. The theory of planned behavior, organizational behavior and human decision processes. J. Leis. Res. 1991, 50, 176–211. [Google Scholar]
  25. Ajzen, I.; Fishbein, M. Attitudes and the Attitude-Behavior Relation: Reasoned and Automatic Processes. Eur. Rev. Soc. Psychol. 2000, 11, 1–33. [Google Scholar] [CrossRef]
  26. Fishbein, M.; Ajzen, I. Belief, Attitude, Intention and Behaviour: An introduction to theory and research. Philos. Rhetor. 1977, 41, 842–844. [Google Scholar]
  27. Ajzen, I. Attitudes, Personality, and Behavior; McGraw-Hill Education: New York, NY, USA, 2005. [Google Scholar]
  28. Maio, G.R.; Haddock, G. The Psychology of Attitudes and Attitude Change; Sage: London, UK, 2019. [Google Scholar]
  29. Saroglou, V.; Jaspard, J.-M. Personality and religion: From eysenck’s taxonomy to the five-factor model. Arch. Psychol. Relig. 2000, 23, 41–70. [Google Scholar] [CrossRef]
  30. Schmitt, D.P.; Allik, J.; Mccrae, R.R.; Benetmartínez, V. The Geographic Distribution of Big Five Personality Traits: Patterns and Profiles of Human Self-Description across 56 Nations. J. Cross Cult. Psychol. 2007, 38, 173–212. [Google Scholar] [CrossRef]
  31. Larsen, R.J.; Buss, D.M. Personality Psychology: Domains of Knowledge about Human Nature; McGraw Hill Education: New York, NY, USA, 2017. [Google Scholar]
  32. Kapogiannis, D.; Sutin, A.; Davatzikos, C.; Costa, P., Jr.; Resnick, S. The five factors of personality and regional cortical variability in the Baltimore longitudinal study of aging. Hum. Brain Mapp. 2013, 34, 2829–2840. [Google Scholar] [CrossRef]
  33. Davis, D.D.; Bjornberg, N.H. Flourishing in the Workplace through Meditation and Mindfulness. Ind. Organ. Psychol. 2015, 8, 667–674. [Google Scholar] [CrossRef]
  34. Bauer, R.A. Consumer Behavior as Risk Taking. In Proceedings of the 43rd National Conference of the American Marketing Assocation, Chicago, IL, USA, 15–17 June 1960; American Marketing Association: Chicago, IL, USA, 1960. [Google Scholar]
  35. van der Weerd, W.; Timmermans, D.R.; Beaujean, D.J.; Oudhoff, J.; van Steenbergen, J.E. Monitoring the level of government trust, risk perception and intention of the general public to adopt protective measures during the influenza A (H1N1) pandemic in the Netherlands. BMC Public Health 2011, 11, 575. [Google Scholar] [CrossRef] [PubMed]
  36. Liao, C.; Lin, H.-N.; Liu, Y.-P. Predicting the use of pirated software: A contingency model integrating perceived risk with the theory of planned behavior. J. Bus. Ethics 2010, 91, 237–252. [Google Scholar] [CrossRef]
  37. McCrae, R.R.; Terracciano, A. Universal features of personality traits from the observer’s perspective: Data from 50 cultures. J. Pers. Soc. Psychol. 2005, 88, 547. [Google Scholar] [CrossRef] [PubMed]
  38. Lim, S.H.; Lee, J.Y. Nursing Students’ Perception, Experience and Attitude on Complementary and Alternative Therapies. J. East West Nurs. Res. 2015, 21, 110–118. [Google Scholar]
  39. Bandura, A. Social Foundations of Thought and Action: A Social Cognitive Theory; Prentice-Hall, Inc.: Englewood Cliffs, NJ, USA, 1986. [Google Scholar]
  40. Hascher, T.; Hagenauer, G. Openness to theory and its importance for pre-service teachers’ self-efficacy, emotions, and classroom behaviour in the teaching practicum. Int. J. Educ. Res. 2016, 77, 15–25. [Google Scholar] [CrossRef]
  41. Hull, D.M.; Booker, D.D.; Näslund-Hadley, E.I. Teachers’ self-efficacy in Belize and experimentation with teacher-led math inquiry. Teach. Teach. Educ. 2016, 56, 14–24. [Google Scholar] [CrossRef]
  42. Manstead, A.S.R.; van Eekelen, S.A.M. Distinguishing between perceived behavioral control and self-efficacy in the domain of academic achievement intentions and behaviors. J. Appl. Soc. Psychol. 1998, 28, 1375–1392. [Google Scholar] [CrossRef]
  43. Xie, C. The Influence of Perceived Risk on Purchase Intention—A Case study of Taobao Online Shopping of Fresh Fruit. Asian Agric. Res. 2017, 9, 30–35. [Google Scholar]
  44. Miyazaki, A.D.; Fernandez, A. Consumer perceptions of privacy and security risks for online shopping. J. Consum. Aff. 2001, 35, 27–44. [Google Scholar] [CrossRef]
  45. Pathman, D.E.; Konrad, T.R.; Freed, G.L.; Freeman, V.A.; Koch, G.G. The awareness-to-adherence model of the steps to clinical guideline compliance: The case of pediatric vaccine recommendations. Med. Care 1996, 34, 873–889. [Google Scholar] [CrossRef]
  46. Howes, O.D.; Vergunst, F.; Gee, S.; Mcguire, P.; Kapur, S.; Taylor, D. Adherence to treatment guidelines in clinical practice: Study of antipsychotic treatment prior to clozapine initiation. Br. J. Psychiatry 2012, 201, 481–485. [Google Scholar] [CrossRef] [PubMed]
  47. Solà, I.; Carrasco, J.M.; del Campo, P.D.; Gracia, J.; Orrego, C.; Martínez, F.; de Gaminde, I. Attitudes and perceptions about clinical guidelines: A qualitative study with Spanish physicians. PLoS ONE 2014, 9, e86065. [Google Scholar] [CrossRef] [PubMed]
  48. Ajzen, I.; Madden, T.J. Prediction of goal-directed behavior: Attitudes, intentions, and perceived behavioral control. J. Exp. Soc. Psychol. 1986, 22, 453–474. [Google Scholar] [CrossRef]
  49. Bhattacherjee, A. Acceptance of e-commerce services: The case of electronic brokerages. IEEE Trans. Syst. Man. Cybern. A. Syst. Hum. 2000, 30, 411–420. [Google Scholar] [CrossRef]
  50. Venkatesh, V.; Davis, F.D. A theoretical extension of the technology acceptance model: Four longitudinal field studies. Manag. Sci. 2000, 46, 186–204. [Google Scholar] [CrossRef]
  51. Bagozzi, R.P.; Dholakia, U.M. Intentional social action in virtual communities. J. Interact. Mark. 2002, 16, 2–21. [Google Scholar] [CrossRef]
  52. Bock, G.-W.; Zmud, R.W.; Kim, Y.-G.; Lee, J.-N. Behavioral intention formation in knowledge sharing: Examining the roles of extrinsic motivators, social-psychological forces, and organizational climate. MIS Q. 2005, 29, 87–111. [Google Scholar] [CrossRef]
  53. Fraedrich, J.P.; Ferrell, O. The impact of perceived risk and moral philosophy type on ethical decision making in business organizations. J. Bus. Res. 1992, 24, 283–295. [Google Scholar] [CrossRef]
  54. Doolin, B. Power and resistance in the implementation of a medical management information system. Inf. Syst. J. 2004, 14, 343–362. [Google Scholar] [CrossRef]
  55. Kesharwani, A.; Bisht, S.S. The impact of trust and perceived risk on internet banking adoption in India: An extension of technology acceptance model. Int. J. Bank Mark. 2012, 30, 303–322. [Google Scholar] [CrossRef]
  56. McKnight, D.H.; Chervany, N.L. What trust means in e-commerce customer relationships: An interdisciplinary conceptual typology. Int. J. Electron. Comer. 2001, 6, 35–59. [Google Scholar] [CrossRef]
  57. Weir, J.P. Quantifying test-retest reliability using the intraclass correlation coefficient and the sem. J. Strength Cond. Res. 2005, 19, 231–240. [Google Scholar] [PubMed]
  58. Hair, J.F.; Black, W.C.; Babin, B.J.; Anderson, R.E.; Tatham, R.L. Multivariate Data Analysis. Technometrics 2013, 49, 103–104. [Google Scholar]
  59. Carrasco, J.-L.; Jover, L. Assessing individual bioequivalence using the structural equation model. Stat. Med. 2003, 22, 901–912. [Google Scholar] [CrossRef] [PubMed]
  60. Srinivasan, R.; Lilien, G.L.; Rangaswamy, A. Technological opportunism and radical technology adoption: An application to e-business. J. Mark. 2002, 66, 47–60. [Google Scholar] [CrossRef]
  61. Multivariate Data Analysis: Pearson New International Education. Available online: https://is.muni.cz/el/1423/podzim2017/PSY028/um/_Hair_-_Multivariate_data_analysis_7th_revised.pdf (accessed on 18 March 2019).
  62. Brislin, R.W. Cross-cultural research methods. Environ. Cult. 1980, 4, 47–82. [Google Scholar]
  63. Sykes, T.A.; Venkatesh, V.; Gosain, S. Model of acceptance with peer support: A social network perspective to understand employees’ system use. MIS Q. 2009, 33, 371–393. [Google Scholar] [CrossRef]
  64. Vozniuk, A.; Holzer, A.C.; Govaerts, S.; Mazuze, J.; Gillet, D. Graspeo: A Social Media Platform for Knowledge Management in NGOs. In Proceedings of the International Conference on Information & Communication Technologies and Development, Singapore, 15–18 May 2015; EPFL Scientific Publications: Lausanne, Switzerland, 2015. [Google Scholar]
  65. Cameron, D.; Smith, G.A.; Daniulaityte, R.; Sheth, A.P.; Dave, D.; Chen, L.; Anand, G.; Carlson, R.; Watkins, K.Z.; Falck, R. PREDOSE: A semantic web platform for drug abuse epidemiology using social media. J. Biomed. Inform. 2013, 46, 985–997. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  66. Razmerita, L.; Phillips-Wren, G.; Jain, L.C. Innovations in Knowledge Management—The Impact of Social Media, Semantic Web and Cloud Computing; Springer: Berlin, Germany, 2016. [Google Scholar]
  67. Tyagi, A.; Tyagi, R. Social media: Opportunities and challenges for human resource management. IJKBO 2012, 2. [Google Scholar] [CrossRef]
Figure 1. Research model.
Figure 1. Research model.
Ijerph 16 01495 g001
Figure 2. Model results. ** represents p < 0.01.
Figure 2. Model results. ** represents p < 0.01.
Ijerph 16 01495 g002
Table 1. Reliability analysis of variables.
Table 1. Reliability analysis of variables.
ConstructItem Statistics
Construct ItemsMeanStd. DeviationLoading
Openness to New ExperienceOtE1 *5.441.350.856783
OtE2 *5.641.280.905741
OtE3 *5.261.440.837521
AttitudeAttitude16.071.10.826909
Attitude26.021.10.827472
Attitude36.021.050.848277
Attitude45.931.160.822302
Perceived Behavioral ControlPBC1 *5.771.20.829332
PBC2 *5.861.190.862304
PBC3 *5.651.280.820957
Subjective NormsSN14.961.710.756089
SN25.621.350.819427
SN35.551.310.822804
Perceived RiskPR15.751.260.891781
PR25.631.240.917101
TrustTrust15.61.230.804032
Trust25.441.240.824332
Trust35.611.230.847866
Trust45.781.190.869369
Sustained Health EngagementSU15.691.20.888886
SU25.621.290.889958
* The construct items are used to explain the construct. For example, OtE1, OtE2, and OtE3 are scales of the openness to new experience. PBC1, PBC2, and PBC3 are scales of the perceived vehavioral control.
Table 2. Validity analysis of variables.
Table 2. Validity analysis of variables.
Construct ItemsAVE 1Composite ReliabilityCronbach’s AlphaAttitudeSUOtEPBCPRSNTrust
Attitude0.69110.89950.8510.8313 *
SU0.7920.88390.73740.69290.89 *
OtE0.7520.90080.8350.67140.6550.8672 *
PBC0.70180.87590.7880.77960.71480.75150.8377 *
PR0.81820.90.77860.62810.62340.6510.6540.9045 *
SN0.640.84190.71880.62690.63510.64080.62080.60240.8 *
Trust0.70020.90320.85710.68970.66610.7130.69610.82550.65620.8368 *
1 AVE stands for average variance extract. * The bold number is the square root of AVE. The bold numbers listed diagonally are the square root of the variance shared between the constructs and their measures. The off-diagonal elements are the correlations among the constructs. For discriminate validity, the diagonal elements should be larger than the off-diagonal elements.
Table 3. Hypothesis testing results of the model.
Table 3. Hypothesis testing results of the model.
Hypothesized Path.Standardized Path Coefficientst-ValueResults
H1: OtE -> Attitude0.67124.0571Yes
H2: OtE -> PBC0.75232.2893Yes
H3: OtE -> PR0.65118.594Yes
H4: Attitude -> SU0.2063.6684Yes
H5: PBC -> SU0.3054.9158Yes
H6: SN -> SU0.1974.3414Yes
H7: PR -> Trust0.82546.9598Yes
H8: Trust -> SU0.1833.3715Yes

Share and Cite

MDPI and ACS Style

Gu, D.; Guo, J.; Liang, C.; Lu, W.; Zhao, S.; Liu, B.; Long, T. Social Media-Based Health Management Systems and Sustained Health Engagement: TPB Perspective. Int. J. Environ. Res. Public Health 2019, 16, 1495. https://doi.org/10.3390/ijerph16091495

AMA Style

Gu D, Guo J, Liang C, Lu W, Zhao S, Liu B, Long T. Social Media-Based Health Management Systems and Sustained Health Engagement: TPB Perspective. International Journal of Environmental Research and Public Health. 2019; 16(9):1495. https://doi.org/10.3390/ijerph16091495

Chicago/Turabian Style

Gu, Dongxiao, Jingjing Guo, Changyong Liang, Wenxing Lu, Shuping Zhao, Bing Liu, and Tianyue Long. 2019. "Social Media-Based Health Management Systems and Sustained Health Engagement: TPB Perspective" International Journal of Environmental Research and Public Health 16, no. 9: 1495. https://doi.org/10.3390/ijerph16091495

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop