- freely available
Int. J. Environ. Res. Public Health 2014, 11(5), 4905-4925; doi:10.3390/ijerph110504905
Published: 7 May 2014
Abstract: Telehealth has become an increasingly applied solution to delivering health care to rural and underserved areas by remote health care professionals. This study integrated social capital theory, social cognitive theory, and the technology acceptance model (TAM) to develop a comprehensive behavioral model for analyzing the relationships among social capital factors (social capital theory), technological factors (TAM), and system self-efficacy (social cognitive theory) in telehealth. The proposed framework was validated with 365 respondents from Nantou County, located in Central Taiwan. Structural equation modeling (SEM) was used to assess the causal relationships that were hypothesized in the proposed model. The finding indicates that elderly residents generally reported positive perceptions toward the telehealth system. Generally, the findings show that social capital factors (social trust, institutional trust, and social participation) significantly positively affect the technological factors (perceived ease of use and perceived usefulness respectively), which influenced usage intention. This study also confirmed that system self-efficacy was the salient antecedent of perceived ease of use. In addition, regarding the samples, the proposed model fitted considerably well. The proposed integrative psychosocial-technological model may serve as a theoretical basis for future research and can also offer empirical foresight to practitioners and researchers in the health departments of governments, hospitals, and rural communities.
Demographic structures change as society changes. Developed countries worldwide are experiencing aging problems. Statistics by the Ministry of Interior, Executive Yuan of the R.O.C. (Republic of China, Taiwan) revealed that the senior citizen population was 7% of the total population in Taiwan in 1993. Taiwan has become an aging society, as defined by the World Health Organization. This percentage reached 10.9% at the end of 2011, and the aging index increased from 42.3% to 72.2%. The population aged 65 or older is estimated to exceed 20% by 2026. Taiwan would then become a super-aged society. In addition, the senior citizen population is estimated to be 36.97% of the total population by 2051; in other words, one senior citizen aged 65 or older for every three citizens.
With the phenomenon of the aging of the population, some crucial issues with seeking medical services have been emerged, including emergency medical care, life care when physical and mental functions are lost, chronic diseases, and so on. These care issues have revealed the increasing demands of long-term care and senior health management. Telhealth is considered one possible solution to answer these demands by providing cost-effective care through the use of information technology and biomedical technology.
Under the promotion of the National Information Infrastructure (NII), Executive Yuan, R.O.C. (Taiwan), Taiwan’s government has accumulated experience in implementing Telemedicine/Telecare/Telehealth Policy for more than 10 years with focus in supporting people living in offshore islands and mountain areas. Since 1995 the Department of Health, Executive Yuan, R.O.C. (Taiwan) has been promoting Telemedicine Pilot Program to remedy the problem of inadequate medical resources in rural area. The applications of Telemedicine can be categorized into three areas—Teleconsultation, Telediagnosis and Teleeducation. Since 2007 the Department of Health has commissioned Information and Communications Laboratories, Industrial Technology Research Institute to develop Telecare Pilot Program. It is aimed at developing Community-based, Home-based, Institution-based Telecare service models and their application systems with user-friendly human/machine interface through introduction and application of the information and communication technology, thus further establishing Telecare Information Integration Platform. In 2008 Telecare Quality and Service Improvement Program was launched. An integrated and continual network of Telemedicine was developed based upon two original telemedicine models consisting of Home/Community-based and Institution-based models. Meanwhile Ministry of Economic Affairs began to launch two famous telehealth projects. The M-care project, which was one of Mobile Taiwan Applications promotion projects (M-Taiwan), was one of the initial telehealth projects in 2006. The purpose of this project was to deliver health care into remote country to improve residents’ health. In 2007 the U-Care project was launched. The scope of this project was to integrate various industries to create a valuable and innovative business model of telehealth care service. Owing to the advantages of telecommunication technology and medical care, the Taiwanese government in 2008 included telecare and telehealth as a development project in the emerging service industry .
The R.O.C. government is promoting relevant health care plans to resolve the weakening care-giving capability of families from the increase of nuclear family, which is made up of the parents and their children, and to manage increasing demands for long-term health care services in an aging society. Information technology (IT) has gradually been integrated into health care services. For residents in rural areas, resources in the community may be effectively combined with medical care and localized through community-based telecare services, helping people self-monitor their physiological conditions and develop healthy behaviors.
Telemedicine has been defined as the electronically transmitted rapid exchange of medical information between sites of clinical practice for the purposes of relief and/or education. Telemedicine includes diagnosis, treatment, monitoring, and education of patients by using systems that allow ready access to expert advice and patient information no matter where the patient or relevant information is located . That is, telemedicine emphasize the use of information and communication technologies (ICT) to provide clinical services to patients in remote areas, for instance, video conferencing with specialists, remote medical diagnoses, and the digital transmission of medical imaging data. Telecare refers to technology that allows patients to stay safe and independent in their own homes. It is characterized by remote, automatic, and passive monitoring of personal health and safety, and home environment . These devices include fall detection systems, lifestyle monitoring devices and home videophones. Telehealth refers to the remote exchange of data between a patient (usually at home) and healthcare professionals (at a monitoring center) to assist in the management of an existing long-term condition . The service scope of telehealth is more broadly than telemedicine and telecare. The service scope of telehealth is more broadly than telemedicine and telecare. It also includes administration and training in addition to clinical services . Some telehealth programs’ goals now have extended beyond chronic care to include acute care management, health promotion, and disease prevention . Telehealth allows for such things as remote doctor-patient consultations (telemedicine), remote monitoring of vital signs (e.g., blood pressure), and health education services. The use of telehealth that can facilitate the assessment of symptoms reported by patients themselves, may enhance effective symptom management in medical care and provide a means to overcome identified barriers to home care, improving the patients’ experience of care . The purpose of target systems of this currently study is not only to provide the rural residents with remote clinical services, but also self-management of health and disease prevention. To avoid confusion, this study will use the term telehealth throughout the whole article.
The Technology Acceptance Model (TAM) has been found more favorable in many studies . Many studies of TAM have confirmed its robustness and reliability to predict and explain IS acceptance behavior . Some studies have also utilized TAM to investigate patients’ adoption of healthcare information systems and found that TAM provides an appropriate theoretical basis [1,9,10,11]. Despite the widespread use of TAM in practice, little attention is paid to extending TAM to better understand the adoption of telehealth systems. Davis  also proposed that additional factors should be added to the TAM based on the study context. Specially, the goal of telehealth is to extend medical services provided by remote hospitals and to provide early diagnosis and early treatment through patients’ self-management of health. Telehealth is not only an innovative information system, but also health care delivery systems. Therefore, there is a need for research to expand TAM to include important variables and examine the relationships among those variables and eventual telehealth acceptance behavior.
Social capital refers to the features of social structure, such as networks, norms, and social trust, which facilitate coordination and cooperation for mutual benefits . Social capital has been proven to be critical for maintaining population health . In addition, the self-efficacy concept of the social cognitive theory (SCT) of Bandura  has been used to understand the behavior and performance of people in various activities. From an empirical standpoint of computer/information technology context, self-efficacy has been found to be an important determinant of the perceptions of users about such technologies . Rahimpour et al.  also suggested system self-efficacy should be critical important in the acceptance of telehealth.
Accordingly, the objective of this study is to integrate the theoretical perspectives of the TAM, social capital theory, and social cognitive theory to theoretically develop and empirically examine the behavioral model of residents in a rural community in using telehealth and to understand the relationships among those crucial factors that affect their behavioral intention of telehealth. Furthermore, the structural equation modeling (SEM) was used to examine the psychometric properties of questionnaires and validate the proposed model and hypotheses. The insights of these findings can be used for the further implementation of telehealth systems and may contribute to the future academic studies in this field.
2. Literature Review
2.1. Telecare and Telehealth
Telecare is defined as “the continuous, automatic and remote monitoring of real time emergencies and lifestyle changes over time in order to manage the risks associated with independent living” . Telecare encompasses a wide range of equipment (e.g., detectors, monitors, alarms, and pendants) and services (e.g., monitoring, call centers, and response). Telecare equipment is used to support people in their homes and is tailored to meet their specific needs. Telecare services range from a basic community alarm service that reacts to an emergency and transmits a response to an integrated system that includes detectors and monitors (e.g., falls, fire, and gas), triggering a warning to a response centre. Telecare involves using information and communication technologies to transfer medical information for diagnosing and treating patients in their homes .
In 2007, the Department of Health of Executive Yuan in Taiwan commissioned telecare projects that established three telecare models: community-, home-, and institution-based telecare . This project integrated medical care, medical equipment, information communication technology, and security protection to provide a model of holistic, continued, accessible, and digital health care services. Telecare services include: (1) physiological information retrieval, such as body temperature, heart rate, respiratory rate, and blood pressure, blood sugar, and blood oxygen levels; (2) communication and collaboration of health care services, such as urgent calls, transmission of abnormal alarm signals, and notice to revisit; and (3) assistance of health self-management, such as collecting changes of physiological information daily, self-management and follow-up, and early prevention.
Proponents of telecare suggest that it can enable older people to live safely and independently. Three generations of telecare systems can be identified. The first generation of telecare systems was technically simple because the systems comprised no embedded intelligence and relied entirely on the user to activate calls. The second generation systems have all of the features of the first generation but also provide some level of intelligence and automatic detection under limited alert conditions. The third-generation systems provide additional support capabilities, such as lifestyle monitoring or reassurance and the introduction of virtual neighborhoods .
Telehealth refers to the remote exchange of data between a patient (usually at home) and healthcare professionals (at a monitoring center) to assist in the management of an existing long-term condition . The service scope of telehealth is more broad than those of telemedicine and telecare. It also includes administration and training in addition to clinical services . Some telehealth programs’ goals now have extended beyond chronic care to include acute care management, health promotion, and disease prevention . Telehealth has been considered a partial solution to the problems of delivering health care to remote areas as well as to areas underserved by health care professionals . The devices monitor vital signs of patients (or rural residents) include blood pressure, blood glucose, blood oxygen, and weight. Telehealth system is currently being trailed to improve older people’s ability to remain within their homes as long as possible, with access to care and support services that enable them to do this safely . The improved access and quality of clinical care available to rural residents through telehealth may contribute to decreasing the urban-rural health disparities. Also, the professional development opportunities and support from specialists through the use of telehealth may contribute to improved rural medical workforce recruitment and retention . Besides, the use of telehealth that can facilitate the assessment of symptoms reported by patients themselves may enhance effective symptom management in medical care and provide a means to overcome identified barriers to home care, improving the patients’ experience of care .
2.2. Technology Acceptance Model
The Technology Acceptance Model (TAM) is a frequently used behavioral model for predicting and explaining IT usage . The TAM identifies two relevant beliefs, namely perceived ease of use and perceived usefulness. Perceived ease of use is defined as the extent to which a person believes that using a system is free of effort, whereas perceived usefulness is defined as the extent to which a person believes that using a system enhances job performance . According to the TAM, using IT is influenced by behavioral intention to use the IT, and behavioral intention is determined jointly according to perceived ease of use and perceived usefulness. Perceived usefulness is also influenced by perceived ease of use and external variables. In the past decade, the TAM has been widely applied in practice, extended in academics, and empirically tested in the field of information management. Based on the TAM, some studies have investigated the perceptions of patients toward health care IS . In addition, some studies have utilized TAM to investigate patients’ adoption of healthcare information systems and found TAM provides an appropriate theoretical basis [1,9,10,11].
In this study user adoption was examined by intention to use telehealth systems rather than actual adoption. There are a couple of reasons as follows. Firstly, owing to the difficulties in interpreting the multidimensional aspects of “use” (mandatory versus voluntary, informed versus uninformed, effective versus ineffective, and so on), DeLone and McLean  suggested “intention to use” may be a worthwhile alternative measure in some contexts. Secondly, Davis, Bagozzi, and Warshaw  found that behavioral intention to use the system has a positive significantly effect on usage. Owing to the strong causal link between behavioral intention and actual behavior, use of behavioral intention as the dependent variable is not a serious limitation . A number of prior studies either suggested or indicated that behavioral intention to use the system is a reasonable indicator of future system usage . Finally, actual use can be replaced by intention to use when the technology is still undergoing development, has a limited number of users, and when the objective of the research is to predict future use . Telehealth is still at the early development stage, characterized by limited technology adoption and use . Recently, many telehealth studies still used the intention to use variable as proxy of adoption [1,9,10].
2.3. Social Capital and the Technology Acceptance Model
Bourdieu  proposed that social capital is the aggregate of actual or potential resources, which are linked to possession of durable networks of relatively institutionalized relationships of mutual acquaintance or recognition. Coleman  stated that social capital includes several aspects of social structure and facilitates certain actions by individuals within the structure. Putnam  argued that social capital indicates the features of social structure, such as networks, norms, and social trust, which facilitate in coordinating and cooperating for mutual benefits. Woolcock  also stated that social capital includes the information, trust, and norms of reciprocity inherent in social networks. Nahapiet and Ghoshal  defined social capital as the sum of the actual and potential resources embedded within, available through, and derived from the network of relationships maintained by an individual or social unit.
In sum, social capital focuses on the fitness of the individuals and their personal relationships. Social capital can be viewed as a facilitator of social structure for certain actions of individuals, which benefit both the individuals and the organizations [13,29,30]. It mainly deals with interactions between people . Similar to all other forms of capital, social capital has common features: (1) it is a long-lived asset, (2) it is both “appropriable” and “convertible”, (3) it can either be a substitute for or complement other resources, (4) it needs maintenance, (5) some forms of social capital are “collective goods” .
Social capital may contextually affect individual health through several mechanisms, such as promoting rapid diffusion of health information, increasing the likelihood that healthy norms of behavior are adopted, exerting social control over deviant health-related behavior, increasing access to local services and amenities, and providing affective support and acting as the source of self-esteem and mutual respect . In addition, social capital theory suggests that social capital satisfies a necessary condition for knowledge exchange. Lindstrom and Janzon  also proposed that social capital is a social and contextual factor. A society exhibiting high levels of social capital typically encounters a high level of civic engagement, social participation, social trust, institutional trust, and interpersonal reciprocity. Nummela et al.  indicated that the core aspects of social capital, such as trust and social participation, have health-protective effects.
Social capital has mostly been measured as patient trust or social participation/social networks [13,37]. Patient trust refers to the expectation that an individual or institution acts competently, fairly, openly, and considerately. Mohseni and Lindstrom  argued that patient trust could be divided into vertical trust in the institutions of society (institutional trust) and horizontal trust or generalized trust in other people (social trust). The health care system is an institution. Institutional trust enables patients to trust providers without any personal knowledge of the health workers . Patient trust in health care providers (i.e., social trust) has been associated with the clinical or technical competence of the providers, interpersonal quality of care, and concern for the person rather that the disease only. In addition, patient trust in the health care system (i.e., institutional trust) also encourages the use of services, submission to treatment, and patient compliance .
Social participation is an observable feature of social capital that can be measured according to the density of an organization in a geographical area or by the level of participation by respondents in formal or informal social activities within a society [13,38,40]. Social participation provides the channels through which people can be recruited to perform good deeds and social networks can be used to foster norms of reciprocity that encourage people to consider the welfare of others [13,41].
Several previous empirical studies have supported integrating social capital with the TAM. Reid  integrated trust with the TAM, arguing that trust relates to perceived ease of use and perceived usefulness. Gefen, Karahanna, and Straub  also proved that institutional trust positively affects perceived ease of use and perceived usefulness. Pavlou  proposed the e-commerce acceptance model, and the findings support the modified TAM with which trust was integrated. Chow and Chan  suggested that social participation provided increased opportunities for interpersonal contact. People reported positive feelings toward sharing ideas and resources with those whom they developed close relationships. Chow and Chan  also showed a positive association between social participation and attitudes toward knowledge sharing.
The utility of telehealth is that it could improve older people’s ability to remain within their homes as long as possible, with easier access to care and more support services that enable them to do this safely. Trust enable residents to believe that the healthcare providers or the health institution (hospital) have enough ability, benevolence, and integrity to provide expected positive outcome to them. Similarly, trust enable residents to believe that the healthcare providers or the health institution (hospital) will provide required assistances and supports (e.g., training courses, consultants, professional staffs, and user guide handbook) to improve perceived ease of use of telehealth.
Also, if the community residents show higher levels of social participation, then they will become more actively involved in associational activities. These associations often offer opportunities for residents to acquire, maintain, or improve the skills of using telehealth, which in turn, may improve perceived ease of use of telehealth. Besides, higher levels of social participation enable residents to share more feeling, health knowledge and resources about telehealth, which in turn, may also promote perceived usefulness of telehealth.
2.4. System Self-efficacy and the Technology Acceptance Model
Social cognitive theory (SCT) is a theoretical framework for analyzing human motivation, thought, and action that embraces an interact model of causation in which behavior, cognition and other personal factors, and environmental influences all operate as interacting determinants that influence each other bidirectionally [15,46]. Self-efficacy is a key element in SCT and refers to the judgments of people regarding their capabilities to organize and execute courses of action required to perform a task. Self-efficacy affects the behaviors that people choose to perform, the amount of effort they are prepared to exert, and the length of their persistence to overcome obstacles [8,15,47]. According SCT, self-efficacy is a major determinant of an individual’s task performance and has been found to have diverse psychological and behavioral effects in many areas of human psychosocial functioning [15,46]. From an empirical standpoint of computer/information technology context, self-efficacy has been found to be an important determinant of the perceptions of users about such technologies .
Adapted from the general concept of self-efficacy, Compeau and Higgins  defined computer self-efficacy as “people’s judgments about their abilities to use a computer system successfully”. In the telehealth context, this innovative system should be a special application of computer systems. Rahimpour et al.  conceptualized the self-efficacy of a telehealth system as the judgment of a person’s capability to use the system. Although most of the participants in that study exhibited high levels of usage intention, they also expressed low levels of confidence in using the system. Therefore, Rahimpour et al. suggested that system self-efficacy is likely to be crucial and should be incorporated into the TAM to develop an extended model for the acceptance of telehealth by patients.
Venkatesh and Davis  and Venkatesh  proposed that users will anchor their ease of use perceptions to the more abstract belief about their abilities to put computer technologies to use (i.e., system self-efficacy), and will require direct interaction with a system in order to be able to form perceptions about more tangible aspects of the system. These two studies have showed that system self-efficacy is a strong determinant of perceived ease of use before hands-on experience. Many previous empirical studies have also found system self-efficacy had a positive effect on perceived ease of use [8,50].
In addition, some studies have indicated that significantly positive relationships exist between system self-efficacy and outcome expectation , which refers to the extent to which the behavior of people, once successfully executed, is believed to be linked to valued outcomes (i.e., perceived usefulness) . Some studies have found a positive relationship between system self-efficacy and perceived usefulness [8,49,50].
Accordingly, this study proposes the following hypotheses:
H1: Social trust positively affects perceived ease of use in a telehealth context.
H2: Social trust positively affects perceived usefulness in a telehealth context.
H3: Institutional trust positively affects perceived ease of use in a telehealth context.
H4: Institutional trust positively affects perceived usefulness in a telehealth context.
H5: Social participation positively affects perceived ease of use in a telehealth context.
H6: Social participation positively affects perceived usefulness in a telehealth context.
H7: System self-efficacy positively affects perceived ease of use in a telehealth context.
H8: System self-efficacy positively affects perceived usefulness in a telehealth context.
H9: Perceived ease of use positively affects perceived usefulness in a telehealth context.
H10: Perceived ease of use positively affects usage intention in a telehealth context.
H11: Perceived usefulness positively affects usage intention in a telehealth context.
The previous arguments support the proposed research model illustrated in Figure 1.
3. Research Method
3.1. Survey Method and Pretest
We used a self-report questionnaire to examine the proposed research model empirically. A self-report method refers to an approach in which observation data are provided by participants instead of raters or coders. The method is commonly used in behavioral and management science research. The items of measurement used in the questionnaire were developed based on previous studies. Responses to the various variables related to the perceptions of the individual subjects were measured with 5-point Likert-type scales, ranging from 1 (strongly disagree) to 5 (strongly agree).
Following the public explanation session, the residents were arranged to visit the community center and participated in the survey. Before the interview, the researcher, research assistants, and well-trained interviewers introduced the investigation and invited them to participate in the study. The survey subjects of the questionnaire were those residents who were the end users of a telehealth system from Nantou County, Taiwan. All of these end users had used the telehealth system for at least one month. The participants were interviewed in person. The survey questions were read to participants by interviewers in Chinese and they verbalized their answers or wrote down directly on the survey response scale. The interviews lasted for 20 to 30 min.
The telehealth system was developed and installed by a community hospital in Jhushang township, namely Chu Shang Show Chwan Hospital. The overall telehealth system is shown in Figure 2. It shows that the computer screen with health information system (software) and the peripherals used for physiological recording (hardware).
The hardware includes weight scale, blood pressure cuff, blood glucose meter, and pulse oximeter. The equipment measures vital signs tailored to residents’ clinical needs, such as weight, blood pressure, blood glucose, heart rate, and oxygen saturation.
Before the study, we conducted a pretest to refine and finalize the survey instruments. A pretest was conducted on 20 selected residents of Nantou County, Taiwan. The respondents were provided with verbal and written feedback on individual items after completing the questionnaire. The scale items were modified according to the feedback of these respondents.
The measurement items of the questionnaire in the study were generated from in-depth interviews with senior physicians, nurses, residents who have ever used the telehealth system, and adjusted from the original constructs’ instruments developed by previous studies. The demographic variables include five questions: gender, age, marital status, educational level, and elderly main carer.
Perceived ease of use describes the extent to which a person believes that using the telehealth system will be free of effort. Perceived ease of use was measured with two items which adapted from Davis , Davis, Bagozzi, and Warshaw , and Venkatesh . A total score ranging from 2 to 10 was obtained by adding the two items. Higher score on the scale were indicative of higher perceived ease of use. The instrument has a high internal consistency (Cronbach’s α = 0.96).
Perceived usefulness is defined as the extent to which a person believes that using the telehealth system will enhance her/his health. Perceived usefulness was measured with three items which adapted from Davis , Davis, Bagozzi, and Warshaw , and Venkatesh . A total score ranging from 3 to 15 was obtained by adding the three items. Higher score on the scale were indicative of higher perceived usefulness. The instrument has a high internal consistency (Cronbach’s α = 0.99).
Usage intention is the strength of one’s intention to use the telehealth systems. Usage intention was measured with two items which adapted from Davis , Davis, Bagozzi, and Warshaw , and Venkatesh . A total score ranging from 2 to 10 is obtained by adding the two items. Higher score on the scale are indicative of higher usage intention. The instrument has a high internal consistency (Cronbach’s α = 0.99).
System self-efficacy refers to a belief of one’s capability to use the telehealth systems. System self-efficacy was measured with three items which adapted from Compeau and Higgins , Venkatesh , and Rahimpour et al. . A total score ranging from 3 to 15 was obtained by adding the three items. Higher score on the scale were indicative of higher system self-efficacy. The instrument has a high internal consistency (Cronbach’s α = 0.99).
Social trust refers to the expectation that health-care providers will act competently, fairly, openly, and considerately. Social trust was measured with three items which adapted from Mohseni and Lindstrom . A total score ranging from 3 to 15 was obtained by adding the three items. Higher score on the scale were indicative of higher social trust. The instrument has a high internal consistency (Cronbach’s α = 0.99).
Institutional trust refers to an individual’s trust in the hospital. Institutional trust was measured with three items which adapted from Mohseni and Lindstrom . A total score ranging from 3 to 15 was obtained by adding the three items. Higher score on the scale were indicative of higher institutional trust. The instrument has a high internal consistency (Cronbach’s α = 0.96).
Social participation describes how actively a person has taken part in social free-time activities. Social participation was measured with three items which adapted from Nummela et al. . A total score ranging from 3 to 15 was obtained by adding the three items. Higher score on the scale were indicative of higher social participation. The instrument has a high internal consistency (Cronbach’s α = 0.80).
3.3. Statistical Method
For examining the proposed model empirically, structural equation modeling (SEM) was used to validate the model and hypotheses. SEM is a statistical methodology that involves a confirmatory approach to analyzing a structural theory bearing on a particular phenomenon. Typically, this theory represents “causal” processes that generate observations of multiple variables . The data analysis proceeded according to the two-step approach recommended by Anderson and Gerbing . First, the assessment of the measurement model consisting of 10 latent factors included reliability, discriminant validity, and convergent validity of the scales. Second, the structural model was validated individually by considering the series of path relationships linking the 10 constructs.
4.1. Sample Characteristics
Among the 370 subjects recruited, 365 subjects participated in this study. Among the respondents, 217 respondents were women (59.5%) and 148 were men (40.5%). Most of the respondents were aged 71–80 years (41.9%) and held elementary school diplomas (46.8%). Most of the caregivers were married (48.8%). The respondents suffered from at least one chronic disease (71.2%). Table 1 presents descriptive statistics for the seven constructs in this study. The mean scores of seven constructs were all higher than the middle point of the 5-point Likert-type scales and exhibited a reasonable dispersion in their distributions among the ranges. The evidence suggested that the telehealth system was remarkably useful and efficient for the health promotion of the residents, and that they were willing to overcome barriers to using it.
|Table 1. Sample Demographics.|
|Perceived Ease of Use||4.50||0.79||2||5|
4.2. Measurement Model Results
To validate the measurement model, three types of validity were assessed: content validity, convergent validity, and discriminant validity. Content validity was done by interviewing senior system users and pilot-testing the instrument. And the convergent validity was validated by examining Cronbach’s α, composite reliability and average variance extracted from the measures . As shown in Table 2, the Cronbach’s α of every subscale range from 0.80 to 0.99 was above the acceptability value 0.7 . Moreover, the composite reliability values, which ranged from 0.81 to 0.99, and the average variances extracted by our measures, which ranged from 0.59 to 0.99, are all within the commonly accepted range greater than 0.5 . In addition, all measures are significant on their path loadings at the level of 0.001. Therefore, the convergent validities of all constructs are confirmed.
|Table 2. Construct Reliability and Convergent Validity.|
|Construct||Cronbach’s α||Composite Reliability||Average Variance Extracted|
|Perceived Ease of Use||0.96||0.96||0.92|
In addition, according to Fornell and Larcker , if all variables are standardized, then the squared correlation between two constructs γ2 is equal to the variance shared between these two constructs in the model. The average variance extracted (AVE) of these two constructs, namely ρ(η) and ρ(ε) can be used to evaluate discriminant validity. To fully satisfy the requirements for discriminant validity, ρ(η) > γ2 and ρ(ε) > γ2. That is, the AVE of the construct should be greater than the variance shared between the construct and other constructs in the model. Table 3 lists the squared correlation (γ2) and AVE (ρ) matrix, with the squared correlations among constructs and the AVE on the diagonal.
|Table 3. Comparison of Squared Correlation and Average Variance.|
|1. Social Trust||(0.98)|
|2. Institutional Trust||0.41||(0.90)|
|3. Social participation||0.29||0.15||(0.59)|
|4. System Self-efficacy||0.11||0.08||0.29||(0.97)|
|5. Perceived Ease of Use||0.33||0.25||0.26||0.31||(0.92)|
|6. Perceived Usefulness||0.35||0.35||0.34||0.15||0.50||(0.98)|
|7. Usage Intention||0.33||0.39||0.24||0.16||0.43||0.57||(0.99)|
Note: All correlations are significant at the 0.001 level, and diagonal elements are the average variance extracted.
In all cases, the AVE for each construct is larger than the squared correlation of that construct with all other constructs in the model. Therefore, the results confirm that the discriminant validity of constructs in the study is satisfactory.
4.3. Structural Model Results
Subsequently, the structural model (which includes hypotheses in addition to the paths between the item and its latent construct) was examined on the measurement model. To validate the structural model, we used AMOS 18.0 to assess the analysis. Several goodness-of-fit statistics were used to access the overall goodness-of-fit of proposed model: the ratio of chi-square to the degree of freedom (χ2 /d.f.), goodness-of-fit index (GFI), adjusted goodness-of-fit index (AGFI), root mean square error of approximation (RMSEA), root mean square residual (RMR), normed fit index (NFI), relative fit index (RFI), incremental index of fit (IFI), Tucker-Lewis index (TLI), and comparative fit index (CFI). The following indices recommended by Hair et al. , as the criteria for the model’s evaluation: (1)χ2 /d.f. should be less than 3, (2) GFI should be more than 0.9, (3) AGFI should be more than 0.9, (4) RMSEA should be less than 0.05, (5) RMR should be less than 0.05, (6) NFI should be more than 0.9, (7) RFI should be more than 0.9, (8) IFI should be more than 0.9, (9) TLI should be more than 0.9, (10) CFI should be more than 0.9. In general, the closer the observed data is to the theoretical model, the better the fit of the model, and the easier it will be to satisfy the thresholds of the above indices. If the threshold of an index cannot be met, it means the model must be modified .
As shown in the Table 4, the results of structural equation modeling obtained for the proposed conceptual model revealed that χ2 /d.f. = 1.284 (p < 0.001), GFI = 0.952, AGFI = 0.933, RMSEA = 0.028, RMR = 0.024, NFI = 0.986, RFI = 0.982, IFI = 0.997, TLI = 0.996, and CFI = 0.997.
These fit statistics of GFI, AGFI, NFI, RFI, IFI, TLI, and CFI were all far greater than the recommended threshold value 0.9. Furthermore, χ2 /d.f. value was less than the recommended threshold value 5, RMSEA value was less than the recommended threshold value 0.05, and RMR value was less than the recommended threshold value 0.05. Accordingly, the summary of the overall goodness-of-fit indices indicated excellent fit of the model and data. That is, the proposed research model has good fitness.
|Table 4. Fit Indices for the Structural Model.|
|Structural Model Statistic||Fit Indices||Recommended Threshold|
|χ2 / d.f.||1.284||<5|
4.4. Hypotheses Testing
The results for the structural model with the estimated standardized path coefficients and path significance among the constructs are presented in Figure 3 and Table 5. The estimated standardized path coefficients indicate the strengths of the relationships between the dependent and independent variables. The squared multiple correlations (R2) value represents the proportion of variance that is explained based on the predictors of the variables in a model. As predicted, almost all of the proposed hypotheses are supported. As expected, social trust (β = 0.197, p < 0.001), institutional trust (β = 0.186, p < 0.001), social participation (β = 0.114, p < 0.05), and system self-efficacy (β = 0.278, p < 0.001) significantly affected perceived ease of use, accounting for 23.7% of the variance among the constructs. This means that H1, H3, H5, and H7 are supported. Institutional trust (β = 0.177, p < 0.001), social participation (β = 0.214, p < 0.001), and perceived ease of use (β = 0.376, p < 0.001) significantly affected perceived usefulness, accounting for 35.3% of the variance among the constructs. Thus, H4, H6, and H9 are supported. However, social trust and system self-efficacy affected perceived usefulness nonsignificantly, implying that H2 and H8 were not supported. In addition, perceived ease of use (β = 0.216, p < 0.001), and perceived usefulness (β = 0.461, p < 0.001) both significantly affected usage intention, accounting for 35.9% of the variance among the constructs. Thus, H10 and H11 are supported. Table 5 summarizes the results for the hypotheses.
Table 6 lists the standardized indirect and total effects in the proposed model. A direct effect, the influence of one variable on another, is represented in a structural model by a single path. An indirect effect assesses the impact of one variable on another as that variable’s influence works through one or more intervening variables. The total effect of one variable on another is the sum of its direct and indirect effects . As shown in Table 6, perceived usefulness exerted the strongest overall effect on intention to use, followed by perceived ease of use. Perceived ease of use exerted the strongest overall effect on perceived usefulness, followed by social participation. In addition, system self-efficacy had the strongest direct effect on perceived ease of use, followed by social trust.
|Table 5. Hypotheses Validated Results.|
|Path||Results||Standardized Path Estimate|
|H1 Social Trust ➔ Perceived Ease of Use||Supported||0.197 ***|
|H2 Social Trust ➔ Perceived Usefulness||Not Supported||0.082|
|H3 Institutional Trust ➔ Perceived Ease of Use||Supported||0.186 ***|
|H4 Institutional Trust ➔ Perceived Usefulness||Supported||0.177 ***|
|H5 Social Participation ➔ Perceived Ease of Use||Supported||0.114 *|
|H6 Social Participation ➔ Perceived Usefulness||Supported||0.214 ***|
|H7 System Self-Efficacy ➔ Perceived Ease of Use||Supported||0.278 ***|
|H8 System Self-Efficacy ➔ Perceived Usefulness||Not Supported||-0.028|
|H9 Perceived Ease of Use ➔ Perceived Usefulness||Supported||0.376 ***|
|H10 Perceived Ease of Use ➔ Intention to Use||Supported||0.216 ***|
|H11 Perceived Usefulness ➔ Intention to Use||Supported||0.461 ***|
Notes: *** path is significant at the 0.001 level, ** path is significant at the 0.01 level, * path is significant at the 0.05 level.
|Table 6. Standardized Indirect and Total Effects in the Proposed Model.|
|Construct||Perceived Ease of Use||Perceived Usefulness||Intention to Use|
|Perceived Ease of Use||-||NA/0.376||0.173/0.389|
|Intention to Use||-||-||-|
Notes: Number before the slash represent indirect effects, numbers after the slash represent total effects; NA means not applicable.
This study investigated the determinants of behavioral intention toward the telehealth acceptance of elderly rural residents in Taiwan by integrating social capital, system self-efficacy, and the TAM. The results strongly support the proposed behavioral model and provide comprehensive understanding of the relationships among social capital (social trust, institutional trust, and social participation), system self-efficacy, technological factors (perceived ease of use and perceived usefulness), and behavioral intention to use this system. Based on the results of SEM, the hypotheses validate the fit of empirical data and the proposed model. The results show that nearly all of the relationships proposed in the model are supported. In addition, the model demonstrated excellent fit and is thus valuable for evaluating and predicting the behavioral intention toward adopting telehealth.
However, social trust affected perceived usefulness nonsignificantly. This unexpected finding can be attributed to the interpersonal trusting climate that may not directly affect the perception of usefulness of people. The effect of social trust on perceived usefulness may be mediated by social participation. Nahapiet and Ghoshal  argued that the relationships of users can strongly influence their willingness to share information in interactive environments, such as social networks or social participation. For example, through “weak ties” and “friends and friends,” network members can acquire privileged access to relevant health information and knowledge, which improves residents’ perception of usefulness toward telehealth systems. Similarly, system self-efficacy affected perceived usefulness nonsignificantly. Consistent with the results provided in Hasan , the effect of system self-efficacy on perceived usefulness was negative (β = −0.028). One possible explanation is that people exhibiting high system self-efficacy beliefs may be able to identify the limitations of telehealth systems that may not be immediately obvious to those exhibiting low efficacy beliefs .
The results of this study indicate that the elderly rural residents generally reported positive perceptions toward ease of use, usefulness, and intention to use the telehealth system. Moreover, perceived usefulness was the most significantly direct antecedent of behavioral intention. This result is consistent with that presented in Liu, Tsai, and Jang , who focused on the acceptance of patients toward a web-based personal health record system. Therefore, the empirical finding of the current study indicates that the elderly rural residents valued the benefits derived from the telehealth system. In addition, Davis, Bagozzi, and Warshaw  also found that users would adopt a new IT system if they perceived the system to be useful, even if they disliked it. In other words, how to provide elderly rural residents with independence, security, confidence, quality of life, and the ability to remain in their own homes is considerably crucial in developing telehealth systems . In addition, further investment is necessary to manage the infrastructure to support and sustain the use of such technologies to ensure their safety, security, and reliability .
The findings of this study also imply that social capital factors play a key role in perceived ease of use and perceived usefulness. Accordingly, some practices can increase social trust by encouraging interpersonal interactions of residents through, for example, religious communities, sports or dancing clubs, formal or informal meetings, and activities that facilitate the flow of affection within a community. In addition, to improve institutional trust, cultivating equality and a partnership in the doctor-patient relationship is crucial. Health service providers expressing their willingness to refer to and respect patients’ feelings, opinions, and self-knowledge is critical. Social participation encourages the attachment of people in public (i.e., community identity). Kwak, Shah, and Holbert  demonstrated that various forms of social associations may strongly contribute to the community participation of people. Developing social associations is essential, because people with stronger psychological ties to their communities are more active in telehealth usage.
In addition, the findings of this study suggest that system self-efficacy significantly affect ease of use perception. The training courses aimed at improving the system self-efficacy of end users could cause increased user acceptance . In introductory telehealth presentations or training programs, no requirement to possess any knowledge on the telehealth system must be emphasized . Thus, successfully deploying this innovation requires more than merely installing the equipment. The role of specialists and community nurses is vital, because the telehealth system is used to enhance health services for rural residents . Local service professionals and remote call centers should provide real-time support cooperatively to users when they encounter any obstacles during operating processes. These proactive design interventions may maximize the acceptance of rural residents to use the technology and promote its effective diffusion .
In this study, behavioral intention was used as dependent variable instead of actual usage behavior. Future studies that incorporate actual telehealth usage into the research model would enable a more comprehensive examination of the integrative model in explaining or predicting telehealth acceptance by residents.
This study integrated two sociopsychological theories, social capital theory and social cognitive theory, with a widely used IS technology acceptance model (i.e., the TAM) to provide a comprehensive behavioral model for understanding elderly rural residents’ intention toward using telehealth systems. The framework was extended from the original TAM by considering the relationships among social capital factors (social trust, institutional trust, and social participation), technological factors (perceived ease of use and perceived usefulness), social cognitive factors (system self-efficacy), and behavioral intention to use the system. The proposed model has been proven to be valuable for evaluating and predicting the behavioral intention of telehealth system because it provides an integrative perspective that prompts researchers and practitioners to pay attention to the interdependence of these aspects. The integrative psychosocial-technological viewpoint implies that hospital managers should consider these key factors simultaneously.
Recently, small sample sizes (typically less than 100) have limited the generalizability of most previous telemedicine/telecare/telehealth studies, causing barriers to knowledge development in the telemedicine/telecare/telehealth area . The large sample size of the current empirical study (365 respondents) can overcome methodological concerns of generalizability and provide valuable insights into the innovative technology development.
The delivery of health care is being transformed by advances in e-health and by an empowered, computer-literate public. However, interactive IS developed for both patients and physicians remain at the early stages of development . This study could be a useful foundation for exploring the implementation of telehealth systems in Taiwan. Future research could continue to explore other factors that influence decisions for adopting telehealth systems. We believe that the proposed integrated model will provide valuable and informative contributions to practitioners and scholars.
This research was supported by grants from Chu Shang Show Chwan Hospital in Taiwan. The author would like to thank the participants in the community for their help in collecting the data for this study. Also, the author would like to thank the reviewers for their constructive and useful suggestions for improving the quality of this paper.
Conflicts of Interest
The author declares no conflict of interest.
- Huang, J.C. Innovative health care delivery system—A questionnaire survey to evaluate the influence of behavioral factors on individuals’ acceptance of telecare. Comput. Biol. Med. 2013, 43, 281–286, doi:10.1016/j.compbiomed.2012.12.011.
- Güler, N.F.; Übeyli, E.D. Theory and applications of telemedicine. J. Med. Syst. 2002, 26, 199–220, doi:10.1023/A:1015010316958.
- Hendy, J.; Barlow, J. The adoption of telecare in the community. Community Pract. 2012, 85, 41–43. 23029778
- Moffatt, J.J.; Eley, D.S. The reported benefits of telehealth for rural Australians. Aust. Health Rev. 2010, 34, 276–281, doi:10.1071/AH09794.
- Young, L.B.; Foster, L.; Silander, A.; Wakefield, B.J. Home telehealth: Patient satisfaction, program functions, and challenges for the care coordinator. J. Gerontol. Nurs. 2011, 37, 38–46, doi:10.3928/00989134-20110706-02.
- Johnston, B.; Kidd, L.; Wengstrom, Y.; Kearney, N. An evaluation of the use of telehealth within palliative care settings across Scotland. Palliat. Med. 2011, 26, 152–161. 21378067
- Venkatesh, V.; Davis, F.D. A theoretical extension of the technology acceptance model: Four longitudinal field studies. Manag. Sci. 2000, 46, 186–204, doi:10.1287/mnsc.188.8.131.5226.
- Hasan, B. Examining the effects of computer self-efficacy and system complexity on technology acceptance. Inform. Resour. Manag. J. 2007, 20, 76–88, doi:10.4018/irmj.2007070106.
- Liu, C.F.; Tsai, Y.C.; Jang, F.L. Patients’ acceptance towards a web-based personal health record system: An empirical study in Taiwan. Int. J. Environ. Res. Publ. Health 2013, 10, 5191–5208, doi:10.3390/ijerph10105191.
- Rahimpour, M.; Lovell, N.H.; Celler, B.G.; McCormick, J. Patients’ perceptions of a home telecare system. Int. J. Med. Inform. 2008, 77, 486–498, doi:10.1016/j.ijmedinf.2007.10.006.
- Wade, R.; Cartwright, C.; Shaw, K. Factors relating to home telehealth acceptance and usage compliance. Risk Manag. Healthc. Pol. 2012, 5, 25–33, doi:10.2147/RMHP.S30204.
- Davis, F.D. User acceptance of information technology: System characteristics, user perceptions and behavioral impacts. Int. J. Man. Mach. Stud. 1993, 38, 475–487, doi:10.1006/imms.1993.1022.
- Putnam, R. Making Democracy Work—Civic Traditions in Modern Italy; Princeton University Press: Englewood Cliffs, NJ, USA, 1993.
- Kawachi, I.; Kennedy, B.P. Health and social cohesion: Why care about income inequality. Brit. Med. J. 1997, 314, 1037–1040, doi:10.1136/bmj.314.7086.1037.
- Bandura, A. Social Foundation of Thought and Action: A Social Cognitive Theory; Prentice-Hall: Englewood Cliffs, NJ, USA, 1986.
- Venkatesh, V.; Davis, F.D. A model of the antecedents of perceived ease of use: Development and test. Decis. Sci. J. 1996, 27, 451–481, doi:10.1111/j.1540-5915.1996.tb01822.x.
- Dewsbury, G. Defining Telecare? Available online: http://thetelecareblog.blogspot.tw/2009/02/defining-telecare.html (accessed on 5 May 2014).
- Lee, C.Y.; Huang, E.W.; Chiou, S.F.; Yang, R.J.; Chao, P.J.; Hung, R.S.; Lin, Y.T. Design and development of a new community healthcare management model by using telehealth service system. J. Taiwan Assoc. Med. Inform. 2009, 18, 39–53.
- Brownsell, S.; Blackburn, S.; Hawley, M.S. An evaluation of second and third generation telecare services in older people’s housing. J. Telemed. Telecare 2008, 14, 8–12, doi:10.1258/jtt.2007.070410.
- Miller, T.W.; Miller, J.M.; Kraus, R.F.; Kaak, O.; Sprang, R.; Veltkamp, L.J. Telehealth: A clinical application model for rural consultation. Consult. Psychol. J. Pract. Res. 2003, 55, 119–127, doi:10.1037/1061-4087.55.2.119.
- Ahn, T.; Ryu, S.; Han, I. The impact of web quality and playfulness on user acceptance of online retailing. Inform. Manage. 2007, 44, 263–275, doi:10.1016/j.im.2006.12.008.
- Davis, F.D.; Bagozzi, R.P.; Warshaw, P.R. User acceptance of computer technology: A comparison of two theoretical models. Manag. Sci. 1989, 35, 982–1002, doi:10.1287/mnsc.35.8.982.
- Or, C.; Karsh, B.T.; Severtson, D.J.; Burke, L.J.; Brown, R.L.; Brennan, P.F. Factors affecting home care patients’ acceptance of a web-based interactive self-management technology. J. Amer. Med. Inform. Assoc. 2011, 18, 51–59, doi:10.1136/jamia.2010.007336.
- DeLone, W.H.; McLean, E.R. The DeLone and McLean model of information systems success: A ten-year update. J. Manage. Inform. Syst. 2003, 19, 9–30.
- Mathieson, K. Predicting user intention: comparing the technology acceptance model with theory of planned behavior. Inform. Syst. Res. 1991, 2, 173–191, doi:10.1287/isre.2.3.173.
- Jackson, C.M.; Chow, S.; Leitch, R.A. Toward an understanding of the behavioral intention to use an information system. Decision Sci. 1997, 28, 357–389, doi:10.1111/j.1540-5915.1997.tb01315.x.
- Williams, M.D.; Slade, E.L.; Dwivedi, Y.K. Consumers’ intentions to use e-readers. J. Comput. Inform. Syst. 2014, 54, 66–76.
- Hu, P.J.; Chau, P.Y.K.; Liu Sheng, O.R.; Kar, Y.T. Examining the technology acceptance model using physician acceptance of telemedicine technology. J. Manage. Inform. Syst. 1999, 16, 91–112.
- Bourdieu, P. The Forms of Capital. In Handbook of Theory and Research for the Sociology of Education; Richardson, J.G., Ed.; Greenwood: New York, NY, USA, 1985.
- Coleman, J. Foundations of Social Theory; Harvard University Press: Cambridge, MA, USA, 1990.
- Woolcock, M. Social capital and economic development: Toward a theoretical synthesis and policy framework. Theor. Soc. 1998, 27, 151–208, doi:10.1023/A:1006884930135.
- Nahapiet, J.; Ghoshal, S. Social capital, intellectual capital, and the organizational advantage. Acad. Manage. Rev. 1998, 23, 242–266.
- Felício, J.A.; Couto, E.; Caiado, J. Human capital and social capital in entrepreneurs and managers of small and medium enterprises. J. Bus. Econ. Manage. 2012, 13, 395–420, doi:10.3846/16111699.2011.620139.
- Adler, P.S.; Kwon, S.W. Social capital: Prospects for a new concept. Acad. Manage. Rev. 2002, 27, 17–40.
- Kawachi, I.; Kennedy, B.P.; Glass, R. Social capital and self-rated health: A contextual analysis. Amer. J. Publ. Health 1999, 89, 1187–1193, doi:10.2105/AJPH.89.8.1187.
- Lindstrom, M.; Janzon, E. Social capital, institutional (vertical) trust and smoking: A study of daily smoking and smoking cessation among ever smokers. Scand. J. Public Health 2007, 35, 460–467, doi:10.1080/14034940701246090.
- Nummela, O.; Sulander, T.; Rahkonen, O.; Karisto, A.; Uutela, A. Social participation, trust, and self-rated health: A study among ageing people in urban, semi-urban and rural settings. Health Place 2008, 14, 243–253, doi:10.1016/j.healthplace.2007.06.006.
- Mohseni, M.; Lindstrom, M. Social capital, trust in the health-care system and self-rated health: The role of access to health care in a population-based study. Soc. Sci. Med. 2007, 64, 1373–1383, doi:10.1016/j.socscimed.2006.11.023.
- Russell, S. Treatment seeking behaviour in urban Sri Lanka: Trusting the state, trusting private doctors. Soc. Sci. Med. 2005, 61, 1396–1407, doi:10.1016/j.socscimed.2004.11.077.
- Cattell, V. Poor people, poor places, and poor health: The mediating role of social networks and social capital. Soc. Sci. Med. 2001, 52, 1501–1516, doi:10.1016/S0277-9536(00)00259-8.
- Wang, L.; Graddy, E. Social capital, volunteering, and charitable giving. Int. J. Volunt. Nonprofit Organ. 2008, 19, 23–42, doi:10.1007/s11266-008-9055-y.
- Reid, M. Integrating trust and computer self-efficacy with TAM: An empirical assessment of customers’ acceptance of banking information systems (BIS) in Jamaica. J. Inter. Bank. Commerce 2008, 12, 1–18.
- Gefen, D.; Karahanna, E.; Straub, D.W. Trust and TAM in online shopping: an integrated model. MIS Quart. 2003, 27, 51–90.
- Pavlou, P.A. Consumer acceptance of electronic commerce: Integrating trust and risk with the technology acceptance model. Int. J. Electron. Commerce 2003, 7, 101–134.
- Chow, W.S.; Chan, L.S. Social network, social trust and shared goals in organizational knowledge sharing. Inform. Manage. 2008, 45, 458–465, doi:10.1016/j.im.2008.06.007.
- Shu, Q.; Tu, Q.; Wang, K. The impact of computer self-efficacy and technology dependence on computer-related technostress: A social cognitive theory perspective. Int. J. Human-Computer Interact. 2011, 27, 923–939, doi:10.1080/10447318.2011.555313.
- Gist, M.E. Self-efficacy: Implications for organizational behavior and human resource management. Acad. Manage. Rev. 1987, 12, 472–485.
- Compeau, D.R.; Higgins, C.A. Computer self-efficacy: Development of a measure and initial test. MIS Quart. 1995, 19, 189–211, doi:10.2307/249688.
- Venkatesh, V. Determinants of perceived ease of use: Integrating control, intrinsic motivation, and emotion into the technology acceptance model. Inform. Syst. Res. 2000, 11, 342–365, doi:10.1287/isre.11.4.342.11872.
- Ong, C.S.; Lai, J.Y.; Wang, Y.S. Factors affecting engineers’ acceptance of asynchronous e-learning systems in high-tech companies. Inform. Manage. 2004, 41, 795–804, doi:10.1016/j.im.2003.08.012.
- Hung, S.Y.; Liang, T.P. Effect of computer self-efficacy on the use of executive support systems. Industrial Manage. Data Syst. 2001, 101, 227–237, doi:10.1108/02635570110394626.
- Davis, F.D. Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS Quart. 1989, 13, 319–340, doi:10.2307/249008.
- Bentler, P.M. Handbook of Multivariate Experimental Psychology; Plenum: New York, NY, USA, 1988.
- Anderson, J.C.; Gerbing, D.W. Structural equation modeling in practice: A review and recommended two-step approach. Psychol. Bull. 1988, 103, 411–423, doi:10.1037/0033-2909.103.3.411.
- Hair, J.F.; Anderson, R.E.; Tatham, R.L.; Black, W.C. Multivariate Data Analysis; Prentice-Hall: Englewood, NJ, USA, 1998.
- Nunnally, J.C. Psychometric Theory, 2nd ed. ed.; McGraw-Hill: New York, NY, USA, 1978.
- Fornell, C.; Larcker, D.F. Evaluating structural equation models with unobservable variables and measurement error. J. Market Res. 1981, 18, 39–50, doi:10.2307/3151312.
- Liu, I.F.; Chen, M.C.; Sun, Y.S.; Wible, D.; Kuo, C.H. Extending the TAM model to explore the factors that affect intention to use an online learning community. Comput. Educ. 2010, 54, 600–610, doi:10.1016/j.compedu.2009.09.009.
- Holbert, R.L.; Stephenson, M.T. The importance of indirect effects in media effects research: Testing for mediation in structural equation modeling. J. Broadcast. Electron. 2003, 4, 556–572, doi:10.1207/s15506878jobem4704_5.
- Chau, P.Y.K. Influence of computer attitude and self-efficacy on IT usage behavior. J. End-User Comput. 2001, 13, 1, 40–52.
- Kwak, N.; Shah, D.V.; Holbert, R.L. Connecting, trusting, and participating: The direct and interactive effects of social associations. Polit. Res. Quart. 2004, 57, 643–652, doi:10.1177/106591290405700412.
- Bakken, S.; Grullon-Frigueroa, L.; Izquierdo, R.; Lee, N.J.; Morin, P.; Palmas, W.; Teresi, J.; Weinstock, R.S.; Shea, S.; Starren, J. Development, validation, and use of English and Spanish versions of the telemedicine satisfaction and usefulness questionnaire. J. Amer. Med. Inform. Assoc. 2006, 13, 660–667, doi:10.1197/jamia.M2146.
© 2014 by the authors; licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution license (http://creativecommons.org/licenses/by/3.0/).