Next Article in Journal
Optimization of Polyaluminum Chloride-Chitosan Flocculant for Treating Pig Biogas Slurry Using the Box–Behnken Response Surface Method
Next Article in Special Issue
Effect of Patient Participation on Nurse and Patient Outcomes in Inpatient Healthcare
Previous Article in Journal
Perceived Needs of The Family Caregivers of People with Dementia in a Mediterranean Setting: A Qualitative Study
Previous Article in Special Issue
The Colonoscopy Satisfaction and Safety Questionnaire (CSSQP) for Colorectal Cancer Screening: A Development and Validation Study
 
 
Search for Articles:
Title / Keyword
Author / Affiliation / Email
Journal
Article Type
 
 
Advanced Search
 
Section
Special Issue
Volume
Issue
Number
Page
 
Journals
IJERPH
Volume 16
Issue 6
10.3390/ijerph16060994
ijerph-logo
Submit to this Journal Review for this Journal Propose a Special Issue
► Article Menu

Article Menu

share Share announcement Help format_quote Cite question_answer Discuss in SciProfiles thumb_up
...
Endorse textsms
...
Comment
first_page
settings
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

What Factors Affect Patient Satisfaction in Public Sector Hospitals: Evidence from an Emerging Economy

by
Abid Hussain
1,
Muhammad Safdar Sial
2,
Sardar Muhammad Usman
2,
Jinsoo Hwang
3,*,
Yushi Jiang
4,* and
Awaisra Shafiq
5
1
School of Public Affairs, Zijingang Campus, Zhejiang University, Hangzhou 310058, China
2
Department of Management Sciences, COMSATS University, Islamabad 44000, Pakistan
3
The College of Hospitality and Tourism Management, Sejong University, 98 Gunja-Dong, Gwanjin-Gu, Seoul 143-747, Korea
4
School of Economics and Management, Southwest Jiaotong University, Chengdu 610031, China
5
Economics department, Bagdad Campus, The Islamia University, Bahawalpur 63100, Pakistan
*
Authors to whom correspondence should be addressed.
Int. J. Environ. Res. Public Health 2019, 16(6), 994; https://doi.org/10.3390/ijerph16060994
Submission received: 14 February 2019 / Revised: 11 March 2019 / Accepted: 14 March 2019 / Published: 19 March 2019
(This article belongs to the Special Issue Patient Satisfaction with Health Services)
Browse Figure
Versions Notes

Abstract

:
Patient satisfaction can identify specific areas of improvement in public sector hospitals. However, the Pakistani healthcare system, and quality of service delivery is rarely assessed through the perspective of patient satisfaction. Our study demonstrated the performance of public healthcare systems in Pakistan by interacting with physical services (tangible and environmental), doctor–patient communication, and pharmacy and laboratory services based on patient satisfaction. Primary data were collected from the patients by using a random sampling method. Patients who participated in the study were visitors of public hospitals’ outpatient departments. A total of 554 questionnaires were circulated, and 445 were received. The confirmatory factor and multiple regression analyses were employed to analyze the collected data. The results revealed that laboratory, as well pharmacy services, had positive significant effects (p = 0.000) on patient satisfaction, while doctor–patient communication (p = 0.189) and physical facilities (p = 0.85) had an insignificant relationship with patient satisfaction. Therefore, it is suggested that a significant communication gap exists in the doctor–patient setting, and that Pakistan’s healthcare system is deprived of physical facilities. Consequently, such services need further improvements.

1. Introduction

Developing nations are making every effort to entitle their citizens to receive fundamental healthcare because of limited consumer resources [1]. Public hospitals play an essential role in providing health facilities or services for citizens who seek fundamental medical service, while the outpatient department (OPD) role is very effective [2]. A world without basic health facilities would be a world of despair and suffering. Hypothetically speaking, if the world had a fundamental healthcare system that was universally recognized as providing low quality, that would only incur greater misery and suffering. In this hypothetical system, the cost of healthcare would further burden and intensify, increasing patient concern and worry. A healthcare unit is useless if it is inadequate to decrease patients’ distress. The healthcare sector of any country is a vital pillar for its overall progress, because it also influences all the other sectors, such as medical, moral, political, social, and business. Moreover, it has a number of economic implications [3].
Healthcare is one of the major sustainable development goals (SDGs) of agenda 2030 of the United Nations Organization (UNO), which states that: “ensure healthy lives and promote well-being for all at all ages”, as well as its target to achieve universal health coverage, affordable medicine, accessibility, effective and safe quality, and access to quality essential healthcare for everyone [4]. Even if you are wealthy, every aspect of life if is nullified without good health. The developed world is steadily building their health sectors by making revenue for their national economy by encouraging health tourism. Contrarily, the policy makers of developing countries, such as Pakistan, are helping the health sector of developed countries by seeking their services frequently at the expense of taxes being paid by their own citizens [5], instead of forming their own healthcare system.
In emerging nations like Pakistan, healthcare problems receive more attention from researchers than from policy makers [5], which is a matter of grave concern in Pakistan, because the current average cost of healthcare for the people of Pakistan is 66.5%, far greater than the world average of 18.147% [6]. It is a regrettable situation that the number of dissatisfied patients receiving healthcare in Pakistan’s public hospitals has continuously increased [7,8]. Moreover, a large number of Pakistani citizens are in despair believing that the country’s healthcare sector is severely damaged by corruption [9].
In accordance with these factual figures, it has become increasingly necessary to revise and assess the performance of feebly performing, less developed countries and to counterbalance their performance with that of their counterparts in the developed world. This is of the utmost importance, being a matter of life or death to the citizens of such countries. Javed and Ilyas [5] stated that “despite this despondent situation of healthcare in Pakistan, where quality initiatives are relatively more visible in the manufacturing, education and agriculture sectors than in the healthcare sector, not many scientific studies have been done in this context.” In light of present situation, the perceived performance of public hospitals in Pakistan has been assessed by measuring the satisfaction of Pakistani patients from the public sector. To achieve this, we took into account their opinion concerning four areas of healthcare services; these include: Physical services (tangible and environmental), doctor–patient communication, pharmacy services, and laboratory services. Our study assessed patient satisfaction of those using OPD services in Pakistani hospitals. There is currently a significant gap in the existing literature regarding the evaluation of patient satisfaction with respect to doctor-patient communication, physical facilities, laboratory services and pharmacy services aspects. The current study is specifically useful for assessment of the Pakistani healthcare system, which is commonly associated with the lack of patient satisfaction and quality of service delivery.
Pakistan has a mixed health system that includes: Public, parastatal, private, civil society, philanthropic contributors, and donor agencies. In Pakistan, healthcare delivery to the public is systematized through four modes of preventive, promotive, curative, and rehabilitative services [10]. According to the constitution of Pakistan, it is the responsibility of the state to provide fundamental health facilities to its citizens without any cost. However, after the implementation of the 18th amendment in the constitution of Pakistan, this duty was shifted from the central government to the provincial governments, who are assumed to devise provincial healthcare policies that affect around 200 million individuals in Pakistan [11]. The public healthcare system of Pakistan is summarized in Figure 1. Central and state governments have their own independent public healthcare setups [12].

2. Literature Review

2.1. Patient Satisfaction

The notion of patient satisfaction can be evaluated as a multi-faceted approach that mirrors the patient’s experiences when looking for healthcare [13]. When correctly assessed alongside the results and the conformity of treatment, patient satisfaction can be an important tool when assessing the quality and outcome of a particular healthcare setup [14].
Patient satisfaction is a crucial phenomenon that recognizes the patients’ needs so as to improve healthcare systems. A patient that reports satisfaction with their own healthcare is more likely to report better health. Patient responses to healthcare services are one way to obtain information about patient views regarding the perceived quality of healthcare, and to establish robust patient engagement [15]. Patients who report higher satisfaction are more likely to benefit from their treatment [16]. Several scholars have used these factors, which include: Pharmacy services, physical services (tangible, environment), doctor–patient communication, and laboratory services to access the sustainability of healthcare services with a concern for patient satisfaction [17,18,19,20].

2.2. Physical Facilities

Physical facilities measure the patient’s perception about the quality of service in regard to the hospital’s physical services. This measure includes: The cleanliness and maintenance of the facility, the availability of physical facility, such as resident rooms, technological capability, diagnostic test rooms, blood banks, wards, beds, ambulance services, waiting rooms, and operation theatres. Several studies have already attempted to ascertain the influence of the physical services in quality delivery [21,22,23].
Forming a pleasant environment that strongly facilitates the patients to make a full recovery. It is very important that the appropriate healthcare staff must work to improve the physical environment of the hospital, such environment will immensely be helpful for the patients to recovery on time and enjoy a healthy life. [20,24].
Hypotheses 1 (H1).
There is a significant and positive relationship between physical facilities and patient satisfaction.

2.3. Doctor–Patient Relationship

The doctor–patient relationship is important because patients normally ascertain their general perception about healthcare service and its potential outcomes [25,26]. In-order to assess the healthcare services by the patients they must develop a good and friendly relationship with the doctor by using a better level of communication [27]. A satisfactory relationship between doctor and patient is important to ensure that the patient adheres to the medical guidance they have received, which ultimately improves treatment efficacy and reduces transaction expenses [28,29]. This interaction may also boost the patient’s trust and willingness to use such medical facilities at a later date. This repeat usage can also heighten the reputation of the hospital [30,31].
Some studies have also shown that the level of patient health has a direct impact on their level of satisfaction [32,33], with patients in need of more in-depth medical attention, having a stronger impression of the quality of the doctor’s service, alongside their own overall satisfaction. Mekoth, et al. [34] demonstrated that good examination and communication skills of a doctor during outpatient facilities could influence patient views or satisfaction. Yi-ren and Peng-de [35] asserted that five productive underlying aspects included: Hospital staff competency and techniques, their medical effectiveness, the environment they create and the support they offer, the overall attitude and service proceedings. The United Nations organization has recently established sustainability development goals (SDGs) that focus on the importance of a better delivery of service by service providers [4].
Hypotheses 2 (H2).
There is a significant and positive relationship between doctor–patient communication (relationship), and patient satisfaction.

2.4. Laboratory Services

The key recipient of public healthcare is the patient. As a client of healthcare, the patient is the main focal point of the healthcare delivery system [36]. A patient’s viewpoint regarding the medical care system appears to have been mainly overlooked by the healthcare administrators in less developed countries [37].
Patient satisfaction consists of several elements, for example the quality of clinical facilities provided, pharmacy services, the accessibility of medication, the quality of communication (the attitude of doctors and paramedical employees), institutional infrastructure, physical ease, emotional backing, and respect for client preferences. Disparity among patient anticipation and the healthcare facilities obtained relates to a decline in levels of satisfaction [38]. As a result, assessing patient viewpoints offers them a voice, which can make personal and government owned healthcare services more responsive to the needs of patients [39]. Therefore, efficient laboratory services, that deliver services within a timely fashion, is essential both from a medical and business viewpoint, as well as its impact on patient satisfaction [19].
Hypotheses 3 (H3).
There is a significant and positive relationship between laboratory services and patient satisfaction.

2.5. Pharmacy Services

The development of new and innovative technological methods and the increased need for specialized healthcare services have brought about a distinct transformation in pharmacy services [40,41,42]. In 2011, the International Pharmaceutical Federation (FIP) and the World Health Organization (WHO) jointly recommended good pharmacy practice guidelines [43]. Consequently, pharmacists have been increasingly involved in marketing their services with a focus on patient satisfaction. Furthermore, pharmacists have been persuaded to become mutually accountable for healthcare consequences and the enhancement of the patient’s quality of life [17,44,45].
However, the clinical training of pharmacists is not advanced, and the activities that represent the usual practice of pharmacists are still executed, in most cases, without direct interaction with the patient [46,47]. Yet, the education of Pakistani pharmacists has endured principal changes in recent years with respect to a professional focus on learning clinical skills. Descriptions of these skills, and the necessary changes that need to be made to the curriculum guidelines of Pakistani institutions are currently being discussed [48].
Pharmacy staff are in a position to clearly define how the patient should use the medication they have been prescribed. Several studies have indicated that these factors are associated with patient satisfaction [48,49,50]. The pharmacy is an important physical service within a hospital, where patients get information about medication [50].
Hypotheses 4 (H4).
There is a significant and positive relationship between pharmacy services and patient satisfaction.

3. Methodology

3.1. Study Setting

Punjab province is the most populous province in Pakistan. It consists of 9 divisions. Bahawalpur division is an administrative division of the Punjab province. It is the largest division of Punjab province and consists of three districts, Bahawalpur, Bahawalnagar, and Rahim yar khan. It consists of 45,588 (km2) and its total population is 11,464031. The Punjab has 23 tertiary hospitals and Bahawalpur division has 2 tertiary care hospitals; one is Qaid e Azam Medical College (QAMC), Bahawalpur, that consists of 1600 beds and its affiliated hospital consist of 400 beds; the second hospital is Sheikh Zayed Medical College (SZMC), Rahim Yar khan, that consists of 841 beds, as well as Bahawalnagar has one district hospital [51]. The population of Punjab province and the study area used in this research is exhibited in Table 1. The hospitals used in this study are shown in Table 2.

3.2. The Sample

The primary data were collected from the Southern Punjab hospitals by using a random sampling method from June to July 2018. The sample size was 554, as recommended by Saunders [52]. This sample size is justified by the fact that it is in accordance with the size of the population. The questionnaire was divided into two portions. The first portion dealt with demographic characteristics, and the second part measured the quality of services delivery, which included the pharmacy services, the laboratory services, doctor–patient communication, and physical facilities. 445 questionnaires were selected for analysis. The remaining questionnaires were not used for analysis due to unfilled and/or inconsistent answers.

3.3. Data Collection and Instruments

The questionnaire for the present research contained 4 factors. The measurement for patient satisfaction consisted of 9 items [53]. The sample item was “The medical care, I have been receiving is just about perfect” and Alpha reliability for this scale was 0.966. Pharmacy services included 8 items [54], and the sample question was “The pharmacist is good at explaining things in a way that I understand.” with Alpha reliability of 0.931. Laboratory services had 6 items [54] with a sample item of “I received the test results in time” and Alpha reliability of 0.927. Physical facilities included 5 items, and doctor–patient communication consisted of 4 items [55]. Sample items for physical facilities and doctor–patient communication were “There was a pleasant atmosphere in the ward” and “The doctors were willing to answer any questions”, respectively. The Alpha reliabilities for these two scales were 0.968 and 0.942, respectively. Patient demographic characteristics included in this study consisted of: Marital status, age, education, occupation, and family income, which are shown in Table 3. The instruments that we used to assess service features from the patients’ perspective were recorded on a five-point Likert’s scale. Following the guidelines from Brislin [56], the questionnaire was translated into Urdu and then translated into English after it was completed. This process was conducted to check for consistency. The questionnaires from illiterate patients were filled out with the assistance of a researcher.

4. Results

4.1. Sociodemographic Characteristics

The number of males was 44.7%, and the number of females was 55.3%. Overall, 30.8% of respondents were aged 40 to 49, whereas 8.1% were younger than 20 years. In regard to marital status, 54.6% were married and 42.3% were single, while 2.7% were not living with their partner/ husband. Overall, 0.4% was widowed participants. In regard to education and income, about 32.6% had an elementary school level of education, and 27.6% belonged to the category receiving a monthly income of less than 10,000 PKR, while 8.3% received more than 30,000 PKR. In regard to profession, 26.2% were housewives, and 1.6% was students (see Table 3).

4.2. Statistical Analysis and Data Interpretation

The data were analyzed using SPSS and AMOS version 24.0. A consistency analysis was performed to assess the reliability of individual variables. Reliability refers to the instrument’s ability to provide consistent results in recurring uses [57]. The Cronbach alpha coefficient has been widely used as a measure for reliability [58]. The results revealed that all variables’ reliabilities (α) exceeded the acceptable threshold value of 0.70 (patient satisfaction = 0.96, laboratory services = 0.92, pharmacy services = 0.93, doctor–patient communication = 0.94, and physical services = 0.96) as suggested by [59,60]. Furthermore, almost all the variables were correlated and statistically significant. See Table 4 for a summary of the descriptive statistics and the zero order correlations and alpha coefficients.
Furthermore, internal consistency was also tested by measuring composite reliability, discriminant validity, and convergent validity for each factor to support more authenticity for the data and the model (see Table 5). Composite reliability (CR) for each factor ranged from 0.781 to 0.923, which exceeded the cutoff criteria (CR > 0.7) [61], while the values of the average variance extracted (hereafter AVE) for each loaded construct ranged from 0.543 to 0.744. This showed convergent validity, because it was shown to be greater than 0.50, which is often used as a threshold [62]. To measure discriminant validity, each value of the square root of the AVE was greater than all the inter factor correlations, as recommended by Shaffer, et al. [63]. All items used in this study had a significant level of (p < 0.001).
Based on the exploratory factor analysis (EFA) of the patients’ overall satisfaction, we conducted a confirmatory factor analysis (CFA), and the model fit indices are shown in Table 6. The values of the standardized root mean square residual (SRMR) = 0.042, the normed fit index (NFI) = 0.959, the root mean square error of approximation (RMSEA) = 0.045, the comparative fit index (CFI) = 0.980, the relative fit index (RFI) = 0.951, the incremental fit index (IFI) = 0.980, and the Tucker-Lewis index (TLI) = 0.976. All these values are above, or at, recommended standards [61,64,65,66].

4.3. Confirmatory Factor Analysis (CFA)

The confirmatory factor analysis (CFA) confirmed the relationship among the observed variables and their underlying latent variables. It was used to assess the loadings of items on a particular factor. The values of the factor loadings, while conducting the confirmatory factor analysis, are given in Table 7. The statistical values of the confirmatory factor analysis all met the criteria standards for the adequacy of fit. The values of factor loadings showed the strength of relation of the factors with their respective constructs. The maximum value for factor loading is 1. The highest factor loading value in this model was 0.925, and the lowest value was 0.709. All the values of factor loading confirmed the validation of the construct validity, which was measured by inspecting the loadings of the items and their reliability.

4.4. Hypothesis Testing Using a Multiple Regression Analysis

Table 8 shows the multiple regression analysis that determined all predictors of overall patient satisfaction in public sector hospitals. According to the results, 37.2% (Adjusted R2 = 0.367, F = 74.33, and p = 0.0001) of the variance in the outcome variable (patient satisfaction) was described by the four independent variables, which included pharmacy services, laboratory services, doctor–patient communication, and physical facilities.
To test multi-collinearity, the range of tolerance values was between 0.766 and 0.900 (a value closer to zero indicates a collinearity issue), while the range of the variance inflation factor (VIF) was between 1.238 and1.511 (a value greater than three indicates a problem with collinearity), which showed that multi-collinearity did not exist in the data. The values shown in Table 8 demonstrate that two out of four variables were significant and affected patient satisfaction positively, while the values of two variables were insignificant. Moreover, pharmacy services β = 0.287; t = 9.591and p < 0.05) showed that one unit increased by 0.232 units in patient satisfaction. Laboratory services (β = 0.331, t = 7.713, and p < 0.05) revealed that one-unit increase in laboratory services resulted in a 0.256 unit increase in patient satisfaction. Doctor–patient communication (β = 0.055, t = 1.136, and p > 0.05) and physical facilities (β = 0.076, t = 1.727, and p > 0.05) were insignificant in this study. The most significant and effecting predictor was laboratory services. Based on these results, H1 and H2 were supported, but H3 and H4 were not supported.

5. Discussion and Implications

This research was carried out to examine the service delivery of OPDs in southern Punjab hospitals, Pakistan, from the patients’ perspective. The present study sought to investigate how pharmacy services, laboratory services, doctor–patient communication, and physical facilities measured patient satisfaction alongside the quality of the hospital service. Our results confirmed that patient satisfaction was highly dependent on pharmacy services. such results are similar to those concluded from India, that pharmacy services have a significant impact on patient satisfaction [67]. In a Pakistani context, the pharmacy staff are usually less qualified, a general lack of professionalism, a lack of knowledge regarding the rules and responsibilities of pharmacists and the execution of their duties are the key factors which impacted negatively on the quality of pharmacy services offered by public hospitals [48]. These issues negatively impact on patient satisfaction. The information that pharmacists provide to patients is insufficient, which leads to a deficient interaction between the dispenser and the patient [68]. It is for this reason that patients are highly concerned with finding a good private pharmacy service, rather than using a pharmacy service provided by public hospitals [67].
For many years, technology has been used in healthcare practices, including in laboratory investigations or as a method to create new diagnostic tools, such as stethoscopes [69]. As laboratory services are highly associated with patient satisfaction, the appropriate medical technology should be used as an aid for medical consultations. The use of technology facilitates a healthy consultation, but still patients are expecting in-depth laboratory investigations, which is consider as a central segment of the healthcare [70]. Regarding to the laboratories used in public hospital services in Pakistan, patients face problems, such as non-hygienic environments, late and fake results, uncompetitive staff, and a significant communication gap [7]. It is for these reasons that laboratory services directly impact on patient satisfaction. The prevalent issue is also highlighted and discussed in other part of the world such as Africa [71].
The present study fills the current gap in the literature by evaluating patient satisfaction in regard to pharmacy services, laboratory services, doctor–patient communication, and physical facilities. Doctor–patient communication and physical facilities did not have a significant impact on patient satisfaction in Pakistan. The physical facilities in OPD had a very small impact on satisfaction, which is proved from previous findings in India [72], South Korea [73], and Iran [74] where physical facilities had no significant relation with patient satisfaction.
For the sake of sustainability in the healthcare sector, governments should take serious steps to solve the issues in the healthcare sector, such as the creation of transparent policies, the provision of increased funding for physical infrastructure, and the involvement of all stakeholders in decision making. The healthcare administration should collaborate with the Provincial Health Department to digitize hospital records to decrease congestion and delays in laboratory services. Our findings will act as an important cue for healthcare administrators who could then be able to continuously maintain clean and attractive environments in hospital premises to retain the loyalty of patients. In order to maintain a better environment, vivid policy structures need to be created by the Government for uplifting the maintenance levels of their respective institutions.
Our findings highlighted that hospital management teams need to focus on a timely delivery of services, proper communication, and the employment of staff that willingly care for patients. As the population increases, the level of patient dissatisfaction also increases. In order to cope this issue, the numbers of doctors and pharmacy staff working in hospitals should be increased. The physical environment plays an important role in patients’ perceived satisfaction. Therefore, hospital administrators should improve facilities, such as the availability of clean drinking water, and hygienic conditions in wash rooms and sitting areas. The results from this study are associated with quality features provided by WHO 2006 framework, which recommends that health services should be sustainable.
These findings are helpful for healthcare organizations to improve their service delivery. Healthcare organizations should adopt a redesigned service delivery procedure by giving it a patient-centric orientation. This strategy may result in better patient care and higher returns of trust for the organizations. We expect that this study will play a significant role in the literature of the healthcare sector. Scholars will get benefit from these findings and, we hope, will conduct similar research involving more parameters to improve Pakistan’s healthcare system.

6. Limitations and Future Research

There are some limitations to this study. One limitation is that this study was carried out in only the southern Punjab province of Pakistan. Another limitation is that this study used random sampling methods that involved a circumscribed number of patients. In future, research endeavors may be conducted by increasing the sample size and by using additional sampling methodologies to gain a deeper insight into the factors that affect patient satisfaction with the services provided in hospitals. Furthermore, attempts can be made by researchers to explore more critical factors, including a disease-wise investigation, which can add further understanding about the elements that influence patient satisfaction at the tertiary level of health problems.

Author Contributions

A.H. contributed to the literature review, the conceptualization and writing of the original article, and prepared the first draft. All the authors contributed equally to the research design and revised and approved the final manuscript.

Funding

This project is supported by the National Natural Science Foundation of China (715721156), Sichuan Wine Development Research Center (CJZB18-02), Sichuan Cycle Economy Research Center (XHJJ-1815).

Acknowledgments

A.H. wishes to convey special gratitude and thanks to his academic supervisor Yu Jianxing (Dean, School of Public Affairs, Zhejiang University, Hangzhou, China,) for his constant guidance and support. He has given me the freedom to pursue my research. A.H. would like to say a very big thanks to Syed Mussawar Hussain Bukhari (Head, Department Political Science, The Islamia University of Bahawalpur, Pakistan) for always providing his valuable guidance, credible ideas and encouragement. A.H. would also like to pay thanks to Noman Sahito (Department of City and Regional Planning, Mehran University of Engineering and Technology Jamshoro, Pakistan) for his help.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Mossialos, E.; Wenzl, M.; Osborn, R.; Sarnak, D. 2015 International Profiles of Health Care Systems; The Commonwealth Fund: New York, NY, USA, 2016. [Google Scholar]
  2. Duan, G.; Qiu, L.; Yu, W.; Hu, H. Outpatient service quality and doctor-patient relationship: A study in Chinese public hospital. Int. J. Serv. Econ. Manag. 2014, 6, 97–111. [Google Scholar] [CrossRef]
  3. Bahadori, M.; Teymourzadeh, E.; Faizy Bagejan, F.; Ravangard, R.; Raadabadi, M.; Hosseini, S.M. Factors affecting the effectiveness of quality control circles in a hospital using a combination of fuzzy VIKOR and Grey Relational Analysis. Proc. Singap. Healthc. 2018, 27, 180–186. [Google Scholar] [CrossRef]
  4. WHO. The Sustainable Development Goals; WHO: Geneva, Switzerland, 2015. [Google Scholar]
  5. Javed, S.A.; Ilyas, F. Service Quality and Satisfaction in Healthcare Sector of Pakistan–The Patients’ Expectations. Int. J. Health Care Qual. Assur. 2018, 31, 489–501. [Google Scholar] [CrossRef] [PubMed]
  6. Bank, W. Out-of-Pocket Expenditure (% of Current Health Expenditure). Available online: https://data.worldbank.org/indicator/SH.XPD.OOPC.CH.ZS (accessed on 26 December 2018).
  7. Irfan, S.; Ijaz, A. Comparison of service quality between private and public hospitals: Empirical evidences from Pakistan. J. Qual. Technol. Manag. 2011, 7, 1–22. [Google Scholar]
  8. Shabbir, A.; Malik, S.A.; Malik, S.A. Measuring patients’ healthcare service quality perceptions, satisfaction, and loyalty in public and private sector hospitals in Pakistan. Int. J. Qual. Reliab. Manag. 2016, 33, 538–557. [Google Scholar] [CrossRef]
  9. Gadit, A.A.M. Opinion and Debate-Corruption in medical practice: How far have we gone? JPMA-J. Pak. Med Assoc. 2011, 61, 93. [Google Scholar]
  10. Kumar, S.; Bano, S. Comparison and Analysis of Health Care Delivery Systems: Pakistan versus Bangladesh. J. Hosp. Med. Manag. 2017, 3, 1–7. [Google Scholar] [CrossRef]
  11. Shafiq, M.; Naeem, M.A.; Munawar, Z.; Fatima, I. Service Quality Assessment of Hospitals in Asian Context: An Empirical Evidence From Pakistan. INQUIRY J. Health Care Organ. Provis. Financ. 2017, 54, 0046958017714664. [Google Scholar] [CrossRef] [PubMed]
  12. Javed, S.A.; Liu, S. Evaluation of outpatient satisfaction and service quality of Pakistani healthcare projects: Application of a novel synthetic grey incidence analysis model. Grey Syst. Theory Appl. 2018, 8, 462–480. [Google Scholar] [CrossRef]
  13. Algudairi, G.; Al-Eisa, E.S.; Alghadir, A.H.; Iqbal, Z.A. Patient satisfaction with outpatient physical therapy in Saudi Arabia. BMC Health Serv. Res. 2018, 18, 888. [Google Scholar] [CrossRef]
  14. Devreux, I.C.; Jacquerye, A.; Kittel, F.; Elsayed, E.; Al-Awa, B. Benchmarking of patient satisfaction with physical rehabilitation services in various hospitals of Jeddah. Life Sci. J. 2012, 9, 73–78. [Google Scholar]
  15. Kamimura, A.; Ashby, J.; Myers, K.; Nourian, M.M.; Christensen, N. Satisfaction with healthcare services among free clinic patients. J. Community Health 2015, 40, 62–72. [Google Scholar] [CrossRef]
  16. Aljuaid, M.; Mannan, F.; Chaudhry, Z.; Rawaf, S.; Majeed, A. Quality of care in university hospitals in Saudi Arabia: a systematic review. BMJ Open 2016, 6, e008988. [Google Scholar] [CrossRef] [Green Version]
  17. Cheng, Y.; Raisch, D.W.; Borrego, M.E.; Gupchup, G.V. Economic, clinical, and humanistic outcomes (ECHOs) of pharmaceutical care services for minority patients: A literature review. Res. Soc. Adm. Pharm. 2013, 9, 311–329. [Google Scholar] [CrossRef]
  18. Jalil, A.; Zakar, R.; Zakar, M.Z.; Fischer, F. Patient satisfaction with doctor-patient interactions: a mixed methods study among diabetes mellitus patients in Pakistan. BMC Health Serv. Res. 2017, 17, 155. [Google Scholar] [CrossRef]
  19. Wankar, A.D. Study of determination of laboratory turnaround time in tertiary care hospital in India. Int. J. Res. Med Sci. 2017, 2, 1396–1401. [Google Scholar] [CrossRef]
  20. Anna, S. How the Physical Environment of a Hospital Affects Patient Health. Available online: https://today.mims.com/how-the-physical-environment-of-a-hospital-affects-patient-health (accessed on 21 December 2018).
  21. Ko, H.H.; Zhang, H.; Telford, J.J.; Enns, R. Factors influencing patient satisfaction when undergoing endoscopic procedures. Gastrointest. Endosc. 2009, 69, 883–891, quiz 891 e881. [Google Scholar] [CrossRef] [PubMed]
  22. Pilpel, D. Hospitalized patients’ satisfaction with caregivers’ conduct and physical surroundings. J. Gen. Intern. Med. 1996, 11, 312–314. [Google Scholar] [CrossRef] [PubMed]
  23. Aiken, L.H.; Clarke, S.P.; Sloane, D.M.; Lake, E.T.; Cheney, T. Effects of hospital care environment on patient mortality and nurse outcomes. J. Nurs. Adm. 2008, 38, 223. [Google Scholar] [CrossRef]
  24. Dijkstra, K.; Pieterse, M.; Pruyn, A. Physical environmental stimuli that turn healthcare facilities into healing environments through psychologically mediated effects: systematic review. J. Adv. Nurs. 2006, 56, 166–181. [Google Scholar] [CrossRef] [PubMed]
  25. Szasz, T.S.; Hollender, M.H. A contribution to the philosophy of medicine: the basic models of the doctor-patient relationship. AMA Arch. Intern. Med. 1956, 97, 585–592. [Google Scholar] [CrossRef] [PubMed]
  26. He, Z.; Zhou, J. Can zero-markup policy for drug sales in public hospitals resolve the problem of ‘seeing a doctor is too expensive’in China? A case study of four municipal general tertiary hospitals at H City in Z Province. J. Chin. Gov. 2017, 2, 329–342. [Google Scholar] [CrossRef]
  27. Takahashi, N.; Kobayashi, H.; Nakamura, T.; Maruo, Y.; Iwanaga, S.; Yamamoto, T.; Fujisaki, S.; Saitou, H.; Okita, T.; Fukunaga, H. Importance of clerical staff in the hospital administration: The serial change of clerical staff number in a national hospital after incorporating administrative agency shift. IRYO-Jpn. J. Natl. Med Serv. 2017, 71, 119–125. [Google Scholar]
  28. Mohr, J.; Spekman, R. Characteristics of partnership success: partnership attributes, communication behavior, and conflict resolution techniques. Strateg. Manag. J. 1994, 15, 135–152. [Google Scholar] [CrossRef]
  29. Waters, S.; Edmondston, S.J.; Yates, P.J.; Gucciardi, D.F. Identification of factors influencing patient satisfaction with orthopaedic outpatient clinic consultation: A qualitative study. Man. Ther. 2016, 25, 48–55. [Google Scholar] [CrossRef] [PubMed]
  30. Stewart, M.A. Effective physician-patient communication and health outcomes: A review. CMAJ Can. Med Assoc. J. 1995, 152, 1423. [Google Scholar]
  31. Ting, X.; Yong, B.; Yin, L.; Mi, T. Patient perception and the barriers to practicing patient-centered communication: A survey and in-depth interview of Chinese patients and physicians. Patient Educ. Couns. 2016, 99, 364–369. [Google Scholar] [CrossRef]
  32. Otani, K.; Waterman, B.; Faulkner, K.M.; Boslaugh, S.; Dunagan, W.C. How patient reactions to hospital care attributes affect the evaluation of overall quality of care, willingness to recommend, and willingness to return. J. Healthc. Manag. 2010, 55, 25–38. [Google Scholar] [CrossRef]
  33. Gu, E.; Page-Jarrett, I. The top-level design of social health insurance reforms in China: Towards universal coverage, improved benefit design, and smart payment methods. J. Chin. Gov. 2018, 3, 331–350. [Google Scholar] [CrossRef]
  34. Mekoth, N.; George, B.P.; Dalvi, V.; Rajanala, N.; Nizomadinov, K. Service quality in the public sector hospitals: a study in India. Hosp. Top. 2012, 90, 16–22. [Google Scholar] [CrossRef]
  35. Yi-ren, D.; Peng-de, T. A Statistic Analysis on the Factors of Influencing Patient Satisfaction. Appl. Stat. Manag. 2005, 1, 021. [Google Scholar]
  36. Spreng, R.A.; MacKenzie, S.B.; Olshavsky, R.W. A reexamination of the determinants of consumer satisfaction. J. Mark. 1996, 60, 15–32. [Google Scholar] [CrossRef]
  37. Jenkinson, C.; Coulter, A.; Bruster, S.; Richards, N.; Chandola, T. Patients’ experiences and satisfaction with health care: results of a questionnaire study of specific aspects of care. Qual Saf Health Care 2002, 11, 335–339. [Google Scholar] [CrossRef] [PubMed]
  38. McKinley, R.; Roberts, C. Patient satisfaction with out of hours primary medical care. BMJ Qual. Saf. 2001, 10, 23–28. [Google Scholar] [CrossRef] [Green Version]
  39. WHO. The World Health Report 2000: Health Systems: Improving Performance; World Health Organization: Geneva, Switzerland, 2000. [Google Scholar]
  40. Young, M.D.; Stilling, W.J.; Munger, M.A. Pharmacy practice acts: a decade of progress. Ann. Pharmacother. 1999, 33, 920–926. [Google Scholar] [CrossRef] [PubMed]
  41. Toklu, H.Z.; Hussain, A. The changing face of pharmacy practice and the need for a new model of pharmacy education. J. Young Pharm. 2013, 5, 38–40. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  42. Dosea, A.S.; Brito, G.C.; Santos, L.M.; Marques, T.C.; Balisa-Rocha, B.; Pimentel, D.; Bueno, D.; Lyra, D.P., Jr. Establishment, implementation, and consolidation of clinical pharmacy services in community pharmacies: perceptions of a group of pharmacists. Qual. Health Res. 2017, 27, 363–373. [Google Scholar] [CrossRef] [PubMed]
  43. WHO. Joint FIP/WHO Guidelines on Good Pharmacy Practice: Standards for Quality of Pharmacy Services. Geneva 2011; Report: 2011; WHO: Geneva, Switzerland, 2011. [Google Scholar]
  44. Hepler, C.D.; Strand, L.M. Opportunities and responsibilities in pharmaceutical care. Am. J. Health-Syst. Pharm. 1990, 47, 533–543. [Google Scholar] [CrossRef]
  45. Ramalho de Oliveira, D.; Brummel, A.R.; Miller, D.B. Medication therapy management: 10 years of experience in a large integrated health care system. J. Manag. Care Pharm. 2010, 16, 185–195. [Google Scholar] [CrossRef]
  46. Hashmi, F.K.; Hassali, M.A.; Saleem, F.; Babar, Z.U.D.; Ahmad, A.; Khan, M.U. A qualitative study exploring perceptions of policymakers about community pharmacy practice and extended pharmacy services in Lahore, Pakistan. J. Pharm. Health Serv. Res. 2018, 9, 71–73. [Google Scholar] [CrossRef]
  47. Ibrahim, M.I.M. Assessment of Medication Dispensing and Extended Community Pharmacy Services. In Social and Administrative Aspects of Pharmacy in Low-and Middle-Income Countries; Elsevier: Amsterdam, The Netherlands, 2018; pp. 295–309. [Google Scholar]
  48. Aziz, M.M.; Fang, Y.; Usman, M. Hospital pharmacy services in Pakistan. Eur. J. Hosp. Pharm. 2017, 24, 253. [Google Scholar] [CrossRef]
  49. Khan, T. Challenges to pharmacy and pharmacy practice in Pakistan. Australas. Med J. 2011, 4, 230. [Google Scholar] [CrossRef]
  50. Aslam, N.; Bushra, R.; Khan, M.U. Community pharmacy practice in Pakistan. Arch. Pharm. Pract. 2012, 3, 297–303. [Google Scholar]
  51. Punjab, B.o.S. Bureau of Statistics: Planning & Development Department Government of the Punjab; Bureau of Statistics Punjab: Lahore, Pakistan, 2018; pp. 1–16.
  52. Saunders, M.N. Research Methods for Business Students, 5/e; Pearson Education: Noida, India, 2011. [Google Scholar]
  53. Tucker, J.L.; Adams, S.R. Incorporating patients’ assessments of satisfaction and quality: an integrative model of patients’ evaluations of their care. Manag. Serv. Qual. Int. J. 2001, 11, 272–287. [Google Scholar] [CrossRef]
  54. Xie, Z.; Or, C. Associations Between Waiting Times, Service Times, and Patient Satisfaction in an Endocrinology Outpatient Department: A Time Study and Questionnaire Survey. INQUIRY J. Health Care Organ. Provis. Financ. 2017, 54, 0046958017739527. [Google Scholar] [CrossRef] [PubMed]
  55. Andaleeb, S.S. Service quality perceptions and patient satisfaction: a study of hospitals in a developing country. Soc. Sci. Med. 2001, 52, 1359–1370. [Google Scholar] [CrossRef]
  56. Brislin, R.W. Research instruments. Field Methods Cross-Cult. Res. 1986, 8, 137–164. [Google Scholar]
  57. Gatewood, R.; Feild, H.S.; Barrick, M. Human Resource Selection; Nelson Education: Scarborough, ON, Canada, 2015. [Google Scholar]
  58. Nunnally, J.; Bernstein, I. Psychometric Theory 3E; Tata McGraw-Hill Education: New York, NY, USA, 2010. [Google Scholar]
  59. Hair, J.; Anderson, R.; Tahtam, R.; Black, W. Multivariate Data Analysis; Prentice Hall International: London, UK, 1998; p. 374. [Google Scholar]
  60. Joseph, F.; Hair, J.; Black, W.; Babin, B.; Anderson, R. Multivariate Data Analysis: A Global Perspective (7th (Global Edition) ed.); Prentice Hall: Upper Saddle River, NJ, USA, 2010. [Google Scholar]
  61. Hu, L.t.; Bentler, P.M. Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Struct. Equ. Model. Multidiscip. J. 1999, 6, 1–55. [Google Scholar] [CrossRef]
  62. Fornell, C.; Larcker, D.F. Structural equation models with unobservable variables and measurement error: Algebra and statistics. J. Mark. Res. 1981, 18, 382–388. [Google Scholar] [CrossRef]
  63. Shaffer, J.A.; DeGeest, D.; Li, A. Tackling the problem of construct proliferation: A guide to assessing the discriminant validity of conceptually related constructs. Organ. Res. Methods 2016, 19, 80–110. [Google Scholar] [CrossRef]
  64. Marsh, H.W.; Hau, K.-T.; Wen, Z. In search of golden rules: Comment on hypothesis-testing approaches to setting cutoff values for fit indexes and dangers in overgeneralizing Hu and Bentler’s (1999) findings. Struct. Equ. Model. 2004, 11, 320–341. [Google Scholar] [CrossRef]
  65. Hooper, D.; Coughlan, J.; Mullen, M. Structural equation modelling: Guidelines for determining model fit. Articles 2008, 2. [Google Scholar] [CrossRef]
  66. McNeish, D.; An, J.; Hancock, G.R. The thorny relation between measurement quality and fit index cutoffs in latent variable models. J. Personal. Assess. 2018, 100, 43–52. [Google Scholar] [CrossRef] [PubMed]
  67. Sharma, R.; Sharma, M.; Sharma, R. The patient satisfaction study in a multispecialty tertiary level hospital, PGIMER, Chandigarh, India. Leadersh. Health Serv. 2011, 24, 64–73. [Google Scholar] [CrossRef]
  68. Hussain, A.; Malik, M.; Toklu, H.Z. A literature review: pharmaceutical care an evolving role at community pharmacies in Pakistan. Pharmacol. Pharm. 2013, 4, 425–430. [Google Scholar] [CrossRef]
  69. George, M. The role of basic laboratory services in strengthening primary health centres. Indian J. Med. Ethics 2011, 8, 161–163. [Google Scholar] [CrossRef]
  70. Mindaye, T.; Taye, B. Patients satisfaction with laboratory services at antiretroviral therapy clinics in public hospitals, Addis Ababa, Ethiopia. BMC Res. Notes 2012, 5, 184. [Google Scholar] [CrossRef] [PubMed]
  71. Abera, R.G.; Abota, B.A.; Legese, M.H.; Negesso, A.E. Patient satisfaction with clinical laboratory services at Tikur Anbessa specialized hospital, Addis Ababa, ethiopia. Patient Prefer. Adherence 2017, 11, 1181–1188. [Google Scholar] [CrossRef]
  72. Rao, K.D.; Peters, D.H.; Bandeen-Roche, K. Towards patient-centered health services in India—A scale to measure patient perceptions of quality. Int. J. Qual. Health Care 2006, 18, 414–421. [Google Scholar] [CrossRef] [PubMed]
  73. Kim, Y.-K.; Cho, C.-H.; Ahn, S.-K.; Goh, I.-H.; Kim, H.-J. A study on medical services quality and its influence upon value of care and patient satisfaction–Focusing upon outpatients in a large-sized hospital. Total Qual. Manag. 2008, 19, 1155–1171. [Google Scholar] [CrossRef]
  74. Zarei, E.; Daneshkohan, A.; Pouragha, B.; Marzban, S.; Arab, M. An Empirical study of the Impact of Service Quality on patient Satisfaction in private Hospitals, Iran. Glob. J. Health Sci. 2015, 7, 1–9. [Google Scholar] [CrossRef] [PubMed]
Ijerph 16 00994 g001 550
Figure 1. The public healthcare delivery system in Pakistan.
Figure 1. The public healthcare delivery system in Pakistan.
Ijerph 16 00994 g001
Table
Table 1. The population of Punjab province and the three districts.
Table 1. The population of Punjab province and the three districts.
PopulationArea km2
Punjab Province110,012,442205,344
Bahawalpur District3,668,10624,830
Bahawalnagar District2,981,9198878
Rahim Yar Khan District4,814,00611,880
Source: Statistical Bureau of Punjab.
Table
Table 2. Hospitals in the districts.
Table 2. Hospitals in the districts.
Sr. No.Teaching HospitalDistrict Hospital (DHQ)Tehsil Headquarter (THQs)Rural Health Center (RHCs)Basic Health Unit (BHUs)
11041072
201410101
310319104
211129277
Source: Statistical Bureau of Punjab.
Table
Table 3. Demographic characteristics.
Table 3. Demographic characteristics.
CharacteristicsFrequency%
Gender
Male19944.7
Female24655.3
Age
Less than 20368.1
20 to 295311.9
30 to 399320.9
40 to 4913730.8
50 and above12628.3
Marital status
Married24354.6
Single18842.3
Divorced122.7
Widow20.4
Occupation
Student71.6
Government employee4510.2
House wife11726.2
Laborer10824.2
Agriculture439.7
Un-employed7116.0
Retired337.5
Other214.6
Education
No formal education13530.3
Primary/elementary school14532.6
Secondary/high school10623.8
College/university245.3
Postgraduate358.0
Monthly income
Less than PKR 10,00012327.6
PKR 10,000 to 14,99910323.2
PKR 15,000 to 19,9997416.6
PKR 20,000 to 24,9996113.8
PKR 25,000 to 29,9994710.5
PKR 30,000 or more378.3
Table
Table 4. Descriptive statistics, Pearson’s correlations, and reliability coefficients among variables.
Table 4. Descriptive statistics, Pearson’s correlations, and reliability coefficients among variables.
VariableMeanSD12345
Patient satisfaction3.990.61(0.96)
Laboratory services3.520.77440 **(0.92)
Pharmacy services4.150.660.445 **0.339 **(0.93)
Doctor–patient communication2.250.800.205 **0.189 **0.230 **(0.94)
Physical services3.020.890.269 **0.402 **0.192 **0.253 **(0.96)
Notes 1: SD = Standard Deviation. Notes 2: Numbers in parenthesis are Cronbach’s Alphas (α). Notes 3: ** Correlation is significant at the 0.01 level (two-tailed).
Table
Table 5. Composite reliability, convergent, and discriminant validity.
Table 5. Composite reliability, convergent, and discriminant validity.
CRAVEMSVMAX (H)PSPHSLSPFDPC
PS0.9650.7530.2300.9760.868
PHS0.9340.6390.2300.9390.479 ***0.799
LS0.9280.6850.2020.9350.450 ***0.369 ***0.827
PF0.9640.8440.1480.9840.267 ***0.199 ***0.385 ***0.919
DPC0.9420.8040.0630.9740.220 ***0.222 ***0.192 ***0.251 ***0.897
Notes 1: PS: Patient Satisfaction, PHS: Pharmacy services, LS: Laboratory services, PF: Physical Facilities, DPC: Doctor–patient communication. Notes 2: CR = Composite Reliabilities, AVE = Average Variance Extracted, MSV = Maximum Shared Variance, MAX (H) = Maximal Reliability. Notes 3: Significance level: *** p < 0.001.
Table
Table 6. Model fit statistics.
Table 6. Model fit statistics.
Absolute Model Fit Indices
Chi Square780.547
DF415
Chi Square/DF1.881
Standardized Root Mean Residual (SRMR)0.042
Comparative Fit Index (CFI)0.980
Normed Fit Index (NFI)0.959
Tucker Lewis Index (TLI)0.976
Relative Fit Index (RFI)0.951
Incremental Fit Index (IFI)0.980
Root Mean Square Error of Approximation (RMSEA)0.045
Table
Table 7. Results of the confirmatory factor analysis.
Table 7. Results of the confirmatory factor analysis.
Construct/FactorsItemsFactor LoadingsCronbach Alpha
Patient satisfaction0.966
Ps10.798
Ps20.817
Ps30.877
Ps40.893
Ps50.863
Ps60.723
Ps70.879
Ps80.876
Ps90.859
Pharmacy services0.931
Ph10.780
Ph20.826
Ph30.796
Ph40.764
Ph50.797
Ph60.827
Ph70.795
Ph80.752
Doctor–patient communication0.942
Dpc10.937
Dpc20.877
Dpc30.883
Dpc40.926
Laboratory services0.927
Ls10.748
Ls20.851
Ls30.827
Ls40.845
Ls50.800
Ls60.770
Physical services0.968
PF10.930
PF20.933
PF30.883
PF40.875
PF50.923
Table
Table 8. Multiple regression models (dependent variable: Patient satisfaction).
Table 8. Multiple regression models (dependent variable: Patient satisfaction).
β Coefficients95.0% Confidence Interval for βCollinearity Statistics
ΒTSig.Lower BoundUpper BoundToleranceVIF
Constant9.5910.0001.3161.994
1. Pharmacy services0.2876.3280.0000.1580.3000.7661.306
2. Laboratory services0.3317.7130.0000.2300.3870.8551.169
3. Doctor–patient communication0.0551.3160.189−0.0210.1050.9001.111
4. Physical services0.0761.7270.0850-.0070.1130.8061.241
Model summary R = 0.555, R2 = 0.308, F = 49.06, p = 0.000, Durbin-Watson (DW) = 2.01

Share and Cite

MDPI and ACS Style

Hussain, A.; Sial, M.S.; Usman, S.M.; Hwang, J.; Jiang, Y.; Shafiq, A. What Factors Affect Patient Satisfaction in Public Sector Hospitals: Evidence from an Emerging Economy. Int. J. Environ. Res. Public Health 2019, 16, 994. https://doi.org/10.3390/ijerph16060994

AMA Style

Hussain A, Sial MS, Usman SM, Hwang J, Jiang Y, Shafiq A. What Factors Affect Patient Satisfaction in Public Sector Hospitals: Evidence from an Emerging Economy. International Journal of Environmental Research and Public Health. 2019; 16(6):994. https://doi.org/10.3390/ijerph16060994

Chicago/Turabian Style

Hussain, Abid, Muhammad Safdar Sial, Sardar Muhammad Usman, Jinsoo Hwang, Yushi Jiang, and Awaisra Shafiq. 2019. "What Factors Affect Patient Satisfaction in Public Sector Hospitals: Evidence from an Emerging Economy" International Journal of Environmental Research and Public Health 16, no. 6: 994. https://doi.org/10.3390/ijerph16060994

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop