Next Article in Journal
Bacterial Contamination of Children’s Toys in Rural Day Care Centres and Households in South Africa
Previous Article in Journal
Low Birthweight Is Associated with Higher Risk of High Blood Pressure in Chinese Girls: Results from a National Cross-Sectional Study in China
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

The Mixed-Method 5W2D Approach for Health System Stakeholders Analysis in Quality of Care: An Application to the Moroccan Context

1
Laboratory of Manufacturing, Energy and Sustainable Development, High School of Technology, Sidi Mohamed Ben Abdellah University, Fez 30000, Morocco
2
Laboratory of International Management, Decision Making and Logistics (MIDLOG), Sidi Mohamed Ben Abdellah University, Fez 30000, Morocco
*
Author to whom correspondence should be addressed.
Int. J. Environ. Res. Public Health 2019, 16(16), 2899; https://doi.org/10.3390/ijerph16162899
Submission received: 22 June 2019 / Revised: 5 August 2019 / Accepted: 9 August 2019 / Published: 13 August 2019
(This article belongs to the Section Health Economics)

Abstract

:
(1) Background: Quality of care (QC) is not only about satisfying patients, but also about satisfying the various health system stakeholders (HSS). This makes it a complex and difficult objective to achieve. This study aims at proposing a methodological framework for identifying HSS, prioritizing them in QC, and analyzing their interrelationships. (2) Methods: The proposed framework is the mixed-method 5W2D approach, which uses a combination of three basic methods: the 5W questioning technique (What, Who, Why, Where, and When), the Delphi method, and the Decision making trial and evaluation laboratory (DEMATEL) technique. It consists of three interdependent phases. First of all, a preliminary list of HSS is established based on a systematic literature review, which is then projected and adapted to the national context using the 5W questioning technique. Secondly, the identified HSS are classified in order according to their influence and impact on QC by employing Delphi method. Thirdly, the interrelationships between HSS are determined and analyzed by applying DEMATEL technique. An application of 5W2D is conducted in the Moroccan context as its health system involves a wide range of stakeholders. (3) Results: Results defined 17 groups of HSS, whose prioritization led to three groups that are at the core of the health system: patients and their families, health personnel, and government. Roles and expectations of these groups regarding QC are divergent and contradictory, which require making trade-offs. The findings of this study intend to guide the development of inclusive strategies and policies that involve key stakeholders for QC assessment and improvement.

1. Introduction

Quality issues have grown to be a major concern for almost all organizations; quality improvement can help at reducing costs and delays, as well as promoting the organization’s image and reputation. In the health sector, healthcare facilities are required to improve the quality of care (QC), which should be developed to best fit the general standards and regulations and meet the patients’ needs [1]. QC is a complex concept because of the multitude of stakeholders who play essential roles in the inputs, processes, and outputs of healthcare services. It is influenced by the stakeholders who make up the health system. Its assessment should consider the perspectives of the service recipients (patients), as well as the direct and indirect healthcare service providers (health professionals and managers) [2]. In this respect, Leviton and Melichar [3] claim that improving QC requires taking into consideration the perspectives of stakeholders that are essential for planning, implementing, and assessing QC improvement programs. The consideration of stakeholders’ concerns is reflected in the concept of total quality, which has been adopted in several sectors as a quality improvement approach with a client–supplier orientation. Its objective is to satisfy internal and external stakeholders [4]. The transposition of the total quality concept into the health sector has, therefore, placed the satisfaction of all stakeholders as a primary objective of healthcare facilities [5]. It is then necessary to identify these stakeholders and meet their expectations. However, health systems are characterized by the multiplicity of stakeholders who are involved in medical and logistical activities [6]. This makes achieving their satisfaction a difficult objective to realize. Meanwhile, it is of great importance to meet the expectations and interests of key stakeholders since their dissatisfaction may lead to undesired outcomes, such as: reduced budgets, loss of positions, decreased effectiveness, creating roadblocks, etc. [7]. Consequently, healthcare facilities should rank their stakeholders in order to retain the most critical ones. The selection process can be viewed as a multi-criteria decision-making problem. To ease out the process of identifying and selecting key stakeholders, an effective approach is called into action. In this article, the objective is to propose an approach for identifying health system stakeholders (HSS) and their roles, prioritizing them according to their importance in the QC, and analyzing their interrelationships. In doing so, the roles and responsibilities of each HSS would become clear, which is the first step towards improving the QC. The proposed approach is a combination of three basic methods: the 5W questioning technique, the Delphi method, and the Decision making trial and evaluation laboratory (DEMATEL) technique. The 5Ws refer to five fundamental questions: What is the topic? Who is involved? Why does it happen? Where does it take place? and When does it take place? Answers to these questions are necessary in information gathering, as well as in understanding the situation and the context. In this study, the 5W questioning technique is used to gather information about HSS and their role. Who are they and why are they considered as stakeholders? Delphi is a qualitative research method frequently used in social science disciplines. It relies on gathering opinions from a panel of experts to produce a collective agreement on a given issue [8]. Using this method, we could rank HSS according to their importance in the QC. DEMATEL is an effective technique for analyzing complex systems and developing causal relationships between its components [9]. Deploying the DEMATEL technique would make it possible to determine and analyze HSS interrelationships, and then to visualize the most influential and influenced HSS groups. We call the combination of these three methods the “5W2D”, which is an acronym composed of their initials.
The theoretical framework of the following article is based on the stakeholder theory. This theory constitutes the theoretical basis for the strategic management of organizations, which enables them to understand, associate and integrate their environment. The remainder of this paper is organized as follows. The second section consists of a general background related to QC and stakeholder theory. The third section describes the working methodology of 5W2D. The fourth section is dedicated to an empirical application of the proposed methodology in the Moroccan context. Finally, the results are discussed in the fifth section.

2. Background

2.1. Quality of Care (QC)

The main concern of this background section is to list some definitions of QC along with its dimensions in order to highlight the complex nature of quality in healthcare. The QC has been largely defined in the literature. Still, no standardized definition is agreed upon. Donabedian [10] defined QC as “the kind of care that is expected to maximize an inclusive measure of patient welfare after one has taken into account the balance of expected gains and losses that attend the process of care in all its parts”. Two aspects of care are highlighted by this definition, namely, losses with reference to safety and welfare with reference to satisfaction. The United States National Academy of Medicine (NAM) defined QC as “the degree to which health services for individuals and populations increase the likelihood of desired health outcomes, and are consistent with current professional knowledge” [11]. This definition emphasizes the effectiveness of care and the notion of probability that recognizes the uncertainty of the outcomes. Other definitions of QC exist; they are properly presented in the article by Nylenna et al. [12], who concluded that there is no universal definition that can be attributed to the concept of QC.
The variety of definitions of QC proposed in the literature makes it a difficult concept to assimilate. In order to better understand this concept, some researches assume that a health system is compelled to satisfy certain criteria so as to be considered as providing QC. These criteria are also known as dimensions of QC. The number, designations, and meanings of these dimensions vary in the literature. In this paper, we have retained six dimensions by WHO [13]. To help grasp these dimensions, we have identified for each of them some observable indicators extracted from The United States National Academy of Medicine (NAM) [14] and The Organization for Economic Co-operation and Development (OECD) [15] reports (Table 1).
Most of studies on QC have focused on two main questions: How can QC be measured and evaluated? and How can QC be improved? The purpose of the QC assessment is to improve healthcare outcomes. In this regard, patient satisfaction is considered as the most important indicator of QC. Nevertheless, some authors noted the limitations of this indicator, in particular its subjectivity and the lack of patients’ skills to judge the technical QC [16]. It was suggested that the views of health professionals should be taken into account [17], as well as compliance with standards and regulatory references. Studies related to QC improvement can be summarized in three areas: improvement of technical aspects of QC (drug effectiveness, surgery, etc.), improvement of service delivery by strengthening the performance of logistics activities (appointment scheduling, hotel services, transportation, etc.) [18], and improvement of the managerial aspects related to strategies and policies of managing healthcare services. All these improvement areas require the effective engagement of stakeholders, which is a vital condition for success [19].

2.2. Stakeholder Theory

The key idea of stakeholder theory is that the success of an organization relies on the cooperation with its stakeholders [20]. A stakeholder is “any group or individual who can affect or is affected by the achievement of the firm’s objectives” [21]. Thus, the organization has to expand its responsibilities to include the interests and rights of all stakeholders in order to win their support [22].
Stakeholder analysis is the process of identifying, categorizing and prioritizing stakeholders for their involvement in decision-making processes [23]. Several researchers have proposed several criteria to identify stakeholders. Mitchell et al. [24] proposed power, legitimacy, and urgency criteria. Kochan and Rubinstein [25] contemplated that a stakeholder has to provide resources to the organization, be affected by its decisions, and have control over it. Fritz et al. [23] suggested using the supply chain approach to identify all stakeholders involved in the product manufacturing from the raw material to the final product. Despite the existence of several approaches for stakeholders’ identification, none of them guarantee a complete identification without omission.
Various stakeholder categorizations can be found in the literature. One well-known categorization distinguished between primary stakeholders who are in direct contact with the organization and form a partnership with it, and secondary stakeholders who are impacted by the organization’s action, but in the absence of any contractual link [26]. Other categories are suggested: influencers and claimants [20], internal and external [27], etc. These different categorizations are said to be classic and generic, new ones that consider the nature of the addressed issues are required.
It can be drawn from the literature that several reasons are behind the analysis of HSS, including:
-
The importance of stakeholders’ participation and involvement in the processes of identification, understanding, and resolution of health issues. Ng et al. [28] sought HSS viewpoints to spot the multiple dimensions and parameters to be included in the development of a medication safety assessment framework. Ong et al. [29] conducted interviews with HSS to identify challenges, opportunities, and ways forward for the implementation of regional health systems. Franco-Trigo et al. [30] conducted a stakeholder analysis of community pharmacy services for the prevention of cardiovascular disease. The authors of these studies highlighted the importance of involving HSS in planning processes to address health programs implementation challenges.
-
Understanding and considering the different perspectives of HSS in a project decision-making process ensures its success and survival. Hamilton et al. [31] suggested that stakeholder engagement is needed to support the implementation of clinical initiatives. For instance, the design and development of new medical devices and equipment require HSS consultation to take into consideration their specific needs and guarantee their acceptance of the proposed devices [32].
-
Highlighting the contradictory interests of HSS. Achieving the organization’s objectives usually involves conflicts of interests between stakeholders who do not have the same objectives [20]. Patients want effective care, health professionals demand favorable working conditions, managers seek to reduce costs, product makers are interested at defending their commercial interests, etc. [33]. Thus, it is important to maintain balance between these competing interests.

3. Methods

The proposed methodological framework for identifying HSS, prioritizing them in QC, and analyzing their interrelationships is composed of three interdependent phases (Figure 1). It is the combination of a systematic literature review reinforced by the 5W questioning technique (What, Who, Why, Where, and When), the Delphi method, and the DEMATEL technique. We called this mixed method “5W2D”. It is an acronym formed from the initials of these three methods (5W, Delphi, DEMATEL).

3.1. Systematic Literature Review and 5W

The objective of a systematic literature review is to establish a preliminary list of HSS from previous studies conducted at the international level. Then, in order to project and adapt this preliminary list to the national context, we propose applying 5W questioning. Answering these questions allows for identifying HSS and their roles at the national level. It should be noted that the 5W has received a great attention in health research areas thanks to its effectiveness in information gathering and identifying the causes of problems [34,35,36].

3.2. Delphi

The aim of using the Delphi method is twofold: to complete the list of HSS established in the previous phase, and to prioritize them according to their degree of influence on and impact by the QC. A key advantage of the Delphi method is its openness to expert opinions as a source of information. Other methods of consulting experts such as the Nominal Group Technique can be used. However, the choice of the Delphi method is justified by the fact that it guarantees anonymity and the absence of interactions between experts. Also, it does not require experts meeting that would be difficult to establish, unlike the Nominal Group Technique in which the risk of influence is present and experts meeting is required [37]. In addition, the Delphi method is commonly used in ranking issues in a given field [8], which is similar to our objective of prioritizing HSS.
The following steps outline how to undertake a Delphi study [38]:
(1)
Identification of experts: they should belong to different disciplines (i.e., academics, practitioners, government officials) and have relevant knowledge and experience in their respective fields. We suggest following expert identification steps by Okoli and Pawlowski [39].
(2)
Questionnaire design: the questionnaire contains two main questions. The first one invites experts to consult the HSS list and add others, if any, that they may consider relevant. The second one asks experts to assign two scores to each HSS regarding their influence on and impact by QC dimensions (Figure 2), using a scale from 1 to 5: “very low (1)”, “low (2)”, “medium (3)”, “high (4)”, and “very high (5)”. Table 1 about QC dimensions is appended to the questionnaire so that experts have a common understanding of the different dimensions.
(3)
Consultation of experts and result analysis: the questionnaire can be administered by e-mail or by post. Before analyzing the results, expert’s responses are completed by calculating the sum of the scores assigned to each HSS with respect to its influence on and impact by QC dimensions. Let us note,
  • d: QC dimension index (1 ≤ d ≤ 6)
  • E: number of experts
  • e: expert index (1 ≤ e ≤ E)
  • n: number of HSS
  • k: HSS index (1 ≤ k ≤ n)
  • Me,k,d: rating given by the expert e to the influence of HSSk on the QC dimension d
  • Ne,k,d: rating given by the expert e to the impact of HSSk by the QC dimension d
  • Mk: the average score of the influence of HSSk on QC
  • Nk: the average score of the impact of HSSk by QC
For the expert e, the influence of HSSk on QC is d = 1 d = 6 M e,k,d and its impact by QC is i = 1 i = 6 N e,k,d. The consolidated result of the expert panel is obtained after the calculation of the average scores Mk and Nk:
M k   =   e = 1 e = E d = 1 d = 6 M e , k , d E
N k   =   e = 1 e = E d = 1 d = 6 N e , k , d E
The degree of consensus among experts is assessed using Kendall’s W coefficient of concordance. For values of W less than 0.7, the questionnaire should be sent back to experts for new answers [39].

3.3. DEMATEL

In order to determine and analyze HSS interrelationships, we propose applying Decision making trial and evaluation laboratory (DEMATEL) technique. It is a structural modelling approach, used particularly for the analysis of cause-and-effect relationships between the components of a complex system. It classifies them into cause group and effect group, and allows identifying the critical ones [40]. It has been applied in different research areas to support decision-making: textile and apparel industry [41], electronics sector [42], sustainable development [9], energy [43], logistics [44], etc. In health science, DEMATEL was used with different perspectives: to select optimal healthcare waste treatment technologies [45], to determine key success factors of service quality in hospitals [46], and to identify critical factors that influence the emergency management process [47], etc.
The DEMATEL technique can be undertaken following steps in Figure 3 [40].
  • Step 1: generate the direct-relation average matrix D
Suppose there are n HSS and E experts are asked to indicate the direct influence that each HSSi has on HSSj, using a scale from 0 to 4: “no influence (0)”, “low influence (1)”, “medium influence (2)”, “high influence (3)” and “very high influence (4)”. For each expert e, an individual direct-relation matrix is generated De = [dije]n×n. the dije represents the judgment of expert e on the degree to which HSSi affects HSSj. DEMATEL does not require a large number of experts, numerous studies have used a sample of three experts [42]. The direct-relation average matrix D is obtained by aggregating the E experts’ opinions:
D = [dij]n × n   i,j = 1, 2, …,n
d i j   =   1 E × e = 1 E d i j e
  • Step 2: construct the normalized direct-relation matrix M
This matrix is obtained by applying Equations (5) and (6):
M = u.D
u   =   min 1 m a x   1 i n j = 1 j = n d i j   ;   1 m a x   1 j n i = 1 i = n d i j  
  • Step 3: establish the total-relation matrix T
Once the normalized direct-relation matrix M is obtained, the total-relation matrix T can be established through Equation (7), in which I is the identity matrix.
T = M (IM)-1
  • Step 4: compute the column vector R and row vector C
R is a column vector and C is a row vector representing the sum of rows and columns of total-relation matrix T. They are computed using the following equations:
R   =   [ r i ] n × 1   =   j = 1 j = n t i j
C   =   [ c j ] 1 × n   =   i = 1 i = n t i j
ri and cj are the sums of the ith raw and jth column of the matrix T. The value of ri represents the total effects that HSSi has on the other HSS. The value of cj indicates the total effects that all the other HSS have on HSSj. For i = j, the (ri + ci) shows how important the HSSi is; it reflects the power of influences given and received by the HSSi, whereas (rici) provides information about its net influence on the other HSS. If (ri ci) > 0, HSSi has a net influence on the other HSS and is classified in the cause group; if (ri ci) < 0, HSSi is influenced by the other HSS and is classified in the effect group. The influential relation map is produced by plotting (ri + ci) and (ri ci) values for each HSSi on horizontal and vertical axis respectively.

4. Application of the Proposed Method: Case of Morocco

In this section, we present an application of the proposed mixed-method 5W2D for HSS analysis in the Moroccan context. The Moroccan health system knows the interventions of a multitude of stakeholders [48]. This makes it difficult to properly determine everyone’s roles and responsibilities in the QC.
The health system in Morocco is organized around two main sectors: a public one and a private one. The first is composed of healthcare services of the Ministry of Health, Defense department, and local governments. The second incorporates the private for-profit sub-sector, which includes hospital clinics, dental surgery, pharmacies, etc., and the private not-for-profit sub-sector made up of healthcare services of the National Fund for Social Security, the Mutuals and the National Fund of Social Welfare Bodies, the Moroccan Red Crescent, and non-governmental organizations.
Moroccan people’s expectations in terms of healthcare can be summed up in the assurance of universal access to high quality healthcare services (http://conference2013.sante.gov.ma/DocumentsConf/LivreBlanc.pdf). Thus, the Ministry of Health’s new strategy (Ministry of Health, (2018), «Plan Santé 2025», https://www.sante.gov.ma/Pages/actualites.aspx?IDActu=276) considers QC as an important challenge and puts it at the forefront of concerns. To meet this challenge, this strategy relies on the participation and commitment of HSS.

4.1. Preliminary List of HSS

To establish the preliminary list of HSS, a systematic literature review was conducted on the Sciencedirect and PubMed databases, using stakeholders and health system as keywords, over the period from January 2015 to April 2019. A total of 306 papers were identified. After reviewing the publications’ titles and abstracts, 189 papers were selected for full reading. The selection criteria were based on papers’ objectives aiming at identifying HSS, or papers’ methods that rely on HSS opinions to address the research issue. Papers that have used the word stakeholders in an abstract way, without detailing the stakeholders’ profiles, were excluded. By doing so, 38 articles were retained (Figure 4).
The review has led to different lists of HSS. In some cases, the reasons behind the involvement of each stakeholder were not clear. The synthesis of these studies allowed for establishing a preliminary list of the main groups of HSS (Table 2). Some HSS groups are included in several papers and others are only mentioned in few papers. To avoid redundancies, we have presented the consolidated results of the main HSS groups provided by the examined papers.

4.2. List of HSS in Morocco

The preliminary list of HSS groups generated by the literature review was adapted to the Moroccan context using the 5W questions to investigate for correspondents in each group. What is the subject under study? Who are the involved actors? Why were they included? Where are they involved (strategic, tactical, or operational level)? The When question was considered less important for this identification phase. Answers to the retained questions were obtained through the applicable regulations, the analysis of the Ministry of Health’s reports (http://conference2013.sante.gov.ma/DocumentsConf/LivreBlanc.pdf), (http://conference2013.sante.gov.ma/DocumentsConf/intidarate%20francais.pdf), and the consultation of the “partnership” tab of its website (https://www.sante.gov.ma/Partenariat/Pages/default0.aspx) (Table 3).

4.3. Prioritization of HSS

Delphi method was deployed to identify further HSS and prioritize them. In this matter, five experts were contacted from the Regional Hospital Center of Fez. The latter have recommended four other experts to be included in the panel (snowball sampling). To increase the panel size, we looked for experienced profiles in the health field making use of professional and scientific social networks (i.e., linkedin, ResearchGate). Hence, 22 people were identified and approached through emails explaining the objective of the study. In feedback, seven expressed their agreement to be part of the panel (Table 4).
All participants did not add any other HSS. They judged the established list to contain all the HSS in the health system. The experts’ responses related to HSS prioritization were analyzed using IBM SPSS Statistics 23 software (New York, NY, USA). The first Delphi round indicated values of W less than 0.7. Accordingly, the questionnaire was sent back a second and third time to each expert for new ratings, accompanied by his or her own rating in the previous rounds and the consolidated result of the panel’s responses. The third round showed an increase of W, which exceeded 0.7, indicating a better degree of consensus (Table 5).
Figure 5 shows the position of each HSS in two axes, its influence on and by impact QC. It appears that three HSS have the highest scores: HSS1, HSS12, and HSS9. Health personnel (HSS12) and government (HSS1) have the most recognized influence on QC, whereas patients and their families (HSS9) are the most affected by QC. However, it should be noted that the obtained prioritization is not the right or the correct one, but rather the one that gave an acceptable level of consensus among experts.

4.4. Analysis of Interrelationships between the HSS

For the purpose of determining and analyzing interrelationships between HSS, three experts were asked to complete the individual direct-relation matrix De. The three experts belong to the Ministry of Health, Fez Regional Hospital, and the Moroccan Association for Consumer Protection and Guidance with 12, 17 and 13 years of experience respectively. The direct-relation average matrix D was obtained by applying Equations (3) and (4) (Table 6). It indicates the influence of HSS in the first column on those in the first row. For example, HSS1 (government) has a strong influence on HSS9 (patients and their families). The diagonal values are null, indicating that there is no influence between the same HSS.
The normalized direct-relation matrix M was calculated from the direct-influence matrix D, using Equations (5) and (6) (Table 7).
The total-relation matrix T was developed using Equation (7) (Table 8). In order to identify the most significant relationships, a threshold limit of influence α is set, which is the arithmetic mean value of the matrix T [41]. This calculation allows the elimination of minor effects; only values of T that are above the threshold α = 0.0272 are retained, and these correspond to the most significant influence relationships. These values are highlighted and shown in Table 8.
We calculated the sums of rows ri and columns ci of the matrix T for each HSSi using Equations (8) and (9) (Table 9). The (ri + ci) and (rici) are used to illustrate the importance of HSS and to classify them into cause and effect groups. All the HSS with positive (rici) values are in the cause group, whereas HSS with negative values are in the effect group. The three highest values of (ri + ci) correspond to patients and their families (HSS9), government (HSS1), and health personnel (HSS12), indicating that they are the most important in the system. The highest value of (rici) matches the government, while the lowest one matches the patients and their families and health personnel. This means that the government significantly affects the other HSS, whilst the patients and their families as well as health personnel are highly influenced by all the other HSS.
On the light of the results acquired in Table 8 and Table 9, an influential relation map is created (Figure 6). It shows significant influences given and received by each HSS. On the horizontal axis of the graph, we presented the degree of prominence (ri + ci) and on the vertical axis, the cause degree (rici). The arrows indicate relationships that exceed the threshold value. It can be seen from the Figure 6 that the government (HSS1) has the highest cause effect value, while patients and their families (HSS9) and health personnel (HSS12) are the most influenced. Thereby, it can be concluded that these three HSS are the critical ones in the health system.

5. Discussion

Health systems are considered to be complex environments which necessitate appropriate methods to manage them [83]. This is mainly because of the several players involved in health services provision. The main objective of this paper was to identify and prioritize the HSS involved in QC. The analysis was carried out by the methodological framework 5W2D, which combines a systematic literature review, the 5W questioning technique, the Delphi method, and the DEMATEL technique. The findings confirm the existence of various HSS, who contribute to the management, production and reception of healthcare services. It should be noted that the identified HSS and their ranking are likely to vary over time. Therefore, they have to be updated at regular intervals, taking into account changes in the environment [26].
The application of the 5W2D in the Moroccan context has allowed the identification of 17 groups of HSS involved at different levels with distinct roles and interests. They are all both influencing and influenced by QC. Nevertheless, three key HSS groups are at the core of the health system:
-
Patients: are the most important group and the reason behind the existence of health systems as the target of healthcare activities [32]. WHO emphasizes the need to place patients and populations at the center of health systems by meeting their needs and expectations [84]. The results of this study clearly showed that the action of all HSS has an impact on patients and, therefore, on the QC the way they perceive it. Similarly, patients influence QC because the care process is initiated at the patient level; patients are who decide when and where to seek care, and to continue or stop it [85]. Patients and populations also play the role of contributors to finance the health system through taxes and social security. Furthermore, the availability and access to information has radically changed the position of patients, who are no longer mere consumers of care, directed and guided by their physicians, but have become aware and able to make choices and decisions [86]. Another way that patients can influence QC is through satisfaction surveys, which are the most widely considered indicators in QC assessment. In this regard, some studies considered patients’ experience and involvement as an opportunity to improve healthcare services and bring new innovative ideas in delivering care [86].
-
Health personnel: are the providers of healthcare services and are involved throughout the care process. This HSS group includes medical, paramedical, administrative, and other health workers, all of whom are the point of contact with patients and largely influence their perception of received care. Also, health personnel play a very potential role in QC through professional skills (effectiveness and safety of care), respect of patients’ preferences and values (patient-centeredness), optimal use of available resources (efficiency), etc. [2].
-
Government: Through the Ministry of Health and other ministries of Finance, Education, Interior, Agriculture and Transport, the government has a significant impact on QC. The health system governance is carried out by the government, whose action is materialized by the strategies and policies it implements, as well as the funds it provides to the health system for its functioning, improvement, and innovation. The government plays a leadership role in the regulation, monitoring, and improvement of QC [87]. Generally speaking, governments play a crucial role in health development, through strengthening health systems and generating human and financial resources, to achieve objectives of improving health, efficiency and equity in health care financing [88].
The differences indicated across the key stakeholders’ roles, are noted also in their understanding and expectations associated with QC. Patients assign great importance to effective and easily accessible services, which are provided by experienced and helpful caregivers in clean and safe environments [89]. Health personnel require good working conditions and fair division of the workload. Their perception of QC involves also the availability of resources to provide care as per established practices [57]. For the government, QC implies optimal use of resources in providing essential care to a large proportion of the population. Thus, the efficiency and the accessibility of health services are placed at the central level [90]. Consequently, QC assessment and improvement need inclusive and integrated strategies, taking into consideration the perspectives of key HSS, who should be kept involved in all phases from conception to implementation.

6. Conclusions

Health systems are genuine crossroads where several stakeholders meet, whose roles and expectations are different. It is no longer a question of considering only the interests of patients to ensure good QC, but rather the perspectives of other HSS. However, health systems involve various groups of HSS; it is difficult to satisfy all stakeholders simultaneously since their interests are conflicting and the resources are limited. Hence, it is necessary to focus on the most critical HSS in the QC. This paper has proposed a methodological framework for identifying HSS, hierarchizing them according to their importance in QC, and analyzing their interrelationships. The proposed method is called 5W2D, which combines three basic methods: 5W, Delphi, and DEMATEL. It successfully identified HSS by applying the 5W questioning technique, hierarchized them by employing the Delphi method, and analyzed their interrelationships applying the DEMATEL technique. The results of its application in the Moroccan context reveal that three HSS are the most critical with regard to QC: patients and their families, health personnel, and the government. These key HSS have conflicting interests which are challenging and demanding in terms of finding trade-offs. For this very purpose, integrative models for understanding, assessing, and improving QC are needed, involving key HSS and taking into consideration their respective roles and expectations.

Author Contributions

Conceptualization, Y.F., F.J. and S.B.; Data curation, F.J.; Formal analysis, Y.F.; Investigation, Y.F.; Methodology, Y.F. and F.J.; Resources, Y.F.; Software, Y.F.; Supervision, F.J.; Validation, F.J.; Writing—original draft, Y.F.; Writing—review and editing, F.J. and S.B.

Funding

This research received no external funding

Acknowledgments

Authors would like to thank the experts who participated in the surveys conducted in this article.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Al-Shdaifat, E.A.; Shdaifat, E. Implementation of total quality management in hospitals. J. Taibah Univ. Med. Sci. 2015, 10, 461–466. [Google Scholar] [CrossRef] [Green Version]
  2. Bautista, J.M.S.J.; Tangsoc, C. Hospital Service Quality Assessment and Analysis: A Multi-Perspective Approach. DLSU Bus. Econ. Rev. 2016, 26, 30–49. [Google Scholar]
  3. Leviton, L.C.; Melichar, L. Balancing stakeholder needs in the evaluation of healthcare quality improvement. BMJ Qual. Saf. 2016, 25, 803–807. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  4. Mendes, L.; Dias, D. Corporate Social Responsibility and Total Quality Management: The Stakeholders’ Value Creation Debate Revisited. In Applying Quality of Life Research; Springer Science and Business Media LLC: Berlin, Germany, 2018; pp. 255–283. [Google Scholar]
  5. Sebai, J. L’évaluation de la performance dans le système de soins. Que disent les théories? Santé Publique 2015, 27, 395. [Google Scholar] [CrossRef] [PubMed]
  6. Jawab, F.; Frichi, Y.; Boutahari, S. Hospital Logistics Activities. In Proceedings of the International Conference on Industrial Engineering and Operations Management, Bandung, Indonesia, 6–8 March 2018; pp. 3228–3237. [Google Scholar]
  7. Bryson, J.M. What to do when stakeholders matter: Stakeholder identification and analysis techniques. Public Manag. Rev. 2004, 6, 21–53. [Google Scholar] [CrossRef]
  8. Ju, B.; Jin, T. Incorporating nonparametric statistics into Delphi studies in library and information science. Inf. Res. Int. Electron. J. 2013, 18, 1–11. [Google Scholar]
  9. Bakir, S.; Khan, S.; Ahsan, K.; Rahman, S. Exploring the critical determinants of environmentally oriented public procurement using the DEMATEL method. J. Environ. Manag. 2018, 225, 325–335. [Google Scholar] [CrossRef] [PubMed]
  10. Donabedian, A. The Definition of Quality and Approaches to Its Assessment. Volume 1. Explorations in Quality Assessment and Monitoring; Health Administration: Chicago, IL, USA, 1980. [Google Scholar]
  11. Lohr, K.N.; Schroeder, S.A. A Strategy for Quality Assurance in Medicare. N. Engl. J. Med. 1990, 322, 707–712. [Google Scholar] [CrossRef] [PubMed]
  12. Nylenna, M.; Bjertnaes, Ø.A.; Saunes, I.S.; Lindahl, A.K. What is Good Quality of Health Care? Prof. Prof. 2015, 5, 1–16. [Google Scholar] [CrossRef]
  13. WHO. Quality of Care: A Process for Making Strategic Choices in Health Systems; World Health Organization: Geneva, Switzerland, 2006. [Google Scholar]
  14. Institute of Medicine. Crossing the Quality Chasm: A New Health System for the 21st Century; Institute of Medicine: Washington, DC, USA, 2001. [Google Scholar]
  15. Kelley, E.; Hurst, J. Health Care Quality Indicators Project: Conceptual Framework Paper. Mar. Sci. J. 2006, 23, 13–14. [Google Scholar]
  16. Mas, A.; Parra, P.; Bermejo, R.; Hidalgo, M.; Calle, J. Improving quality in healthcare: What makes a satisfied patient? Rev. Calid. Asist. 2016, 31, 196–203. [Google Scholar] [CrossRef] [PubMed]
  17. Chougrani, S.; Ouhadj, S. Les questionnaires de sortie et la place des usagers dans le projet qualité à l’Établissement hospitalier universitaire d’Oran. Santé Publique 2014, 26, 499. [Google Scholar] [CrossRef] [PubMed]
  18. Frichi, Y.; Jawab, F.; Boutahari, S. Elaboration of an Association Matrix of Satisfaction Factors in Healthcare Facilities and Hospital Logistics Activities. In Proceedings of the 2018 International Colloquium on Logistics and Supply Chain Management (LOGISTIQUA), Tangier, Morocco, 26–27 April 2018; pp. 32–37. [Google Scholar]
  19. Norris, J.M.; White, D.E.; Nowell, L.; Mrklas, K.; Stelfox, H.T. How do stakeholders from multiple hierarchical levels of a large provincial health system define engagement? A qualitative study. Implement. Sci. 2017, 12, 98. [Google Scholar] [CrossRef] [PubMed]
  20. Tullberg, J. Stakeholder theory: Some revisionist suggestions. J. Socio. Econ. 2013, 42, 127–135. [Google Scholar] [CrossRef]
  21. Freeman, R.E. Strategic Management: A Stakeholder Approach; Cambridge University Press: Boston, MA, USA, 1984. [Google Scholar]
  22. Dos Muchangos, L.S.; Tokai, A.; Hanashima, A. Stakeholder analysis and social network analysis to evaluate the stakeholders of a MSWM system—A pilot study of Maputo City. Environ. Dev. 2017, 24, 124–135. [Google Scholar] [CrossRef]
  23. Fritz, M.M.; Rauter, R.; Baumgartner, R.J.; Dentchev, N. A supply chain perspective of stakeholder identification as a tool for responsible policy and decision-making. Environ. Sci. Policy 2018, 81, 63–76. [Google Scholar] [CrossRef]
  24. Mitchell, R.K.; Agle, B.R.; Wood, D.J. Toward a Theory of Stakeholder Identification and Salience: Defining the Principle of who and What Really Counts. Acad. Manag. Rev. 1997, 22, 853–886. [Google Scholar] [CrossRef]
  25. Kochan, T.A.; Rubinstein, S.A. Toward a Stakeholder Theory of the Firm: The Saturn Partnership. Organ. Sci. 2000, 11, 367–386. [Google Scholar] [CrossRef]
  26. Sobczak, A.; Girard, C. Pour une cartographie des parties prenantes fondée sur leur engagement: Une application aux sociétaires d’une banque mutualiste française. Manag. Avenir. 2010, 33, 157. [Google Scholar]
  27. Näsi, J.; Carroll, A.B. Understanding Stakeholder Thinking: Themes from a Finnish Conference. Bus. Ethic Eur. Rev. 1997, 6, 46–51. [Google Scholar]
  28. Ng, J.; Scahill, S.; Harrison, J. Stakeholder views do matter: A conceptual framework for medication safety measurement. J. Pharm. Health Serv. Res. 2018, 9, 21–31. [Google Scholar] [CrossRef]
  29. Ong, S.E.; Tyagi, S.; Lim, J.M.; Chia, K.S.; Legido-Quigley, H.; Lim, M.J.; Chia, S.K. Health systems reforms in Singapore: A qualitative study of key stakeholders. Health Policy 2018, 122, 431–443. [Google Scholar] [CrossRef] [PubMed]
  30. Franco-Trigo, L.; Hossain, L.; Durks, D.; Fam, D.; Inglis, S.; Benrimoj, S.; Sabater-Hernández, D. Stakeholder analysis for the development of a community pharmacy service aimed at preventing cardiovascular disease. Res. Soc. Adm. Pharm. 2017, 13, 539–552. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  31. Hamilton, A.B.; Brunner, J.; Cain, C.; Chuang, E.; Luger, T.M.; Canelo, I.; Rubenstein, L.; Yano, E.M. Engaging multilevel stakeholders in an implementation trial of evidence-based quality improvement in VA women’s health primary care. Transl. Behav. Med. 2017, 7, 478–485. [Google Scholar] [CrossRef] [PubMed]
  32. Symmank, C.; Krause, J.; Gurtner, S. Stakeholder Variety in Healthcare and Their Integration in the Medical Device Development Process. In Challenges and Opportunities in Health Care Management; Gurtner, S., Soyez, K., Eds.; Springer: Berlin/Heidelberg, Germany, 2015; pp. 247–258. [Google Scholar]
  33. Concannon, T.W.; Meissner, P.; Grunbaum, J.A.; McElwee, N.; Guise, J.M.; Santa, J.; Conway, P.H.; Daudelin, D.; Morrato, E.H.; Leslie, L.K. A New Taxonomy for Stakeholder Engagement in Patient-Centered Outcomes Research. J. Gen. Intern. Med. 2012, 27, 985–991. [Google Scholar] [CrossRef] [PubMed]
  34. Frullani, Y.; Pitet, L. Pharmacien, un savoir-faire, un objectif: Satisfaire les patients. Actual. Pharm. 2015, 54, 40–43. [Google Scholar] [CrossRef]
  35. Pergolotti, M.; Lyons, K.D.; Williams, G.R. Moving beyond symptom management towards cancer rehabilitation for older adults: Answering the 5W’s. J. Geriatr. Oncol. 2018, 9, 543–549. [Google Scholar] [CrossRef] [PubMed]
  36. Sabtu, N.; Enoch, D.A.; Brown, N.M. Antibiotic resistance: What, why, where, when and how? Br. Med. Bull. 2015, 116, 105–113. [Google Scholar] [CrossRef] [PubMed]
  37. Jones, J.; Hunter, D. Consensus methods for medical and health services research. BMJ 1995, 311, 376–380. [Google Scholar] [CrossRef]
  38. Caire, J.M. Les différentes possibilités de la technique DELPHI. Rev. Francoph. Rech. Ergothérapie 2016, 2, 45–51. [Google Scholar]
  39. Okoli, C.; Pawlowski, S.D. The Delphi method as a research tool: An example, design considerations and applications. Inf. Manag. 2004, 42, 15–29. [Google Scholar] [CrossRef]
  40. Si, S.L.; You, X.Y.; Liu, H.C.; Zhang, P. DEMATEL Technique: A Systematic Review of the State-of-the-Art Literature on Methodologies and Applications. Math. Probl. Eng. 2018, 2018, 1–33. [Google Scholar] [CrossRef] [Green Version]
  41. Gardas, B.B.; Raut, R.D.; Narkhede, B. Modelling the challenges to sustainability in the textile and apparel (T&A) sector: A Delphi-DEMATEL approach. Sustain. Prod. Consum. 2018, 15, 96–108. [Google Scholar]
  42. Bhatia, S.M.; Srivastava, R.K. Analysis of external barriers to remanufacturing using grey-DEMATEL approach: An Indian perspective. Resour. Conserv. Recycl. 2018, 136, 79–87. [Google Scholar] [CrossRef]
  43. Wei, D.; Liu, H.; Shi, K. What are the key barriers for the further development of shale gas in China? A grey-DEMATEL approach. Energy Rep. 2019, 5, 298–304. [Google Scholar] [CrossRef]
  44. Govindan, K.; Chaudhuri, A. Interrelationships of risks faced by third party logistics service providers: A DEMATEL based approach. Transp. Res. Part. E Logist. Transp. Rev. 2016, 90, 177–195. [Google Scholar] [CrossRef] [Green Version]
  45. Liu, H.C.; You, J.X.; Lu, C.; Chen, Y.Z. Evaluating health-care waste treatment technologies using a hybrid multi-criteria decision making model. Renew. Sustain. Energy Rev. 2015, 41, 932–942. [Google Scholar] [CrossRef]
  46. Shieh, J.I.; Wu, H.H.; Huang, K.K. A DEMATEL method in identifying key success factors of hospital service quality. Knowl. Based Syst. 2010, 23, 277–282. [Google Scholar] [CrossRef]
  47. Zhou, Q.; Huang, W.; Zhang, Y. Identifying critical success factors in emergency management using a fuzzy DEMATEL method. Saf. Sci. 2011, 49, 243–252. [Google Scholar] [CrossRef]
  48. Frichi, Y.; Jawab, F.; Boutahari, S. Identification of Health System Stakeholders in Morocco. In Proceedings of the International Conference on Industrial Engineering and Operations Management, Bangkok, Thailand, 5–7 March 2019; pp. 1193–1199. [Google Scholar]
  49. Duong, M.H.; Moles, R.J.; Chaar, B.; Chen, T.F. Stakeholder roles in facilitating access to essential medicines. Res. Soc. Adm. Pharm. 2019, 15, 260–266. [Google Scholar] [CrossRef] [PubMed]
  50. Sun, T.Q.; Medaglia, R. Mapping the challenges of Artificial Intelligence in the public sector: Evidence from public healthcare. Gov. Inf. Q. 2019, 36, 368–383. [Google Scholar] [CrossRef]
  51. Khan, N.; Puthussery, S. Stakeholder perspectives on public-private partnership in health service delivery in Sindh province of Pakistan: A qualitative study. Public Health 2019, 170, 1–9. [Google Scholar] [CrossRef] [PubMed]
  52. Musyimi, C.W.; Mutiso, V.N.; Nyamai, D.N.; Ebuenyi, I.D.; Ndetei, D.M. Integration of Traditional Birth Attendants into Mental Healthcare: A Multistakeholder Qualitative Study Exploration. BioMed Res. Int. 2019, 2019, 1–7. [Google Scholar] [CrossRef] [PubMed]
  53. Martin, G.P.; Chew, S.; Dixon-Woods, M. Senior stakeholder views on policies to foster a culture of openness in the English National Health Service: A qualitative interview study. J. R. Soc. Med. 2019, 112, 153–159. [Google Scholar] [CrossRef] [PubMed]
  54. Brousselle, A.; Contandriopoulos, D.; Haggerty, J.; Breton, M.; Rivard, M.; Beaulieu, M.D.; Champagne, G.; Perroux, M. Stakeholder Views on Solutions to Improve Health System Performance. Healthc. Policy Polit. St. 2018, 14, 71–85. [Google Scholar] [CrossRef]
  55. Franklin, P.D.; Chenok, K.E.; Lavalee, D.; Love, R.; Paxton, L.; Segal, C.; Holve, E. Framework to Guide the Collection and Use of Patient-Reported Outcome Measures. In the Learning Healthcare System. eGEMs 2017, 5, 17. [Google Scholar] [CrossRef] [PubMed]
  56. Trevino, K.M.; Healy, C.; Martin, P.; Canin, B.; Pillemer, K.; Sirey, J.A.; Reid, M.C. Improving implementation of psychological interventions to older adult patients with cancer: Convening older adults, caregivers, providers, researchers. J. Geriatr. Oncol. 2018, 9, 423–429. [Google Scholar] [CrossRef]
  57. Carello, G.; Lanzarone, E.; Mattia, S. Trade-off between stakeholders’ goals in the home care nurse-to-patient assignment problem. Oper. Res. Health Care 2018, 16, 29–40. [Google Scholar] [CrossRef]
  58. Parimbelli, E.; Bottalico, B.; Losiouk, E.; Tomasi, M.; Santosuosso, A.; Lanzola, G.; Quaglini, S.; Bellazzi, R. Trusting telemedicine: A discussion on risks, safety, legal implications and liability of involved stakeholders. Int. J. Med. Inform. 2018, 112, 90–98. [Google Scholar] [CrossRef]
  59. Van Veenendaal, H.; Van Der Weijden, T.; Ubbink, D.T.; Stiggelbout, A.M.; Van Mierlo, L.A.; Hilders, C.G. Accelerating implementation of shared decision-making in the Netherlands: An exploratory investigation. Patient Educ. Couns. 2018, 101, 2097–2104. [Google Scholar] [CrossRef] [Green Version]
  60. Mayo, C.S.; Moran, J.M.; Bosch, W.; Xiao, Y.; McNutt, T.; Popple, R.; Michalski, J.; Feng, M.; Marks, L.B.; Fuller, C.D.; et al. American Association of Physicists in Medicine Task Group 263: Standardizing Nomenclatures in Radiation Oncology. Int. J. Radiat. Oncol. 2018, 100, 1057–1066. [Google Scholar] [CrossRef] [PubMed]
  61. Reddy, A.; Lester, C.A.; Stone, J.A.; Holden, R.J.; Phelan, C.H.; Chui, M.A. Applying participatory design to a pharmacy system intervention. Res. Soc. Adm. Pharm. 2018. [Google Scholar] [CrossRef] [PubMed]
  62. Habli, I.; White, S.; Sujan, M.; Harrison, S.; Ugarte, M. What is the safety case for health IT? A study of assurance practices in England. Saf. Sci. 2018, 110, 324–335. [Google Scholar] [CrossRef] [Green Version]
  63. Hébert, G.J.; Colasante, C.; Ilse, R.G.; Forster, A.J. Using structured incentives to increase value for money in an academic health sciences centre. Health Manag. Forum 2017, 30, 187–189. [Google Scholar] [CrossRef] [PubMed]
  64. Van Schendel, R.V.; Van El, C.G.; Pajkrt, E.; Henneman, L.; Cornel, M.C. Implementing non-invasive prenatal testing for aneuploidy in a national healthcare system: Global challenges and national solutions. BMC Health Serv. Res. 2017, 17, 670. [Google Scholar] [CrossRef] [PubMed]
  65. Eriksson, L.; Bergström, A.; Hoa, D.T.P.; Nga, N.T.; Eldh, A.C. Sustainability of knowledge implementation in a low- and middle- income context: Experiences from a facilitation project in Vietnam targeting maternal and neonatal health. PLoS ONE 2017, 12, e0182626. [Google Scholar] [CrossRef] [PubMed]
  66. Mazor, K.M.; Richards, A.; Gallagher, M.; Arterburn, D.E.; Raebel, M.A.; Nowell, W.B.; Curtis, J.R.; Paolino, A.R.; Toh, S. Stakeholders’ Views on Data Sharing in Multi-Center Studies. J. Comp. Eff. Res. 2017, 6, 537–547. [Google Scholar] [CrossRef] [PubMed]
  67. Toumi, M.; Rémuzat, C. Value added medicines: What value repurposed medicines might bring to society? J. Mark. Access Health Policy 2017, 5, 1264717. [Google Scholar] [CrossRef] [PubMed]
  68. Gardarsdottir, H.; Bekker, C.L.; Egberts, T.C.; Bouvy, M.L.; Van den Bemt, B.J. Redispensing of medicines unused by patients: A qualitative study among stakeholders. Int. J. Clin. Pharm. 2017, 39, 196–204. [Google Scholar]
  69. Hossain, L.N.; Tudball, J.; Franco-Trigo, L.; Durks, D.; Benrimoj, S.I.; Sabater-Hernández, D. A multilevel stakeholder approach for identifying the determinants of implementation of government-funded community pharmacy services at the primary care level. Res. Soc. Adm. Pharm. 2017, 14, 765–775. [Google Scholar] [CrossRef]
  70. Denburg, A.; Wilson, M.G.; Johnson, I.S.; Kutluk, T.; Torode, J.; Gupta, S. Advancing the development of national childhood cancer care strategies in Latin America. J. Cancer Policy 2017, 12, 7–15. [Google Scholar] [CrossRef]
  71. Davidson, G.H.; Austin, E.; Thornblade, L.; Simpson, L.; Ong, T.D.; Pan, H.; Flum, D.R. Improving transitions of care across the spectrum of healthcare delivery: A multidisciplinary approach to understanding variability in outcomes across hospitals and skilled nursing facilities. Am. J. Surg. 2017, 213, 910–914. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  72. Foley, C.; Droog, E.; Healy, O.; McHugh, S.; Buckley, C.; Browne, J.P. Understanding perspectives on major system change: A comparative case study of public engagement and the implementation of urgent and emergency care system reconfiguration. Health Policy 2017, 121, 800–808. [Google Scholar] [CrossRef] [PubMed]
  73. Gagnon, M.P.; Payne-Gagnon, J.; Breton, E.; Fortin, J.P.; Khoury, L.; Dolovich, L.; Price, D.; Wiljer, D.; Bartlett, G.; Archer, N. Adoption of Electronic Personal Health Records in Canada: Perceptions of Stakeholders. Int. J. Health Policy Manag. 2016, 5, 425–433. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  74. O’Rourke, T.; Higuchi, K.S.; Hogg, W. Stakeholder Participation in System Change: A New Conceptual Model. Worldviews Evid. Nurs. 2016, 13, 261–269. [Google Scholar] [CrossRef] [PubMed]
  75. Helena, R. Cross-border healthcare directive: Assessing stakeholders’ perspectives in Poland and Portugal. Health Policy 2016, 120, 369–376. [Google Scholar] [CrossRef] [PubMed]
  76. Yassoub, R.; Alameddine, M.; Saleh, S. The Path Toward Universal Health Coverage: Stakeholder Acceptability of a Primary Care Health Benefits Package in Lebanon. Int. J. Health Serv. 2016, 47, 352–373. [Google Scholar]
  77. Stelfox, H.T.; Niven, D.J.; Clement, F.M.; Bagshaw, S.M.; Cook, D.J.; McKenzie, E.; Potestio, M.L.; Doig, C.J.; O’Neill, B.; Zygun, D. Stakeholder Engagement to Identify Priorities for Improving the Quality and Value of Critical Care. PLoS ONE 2015, 10, e0140141. [Google Scholar] [CrossRef]
  78. Ovseiko, P.V.; Buchan, A.M. Medical workforce education and training: A failed decentralisation attempt to reform organisation, financing, and planning in England. Health Policy 2015, 119, 1545–1549. [Google Scholar] [CrossRef]
  79. Bond, R.R.; Mulvenna, M.D.; Finlay, D.D.; Martin, S. Multi-faceted informatics system for digitising and streamlining the reablement care model. J. Biomed. Inform. 2015, 56, 30–41. [Google Scholar] [CrossRef] [Green Version]
  80. Andriopoulou, F.G.; Birkos, K.; Lymberopoulos, D. Computers in Industry P2Care: A dynamic peer-to-peer network for collaboration in personalized healthcare service delivery. Comput. Ind. 2015, 69, 45–60. [Google Scholar] [CrossRef]
  81. Saleem, J.J.; Plew, W.R.; Speir, R.C.; Herout, J.; Wilck, N.R.; Ryan, D.M.; Cullen, T.A.; Scott, J.M.; Beene, M.S.; Phillips, T. Understanding Barriers and Facilitators to the use of Clinical Information Systems for Intensive Care Units and Anesthesia Record Keeping: A Rapid Ethnography. Int. J. Med. Inform. 2015, 84, 500–511. [Google Scholar] [CrossRef] [PubMed]
  82. Caniato, M.; Tudor, T.; Vaccari, M. Understanding the perceptions, roles and interactions of stakeholder networks managing health-care waste: A case study of the Gaza Strip. Waste Manag. 2015, 35, 255–264. [Google Scholar] [CrossRef] [PubMed]
  83. Ibn El Farouk, I.; Talbi, A.; Jawab, F. Modeling and simulation of hospital supply chain: State of the art and research perspectives. In Proceedings of the 2011 4th International Conference on Logistics, Hammamet, Tunisia, 31 May–3 June 2011; pp. 287–291. [Google Scholar]
  84. WHO. The World Health Report 2000–Health Systems: Improving Performance; World Health Organization: Geneva, Switzerland, 2000. [Google Scholar]
  85. Madison, K. Patients as regulators? Patients’ evolving influence over health care delivery. J. Leg. Med. 2010, 31, 9–34. [Google Scholar] [CrossRef] [PubMed]
  86. Pomey, M.P.; Hihat, H.; Khalifa, M.; Lebel, P.; Néron, A.; Dumez, V. Patient partnership in quality improvement of healthcare services: Patients’ inputs and challenges faced. Patient Exp. J. 2015, 2, 29–42. [Google Scholar] [CrossRef]
  87. Farrag, A.; Harris, Y. A discussion of the United States’ and Egypt’s health care quality improvement efforts. Int. J. Health Manag. 2019, 29, 1–8. [Google Scholar] [CrossRef]
  88. WHO. The Role of Government in Health Development; World Health Organization: Geneva, Switzerland, 2006. [Google Scholar]
  89. Lupo, T. A fuzzy framework to evaluate service quality in the healthcare industry: An empirical case of public hospital service evaluation in Sicily. Appl. Soft Comput. 2016, 40, 468–478. [Google Scholar] [CrossRef]
  90. Piligrimienė, Ž.; Bučiūnienė, I. Different Perspectives on Health Care Quality: Is the Consensus Possible? Eng. Econ. 2008, 1, 104–111. [Google Scholar]
Figure 1. Methodological framework 5W2D for health system stakeholders (HSS) analysis.
Figure 1. Methodological framework 5W2D for health system stakeholders (HSS) analysis.
Ijerph 16 02899 g001
Figure 2. Grid for prioritizing HSS in QC.
Figure 2. Grid for prioritizing HSS in QC.
Ijerph 16 02899 g002
Figure 3. Steps to implement the Decision making trial and evaluation laboratory (DEMATEL) technique.
Figure 3. Steps to implement the Decision making trial and evaluation laboratory (DEMATEL) technique.
Ijerph 16 02899 g003
Figure 4. The paper selection process.
Figure 4. The paper selection process.
Ijerph 16 02899 g004
Figure 5. Positions of HSS according to their influence on and impact by QC.
Figure 5. Positions of HSS according to their influence on and impact by QC.
Ijerph 16 02899 g005
Figure 6. Influential relation map.
Figure 6. Influential relation map.
Ijerph 16 02899 g006
Table 1. Dimensions of quality of care.
Table 1. Dimensions of quality of care.
DimensionDefinitionObservable Indicators
(1) EffectivenessHealth care is based on current scientific knowledge and provided to those in need.
-
Healthcare is based on current scientific knowledge (compliance with standards, compliance with recommendations, etc.).
-
Healthcare is provided to those who need it (targeting).
-
Healthcare achieves the desired outcomes.
(2) SafetyThe extent to which health care processes avoid and prevent adverse events.
-
Healthcare is provided in a way that reduces the occurrence of sentinel events (transfusion-related accidents, surgery on the wrong person, forgetting foreign objects in the patient’s body, etc.).
-
Measures are taken to minimize surgical and post-operative complications.
-
Healthcare is provided in a way that prevents the acquisition of nosocomial infections.
(3) EfficiencyHealth care is produced with optimal use of available resources to achieve the best results.
-
Resources are used in a rational way.
-
Activities with no added value are reduced to the minimum or even eliminated.
-
Waste is reduced by effective recycling.
(4) AccessibilityThe availability of healthcare services and the ease with which they are reached (physical, financial, psychological accessibility).
-
Medical resources are available.
-
Difficulties of geographical access to healthcare are reduced.
-
The burden to healthcare costs are reduced.
-
The time allocated to making appointments and waiting for care is short.
(5) Patient-leftednessThe extent to which healthcare delivery takes into account patient preferences, values and choices.
-
Patients are informed about their health conditions.
-
Patients have the opportunity to communicate with their doctors.
-
Patients are involved in decision-making processes.
-
Healthcare is provided with respect for patients, their preferences and cultures.
-
Healthcare is coordinated and integrated (patient transitions between care units and between health facilities are managed effectively).
(6) EquityServices quality does not vary because of patients’ personal characteristics such as gender, ethnicity, geographical location and socio-economic status.
-
The health system guarantees services to the entire population.
-
Disparities in the provision of healthcare between groups in society are very small or even absent (rich/poor, rural/urban areas, etc.).
-
Healthcare services are provided according to patients’ needs and not to their personal characteristics.
Table 2. Selected publications on HSS.
Table 2. Selected publications on HSS.
RefObjectiveCountryMain HSS Groups
[49]Examine stakeholders’ roles to facilitate access to essential medicines.Australia
(1)
Government: ministries of health, education, transport, agriculture, industry, etc.
(2)
Political parties
(3)
Local authorities
(4)
Regional and provincial directorates of ministries in charge of health, education, transport, etc.
(5)
Health personnel: physicians, nurses, pharmacists, etc.
(6)
Health personnel representatives: trade unions, etc.
(7)
Patients and their families
(8)
Patient advocates
(9)
Health insurance bodies
(10)
Non-governmental organizations and the not-for-profit sector
(11)
United Nations agencies
(12)
Health facilities
(13)
Healthcare industry and professional associations: product suppliers (drugs, equipment, software, etc.) subcontractors (transportation, food service, etc.)
(14)
Health researchers: universities, laboratories, learned societies, etc.
(15)
Shareholders (for private healthcare facilities)
(16)
Employers
(17)
Media
[50]Mapping challenges related to the adoption of Artificial Intelligence in the public health sector.China
[51]Exploring stakeholders’ perspectives on public-private partnership in health service delivery in the Pakistani context. Pakistan
[52]Studying the feasibility of integrating traditional birth attendants into maternal mental healthcare.Kenya
[53]Examine the openness of health policies in terms of integrating the employees voice. England
[54]Analysis of stakeholders’ views on proposed solutions to improve the performance of the Quebec health system.Canada
[55]Proposition of a framework to guide the collection, planning of the implementation and use of Patient-Reported Outcome Measures.USA
[56]Identification of barriers and strategies for implementing psychological interventions for older adults with cancer.USA
[57]Modeling the nurse-to-patient assignment problem in home care under continuity of care while taking into consideration stakeholders’ perspectives.Italy
[58]Discussing risks and legal implications of using modern telemedicine systems. Italy
[59]Formulation and prioritization of strategies for the implementation of Shared Decision Making, based on the identification of obstacles to change.Netherlands
[60]Establishment of guidelines for the development of radiation oncology nomenclature for clinical trials, data sharing initiatives, and population-based studies.USA
[61]Description of a blueprint for the use of participatory design in the design of community pharmacy interventions. USA
[29]Identification of challenges and opportunities for the implementation of regional health systems. Singapore
[62]Analysis of health information technology safety assurance practices.England
[30]Stakeholder analysis to identify a planning group for the development of community pharmacy service to prevent cardiovascular disease.Australia
[63]Development of an innovative system of structured incentives model in an academic health sciences center, linking distribution of government payments to quality and performance outcomes. Canada
[64]Identification of challenges in the implementation of non-invasive prenatal testing for fetal aneuploidy.Netherlands
[65]Identification of factors promoting or hindering the sustainability of the implementation of knowledge implementation strategies in low- and middle-income contexts.Vietnam
[66]Analysis of stakeholders’ opinions on the benefits and risks of data sharing in multicenter comparative efficacy research studies.USA
[19]Studying stakeholders’ understanding of engagement in care improvement initiatives. Canada
[67]Evaluation of the value and potential of drug repositioning. European Union
[68]Analysis of stakeholders’ opinions on the Redispensing of medicines unused by patients, and their reuse by other patients. Netherlands
[31]Engaging stakeholders to adapt patient-centered home care tenets for veterans to the needs of women veterans. USA
[69]Identification of key determinants of practice influencing the implementation of community pharmacy services in the primary care network. Australia
[70]Identification of the main problems and potential solutions to the implementation of national strategies for childhood cancer in Latin America.Latin America
[71]Improving coordination between health care facilities in patient transition by identifying factors that lead to poor clinical outcomes. USA
[72]Analysis of the views of different stakeholders on public engagement in the reconfiguration of emergency care systems.Ireland
[73]Description of the current status of the use of electronic personal health records and identification of facilitators and barriers to their adoption. Canada
[74]Analyzing stakeholder perspectives and participation in the health system change process that led to the introduction of the first Nurse Practitioner-Led clinics in Ontario.Canada
[75]Analysis of stakeholders’ views on the European Union’s cross-border healthcare directive. European Union
[76]Determination of the health benefits package to be included in universal health coverage that is acceptable and sustainable to stakeholders.Lebanon
[77]Identification and prioritization of gaps between current scientific evidence and the actual care provided, as well as opportunities to improve the QC.Canada
[78]Discussion and analysis of the reform on the organization, financing and planning of medical workforce education in England during the Conservative and Liberal Democrat coalition government’s time in office.England
[79]Establishment of a comprehensive set of design requirements for digital reablement system to increase the home autonomy of older people. England
[80]Proposal and development of a decentralized information system for collaboration purposes linking medical providers, paramedical providers and patients for personalized quality services.Greece
[81]Understanding and analyzing facilitators and barriers to the adoption and use of clinical information systems in intensive care units. USA
[82]Understanding and examining the manner in which function the networks managing health-care waste.Palestine
Table 3. Identification of HSS in Morocco.
Table 3. Identification of HSS in Morocco.
What
Identification of Organizations, Institutions, Individuals and Groups of Individuals Who Have an Influence or are Influenced by Health System Actions in Morocco.
WhoWhyWhere
Government: Ministries of Health, Economy and Finance, Interior, National Defense, Transport, Education, Agriculture, etc.Responsible for the development and implementation of national health strategies. It defines the budget allocated to the implementation of health programs and ensures its monitoring and control. The government is accountable for opening up the isolated rural areas through its policies of road network development and transportation. It is also responsible for education and scientific research development strategies.Strategic
ParliamentIt is the legislative institution that passes laws, oversees government actions, and evaluates public policies, particularly those related to the health sector.Strategic
Regional and Provincial Directorates of MinistriesResponsible for the implementation of national policies in their territories.Tactical
Local authorities: Regions, Wilayas, prefectures, provinces and municipalitiesParticipate in the regional and local implementation of national policies and strategies in the health, education, and transportation sectors, etc. They ensure the diagnosis of health and hygiene needs and the maintenance of rural roads. They also manage urban transportation, patients and deceased transportation, etc.Tactical and operational
Public and private healthcare facilities: Basic health care centers network, hospital networks, hospital clinics, hemodialysis centers, laboratories, pharmacies, etc.Provide preventive, curative and promotional care services (consultations, nursing care, chronic disease follow-up, etc.). They also contribute to medical and pharmaceutical training activities.Operational
Health insurance bodies: National Agency of Health Insurance (NAHI), Moroccan Health Insurance Fund (MHIF), National Fund for Social Security (NFSS), private supplementary health insurance companies.The NAHI ensures the proper functioning of the medical coverage system by providing technical support for the obligatory health insurance. It also manages the regime of medical aid to poor populations. The MHIF manages the obligatory health insurance for civil servants and students. The NFSS manages the obligatory health insurance for employees of private enterprises and self-employed persons.Strategic, tactical, and operational
Training and research institutions: Universities, Faculties of Medicine and Pharmacy, Health Career Training Institutes, National School of Public Health, Pasteur Institute of Morocco, Learned societies, etc.Provide initial and in-service training in various medical, managerial and technical disciplines. They also develop research in health sciences.Tactical and operational
International health organizations: WHO, UNICEF, UNAIDS, World Bank, etc.Provide technical and financial assistance to the State for the development of health policies and the implementation of related programs.Strategic
Supranational
Patients and their familiesPatients are the beneficiaries of healthcare services, but also any person acting on their behalf, in particular their families.Operational
Patient advocates: consumer protection associations. Promote consumers’ right to have access to clear, objective and fair information in particular with regard to service prices and safety.Tactical and operational
Civil society organizations: NGOs and private not-for-profit entities working in the health field.Help to reach disadvantaged populations and raise awareness of public health issues.Tactical and operational
Health personnel: physicians, biologists, pharmacists, dentists, nurses, medical assistants, and administrative staffPhysicians are responsible, each within their respective areas of competence, for diagnosis and care, supervision of trainee physicians, prevention and health education. Nurses carry out medical prescriptions, provide nursing care and prepare the necessary equipment and products for medical analysis and care. The administrative staff is responsible for the management of administrative affairs.Operational
Health personnel representatives: Order of Physicians, Order of Dentists, Order of Pharmacists, Trade unions, etc.Professional Orders represent the medical professions vis-a-vis the government, participate in the development and implementation of health policy and defend the moral and professional interests of the medical/pharmaceutical profession. Trade unions protect the economic, industrial, commercial and professional interests of their members.Tactical and operational
National consultation institutions: Economic, Social and Environmental Council (ESEC), National Observatory for Human Development (NOHD), National Human Rights Council (NHRC), etc.The ESEC provides advisory services to the government on social and environmental policies. The NOHD analyses and evaluates the impact of human development programs. The NHRC sees to the observation, surveillance and monitoring of human rights.Strategic
Healthcare industry: manufacturers, wholesalers, distributors and subcontractorsResponsible for product development, production, and distribution. They provide healthcare facilities with goods (medicines, medical supplies, equipment, etc.) and services (IT, maintenance, food services, cleaning, etc.), that are necessary for their operations and the production of care.Tactical and operational
EmployersProvide workers with a healthy and safe working environment. They are responsible for implementing appropriate environmental and health protection measures against pollution generated by industrial activities.Operational
MediaContribute to the promotion of health information and public awareness.Tactical and operational
Table 4. Experts included in the Delphi survey.
Table 4. Experts included in the Delphi survey.
AffiliationPositionYears of ExperienceDegreeCity
1Regional HospitalQuality manager13DoctorFez
2Head of Medical Affairs Department17DoctorFez
3Administrator10MasterFez
4Quality manager10MaserTangier
5Purchasing manager16MasterFez
6Head of the Nursing Care Unit10TechnicianFez
7Ministry of HealthAdministrator12MasterRabat
8UniversityHealth researcher10DoctorCasablanca
9Health researcher11DoctorTangier
10Moroccan Association for Consumer Protection and GuidanceMember of the Association13MasterKenitra
11University HospitalHead of Performance Evaluation Department24MasterRabat
12Prefectural HospitalQuality manager15DoctorCasablanca
13Pasteur InstituteHealth researcher11DoctorCasablanca
14Regional Oncology CentreAdministrator 12MasterMeknes
15Head of Medical Affairs Department23DoctorMeknes
16Administrator 12MasterMeknes
Table 5. Results of the three Delphi rounds of HSS prioritization.
Table 5. Results of the three Delphi rounds of HSS prioritization.
HSSInfluence on QCImpact by QC
First RoundSecond RoundThird RoundFirst RoundSecond RoundThird Round
Mean(Mk)Standard DeviationMean(Mk)Standard DeviationMean(Mk)Standard DeviationMean(Nk)Standard DeviationMean(Nk)Standard DeviationMean(Nk)Standard Deviation
HSS1: Government25.254.1825.333.2726.132.8022.833.4623.833.0423.202.73
HSS2: Parliament18.583.4017.133.3116.801.9015.256.2216.674.4215.074.82
HSS3: Regional and Provincial Directorates of Ministries of Health, Transport, Interior, etc.22.333.2022.532.5621.802.1819.674.1920.334.0120.133.60
HSS4: Local authorities16.172.9216.001.5116.001.5114.175.2515.173.3013.874.60
HSS5: Public and private healthcare facilities19.002.9519.532.5919.472.0020.754.4520.083.5020.673.44
HSS6: Health insurance bodies17.503.1817.931.9418.271.7519.004.1618.423.6518.003.27
HSS7: Training and research institutions17.333.1717.801.7017.471.8113.424.3413.334.1212.873.83
HSS8: International health organizations20.003.6418.672.3518.272.0916.254.9416.004.7115.003.72
HSS9: Patients and their families21.923.9419.872.2620.602.2326.832.9227.922.4327.802.31
HSS10: Patient advocates20.002.9517.332.8719.071.7115.502.9414.752.1815.802.04
HSS11: Civil society organizations18.332.1018.001.4618.001.4614.174.4514.924.2514.933.47
HSS12: Health personnel26.423.8225.732.9426.532.8021.504.4223.924.5223.603.87
HSS13: Health personnel representatives18.753.0217.532.2017.532.2017.003.7917.673.2016.802.86
HSS14: Employers14.003.1613.401.9612.871.9212.004.0011.503.2111.072.81
HSS15: Healthcare industry17.082.7516.802.0116.932.0213.002.6313.252.3012.732.22
HSS16: National consultation institutions14.833.9713.802.5413.802.5411.174.3411.004.1110.533.66
HSS17: Media16.503.6116.272.2216.272.129.584.259.423.829.333.22
Kendall’s W coefficient of concordance0.4680.6260.7050.5600.6650.708
Table 6. Direct-relation average matrix D.
Table 6. Direct-relation average matrix D.
HSS1HSS2HSS3HSS4HSS5HSS6HSS7HSS8HSS9HSS10HSS11HSS12HSS13,HSS14HSS15HSS16,HSS17
HSS10.00000.66674.00002.00003.00003.00003.66671.33334.00001.33332.33334.00002.66673.33333.00000.66672.0000
HSS22.33330.00000.66671.33331.00000.66670.66670.33331.66671.66671.33331.66671.00002.00000.66671.33330.3333
HSS30.66670.00000.00000.66674.00000.00001.33330.33334.00000.33331.00002.66670.66670.00001.66670.00000.3333
HSS40.33330.00001.33330.00000.66670.00000.33330.00003.66670.00001.33330.66670.00001.00000.00000.00000.3333
HSS50.66670.00001.33330.33330.00001.33332.00001.66674.00000.33330.66674.00001.66670.00002.00000.00000.6667
HSS60.33330.00000.00000.00001.00000.00000.00000.66674.00000.00000.00000.33330.33330.00002.66670.00000.0000
HSS70.66670.00000.00000.00000.00000.33330.00001.66673.66670.00000.00001.33330.33330.00002.33330.00000.0000
HSS82.66670.33331.33330.33332.00001.33331.33330.00003.00000.00001.00003.33332.33330.00003.00001.33330.3333
HSS92.33332.00001.66672.33331.00000.33330.66670.33330.00001.33331.33332.33330.66670.00000.66670.66670.3333
HSS101.66670.66672.33330.33332.33330.00000.00000.33332.00000.00000.33331.00001.66670.33331.33330.00000.6667
HSS110.66670.66670.00000.66670.00000.00000.00001.33333.66671.33330.00001.33330.66671.66670.00000.00001.6667
HSS120.66670.00001.33330.00001.66671.66671.00001.66674.00000.00000.33330.00003.33330.00001.33330.00000.0000
HSS132.33330.33331.66670.33332.00000.33330.66671.66673.33330.33330.33333.66670.00000.00001.66670.00000.0000
HSS140.66670.33330.00001.00000.00003.00000.00000.00004.00000.00000.00000.00000.00000.00000.00000.00000.0000
HSS152.00000.33331.66670.00002.66672.66670.66670.66674.00000.00000.00000.66671.30000.00000.00000.00000.0000
HSS161.33330.00001.33331.00001.66671.33330.33330.00002.33330.33330.00000.66670.33331.33330.66670.00000.0000
HSS171.66671.66670.33330.66671.00000.66670.00000.00002.66670.66670.33330.66670.33330.00000.33330.00000.0000
Table 7. Normalized direct-relation matrix M.
Table 7. Normalized direct-relation matrix M.
HSS1HSS2HSS3HSS4HSS5HSS6HSS7HSS8HSS9HSS10HSS11HSS12HSS13HSS14HSS15HSS16HSS17
HSS10.00000.01230.07410.03700.05560.05560.06790.02470.07410.02470.04320.07410.04940.06170.05560.01230.0370
HSS20.04320.00000.01230.02470.01850.01230.01230.00620.03090.03090.02470.03090.01850.03700.01230.02470.0062
HSS30.01230.00000.00000.01230.07410.00000.02470.00620.07410.00620.01850.04940.01230.00000.03090.00000.0062
HSS40.00620.00000.02470.00000.01230.00000.00620.00000.06790.00000.02470.01230.00000.01850.00000.00000.0062
HSS50.01230.00000.02470.00620.00000.02470.03700.03090.07410.00620.01230.07410.03090.00000.03700.00000.0123
HSS60.00620.00000.00000.00000.01850.00000.00000.01230.07410.00000.00000.00620.00620.00000.04940.00000.0000
HSS70.01230.00000.00000.00000.00000.00620.00000.03090.06790.00000.00000.02470.00620.00000.04320.00000.0000
HSS80.04940.00620.02470.00620.03700.02470.02470.00000.05560.00000.01850.06170.04320.00000.05560.02470.0062
HSS90.04320.03700.03090.04320.01850.00620.01230.00620.00000.02470.02470.04320.01230.00000.01230.01230.0062
HSS100.03090.01230.04320.00620.04320.00000.00000.00620.03700.00000.00620.01850.03090.00620.02470.00000.0123
HSS110.01230.01230.00000.01230.00000.00000.00000.02470.06790.02470.00000.02470.01230.03090.00000.00000.0309
HSS120.01230.00000.02470.00000.03090.03090.01850.03090.07410.00000.00620.00000.06170.00000.02470.00000.0000
HSS130.04320.00620.03090.00620.03700.00620.01230.03090.06170.00620.00620.06790.00000.00000.03090.00000.0000
HSS140.01230.00620.00000.01850.00000.05560.00000.00000.07410.00000.00000.00000.00000.00000.00000.00000.0000
HSS150.03700.00620.03090.00000.04940.04940.01230.01230.07410.00000.00000.01230.02410.00000.00000.00000.0000
HSS160.02470.00000.02470.01850.03090.02470.00620.00000.04320.00620.00000.01230.00620.02470.01230.00000.0000
HSS170.03090.03090.00620.01230.01850.01230.00000.00000.04940.01230.00620.01230.00620.00000.00620.00000.0000
Table 8. Total-relation matrix T.
Table 8. Total-relation matrix T.
HSS1HSS2HSS3HSS4HSS5HSS6HSS7HSS8HSS9HSS10HSS11HSS12HSS13HSS14HSS15HSS16HSS17
HSS10.02440.02170.09400.04970.08290.07400.08220.04090.13730.03290.05450.10730.06970.06720.08040.01590.0432
HSS20.05380.00480.02530.03220.03220.02300.02090.01360.06070.03540.03130.04730.02940.04300.02430.02660.0108
HSS30.02400.00530.01220.01920.08510.00940.03370.01530.10100.01090.02490.06780.02450.00290.04260.00210.0100
HSS40.01250.00400.02990.00550.01850.00410.01010.00360.08040.00360.02850.02160.00480.02050.00500.00130.0085
HSS50.02680.00590.03760.01360.01650.03470.04580.04020.10530.01090.01920.09240.04440.00290.05160.00280.0155
HSS60.01440.00400.00760.00490.02620.00590.00480.01600.08640.00300.00390.01630.01220.00130.05480.00170.0018
HSS70.02140.00410.00840.00510.00930.01290.00540.03490.08250.00300.00440.03530.01390.00180.05030.00220.0019
HSS80.06450.01220.04180.01540.05680.03870.03730.01190.09470.00630.02700.08550.05880.00630.07250.02730.0113
HSS90.05340.04040.04330.04960.03330.01520.02160.01400.03040.02960.03220.06000.02430.00720.02440.01470.0110
HSS100.04100.01650.05400.01270.05670.00860.00920.01330.06220.00450.01280.03670.04060.01000.03570.00200.0160
HSS110.02280.01780.00920.01910.00950.00700.00530.02870.08550.02870.00560.03650.02020.03370.00780.00250.0333
HSS120.02560.00520.03610.00710.04460.03840.02680.03870.09960.00460.01260.02060.07070.00240.03820.00260.0031
HSS130.05570.01140.04530.01420.05360.01790.02400.04000.09270.01130.01450.08820.01540.00470.04580.00310.0046
HSS140.01800.00980.00550.02340.00550.05810.00320.00260.08470.00310.00400.00740.00360.00210.00610.00160.0017
HSS150.04770.01120.04250.00790.06250.05720.02210.02020.10000.00510.00740.03240.03430.00380.01460.00260.0040
HSS160.03170.00340.03290.02400.04010.03160.01260.00500.06330.00930.00510.02470.01310.02750.02110.00140.0027
HSS170.03850.03440.01490.01830.02710.01800.00620.00460.06530.01670.01180.02440.01340.00450.01390.00220.0032
Color: values are above the threshold 0.0272.
Table 9. Influences received and given by each HSS.
Table 9. Influences received and given by each HSS.
riciri + ci
(Prominence Degree)
ri − ci
(Cause Degree)
HSS11.07820.57601.65420.5021
HSS20.51460.21210.72670.3025
HSS30.49100.54071.0317−0.0498
HSS40.26240.32190.5843−0.0595
HSS50.56620.66061.2268−0.0944
HSS60.26540.45460.7200−0.1892
HSS70.29690.37120.6681−0.0743
HSS80.66810.34351.01160.3246
HSS90.50471.43201.9367−0.9272
HSS100.43250.21890.65150.2136
HSS110.37310.29980.67290.0733
HSS120.47690.80441.2814−0.3275
HSS130.54230.49351.03580.0488
HSS140.24010.24180.4819−0.0016
HSS150.47560.58911.0647−0.1135
HSS160.34950.11260.46210.2370
HSS170.31760.18250.50010.1351

Share and Cite

MDPI and ACS Style

Frichi, Y.; Jawab, F.; Boutahari, S. The Mixed-Method 5W2D Approach for Health System Stakeholders Analysis in Quality of Care: An Application to the Moroccan Context. Int. J. Environ. Res. Public Health 2019, 16, 2899. https://doi.org/10.3390/ijerph16162899

AMA Style

Frichi Y, Jawab F, Boutahari S. The Mixed-Method 5W2D Approach for Health System Stakeholders Analysis in Quality of Care: An Application to the Moroccan Context. International Journal of Environmental Research and Public Health. 2019; 16(16):2899. https://doi.org/10.3390/ijerph16162899

Chicago/Turabian Style

Frichi, Youness, Fouad Jawab, and Said Boutahari. 2019. "The Mixed-Method 5W2D Approach for Health System Stakeholders Analysis in Quality of Care: An Application to the Moroccan Context" International Journal of Environmental Research and Public Health 16, no. 16: 2899. https://doi.org/10.3390/ijerph16162899

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop