1. Introduction
Developing countries are working towards the provision of safe and affordable drinking water services to their citizens. This is due to the fact that the global community is working towards the realization of sustainable development goals [
1,
2] which is no exception for developing countries. The cost of inaction leads to negative social [
3], economic [
4], and environmental [
5] impacts in the areas inhabited by populations that do not have access to clean water services. Reports revealed that lack of access to clean water and subsequent poor sanitation cost countries between 0.5% and 4.3% of their annual GDP [
4], in addition to the toll that it takes on their time and energy traveling to and from water sources [
6]. Lack of safe and improved drinking water supply causes diseases, such as diarrhea, cholera, dysentery, typhoid, and polio, resulting in the death of more than 0.36 million people each year [
7]. These data show that working towards achieving SDGs of the water sector can greatly improve the lives and health of the population in the region.
Ninety-one percent of the world population had access to improved water supply services with some gap between urban and rural areas in the year 2015, though there existed a significant disparity among regions [
6]. The sub-Saharan Africa region had the lowest water supply coverage wherein only 56% of the total population had access to the service in which almost half (48%) of the rural community relied on unimproved water sources [
6]. The majority of rural residents who obtained access mainly rely on boreholes with hand pumps [
8]. The limited capital investment needed to achieve the target, which is about three times the current investment levels [
4], dependence on unimproved sources [
6], and sustainability of existing infrastructures [
9] are the main challenges for the sector.
Several studies evaluating rural water services in developing countries prompt that sustainability and continuous delivery of services are the foremost problems coupled with expanding the access for the unserved. To tackle the problem, governments and donor agencies are spending billions of dollars every year. Despite efforts, many water points failed to continuously provide services throughout the span of time that they were supposed to [
10]. According to an assessment made by rural water supply and sanitation networks in selected sub-Saharan African countries in the year 2016, 22.5% of rural water services were non-functional at visit time [
11]. Some other studies claim that the figure of non-functionality reaches 35% [
12], while operational failures stand at 60% [
13]. Reasons cited for non-functionality are universal and multidimensional [
14,
15], constituting institutional, management, technical, financial, and environmental issues. Fragmented institutional responsibilities, weak local management institutions, and stalled decentralization [
16], inefficient service providers [
17], inefficient tariff, unreliable quality, and quantity [
18] are some of the crucial problems. In many developing countries, sustainability and continuous delivery of the services receive negligible attention compared to the construction of water supply projects [
19].
Studies made on the sustainability of rural water services gave prominence to a demand-responsive approach than that of a supply-driven approach, claiming that the former is a relatively better way of sustaining rural water services. The approach was initially designed and accepted by governments in the 1990s following the poor performance of supply-driven approaches in rural water services [
20]. It opened a way for participation of beneficiary communities in planning, choice of technology, and source, while giving the role of operation and maintenance management to representative user committees [
20]. It is applauded in improving the sense of ownership, increase functionality, and playing a role in improving the sustainability of the services [
21,
22]. Some studies criticized the demand-driven approach by citing the limitations the communities have in managing the operation and maintenance management of the facilities [
23]. The supply-driven approach solely depends on the provision of services by external actors while the demand-driven approach gives room for participation of communities in the development and management of their water supply facilities [
24]. Though the demand-driven approach is praised against the supply-driven, many still believe that a better way of ensuring the sustainability of rural water services need to be in place since it is assumed by many that rural water services still suffer from sustainability problems.
Even though attempts were made to assess the role of demand responsive factors, the impact of project implementation management modalities was hardly studied in the area. Additionally, most of the previous studies were relying on a qualitative assessment of sustainability. To the best of our knowledge, Ethiopia became the first country from the sub-Saharan African region to adopt different project implementation management modalities in the water supply, sanitation, and hygiene (WASH) implementation framework which was sanctioned in 2011. This move makes the country a pioneering figure in embracing four alternative project implementation management modalities (i.e., community, local government, self-supply, and other external sources including NGOs and charity organizations) irrespective of its budgetary sources for the purpose of undertaking the construction of new water facilities [
25].
Thus, this study was designed to empirically assess the implications of project implementation management modalities on the sustainability outcomes of rural water services in Abichu Gna district, Ethiopia. It focused on factors internal to the community affecting sustainability using sustainability assessment indicators. The aim of the study is to (i) assess the sustainability of rural water services, and (ii) assess and test the impact of project implementation management approaches on sustainability outcomes of rural water services. It provides evidence on the sustainability effectiveness of community-managed vis-à-vis other conventional demand-driven project implementation management approaches. The output of the study gives a policy indication in the rural water infrastructure management strategy of attaining optimal sustainability.
2. Background: Community-Managed Project Approach
Though there existed controversies in top down and bottom up development approaches, many studies support a bottom-up development approach, especially in rural community development projects. Proponents of a bottom-up development approach believe that the approach gives room for wider participation of communities which is capable of maintaining sustainability [
26,
27] and criticises the top-down development approach that communities perceive government is responsible for service delivery [
28], which weakens communities’ sense of ownership. The bottom-up approach is not without criticism in that it suffers a low level of community capacity and knowledge constraints [
29]. In principle, rural water policies in many sub-Saharan African countries encourage rural water services to follow a bottom-up development approach by permitting water points to be managed at the lowest decentralized level [
25,
30] though it is a practical fact to observe role changes in which other bodies of the government and their development partners engage in many rural water infrastructures. The community-managed project approach is among the four project implementation management modalities adopted by the government of Ethiopia and included in the One WASH national program in 2011, which opted to follow a bottom-up approach [
25].
Community-managed project is an approach that gives communities the responsibility to plan, implement, and manage both the construction and operation and maintenance of rural water services [
31]. The approach passes through the following sequence of steps [
32]: (1) promotion: a step in which promotion is made about the project to communities; (2) application: a stage in which communities organize themselves, discuss their water problem, select water sanitation, and hygiene committees (WASHCOs). It is made up of seven people who live in the user community and acts on their behalf with respect to water issues and takes the lead in managing water facilities, and, finally, submit applications to the district water supply, sanitation and hygiene team (DWT), which is the highest government body made up of seven people, which makes decisions related to funds allocated to water resource development and management in the district, for appraisal and approval; (3) appraisal: desk and field appraisal of applications is made by water professionals that submit results to DWT for approval; (4) approval: DWT makes the final decisions on applications; (5) funding agreement: this is a step in which a funding agreement is made between the district administrator on behalf of the DWT and head of the WASHCOs; (6) contracting and procurement: after getting funds, WASHCOs, on behalf of communities and technical support from the district water office, an office mandated for development and management of water resources in the district, make contracts and procurements; (7) construction: this is conducted by hired contractors under the project management role of WASHCOs and technical support from district water office; and (8) post-construction operation and maintenance management by WASHCOs on behalf of communities. The project cycle permits communities to make an informed choice about the level of services, technology type, and reveals their level of participation.
The main distinguishing features of the community-managed project approach that differentiates it from local government- and other external actor-managed project approaches is the flow of fund transfer, project management role, and procurement responsibility [
25]. In the community-managed project approach, the budget assigned for construction of water services is directly transferred to the community based on approval of DWT through a designated micro-credit and saving association opened by the name of WASHCOs while the allocated money is not directly transferred to the community, but retained in the account of the respective organizations in local and other externally-managed project approaches.
The communities through representative user WASHCOs are responsible for the overall process of their water supply development, including planning, construction management, financial responsibility, implementation, operation and maintenance management of water services in community-managed project approaches. In local government- and other externally-managed project approaches, the role of communities are restricted to planning, participation in the construction process, and operation and maintenance management by leaving the role of construction and financial management to the structures of the governments, NGOs, and/or charity organizations. Materials and services required in the construction of water services are procured by WASHCOs through structured external support in community-managed project approaches, but the structures of the governments are responsible in local government, and NGOs or charity organizations in other externally-managed project approaches.
3. Materials and Methods
3.1. Study Area
Ethiopia is one of the avenues that offers a viable context to carry out a study on the sustainability of rural water services’ performance whose constructions were run by different project implementation management approaches. The country had a population of 105 million in 2017 [
33], the second most populous country in Africa next to Nigeria in which 79.7% of the total population lives in rural areas [
34]. It is one of the fastest growing economies in the region with an average annual growth rate of 10.3% from year 2005/2006 to 2015/2016, compared with a regional average of 5.4% [
35]. According to 2015 UNICEF/JMP estimates, the country ranked among the lowest sub-Saharan African countries in water supply coverage in which only 51% of the total population had access to clean water [
6].
Oromia region, the largest national state in the country in terms of population and area coverage [
36] was purposively selected for the study. Among districts found in the region, Abichu Gna was purposively selected based on the availability of the highest possible number of rural water services constructed by project implementation management approaches that are regarded as the core issues the current study is anchored on. The district is found in North Shoa zone of Oromia regional state, about 271 km from the capital city of the country, Addis Ababa [
37]. According to the data we obtained from the district water office, it has 19 peasant associations and one urban part with a total population estimated to be 100,741. The livelihood of the populations of the area mainly depends on agriculture and the socio-cultural conditions are almost similar. The area is mostly high land ranging from 2590 to 2843 meter above sea level which accounts for about 92.0% of the total area, and data analyzed from the year 2011/2012 to 2016/2017 shows an average annual rainfall of 950 mm. The rural water supply coverage of the district was 76.2% in the year 2017. A total of 658 rural water points were constructed and serving the community, among which 312 are hand pumps [
38]. The representative of users WASHCOs are in charge of the post construction operation and maintenance management despite the fact that there exists a difference with regard to the construction of water points in the area. The following figure (
Figure 1) shows the location of water points under the study.
3.2. Data Collection
Data supporting the study were collected between December 2017 and April 2018 in four separate operations consisting: (a) an interview of 612 rural households benefiting from 102 water services; (b) an interview held with 387 WASHCO members drawn from 102 water services; (c) an observation carried out to gather data on the technical status of 102 water services; and (d) a document analysis conducted on the records kept by 102 WASHCOs. A total of ten trained local enumerators made all operations in the local language, Afan Oromo. They were selected from the water sector based on their years of professional experience, educational background, and knowledge of the local language. The data collection was made with consent and permission of the local communities and the government. The questionnaires were adopted for implementation after a pilot survey was conducted on 15 households and five water services.
The household survey revealed factors such as their perception of WASHCO selection, transparency of WASHCOs, participation in tariff payment, satisfaction with the level of services and their awareness about water shade management plan. A set of data gathered from 606 households was used for analysis, excluding six response bias cases with poor respondent understanding or concerns about the accuracy of responses. An interview aiming at performance appraisal that encompasses institutional, managerial, financial, technical, and environmental matters was held with WASHCOs in charge of managing the selected water services. A similar step was followed while analyzing the records and files kept by them. The water point observation was made by preparing an assessment checklist which captured technical sustainability of the system including functionality, inclusiveness of design which ensure the ease of a potentially marginalized group of the population including aged, women’s, and people with disabilities, the sanitary condition of surrounding, drainage condition, and risk of flooding.
Communal hand pumps fitted with Afridev, which is a dominant type of pump in the area, were selected for the study. Though the country adopted four project implementation management approaches, due to the unavailability of the self-supply management approach in the study area as it is rarely practiced in the country, our study focused on the other three management modalities. Accordingly water points are included in the study only if they were constructed by project implementation modalities under the study. We employed a cluster-based random sampling method of data collection to ensure that every household of the community and water services can get an equal chance of being selected. A perfect response rate was registered during the campaign due to the fact that the interviewers were experts from the district water office that often meets with the communities which might boost their confidence in answering the questions.
3.3. Construction and Measurement of Variables
Due to the multidimensional relations between user communities and the water systems [
39], measuring sustainability outcomes of water services in a particular community requires data about user’s preference and decision-making behavior related to water, and the operation and maintenance management of the system. Multiple characteristics of sustainability make it tough to quantify, due to the fact that available data on the traits and sustainability indicators vary when examined in light of types of technology and countries [
40].
Different authors had made attempts to develop sustainability indicators to measure the sustainability performance of water services. Among them, a multi-criteria approach [
41], life cycle thinking approach [
15], and the sustainability index tool prepared by United States Aid for International Development (USAID) in collaboration with Rotary International [
42] appear to be worth mentioning. Despite the existence of various sustainability measurement indicators in recent years, there is neither scholarly agreement on what methods must be used to measure the outcomes in water services nor possible rationalization in the literature for preferring one criterion to another [
43]. In spite of the above mentioned indeterminacy, there is a tacit convention that performance is such a multifaceted concept within which institutional, managerial, financial, technical, and environmental indicators are embedded. Each of these indicators also comes out along with other factors/frames of reference.
The following variables and factors were used in the study since the study is confined to hand pump types of rural water services. They were built on the conceptual framework of sustainability assessment measurement developed by USAID in collaboration with Rotary International and factors contextualized by consultation with water sector professionals according to the country’s situation. Due to the relatively large number of factors the study has, exploratory factor analysis is employed and used in the study as the technique is recommended to obtain a small set of variables from a given large set of factors [
44]. The Cronbach statistic is typically used as a reference of the consistency and reliability of the combined factors [
45], which is used in the study.
Institutional sustainability. Two variables were used to measure institutional sustainability in the analysis. The existence of institutions that were built in accordance with the standards set by the country was one of the variables of the study. This variable encompasses: (1) the existence of WASHCOs; (2) the existence of caretakers, which are selected from beneficiary communities and responsible for preventive maintenance and daily operation of the water facility; and (3) the existence of WASHCOs as per national standard with regard to gender composition (which sets at least 50% of WASHCO members shall be women). As only one factor emerged in exploratory factor analysis, dichotomous responses to the three factors (0 = no, 1 = yes) were summed as a composite existence of institutions which has been constituted in line with national norms and standards measure (Cronbach’s alpha reliability coefficient = 0.73). The second institutional sustainability indicator represented the democratic election of WASHCOs. A dichotomous indicator of community perception (0 = no, 1 = yes) was created based on households response to the question. The percentage of households reporting democratic participation in selecting their WASHCO reflected the aggregate level of democratic involvement of communities in selecting WASHCOs.
Management sustainability. The survey included the following series of questions related to the management performance of WASHCOs and caretakers: (1) is the management roles and responsibilities of WASHCOs clearly defined? (2) Does the WASHCO carry out its technical duties? (3) Does the WASHCO carry out its administrative duties? (4) Does the WASHCO carry out its financial management responsibilities? (5) Does the caretaker carry out its technical responsibilities? (6) Are the WASHCO meetings conducted at minimum frequency stipulated in their law? As only one factor emerged in the exploratory factor analysis, dichotomous responses to the six items (0 = no, 1 = yes) were summed as a composite management sustainability performance measure (Cronbach’s alpha reliability coefficients = 0.71).
Financial sustainability. Four variables were used to measure the financial sustainability in the analysis. The first was an indicator of water services tariff setting compliance with the national regulations which include the existence of: (1) water tariff rule; (2) the tariff set in line with national regulations; and (3) social tariff, a special tariff payment system designed for low income and other vulnerable groups. As only one factor emerged in exploratory factor analysis, dichotomous responses to the three factors (0 = no, 1 = yes) were summed as a composite tariff setting compliance with national regulation measure (Cronbach’s alpha reliability coefficient = 0.74). The second indicator represented the regularity and sufficiency of tariff collection. WASHCO interviews and document observation were made to assure: (1) the regularity of tariff collection; and (2) the tariff paid can cover the operation and maintenance cost. As only one factor emerged in exploratory factor analysis, dichotomous responses to the two factors (0 = no, 1 = yes) were summed as a composite regularity and sufficiency of tariff collection measure (Cronbach’s alpha reliability coefficients = 0.71). The third variable represented the effectiveness of WASHCOs in demonstrating financial management and accounting’. The variable was measured by the interviews conducted with WASHCOs and observation of financial records. Exploratory factor analysis revealed three factors among these variables: (1) the existence of financial records; (2) the existence of bank account; and (3) audit. Dichotomous responses to the three factors (0 = no, 1 = yes) were summed as a composite WASHCO demonstrates effective financial management and accounting measure (Cronbach’s alpha reliability coefficients = 0.73). The final variable was the number of households paying tariff. A dichotomous indicator of tariff payment (0 = no, 1 = yes) was created based on households’ responses to the question. The percentage of households reporting paying the tariff reflected the aggregate level of households paying tariff.
Technical sustainability. Three variables were used to measure the technical sustainability of water services in the analysis. The first was an indicator of functionality, inclusiveness of design and standard which includes: (1) functionality; (2) standard as per the national regulation; and (3) inclusiveness of design. As only one factor emerged in exploratory factor analysis, dichotomous responses to the three factors (0 = no, 1 = yes) were summed as a composite functionality, inclusiveness of design and standard measure (Cronbach’s alpha reliability coefficients = 0.67). The second technical sustainability indicator represented compliance of hand pump with standards and norms in terms of siting and public health risk. Water point observation was made to assess three factors: (1) maintenance of sanitary surrounding; (2) existence of drainage; and (3) existence of flooding control. As only one factor emerged in the exploratory factor analysis, dichotomous responses to the three factors (0 = no, 1 = yes) were summed as a composite compliance of hand pump with standards and norms in terms of siting and public health risk measures (Cronbach’s alpha reliability coefficients = 0.69). The third variable represented households’ satisfaction with the level of services which includes: (1) quantity (availability throughout the year); and (2) quality. As only one factor emerged in the exploratory factor analysis, dichotomous responses to the two factors (0 = no, 1 = yes) were summed as a composite households satisfaction with the level of services measure (Cronbach’s alpha reliability coefficients = 0.72).
Environmental sustainability. Three variables were used to measure environmental sustainability in the analysis. The first was an indicator of the existence of local watershed management plan related to water points. A dichotomous indicator of the availability of a watershed management plan (0 = no, 1 = yes) was created based on results obtained from field observation. The percentage of water services having a watershed management plan reflected the aggregate level of water services having a watershed management plan. The second variable was related to communities’ awareness about the watershed management plan related to water services. A dichotomous indicator of community awareness (0 = no, 1 = yes) was created based on households’ responses to the question. The percentage of households having awareness reflected the aggregate level of households’ awareness about watershed management plan. The third variable was related to environment-related adaptation measures (i.e., afforestation, and cut off drain) incorporated in the development of water supply services. A dichotomous indicator of community adaptation measure (0 = no, 1 = yes) was created based on the observations towards committees’ responses. The percentage of water services having environment related adaptation measures reflected the aggregate level of water services having environment-related adaptation measures incorporated in the development of water services.
3.4. Analysis
The analysis was made to measure sustainability performance and find out the existence of a statistically significant difference among project implementation management modalities. Accordingly, post hoc tests were conducted using one-way ANOVA for numeric and continuous variables and a chi-squared test was employed for dichotomous variables to determine whether the groups of implementation management modalities are statistically significant regarding sustainability performance outcomes. Eventually, differences were identified using Statistical Package for the Social Sciences (SPSS) version 25, of International Business Machine (IBM) Corporation, which is based in Armonk, New York, Unites States.
5. Discussion
The study offers the following major insights about the sustainability of rural water services and how project implementation management modalities, conveyed by the responsible body for managing the construction of projects, can influence the sustainability of rural water services.
Accordingly, the study revealed that sustainability outcomes of water services were affected by project implementation management modalities under the study. A high level of institutional performance was generated by the community-managed project approach, relatively. This is in harmony with the hypothesis that empowering communities with the project construction management role initiates them to create a relatively stronger institution that involves women responsible for managing the operation and maintenance of the system. The skill and knowledge acquired from managing the construction of the projects and the existence of stronger institutions are associated with management sustainability performance. Relative management sustainability inefficiency was observed in the local government- and other external actor-managed projects. This inefficiency is mainly linked to lack of experience. In the aforementioned project management approaches, the communities were entitled to take over the management role only after projects are completed, and handover made to the beneficiaries. Although there is a lack of prior study related to community empowerment in the construction stage, there is evidence that participation is positively affecting sustainability [
46,
47]. The study found that empowering communities leads to better water service as measured by institutional and management sustainability indicators, implying that the communities are more engaged and committed to sustaining their water services.
A comparable study undertaken on the financial sustainability in sub-Saharan African countries [
48] indicated that, on average, 30% of beneficiary households were paying the tariff, though there exists significant difference among countries. The regularity of the tariff collection and its capacity in covering the operation and maintenance cost was even lower than the figure. On contrary, this study revealed that almost 73.6% of households were paying the tariff, and a significant proportion was paying on a regular basis for water services construction managed by the communities. There exists a significant difference in financial sustainability performance among the project implementation modalities. The regularity of the tariff collection and percentage of households paying the tariff was also a mirror reflection of the cost of covering operation and maintenance. A significant relationship is observed between the financial transparency and project implementation management approach in which the level of involvement of the communities in selecting the WASHCOs and managing the construction is related to financial transparency. Thus, the study found that to realize a cost recovery system, the involvement of the user communities in managing the construction of their water points can make households pay regularly and sufficiently, and enables WASHCOs to handle proper financial management, which is key in maintaining the financial sustainability of water services.
The technical assessment of the study revealed that 92.2% of the rural water services under scrutiny were functional at visit time and there existed differences among the project implementation management modalities. The result showed that the community-managed project approach registered a lower non-functionality rate and this result is in contradiction with similar studies made in sub-Saharan African countries which figures a non-functionality rate up to 35% [
11]. The level of satisfaction with regard to the service level, the participation of the communities in keeping sanitation of the surrounding area, and control flooding are also related to the level of empowerment. It is observed that communities do not have the capacity necessary to manage water services in tandem with the required technical skills, standards, and designs. From the results, the technical sustainability of the study came to conclude that if communities are empowered and given a proper managerial role in the construction of water facilities, they can become more capable of shouldering responsibilities in maintaining the functional and technical status of water services. Water shade management plans and environmental adaptation measures taken to maintain the environmental flow of the water services also revealed there is a low level of awareness among the communities on the issues. There is a need to maintain the minimum environmental flow in fulfilling the demand of all water needs [
49,
50]. The low level of environmental protection activities in the study area might have a long-term effect on the availability of water and even in meeting the needs of growing demand due to population pressure.
Generally, the study has provided vital insights that water service projects, where the community is empowered and maintained leadership responsibility in constructing their rural water projects, the outcome was found more sustainable than that of managed by local government, NGOs and charity organizations. A demand-responsive approach gives communities the opportunity to participate rather than a managerial role. In accordance with this, the current study found that the highly-praised conventional demand-driven approach of rural water supply can benefit more in terms of sustainability and continuous delivery of the services if it brings communities to managerial and decision-making positions in the process of constructing water projects. The result is in contradiction with previous research made by Ellie which raised the risk of community management [
23]. These might be a clear indication that, as far as sustainability is concerned, the role of governments, NGOs, and charity organizations in construction management of rural water projects might be restricted and areas of particular intervention need to be identified. The facilitative role of involvement taken by the governments, NGOs, and charity organizations in structured support and capacity building initiatives to the communities throughout the project cycle might optimize the benefits of sustainable, and continuous, delivery of systems.
6. Conclusions
In addition to serving the unserved, sustainability of rural water services is one of the overriding problems for the water sector in developing countries. Different attempts were made to identify factors affecting sustainability in spite of the fact that there is lack of studies on the impact of project implementation management modalities on sustainability outcomes of rural water services. The study has made an attempt to shed light on the relationship between project implementation management modalities and sustainability outcomes of rural water services in Abichu Gna district, Ethiopia. Three different types of project implementation management modalities: community, local government, and other external actors were identified in the area. The USAID sustainability assessment tool was adopted, contextualized, and employed to quantify factors affecting sustainability. The analysis of the data from the study area reveals that the sustainability of rural water services is still a major concern for the sector and different aspects of sustainability of rural water services are significantly affected by project implementation management modalities. The followings are key findings of the study:
Though the community-managed project approach to construction of water projects are not common in sub-Saharan African countries, the evidence from Abichu Gna district reveals that community management of water infrastructures generates higher institutional, managerial, financial, and technical sustainability performance compared to projects managed by local government, NGOs, and charity organizations. In most of the sustainability assessment variables, community-managed projects registered a higher statistically significant difference. We think these results linking the community-managed project approach in greater sustainability of water services can be explained by the reaction of communities to empowerment which increases their awareness and sense of ownership. The experience they are getting from construction management of water points might also give them the necessary skills and knowledge on how to sustain their water services. Thus, in order to attain the sustainable development goal target of the water sector, which aimed at increasing the water supply coverage and improve the functionality of existing water infrastructures, the policymakers and governments of developing countries should work more, besides participation, on the empowerment of user communities in the construction of water points.
The study is limited to low-cost rural water technology of hand pumps and internal factors to the community affecting sustainability. A sort of action research that anchors its analysis on a mix of variables treating external factors and the possibility of engaging the community in the tasks related to other types of rural water construction and its cost implication needs to be conducted.