Next Article in Journal
Probabilistic Graphical Framework for Estimating Collaboration Levels in Cloud Manufacturing
Next Article in Special Issue
Climate, Agroecology and Socio-Economic Determinants of Food Availability from Agriculture in Bangladesh, (1948–2008)
Previous Article in Journal
Determination of Key Risk Supervision Areas around River-Type Water Sources Affected by Multiple Risk Sources: A Case Study of Water Sources along the Yangtze’s Nanjing Section
Previous Article in Special Issue
Exploring the Factors Driving Seasonal Farmland Abandonment: A Case Study at the Regional Level in Hunan Province, Central China
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Elimination Method of Multi-Criteria Decision Analysis (MCDA): A Simple Methodological Approach for Assessing Agricultural Sustainability

1
Parmalat Canada and McGill Centre for the Convergence of Health and Economics (MCCHE), McGill University, Montreal, QC H3A 1X9, Canada
2
Department of Geography and Environmental Studies, Wilfrid Laurier University, Centre for Sustainable Food Systems (CSFS), Centre for International Governance Innovation, Balsillie School of International Affairs, Waterloo, ON N2L 6C2, Canada
3
System Design Engineering Department, Conflict Analysis Group, University of Waterloo, Centre for International Governance Innovation, Balsillie School of International Affairs, Waterloo, ON N2L 6C2, Canada
4
School of Environmental Studies, Queen’s University, Kingston, ON K7L 3J9 Canada
*
Author to whom correspondence should be addressed.
Sustainability 2017, 9(2), 287; https://doi.org/10.3390/su9020287
Submission received: 10 November 2016 / Revised: 24 January 2017 / Accepted: 9 February 2017 / Published: 16 February 2017
(This article belongs to the Special Issue Sustainable Agriculture and Development)

Abstract

:
In the present world context, there is a need to assess the sustainability of agricultural systems. Various methods have been proposed to assess agricultural sustainability. Like in many other fields, Multi-Criteria Decision Analysis (MCDA) has recently been used as a methodological approach for the assessment of agricultural sustainability. In this paper, an attempt is made to apply Elimination, a MCDA method, to an agricultural sustainability assessment, and to investigate its benefits and drawbacks. This article starts by explaining the importance of agricultural sustainability. Common MCDA types are discussed, with a description of the state-of-the-art method for incorporating multi-criteria and reference values for agricultural sustainability assessment. Then, a generic description of the Elimination Method is provided, and its modeling approach is applied to a case study in coastal Bangladesh. An assessment of the results is provided, and the issues that need consideration before applying Elimination to agricultural sustainability, are examined. Whilst having some limitations, the case study shows that it is applicable for agricultural sustainability assessments and for ranking the sustainability of agricultural systems. The assessment is quick compared to other assessment methods and is shown to be helpful for agricultural sustainability assessment. It is a relatively simple and straightforward analytical tool that could be widely and easily applied. However, it is suggested that appropriate care must be taken to ensure the successful use of the Elimination Method during the assessment process.

1. Introduction

Sustainability in agriculture has become an important consideration for the Sustainable Development Goals (SDGs). Target two of the SDGs (end hunger, achieve food security, improve nutrition, and promote sustainable agriculture) emphasizes agricultural sustainability, with a variety of recommendations suggested for sustainable agriculture [1]. However, to promote the concept of sustainable agricultural systems, it is important to operationalize the assessment of sustainability [2], by evaluating the sustainability of the existing practices and initiatives [3]. Sustainability assessment through the provision of relevant environmental, economic, and social information, is employed as a policy tool for planning and decision-making. According to the International Union for Conservation of Nature [4] (p. 4), “the main uses of sustainability assessment are: (1) as an input to strategic planning, decision-making, project and programme; (2) as a source of information for monitoring, evaluation and impact analysis; (3) as a source of information for sustainability reporting; and (4) as a process to raise awareness”.
A wide variety of methods have been developed to assess the sustainability of agriculture at the international, national, regional, farm, and product level. While this is an important step, there are drawbacks for many of these methods. In some methods, only one aspect of sustainability is assessed, such as cost-benefit analysis, or the carbon or ecological footprint. Other methods assess the three pillars of sustainability: environmental, economic, and social. Some methods are expert-driven (top-down), while some are expert- and stakeholder-driven (top-down and bottom-up), and some are only stakeholder-driven (bottom-up). Some assessments are based on indicators and some are based on indexes. Most of the initiatives for agricultural assessment have been undertaken by individual scholars or groups. The approaches for the assessment of agricultural sustainability are continuously evolving, because sustainability assessment frameworks are influenced by local agricultural priorities and practices [5]. There are more than 100 assessment tools used around the world [5]. Some of the most practical and useful methods are summarized in Table 1.
Apart from the above mentioned approaches, different MCDA methods, including the Multi Attribute Utility Theory (MAUT), have recently been used in agricultural sustainability assessment [12,13]. While different methods of MCDA, like MAUT, AHP, PROMETHEE, ELECTRE, and DRSA, are being used for sustainability assessment in different fields [14,15], they have not yet been tested for their ability to assess agricultural sustainability.
As agricultural sustainability is complex, including environmental, economic, and social processes, its assessment requires a range of information across all categories. MCDA can be an important and suitable framework for assessing agricultural sustainability, because of its flexibility and capacity to handle diverse information [15]. In this paper, an attempt is made to assess agricultural sustainability using the Elimination Method of MCDA, through a case study of coastal agricultural systems in Bangladesh. The main objective of this paper is to investigate the applicability of the Elimination Method for assessing agricultural sustainability. A related objective is to identify the benefits and obstacles of using Elimination as an MCDA tool for agricultural sustainability assessment.

2. Method and Data

MCDA is a method that helps decision makers to evaluate, prioritize, and select between many conflicting alternatives and criteria [16,17]. MCDA is also known as Multiple Criteria Decision Making (MCDM), Multi Criteria Decision Aiding (MCDA), Multi-Attribute Decision Analysis (MADA), Multiple Objective Decision Analysis (MODA), and Single Participant-Multiple Criteria Decision Making (SPMC) [18]). Generally, MCDA follows several phases. It starts by defining the objectives, after which the criteria are chosen to measure these objectives, and alternatives are then specified. Once the criteria and alternatives are fixed, the criteria from different scales are transformed into commensurable units, and weights are assigned to reflect the relative importance of the criteria. In the last phase, mathematical algorithms are selected and utilized for ranking the criteria, or for choosing an alternative [19,20]. In the literature, a rich variety of MCDA techniques are available for utilization, such as the Multi-Attribute Utility Theory (MAUT) [21], Preference Ranking Organization Method for Enrichment Evaluation (PROMETHEE) [22,23], ELECTRE [24], and the Analytic Hierarchy Process (AHP) [25,26]. To handle uncertainty, concepts from probability [27], fuzzy sets [28], and grey numbers [23] have been incorporated into some of the MCDA methods. Because so many different types of MCDA methods are available for employment by decision makers, one must select the most suitable technique to use in a given situation. The particular MCDA technique which one should employ depends on the characteristics of the problem under study, such as the type of data that are available and the size of the problem. Many MCDA approaches are available, as decision support systems having user-friendly computer programs to allow them to be readily applied to practical problems.
The specific MCDA technique used in the case study investigated this paper is called the Elimination Method. Reasons for utilizing this technique are its simplicity in design and implementation, as well as its capability to provide meaningful findings. Moreover, the case study contains a relatively large number of criteria, which can be readily handled by the technique.
In the next subsection, the approach for applying a particular version of the Elimination Method is explained, followed by a short mathematical description. Within Section 2.2, the data for the case study are presented for the sustainability assessment of five different agricultural systems in Bangladesh.

2.1. Elimination Method of MCDA

The Elimination Method was proposed by MacCrimmon [29] and Radford [30]. It is founded on linguistic rule-based models, which “focus on expressions of preferences on criteria via some linguistic rules, mostly expressed as ‘If ..., then ...’. The advantage of this kind of preference data is that people make decisions by searching for rules that provide good justification of their choices” [31] (p. 19). This method allows the user to rank feasible alternatives, and to consider both numeric and non-numeric criteria [32].
Reference values (Reference value is also referred to as “threshold”, “fair earthshare”, “critical flow” and “sustainability standard” [33] (p. 433) or thresholds are important considerations for elimination methods. Reference values can be determined using normative and relative considerations. “Normative reference values are defined based on science or policy (Experts and stakeholders may be involved), whereas relative reference values are based on indicator values for similar systems or a reference/ideal system. Normative reference values allow comparison of a system with previously defined reference values” [33] (p. 433). To produce a sustainability assessment which is robust, comparable, and transparent among stakeholders, it is important to clarify what type of reference point is being used in the sustainability assessment, as well as how the reference points were determined and why [33]. In the current study, relative reference values are used.
The flow chart in Figure 1 explains the major steps used by the authors to rank the alternatives in their research, as illustrated by the case study in Section 2.2, Section 3 and Section 4. As can be seen, five main steps are utilized to order the alternatives according to preference, from most to least preferred. In fact, the procedures displayed in Figure 1 constitute a special case of the overall elimination approach [32], which is explained in detail by Ma et al. [32]. In Step 4 of the current case study, shown in Figure 1, the highest criterion values of the agricultural systems are considered as reference values, to which the other values of the criteria of the agricultural systems are compared. The reference value represents the highest achievable value in this data set for a given criterion. The scores of the criteria are developed in such a way that the highest value of the criteria represents a higher level of sustainability. Therefore, all of the highest scores of the criteria of different agricultural systems are considered as reference values for the respective criteria. If the criterion value is equal to the reference value, the agricultural system fulfills the criterion. This new rule can be considered as an addition to the overall Elimination Method, that makes it easier to use in sustainability assessment. The total number of criteria fulfilled for each sustainability criterion determines the rank for each agricultural system.
To explain the process in Figure 1 in more detail, suppose that a set of alternative agricultural systems is represented by the set:
A =   { a 1 ,   a 2 ,     ..   .   ,     a n }
where | A |   2 .
The sustainability of each alternative can be evaluated using the set of criteria:
C =   { c 1 ,   c 2 ,   .   .   .   ,   c m }
where | C |   2 .
Note, that if there were only one criterion to assess each alternative, then the alternatives could be directly ranked according to their performance, with respect to that one criterion, from most to least preferred. This could produce tied results. When there are at least two criteria, one must then determine the scores for each criterion across all of the alternatives, as indicated in Step 2 of Figure 1.
In Step 3, let v i be the maximum value of criterion c i , across all of the m alternatives. Here, v i is referred to as the reference value for criterion i . In this application, the maximum value is used, but in other situations it may be meaningful to use a reference value such as the mean or minimum value. If the value of an alternative for criterion c i is less than v i , then an “X” is assigned to indicate that the alternative is below the reference value for c i . As can be seen in Step 4, one does this for every criterion over all of the alternatives. In Step 5, the total number of times that an alternative fails to meet the reference value across all of the criteria, is used to rank the alternatives, where ties are allowed.
The simplified elimination method utilized in the paper possesses a number of distinct advantages. For instance, it can easily handle a large number of criteria and alternatives, for which the criteria may be quantitative or qualitative in nature. Moreover, the criteria can be compensatory, whereby a value change in one criterion can affect others, and non-compensatory criteria. The criteria may be commensurable, whereby the criteria may or may not have the same units, respectively. As can be seen from Figure 1, the evaluation process is transparent and easy to follow, as well as to apply in practice, as demonstrated by the real-world case study in Section 2.2, Section 3 and Section 4. The methodology in Figure 1 could be expanded to handle weights for the criteria, by ordering the criteria from most to least important [32]. However, when there are a large number of criteria, ordering of the criteria could be time-consuming. In addition, uncertainty could be taken into consideration by the use of probability, fuzzy set (28), or grey numbers (23). However, a disadvantage of entertaining uncertainty is that the model becomes more complicated.

2.2. Data for the Case Study

To test the Elimination method for assessing agricultural sustainability, data (Appendix A: Table A1, Table A2, Table A3, Table A4, Table A5 and Table A6) were collected from Talukder [35]. These data are associated with the sustainability of five different agricultural systems: Bagda (shrimp)-based agricultural systems (S) from Shyamnagar Upazila (Upazila is the second lowest tier of local government in Bangladesh [36]), Bagda-rice-based agricultural systems (SR) from Kalijang Upazila, rice-based agricultural systems (R) from Kalaroa Upazila, Galda-rice-vegetable-based integrated agricultural systems (I) from Dumuria Upazila, and traditional practice-based agricultural systems (T) from Bhola Sadar Upazila. These Upazilas are located in the southwest coastal zone of Bangladesh (Figure 2). Data were collected from the literature, field observations, questionnaire surveys, and key informant interviews of knowledgeable farmers, agricultural extension officers, fishery officers, livestock officers, and block supervisors. Representatives from a total of 221 households, representing five categories of farmers: (landless (<0.01 acres), marginal (0.01 ≤ 0.50 acres), small (0.50 ≤ 2.5 acres), medium (2.5 ≤ 5.0 acres) and large (>5.0 acres) [35]) were considered during data collection [35]. The data for sustainability criteria were grouped into six categories of sustainability: productivity, stability, efficiency, durability, compatibility, and equity. In brief: productivity is related to the yields of agricultural systems; stability refers to the ability to maintain a good level of productivity over an extended period of time; efficiency is the measure of the extent to which the inputs for agricultural production enhance the crop yield (expressed in energy); durability is the ability of the agricultural system to resist or recover from stress and therefore, maintain a good level of productivity over a cropping cycle; compatibility refers to the ability of an agricultural system to fit in with the bio-geophysical, human, and socio-cultural surroundings in which the system is placed; and equity promotes a good quality of life for farmers and their family members [37].

3. Results of Elimination Method

Ranking the sustainability of agricultural systems depends on all of the scores of the criteria, from all categories. Scores of the criteria vary across the agricultural systems. For example, in the productivity category, ‘I’ (Integrated agriculture system) has the highest yield and net income (Appendix A: Table A1). A comparison of results and an in-depth knowledge of on-the-ground production and community considerations, are instructive and help to interpret results. For example, the overall productivity is higher in ‘I’ due to the year-round production of many crops, including three rice harvests a year, as well as the simultaneous production of crops such as jute, oilseed, and vegetables. Among environmental criteria, the energy output and input ratio, crop richness, and biodiversity condition, are very good in ‘I’, when compared to other systems. Due to fewer crops, the energy output to input ratio and crop richness are smaller in ‘SR’ and ‘S’. The condition of biodiversity is poor in ‘S’ because shrimp farming causes biodiversity degradation [38]. Since it is near the tidal zone, the study area ‘S’ is more exposed to salt water. However, according to the local people, the soil salinity is low in ‘R’ and close to zero in ‘T’, due to the significant input of rainwater and freshwater from the upstream rivers. Among responding farmers, those in ‘I’ have a higher level of education than their counterparts in ‘S’, ‘SR’, ‘R’, and ‘T’.
Table 2 shows the reference values and scores of the criteria of the agricultural systems. Here, all of the criteria are considered important for agricultural sustainability. The results of the case study are presented in Table 3 and Figure 3, and are self-explanatory.
The relative reference values are considered here, since it is very difficult to identify the normative reference values in the context of the coastal agriculture of Bangladesh, because there are not enough secondary data related to sustainability of the agricultural systems. This is appropriate as the determination of normative reference values is time-consuming and sometimes pointless, since agricultural sustainability is a very relative concept, that varies over time and space [19]. Table 3 presents the evaluation results after applying the rules of the Elimination Method, as described in the methodology section.
Figure 3 displays the final results, that is, the ranking of the sustainability of agricultural systems. According to the ranking of the sustainability of agricultural systems, ‘I’ is the most preferred sustainable system, in comparison to the other four systems. ‘I’ fails on 25 of the 50 criteria, meaning that, for ‘I’, the remaining 25 criteria are equivalent to the reference values. The farmers of ‘I’ also expressed their satisfaction with most of the sustainability issues, like productivity, biodiversity, social health, and economics. This finding also echoes the finding of Rahman and Barmon [39], that ‘I’-type agricultural systems are more sustainable compared to others. Among agricultural systems, ‘S’ failed in most of the reference criteria and ranked as the least preferred system. Hossain et al. [38] also expressed that shrimp-based agricultural systems are less sustainable, due to the socio-ecological effects of shrimp cultivation.
While this type of assessment is based on very simple conditional statements and is easy to calculate, it depends entirely on the calculation of the criteria’s values. Therefore, the selection of criteria and the calculation of criteria values, requires a high degree of transparency, to ensure that this type of calculation is as clear and robust as possible. While agricultural sustainability in this assessment is divided into six categories, it does not reflect the actual performance of the individual categories in the overall ranking. It is important to note that the overall rank is heavily influenced by the number of criteria in each category as the criteria are added up, and thus have a significant impact on the final outcome. For example, ‘S’ as a whole, ranked the lowest, but if we examine the performance of each category, durability is tied between ‘S’ and ‘I’ (Table 3). If we explain this result by category, we see that “I” is highlighted as the “most sustainable” agricultural system for each category: ‘I’ for productivity, efficiency, durability (tied with ‘S’), and equity, ‘T’ for stability, and ‘R’ for compatibility. Therefore, while final rankings based on all of the criteria are important for this study, it is also useful to check the individual performance of each category. This will allow a more refined consideration of the performance of different categories, and also help to suggest ways to improve the categories of agricultural systems for agricultural sustainability.

4. Discussion

There are several considerations for applying an MCDA method as an agricultural sustainability assessment tool. In general, MCDA is appropriate because it can consider many criteria, thus allowing for the complexity needed for sustainability analysis. However, when using the MCDA framework, assigning the weighting of the criteria is very subjective. To avoid this subjectivity, using reference values based on the Elimination Method is a useful approach for sustainability assessment. By using criteria scores and relative reference values, the Elimination Method offers the ability to rank the sustainability of agricultural systems [32]. The advantage of this method is that, using the highest score in each category, readily allows for the identification of the criteria that fulfill the reference values. This makes it a flexible, transparent, time-saving, and holistic process, that can handle the imprecision and subjectivity of the information associated with sustainability criteria. If the sustainability criteria fall in a regular pattern, such as higher positive values of the criteria indicating higher sustainability, it can handle large data with ease. However, having to eliminate many criteria and not consider all the criteria’s values, will lessen the actual effect of the total criteria in the overall ranking [40].
The results of the Elimination analysis reveal that shrimp-based agricultural systems perform poorly in comparison to integrated and rice-based agricultural systems. There is a significant difference in how these systems fulfill the criteria of sustainability. It should be noted that farmers consider shrimp-based agricultural systems to be profitable, but there are adverse ecological consequences, and the production of shrimp has dropped over successive years. Rice yields are very low in S and SR, which is jeopardizing the food supply. Biodiversity is also low in these systems, which suggests a trend of agricultural unsustainability. Therefore, some of the farmers interviewed by Talukder [35] reported that they are considering changing to integrated agricultural systems.
This suggested modified Elimination Method allows the user to set a threshold value in a category, as a bar below which all data are eliminated. This leaves the top value for that category. Once all top values for each category have been determined, these category values can be summed, and the results can be ranked. This case study demonstrates that Elimination is able to determine sustainability rankings for the different systems. This finding may motivate other researchers to collect more reliable criteria with which to apply the Elimination Method for sustainability assessment. The ranking of agricultural sustainability raises various questions about the sustainability performance of the agricultural systems. The Elimination Method can be offered as an option for holistically assessing agriculture [41], as it can consider criteria from all three pillars of sustainability.

5. Conclusions

Applying MCDA to agricultural sustainability assessment is complex, as many criteria need to be considered. In any MCDA-based assessment (Like MAUT, PROMETHEE), the weighting of criteria is very subjective. To avoid this, eliminating criteria based on objective reference values, defined in terms of a case study, is a useful alternative.
To the best of our knowledge, this is the first time an attempt has been made to use Elimination Method to evaluate and compare the agricultural sustainability of different systems. In this study, the process of the Elimination Method is described, and the scores of criteria and relative reference values are determined. Furthermore, the methodological process of Elimination is tested through a case study, in order to identify its advantages and pitfalls. This paper is not an “instruction manual” for using the Elimination Method for agricultural sustainability, but the framework presented here can help to simplify sustainability assessment. However, appropriate and transparent measures are needed for selecting the criteria, and their scoring and reference values. The MCDA Elimination Method is used to rank the sustainability performance of agriculture by considering economic, environmental, and social criteria. This framework allows an integrated assessment as it handles data related to the three pillars of sustainability. The Elimination approach can be an option for sustainability assessment, but there is still a lot of scope to investigate, including the applicability of other techniques of the MCDA approach, in order to identify suitable or preferred MCDA techniques for assessing agricultural sustainability.
One drawback to this is that successive elimination can cause the method to lose fundamental properties of the original criteria, as part of the overall final ranking [41]. The research and Elimination analysis reported in this thesis offer insights for future researchers as they define their categories, and collect data to test the Elimination Method in the context of agricultural and other types of sustainability assessment. Like MAUT and PROMETHEE, Elimination can also facilitate learning, debate, and consensus building among the stakeholders, for agricultural sustainability. Adopting Elimination for agricultural sustainability assessment can be a positive step in understanding and comparing multiple dimensions of sustainability.

Acknowledgments

This paper has been supported by the Social Sciences and Humanities Research Council (SSHRC), Canada.

Author Contributions

Byomkesh Talukder conceived and designed the original research as part of his Ph.D. thesis. Alison Blay-Palmer guided to execute the research. Keith W. Hipel helped to understand the applicability of the Emanation Method in sustainability assessment and Gary W. vanLoon guided by statistical techniques to develop criteria.

Conflicts of Interest

The authors declare no conflict of interest.

Appendix A. Databases Used in the Bangladesh Study

Table A1. Selected indicators and values to construct single composite indicators for productivity.
Table A1. Selected indicators and values to construct single composite indicators for productivity.
Sustainability CategoryComposite IndicatorDescriptionUnitData TypeSustainability PillarData SourceAgricultural SystemsLevel of Measurement
SSRRIT
ProductivityProductivityWeighted yield of the main staple cropt/haQTLEconomicQ.S.2.264.415.236.512.86Ratio scale
Net income from the agro-ecosystem$/haQTLEconomicQ.S.311.151020.371585.811806.04544.01Ratio scale
Protein yield from the agro-ecosystemkg/haQTLEcologicalQ.S.68.42147.23552373.01318.87Ratio scale
Legend: QTL = Quantitative; Q.S. = Questionnaire survey.
Table A2. Selected indicators and values to construct single composite indicators for stability.
Table A2. Selected indicators and values to construct single composite indicators for stability.
Sustainability CategoryComposite IndicatorDescriptionUnitData TypeSustainability PillarData SourceAgricultural SystemsLevel of Measurement
SSRRIT
StabilityLandscape stabilityLand exposure to natural events: cyclonebinary yes/no responseQUALEcologicalS.D.12221Nominal scale
Land exposure to natural events: saline waterbinary yes/no responseQUALEcologicalS.D.11323Nominal scale
Land exposure to natural events: drought in kharif to rabi seasonbinary yes/no responseQUALEcologicalS.D.1.51.5223.5Nominal scale
Land exposure to natural events: river bank erosionbinary yes/no responseQUALEcologicalS.D.22221Nominal scale
Stability of embankmentbinary yes/no responseQUALEcologicalF. O.12122Nominal scale
Withdraw of upstream waterbinary yes/no responseQUALEcologicalS.D.11112Nominal scale
Soil health/stabilityOrganic materials%QTLEcologicalS.D.44232Ordinal scale
SalinitydS/mQTLEcologicalS.D.15636Ordinal scale
Macronutrient: Nmeq/100 gm QTLEcologicalS.D.22212Ordinal scale
Macronutrient: Pmeq/100 gmQTLEcologicalS.D.32333Ordinal scale
Macronutrients: Kmeq/100 gmQTLEcologicalS.D.64324Ordinal scale
Soil pHRatio (no unit)QTLEcologicalS.D.13424Ordinal scale
Water qualityWater salinity in surface water (quality of surface water for irrigation)dS/mQTLEcologicalS.D.12223Ordinal scale
Water salinity in ground water (quality of ground water for irrigation)dS/mQTLEcologicalS.D.12243Ordinal scale
Arsenic concentration (quality of ground water for irrigation)PpmQTLEcologicalS.D.22224Ordinal scale
Legend: QTL = Quantitative; QUAL = Qualitative; S.D. = Secondary data; F.O. = Field observation.
Table A3. Selected indicators and values to construct single composite indicators for efficiency.
Table A3. Selected indicators and values to construct single composite indicators for efficiency.
Sustainability CategoryComposite IndicatorDescriptionUnitData TypeSustainability PillarData SourceAgricultural SystemsLevel of Measurement
SSRRIT
EfficiencyMonetary efficiency Money input and output in the agro-ecosystem$ output/$ inputQTLEconomicQ.S.1.532.242.786.672.29Ratio scale
Energy efficiencyOverall energy efficiency Ratio of energy output and inputQTLEcologicalQ.S.1.372.015.535.545.9Ratio scale
Non-renewable energy efficiencyRatio of energy output and inputQTLEcologicalQ.S.0.780.922.172.522.44Ratio scale
Legend: QTL = Quantitative; Q.S. = Questionnaire survey.
Table A4. Selected indicators and values to construct single composite indicators for durability.
Table A4. Selected indicators and values to construct single composite indicators for durability.
Sustainability CategoryComposite IndicatorsDescriptionUnitData TypeSustainability PillarData SourceAgricultural SystemsLevel of Measurement
SSRRIT
DurabilityResistance to pest stressChemical response to pest stress binary yes/no response QUALEcologicalQ.S.1.784.174.245.456.54Nominal scale
Water availability at transplanting stage of ricebinary yes/no response QUALEcologicalQ.S.0.750.750.20.20.2Nominal scale
Water availability at flowering stage of ricebinary yes/no response QUALEcologicalQ.S.0.750.750.20.20.2Nominal scale
Farm management (soil test, pest management, land management, soil fertility management)binary yes/no response QUALEcologicalQ.S.0.670.831.691.360.0Nominal scale
Resistance to economic stressGood product pricebinary yes/no response QUALeconomicQ.S.8.4454.584.553.8Nominal scale
Availability of seedsbinary yes/no response QUALEcologicalQ.S.9.339.510108.85Nominal scale
Availability of market (market diversification)Yes/noQUALSocial/economicQ.S.109.178.47107.69Nominal scale
Resistance to climate changeAgricultural trainingbinary yes/no responseQUALSocial/ecologicalQ.S.1.331.830.332.271.15Nominal scale
Climate change awarenessbinary yes/no response QUALSocialQ.S.1.110.670.511.820Nominal scale
Advice from agricultural extension workers or NGObinary yes/no response QUALEcologicalQ.S.0.661.170.510.450.38Nominal scale
Legend: QUAL= Qualitative; Q.S. = Questionnaire survey.
Table A5. Selected indicators to construct single composite indicators for compatibility.
Table A5. Selected indicators to construct single composite indicators for compatibility.
Sustainability CategoryComposite IndicatorsDescriptionUnitData TypeSustainability PillarData SourceAgricultural SystemsLevel of Measurement
SSRRIT
CompatibilityHuman CompatibilityDrinking water quality (protected)binary yes/no responseQUALEcologicalQ.S.089109Nominal scale
Illness from drinking waterbinary yes/no response QUALEcologicalQ.S.510101010Nominal scale
Biophysical CompatibilityOverall biodiversity condition: Percentage of non-crop area%QTLEcologicalQ.S.7.546.4823.0115.7318.68Ordinal scale
Overall biodiversity condition: crop richnessnumber of cropsQTLEcologicalQ.S.26161017Ordinal scale
Overall biodiversity condition: crop rotationnumberQTLEcologicalQ.S.23544Ordinal scale
Ecosystem connectivitybinary yes/no responseQUALEcologicalF.O.11222Nominal scale
Legend: QTL = Quantitative; QUAL = Qualitative; Q.S. = Questionnaire survey; F.O. = Field observation.
Table A6. Selected indicators and values to construct single composite indicators for equity.
Table A6. Selected indicators and values to construct single composite indicators for equity.
Sustainability CategoryComposite IndicatorsDescriptionUnitData TypeSustainability PillarData Source Agricultural SystemsLevel of Measurement
SSRRIT
EquityEducationEducation of farmers %QTLSocialQ.S.8.569.254.75105Ordinal scale
Education status of farmers’ male children%QTLSocialQ.S.109.4911.213.17.45Ordinal scale
Education status of farmers’ female children%QTLSocialQ.S.9.0710.5411.1712.56.36Ordinal scale
Access to electronic media%QTLSocialQ.S.7.789.179.39103.08Ordinal scale
EconomicFarm profitability (previously it was Income from agro ecosystem)$QTLEconomicQ.S.648.233340.551371.321992.391025.06Ratio scale
Average wage of farm labourer ($)$/person/dayQTLEconomicQ.S.1.331.331.601.801.60Ratio scale
Livelihood diversity other than agricultureCount, 0 to 5QTLEconomicQ.S.6.224.335.934.556.92Ordinal scale
Years of economic hardshipNo. of yearQTLEconomicQ.S.0.730.730.910.820.64Ordinal scale
Road network (establishing farm roads and access roads)access/not accessQTLEconomic/socialQ.S.23331Nominal scale
HealthSettings where treatment is taken or public health%QTLSocialQ.S.3.514.764.078.144.29Ordinal scale
Sanitation or public health%QTLsocialQ.S.7.698.737.597.417.08Ordinal scale
GenderWomen’s involvement in decision making about agricultural activities%QTLSocialQ.S.3456.52.5Ordinal scale
Gender-based wage differentials$/person/dayQTLEconomicQ.S.0.330.330.50.590Ratio scale
Legend: QTL = Quantitative; Q.S. = Questionnaire survey.

References

  1. International Council for Science (ICSU); International Social Science Council (ISSC). Review of the Sustainable Development Goals: The Science Perspective; International Council for Science (ICSU): Paris, France, 2015; Available online: http://www.icsu.org/publications/reports-and-reviews/review-of-targets-for-the-sustainable-development-goals-the-science-perspective-2015/SDG-Report.pdf (accessed on 10 July 2016).
  2. Astier, M.; García-Barrios, L.; Galván-Miyoshi, Y.; González-Esquivel, C.E.; Masera, O.R. Assessing the Sustainability of Small Farmer Natural Resource Management Systems. A Critical Analysis of the MESMIS Program. Ecol. Soc. 2012, 17, 25. [Google Scholar]
  3. Pope, J.; Annandale, D.; Morrison-Saunders, A. Conceptualising sustainability assessment. Environ. Impact Assess. Rev. 2004, 24, 595–616. [Google Scholar] [CrossRef]
  4. IUCN—The World Conservation Union. IUCN Resource Kit for Sustainability Assessment. Part A: Overview Based on the Work of the IUCN /IDRC Sustainability Assessment Team Compiled and Written by Irene Guijt and Alex Moiseev with Robert Prescott-Allen. IUCN Monitoring and Evaluation Initiative, 2001. Available online: http://cmsdata.iucn.org/downloads/resource_kit_a_eng.pdf (accessed on 7 January 2015).
  5. Food and Agriculture Organization (FAO). Sustainability Assessment of Food and Agriculture Systems (SAFA) Guidelines; Natural Resources Management and Environment Department: Rome, Italy, 2012; Available online: http://www.fao.org/fileadmin/templates/nr/sustainability_pathways/docs/Reflections_SAFA_E_Forum_2012_final.pdf (accessed on 20 July 2015).
  6. Van Cauwenbergh, N.; Biala, K.; Bielders, C.; Brouckaert, V.; Franchois, L.; Garcia Cidad, V.; Hermy, M.; Mathijs, E.; Muys, B.; Reijnders, J.; et al. SAFE—A hierarchical framework for assessing the sustainability of agricultural systems. Agric. Ecosyst. Environ. 2007, 120, 229–242. [Google Scholar] [CrossRef]
  7. Häni, F.; Braga, F.; Stämpfli, A.; Keller, T.; Fischer, M.; Porsche, H. RISE, a tool for holistic sustainability assessment at the farm level. Int. Food Agribus. Manag. Rev. 2003, 6, 78–90. [Google Scholar]
  8. Eriksson, I.S.; Elmquist, H.; Nybrant, T. SALSA: A simulation tool to assess ecological sustainability of agricultural production. AMBIO 2005, 34, 388–392. [Google Scholar] [CrossRef] [PubMed]
  9. Gomez-Limon, J.A.; Sanchez-Fernandez, G. Empirical evaluation of agricultural sustainability using composite indicators. Ecol. Econ. 2010, 69, 1062–1075. [Google Scholar] [CrossRef]
  10. Zahm, F.; Viaux, P.; Vilain, L.; Girardin, P.; Mouchet, C. Assessing farm sustainability with the IDEA method-from the concept of agriculture sustainability to case studies on farms. Sustain. Dev. 2008, 16, 271–281. [Google Scholar] [CrossRef]
  11. Van Ittersum, M.K.; Ewert, F.; Heckelei, T.; Wery, J.; Olsson, J.A.; Andersen, E.; Bezlepkina, I.; Brouwer, F.; Donatelli, M.; Olsson, L. Integrated assessment of agricultural systems—A component-based framework for the European Union (SEAMLESS). Agric. Syst. 2008, 96, 150–165. [Google Scholar] [CrossRef]
  12. Dantsis, T.; Douma, C.; Giourga, C.; Loumou, A.; Polychronaki, E.A. A methodological approach to assess and compare the sustainability level of agricultural plant production systems. Ecol. Indic. 2010, 10, 256–263. [Google Scholar] [CrossRef]
  13. Talukder, B.; Saifuzzaman, M.; vanLoon, G.W. Sustainability of agricultural systems in the coastal zone of Bangladesh. Renew. Agric. Food Syst. 2016, 31, 148–165. [Google Scholar] [CrossRef]
  14. Velasquez, M.; Hester, P.T. An analysis of multi-criteria decision making methods. Int. J. Oper. Res. 2013, 10, 56–66. [Google Scholar]
  15. Cinelli, M.; Coles, S.R.; Kirwan, K. Analysis of the potentials of multi criteria decision analysis methods to conduct sustainability assessment. Ecol. Indic. 2014, 46, 138–148. [Google Scholar] [CrossRef]
  16. Köksalan, M.; Wallenius, J.; Zionts, S. Multiple Criteria Decision Making: From Early History to the 21st Century; World Scientific: Singapore, 2011. [Google Scholar]
  17. Ishizaka, A.; Pearman, C.; Nemery, P. AHP Sort: An AHP-based method for sorting problems. Int. J. Prod. Res. 2012, 50, 4767–4784. [Google Scholar] [CrossRef] [Green Version]
  18. Hipel, K.W.; Radford, K.J.; Fang, L. Multiple Participant‑Multiple Criteria Decision Making. IEEE Trans. Syst. Man Cybern. 1993, 23, 1184–1189. [Google Scholar] [CrossRef]
  19. Herath, G.; Prato, T. Role of Multi-Criteria Decesion making in Natual Resource Management. In Using Multi-Criteria Decision Analysis in Natural Resource Management; Herath, G., Prato, T., Eds.; Ashgate Publishing, Ltd.: Farnham, UK, 2006. [Google Scholar]
  20. Chen, Y.; Kilgour, D.M.; Hipel, K.W. Screening in multiple criteria decision analysis. Decis. Support Syst. 2008, 45, 278–290. [Google Scholar] [CrossRef]
  21. Keeney, R.; Raiffa, H. Decisions with Multiple Objectives: Preferences and Value Tradeoffs; Cambridge University Press: New York, NY, USA, 1993. [Google Scholar]
  22. Brans, J.P.; Mareschal, B. PROMETHEE methods. In Multiple Criteria Decision Analysis: State of the Art Surveys; Springer: New York, NY, USA, 2005; pp. 163–186. [Google Scholar]
  23. Kuang, H.; Kilgour, D.M.; Hipel, K.W. Grey-based PROMTHEE II with Application to Evaluation of Source Water Protection Strategies. Inf. Sci. 2015, 294, 376–389. [Google Scholar] [CrossRef]
  24. Figueira, J.; Mousseau, V.; Roy, B. ELECTRE methods. In Multiple Criteria Decision Analysis: State of the Art Surveys; Springer: New York, NY, USA, 2005; pp. 133–153. [Google Scholar]
  25. Saaty, T.L. The Analytic Hierarchy Process, New York: McGraw Hill. International, Revised ed.; RWS Publications: Pittsburgh, PA, USA, 2000. [Google Scholar]
  26. Saaty, T.L.; Peniwati, K. Group Decision Making: Drawing out and Reconciling Differences; RWS Publications: Pittsburgh, PA, USA, 2013. [Google Scholar]
  27. Doumpos, M.; Grigoroudis, E. Multicriteria Decision Aid and Artificial Intelligence: Links, Theory and Applications; John Wiley & Sons: Hoboken, NJ, USA, 2013. [Google Scholar]
  28. Hipel, K.W. Fuzzy Multicriteria Modelling. Invited paper in Systems and Control Encyclopaedia, Theory, Technology and Applications; Singh, M.G., Ed.; Pergamon Press: Oxford, UK, 1987; pp. 1826–1829. [Google Scholar]
  29. MacCrimmon, K.R. An Overview of Multiple-Objective Decision-Making. In Multiple-Criteria Decision-Making; Cochrance, J.L., Zeleny, M., Eds.; University of South Carolina Press: Columbia, SC, USA, 1973; pp. 18–44. [Google Scholar]
  30. Radford, K.J. Individual and Small Group Decisions; Springer: New York, NY, USA, 1989. [Google Scholar]
  31. Chen, Y. Multiple Criteria Decision Analysis: Classification Problems and Solutions. Ph.D. Dissertation, University of Waterloo, Waterloo, ON, Canada, 2006. [Google Scholar]
  32. Ma, J.; Hipel, K.W.; De, M.; Cai, J. Transboundary water policies: Assessment, comparison and enhancement. Water Resour. Manag. 2008, 22, 1069–1087. [Google Scholar] [CrossRef]
  33. Acosta-Alba, I.; Van der Werf, H.M.G. The use of reference values in indicator-based methods for the environmental assessment of agricultural systems. Sustainability 2011, 3, 424–442. [Google Scholar] [CrossRef]
  34. Hipel, K.H. Multiple Participant Multiple Criteria Decision Making; SYDE 433. Fall 2013. 396 Courseware; Waterloo University: Waterloo, ON, Canada, 2013. [Google Scholar]
  35. Talukder, B. Sustainability of Changing Agricultural Systems in the Coastal Zone of Bangladesh. Master’s Thesis, Queen’s University, Kingston, ON, Canada, 2012. [Google Scholar]
  36. Bangladesh Bureau of Statistics (BBS). 2012 Statistical Yearbook of Bangladesh; Ministry of Planning: Dhaka, Bangladesh, 2013. [Google Scholar]
  37. Van Loon, G.W.; Patil, S.G.; Hugar, L.B. Agricultural Sustainability: Strategies for Assessment; SAGE Publications: New Delhi, India, 2005. [Google Scholar]
  38. Hossain, M.S.; Uddin, M.J.; Fakhruddin, A.N. M. Impacts of shrimp farming on the coastal environment of Bangladesh and approach for management. Rev. Environ. Sci. Bio/Technol. 2013, 12, 313–332. [Google Scholar] [CrossRef]
  39. Rahman, S.; Barmon, B.K. Energy productivity and efficiency of the ‘gher’ (prawn-fish-rice) farming system in Bangladesh. Energy 2012, 43, 293–300. [Google Scholar] [CrossRef]
  40. Munda, G. Social Multi-Criteria Evaluation for a Sustainable Economy; Springer: Berlin, Germany, 2008. [Google Scholar]
  41. Marta-Costa, A.A.; Silva, E. Methods and Procedures for Building Sustainable Farming Systems: Application in the European Context; Springer Science and Business Media: Berlin, Germany, 2012. [Google Scholar]
Figure 1. Steps in Elimination Method. Source: Based on [32,34].
Figure 1. Steps in Elimination Method. Source: Based on [32,34].
Sustainability 09 00287 g001
Figure 2. Location of the study areas in Bangladesh [35].
Figure 2. Location of the study areas in Bangladesh [35].
Sustainability 09 00287 g002
Figure 3. Ranking of the agricultural systems.
Figure 3. Ranking of the agricultural systems.
Sustainability 09 00287 g003
Table 1. Selected agricultural sustainability assessment methods/approaches.
Table 1. Selected agricultural sustainability assessment methods/approaches.
Name of MethodPurposeSome AdvantagesSome Disadvantages
SAFA (Sustainability Assessment of Food and Agricultural Systems) [5]It is a guideline for Sustainability Assessment of Food and Agriculture Systems. It is a general framework for assessing sustainability of food and agriculture systems and takes an umbrella approach. It builds on existing systems that facilitate transparency. It assesses performance, not improvements of the system.It supports a sustainability management that facilitates progress towards production to processing and distribution of food and agricultural products. The guiding vision of this method is to promote sustainable agriculture systems characterised by “environmental integrity, economic resilience, social well-being and good governance” [5] (p. 1). It is a globally applicable template. It is credible because of institutional independence [5].It is in the development process and has been applied in few studies. Not all indicators are acceptable by all farming systems of the world.
SAFE [6] (A hierarchical framework for assessing the sustainability of agricultural systems)SAFE is a dependable and wide-ranging framework of principles, criteria and indicators and reference values structured for sustainability assessment of agricultural systems. It identifies, develops and evaluates the production systems, techniques and policies of agriculture.The framework is capable of assessing agricultural sustainability at the parcel, farm and higher spatial levels. It is developed in a hierarchical and structured way so it is able to assess the sustainability of agricultural systems. It encompasses the three dimensions of sustainability.It is not designed to find an answer of agricultural sustainability as a whole. It does not measure the interaction of the three SD’s pillars.
RISE [7] (Response-Inducing Sustainability Evaluation model)A tool that allows easy assessment of sustainability at the farm level.It offers a holistic approach by covering agricultural sustainability aspects (ecological, economic and social). It is able to quantify the sustainability level of agricultural systems. It is globally applicable.It is based on 12 indicators only. It does not measure the interaction of the indicators.
SALSA (A Simulation Tool to Assess Ecological Sustainability of Agricultural Production) [8]It helps to assess the ecological sustainability of a farm’s agricultural production system. It is based on life-cycle assessment methodology.It helps in complex studies of agricultural production systems as it is able to capture the consequences of agricultural production management options.Concentrates on environmental issues only. Used in Switzerland.
EVAS (Empirical Evaluation of Agricultural Sustainability) [9]It aims to develop a practical methodology for evaluating the sustainability of farms by means of composite indicators.It evaluates and aims to improve the three dimensions of farm sustainability. This assessment helps to improve current agriculture-related policies such as income, agricultural structure and rural development.Only 16 indicators cover the three components of the sustainability concept.
IDEA (Indicateurs de Durabilité des Exploitations Agricoles or Farm Sustainability Indicators) [10]The IDEA method is based on research work conducted since 1998 in France. It gives a practical expression to the concept of sustainable farms. This method supports farmers as well as policy makers to assess sustainable agriculture and support it. It is based on the three different scales of sustainability.It provides an operational tool for sustainability assessment at the farm level through 41 sustainability indicators covering the three dimensions of sustainability. It can be linked with the Farm Accounting Data Network of France which opens an interesting possibility to assess the sustainability levels of different farming systems. It concentrates on economic viability, social liveability and environmental reproducibility.There are many models of farm sustainability, therefore while using this method the indicators must be adapted to local farming. It is based on a case study in France.
SEAMLESS (Integrated assessment of agricultural systems—A component-based framework for the European Union) [11]This framework “aims to assess, ex-ante, agricultural and agri-environmental policies and technologies across a range of scales, from field-farm to region up to the European Union, as well as some global interactions”. “It links individual model and data components and a software infrastructure that allows a flexible (re-) use and linkage of components” [11] (p. 150).“It addresses the four identified challenges for integrated assessment tools, i.e., linking micro and macro analysis, assessing economic, environmental, social and institutional indicators, (re-)using standalone model components for field, farm and market analysis and their conceptual and technical linkage” [1] (p.150).Based on the European context.
Table 2. Scoring of criteria and rules of reference values.
Table 2. Scoring of criteria and rules of reference values.
CategorySl. No.CriteriaReference ValuesAgricultural Systems
SSRRIT
Productivity1Weighted yield of the main staple crop6.512.264.415.236.512.86
2Net income from the agro-ecosystem1806.04311.151020.371585.811806.04544.01
3Protein yield from the agro-ecosystem55268.42147.23552373.01318.87
Stability4Land exposure to natural events: cyclone212221
5Land exposure to natural events: saline water311323
6Land exposure to natural events: drought in kharif to rabi season3.51.51.5223.5
7Land exposure to natural events: river bank erosion222221
8Stability of embankment212122
9Withdrawal of upstream water211112
10Organic materials444232
11Salinity615636
12Macronutrient: N222212
13Macronutrient: P332333
14Macronutrient: K664324
15Soil pH413424
16Water salinity in surface water (quality of surface water for irrigation)312223
17Water salinity in ground water (quality of ground water for irrigation)412243
18Arsenic concentration (quality of ground water for irrigation)422224
Efficiency19Money input and output in the agro-ecosystem6.671.532.242.786.672.29
20Overall energy efficiency5.91.372.015.535.545.9
21Non-renewable energy efficiency2.520.780.922.172.522.44
Durability22Chemical response to pest stress6.541.784.174.245.456.54
23Water availability at transplanting stage of rice0.750.750.750.20.20.2
24Water availability at flowering stage of rice0.750.750.750.20.20.2
25Farm management (soil test, pest management, land management, soil fertility management)1.690.670.831.691.360
26Good product price8.448.4454.584.553.8
27Availability of seeds109.339.510108.85
28Availability of market (market diversification)10109.178.47107.69
29Agricultural training2.271.331.830.332.271.15
30Climate change awareness1.821.110.670.511.820
31Advice from agricultural extension workers or NGO1.170.661.170.510.450.38
Compatibility32Drinking water quality (protected)10089109
33Illness from drinking water10510101010
34Overall biodiversity condition: percentage of non-crop area23.017.546.4823.0115.7318.68
35Overall biodiversity condition: crop richness1726161017
36Overall biodiversity condition: crop rotation523544
37Ecosystem connectivity211222
Equity38Education of farmers108.569.254.75105
39Education status of farmers’ male children13.1109.4911.213.17.45
40Education status of farmers’ female children12.59.0710.5411.1712.56.36
41Access to electronic media107.789.179.39103.08
42Farm profitability3340.55648.233340.551371.321992.391025.06
43Average wage of farm labourer ($)1.81.331.331.61.81.6
44Livelihood diversity other than agriculture6.926.224.335.934.556.92
45Years of economic hardship0.910.730.730.910.820.64
46Road network [establishing farm roads and access roads]323331
47Availability of medical treatment or public health8.143.514.764.078.144.29
48Sanitation or public health8.737.698.737.597.417.08
49Women’s involvement in decision making about agricultural activities6.53456.52.5
50Gender-based wage differentials0.590.330.330.50.590
Table 3. Evaluation results after applying rules of Elimination Method.
Table 3. Evaluation results after applying rules of Elimination Method.
CategorySl. No.CriteriaReference ValuesAgricultural Systems
SSRRIT
Productivity1Weighted yield of the main staple crop6.51XXX X
2Net income from the agro-ecosystem1806.04XXX X
3Protein yield from the agro-ecosystem552XX XX
Stability4Land exposure to natural events: cyclone2X X
5Land exposure to natural events: saline water3XX X
6Land exposure to natural events: drought in kharif to rabi season3.5XXXX
7Land exposure to natural events: river bank erosion2 X
8Stability of embankment2X X
9Withdrawal of upstream water2XXXX
10Organic materials4 XXX
11Salinity6XX X
12Macronutrient: N2 X
13Macronutrient: P3 X
14Macronutrient: K6 XXXX
15Soil pH4XX X
16Water salinity in surface water (quality of surface water for irrigation)3XXXX
17Water salinity in ground water (quality of ground water for irrigation)4XXX X
18Arsenic concentration (quality of ground water for irrigation)4XXXX
Efficiency19Money input and output in the agro-ecosystem6.67XXX X
20Overall energy efficiency5.9XXXX
21Non-renewable energy efficiency2.52XXX X
Durability22Chemical response to pest stress6.54XXXX
23Water availability at transplanting stage of rice0.75 XXX
24Water availability at flowering stage of rice0.75 XXX
25Farm management (soil test, pest management, land management, soil fertility management)1.69XX XX
26Good product price8.44 XXXX
27Availability of seeds10XX X
28Availability of market (market diversification)10 XX X
29Agricultural training2.27XXX X
30Climate change awareness1.82XXX X
31Advice from agricultural extension workers or NGO1.17X XXX
Compatibility32Drinking water quality (protected)10XXX X
33Illness from drinking water10X
34Overall biodiversity condition: percentage of non-crop area23.01XX Xx
35Overall biodiversity condition: crop richness17XXXX
36Overall biodiversity condition: crop rotation5XX XX
37Ecosystem connectivity2XX
Equity38Education of farmers10XXX X
39Education status of farmers’ male children13.1XXX X
40Education status of farmers’ female children12.5XXX X
41Access to electronic media10XXX X
42Farm profitability 3340.55X XXX
43Average wage of farm labourer ($)1.8XXX X
44Livelihood diversity other than agriculture6.92XXXX
45Years of economic hardship0.91XX XX
46Road network (establishing farm roads and access roads)3X X
47Availability of medical treatment or public health8.14XXX X
48Sanitation or public health8.73X XXX
49Women’s involvement in decision making about agricultural activities6.5XXX X
50Gender-based wage differentials0.59XXX X
Note: Yellow, gray, blue, green and red colors represent degree of fulfilment of the reference values by the criteria in each category of ‘S’, ‘SR’, ‘R’, ‘I’, and ‘T’, respectively. X = non-fulfilment of the reference values.

Share and Cite

MDPI and ACS Style

Talukder, B.; Blay-Palmer, A.; Hipel, K.W.; VanLoon, G.W. Elimination Method of Multi-Criteria Decision Analysis (MCDA): A Simple Methodological Approach for Assessing Agricultural Sustainability. Sustainability 2017, 9, 287. https://doi.org/10.3390/su9020287

AMA Style

Talukder B, Blay-Palmer A, Hipel KW, VanLoon GW. Elimination Method of Multi-Criteria Decision Analysis (MCDA): A Simple Methodological Approach for Assessing Agricultural Sustainability. Sustainability. 2017; 9(2):287. https://doi.org/10.3390/su9020287

Chicago/Turabian Style

Talukder, Byomkesh, Alison Blay-Palmer, Keith W. Hipel, and Gary W. VanLoon. 2017. "Elimination Method of Multi-Criteria Decision Analysis (MCDA): A Simple Methodological Approach for Assessing Agricultural Sustainability" Sustainability 9, no. 2: 287. https://doi.org/10.3390/su9020287

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop