<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v2.3 20070202//EN" "journalpublishing.dtd">
<article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" xml:lang="en" article-type="research-article">
  <front>
    <journal-meta>
      <journal-id journal-id-type="publisher-id">ijgi</journal-id>
      <journal-title>ISPRS International Journal of Geo-Information</journal-title>
      <abbrev-journal-title abbrev-type="publisher">IJGI</abbrev-journal-title>
      <abbrev-journal-title abbrev-type="pubmed">IJGI</abbrev-journal-title>
      <issn pub-type="epub">2220-9964</issn>
      <publisher>
        <publisher-name>MDPI</publisher-name>
      </publisher>
    </journal-meta>
    <article-meta>
      <article-id pub-id-type="doi">10.3390/ijgi1030272</article-id>
      <article-id pub-id-type="publisher-id">ijgi-01-00272</article-id>
      <article-categories>
        <subj-group>
          <subject>Article</subject>
        </subj-group>
      </article-categories>
      <title-group>
        <article-title>A Spatial Multi-Criteria Model for the Evaluation of Land Redistribution Plans </article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <name>
            <surname>Demetriou</surname>
            <given-names>Demetris</given-names>
          </name>
          <xref rid="af1-ijgi-01-00272" ref-type="aff">1</xref>
          <xref rid="c1-ijgi-01-00272" ref-type="corresp">*</xref>
        </contrib>
        <contrib contrib-type="author">
          <name>
            <surname>See</surname>
            <given-names>Linda</given-names>
          </name>
          <xref rid="af2-ijgi-01-00272" ref-type="aff">2</xref>
          <xref rid="af3-ijgi-01-00272" ref-type="aff">3</xref>
        </contrib>
        <contrib contrib-type="author">
          <name>
            <surname>Stillwell</surname>
            <given-names>John</given-names>
          </name>
          <xref rid="af1-ijgi-01-00272" ref-type="aff">1</xref>
        </contrib>
      </contrib-group>
      <aff id="af1-ijgi-01-00272"><label>1</label> School of Geography, University of Leeds, Leeds LS2 9JT, UK; Email: <email>j.c.h.stillwell@leeds.ac.uk</email></aff>
      <aff id="af2-ijgi-01-00272"><label>2</label> International Institute of Applied Systems Analysis (IIASA), Schlossplatz 1, A-2361 Laxenburg, Austria; Email: <email>see@iiasa.ac.at</email> </aff>
      <aff id="af3-ijgi-01-00272"><label>3</label> Centre for Advanced Spatial Analysis (CASA), University College London (UCL), London WC1E 6BT, UK; Email: <email>l.see@ucl.ac.uk</email> </aff>
      <author-notes>
        <corresp id="c1-ijgi-01-00272"><label>*</label> Author  to whom correspondence should be addressed; Email: <email>demdeme@cytanet.com.cy</email>; Tel.: +357-99-428-462; Fax: +357-25-824-225.</corresp>
      </author-notes>
      <pub-date pub-type="epub">
        <day>09</day>
        <month>11</month>
        <year>2012</year>
      </pub-date>
      <pub-date pub-type="collection"><month>12</month>
        <year>2012</year>
      </pub-date>
      <volume>1</volume>
      <issue>3</issue>
      <fpage>272</fpage>
      <lpage>293</lpage>
      <history>
        <date date-type="received">
          <day>18</day>
          <month>08</month>
          <year>2012</year>
        </date>
        <date date-type="rev-recd">
          <day>23</day>
          <month>10</month>
          <year>2012</year>
        </date>
        <date date-type="accepted">
          <day>26</day>
          <month>10</month>
          <year>2012</year>
        </date>
      </history>
      <permissions>
        <copyright-statement>©  2012 by the authors; licensee MDPI, Basel, Switzerland.</copyright-statement>
        <copyright-year>2012</copyright-year>
        <license xmlns:xlink="http://www.w3.org/1999/xlink" license-type="open-access" xlink:href="http://creativecommons.org/licenses/by/3.0/">
          <p>This article is an open-access article distributed under the terms and conditions of the Creative Commons Attribution license (http://creativecommons.org/licenses/by/3.0/).</p>
        </license>
      </permissions>
      <abstract>
        <p>A planning support system for land consolidation has been developed that has, at its heart, an expert system called LandSpaCES (Land Spatial Consolidation Expert System) which contains a “design module” that generates alternative land redistributions under different scenarios and an “evaluation module” which integrates GIS with multi-criteria decision making for assessing these alternatives. This paper introduces the structural framework of the latter module which has been applied using a case study in Cyprus. Two new indices are introduced: the “parcel concentration coefficient” for measuring the dispersion of parcels; and the “landowner satisfaction rate” for predicting the acceptance of the land redistribution plan by the landowners in terms of the location of their new parcels. These two indices are used as criteria for the evaluation of the land redistribution alternatives and are transferable to any land consolidation project. Moreover, a modified version of the ratio estimation procedure, referred to as the “qualitative rating method” for assigning weights to the evaluation criteria, is presented, along with a set of non-linear value functions for standardizing the performance scores of the alternatives and incorporating expert knowledge for five evaluation criteria. The application of the module showed that it is a powerful new tool for the evaluation of alternative land redistribution plans that could be implemented in other countries after appropriate adjustments. A broader contribution has also been made to spatial planning processes, which might follow the methodology and innovations presented in this paper.</p>
      </abstract>
      <kwd-group>
        <kwd>land consolidation</kwd>
        <kwd>multi-attribute decision making</kwd>
        <kwd>parcel concentration coefficient</kwd>
        <kwd>landowner satisfaction rate</kwd>
        <kwd>qualitative rating method</kwd>
        <kwd>value functions</kwd>
        <kwd>GIS</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec sec-type="intro">
      <title>1. Introduction</title>
      <p>Land fragmentation occurs when single landholdings consist of numerous spatially separated land parcels [<xref ref-type="bibr" rid="B1-ijgi-01-00272">1</xref>]. Land consolidation is considered to be the most effective land management approach for solving this problem and is undertaken in many countries around the world [<xref ref-type="bibr" rid="B2-ijgi-01-00272">2</xref>,<xref ref-type="bibr" rid="B3-ijgi-01-00272">3</xref>]. Land consolidation includes the process of land reallocation, which can itself be divided into two sub-processes, land redistribution and land partitioning. Land redistribution comprises the preparation of a preliminary plan to restructure land parcels in terms of their number, ownership, size, value and approximate location based on legislation, the existing land tenure structure, rules of thumb and the experience of the planner. For example, in Cyprus, the development of such a plan requires that a team of land consolidation planners meet with each land owner in order to understand their preferences, the most important aspect being where their new parcels should be located. An acceptable plan, determined from a set of alternatives is then drawn up, which forms the basis of land partitioning in which new parcels are created that consolidate the land holdings and minimize the amount of spatial separation between the parcels belonging to each landowner. </p>
      <p>One problem with the land consolidation process is the amount of time needed to complete each land consolidation project. For example, the average project duration is 8–16 years in Germany, 10–12 years in the Netherlands, 8–12 years in Finland and 5–7 years in Sweden [<xref ref-type="bibr" rid="B4-ijgi-01-00272">4</xref>]. In Cyprus, a project takes on average from 6 to 10 years [<xref ref-type="bibr" rid="B5-ijgi-01-00272">5</xref>] with 2–3 years spent on the preparation of the land reallocation plan. The amount of time required is partly a function of the lack of adequate tools to support land consolidation, since proprietary geographic information systems (GIS) are not capable of handling the complexity involved. Demetriou <italic>et al. </italic> [<xref ref-type="bibr" rid="B6-ijgi-01-00272">6</xref>] have proposed a framework for an integrated planning and decision support system (IPDSS) which encapsulates the entire land reallocation process into an automated workflow. Using this framework embedded within a GIS environment, the LAnd CONsolidation Integrated Support System for planning and decision making (<italic>LACONISS</italic>) system was developed, which consists of three main sub-systems: a Land Fragmentation System (<italic>LandFragmentS</italic>) [<xref ref-type="bibr" rid="B7-ijgi-01-00272">7</xref>]; a Land Spatial Consolidation Expert System (<italic>LandSpaCES</italic>) [<xref ref-type="bibr" rid="B8-ijgi-01-00272">8</xref>]; and a Land Parcelling System (<italic>LandParcelS</italic>) [<xref ref-type="bibr" rid="B9-ijgi-01-00272">9</xref>].</p>
      <p>This paper is specifically concerned with a methodology for evaluation but we must acknowledge that evaluation in the context of land consolidation may have different meanings according to whether it refers to suitability evaluation, comprehensive project evaluation or land reallocation plan evaluation. Suitability evaluation studies [<xref ref-type="bibr" rid="B10-ijgi-01-00272">10</xref>,<xref ref-type="bibr" rid="B11-ijgi-01-00272">11</xref>,<xref ref-type="bibr" rid="B12-ijgi-01-00272">12</xref>] are carried out before project implementation and aim to investigate the potential for applying land consolidation. Comprehensive evaluation studies [<xref ref-type="bibr" rid="B13-ijgi-01-00272">13</xref>,<xref ref-type="bibr" rid="B14-ijgi-01-00272">14</xref>,<xref ref-type="bibr" rid="B15-ijgi-01-00272">15</xref>,<xref ref-type="bibr" rid="B16-ijgi-01-00272">16</xref>,<xref ref-type="bibr" rid="B17-ijgi-01-00272">17</xref>,<xref ref-type="bibr" rid="B18-ijgi-01-00272">18</xref>] are broad based and consider the potential impacts of the whole project usually in terms of three main components: economic efficiency which is related to the improvement of land fragmentation indices and the consequent agricultural benefits (e.g., production, productivity, farmers’ income); environmental impacts; and social impacts covering the potential project impacts to landowners or a group of people or to society as a whole. This kind of evaluation can be applied <italic>ex-ante</italic> or <italic>ex-post</italic> with the latter being the most usual case. The third type of evaluation, <italic>i.e.</italic>, land reallocation plan evaluation studies [<xref ref-type="bibr" rid="B19-ijgi-01-00272">19</xref>,<xref ref-type="bibr" rid="B20-ijgi-01-00272">20</xref>,<xref ref-type="bibr" rid="B21-ijgi-01-00272">21</xref>,<xref ref-type="bibr" rid="B22-ijgi-01-00272">22</xref>] has a narrow scope, focusing on the quality of the land reallocation plan during the design stage, <italic>i.e.</italic>, <italic>ex-ante</italic> evaluation. However, existing studies do not present any methodological developments in this area because they use isolated indices regarding land fragmentation such as the size, shape and dispersion of parcels and hence they do not provide a systematic method for evaluating land reallocation or land redistribution plans. One reason may be that land reallocation plans are usually generated manually, resulting in a single (although not necessarily optimal) solution. </p>
      <p>Thus, within the <italic>LACONISS</italic> system, the <italic>LandSpaCES</italic> sub-system consists of two components. The first is a “design module”, which is an expert system (ES) that can generate alternative land redistribution solutions [<xref ref-type="bibr" rid="B8-ijgi-01-00272">8</xref>] in an automated way. The second is an “evaluation module” that integrates GIS with a multi-attribute decision-making method (MADM) to evaluate these solutions efficiently and systematically according to the specific needs of each land consolidation project and to assist in the selection of an optimum solution. The purpose of this paper is to outline the methodology that we have developed for this evaluation process, which is embedded within <italic>LandSpaCES</italic> and which incorporates new concepts such as the “parcel concentration coefficient” (PCC) for characterizing parcel dispersion and the “landowner satisfaction rate” (LSR) which attempts to capture the preferences of each landowner in an automated way. The methodology is then demonstrated on a real land consolidation case study in Cyprus where ten alternative land redistribution solutions have been generated under a set of different scenarios. More details of the generation of these alternative land redistribution solutions can be found in Demetriou <italic>et al.</italic> [<xref ref-type="bibr" rid="B8-ijgi-01-00272">8</xref>].</p>
    </sec>
    <sec sec-type="methods">
      <title>2. Methodology</title>
      <p>The evaluation of alternative land redistribution plans uses multi-attribute decision making (MADM) methods [<xref ref-type="bibr" rid="B23-ijgi-01-00272">23</xref>,<xref ref-type="bibr" rid="B24-ijgi-01-00272">24</xref>] which attempt to find the best solution among a discrete number of alternative solutions. The process is illustrated in <xref ref-type="fig" rid="ijgi-01-00272-f001">Figure 1</xref> where initially a set of alternative land redistributions is generated and the planner has to select a set of evaluation criteria to assess these alternatives. This produces an effect table with the alternatives in columns and the criteria in rows. The performance of each alternative for each criterion is represented by a score that constitutes an element of the effect table located in a cell of the matrix. The scores are standardized to values between 0 and 1 (representing worst and best performances of alternatives, respectively) and weights are chosen for each criterion by the planner. The decision rules comprise the evaluation method utilized in order to rank the alternatives. Finally, a sensitivity analysis is carried out aimed at assessing the robustness of the ranking order followed by the output of a final recommendation about the most beneficial solution. Each component of the process is now explained in further detail in the sections that follow. The entire process described above has been embedded in a GIS environment (<italic>i.e</italic>., ArcGIS) by utilizing VBA and ArcObjects [<xref ref-type="bibr" rid="B25-ijgi-01-00272">25</xref>,<xref ref-type="bibr" rid="B26-ijgi-01-00272">26</xref>]. Several authors refer to the integration of multi-criteria methods with GIS [<xref ref-type="bibr" rid="B27-ijgi-01-00272">27</xref>,<xref ref-type="bibr" rid="B28-ijgi-01-00272">28</xref>,<xref ref-type="bibr" rid="B29-ijgi-01-00272">29</xref>,<xref ref-type="bibr" rid="B30-ijgi-01-00272">30</xref>]. The role of GIS is critical in both designing and evaluating the alternative solutions [<xref ref-type="bibr" rid="B8-ijgi-01-00272">8</xref>]. In terms of the latter, GIS automatically provides all the metrics of each alternative for each of the evaluation criteria involved, a task that would be impossible to carry out manually or through using conventional non-spatial systems since the spatial component of the problem significantly increases the complexity of the calculations.</p>
      <fig id="ijgi-01-00272-f001" position="anchor">
        <label>Figure 1</label>
        <caption>
          <p>General model of multi-attribute decision-making method (MADM) (adapted from Sharifi <italic>et al.</italic> [<xref ref-type="bibr" rid="B31-ijgi-01-00272">31</xref>]).</p>
        </caption>
        <graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="ijgi-01-00272-g001.tif"/>
      </fig>
      <sec>
        <title>2.1. Evaluation Criteria</title>
        <p>The selection of the appropriate criteria begins with the definition of a hierarchical objective tree specified via the goal, aims and objectives of the land consolidation problem [<xref ref-type="bibr" rid="B32-ijgi-01-00272">32</xref>]. Thereafter, a specific land redistribution objective tree can be formulated (<xref ref-type="fig" rid="ijgi-01-00272-f002">Figure 2</xref>) which contains the aims, objectives and the corresponding criteria/attributes, which can be used in the evaluation of the alternative land redistribution plans. </p>
        <p>Whilst <xref ref-type="fig" rid="ijgi-01-00272-f002">Figure 2</xref> shows nine possible criteria, Demetriou <italic>et al.</italic> [<xref ref-type="bibr" rid="B32-ijgi-01-00272">32</xref>] suggest that only the following five criteria are required: the mean size (as a percentage change before and after applying a solution) of the new parcels (C1); the mean parcel concentration coefficient (C2); the change (as a percentage) in the number of landowners (C3); the percentage of ownerships “completed” involving the percentage of ownerships that had less than the minimum size limit provided by legislation and “complete” to reach that minimum limit (C4); and the mean landowner satisfaction rate (C5). Both the PCC and LSR are new concepts, which are explained in more detail below.</p>
        <fig id="ijgi-01-00272-f002" position="anchor">
          <label>Figure 2</label>
          <caption>
            <p>The objective tree for the land redistribution problem. </p>
          </caption>
          <graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="ijgi-01-00272-g002.tif"/>
        </fig>
        <sec>
          <title>2.1.1. Parcel Concentration Coefficient (<italic>PCC</italic>)</title>
          <p>A basic measure of spatial dispersion is standard distance which is the spatial equivalent of the standard deviation, showing how locations or points are scattered around the spatial mean [<xref ref-type="bibr" rid="B33-ijgi-01-00272">33</xref>,<xref ref-type="bibr" rid="B34-ijgi-01-00272">34</xref>]. The spatial mean or mean center of gravity is an important spatial statistical measure of central tendency which indicates the average location of a set of points defined in a Cartesian coordinate system. Thus, standard distance measures the degree to which parcels (or more precisely the centroids of parcels) are concentrated or dispersed around their geometric mean. Although, in practice, the dispersion of holdings is dependent on the location of the farmstead or the village where the farmer resides, and in this case transport distances could be calculated based on some assumptions [<xref ref-type="bibr" rid="B21-ijgi-01-00272">21</xref>], the extra information needed is usually not available, so the mean center of parcels of a holding is a proxy criterion that gives an adequate representation of the dispersion before and after land consolidation. </p>
          <p>An extension of both statistics is the weighted mean center and the weighted standard distance where centroids may have different attribute values representing the different sizes or land values of each parcel. For instance, if the largest parcels of a holding are very much dispersed in terms of location, this may have greater negative effects on production, productivity, labor and hence the income of farmer, than if the smaller parcels are dispersed [<xref ref-type="bibr" rid="B19-ijgi-01-00272">19</xref>]. Thus, the weighted mean center of a holding is a better indicator than the simple mean center because it reflects not only the spatial dispersion of parcels but also the agricultural importance of each parcel.</p>
          <p>Expressing these spatial statistics in the context of land consolidation, the mean center of the parcels of a holding can be expressed as: <disp-formula id="ijgi-01-00272-i003"><inline-graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="ijgi-01-00272-i003.tif"/><label>(1)</label></disp-formula> where <italic>x<sub>hmc</sub></italic> and <italic>y<sub>hmc</sub></italic> are the co-ordinates of the mean center of the holding; <italic>x<sub>i</sub></italic> and <italic>y<sub>i</sub></italic> are the co-ordinates of the centroid of parcel <italic>i</italic>; and <italic>n</italic> is the number of parcels belonging to a holding. The weighted mean center of a holding can be calculated in a similar way as: <disp-formula id="ijgi-01-00272-i004"><inline-graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="ijgi-01-00272-i004.tif"/><label>(2)</label></disp-formula> where <italic>x<sub>whmc</sub></italic> and <italic>y<sub>whmc</sub></italic> are the co-ordinates of the weighted mean center of the holding and <italic>w<sub>i</sub></italic> is the weight of each parcel <italic>i</italic>. From these quantities, the dispersion of parcels (<italic>DoP</italic>) and the weighted version of <italic>DoP </italic>can be calculated as: <disp-formula id="ijgi-01-00272-i005"><inline-graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="ijgi-01-00272-i005.tif"/><label>(3)</label></disp-formula><disp-formula id="ijgi-01-00272-i006"><inline-graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="ijgi-01-00272-i006.tif"/><label>(4)</label></disp-formula> where both measures have been utilized previously by Tourino <italic>et al.</italic> [<xref ref-type="bibr" rid="B19-ijgi-01-00272">19</xref>]. However, the disadvantage of these measures is that they may vary across an unlimited range of values with no explicit extreme values, which renders interpretation difficult. In this research, a new indicator is developed called the parcel concentration coefficient (<italic>PCC</italic>) for each holding which is measured on a scale between −1 and 1. A value of zero indicates no change in the dispersion of a holding’s parcels before and after land consolidation. The value of +1 refers to the situation of “perfect concentration” while −1 represents the “worst concentration”. The <italic>DoP</italic> can be calculated for each holding twice, <italic>i.e.</italic>, before (<italic>DoP<sub>b</sub></italic>) and after (<italic>DoP<sub>a</sub></italic>) land consolidation and then combined to calculate the PCC for three situations:
  <list list-type="order">
   <list-item>
    <p>If <italic>DoP<sub>b</sub></italic><italic> = DoP<sub>a</sub></italic> then <italic>PCC</italic> = 0 and the dispersion of parcels has not changed. </p>
	<p>In this situation, land consolidation has not achieved any concentration of parcels for the holding concerned independently of the number of new parcels allocated to a landowner (<italic>n</italic>') or the number of original parcels owned by the landowner (<italic>n</italic>).</p>
   </list-item>
   <list-item>
    <p>If <italic>DoP<sub>b</sub></italic> &gt;  <italic>DoP<sub>a</sub></italic> the <italic>PCC</italic> can be expressed as: <disp-formula id="ijgi-01-00272-i007"><inline-graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="ijgi-01-00272-i007.tif"/><label>(5)</label></disp-formula></p>
	<p>In this situation, an improvement in the dispersion of parcels has occurred. The maximum value of 1 means that parcels have been concentrated after land consolidation into a single parcel, <italic>i.e.</italic>, <italic>n</italic>' = 1 and perfect concentration has been achieved. This happens when the <italic>DoP<sub>a</sub></italic> equals 0 and consequently <italic>n</italic>' = 1. The numerator in Equation (5) represents the proportional change of dispersion before and after land consolidation of a holding. The denominator, <italic>i.e.</italic>, <italic>n</italic>', adjusts the proportional change in dispersion (the level of concentration) since the <italic>PCC</italic> increases as <italic>n</italic>' decreases. In other words, the higher <italic>n</italic>', the less the concentration of new parcels and hence <italic>PCC</italic> reduces towards a value of zero. </p>
   </list-item>
   <list-item>
    <p>If <italic>DoP<sub>b</sub></italic> &lt;  <italic>DoP<sub>a</sub></italic>, then the <italic>PCC</italic> is expressed as: <disp-formula id="ijgi-01-00272-i008"><inline-graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="ijgi-01-00272-i008.tif"/><label>(6)</label></disp-formula></p>
   </list-item>   
  </list>		  
		  </p>
          <p>In this situation, deterioration in the dispersion of parcels has occurred. This may occur when either <italic>n</italic>' is greater than <italic>n</italic> (which is a very rare case) and/or when the parcels have been allocated at greater distances. The extreme value of −1 means that the concentration of parcels after land consolidation has worsened independent of the number of new parcels allocated since the basic aim of concentrating parcels via land consolidation has completely failed. This happens when the <italic>DoP<sub>b</sub></italic> equals 0 and consequently <italic>n</italic> = 1. The denominator <italic>n</italic> adjusts the proportional change in dispersion, <italic>i.e.</italic>, the level of concentration, since the <italic>PCC</italic> increases as <italic>n</italic> increases. In other words, the greater the value of <italic>n</italic>, the less extreme the difference (before and after a project) in parcel concentration and hence <italic>PCC</italic> reduces towards zero because the dispersion was already poor. </p>
        </sec>
        <sec>
          <title>2.1.2. Landowner Satisfaction Rate (<italic>LSR</italic>)</title>
          <p>The landowner satisfaction rate (<italic>LSR</italic>) is an indicator that captures the satisfaction of the landowners with regard to their preferences in terms of the location of their new parcels. It is based on the parcel priority index (<italic>PPI</italic>) introduced in Demetriou <italic>et al.</italic> [<xref ref-type="bibr" rid="B8-ijgi-01-00272">8</xref>], which ranks the preferences of the landowners regarding the locations of the new parcels they wish to receive. The calculation of the <italic>LSR</italic> involves determining which preferences of each landowner have been satisfied and assigns a proportional percentage of satisfaction (called the partial satisfaction rate, <italic>PSR</italic>) to each new parcel depending on the ranking of the preference satisfied, with a maximum of 100%. A critical point in this process is that the original parcels of a landowner (<italic>n</italic>), which are already in preference ranking order, are divided into two parts. The first covers the situation up to <italic>n</italic>' whilst the other part covers the situation for the rest of the parcels, <italic>i.e.</italic>, from <italic>n</italic>−<italic>n</italic>'. Thus, if a new parcel falls in the first part, the PSR will be 100% but if it falls in the second part, then the PSR is assigned proportionally, <italic>i.e.</italic>, reduced, depending on <italic>n</italic> and <italic>n</italic>′. This can be expressed mathematically as follows: </p>
          <p>If <italic>n </italic>≥<italic>n</italic>' then the <italic>PSR</italic> for each new parcel <italic>i</italic> allocated to a landowner can be calculated as follows: <disp-formula id="ijgi-01-00272-i009"><inline-graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="ijgi-01-00272-i009.tif"/><label>(7)</label></disp-formula> where <italic>m<sub>i</sub></italic> is a variable that takes into account the number of parcels originally owned by a landowner (<italic>n</italic>) and the rank order of the preference of each original parcel <italic>i </italic>(<italic>RO<sub>i</sub></italic>), and <italic>P</italic> is a linear function that expresses decreasing satisfaction for each landowner. The two variables, <italic>m<sub>i</sub></italic> and <italic>P</italic> are computed as follows:<disp-formula id="ijgi-01-00272-i010"><inline-graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="ijgi-01-00272-i010.tif"/><label>(8)</label></disp-formula></p>
          <p><italic>Max</italic><italic><sub>mi</sub></italic> is the <italic>m<sub>i</sub></italic> value assigned to those new parcels that fall in the first part of original parcels as explained earlier. In this case, the parameter <italic>RO<sub>i</sub></italic> in Equation (8) is replaced by the number of new parcels (<italic>n</italic>') as follows: <disp-formula id="ijgi-01-00272-i011"><inline-graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="ijgi-01-00272-i011.tif"/><label>(9)</label></disp-formula></p>
          <p><italic>P</italic> is a constant percentage for the redistribution of each holding which is calculated based on the two parts mentioned earlier. In particular, the parcels that belong in the first part count as one sub-part whilst the parcels that belong in the second part count as a separate sub-part. Thus, <italic>P</italic> results by dividing 100% by the total number of sub-parts which always equals <italic>n−</italic><italic>n</italic>'+1. Therefore, <italic>P</italic> can be computed as: <disp-formula id="ijgi-01-00272-i012"><inline-graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="ijgi-01-00272-i012.tif"/><label>(10)</label></disp-formula></p>
          <p>Combining Equations (8) and (10) yields: <disp-formula id="ijgi-01-00272-i013"><inline-graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="ijgi-01-00272-i013.tif"/><label>(11)</label></disp-formula></p>
          <p>The total <italic>LSR</italic> for each landowner <italic>j</italic> is then calculated as the mean value of the <italic>PSR</italic>: <disp-formula id="ijgi-01-00272-i014"><inline-graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="ijgi-01-00272-i014.tif"/><label>(12)</label></disp-formula></p>
          <p>Similarly, the average <italic>LSR </italic>for the whole land consolidation area, <italic>i.e.</italic>, the whole project, can be calculated as the mean <italic>LSR</italic> of all landowners (<italic>l</italic>) who received property in the plan as follows: <disp-formula id="ijgi-01-00272-i015"><inline-graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="ijgi-01-00272-i015.tif"/><label>(13)</label></disp-formula></p>
          <p>The above assumptions become clearer by utilizing an example for calculating <italic>PSR</italic> and <italic>LSR</italic>. An example is provided in <xref ref-type="table" rid="ijgi-01-00272-t001">Table 1</xref> which involves a landowner who originally had five parcels (<italic>i.e</italic>., <italic>n</italic> = 5) and after land consolidation receives 1, 2 or 3 parcels (<italic>i.e.</italic>, <italic>n</italic>' = 1 to 3). Each cell of the table contains the PSR value for each combination of <italic>n</italic> and <italic>n</italic>'.</p>
          <table-wrap id="ijgi-01-00272-t001" position="float">
            <object-id pub-id-type="pii">ijgi-01-00272-t001_Table 1</object-id>
            <label>Table 1</label>
            <caption>
              <p>An example for the calculation of the partial satisfaction rate. </p>
            </caption>
            <table>
              <thead>
                <tr>
                  <th align="center" valign="middle"> </th>
                  <th colspan="3" align="center" valign="middle" style="border-bottom:solid thin">Number of New Parcels (<italic>n</italic>') Allocated to the Landowner</th>
                </tr>
                <tr>
                  <th align="center" valign="middle">
                    <italic>n</italic>
                  </th>
                  <th align="center" valign="middle">1</th>
                  <th align="center" valign="middle">2</th>
                  <th align="center" valign="middle">3</th>
                </tr>
              </thead>
              <tbody>
                <tr>
                  <td align="center" valign="middle">1</td>
                  <td align="center" valign="middle"><italic>maxM × P</italic> = 5<italic>× </italic>20 = 100%</td>
                  <td align="center" valign="middle"><italic>maxM × P</italic> = 4<italic>× </italic>25 = 100%</td>
                  <td align="center" valign="middle"><italic>maxM × P</italic> = 3<italic>× </italic>33.33 = 100%</td>
                </tr>
                <tr>
                  <td align="center" valign="middle">2</td>
                  <td align="center" valign="middle"><italic>M2 × P</italic> =(5 – 2 + 1)<italic>× </italic>20 = 80%</td>
                  <td align="center" valign="middle"><italic>maxM × P</italic> = 4<italic>× </italic>25 = 100%</td>
                  <td align="center" valign="middle"><italic>maxM × P</italic> = 3<italic>× </italic>33.33 = 100%</td>
                </tr>
                <tr>
                  <td align="center" valign="middle">3</td>
                  <td align="center" valign="middle"><italic>M3 × P</italic> = (5 – 3 + 1)<italic>× </italic>20 = 60%</td>
                  <td align="center" valign="middle"><italic>M3 × P</italic> = (5 – 3 +1 )<italic>× </italic>25 = 75%</td>
                  <td align="center" valign="middle"><italic>maxM × P</italic> = 3<italic>× </italic>33.33 = 100%</td>
                </tr>
                <tr>
                  <td align="center" valign="middle">4</td>
                  <td align="center" valign="middle"><italic>M4 × P</italic> = (5 – 4 + 1)<italic>× </italic>20 = 40%</td>
                  <td align="center" valign="middle"><italic>M4 × P</italic> = (5 – 4 + 1)<italic>× </italic>25 = 50%</td>
                  <td align="center" valign="middle"><italic>M4 × P</italic> = (5 – 4 + 1)<italic>× </italic>33.33 = 66.66%</td>
                </tr>
                <tr>
                  <td align="center" valign="middle">5</td>
                  <td align="center" valign="middle"><italic>M5 × P</italic> = (5 – 5 + 1)<italic>× </italic>20 = 20%</td>
                  <td align="center" valign="middle"><italic>M5 × P</italic> = (5 − 5 + 1)<italic>× </italic>25 = 25%</td>
                  <td align="center" valign="middle"><italic>M5 × P</italic> = (5 – 5 + 1)<italic>× </italic>33.33 = 33.33%</td>
                </tr>
              </tbody>
            </table>
          </table-wrap>
          <p>For example, if a landowner has been allocated one parcel (<italic>i.e</italic>., first column) in the same location as its fourth preference (<italic>i.e</italic>., fourth row), then the <italic>PSR</italic> and hence the <italic>LSR</italic> (because <italic>n</italic>' = 1) is 40%. Similarly, if the landowner has been allocated two parcels (<italic>i.e</italic>., second column), say in the same location as the first (<italic>i.e.</italic>, first row) and fourth preference (<italic>i.e</italic>., fourth row), then the <italic>PSR</italic> is 100% and 50% for the location of the first parcel and second parcel, respectively. In this case, the average <italic>LSR</italic> is calculated as 75%.</p>
        </sec>
      </sec>
      <sec>
        <title>2.2. Weighting the Criteria</title>
        <p>There are several methods available to weight the evaluation criteria including direct ranking; swing weights; ranking; rating; pairwise comparison; trade off analysis; and qualitative translation [<xref ref-type="bibr" rid="B23-ijgi-01-00272">23</xref>,<xref ref-type="bibr" rid="B31-ijgi-01-00272">31</xref>,<xref ref-type="bibr" rid="B35-ijgi-01-00272">35</xref>]. The most popular are the ranking and rating methods because of their simplicity. However, there are problems with assigning weights to a fine scale, e.g., to two decimal points in the direct ranking method. In addition, other ranking methods (e.g., the rank sum, rank reciprocal and rank exponent method) do not provide the potential to rank two or more criteria with equal importance, which is relevant for this problem. To develop a simple fit-for-purpose method that allows planners to assign weights while overcoming the aforementioned problems, a modified version of the ratio estimation procedure has been developed that uses a similar qualitative scale as found in pair-wise comparison method is hereafter called the “qualitative rating method”. The criteria are classified into the following seven classes of importance: extremely high; very high; high; intermediate; moderate; low; and very low, which are more intuitive to rank than a number or score, and the criteria may have the same importance using this method. Each class has a predefined range of importance from 0 to 100 as shown in <xref ref-type="table" rid="ijgi-01-00272-t002">Table 2</xref> but the rate of increase in importance in the lower part of the scale is 10 points whilst in the upper part it is double, <italic>i.e.</italic>, 20 points. This represents an imposed weighting in favor of the higher classes. Although this scoring seems arbitrary, in practice this is realistic since planners and decision makers tend to ignore the less important criteria in the decision-making process. After selecting the importance of each criterion, the weights are standardized based on the score assigned to each criterion so that the weights sum to 1. </p>
        <table-wrap id="ijgi-01-00272-t002" position="float">
          <object-id pub-id-type="pii">ijgi-01-00272-t002_Table 2</object-id>
          <label>Table 2</label>
          <caption>
            <p>The scale of importance and the relevant scores utilized by the qualitative rating method.</p>
          </caption>
          <table>
            <thead>
              <tr>
                <th align="center" valign="middle">Rank Order</th>
                <th align="center" valign="middle">Scale of Importance</th>
                <th align="center" valign="middle">Score</th>
                <th align="center" valign="middle">Classes</th>
              </tr>
            </thead>
            <tbody>
              <tr>
                <td align="center" valign="middle">1</td>
                <td align="center" valign="middle">Extremely high</td>
                <td align="center" valign="middle">100</td>
                <td rowspan="3" align="center" valign="middle">Upper</td>
              </tr>
              <tr>
                <td align="center" valign="middle">2</td>
                <td align="center" valign="middle">Very high</td>
                <td align="center" valign="middle">80</td>
              </tr>
              <tr>
                <td align="center" valign="middle">3</td>
                <td align="center" valign="middle">High</td>
                <td align="center" valign="middle">60</td>
              </tr>
              <tr>
                <td align="center" valign="middle">4</td>
                <td align="center" valign="middle">Intermediate</td>
                <td align="center" valign="middle">40</td>
                <td align="center" valign="middle">Middle</td>
              </tr>
              <tr>
                <td align="center" valign="middle">5</td>
                <td align="center" valign="middle">Moderate</td>
                <td align="center" valign="middle">30</td>
                <td align="center" valign="middle">Lower</td>
              </tr>
              <tr>
                <td align="center" valign="middle">6</td>
                <td align="center" valign="middle">Low</td>
                <td align="center" valign="middle">20</td>
                <td align="center" valign="middle"> </td>
              </tr>
              <tr>
                <td align="center" valign="middle">7</td>
                <td align="center" valign="middle">Very low</td>
                <td align="center" valign="middle">10</td>
                <td align="center" valign="middle"> </td>
              </tr>
            </tbody>
          </table>
        </table-wrap>
        <p>Whatever method is employed for assigning weights to criteria, the planner needs to be aware that the weights of the criteria should be aligned with the range of the corresponding performance scores [<xref ref-type="bibr" rid="B35-ijgi-01-00272">35</xref>,<xref ref-type="bibr" rid="B36-ijgi-01-00272">36</xref>]. In other words, the larger the range of a performance score for a criterion, the greater the importance (hence the weight) of that criterion in terms of its contribution in the ranking of alternatives. This is known as the range sensitivity principle [<xref ref-type="bibr" rid="B37-ijgi-01-00272">37</xref>]. </p>
      </sec>
      <sec>
        <title>2.3. Standardization Process</title>
        <p>Standardization (or normalization) is the process of transforming the scores of the evaluation criteria into the same scale so that they can be combined and compared. Several standardization methods have been developed, which generally fall into: linear scale transformations [<xref ref-type="bibr" rid="B23-ijgi-01-00272">23</xref>,<xref ref-type="bibr" rid="B31-ijgi-01-00272">31</xref>] and value/utility function approaches. Linear methods (maximum, interval and goal standardization) are most commonly adopted because of simplicity and a predefined behavior but they have two main disadvantages. First, they assume a linear association between the original values and the standardized values when, in practice, this relationship is more complex; and second, they ignore the judgments of the decision makers as they have no input in the development of the simple linear standardization functions that are commonly used. These limitations are overcome by using value functions, which encapsulate human judgment in a mathematical form. These functions translate the performance score of an alternative for a criterion into a value score between 0 and 1, representing the degree to which a certain decision objective is achieved. A number of methods have been developed for the creation of value functions. The most common are the midvalue, Evalue and direct rating methods [<xref ref-type="bibr" rid="B35-ijgi-01-00272">35</xref>]. The latter has been utilized in this research because of simplicity and flexibility in terms of assigning values that depend on the criterion concerned. Direct value rating involves the following five steps for each criterion: </p>
        <list list-type="order">
          <list-item>
            <p>Identify the minimum and maximum values of the criterion which correspond to values of 0 (worst) and 1 (best), respectively. In the context of this research, the minimum and maximum values for criteria C1, C3 and C4 were identified from 40 year statistical records provided by the Land Consolidation Department (LCD) of Cyprus for 74 land consolidation projects. For criteria C2 and C5, the minimum values are zero and the maximum values are 1 and 100%, respectively.</p>
          </list-item>
          <list-item>
            <p>Define characteristics of the value function, <italic>i.e.</italic>, monotonicity, shape, <italic>etc.</italic></p>
          </list-item>
          <list-item>
            <p>Assign values to selected criterion scores at equal intervals between the minimum and maximum.</p>
          </list-item>
          <list-item>
            <p>Fit a mathematical equation through these points using appropriate software.</p>
          </list-item>
          <list-item>
            <p>Validate the functions as representations of preference.</p>
          </list-item>
        </list>
        <p>The values functions for C1 to C5 for the Cyprus case study are presented in <xref ref-type="fig" rid="ijgi-01-00272-f003">Figure 3</xref>(a–e) and as Equations (14–18) respectively. </p>
        <p><xref ref-type="fig" rid="ijgi-01-00272-f003">Figure 3</xref>(a) shows a concave benefit value function for the mean percentage change in the size of parcels represented as: <disp-formula id="ijgi-01-00272-i016"><inline-graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="ijgi-01-00272-i016.tif"/><label>(14)</label></disp-formula></p>
        <p>The value function increases sharply from 0 to 0.8 since the latter value corresponds to 100%, a score considered by experts as easily achievable, and then gradually increases up to the maximum score of 600% which is the highest ever achieved in land consolidation projects. <xref ref-type="fig" rid="ijgi-01-00272-f003">Figure 3</xref>(b) is another concave benefit value function for mean <italic>PCC</italic>: <disp-formula id="ijgi-01-00272-i017"><inline-graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="ijgi-01-00272-i017.tif"/><label>(15)</label></disp-formula></p>
        <p>A maximum score of 1 which denotes perfect concentration of parcels whilst a minimum of 0 means that nothing has changed in terms of the parcel concentration after land consolidation. A mean <italic>PCC</italic> of more than 0.5 (which corresponds to a value of 0.8 or 80%) is highly satisfactory for the experts, since on most occasions, it is not always possible to join all the parcels of a holding into a single parcel.</p>
        <fig id="ijgi-01-00272-f003" position="anchor">
          <label>Figure 3</label>
          <caption>
            <p>The value functions for the evaluation criteria. </p>
          </caption>
          <graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="ijgi-01-00272-g003.tif"/>
        </fig>
        <p><xref ref-type="fig" rid="ijgi-01-00272-f003">Figure 3</xref>(c) shows a mixed bell-shaped benefit-cost value function for the percentage change in the number of landowners: <disp-formula id="ijgi-01-00272-i019"><inline-graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="ijgi-01-00272-i019.tif"/><label>(16)</label></disp-formula></p>
        <p>The curve increases rapidly from 0 to the peak (20%) where this range includes holdings that are much smaller in size than the minimum limits provided by legislation. These properties will be redistributed (by compensation) to the other landowners either mainly to “complete” their property at the minimum size or increase the size of other properties. The rest of the function then falls steeply from 20% to 40%, which represents a negative effect since a high percentage of landless landowners would be generated, with many not agreeing to leave their property for compensation.</p>
        <p><xref ref-type="fig" rid="ijgi-01-00272-f003">Figure 3</xref>(d) shows an s-shaped benefit value function for percentage of ownerships completed: <disp-formula id="ijgi-01-00272-i020"><inline-graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="ijgi-01-00272-i020.tif"/><label>(17)</label></disp-formula></p>
        <p>The convexity in the first part of the function (0 to 25%) represents a low satisfaction rate for the objective. The second linear section (25 to 40%) presents a significant increase in satisfaction where many land redistribution alternatives are expected to fall. The final concave section (40 to 60%) is the most desirable in terms of alternative performance but is the most difficult to achieve. The final benefit value function represents the mean <italic>LSR</italic> as a convex curve (<xref ref-type="fig" rid="ijgi-01-00272-f003">Figure 3</xref>(e)): <disp-formula id="ijgi-01-00272-i021"><inline-graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="ijgi-01-00272-i021.tif"/><label>(18)</label></disp-formula></p>
        <p>This function increases slowly from 0 to 60% corresponding to values of 0 to 0.3, respectively, representing low importance and then increases steeply between 60 to 90%, representing the most significant part of the function. Thus, the objective “to maximize the acceptance of the plan by the landowners” is achieved only at high values, <italic>i.e.</italic>, greater than 80%. </p>
      </sec>
      <sec>
        <title>2.4. Ranking the Alternatives</title>
        <p>A value function approach is then utilized for ordering the alternative land redistributions, which is the weighted average of the single attribute values: <disp-formula id="ijgi-01-00272-i022"><inline-graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="ijgi-01-00272-i022.tif"/><label>(19)</label></disp-formula> where <italic>V<sub>j</sub></italic> is the overall value (or performance score) of the <italic>j</italic>th alternative (<italic>j </italic>= 1 to <italic>M</italic>), <italic>v<sub>ij</sub></italic> is the standardized value of the score α<sub>ij</sub> of the <italic>j</italic>th alternative with respect to the <italic>i</italic>th criterion/attribute (<italic>i</italic> = 1 to <italic>N</italic>) measured by utilizing an appropriate value function, and <italic>w<sub>i</sub></italic> is the normalized weight for criterion/attribute <italic>i</italic> such that: <disp-formula id="ijgi-01-00272-i023"><inline-graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="ijgi-01-00272-i023.tif"/><label>(20)</label></disp-formula></p>
        <p>The alternative with the highest <italic>V<sub>j</sub></italic> is the best alternative compared with the other competitive alternative solutions.</p>
        <p>It is noted that in contrast to the value function approach, other popular aggregation methods that can be utilized for evaluating a set of discrete alternatives include outranking methods that involve a pairwise comparison between all the alternatives. Chakhar and Mousseau [<xref ref-type="bibr" rid="B38-ijgi-01-00272">38</xref>] proposed a general framework to incorporate these methods into a GIS. </p>
      </sec>
      <sec>
        <title>2.5. Sensitivity Analysis</title>
        <p>Sensitivity analysis (SA) investigates the impact of changes in the inputs on the decision outcomes. It is a critical task for decision-making processes since it reveals how reliable the final decisions are [<xref ref-type="bibr" rid="B30-ijgi-01-00272">30</xref>]. For MADM, two important elements need to be examined: the weights of the evaluation criteria and the criterion scores (or performance measures) [<xref ref-type="bibr" rid="B23-ijgi-01-00272">23</xref>,<xref ref-type="bibr" rid="B39-ijgi-01-00272">39</xref>]. However, SA is not common practice in spatial multi-criteria decision problems, and where it has been used, only the sensitivity of the weights has been considered [<xref ref-type="bibr" rid="B40-ijgi-01-00272">40</xref>].The sensitivity of criterion weights is crucial because the process of assigning weights is subjective and may demonstrate significant variation between the decision makers’ perceptions and preferences. In addition, the available methods for defining the weights may lead to different results. Thus, a decision maker can take better decisions if he/she is aware of how critical each criterion is. Triantaphyllou [<xref ref-type="bibr" rid="B37-ijgi-01-00272">37</xref>,<xref ref-type="bibr" rid="B41-ijgi-01-00272">41</xref>] developed a methodology for individual decision making, which calculates the percentage change needed to alter the current weight of each relevant criterion so as to reverse the ranking order of the corresponding pair of alternatives for each combination of alternative pairs and for each criterion. The “percent top critical criterion” (that may alter the ranking of the best alternative), the “percent any critical criterion” (that may alter the ranking of any alternative) and a sensitivity coefficient for each criterion can be calculated. In the case of group decision making, e.g., in multi-stakeholder participatory processes, other methods can be used such as that provided by Jankowski <italic>et al.</italic> [<xref ref-type="bibr" rid="B42-ijgi-01-00272">42</xref>] in their web-based <italic>Choice Modeler </italic>system that involves extensive sensitivity analysis capabilities at three different levels (global, local and spatial). </p>
        <p>In addition, the standardization process of utilizing value functions also involves considerable subjectivity, since the value functions have been defined by experts and the process of assessing them is inherently prone to uncertainties. The percentage change needed to alter the current performance score (of the first alternative from the pair) so as to reverse the rank order of the corresponding pair of alternatives for each combination of alternative pairs and for each criterion can be calculated [<xref ref-type="bibr" rid="B37-ijgi-01-00272">37</xref>,<xref ref-type="bibr" rid="B41-ijgi-01-00272">41</xref>].From this, the “most critical alternative”, the competing alternative to the best alternative, and the percentage change in the relevant performance score that will alter the ranking can be calculated. The above methodology has been incorporated into the evaluation module of <italic>LACONISS </italic>and is applied in the case study described in the next section. </p>
      </sec>
    </sec>
    <sec>
      <title>3. Case Study</title>
      <p>The evaluation methodology has been applied to an actual land consolidation project that was carried out in the district of Paphos, which was amongst the first land consolidation projects undertaken in Cyprus. The village administrative boundaries cover a total area of 492 ha of lowland while the extent of the consolidated area covered 195 hectares. The data for this land consolidation project were digitized; more details can be found in Demetriou <italic>et al. </italic> [<xref ref-type="bibr" rid="B8-ijgi-01-00272">8</xref>]. The system was applied with ten different sets of input facts generating ten alternative land redistributions. These facts represent eleven decision variables: the minimum parcel area limit (in m<sup>2</sup>) for the land consolidation area as set by legislation (F1); the minimum size limit (in m<sup>2</sup>) of the holding for a landowner to receive a parcel in the new plan as set by the Committee (F2); the minimum land value limit (in monetary values) of the holding for a landowner to receive a parcel in the new plan as set by the Committee (F3); the lower limit (in m<sup>2</sup>) of a small holding size (F4); the upper limit (in m<sup>2</sup>) of a small holding size (F5); the lower limit (in m<sup>2</sup>) of a medium holding size (F6); the upper limit (in m<sup>2</sup>) of a medium holding size (F7); the lower limit (in m<sup>2</sup>) of a large holding size (F8); the weight attached to the parcel area for the calculation of the parcel priority index(<italic>PPI</italic> ) (F9); the weight attached to the parcel land value for the calculation of the <italic>PPI</italic> (F10); and the minimum residual area limit (in m<sup>2</sup>) for the creation of a new parcel for those landowners who receive more than one parcel (F11). Each alternative is described briefly in <xref ref-type="table" rid="ijgi-01-00272-t003">Table 3</xref> by comparing the facts with those of alternative 1, <italic>i.e.</italic>, the solution given by the experts.</p>
      <table-wrap id="ijgi-01-00272-t003" position="float">
        <object-id pub-id-type="pii">ijgi-01-00272-t003_Table 3</object-id>
        <label>Table 3</label>
        <caption>
          <p>The description of the ten alternative land redistributions. </p>
        </caption>
        <table>
          <thead>
            <tr>
              <th align="center" valign="middle">Alternative </th>
              <th align="center" valign="middle">Description</th>
            </tr>
          </thead>
          <tbody>
            <tr>
              <td align="center" valign="middle">A1</td>
              <td align="center" valign="middle">Experts solution (Irrigated project)</td>
            </tr>
            <tr>
              <td align="center" valign="middle">A2</td>
              <td align="center" valign="middle">Medium area and land value minimum limits</td>
            </tr>
            <tr>
              <td align="center" valign="middle">A3</td>
              <td align="center" valign="middle">High area and land value minimum limits</td>
            </tr>
            <tr>
              <td align="center" valign="middle">A4</td>
              <td align="center" valign="middle">Unequal PPI weights for area and land value</td>
            </tr>
            <tr>
              <td align="center" valign="middle">A5</td>
              <td align="center" valign="middle">Low small-medium-large holdings sizes</td>
            </tr>
            <tr>
              <td align="center" valign="middle">A6</td>
              <td align="center" valign="middle">High minimum area of new parcels with high area and land value minimum limits</td>
            </tr>
            <tr>
              <td align="center" valign="middle">A7</td>
              <td align="center" valign="middle">Low minimum area of new parcels with high area and land value minimum limits</td>
            </tr>
            <tr>
              <td align="center" valign="middle">A8</td>
              <td align="center" valign="middle">Low area and land value minimum limits with low small-medium-large holdings sizes</td>
            </tr>
            <tr>
              <td align="center" valign="middle">A9</td>
              <td align="center" valign="middle">Inverse unequal PPI weights for area and land value (comparing to alt-4) </td>
            </tr>
            <tr>
              <td align="center" valign="middle">A10</td>
              <td align="center" valign="middle">Arid project</td>
            </tr>
          </tbody>
        </table>
      </table-wrap>
      <p>These alternative solutions were evaluated based on two different scenarios. Scenario I involves changing the weights of the criteria based on four different cases while Scenario II focuses on different project objectives under two different situations. </p>
      <sec>
        <title>3.1. Evaluating Alternatives: Scenario I</title>
        <sec>
          <title>3.1.1. Ranking Alternatives</title>
          <p>Ranking alternatives is carried out using four cases. In case 1, all five criteria have the same weight. In case 2, the weights were assigned to each of the five criteria in the following descending order of importance: extremely high, very high, high, intermediate and moderate. In contrast, the weights in case 3 were assigned in ascending order of importance, whilst in case 4, they were assigned based on the judgment of the principal author as: extremely high, high, high, intermediate and very high, respectively. The performance score and the rank order of each alternative for each case are shown in <xref ref-type="table" rid="ijgi-01-00272-t004">Table 4</xref> and a graphical representation is provided in <xref ref-type="fig" rid="ijgi-01-00272-f004">Figure 4</xref>.</p>
          <p>A number of interesting findings can be reported. For example, no one alternative was found to be the best in all cases. In particular, alternatives 3 and 10 are ranked as best in cases 1, 3 and 2, 4 respectively. However, alternative 3 presents a more stable behavior in all cases than alternative 10, because the former ranked second in both cases in which the latter ranked first. In contrast, alternative 10 involves a high unreliability because it is the only alternative that presents so much distance in ranking positions (<italic>i.e.</italic>, first, sixth and ninth) while all the other alternatives change at worst by two positions in terms of ranking. As a result, alternative 3 is classified as the best alternative. Alterative 3 also achieves a better balance in terms of performance scores <italic>i.e.</italic>, a trade-off between all criteria. Regardless it performs best only in C3 whilst alternative 10 achieves the highest performance scores in criteria C1 and C2 and the worst in C3 and C5 in all four all cases (<xref ref-type="fig" rid="ijgi-01-00272-f005">Figure 5</xref>). </p>
          <p>The variability of the performance scores of the best and worst alternatives appears to vary greatly per case, <italic>i.e.</italic>, 21.4%, 29.8%, 16.1% and 23.2% respectively, which means that different facts and different weight schemes may produce considerably varying alternatives. Furthermore, the ranking of alternative 1 (that represents the solution given by human experts in the case study), <italic>i.e.</italic>, fifth or sixth in the four cases, indicates that it underperforms compared to alternatives 2, 3, 4 and 9 with which it is comparable in terms of facts. This proves that the system may produce better solutions than the experts. Moreover, it is clear that alternative eight ranks last in all cases. A general finding is that the ranking of alternatives is very sensitive to the alteration of the weights of the criteria, which has also been found by Janssen and Rietveld [<xref ref-type="bibr" rid="B13-ijgi-01-00272">13</xref>]. Therefore, planners should be aware both of the weights assigned to each criterion and hence the weighting method utilized. </p>
          <table-wrap id="ijgi-01-00272-t004" position="float">
            <object-id pub-id-type="pii">ijgi-01-00272-t004_Table 4</object-id>
            <label>Table 4</label>
            <caption>
              <p>The performance score and the ranking order of each alternative for four weighting scenarios. </p>
            </caption>
            <table>
              <thead>
                <tr>
                  <th align="center" valign="middle"> </th>
                  <th colspan="2" align="center" valign="middle">Case 1</th>
                  <th colspan="2" align="center" valign="middle">Case 2</th>
                  <th colspan="2" align="center" valign="middle">Case 3</th>
                  <th colspan="2" align="center" valign="middle">Case 4</th>
                </tr>
                <tr>
                  <th align="center" valign="middle">Ranking</th>
                  <th align="center" valign="middle">Alternative</th>
                  <th align="center" valign="middle">Score</th>
                  <th align="center" valign="middle">Alternative</th>
                  <th align="center" valign="middle">Score</th>
                  <th align="center" valign="middle">Alternative</th>
                  <th align="center" valign="middle">Score</th>
                  <th align="center" valign="middle">Alternative</th>
                  <th align="center" valign="middle">Score</th>
                </tr>
              </thead>
              <tbody>
                <tr>
                  <td align="center" valign="middle">1</td>
                  <td align="center" valign="middle">A3</td>
                  <td align="center" valign="middle">0.823</td>
                  <td align="center" valign="middle">A10</td>
                  <td align="center" valign="middle">0.791</td>
                  <td align="center" valign="middle">A3</td>
                  <td align="center" valign="middle">0.875</td>
                  <td align="center" valign="middle">A10</td>
                  <td align="center" valign="middle">0.797</td>
                </tr>
                <tr>
                  <td align="center" valign="middle">2</td>
                  <td align="center" valign="middle">A2</td>
                  <td align="center" valign="middle">0.820</td>
                  <td align="center" valign="middle">A3</td>
                  <td align="center" valign="middle">0.765</td>
                  <td align="center" valign="middle">A2</td>
                  <td align="center" valign="middle">0.873</td>
                  <td align="center" valign="middle">A3</td>
                  <td align="center" valign="middle">0.789</td>
                </tr>
                <tr>
                  <td align="center" valign="middle">3</td>
                  <td align="center" valign="middle">A4</td>
                  <td align="center" valign="middle">0.809</td>
                  <td align="center" valign="middle">A2</td>
                  <td align="center" valign="middle">0.761</td>
                  <td align="center" valign="middle">A9</td>
                  <td align="center" valign="middle">0.863</td>
                  <td align="center" valign="middle">A2</td>
                  <td align="center" valign="middle">0.784</td>
                </tr>
                <tr>
                  <td align="center" valign="middle">4</td>
                  <td align="center" valign="middle">A9</td>
                  <td align="center" valign="middle">0.809</td>
                  <td align="center" valign="middle">A4</td>
                  <td align="center" valign="middle">0.751</td>
                  <td align="center" valign="middle">A4</td>
                  <td align="center" valign="middle">0.863</td>
                  <td align="center" valign="middle">A4</td>
                  <td align="center" valign="middle">0.775</td>
                </tr>
                <tr>
                  <td align="center" valign="middle">5</td>
                  <td align="center" valign="middle">A1</td>
                  <td align="center" valign="middle">0.808</td>
                  <td align="center" valign="middle">A9</td>
                  <td align="center" valign="middle">0.749</td>
                  <td align="center" valign="middle">A1</td>
                  <td align="center" valign="middle">0.862</td>
                  <td align="center" valign="middle">A9</td>
                  <td align="center" valign="middle">0.774</td>
                </tr>
                <tr>
                  <td align="center" valign="middle">6</td>
                  <td align="center" valign="middle">A10</td>
                  <td align="center" valign="middle">0.804</td>
                  <td align="center" valign="middle">A1</td>
                  <td align="center" valign="middle">0.749</td>
                  <td align="center" valign="middle">A5</td>
                  <td align="center" valign="middle">0.839</td>
                  <td align="center" valign="middle">A1</td>
                  <td align="center" valign="middle">0.773</td>
                </tr>
                <tr>
                  <td align="center" valign="middle">7</td>
                  <td align="center" valign="middle">A5</td>
                  <td align="center" valign="middle">0.787</td>
                  <td align="center" valign="middle">A5</td>
                  <td align="center" valign="middle">0.729</td>
                  <td align="center" valign="middle">A7</td>
                  <td align="center" valign="middle">0.818</td>
                  <td align="center" valign="middle">A5</td>
                  <td align="center" valign="middle">0.750</td>
                </tr>
                <tr>
                  <td align="center" valign="middle">8</td>
                  <td align="center" valign="middle">A6</td>
                  <td align="center" valign="middle">0.737</td>
                  <td align="center" valign="middle">A6</td>
                  <td align="center" valign="middle">0.652</td>
                  <td align="center" valign="middle">A6</td>
                  <td align="center" valign="middle">0.816</td>
                  <td align="center" valign="middle">A6</td>
                  <td align="center" valign="middle">0.695</td>
                </tr>
                <tr>
                  <td align="center" valign="middle">9</td>
                  <td align="center" valign="middle">A7</td>
                  <td align="center" valign="middle">0.735</td>
                  <td align="center" valign="middle">A7</td>
                  <td align="center" valign="middle">0.646</td>
                  <td align="center" valign="middle">A10</td>
                  <td align="center" valign="middle">0.815</td>
                  <td align="center" valign="middle">A7</td>
                  <td align="center" valign="middle">0.690</td>
                </tr>
                <tr>
                  <td align="center" valign="middle">10</td>
                  <td align="center" valign="middle">A8</td>
                  <td align="center" valign="middle">0.647</td>
                  <td align="center" valign="middle">A8</td>
                  <td align="center" valign="middle">0.555</td>
                  <td align="center" valign="middle">A8</td>
                  <td align="center" valign="middle">0.734</td>
                  <td align="center" valign="middle">A8</td>
                  <td align="center" valign="middle">0.612</td>
                </tr>
              </tbody>
            </table>
          </table-wrap>
          <fig id="ijgi-01-00272-f004" position="anchor">
            <label>Figure 4</label>
            <caption>
              <p>Ranking of alternatives for four different criteria weighting cases. </p>
            </caption>
            <graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="ijgi-01-00272-g004.tif"/>
          </fig>
          <fig id="ijgi-01-00272-f005" position="anchor">
            <label>Figure 5</label>
            <caption>
              <p>Performance of alternatives for all criteria in four cases. </p>
            </caption>
            <graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="ijgi-01-00272-g005.tif"/>
          </fig>
        </sec>
        <sec>
          <title>3.1.2. Sensitivity Analysis</title>
          <p><xref ref-type="table" rid="ijgi-01-00272-t005">Table 5</xref> and <xref ref-type="fig" rid="ijgi-01-00272-f006">Figure 6</xref> show the sensitivity coefficient variability for all criteria for each case; the higher the sensitivity coefficient, the more sensitive is that criterion in terms of changing the rank of the best alternative or any pair of alternatives. It is apparent that all the criteria are very sensitive in case 3. The reason is that the weighting scheme in case 3 can be considered as a paradox in terms of the importance of criteria that would normally be assigned by land consolidation experts because the first two and the last two criteria have a significant distance in terms of weighting class. As a result, a slight change in the weights towards a more reasonable scheme causes a change in the rank order of the alternatives. In contrast, the criteria are much less sensitive for the other three cases because they involve a “sensible” weighting pattern in terms of practice. </p>
          <table-wrap id="ijgi-01-00272-t005" position="float">
            <object-id pub-id-type="pii">ijgi-01-00272-t005_Table 5</object-id>
            <label>Table 5</label>
            <caption>
              <p>Sensitivity coefficient and weight for criteria for the four cases. </p>
            </caption>
                        <table>
              <thead>
                <tr>
                  <th align="center" valign="middle">Criteria</th>
                  <th colspan="2" align="center" valign="middle">Case 1</th>
                  <th colspan="2" align="center" valign="middle">Case 2</th>
                  <th colspan="2" align="center" valign="middle">Case 3</th>
                  <th colspan="2" align="center" valign="middle">Case 4</th>
                </tr>
              </thead>
              <tbody>
                <tr>
                  <td align="center" valign="middle"> </td>
                  <td align="center" valign="middle">SensC</td>
                  <td align="center" valign="middle">Weight</td>
                  <td align="center" valign="middle">SensC</td>
                  <td align="center" valign="middle">Weight</td>
                  <td align="center" valign="middle">SensC</td>
                  <td align="center" valign="middle">Weight</td>
                  <td align="center" valign="middle">SensC</td>
                  <td align="center" valign="middle">Weight</td>
                </tr>
                <tr>
                  <td align="center" valign="middle">C1</td>
                  <td align="center" valign="middle">0.081</td>
                  <td align="center" valign="middle">0.200</td>
                  <td align="center" valign="middle">0.025</td>
                  <td align="center" valign="middle">0.323</td>
                  <td align="center" valign="middle">0.382</td>
                  <td align="center" valign="middle">0.097</td>
                  <td align="center" valign="middle">0.068</td>
                  <td align="center" valign="middle">0.294</td>
                </tr>
                <tr>
                  <td align="center" valign="middle">C2</td>
                  <td align="center" valign="middle">0.028</td>
                  <td align="center" valign="middle">0.200</td>
                  <td align="center" valign="middle">0.006</td>
                  <td align="center" valign="middle">0.258</td>
                  <td align="center" valign="middle">0.241</td>
                  <td align="center" valign="middle">0.129</td>
                  <td align="center" valign="middle">0.016</td>
                  <td align="center" valign="middle">0.176</td>
                </tr>
                <tr>
                  <td align="center" valign="middle">C3</td>
                  <td align="center" valign="middle">0.077</td>
                  <td align="center" valign="middle">0.200</td>
                  <td align="center" valign="middle">0.018</td>
                  <td align="center" valign="middle">0.194</td>
                  <td align="center" valign="middle">0.096</td>
                  <td align="center" valign="middle">0.194</td>
                  <td align="center" valign="middle">0.024</td>
                  <td align="center" valign="middle">0.176</td>
                </tr>
                <tr>
                  <td align="center" valign="middle">C4</td>
                  <td align="center" valign="middle">0.068</td>
                  <td align="center" valign="middle">0.200</td>
                  <td align="center" valign="middle">0.010</td>
                  <td align="center" valign="middle">0.129</td>
                  <td align="center" valign="middle">0.196</td>
                  <td align="center" valign="middle">0.258</td>
                  <td align="center" valign="middle">0.024</td>
                  <td align="center" valign="middle">0.118</td>
                </tr>
                <tr>
                  <td align="center" valign="middle">C5</td>
                  <td align="center" valign="middle">0.032</td>
                  <td align="center" valign="middle">0.200</td>
                  <td align="center" valign="middle">0.035</td>
                  <td align="center" valign="middle">0.097</td>
                  <td align="center" valign="middle">0.341</td>
                  <td align="center" valign="middle">0.323</td>
                  <td align="center" valign="middle">0.026</td>
                  <td align="center" valign="middle">0.235</td>
                </tr>
              </tbody>
            </table>

          </table-wrap>
          <fig id="ijgi-01-00272-f006" position="anchor">
            <label>Figure 6</label>
            <caption>
              <p>Variability of the sensitivity coefficient for each criterion for four cases.</p>
            </caption>
            <graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="ijgi-01-00272-g006.tif"/>
          </fig>
          <p><xref ref-type="table" rid="ijgi-01-00272-t006">Table 6</xref> shows the most critical criteria and the alternatives. The “percent top critical criterion” (PTCC) is C1 for cases 1, 2 and 4. That is, if the weight for C1 changes by 55.8%, 46.2% and 14.7%, the ranking of best alternatives will alter, <italic>i.e.</italic>, alternatives 3, 10 and 4 for the relevant cases will change. It is noted that the “qualitative rating” method involves a change of 90% from best (<italic>i.e.</italic>, extremely high importance) to worst (<italic>i.e.</italic>, very low importance) (<xref ref-type="table" rid="ijgi-01-00272-t002">Table 2</xref>). Hence it is not impossible to have this magnitude in the percentage changes mentioned earlier. Criterion C1 is the most critical for three out of four cases since it presents the highest range of values for the former and a low range of values for the latter case. Similarly, the “percent any critical criterion” (PACT) is C1 for cases 1, 3 and 4, and if the weights of C1 change by 12.3%, 2.6% and 14.7% respectively, then any ranking may change.</p>
          <table-wrap id="ijgi-01-00272-t006" position="float">
            <object-id pub-id-type="pii">ijgi-01-00272-t006_Table 6</object-id>
            <label>Table 6</label>
            <caption>
              <p>Critical criteria and alternatives for each scenario. </p>
            </caption>
            <table>
              <thead>
                <tr>
                  <th align="center" valign="middle"> </th>
                  <th align="center" valign="middle">Case 1</th>
                  <th align="center" valign="middle">Case 2</th>
                  <th align="center" valign="middle">Case 3</th>
                  <th align="center" valign="middle">Case 4</th>
                </tr>
              </thead>
              <tbody>
                <tr>
                  <td align="center" valign="middle">Percent top critical criterion</td>
                  <td align="center" valign="middle">C1</td>
                  <td align="center" valign="middle">C1</td>
                  <td align="center" valign="middle">C4</td>
                  <td align="center" valign="middle">C1</td>
                </tr>
                <tr>
                  <td align="center" valign="middle">Percent any critical criterion</td>
                  <td align="center" valign="middle">C1</td>
                  <td align="center" valign="middle">C5</td>
                  <td align="center" valign="middle">C1</td>
                  <td align="center" valign="middle">C1</td>
                </tr>
                <tr>
                  <td align="center" valign="middle">Most critical alternative</td>
                  <td align="center" valign="middle">A9</td>
                  <td align="center" valign="middle">A9</td>
                  <td align="center" valign="middle">A4</td>
                  <td align="center" valign="middle">A1</td>
                </tr>
              </tbody>
            </table>
          </table-wrap>
          <p>In addition, the most sensitive alternative in terms of changing ranking is alternative 9 (because of C4 and C1, respectively) for cases 1 and 2, alternative 4 (because of C5) for case 3, and alternative 1 (because of C5) for case 4. Another interesting finding extracted from <xref ref-type="table" rid="ijgi-01-00272-t005">Table 5</xref> is that there is no association between the sensitivity coefficient and the weights for each criterion for the three first cases since the correlation coefficient (R) was calculated as 0, −0.24, −0.09, respectively. However, there is a relationship (R = 0.79) in case 4 perhaps because this case involves weights assigned by the expert and they have not been randomly defined as in the first three cases. In addition, the most critical criterion is that with the highest weight, a result that confirms the finding of Triantaphyllou [<xref ref-type="bibr" rid="B37-ijgi-01-00272">37</xref>].</p>
        </sec>
      </sec>
      <sec>
        <title>3.2. Evaluating Alternatives: Scenario II</title>
        <p>For Scenario II, the ranking of alternatives is carried out using two cases. In case 1, the objective of the project focuses only on minimizing land fragmentation, <italic>i.e.</italic>, only two criteria (C1 and C2) are involved in the evaluation. In case 2, only C3, C4 and C5 are involved in the evaluation, which represent the objective “minimizing social impacts”. The ranking of alternatives for each case is shown in <xref ref-type="table" rid="ijgi-01-00272-t007">Table 7</xref>. From this table and <xref ref-type="fig" rid="ijgi-01-00272-f007">Figure 7</xref>, it can be seen that alternative 10 is ranked first in case 1 while alternative 3 is ranked best in case 2. In other words, alternative 10 is best in terms of minimizing land fragmentation but worst at minimizing social impacts. In contrast, alternative 3 is best at minimizing social impacts but is also ranked second in case 1, <italic>i.e.</italic>, minimizing land fragmentation, revealing again stability in performance. This clearly illustrates that the objectives of a project play a crucial role in the ranking order in addition to the weight of the criteria.</p>
        <table-wrap id="ijgi-01-00272-t007" position="float">
          <object-id pub-id-type="pii">ijgi-01-00272-t007_Table 7</object-id>
          <label>Table 7</label>
          <caption>
            <p>The performance score and the ranking order of each alternative for the two scenarios.</p>
          </caption>
          <table>
            <thead>
              <tr>
                <th align="center" valign="middle"> </th>
                <th colspan="2" align="center" valign="middle" style="border-bottom:solid thin">Scenario 1</th>
                <th colspan="2" align="center" valign="middle" style="border-bottom:solid thin">Scenario 2</th>
              </tr>
              <tr>
                <th align="center" valign="middle">Ranking</th>
                <th align="center" valign="middle">Alternative</th>
                <th align="center" valign="middle">Score</th>
                <th align="center" valign="middle">Alternative</th>
                <th align="center" valign="middle">Score</th>
              </tr>
            </thead>
            <tbody>
              <tr>
                <td align="center" valign="middle">1</td>
                <td align="center" valign="middle">A10</td>
                <td align="center" valign="middle">0.750</td>
                <td align="center" valign="middle">A3</td>
                <td align="center" valign="middle">0.951</td>
              </tr>
              <tr>
                <td align="center" valign="middle">2</td>
                <td align="center" valign="middle">A3</td>
                <td align="center" valign="middle">0.631</td>
                <td align="center" valign="middle">A2</td>
                <td align="center" valign="middle">0.950</td>
              </tr>
              <tr>
                <td align="center" valign="middle">3</td>
                <td align="center" valign="middle">A2</td>
                <td align="center" valign="middle">0.625</td>
                <td align="center" valign="middle">A9</td>
                <td align="center" valign="middle">0.934</td>
              </tr>
              <tr>
                <td align="center" valign="middle">4</td>
                <td align="center" valign="middle">A4</td>
                <td align="center" valign="middle">0.624</td>
                <td align="center" valign="middle">A1</td>
                <td align="center" valign="middle">0.933</td>
              </tr>
              <tr>
                <td align="center" valign="middle">5</td>
                <td align="center" valign="middle">A1</td>
                <td align="center" valign="middle">0.621</td>
                <td align="center" valign="middle">A4</td>
                <td align="center" valign="middle">0.933</td>
              </tr>
              <tr>
                <td align="center" valign="middle">6</td>
                <td align="center" valign="middle">A9</td>
                <td align="center" valign="middle">0.620</td>
                <td align="center" valign="middle">A5</td>
                <td align="center" valign="middle">0.916</td>
              </tr>
              <tr>
                <td align="center" valign="middle">7</td>
                <td align="center" valign="middle">A5</td>
                <td align="center" valign="middle">0.593</td>
                <td align="center" valign="middle">A6</td>
                <td align="center" valign="middle">0.913</td>
              </tr>
              <tr>
                <td align="center" valign="middle">8</td>
                <td align="center" valign="middle">A6</td>
                <td align="center" valign="middle">0.472</td>
                <td align="center" valign="middle">A7</td>
                <td align="center" valign="middle">0.912</td>
              </tr>
              <tr>
                <td align="center" valign="middle">9</td>
                <td align="center" valign="middle">A7</td>
                <td align="center" valign="middle">0.471</td>
                <td align="center" valign="middle">A8</td>
                <td align="center" valign="middle">0.843</td>
              </tr>
              <tr>
                <td align="center" valign="middle">10</td>
                <td align="center" valign="middle">A8</td>
                <td align="center" valign="middle">0.352</td>
                <td align="center" valign="middle">A10</td>
                <td align="center" valign="middle">0.839</td>
              </tr>
            </tbody>
          </table>
        </table-wrap>
        <fig id="ijgi-01-00272-f007" position="anchor">
          <label>Figure 7</label>
          <caption>
            <p>Ranking of alternatives for the two cases. </p>
          </caption>
          <graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="ijgi-01-00272-g007.tif"/>
        </fig>
        <p>Once again the variability of performance scores of alternatives ranked best and worst for case 1 is extremely high (53.1%) but it is low for case 2 (11.8%). This indicates that the input facts in the “design module” strongly influence the outcome solutions regarding minimizing land fragmentation and, in contrast, only slightly influence the outcomes regarding minimizing social impacts. As a result, this finding suggests flexibility for the planner in the former case and limitations for the planner in the latter case because of the strict provisions in the legislation.</p>
        <p>The sensitivity analysis shows that the most sensitive criteria are those associated with case 2 (<xref ref-type="fig" rid="ijgi-01-00272-f008">Figure 8</xref>). In particular, the criteria for case 2 are more sensitive than those of case 1 regardless of the higher variability of the values in the former case. This is a controversial finding compared with that for scenario I. This finding reveals that the selection of the criteria involved in the evaluation process, and hence the objectives of a project, play a crucial role in the ranking in addition to the weight of the criteria.</p>
        <fig id="ijgi-01-00272-f008" position="anchor">
          <label>Figure 8</label>
          <caption>
            <p>Variability of the sensitivity coefficient for each criterion for the two cases. </p>
          </caption>
          <graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="ijgi-01-00272-g008.tif"/>
        </fig>
        <p>Based on the previous analyses, the best solution is alternative 3 for both scenarios because it presents the most stable behavior in terms of rank order. Thus, planners would definitely make a decision to implement this solution. The outcome of this evaluation, <italic>i.e.</italic>, the best solution, is now passed onto the land partitioning module (<italic>LandParcelS</italic>) for the automatic generation of the new parcels in terms of shape, size, land value and location. This is the function of the last module of <italic>LACONISS </italic>(see [<xref ref-type="bibr" rid="B9-ijgi-01-00272">9</xref>] for more details).</p>
      </sec>
    </sec>
    <sec sec-type="conclusions">
      <title>4. Conclusions</title>
      <p>This paper has presented a GIS-based methodology for evaluating alternative land redistribution solutions that is embedded as an evaluation module within <italic>LACONISS</italic>. The methodology was then demonstrated using a case study of an actual land consolidation project in Cyprus. The evaluation module represents a powerful new tool for the comprehensive evaluation of alternative land redistribution plans. In addition, two new measures were introduced: the parcel concentration coefficient for measuring the dispersion of parcels, and the landowner satisfaction rate for predicting the acceptance of the land redistribution plan by the landowners in terms of the location of the newly allocated parcels. These indices have general and practical applicability that could be transferred to any land consolidation project. Moreover, a new approach, referred to as the “qualitative rating method”, was presented, which captures a more realistic way to assign weights to the evaluation criteria. Finally, a set of non-linear value functions for standardizing the performance scores of the alternatives for five evaluation criteria were developed, demonstrating how expert knowledge is encapsulated in the evaluation process. The main contribution of this work in the area of land consolidation is that the evaluation module presented can also be applied in other countries that implement land consolidation projects after appropriate adjustments. A broader contribution has also been made to spatial planning processes, which might follow the methodology presented in this paper. In addition, the dispersion metric could be adopted by other spatial disciplines (e.g., in ecosystem analysis) that deal with the study of the dispersion of point entities between an existing and a new status due to a course of action. Finally, the paper has demonstrated that the role of GIS in spatial decision making is critical not only for formulating alternative solutions for the problem concerned but also for evaluating these solutions through embedding tools such as MADM. The role of the planner in investigating and evaluating the various alternatives is facilitated so as to reach the optimum decision for implementation.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <title>References</title>
      <ref id="B1-ijgi-01-00272">
        <label>1.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>King</surname>
              <given-names>R.</given-names>
            </name>
            <name>
              <surname>Burton</surname>
              <given-names>S.</given-names>
            </name>
          </person-group>
          <article-title>Land fragmentation: Notes on a fundamental rural spatial problem</article-title>
          <source>Prog. Hum. Geogr.</source>
          <year>1982</year>
          <volume>6</volume>
          <fpage>475</fpage>
          <lpage>494</lpage>
          <pub-id pub-id-type="doi">10.1177/030913338200600401</pub-id>
        </citation>
      </ref>
      <ref id="B2-ijgi-01-00272">
        <label>2.</label>
        <citation citation-type="gov">
		<collab>FAO</collab>
          <source>The Design of Land Consolidation Pilot Projects in Central and Eastern Europe</source>
          <publisher-name>FAO-Land Tenure Studies</publisher-name>
          <publisher-loc>Rome, Italy</publisher-loc>
          <year>2003</year>
        </citation>
      </ref>
      <ref id="B3-ijgi-01-00272">
        <label>3.</label>
        <citation citation-type="gov">
		<collab>FAO</collab>
          <source>Opportunities to Mainstream Land Consolidation in Rural Development Programmes of the European Union</source>
          <publisher-name>FAO-Land Tenure Policy Series</publisher-name>
          <publisher-loc>Rome, Italy</publisher-loc>
          <year>2008</year>
        </citation>
      </ref>
      <ref id="B4-ijgi-01-00272">
        <label>4.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Vitikainen</surname>
              <given-names>A.</given-names>
            </name>
          </person-group>
          <article-title>An overview of land consolidation in Europe</article-title>
          <source>Nordic J. Surv. Real Estate Res.</source>
          <year>2004</year>
          <volume>1</volume>
          <fpage>25</fpage>
          <lpage>43</lpage>
        </citation>
      </ref>
      <ref id="B5-ijgi-01-00272">
        <label>5.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Demetriou</surname>
              <given-names>D.</given-names>
            </name>
            <name>
              <surname>Stillwell</surname>
              <given-names>J.</given-names>
            </name>
            <name>
              <surname>See</surname>
              <given-names>L.</given-names>
            </name>
          </person-group>
          <article-title>Land consolidation in Cyprus: Why is an integrated planning and decision support system required?</article-title>
          <source>Land Use Policy</source>
          <year>2012</year>
          <volume>29</volume>
          <fpage>131</fpage>
          <lpage>142</lpage>
          <pub-id pub-id-type="doi">10.1016/j.landusepol.2011.05.012</pub-id>
        </citation>
      </ref>
      <ref id="B6-ijgi-01-00272">
        <label>6.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Demetriou</surname>
              <given-names>D.</given-names>
            </name>
            <name>
              <surname>Stillwell</surname>
              <given-names>J.</given-names>
            </name>
            <name>
              <surname>See</surname>
              <given-names>L.</given-names>
            </name>
          </person-group>
          <article-title>An integrated planning and decision support system (IPDSS) for land consolidation: Theoretical framework and application of the land redistribution modules</article-title>
          <source>Environ. Plan. B-Plan. Design</source>
          <year>2012</year>
          <volume>39</volume>
          <fpage>609</fpage>
          <lpage>628</lpage>
        <pub-id pub-id-type="doi">10.1068/b37075</pub-id></citation>
      </ref>
      <ref id="B7-ijgi-01-00272">
        <label>7.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Demetriou</surname>
              <given-names>D.</given-names>
            </name>
            <name>
              <surname>Stillwell</surname>
              <given-names>J.</given-names>
            </name>
            <name>
              <surname>See</surname>
              <given-names>L.</given-names>
            </name>
          </person-group>
          <article-title>A new methodology for measuring land fragmentation</article-title>
          <source>Comput. Environ. Urban Syst.</source>
          <year>2012</year>
        </citation>
      </ref>
      <ref id="B8-ijgi-01-00272">
        <label>8.</label>
        <citation citation-type="book">
          <person-group person-group-type="author">
            <name>
              <surname>Demetriou</surname>
              <given-names>D.</given-names>
            </name>
            <name>
              <surname>Stillwell</surname>
              <given-names>J.</given-names>
            </name>
            <name>
              <surname>See</surname>
              <given-names>L.</given-names>
            </name>
          </person-group>
          <article-title>LandSpaCES: A Spatial Expert System for Land Consolidation</article-title>
          <source>Advancing Geoinformation Science for a Changing World</source>
          <person-group person-group-type="editor">
            <name>
              <surname>Geertman</surname>
              <given-names>S.</given-names>
            </name>
            <name>
              <surname>Reinhardt</surname>
              <given-names>W.</given-names>
            </name>
            <name>
              <surname>Toppen</surname>
              <given-names>F.</given-names>
            </name>
          </person-group>
          <publisher-name>Springer-Verlag</publisher-name>
          <publisher-loc>Berlin/Heidelberg, Germany</publisher-loc>
          <year>2011</year>
          <fpage>249</fpage>
          <lpage>274</lpage>
        </citation>
      </ref>
      <ref id="B9-ijgi-01-00272">
        <label>9.</label>
        <citation citation-type="web">
          <person-group person-group-type="author">
            <name>
              <surname>Demetriou</surname>
              <given-names>D.</given-names>
            </name>
            <name>
              <surname>Stillwell</surname>
              <given-names>J.</given-names>
            </name>
            <name>
              <surname>See</surname>
              <given-names>L.</given-names>
            </name>
          </person-group>
          <article-title>LandParcelS: A Module for Automated Land Partitioning</article-title>
          <access-date>(accessed on 25 April 2012)</access-date>
          <comment>Available online:<ext-link xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="http://www.geog.leeds.ac.uk/fileadmin/downloads/school/research/wpapers/12-02.pdf" ext-link-type="uri">http://www.geog.leeds.ac.uk/fileadmin/downloads/school/research/wpapers/12-02.pdf</ext-link></comment>
        </citation>
      </ref>
      <ref id="B10-ijgi-01-00272">
        <label>10.</label>
        <citation citation-type="confproc">
          <person-group person-group-type="author">
            <name>
              <surname>Miranda</surname>
              <given-names>D.</given-names>
            </name>
            <name>
              <surname>Crecente</surname>
              <given-names>R.</given-names>
            </name>
          </person-group>
          <article-title>Suitability Model for Land Consolidation Projects: A Case Study in Galicia, Spain</article-title>
          <source>Proceedings of the Symposium on Modern Land Consolidation, Clermont-Ferrand</source>
          <conf-loc>France</conf-loc>
          <conf-date>10-11 September 2004</conf-date>
        </citation>
      </ref>
      <ref id="B11-ijgi-01-00272">
        <label>11.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Zou</surname>
              <given-names>X.</given-names>
            </name>
            <name>
              <surname>Luo</surname>
              <given-names>M.</given-names>
            </name>
            <name>
              <surname>Su</surname>
              <given-names>W.</given-names>
            </name>
            <name>
              <surname>Li</surname>
              <given-names>D.</given-names>
            </name>
            <name>
              <surname>Jiang</surname>
              <given-names>Y.</given-names>
            </name>
            <name>
              <surname>Ju</surname>
              <given-names>Z.</given-names>
            </name>
            <name>
              <surname>Wang</surname>
              <given-names>J.</given-names>
            </name>
          </person-group>
          <article-title>Spatial decision support system for the potential evaluation of land consolidation projects</article-title>
          <source>WSEAS Trans. Comput.</source>
          <year>2008</year>
          <volume>7</volume>
          <fpage>887</fpage>
          <lpage>898</lpage>
        </citation>
      </ref>
      <ref id="B12-ijgi-01-00272">
        <label>12.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Thapa</surname>
              <given-names>G.</given-names>
            </name>
            <name>
              <surname>Niroula</surname>
              <given-names>G.</given-names>
            </name>
          </person-group>
          <article-title>Alternative options of land consolidation in the mountains of Nepal: An analysis based on stakeholders’ opinions</article-title>
          <source>Land Use Policy</source>
          <year>2008</year>
          <volume>25</volume>
          <fpage>338</fpage>
          <lpage>350</lpage>
          <pub-id pub-id-type="doi">10.1016/j.landusepol.2007.09.002</pub-id>
        </citation>
      </ref>
      <ref id="B13-ijgi-01-00272">
        <label>13.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Janssen</surname>
              <given-names>R.</given-names>
            </name>
            <name>
              <surname>Rietveld</surname>
              <given-names>P.</given-names>
            </name>
          </person-group>
          <article-title>Multicriteria evaluation of land reallotment plans: A case study</article-title>
          <source>Environ. Plan. A</source>
          <year>1985</year>
          <volume>17</volume>
          <fpage>1653</fpage>
          <lpage>1668</lpage>
        <pub-id pub-id-type="doi">10.1068/a171653</pub-id></citation>
      </ref>
      <ref id="B14-ijgi-01-00272">
        <label>14.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Huylenbroeck</surname>
              <given-names>G.</given-names>
            </name>
            <name>
              <surname>Coelho</surname>
              <given-names>J.</given-names>
            </name>
            <name>
              <surname>Pinto</surname>
              <given-names>P.</given-names>
            </name>
          </person-group>
          <article-title>Evaluation of land consolidation projects (LCPs): A multidisciplinary approach</article-title>
          <source>J. Rural Stud.</source>
          <year>1996</year>
          <volume>12</volume>
          <fpage>297</fpage>
          <lpage>310</lpage>
          <pub-id pub-id-type="doi">10.1016/0743-0167(96)00024-1</pub-id>
        </citation>
      </ref>
      <ref id="B15-ijgi-01-00272">
        <label>15.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Coelho</surname>
              <given-names>C.</given-names>
            </name>
            <name>
              <surname>Pinto</surname>
              <given-names>PA.</given-names>
            </name>
            <name>
              <surname>Silva</surname>
              <given-names>M.</given-names>
            </name>
          </person-group>
          <article-title>A systems approach for the estimation of the effects of land consolidation projects (LCPs): A module and its application</article-title>
          <source>Agr. Syst.</source>
          <year>2001</year>
          <volume>68</volume>
          <fpage>179</fpage>
          <lpage>195</lpage>
          <pub-id pub-id-type="doi">10.1016/S0308-521X(00)00061-5</pub-id>
        </citation>
      </ref>
      <ref id="B16-ijgi-01-00272">
        <label>16.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Crecente</surname>
              <given-names>R.</given-names>
            </name>
            <name>
              <surname>Alvarez</surname>
              <given-names>C.</given-names>
            </name>
            <name>
              <surname>Fra</surname>
              <given-names>U.</given-names>
            </name>
          </person-group>
          <article-title>Economic, social and environmental impact of land consolidation in Galicia</article-title>
          <source>Land Use Policy</source>
          <year>2002</year>
          <volume>19</volume>
          <fpage>135</fpage>
          <lpage>147</lpage>
          <pub-id pub-id-type="doi">10.1016/S0264-8377(02)00006-6</pub-id>
        </citation>
      </ref>
      <ref id="B17-ijgi-01-00272">
        <label>17.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Miranda</surname>
              <given-names>D.</given-names>
            </name>
            <name>
              <surname>Crecente</surname>
              <given-names>R.</given-names>
            </name>
            <name>
              <surname>Alvarez</surname>
              <given-names>M.F.</given-names>
            </name>
          </person-group>
          <article-title>Land consolidation in inland rural Galicia, N.W. Spain, since 1950: An example of the formulation and the use of questions, criteria and indicators for the evaluation of rural development policies</article-title>
          <source>Land Use Policy</source>
          <year>2006</year>
          <volume>23</volume>
          <fpage>511</fpage>
          <lpage>520</lpage>
          <pub-id pub-id-type="doi">10.1016/j.landusepol.2005.05.003</pub-id>
        </citation>
      </ref>
      <ref id="B18-ijgi-01-00272">
        <label>18.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Sklenicka</surname>
              <given-names>P.</given-names>
            </name>
          </person-group>
          <article-title>Applying evaluation criteria for the land consolidation effect to three contrasting study areas in the Czech Republic</article-title>
          <source>Land Use Policy</source>
          <year>2006</year>
          <volume>23</volume>
          <fpage>502</fpage>
          <lpage>510</lpage>
          <pub-id pub-id-type="doi">10.1016/j.landusepol.2005.03.001</pub-id>
        </citation>
      </ref>
      <ref id="B19-ijgi-01-00272">
        <label>19.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Tourino</surname>
              <given-names>J.</given-names>
            </name>
            <name>
              <surname>Boullon</surname>
              <given-names>M.</given-names>
            </name>
            <name>
              <surname>Gonzalez</surname>
              <given-names>X.</given-names>
            </name>
          </person-group>
          <article-title>A GIS-embedded system to support land consolidation plans in Galicia</article-title>
          <source>Int. J. Geogr. Inf. Sci.</source>
          <year>2003</year>
          <volume>17</volume>
          <fpage>377</fpage>
          <lpage>396</lpage>
          <pub-id pub-id-type="doi">10.1080/1365881031000072636</pub-id>
        </citation>
      </ref>
      <ref id="B20-ijgi-01-00272">
        <label>20.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Gonzalez</surname>
              <given-names>X.P.</given-names>
            </name>
            <name>
              <surname>Alvarez</surname>
              <given-names>C.J.</given-names>
            </name>
            <name>
              <surname>Crecente</surname>
              <given-names>R.</given-names>
            </name>
          </person-group>
          <article-title>Evaluation of land distributions with joint regard to plot size and shape</article-title>
          <source>Agr. Syst.</source>
          <year>2004</year>
          <volume>82</volume>
          <fpage>31</fpage>
          <lpage>43</lpage>
          <pub-id pub-id-type="doi">10.1016/j.agsy.2003.10.009</pub-id>
        </citation>
      </ref>
      <ref id="B21-ijgi-01-00272">
        <label>21.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Gonzalez</surname>
              <given-names>X.P.</given-names>
            </name>
            <name>
              <surname>Marey</surname>
              <given-names>M.F.</given-names>
            </name>
            <name>
              <surname>Alvarez</surname>
              <given-names>C.J.</given-names>
            </name>
          </person-group>
          <article-title>Evaluation of productive rural land patterns with joint regard to the size, shape and dispersion of plots</article-title>
          <source>Agr. Syst.</source>
          <year>2007</year>
          <volume>92</volume>
          <fpage>52</fpage>
          <lpage>62</lpage>
          <pub-id pub-id-type="doi">10.1016/j.agsy.2006.02.008</pub-id>
        </citation>
      </ref>
      <ref id="B22-ijgi-01-00272">
        <label>22.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Aslan</surname>
              <given-names>T.</given-names>
            </name>
            <name>
              <surname>Gundogdu</surname>
              <given-names>K.</given-names>
            </name>
            <name>
              <surname>Arici</surname>
              <given-names>I.</given-names>
            </name>
          </person-group>
          <article-title>Some metric indices for the assessment of land consolidation projects</article-title>
          <source>Pakistan J. Bio. Sci.</source>
          <year>2007</year>
          <volume>10</volume>
          <fpage>1390</fpage>
          <lpage>1397</lpage>
          <pub-id pub-id-type="doi">10.3923/pjbs.2007.1390.1397</pub-id>
        </citation>
      </ref>
      <ref id="B23-ijgi-01-00272">
        <label>23.</label>
        <citation citation-type="book">
          <person-group person-group-type="author">
            <name>
              <surname>Malczewski</surname>
              <given-names>J.</given-names>
            </name>
          </person-group>
          <source>GIS and Multicriteria Decision Analysis</source>
          <publisher-name>John Wiley &amp; Sons, Inc.</publisher-name>
          <publisher-loc>New York, NY, USA</publisher-loc>
          <year>1999</year>
        </citation>
      </ref>
      <ref id="B24-ijgi-01-00272">
        <label>24.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Malczewski</surname>
              <given-names>J.</given-names>
            </name>
          </person-group>
          <article-title>GIS-based multicriteria decision analysis: a survey of the literature</article-title>
          <source>Int. J. Geogr. Inf. Sci.</source>
          <year>2006</year>
          <volume>20</volume>
          <fpage>703</fpage>
          <lpage>726</lpage>
          <pub-id pub-id-type="doi">10.1080/13658810600661508</pub-id>
        </citation>
      </ref>
      <ref id="B25-ijgi-01-00272">
        <label>25.</label>
        <citation citation-type="book">
          <person-group person-group-type="author">
            <name>
              <surname>Zeiler</surname>
              <given-names>M.</given-names>
            </name>
          </person-group>
          <source>Exploring ArcObjects. Vol. I-Applications and Cartography</source>
          <publisher-name>ESRI Press</publisher-name>
          <publisher-loc>Redlands, CA, USA</publisher-loc>
          <year>2001</year>
        </citation>
      </ref>
      <ref id="B26-ijgi-01-00272">
        <label>26.</label>
        <citation citation-type="book">
          <person-group person-group-type="author">
            <name>
              <surname>Zeiler</surname>
              <given-names>M.</given-names>
            </name>
          </person-group>
          <source>Exploring ArcObjects. Vol. II-Geographic Data Management</source>
          <publisher-name>ESRI Press</publisher-name>
          <publisher-loc>Redlands, CA, USA</publisher-loc>
          <year>2001</year>
        </citation>
      </ref>
      <ref id="B27-ijgi-01-00272">
        <label>27.</label>
        <citation citation-type="confproc">
          <person-group person-group-type="author">
            <name>
              <surname>Al-Shalabi</surname>
              <given-names>M.</given-names>
            </name>
            <name>
              <surname>Mansor</surname>
              <given-names>S.</given-names>
            </name>
            <name>
              <surname>Ahmed</surname>
              <given-names>N</given-names>
            </name>
            <name>
              <surname>Shiriff</surname>
              <given-names>R.</given-names>
            </name>
          </person-group>
          <article-title>GIS Based Multicriteria Approaches to Housing Site Suitability Assessment</article-title>
          <source>Proceedings of the XXIII FIG (International Federation of Surveyors) Congress</source>
          <conf-loc>Munich, Germany</conf-loc>
          <conf-date>8-13 October 2006</conf-date>
        </citation>
      </ref>
      <ref id="B28-ijgi-01-00272">
        <label>28.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Carver</surname>
              <given-names>J.</given-names>
            </name>
          </person-group>
          <article-title>Integrating multicriteria evaluation with geographical information systems</article-title>
          <source>Int.J. Geogr. Inf. Syst.</source>
          <year>1991</year>
          <volume>5</volume>
          <fpage>321</fpage>
          <lpage>339</lpage>
          <pub-id pub-id-type="doi">10.1080/02693799108927858</pub-id>
        </citation>
      </ref>
      <ref id="B29-ijgi-01-00272">
        <label>29.</label>
        <citation citation-type="book">
          <person-group person-group-type="author">
            <name>
              <surname>Giupponi</surname>
              <given-names>C.</given-names>
            </name>
            <name>
              <surname>Mysiak</surname>
              <given-names>J.</given-names>
            </name>
            <name>
              <surname>Fassio</surname>
              <given-names>A.</given-names>
            </name>
          </person-group>
          <source>Mulino DSS. User’s Guide</source>
          <publisher-name>Fondazione Eni Enrico Mattei </publisher-name>
          <publisher-loc>Venice, Italy</publisher-loc>
          <year>2004</year>
        </citation>
      </ref>
      <ref id="B30-ijgi-01-00272">
        <label>30.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Jankowski</surname>
              <given-names>P.</given-names>
            </name>
          </person-group>
          <article-title>Integrating geographical information systems and multiple criteria decision making methods</article-title>
          <source>Int. J. Geogr. Inf. Syst.</source>
          <year>1995</year>
          <volume>9</volume>
          <fpage>251</fpage>
          <lpage>273</lpage>
          <pub-id pub-id-type="doi">10.1080/02693799508902036</pub-id>
        </citation>
      </ref>
      <ref id="B31-ijgi-01-00272">
        <label>31.</label>
        <citation citation-type="book">
          <person-group person-group-type="author">
            <name>
              <surname>Sharifi</surname>
              <given-names>A.</given-names>
            </name>
            <name>
              <surname>Herwijnen</surname>
              <given-names>M.</given-names>
            </name>
            <name>
              <surname>Toorn</surname>
              <given-names>W.</given-names>
            </name>
          </person-group>
          <source>Spatial Decision Support Systems, Lecture Notes</source>
          <publisher-name>ITC,International Institute for Geo-Information Science and Earth Observation</publisher-name>
          <publisher-loc>Enschede, The Netherlands</publisher-loc>
          <year>2004</year>
        </citation>
      </ref>
      <ref id="B32-ijgi-01-00272">
        <label>32.</label>
        <citation citation-type="web">
          <person-group person-group-type="author">
            <name>
              <surname>Demetriou</surname>
              <given-names>D.</given-names>
            </name>
            <name>
              <surname>Stillwell</surname>
              <given-names>J.</given-names>
            </name>
            <name>
              <surname>See</surname>
              <given-names>L.</given-names>
            </name>
          </person-group>
          <source>A Multi-Attribute Decision-Making Module for the Evaluation of Alternative Land Consolidation Plans.</source>
          <access-date>(accessed on 25 April 2012)</access-date>
          <comment>Available online:<ext-link xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="http://www.geog.leeds.ac.uk/fileadmin/downloads/school/research/wpapers/11-02.pdf" ext-link-type="uri">http://www.geog.leeds.ac.uk/fileadmin/downloads/school/research/wpapers/11-02.pdf</ext-link></comment>
        </citation>
      </ref>
      <ref id="B33-ijgi-01-00272">
        <label>33.</label>
        <citation citation-type="book">
          <person-group person-group-type="author">
            <name>
              <surname>Ebdon</surname>
              <given-names>D.</given-names>
            </name>
          </person-group>
          <source>Statistics in Geography</source>
          <publisher-name>Replika Press</publisher-name>
          <publisher-loc>Kundli, India</publisher-loc>
          <year>1985</year>
        </citation>
      </ref>
      <ref id="B34-ijgi-01-00272">
        <label>34.</label>
        <citation citation-type="book">
          <person-group person-group-type="author">
            <name>
              <surname>Wong</surname>
              <given-names>D.</given-names>
            </name>
            <name>
              <surname>Lee</surname>
              <given-names>J.</given-names>
            </name>
          </person-group>
          <source>Statistical analysis of Geographic Information: With ArcView and ArcGIS</source>
          <publisher-name>Wiley</publisher-name>
          <publisher-loc>Hopoken, NJ, USA</publisher-loc>
          <year>2005</year>
        </citation>
      </ref>
      <ref id="B35-ijgi-01-00272">
        <label>35.</label>
        <citation citation-type="book">
          <person-group person-group-type="author">
            <name>
              <surname>Beinat</surname>
              <given-names>E.</given-names>
            </name>
          </person-group>
          <source>Value Functions for Environmental Management</source>
          <publisher-name>Kluwer Academic Publishers</publisher-name>
          <publisher-loc>Dordrecht, The Netherlands</publisher-loc>
          <year>1997</year>
        </citation>
      </ref>
      <ref id="B36-ijgi-01-00272">
        <label>36.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Steele</surname>
              <given-names>K.</given-names>
            </name>
            <name>
              <surname>Carmel</surname>
              <given-names>Y.</given-names>
            </name>
            <name>
              <surname>Cross</surname>
              <given-names>J.</given-names>
            </name>
            <name>
              <surname>Wilcox</surname>
              <given-names>C.</given-names>
            </name>
          </person-group>
          <article-title>Uses and misuses of multicriteria decision analysis (MCDA) in environmental decision making</article-title>
          <source>Risk Anal.</source>
          <year>2009</year>
          <volume>29</volume>
          <fpage>26</fpage>
          <lpage>33</lpage>
          <pub-id pub-id-type="doi">10.1111/j.1539-6924.2008.01130.x</pub-id>
        </citation>
      </ref>
      <ref id="B37-ijgi-01-00272">
        <label>37.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Malczewski</surname>
              <given-names>J.</given-names>
            </name>
          </person-group>
          <article-title>Local weighted linear combination</article-title>
          <source>Trans. GIS</source>
          <year>2011</year>
          <volume>15</volume>
          <fpage>439</fpage>
          <lpage>455</lpage>
          <pub-id pub-id-type="doi">10.1111/j.1467-9671.2011.01275.x</pub-id>
        </citation>
      </ref>
      <ref id="B38-ijgi-01-00272">
        <label>38.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Chakhar</surname>
              <given-names>S.</given-names>
            </name>
            <name>
              <surname>Mousseau</surname>
              <given-names>V.</given-names>
            </name>
          </person-group>
          <article-title>GIS-based multicriteria spatial modeling generic framework</article-title>
          <source>Int. J. Geogr. Inf. Sci.</source>
          <year>2008</year>
          <volume>22</volume>
          <fpage>1159</fpage>
          <lpage>1196</lpage>
          <pub-id pub-id-type="doi">10.1080/13658810801949827</pub-id>
        </citation>
      </ref>
      <ref id="B39-ijgi-01-00272">
        <label>39.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Triantaphyllou</surname>
              <given-names>E.</given-names>
            </name>
          </person-group>
          <article-title>A sensitivity analysis approach for some deterministic multi-criteria decision making methods</article-title>
          <source>Decision Sci.</source>
          <year>1997</year>
          <volume>28</volume>
          <fpage>151</fpage>
          <lpage>194</lpage>
          <pub-id pub-id-type="doi">10.1111/j.1540-5915.1997.tb01306.x</pub-id>
        </citation>
      </ref>
      <ref id="B40-ijgi-01-00272">
        <label>40.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Delgado</surname>
              <given-names>M.G.</given-names>
            </name>
            <name>
              <surname>Sendra</surname>
              <given-names>J.B.</given-names>
            </name>
          </person-group>
          <article-title>Sensitivity analysis in multicriteria spatial decision making: A review</article-title>
          <source>Hum. Ecol. Risk Assessment</source>
          <year>2004</year>
          <volume>10</volume>
          <fpage>1173</fpage>
          <lpage>1187</lpage>
          <pub-id pub-id-type="doi">10.1080/10807030490887221</pub-id>
        </citation>
      </ref>
      <ref id="B41-ijgi-01-00272">
        <label>41.</label>
        <citation citation-type="book">
          <person-group person-group-type="author">
            <name>
              <surname>Triantaphyllou</surname>
              <given-names>E.</given-names>
            </name>
          </person-group>
          <source>Multi-Criteria Decision Making Methods: A Comparative Study</source>
          <publisher-name>Kluwer Academic Publishers</publisher-name>
          <publisher-loc>Dordrecht, The Netherlands</publisher-loc>
          <year>2000</year>
        </citation>
      </ref>
      <ref id="B42-ijgi-01-00272">
        <label>42.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Jankowski</surname>
              <given-names>P.</given-names>
            </name>
            <name>
              <surname>Ligmann-Zielinska</surname>
              <given-names>A.</given-names>
            </name>
            <name>
              <surname>Swobodzinski</surname>
              <given-names>M.</given-names>
            </name>
          </person-group>
          <article-title>Choice modeler: A web-based spatial multiple criteria evaluation tool</article-title>
          <source>Trans. GIS</source>
          <year>2008</year>
          <volume>12</volume>
          <fpage>541</fpage>
          <lpage>561</lpage>
          <pub-id pub-id-type="doi">10.1111/j.1467-9671.2008.01111.x</pub-id>
        </citation>
      </ref>
    </ref-list>
  </back>
</article>
