OffshoringDSS: An Automated Tool of Application Maintenance Offshoring

: The rapid spread of the internet over the last two decades has prompted more and more companies to deploy their work internationally. The offshoring strategy enables organizations to cut down costs, boost shareholder value, acquire a competitive advantage, reduce cycle time, increase workforce flexibility, generate revenue and focus on their core business. The number of worldwide software development projects has increased due to globalization. Global Software Development (GSD) projects are forecast to grow by 20% to 30% in countries like India and China. The outsourcing experts choose one of the suitable models from the available global delivery options to deliver services in the global software paradigm. However, adopting the appropriate model for application maintenance is a complicated process. In addition, the right model is selected based on various influencing factors, type of the project and client requirements. Additionally, sufficient domain expertise is necessary for the decision making of offshore outsourcing. Currently, there is no dynamic and automated tool for the decision making of application maintenance offshoring. Therefore, this study presents an Offshoring Decision Support System (OffshoringDSS), an automated and novel tool to make the offshoring decisions of application maintenance. The suggested tool is based on the Analytic Hierarchy Process (AHP) technique. The tool automatically performs all the calculations involved in the decision making and ranks the sourcing models.


Introduction
The rapid spread of the internet over the last two decades has prompted more and more companies to deploy their work internationally and to outsource their IT services to specialized vendors.Outsourcing is a contract that hires subcontractors to develop and maintain software.In global outsourcing, on the other hand, a company engages a distant provider.It is a contract that allows quality software to be developed across national borders.Offshoring, offshore outsourcing, and global outsourcing are terms used interchangeably.The offshoring strategy enables organizations to cut down on costs, boost shareholder value, acquire a competitive advantage, reduce cycle time, increase workforce flexibility, generate revenue, and focus on their core business [1,2].
The number of worldwide software development projects has increased due to globalization.Likewise, the number of offshore projects is likely to increase over time.Global Software Development (GSD) projects are forecast to grow by 20% to 30% in countries such as India and China.Software companies are moving to Eastern Europe and Asia because of the lower labor costs in these countries.Other benefits of using GSD include faster time to market by leveraging the time zone difference and the use of virtual teams with diverse skills.There are many other benefits of using GSD, including reduced time to market due to time zone variations and the use of virtual teams with diverse talents [3][4][5][6].
IT outsourcing has subcategories such as software maintenance, software development, business process and infrastructure outsourcing.The four basic types of software maintenance are corrective, adaptive, perfective and preventive.Software maintenance is considered to be one of the most time-consuming and expensive phases in the software development lifecycle.The upgrading process of the existing program to fix bugs, adapt to new technologies and platforms, and adapt to a new environment is known as software maintenance.The cost of the software maintenance phase accounts for approximately 60% of total IT expenditures.Thus, an offshore outsourcing strategy is adopted to reduce the high cost of application maintenance.It is one of the common business techniques for developing and maintaining quality applications at a low price.Organizations save between 20% and 50% when outsourcing software development and offshoring maintenance [7,8].
The outsourcing experts choose one of the suitable models from the available global delivery options to deliver services in the global software paradigm.However, adopting the appropriate model is a complicated decision-making process, because the selection of the right model is based on various influencing factors, type of project and client requirements.Additionally, the process of offshore outsourcing requires knowledge and experience in the same domain.
The existing literature indicates that a minimum number of studies have concentrated on offshore outsourcing decisions.Particularly scarce research studies addressing the decision-making process of the offshoring decision of application maintenance can be found in the literature, such as [9][10][11][12][13][14][15][16][17][18][19].However, we have not observed any research study that presented an automated and novel tool to make the offshoring decisions of application maintenance.Currently, IT professionals use their experience as well as frameworks, conceptual models or multi-criteria decision-making (MCDM) models to assess the projects and choose one of the available sourcing alternatives.Hence, the current study presents Offshoring Decision Support System (OffshoringDSS), an automated and novel tool to make the offshoring decisions of application maintenance.The suggested tool is able to make the sourcing decision based on the Analytic Hierarchy Process (AHP) technique that automatically performs all the calculations according to the input provided and ranks the sourcing models.To the best of my knowledge, no such automated tool exists to make sourcing decisions.

Study Background
The literature review shows that several researchers [20][21][22][23][24][25][26][27][28][29][30] have proposed different tools as well as models that are used in the GSD context.Rahman et al. [15] suggested a model based on the factors that are used to help IT experts in taking decisions in the global delivery context.The proposed model was developed using the AHP technique, which identifies and ranks the available options and helps IT experts to choose one of the delivery models.Similarly, Ikram et al. [11] performed an empirical investigation to derive a dataset, and then a model was built based on the identified dataset using machine learning techniques.Using the proposed model, the client proposal is evaluated for software maintenance in the offshore outsourcing context.
Raza and Faria [31] presented ProcessPAIR, a revolutionary tool used by developers to analyze their performance data.Additionally, it is used to automatically identify and prioritize the performance issues as well as the basic reasons in the development of software.Beecham et al. [32] proposed the Global Teaming Decision Support System, which helps the software managers to navigate the numerous suggestions in the GSD literature and the Global Teaming Model.It is an interactive application which gathers data from the development organization and customizes global teaming model approaches to fit specific businesses and the goals of a company.The suggested tool utilizes standardized procedures that are contextualized to meet the needs of specific companies.Practitioners are capable of finding out the procedures essential to effective global software development and may go a step further by engaging with the proposed model to produce their own personalized list of recommendations.
To enable virtual software design sessions, Cataldo et al. [33] developed the CAMEL tool.The basic challenges found in the literature are addressed by the tool, such as the sharing of information, the resolution of conflict and consensus building between geographically dispersed designers, as well as providing sufficient drawing surfaces, developing understanding and maintaining focus during discussions and storing all design information for graphical representation.Hattori and Lanza [34] created a tool called Syde to help developers to restore the team awareness by disseminating information regarding the change and any dispute across developers' workstations.This method recognizes source code alterations as first-class entities to track the precise evolution of the project with several developers.Therefore, Syde offers developers detailed information about the changes.The Internet-Based Inspection System (IBIS) was developed by Lanubile et al. [35] as a web-based tool that is used to assist inspection teams that are geographically distributed.To eliminate coordination difficulties, IBIS utilizes a reengineered inspection methodology based on insights from empirical study on software inspection.Further, they discussed the use of tools during the process of inspection and presented their experience of using the IBIS tool for distributed software inspection as enabling infrastructure.
TAMRI is a planning technique developed by Lamersdorf and Münch [36] for calculating task assignments based on numerous characteristics and weighted project goals.In its implementation, it combines the distributed systems notion with Bayesian networks.Modifying the underlying Bayesian network allows the tool to be adapted to unique organizational environments.They presented and discussed the task allocation approaches, three tool application scenarios and tool implementation demos.
When a project is offshored, IT specialists pick the appropriate model among the available sourcing models to deliver the services.The appropriate model is chosen based on the projects requirements and customer preferences.Therefore, IT experts use their knowledge to evaluate and rank the sourcing options.Similarly, the experts can use an offshoring framework or an MCDM model is adopted to make the sourcing strategy.The literature, on the other hand, shows the need for an automated tool.A model that receives input from experts and automatically ranks the sourcing alternatives of application maintenance.Therefore, the present study introduces the Offshoring Decision Support System (OffshoringDSS), an innovative and automated decision-making tool.The suggested tool uses the AHP technique to make sourcing decisions and performs all calculations automatically based on the input.
The rest of the paper is organized as follows.Section 3 presents the proposed research method.Section 4 presents construction of automated tool that includes tool architecture, AHP technique for MCDM models and algorithms along with their flowcharts, and case study and discussion.While Section 5 contains limitations, and Section 6 outlines the conclusions and future work.

Proposed Method
The current section discusses the research method of developing an automated tool for application maintenance.Furthermore, the four steps as shown in Figure 1, are used to create the suggested tool.The most important factors of application maintenance were derived by conducting two systematic literature reviews, as reported in [12,13].Both literature reviews presented a list of 15 influencing factors, as given in Table 1, that will be used to assess the projects for making decisions regarding application maintenance.The identified list of influencing factors was further reviewed and validated by 93 outsourcing experts using an empirical study, as published in [14].Table 2 shows that among the 15 factors, 10 factors were identified as critical success factors.The critical factors will be used to evaluate the projects for sourcing decisions.Using the AHP approach, an MCDM model was created based on identified critical success factors, as published in [15].The model gives the ranking of alternatives for the application maintenance based on the provided priorities by the decisions makers to the factors and sourcing models.
The proposed sourcing frameworks [14,15] are employed to assess projects that help the experts to choose one of the suitable alternatives.However, using the frameworks, projects are evaluated on the basis of "Yes" and "No" or "Low", "Medium" and "High"; for example: is "legal requirements" high in the project (Yes or No)?Similarly, the decision is taken whether the impact of the legal requirements is high or medium or low.However, it is not always possible to make appropriate sourcing decisions on the basis of "Yes" or "No" and "Low", "Medium" or "High", as shown in these presented frameworks.More importantly, sufficient domain expertise is necessary to evaluate the projects based on the presented frameworks.
Furthermore, an MCDM model was presented [15] to solve the afore-mentioned limitations of the suggested frameworks.Although the presented MCDM model ranks the alternatives based on the weights assigned to factors by experts but the model lacks automation.It does not automatically calculate the various options according to the input provided.Furthermore, it is based on complex formulas and equations that need to be solved for decision making.
The current study intends to improve the process of decision-making concerning application maintenance by addressing the limitations of the previously proposed frameworks, as presented in [14,15].Furthermore, the present study also introduces automation into the previously developed MCDM model [15].Thus, a novel and automated tool for offshoring decisions using the JavaScript language is developed.The proposed automated tool is developed using the JavaScript language by implementing the AHP techniques.It would be used as a decision support system for the sourcing decision making of application maintenance.It automatically ranks the three alternatives, namely the onshore model, nearshore model and offshore model, according to the provided input.It can be adopted by both vendors and clients to make suitable sourcing decisions.Vendors may utilize the developed tool to analyze the projects in order to adopt an effective sourcing strategy that increases the likelihood of future business success.Clients may assess their projects and make the best possible selection of alternatives based on their priorities, needs and preferences.
The suggested tool consists of three major components, which are the weight calculation of criteria, the weight calculation of available alternatives, computing the consistency ratios, and ranking the sourcing alternatives.Figure 2 shows the whole working mechanism of the suggested OffshoringDSS.

Construction of Automated Tool
This section outlines the steps required to develop the proposed tool.The steps include architecture of proposed tool, the AHP technique for the MCDM model, the designed algorithms for the tool and the respective flowcharts of the developed algorithms.The following subsections provide a detailed description of these steps.

Architecture of the Tool
The architecture of the proposed OffshoringDSS is discussed in this section.Figure 3 shows a high-level overview of the artifact that describes the architecture of the proposed tool.The figure shows that the main components are calculation of the criteria weights with respect to the goal, the alternative weights with respect to the criteria and the calculation of consistency ratio with Lambda max value.Finally, the criteria weights and the alternative weights are combined to obtain the total weights, showing the ranking of the sourcing alternatives.Three different algorithms are embedded in the OffshoringDSS to perform all the required calculations for the sourcing decision-making of application maintenance.Algorithm 1 is used to compute the criteria weights and alternative weights, Algorithm 2 is used to find consistency ratios that include Lambda max value, and Algorithm 3 ranks the alternatives.The tool would help in making the sourcing decisions as follows.First, values are assigned to criteria based on the purpose and nature of the project.The tool calculates the criteria weights accordingly.The criteria used by OffshoringDSS, known as critical success factors, include the employees skills, legal requirements, cost, maturity level, poor communication, infrastructure, domain knowledge, frequent requirements' changes, project management and language barrier.Second, IT specialists obtain the weights of alternatives by assigning values to alternatives with respect to criteria.The scores to alternatives with respect to each factor are assigned based on their impact or effect on the sourcing decision.More importantly, the IT expert needs prior experience and knowledge of outsourcing, sourcing decisions and global delivery to make effective sourcing decisions.Finally, the tool ranks the available models for sourcing decisions.In addition, the tool also calculates the value of the lambda max.

AHP Technique for MCDM Model
The present study introduces the AHP-based decision support system that accepts expert input and ranks the available models accordingly.Decision-making that uses multiple criteria is known as multi-criteria decision-making.The AHP technique has various applications in fields like engineering, economics and management, etc.It mainly comprises two subcategories, namely Multi-Attribute Decision Making (MADM) and Multi-Objective Decision Making (MODM).The MADM has discrete elements and options or alternatives with limited numbers, while MODM includes continuous elements and unlimited alternatives.The two names, MADM and MCDM, are used interchangeably in the literature.MODM features continuous variables and limitless possibilities, whereas MADM has discrete elements and a limited number of options.Researchers have suggested a variety of MCDM approaches in recent years, including Elimination and Choice Expression Reality (ELECTER), Technique for Order Preference by Similarity to Ideal Solution (TOPSIS), Step-Wise Weight Assessment Ratio Analysis (SWARA), Gray Decision Making (GDM), AHP and Analytical Network Process (ANP) [37][38][39][40].
Thomas Saaty introduced AHP in 1980, one of the most important MCDM techniques.It is considered a precise and accurate technique to rank and prioritize variables.It is easy to use and offers a flexible multi-criteria decision-making technique.A complex problem is represented using the hierarchical structure of AHP, which simplifies the problem by decomposing it into the sub-problems.AHP systematically arranges both elements, such as intangible and tangible elements, resulting in a structured and relatively simple, as well as easy, solution to multi-criteria problems.This method works in areas where risk and uncertainty are accompanied by intuition, logic and irrationality.The problem can involve significant social, economic, political and technical quantities as well as a range of objectives, criteria and options [41][42][43].
AHP is a popular tool for analyzing and structuring complicated decision-making problems.It is very beneficial for assessing complex multi-criteria choices that include subjective criteria.The AHP technique can assist decision makers in calculating the weight of each criterion through pairwise comparative assessments.The weighted scoring system also has significant flaws.First, the decision-makers need to select suitable scores for the factors and available alternatives.This will need tremendous effort on the part of the parties to establish consensus.Additionally, both the weights and the ratings indicate trade-offs between the performance levels of the available options [42,44,45].
In the decision making of multi-criteria problem, AHP is often used to assess the relative importance of a collection of activities.This technique makes it possible to combine intangible qualitative aspects with measurable quantitative decision criteria.The AHP method mainly consists of three principles: first, the structure of the model; second, the comparison of alternatives and criteria; and third, prioritization.The decision-maker first divides the problem into three or more hierarchical levels.As shown in Figure 4, the goal of decision is clearly expressed at the top level of hierarchy.Similarly, criteria and sub-criteria are provided in the hierarchy at the middle level.The bottom level represents the alternatives.The decision maker uses pairwise comparisons of criteria relative to the goal to generate ratio-scaled priorities that show the relative importance of the factors.Similarly, the decision maker develops ratio-scaled priorities of alternatives with respect to each criterion.Finally, the weights are merged to obtain the ranking of the sourcing alternatives and to choose the best model.The current study aims to determine the relative importance of factors and ranks the sourcing options accordingly.Therefore, the AHP is the best method to calculate the weights of the attributes and to identify the rankings of available models [42,[46][47][48].

Developed Algorithms and Their Respective Flowcharts
The current subsection provides a detailed description of the working mechanism of the suggested tool.The OffshoringDSS performs automated operations, such as calculating the criteria weights and alternative weights and identifying the preferences of sourcing alternatives.The developed tool is based on Analytic Hierarchy Process (AHP) approach and developed using JavaScript language.The overall AHP method is represented by three algorithms: Algorithm 1 "finding weights", Algorithm 2 "finding inconsistency ratios" and Algorithm 3 "ranking of alternatives".Similarly, these algorithms are represented by their respective flowcharts, as given in Figures 5-7.
In the first step, input is provided to factors and alternatives by IT experts on a 1-9 points scale.Algorithm 1, as represented by its corresponding flowchart shown in Table 3 and Figure 5, calculates the weights of factors relative to goal and the weights of alternatives relative to criteria.The second step is about the calculation of inconsistency ratios that check the results obtained in the previous step.If the CR is less than 0.1 the output is acceptable and if it is greater than 0.1 then the expert should revise the input to factors and alternatives.Checking and calculating inconsistency ratios are achieved in the second step using Algorithm 2 and its respective flowchart, as given in Table 4 and Figure 6.Initialize var_counter = 0 2.
Loop till model_data

. Exit function
The third step provides ranking of the available alternatives.It is the final step that ranks the alternatives by combining the weights identified in the previous two steps.Algorithm 3 and its corresponding flowchart are given in Table 5 and Figure 7.This final step shows the raking process and identifies the order of sourcing models for offshoring application maintenance.Initialize var_counter = 0 2.
End Loop on Wa 8.
Exit function

Case Study Analysis and Discussion
This section discusses a case study conducted in the outsourcing industry to assess and validate the OffshoringDSS results.Before making an offshoring decision and selecting the best sourcing model from the available options, the project is reviewed on the basis of goals and requirements of the organization.The critical success factors used to evaluate projects and make the decisions of application maintenance are employees' skills, infrastructure, cost, poor communication, domain knowledge, legal requirements, project management, frequent requirements changes, language barrier and maturity level.The proposed OffshoringDSS determines the criteria weights and alternative weights based on the supplied input.Consequently, the overall weights of the alternatives are computed, and the sourcing models are ranked accordingly.The developed innovative tool is used by experts to make application maintenance outsourcing decisions.Similarly, it is able to automatically compute the weights of factors and available alternatives and accurately determine the ranking of sourcing options with less effort.The tool is freely available online at http://47.243.206.42/dmm/.Figure 8 shows the login page of the developed tool.
The input for the case study comes from an IT specialist from Vattenfall AB, Stockholm, Sweden.In addition, a strategist and consultant from Stairo Global LLC in the United States and an IT specialist from Khyber Pakhtunkhwa Information Technology Board (KPITB), Peshawar, Pakistan, validated the results generated by the developed tool.The complete decision-making process of application maintenance utilizing the developed OffshoringDSS is as follows.

Input to Criteria
The proposed automated tool is developed using the AHP approach.In order to develop the proposed tool, the first step is to determine the criteria.In the current study the adopted criteria are employees' skills, domain knowledge, legal requirements, cost, infrastructure, poor communication, project management, maturity level, frequent requirements changes and language barrier.Each component is assigned a relative value using the 9-point scale as shown in Table 1.The score is given based on its importance in relation to the objective.By comparing each pair of components, the relative significance of one attribute to the other is determined.A score of 9 shows that one criterion is extremely superior to another, while a value of 1 indicates equality.If the second factor has a higher priority than the first factor, a reciprocal is included.Thus, using the 9-point scale, the values from 1/9 to 9 are obtained [42,49,50].An IT professional from Vattenfall AB, Stockholm, Sweden, supplied his choices for the sourcing criteria, as indicated in Table 6.

Criteria Weight Calculation
In the second step, the weights of the criteria and sourcing alternatives are calculated.Table 7 shows the weights calculation of the criteria.The proposed tool automatically determines the weights of the factors after receiving the criteria scores.As shown in Figure 9, the factors weights are achieved by providing the specified scores into the constructed tool.

Calculation of Inconsistencies
Some inconsistencies may be observed as the comparisons are based on personal or subjective judgments.One of the most important advantages of the AHP is the final operation called the consistency check.It is used to calculate the consistency ratio between pairwise comparisons.This ensures that the judgments are consistent.
The upper value limit of CR is 0.1; therefore, the IT experts should revise the pairwise comparisons if a consistency ratio is greater than 0.1.It is used to evaluate the consistency of the expert and the overall hierarchy [42,51,52].Equation ( 1) is used to calculate the Consistency Index (CI), whereas Equation ( 2) is used to identify the Consistency Ratio (CR) [53,54].These formulas are implemented in the proposed tool to present the consistency ratios.

C I =
(  − 1) ( − 1) In order to find value of CI, the Lambda max value need to calculated using Equation (3).
Furthermore, the step by step, calculation of Lambda max is given as follows: Besides the weights, it also provides the consistency ratios.The results of the tool indicate that both the offshore model and nearshore model received equal importance of 44%, while the received preference of onshore model is just 11%.Similarly, Figures A1-A9, as given in Appendix A, show the assigned scores for sourcing alternatives in relation to the remaining criteria, their corresponding calculated weights using remaining criteria and their corresponding calculated weights using the developed OffshoringDSS, along with the consistency ratios.

Ranking of Sourcing Alternatives
The current section discusses the ranking process of sourcing alternatives as well as the ranking of alternatives using the developed tool.The preference of each alternative is achieved by summing the total weights (Wci*Wai).Wci means the weight of criteria in relation to the goal as shown in Section 4.6, whereas Wai means the weights of alternatives in relation to the criteria as given in Section 4.8.Similarly, Table 10 shows the process of identifying the preferences of sourcing alternatives.Algorithm 3 was added to the OffshoringDSS to automatically rank the sourcing alternatives.Figure 11 shows the ranking of three sourcing models.The received preferences of the onshore model and offshore model are 34.8% and 35.7%, respectively, while the offshore model gained only 29%.The nearshore model appears to be the most appropriate model for the project, whereas the onshore model comes second.The obtained result was shared back with the same offshoring expert who supplied the input for this case study and also with other outsourcing specialists.They noted that OffshoringDSS is simple, easy to use and produces accurate results.

Limitations of the Proposed Tool
To our knowledge, there is no such automated and novel tool to make the application maintenance offshoring decisions.The OffshoringDSS is a novel tool that helps decision makers to make effective decisions of application maintenance offshoring.However, the automated tool has several limitations that may hamper its wide application in the outsourcing industry.
To make sourcing decisions, IT professionals need to evaluate factors and alternatives.Based on the type of project and client's requirements, the influencing factors are quantified.Therefore, decision makers need to be experts in offshore outsourcing and GSD to make effective sourcing decisions.
The current version of the tool is based on 10 influencing factors.These factors were identified by conducting two systematic literature reviews [12,13].Furthermore, these factors were validated by an empirical study [14].Therefore, the developed tool considers no more than 10 factors to make sourcing decisions.
It is an automated tool capable of ranking the onshore model, nearshore model and offshore model.The ranking is based on the supplied ratings of variables and alternatives.The created tool, however, can only rank three different sourcing options.Although other multi-criteria decision-making strategies, such as the analytic network process, are available, the current version of the tool relies solely on the AHP technique to make offshore decisions.

Conclusions and Future Research
The purpose of this study is to examine the application maintenance outsourcing decision-making process.OffshoringDSS, a novel and automated tool, was introduced for reaching application maintenance offshoring decisions.A set of 10 influencing factors were used in the development of tool, namely employee skills, cost, legal requirements, poor communication, infrastructure, project management, maturity level, domain knowledge, frequent requirements changes and language barrier.The AHP technique was implemented using the JavaScript language to create the tool.The tool was validated in the outsourcing industry by conducting a case study.An IT expert from Vattenfall AB, Stockholm, Sweden, provided input for the decision making.In addition, the result obtained with the developed tool was validated by a strategist and consultant at Stairo Global LLC in the United States and an IT expert at KPITB, Peshawar, Pakistan.The developed tool is used to make the offshoring decisions based on the influencing factors, project nature and preferences of the clients.It can be adopted by vendors as well as clients for making suitable sourcing decisions.It can be used as a decision support system that ranks three alternatives, i.e., the onshore model, nearshore model and offshore model and shows the appropriate model for application maintenance.Vendors may utilize the developed tool to analyze the projects in order to adopt an effective sourcing strategy that increases the likelihood of future venture success.Clients may assess their projects based on their priorities and make the best possible selection based on their needs and preferences.Therefore, the suggested tool also assists clients in making effective and appropriate sourcing decisions.The current tool is based on the AHP technique, and it is therefore planned to incorporate the ANP technique in the future.The developed tool only ranks onshore, nearshore and offshore models based on a set of 10 factors.Therefore, by implementing the ANP technique, the current automated model will be further improved, as well as the developed tool will be enabled to rank more than three alternatives.

Figure 2 .
Figure 2. Working procedure of the suggested OffshoringDSS.

Figure 4 .
Figure 4. Hierarchical model to choose the appropriate alternative.

Figure 8 .
Figure 8. Login page of the proposed tool.

Figure 9 .
Figure 9. Weights of criteria with reference to the goal.

Figure A3 .
Figure A3.Alternatives weights with reference to LR and CR.

Figure A4 .
Figure A4.Alternatives weights with reference to Inf and CR.

Figure A5 .
Figure A5.Alternatives weights with reference to ML and CR.

Figure A6 .
Figure A6.Alternatives weights with reference to FRC and CR.

Figure A7 .
Figure A7.Alternatives weights with reference to LB and CR.

Figure A8 .
Figure A8.Alternatives weights with reference to DM and CR.

Figure A9 .
Figure A9.Alternatives weights with reference to PM and CR.

Table 1 .
List of influencing factors.

Table 2 .
Factors ranked as critical success factors.

Table 3 .
Calculating weights of factors and alternatives.

Table 5 .
Identifying the ranking of sourcing alternatives.

Table 6 .
Relative scores of criteria.

Table 10 .
Identifying ranking of the given alternatives.