Next Article in Journal
Tailor-Made Feedback to Reduce Residential Electricity Consumption: The Effect of Information on Household Lifestyle in Japan
Previous Article in Journal
The Role of Knowledge Intensive Business Services on Romania’s Economic Revival and Modernization at the Regional Level
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Integration of Balanced Scorecard (BSC), Strategy Map, and Fuzzy Analytic Hierarchy Process (FAHP) for a Sustainability Business Framework: A Case Study of a Spanish Software Factory in the Financial Sector

Department of Project Engineering, University of Oviedo, C/Independencia 3, 33004 Oviedo, Spain
*
Author to whom correspondence should be addressed.
Sustainability 2017, 9(4), 527; https://doi.org/10.3390/su9040527
Submission received: 2 February 2017 / Revised: 23 March 2017 / Accepted: 28 March 2017 / Published: 30 March 2017
(This article belongs to the Section Economic and Business Aspects of Sustainability)

Abstract

:
This paper presents a case study of how a Spanish financial software factory (FSF) has determined the weights of the indicators and objectives included in their strategy map with the aim of ensuring its business sustainability. A strategy map is a graphical representation of the cause-effect relationships between strategic objectives and indicators of a balanced scorecard (BSC). The detailed description of the strategy map development and deployment is not part of the aim of this work as it was described in a former paper. In this study, FAHP, a multicriteria decision-making (MCDM) method using the concepts of fuzzy set theory and hierarchical structure analysis, was used to calculate the weights. The analysis was carried out considering the points of view of different groups of stakeholders (shareholders, top management, middle managers, other employees, customers and some experts in the field of software factories) and the results are presented grouped by role to get a better understanding of the preferences of each kind of stakeholder. The conclusions of this study give a better insight of the corporative sustainability strategies of this kind of firms as well as the different vision of each stakeholder, what could be very valuable to the software factory managers for the decision-making and the strategic management of their organizations.

1. Introduction

The banking sector is one of the sectors that requires the most amount of software and the development of its business applications represents over 50% of the managed information technology (IT) budget [1], but banks usually pay for the time it takes to produce the software and not the amount produced, a model that in most cases increases the cost of the projects. Financial entities need software development firms to measure the “software production” they are delivering to them. With this information, they can create strategies to transform these software firms into industrialized software manufacturers able to provide software projects related to the efficiency, fast delivery and quality that the financial markets expect today [2]. In addition, since the advent of the Internet and especially since the emergence of smartphones, around the year 2007, banks have tried to relocate in order not to lose their dominant position in the financial sector, although, according to SAP and IBM [3], the traditional banking industry does not keep up very well with today’s constantly changing technology landscape. To solve these challenges, banking requires changes in the software factories that develop its software and systems to increase productivity and reduce costs to be able to face the new challenges in the sector.
Our paper [4] published at the end of 2015 describes the case in which a financial software factory FSF in Spain decided to review the concept of industrialization of software development to implement the principles and elements of the software factory approach [5]. This initial paper suggests a strategic management framework based on the balanced scorecard BSC [6,7] and the strategy map [8,9] to guarantee the business sustainability of FSF. One problem with this initial proposal of BSC framework is that it does not establish the importance weights of the indicators, perspectives and objectives defined in the strategy map of FSF. To know these weights, we have opted for the integration of BSC and strategy map with fuzzy analytic hierarchy process FAHP, a multicriteria decision-making useful method of calculating weights into an evaluation performance system [10] to ensure its sustainability.
The literature does not offer a general conceptual definition of sustainable business models in the context of technological, organizational and social innovation [11], but changes to business models are recognised as a fundamental approach to realise innovations for sustainability [12]. Wirtz’s book [13] makes a systematic overview of business model management, and identifies three perspectives related to this model focused on: technology, organizational (deals with the business model as a strategic management tool to improve a company’s value chain) and strategy-oriented (adds the element of market competition to the efficiency). The notion of sustainable business models builds on the business model concept and combines it with the important concepts of stakeholder management [14], sustainable value creation [15], and a long-term perspective. Sustainable business model is an emerging topic, but only few tools are currently available to assist companies in sustainable business modelling [16]. The sustainable business model outlined in this paper encourages the operational efficiency, long-term relationship with customers and a focus on their needs, expanding the customer portfolio and employee engagement.
This paper shows a case study in which a Spanish FSF opted to change its management system and establish a new framework based on a weighted strategy map with the aim of ensuring its business sustainability, which is related to achieving a viable sustainable business model over time in terms of productivity and profitability, through appropriate decision-making. In addition, the results will be analysed not only globally, but also by stakeholder roles grouped, which represents a fact to highlight compared to other studies that apply a similar methodology as this study.
The remainder of this paper is organized as follows. Section 2 reviews the literature related to the BSC, the strategy map, FAHP theory and their integration as an evaluation framework. Section 3 describes the research methodology. Section 4 shows the results of the study. Section 5 presents the analysis and discussion of the results. Finally, Section 6 exposes the conclusions, implications, limitations and future research directions related to this paper.

2. Sustainable Evaluation Framework for a FSF Based con BSC, Strategy Map and FAHP

This section includes a review of the literature on the BSC and the strategy map, paying particular attention to their application in a FSF. We then introduce the fuzzy set theory and the FAHP. Finally, and integration of the BSC and the strategy map with FAHP is presented to establish the importance weights for links among indicators and goals included in the strategy map for a sustainable evaluation framework.

2.1. The BSC for a FSF

In today’s competitive world, every organization needs a management system that permits an awareness of the performance and productivity with which it is working in order to protect its competitive advantages. The productivity measure in software development is more difficult as is in other industries, due to the intangible nature of software and the difficult to measure output [17]. Nevertheless, it is a necessary management system that can monitor production. The BSC developed by Kaplan and Norton is probably the best–known management tool for companies. In 1992 and the years that followed, Kaplan and Norton, of Harvard University, presented the BSC [6,7] as a corporate performance tool that allows managers to look at the business from four important perspectives: financial, customer, internal business processes and learning and growth. In the following years, Kaplan and Norton presented new views and ways to improve the initial BSC approach and linked it with measures, objectives and business strategy [18,19,20]. The BSC is applied by many businesses to assess their performance in diverse aspects of their organization, but it is only a template and must be customized for the specific elements of an organization. Since the BSC was introduced, many authors have proposed some modifications to adapt the initial BSC to other scorecards that were specific for different areas or industrial environments. Studies about the IT BSC [21,22] in the IT sector, the Sustainability BSC (SBSC) [23,24] for sustainable businesses, other studies such as [25,26] that expose the benefits of using the BSC in the financial sector, and finally the specific BSC for a FSF [4,27] are some examples in relation to this study.
Figure 1 shows the BSC for a FSF and includes the chosen key performance indicators (KPIs) with various fields assigned to each: Code, KPI Name, KPI Owner, Frequency Measurement, Value Measurement, Target Tendency and the Upper and Lower Control Limits to manage the stability of processes. This BSC was established by the FSF as a control tool for the top management of the organization according the strategic objectives and the mission and vision of the FSF defined in its strategy map. The KPIs were made in several work sessions with the participation of different roles of employees. Some of the KPIs were simple to create and easy to obtain, but others are difficult to obtain because they are a compendium of different indicators and measures. The top management and consultants review the validity of the KPIs annually, and KPIs are modified or adjusted if it is necessary. The description of the KPIs included in the BSC for a FSF are extensively explained in our prior paper [4].

2.2. The Strategy Map for a FSF

The main contribution of the BSC framework is that it includes performance measurements and strategic objectives. Kaplan and Norton introduced three principles that link the BSC of an organization to its own strategy: (1) cause–effect relationships; (2) performance drivers; and (3) linkage to financial goals [28]. Strategy maps are built according to the four perspectives of the BSC and they interface between the business strategy and the BSC. Strategy maps provide a visual framework that has been developed by companies in virtually all areas. In relation to this article, it is necessary to highlight the following proposals about the application of the BSC and the strategy maps in the financial sector [28,29], in the software development sector [30,31], in IT departments or companies [22,32,33] and other proposals related to business and corporate sustainability [24,34]. These studies are some examples about the application of strategy maps for linking measurements with business aims.
In software-intensive organizations, such as a software factory, it is necessary to link software measurement goals to higher-level goals. This linkage is important, as it helps to justify software measurement efforts and allows measurement data to contribute to higher-level decisions [30]. Furthermore, linking software activities to an organization’s higher-level business goals can improve its performance [35]. Our prior paper [4] implements the business strategy in a FSF by applying the BSC framework, linking the measurement to higher-level goals for the FSF through its strategy map. Figure 2 shows the strategy map for a FSF. At the top of the strategy map are the strategic goals: the mission and vision, the two high-level goals and the six business goals. Under each business goal, a subset of KPIs is situated. This subset includes the KPIs that are directly linked and have an influence on each specific business goal. Every business goal has its own subset of KPIs, and every KPI can influence more than one business goal. This proposal shows the relationships among indicators, perspectives and objectives included in the strategy map, but it does not include weights for each of them.

2.3. Fuzzy Theory and FAHP

In this section, we review some relevant concepts as fuzzy numbers theory and its incorporation into the AHP, calling the resulting theory FAHP, used to determine criteria weights.

2.3.1. Fuzzy Numbers and Linguistic Variables

Evaluating different alternatives is a MCDM problem in the presence of many quantitative and qualitative attributes. The AHP is a method that has been widely used for selecting the best alternative among others [36,37], but fuzzy sets could be incorporated with the AHP, an approach that allows a more accurate description of the decision-making process [38]. Expressions such as “not very clear”, “probably so”, and “very likely” are used often in daily life and more or less represent some degree of uncertainty of human thought. The fuzzy set theory proposed by Zadeh in 1965 [39], an important concept applied in the scientific environment, has been available to other fields as well. Consequently, fuzzy theory has become a useful tool for automating human activities with uncertainty-based information [38]. Therefore, this research incorporates fuzzy theory into the performance measurement by objectifying the evaluators’ subjective judgements. Below, some basic definitions of fuzzy sets, fuzzy numbers, and linguistic variables, mainly from Buckley, Zadeh, and others [40,41,42,43,44], are reviewed, similarly to those presented in other studies [38,45] that combine the FAHP and the BSC framework.
In classical set theory, the truth value of a statement can be given by the membership function as μA(x):
μ A   ( x ) =   { 1   if   x     A 0   if   x     A
Central to fuzzy set theory is the notion of the fuzzy number. Fuzzy numbers are a fuzzy subset of real numbers and they represent the expansion of the idea of a confidence interval. According to the definition by Dubois and Prade [46], the fuzzy number A ˜ is a fuzzy set and its membership function is μ A ˜ ( x ) : R [ 0 , 1 ] ( 0 μ A ˜ ( χ ) 1 , x X ) , where x represents the criterion and is described by the following characteristics: (1) μ A ˜ ( x ) is a continuous mapping from R (real line) to the closed interval [0, 1]; (2) μ A ˜ ( x ) is a convex fuzzy subset; and (3) μ A ˜ ( x ) is the normalization of a fuzzy subset, which means that there exists a number x 0 such that μ A ˜ ( x 0 ) = 1 .
In applications, it is often convenient to work with triangular fuzzy numbers (TFNs) because of their computational simplicity [47,48,49], and they are useful in promoting representation and information processing in a fuzzy environment [50]. For instance, the TFN A ˜ = ( l ,   m ,   u ) can be defined as Equation (2) and the TFN membership function is shown in Figure 3:
μ A ˜ ( x ) =   { ( x l ) / ( m l )   if   l x m   ( u x ) / ( u m )   if   m x u 0   otherwise .
Based on the characteristics of TFNs and the extension definitions proposed by Zadeh [41], given any two positive TFNs A ˜ 1 = ( l 1 ,   m 1 ,   u 1 ) and A ˜ 2 = ( l 2 ,   m 2 ,   u 2 ) and a positive real number r, some algebraic operations of the TFNs A ˜ 1   and   A ˜ 2 can be expressed as follows:
Addition   of   two   TFNs   : A ˜ 1 A ˜ 2 = ( l 1 + l 2 , m 1 + m 2 , u 1 + u 2 )
Multiplication   of   two   TFNs   : A ˜ 1 A ˜ 2 = ( l 1   l 2 , m 1   m 2 , u 1   u 2 )
Multiplication   of   any   real   number   r   and   a   TFN   : r A ˜ 1 = ( r l 1 ,   r m 1 ,   r u 1 )   for   r > 0   and   l i > 0 ,   m i > 0 ,   u i > 0
Subtraction   of   two   TFNs   : A ˜ 1 A ˜ 2 = ( l 1 u 2 , m 1 m 2 , u 1 l 2 )   for   l i > 0 ,   m i > 0 ,   u i > 0
Division   of   two   TFNs   : A ˜ 1 A ˜ 2 = ( l 1 u 2 , m 1 m 2 , u 1 l 2 )
Reciprocal   of   a   TFN : A ˜ 1 1 = ( 1 u 1 , 1 m 1 , 1 l 1 )   for   l i > 0 ,   m i > 0 ,   u i > 0
According to [41], a conventional quantification of reasonable expression in situations that are complex or hard to define is very difficult. In these cases, the notion of a linguistic variable is vital. Linguistic variables are variables whose values are words or sentences in a natural or artificial language. In other words, they are variables with lingual expression as their values [41,51].
This paper uses five basic linguistics terms for comparing the best plan evaluation criteria: “equally important”, “weakly important”, “essentially important”, “very strongly important”, and “absolutely important”, according to the fundamental scale of Saaty [52]. The membership function of a linguistic term is defined by Mon et al. [53] and displayed in Table 1.
The evaluators are asked to conduct their judgements, and each linguistic variable can be indicated by a TFN. An example of membership functions of five levels of linguistic variables is shown in Figure 4.
The use of linguistic variables is applied widely. In this paper, linguistic variables expressed by TFNs are adopted to represent evaluators’ subjective measures to determine the degrees of importance among evaluation criteria and also to assess the performance value of alternatives.

2.3.2. FAHP

AHP was developed by Saaty in the 1970s [54,55,56,57,58], initially to solve the scarce resources allocation and planning needs of the military. Since its introduction, the AHP has become one of the most widely used MCDM methods and has been used to solve unstructured problems in different areas of human needs and interests [59]. Finally, the AHP became a useful approach to solve complex decision problems that prioritizes the relative importance of a list of criteria (critical factors and sub-factors) through pairwise comparisons amongst the factors by relevant experts using a nine-point scale. However, due to the vagueness and uncertainty of judgements of the decision-makers, the fuzzy number logic was introduced in the pairwise comparison of the AHP to make up for this deficiency in the conventional AHP [60]. Buckley [40] incorporated fuzzy theory into the AHP, calling the resulting theory FAHP. In 1996, Chang introduced a new approach for handling FAHP with the use of TFNs [61] for pairwise comparisons. FAHP generalizes the calculation of the consistent ratio into a fuzzy matrix.
The procedure of the FAHP for determining the evaluation weights is explained as follows:
  • Step 1: Construct fuzzy pairwise comparison matrices. Through expert questionnaires, each expert is asked to assign linguistic terms by TFNs (as shown in Table 2 and Figure 4) to the pairwise comparisons among all criteria in the dimensions of a hierarchy system. The result of the comparisons is constructed as fuzzy pairwise comparison matrices ( A ˜ ) as shown in Equation (9).
  • Step 2: Examine the consistency of the fuzzy pairwise comparison matrices. According to this research [40], it proves that if A = [ a i j ] is a positive reciprocal matrix then A ˜ = [ a ˜ i j ] is a fuzzy positive reciprocal matrix. That is, if the result of the comparisons of A = [ a i j ] is consistent, it implies that the result of the comparisons of A ˜ = [ a ˜ i j ] is also consistent. Therefore, this research employs this method to validate the questionnaire:
    A ˜ = [ 1 a ˜ 12 a ˜ 1 n a ˜ 21 1 a ˜ 2 n a ˜ n 1 a ˜ n 2 1 ] = [ 1 a ˜ 12 a ˜ 1 n 1 a ˜ 12 1 a ˜ 2 n 1 a ˜ 1 n 1 a ˜ 2 n 1 ]
  • Step 3: Compute the fuzzy geometric mean for each criterion. The geometric technique is used to calculate the geometric mean ( r ˜ i ) of the fuzzy comparison values of criterion i to each criterion, as shown in Equation (10), where a ˜ i n is a fuzzy value of the pairwise comparison of criterion i to criterion n [40].
    r ˜ i = [ a ˜ i 1 a ˜ i n ] 1 n
  • Step 4: Compute the fuzzy weights by normalization. The fuzzy weight of the ith criterion ( w ˜ i ) can be derived as Equation (11), where w ˜ i is denoted as w ˜ i = (Lwi, Mwi, Uwi) by a TFN and Lwi, Mwi, and Uwi represent the lower, middle, and upper values of the fuzzy weight of the ith criterion.
    w ˜ i = r ˜ i ( r ˜ 1 r ˜ 2 r ˜ n ) 1

2.3.3. The Synthetic Value of Fuzzy Judgement

Since Bellman and Zadeh [62] proposed the decision-making methods in fuzzy environments in 1970, an increasing number of related models have been applied in various fields, including control engineering, expert systems, artificial intelligence, management science, operations research, and MCDM. The main application to decision-making problems is focused on criteria evaluation or project selection and can assist in selecting the best alternative or ranking the order of projects or alternatives.
Due to the differences in the subjective judgements among the experts about each evaluation criterion, the overall valuation of the fuzzy judgement is employed to synthesize the various experts’ opinions in order to achieve a reasonable and objective evaluation. The calculation steps to obtain the synthetic value are as follows:
Step 1: Performance evaluation of the alternatives. Against the evaluation criteria, each linguistic variable can be represented by a TFN. Assume that E ˜ i j k denotes the fuzzy valuation of performance given by the evaluator k towards alternative i under criterion j, as Equation (12) shows, then:
E ˜ i j k = ( L E i j k , M E i j k , U E i j k )
In this research, E ˜ i j k represents the average fuzzy judgement values integrated by m evaluators as
E ˜ i j = ( 1 m ) ( E ˜ i j 1 E ˜ i j 2 E ˜ i j m )
According to Buckley [40], the three end points of E ˜ i j can be computed as
L E i j = ( k = 1 m L E i j k ) / m ,   M E i j = ( k = 1 m M E i j k ) / m ,   U E i j = ( k = 1 m U K i j k ) / m
Step 2: Fuzzy synthetic judgement. According to the fuzzy weight, w ˜ j , of each criterion calculated by FAHP, the criteria vector ( w ˜ ) is derived as Equation (15). The fuzzy performance matrix ( E ˜ ), as presented in Equation (16), of all the alternatives can be acquired from the fuzzy performance value of each alternative under n criteria.
w ˜ = ( w ˜ 1 , , w ˜ j , w ˜ n ) t ,
E ˜ = [ e ˜ i j ]
Then, the final fuzzy synthetic decision can be deduced from the criteria weight vector ( w ˜ ) and the fuzzy performance matrix ( E ˜ ), and then the derived result, the final fuzzy synthetic decision matrix ( R ˜ ), is calculated by R ˜ =   E ˜     w ˜ , where the sign indicates the computation of the fuzzy number, consisting of both fuzzy addition and fuzzy multiplication. Considering that the computation of fuzzy multiplication is rather complicated, the approximate result of the fuzzy multiplication is used here. For instance, the approximate fuzzy number ( R ˜ i ) of the fuzzy synthetic decision of the alternative i is denoted as Equation (17), where L R i , M R i , and U R i are the lower, middle, and upper synthetic performance values of alternative i, respectively, and the calculations of each are illustrated as Equation (18).
R ˜ i = ( L R i , M R i , U R i )
where
L R i = j = 1 n L w j × L E i j ,   M R i = j = 1 n M w j × M E i j ,   U R i = j = 1 n U w j × U E i j .
Next, the procedure of defuzzification [51,63] locates the best nonfuzzy performance (BNP) value. There are different methods that can be used in such defuzzified fuzzy ranking, but in this study we used the Center of Area method to find out the BNP because it is simple and practical without the need to bring in the preferences of any evaluators. The BNP value of the fuzzy number R ˜ i can be found by
B N P i = [ ( U R i   L R i ) + ( M R i   L R i ) ] 3 + L R i i
According to the value of the derived BNP for each alternative, the weight of each of the alternatives and criteria can then proceed.

2.4. Integration of BSC and Strategy Map Framework with FAHP

Although the integration of BSC with MCDM techniques such as AHP or FAHP has usually been adopted as a useful method of calculating weights and can help establish an evaluation performance system, the integration of strategy maps with AHP or FAHP to establish the importance or weights for business strategic objectives has only been used in a few studies. In most cases, it has been used to define the strategy map of a company, but this study integrates the BSC and the strategy map of a FSF with FAHP to assess the impact of each indicators measure changes in the affected business strategies, facilitating to the FSF managers the decision-making based on the improvement of the desired strategy. Wu [28] presents a structural evaluation methodology to link KPIs into a strategy map of the BSC for banking institutions, using MCDM analytical techniques to construct the strategy map for banks. For information services firms, Chen and Wang [64] propose a fuzzy–delphi AHP combined with performance indexes to help firms adjust their business strategies and make better business decisions. Ren et al. [65] present a comprehensive methodology with AHP to translate strategic objectives into performance metrics in supply-chain decision-making, linking the strategy map to low-level metrics with weights. Taticchi et al. [66] present a framework based on business performance measurements and AHP for providing direction and guidance to an organization. It identifies cause–effect relationships in business processes and measures performance and business strategic objectives in a hierarchical strategy branch. Quezada et al. [67] present an application of AHP to support the creation of a strategy map and propose the relationships that are important (with weights for each of them) within the strategy map. With a similar aim, another paper of Quezada and López-Ospina [68] presents a method of designing a strategy map using AHP and linear programming. Lu et al. [69] propose a multicriteria decision analysis to develop effective sustainable development strategies for enhancing competitive advantages. Finally, in the auto industry and dairy companies, respectively, Abdolshah et al. [70] and Sorayaei et al. [71] propose an integrated approach to analyse the strategy map using the BSC and the FAHP, and they determine weights for each strategy and each aspect.
The study presented here proposes an integration of BSC and strategy map with FAHP to determine the relative weights for the KPIs and objectives included in the strategy map to assess the impact of changes in the mission and vision of the organization.

3. Methodology

This section presents the research methods used to conduct the study. We explain the methodology steps and how the necessary data and information to address the research objectives were collected, presented and analysed.

3.1. Methodology Steps

In this research, the BSC and the strategy map for a FSF were taken as the framework for establishing weights for KPIs, perspectives, business goals, and high-level goals. The analytical structure of this research is explained in Figure 5. We first used the BSC and the strategy map for a FSF to study the different KPIs and strategic objectives and then we interviewed several managers in a Spanish FSF. We then got the views of software factory experts and we designed a pairwise comparison questionnaire based on the hierarchical structure of the BSC and the strategy map. Finally, FAHP was applied to obtain the weights of KPIs and objectives included in the strategy map. Afterwards, these weights were treated with the purpose of determining the influence that KPI measures exert on the mission and vision of the organization, depending on the business strategy to be valued.
The steps taken to achieve this purpose are as follows:
  • Analyse the BSC and the strategy map of the FSF.
  • Define the hierarchical framework related to the BSC and strategy map of FSF.
  • Prepare a questionnaire in AHP format to obtain the opinions of experts regarding KPIs, perspectives and goals, under the premise of achieving the mission and vision defined in the strategy map of the organization.
  • Prepare the answers obtained from the experts and give these answers the necessary format for their computer treatment with FAHP software.
  • Calculate the local and overall weights of all the KPIs and perspectives included in the BSC.
  • Calculate the local and global weights of all the objectives included in the strategy map.
  • Based on the relationships between KPIs and goals defined in the strategy map, calculate the relative weight of each indicator according to the business goal that it affects directly. The total weight of the indicators is distributed in proportion to the weight of the affected business goals.
  • Incorporate the calculated weights in the strategy map, which allows the impact of each KPI on the mission and vision of the organization to be known.

3.2. Hierarchical Framework of the BSC and the Strategy Map for Evaluation Criteria in a FSF

The BSC and the strategy map for a FSF have been adopted as hierarchical models in this study. The hierarchical framework of the BSC performance evaluation criteria and sub-criteria (i.e., four perspectives and thirteen KPIs) for a FSF is shown in Figure 6 and uses the four perspectives of the BSC for FSF and the indicators included in each one of them to create the hierarchy. The thirteen KPIs are grouped into the four BSC perspectives: “F: Financial (F1–F3)”, “C: Customer (C1–C3)”, “I: Internal Business Process (I1–I5)”, and “L: Learning and Growth (L1–L2)”. On the other hand, the hierarchical framework of the strategy map evaluation criteria and sub-criteria (i.e., six business goals and two high-level goals) for a FSF is shown in Figure 7 and uses the existing relationships between the strategic objectives defined in the strategy map to create the hierarchy. The six business goals are grouped into the two high-level goals: “HLG1: Improve Productivity (BG1–BG4)” and “HLG2: Improve Cost (BG5–BG6)”. These hierarchies provide a structure to express the organization’s needs [72] and directly support achievement of the mission and vision of the company [24].

3.3. Data Collection

Based on the hierarchies shown in Figure 6 and Figure 7, a questionnaire to find out the participants’ judgements was designed with a conventional AHP questionnaire format, the five-point linguistic scale shown in Table 1, and pairwise comparison. The questionnaire included the definition and meaning of each criterion or sub-criterion included in every question. After the questionnaire was designed, it was given to some experts, shareholders, and managers of a FSF to test its reliability and validity. Their corrective views were taken into consideration in the final design to avoid potential interpretation errors when the different stakeholders answered the questionnaire. An instruction sheet for completing the questionnaire was created to assist respondents and an example of how the questionnaire should be filled in was given to them. A total of 83 questionnaires were distributed (by email and online form) to stakeholders with different roles related with the FSF. These were grouped, according to the proposal of roles made by the top management of the FSF and the purpose of consider different types of points of view, into Shareholders, Top management, Middle managers, Other employees, Customers and Experts in the field of software factories. The latter were included to seek their professional opinions and the purpose of weighting criteria under the FSF business sustainability aim. Table 2 shows the different stakeholder roles and their relation with a FSF.
Finally, 61 questionnaires were received (73.5% of questionnaires sent). The questionnaire responses were revised and adapted to the necessary format in order to put this information into the FAHP system (the software used in this study was the FuzzyAHP package of R [73]) generating the pairwise comparison matrixes. The questionnaires that did not pass the consistency test (used to directly estimate the consistency of pairwise comparisons [56]) were revised and the values of the comparison matrix were considered and checked. In those cases in which the adjustments were minor or not significant, the procedure was repeated [74]. The definitive number of valid questionnaires was 44 (72.1% of questionnaires received). Table 3 shows the number and percentage of questionnaires sent, received and validated by stakeholder role. Finally, the FAHP system calculated the comparison weights and generates as output of the FAHP process the result with the weights of the KPIs, perspectives and strategic objectives.

4. Results: A Case Study for a Spanish FSF

The results of this study are shown in two different ways: first they are shown globally as a main result of this research. Then, the results are shown grouped by stakeholder roles, which allow assessing the different points of view according to the relationship of each role with the software factory.

4.1. Global Results

The intermediate global results of the study are shown in Table 4 and Table 5. Table 4 shows the results for the weights of KPIs and perspectives in the BSC ranked by weights. The Customer Perspective, with a priority weight of 0.4254, is the most important perspective. This is followed by the Financial Perspective, with a priority weight of 0.2134. The priority weight of the Learning and Growth Perspective is 0.1808, and the Internal Business Processes Perspective has the lowest priority weight of 0.1804. The priority order of the thirteen KPIs shows that User Satisfaction, with a priority weight of 0.2109, and SLA with 0.1268 (both included in the Customer Perspective), are the most important KPIs among all of those included in the BSC for a FSF. The third most important KPI is Intellectual Capital, with a weight of 0.1053 (included in the Learning and Growth Perspective), followed by Cost Structure, with a weight of 0.0877 (included in the Financial Perspective). The eighth KPI is Software Quality, with a weight of 0.0633 (included in the Internal Business Processes Perspective). Table 5 shows the results for the weights of objectives in the strategy map ranked by weights. The Improve Productivity high-level goal (HLG) is the most important of the two, with a priority weight of 0.7083, and the other HLG, Improve Costs, has a priority weight of 0.2917. The priority order of the six business goals shows that Building the Necessary Software and Software Deliveries on Time are the most important strategies among the business goals.
The result of the study is shown in Table 6. This table shows the link weights between KPIs and business goals in the strategy map. The overall weight of each KPI has been distributed in proportion to the weight of the business goals affected by this indicator, thus obtaining both the overall impact on the organization’s mission and the particular impact of each KPI according to the different strategies defined by the business goals. Finally, Figure 8 shows the strategy map of a FSF and the calculated link weights between KPIs and strategic goals.

4.2. Results Grouped by Stakeholder Roles

Table 7 shows the results about KPIs and perspectives of BSC by stakeholder role. As is shown, the results by role in the FAHP analysis reveal that the Customer Perspective is the primary focus of the BSC, and User Satisfaction is the most important evaluation KPI. The Customer Perspective is the most important by role (Other Employees being the only exception), but User Satisfaction is the best ranking KPI in all cases. The SLA indicator is globally the second most important KPI, and is mostly one of the four most important KPIs for the different roles (Other Employees is again the only exception). The third most important KPI is Intellectual Capital, which is always one of the five most important KPIs for the different roles.
Table 8 shows the results about strategic goals of the strategy map by role. These results grouped by role show that Improve Productivity is the main HLG for all roles, with a weight always higher than 0.6384. Results by role for business goals show that none of them is determinant for all roles.

5. Discussion

As shown in Table 4 and focusing on the BSC, the result of the FAHP analysis reveals that the Customer Perspective is the primary focus of the BSC and User Satisfaction is the most important evaluation KPI. The SLA KPI, also included in the Customer Perspective, is the second most important KPI. This means that the importance given to the Customer Perspective, which is twice as high as that of the next most important perspective, the Financial Perspective, makes clear the relationship and mutual dependence between the FSF and its customers. All of this implies that the main objective of the FSF should be focusing on the continuous improvement of the services offered to its customers to meet the customers’ needs in the most efficient way. The third most important KPI is Intellectual Capital, a compendium of human, structural, and relational capital indicators concerning the value of the organization. The importance given to this indicator, included in the Learning and Growth Perspective, is that it provides evidence about the meaning of human factors in software development [75], where human capital plays a very important role [76]. The very nature of this kind of industry, which is absolutely linked to the banking sector, makes Cost Structure, a very important indicator for banks and included in the Financial Perspective of the BSC for an FSF, appear as the fourth most important KPI in this study. The Software Quality KPI is the most important in the Internal Business Processes Perspective. The importance that the software quality has on the user satisfaction [77], the most important KPI, is probably one of the factors that give Software Quality KPI a much greater weight than the other indicators included in the Internal Business Processes Perspective. Furthermore, it is necessary to emphasize the great difference in valuation between the indicators that have the highest weights and those that have the lowest; this difference in valuation reaches a factor of nine in the most extreme cases, ranging from a weight of 0.2109 for the User Satisfaction KPI to a weight of 0.0231 for the Budgeting Error, which is the KPI with the lowest weight.
As shown in Table 5 and focusing on the strategic goals included in the strategy map, the result of the FAHP analysis reveals that the Improve Productivity HLG is the primary focus of the strategy map and Build the Necessary Software is the most important evaluation business goal. Contrary to what happens with the KPI weights, in the case of the business goals, the difference in weights among them is much less significant, ranging from a weight of 0.2043 for Build the Necessary Software to a weight of 0.1323 for Decrease Cost, which is the business goal with the least weight. The priority order of the six business goals shows that building the necessary software on time and with the expected quality and innovation is directly linked to User Satisfaction (the most important KPI) and these are the most important strategies included in the strategy map of the FSF. Finally, Table 6 shows the link weights assigned to each indicator according to the affected business strategy. These link weights are included in the new proposal of strategy map of a FSF (see Figure 8), which provides a powerful and graphical tool for controlling the company’s framework and must allow the correct decision-making in the software development processes in a FSF.
In relation to the result by stakeholder roles, Figure 9 and Figure 10 reveal that the Customer Perspective is the most important by role (Other employees being the only exception), but User Satisfaction is the best ranking KPI in all cases. The SLA indicator (also included in the Customer Perspective) is globally the second most important KPI, and is mostly one of the four most important KPIs for the different roles (Other employees is again the only exception). Intellectual Capital, the third most important KPI, is mostly one of the five most important KPI for the different role. On the other hand, as shown in Figure 11 in relation to the business strategies, there are no significant differences among the results for the different strategies by role, although the Other Employees role assign greater importance to the Improve Productivity HLG than the rest of roles, as also happens with the shareholders with the Improve Cost HLG.

6. Conclusions

The case of how a Spanish FSF involved in a corporate transformation towards sustainability has determined the weights of the KPIs and goals included in their strategy map presented here. The results enable assessing the impact that each KPI included in the BSC has on the different strategic goals defined in the strategy map of the FSF. This knowledge could be the basis for making decisions based on strategic business goals of the organization. The strategy map defines the relationships between indicators and strategic goals to achieve the mission and vision of the organization. Knowing the overall weight that each indicator and goal has in the strategy map and the links between them, it is possible to know the specific effect of each indicator according to each strategic goal. This in turn makes it possible to know the importance of each indicator in the organization’s strategy map according to the perspective of the BSC in which it is included and under the influence of each different business strategy defined by the business and high-level goals.
This article shows the case study of a FSF in Spain which refocuses its business model on one based on a new strategy map to achieve the sustainability of its business. In order to know the impact of the decisions in the business sustainability, it was decided to integrate the BSC and the strategy map with FAHP to determine the value that each indicator and objective had in the FSF, according to the opinions of stakeholders and experts of software factories under the premise of achieving the mission of the organization. With the information provided by this new proposal of weighted strategy map, the FSF management can make the most appropriate strategic decisions according to the desired business goal, knowing in advance the relative impact of changes in KPI’s measures for the sustainability of the FSF. Banking software faces a constantly changing landscape, so it is necessary that the FSF that develops this software can know in advance the impact of decision-making in order to take the most appropriate decision at any time according to the mission and vision of the company.
The analysis of the results obtained for each kind of stakeholder shows that each stakeholder gives more importance to those indicators or perspectives that, in theory, have a greater relation to its own role. In this sense, as presented in Table 7 and Figure 9 and Figure 10, the shareholders give greater weight to the Financial Perspective. The employees (Top management, Middle managers and Other employees) of the software factory place greater value on the Internal Business Process Perspective. Customers are those that give less importance to the Financial Perspective, but instead they attribute great importance to the assets and image of the company that offers them services. In addition, to confirm this appreciation, User Satisfaction and SLA are the two main indicators for Customers. Furthermore, the role of Other employees differs substantially from the rest of employees, which could indicate the lack of organizational communication, related to the importance of customers for the FSF and satisfying their needs, from higher level of employees to lower levels. The importance given to Intellectual Capital, an indicator that includes human capital value, by the Other employees is the highest of all the stakeholders.
According to the analysis of the results of strategic goals, the different points of view of each kind of stakeholder were presented in Table 8 and Figure 11. The most important differences of points of view are shown for the roles of Shareholders and Other employees. Similar to what happens with the valuation of KPIs and perspectives, the Shareholders is the role who gives the highest value to the business strategies based on improving costs, and Other employees role gives the highest weight to the business strategies related to the improvement of productivity, especially with the improvement of software development processes.
This proposal was applied to the specific case of an FSF, but the methodology proposed in this paper can be applied in other types of organizations that present a framework similar to the one exposed in this paper.
Future research will aim to study the differences in criteria that can represent the different stakeholder roles when they evaluate the strategy map of a FSF, as well as the repercussions of these differences in software development performance.

Acknowledgments

This work has been subsidized through the Plan of Science, Technology and Innovation of the Principality of Asturias (Ref: FC-15-GRUPIN14-132). The authors also thank anonymous referees who reviewed and gave important comments to this paper.

Author Contributions

Vicente Rodríguez Montequín and Francisco Ortega Fernández contributed in developing the conception of the research design, data interpretation, and writing. César Álvarez Pérez contributed in the development and execution of the research approach, literature review, data collection and integration, and validation and writing. Joaquín Villanueva Balsera contributed in enhancing the research approach and data processing.

Conflicts of Interest

The authors declare no conflict of interest.

Glossary

AbbreviationsFull FormsMeaning
BSCBalanced scorecardThe BSC is a performance metric used in strategic planning and management system.
AHPAnalytic hierarchy processMethod used to select the best alternative among others and prioritize their relative importance.
FAHPFuzzy analytic hierarchy processMethod that incorporates the fuzzy theory into the AHP.
MCDMMulticriteria decision-makingMCDM is a subdiscipline of operations research that explicitly evaluates multiple conflicting criteria in decision-making
FSFFinancial software factorySoftware factory specializes in software development for the financial sector
KPIKey performance indicatorPerformance measurable value that shows how effectively a company is achieving its business objectives.
TFNTriangular fuzzy numbersA type of fuzzy number (fuzzy subset of real numbers which represent the expansion of the idea of a confidence interval) easy to use for its computational simplicity.
BNPBest nonfuzzy performanceBNP is a real number obtained from the defuzzification of a fuzzy number
HLGHigh-level goalA HLG is a set of business goals that directly supports achievement of the mission and vision of the organization

References

  1. De la Fuente Asprón, R. Medir la Productividad del Desarrollo de Software en Banca. Available online: http://www.financialtech-mag.com (accessed on 22 June 2013). (In Spanish).
  2. Emaldi Abasolo, M. The Software Factories. Dyna Bilbao 2007, 82, 330–333. (In Spanish) [Google Scholar]
  3. Schubert, J. 4 Top Challenges Facing The Banking Industry Right Now. Available online: https://goo.gl/b5NMD0 (accessed on 27 November 2016).
  4. Álvarez, C.; Rodríguez, V.; Ortega, F.; Villanueva, J. A Scorecard Framework Proposal for Improving Software Factories’ Sustainability: A Case Study of a Spanish Firm in the Financial Sector. Sustainability 2015, 7, 15999–16021. [Google Scholar] [CrossRef]
  5. Brown, A.W.; Lopez Mancisidor, A.; Reyes Oliva, L. Practical Experiences with Software Factory Approaches in Enterprise Software Delivery. In Proceedings of the Sixth International Conference on Software Engineering Advances, ICSEA, Barcelona, Spain, 23–29 October 2011; pp. 465–470. [Google Scholar]
  6. Kaplan, R.S.; Norton, D.P. The balanced scorecard—Measures that drive performance. Harv. Bus. Rev. 1992, 70, 71–79. [Google Scholar] [PubMed]
  7. Kaplan, R.S.; Norton, D.P. Putting the balanced scorecard to work. Harv. Bus. Rev. 1993, 71, 134–140. [Google Scholar]
  8. Kaplan, R.S.; Norton, D.P. Strategy maps: Converting Intangible Assets into Tangible Outcomes; Harvard Business Press: Boston, MA, USA, 2004. [Google Scholar]
  9. Kaplan, R.S.; Norton, D.P. The strategy map: Guide to aligning intangible assets. Strategy Leadersh. 2004, 32, 10–17. [Google Scholar] [CrossRef]
  10. Bentes, A.V.; Carneiro, J.; da Silva, J.F.; Kimura, H. Multidimensional assessment of organizational performance: Integrating BSC and AHP. J. Bus. Res. 2012, 65, 1790–1799. [Google Scholar] [CrossRef]
  11. Boons, F.; Lüdeke-Freund, F. Business models for sustainable innovation: State-of-the-art and steps towards a research agenda. J. Clean. Prod. 2013, 45, 9–19. [Google Scholar] [CrossRef]
  12. Evans, S.; Vladimirova, D.; Holgado, M.; Van Fossen, K.; Yang, M.; Silva, E.A.; Barlow, C.Y. Business Model Innovation for Sustainability: Towards a Unified Perspective for Creation of Sustainable Business Models; Business Strategy and the Environment: Sydney, Australia, 2017. [Google Scholar]
  13. Wirtz, B.W. Business Model Management. Design–Instruments–Success Factors; Gabler Verlag: Wiesbaden, Germany, 2011. [Google Scholar]
  14. Donaldson, T.; Preston, L.E. The stakeholder theory of the corporation: Concepts, evidence, and implications. Acad. Manag. Rev. 1995, 20, 65–91. [Google Scholar]
  15. Evans, S.; Rana, P.; Short, S.W. Deliverable 2.6. Final Set of Tools & Methods that Enable Analysis of Future Oriented, Novel, Sustainable, Value Adding Business-Models and Value-Networks; University Cambridge: Cambridge, UK, 2014. [Google Scholar]
  16. Geissdoerfer, M.; Bocken, N.M.P.; Hultink, E.J. Design thinking to enhance the sustainable business modelling process—A workshop based on a value mapping process. J. Clean. Prod. 2016, 135, 1218–1232. [Google Scholar] [CrossRef]
  17. Netherlands Software Metrics Users Association Challenges in Productivity Measurement. Why Is It Hard to Measure Productivity in the Software Industry? Available online: https://goo.gl/GfkkAr (accessed on 4 February 2017).
  18. Kaplan, R.S.; Norton, D.P. The Balanced Scorecard: Translating Strategy into Action; Harvard Business Press: Boston, MA, USA, 1996. [Google Scholar]
  19. Kaplan, R.S.; Norton, D.P. Linking the balanced scorecard to strategy. Calif. Manag. Rev. 1996, 39, 53–79. [Google Scholar] [CrossRef]
  20. Kaplan, R.S.; Norton, D.P. Using the balanced scorecard as a strategic management system. Harv. Bus. Rev. 1996, 74, 75–85. [Google Scholar]
  21. Van Grembergen, W. The balanced scorecard and IT governance. Inf. Syst. Control J. 2000, 2, 40–43. [Google Scholar]
  22. Keyes, J. Implementing the IT Balanced Scorecard: Aligning IT with Corporate Strategy; CRC Press: Boca Raton, FL, USA, 2016. [Google Scholar]
  23. Figge, F.; Hahn, T.; Schaltegger, S.; Wagner, M. The Sustainability BSC—Theory and Applicantion of a Tool for Value-Based Sustainability Management. In Corporate Social Responsability—Governance for Sustainability, Proceedings of the Greening of Industry Network Conference, Gothenburg, Sweden, 23–26 June 2002; Emerald Publishing Limited: Bingley, UK, 2002. [Google Scholar]
  24. Rohm, H.; Montgomery, D. Link Sustainability to Corporate Strategy Using the Balanced Scorecard; Balanced Scorecard Institute: Cary, NC, USA, 2011. [Google Scholar]
  25. Davis, S.; Albright, T. An investigation of the effect of balanced scorecard implementation on financial performance. Manag. Account. Res. 2004, 15, 135–153. [Google Scholar] [CrossRef]
  26. Al-Najjar, S.M.; Kalaf, K.H. Designing a balanced scorecard to measure a bank’s performance: A case study. Int. J. Bus. Adm. 2012, 3, 44. [Google Scholar] [CrossRef]
  27. Rodríguez Montequín, V.; Álvarez Pérez, C.; Ortega Fernández, F.; Villanueva Balsera, J. Scorecard and KPIs for monitoring software factories effectiveness in the financial sector. Int. J. Inf. Syst. Proj. Manag. 2013, 1, 29–43. [Google Scholar]
  28. Wu, H.-Y. Constructing a strategy map for banking institutions with key performance indicators of the balanced scorecard. Eval. Prog. Plan. 2012, 35, 303–320. [Google Scholar] [CrossRef] [PubMed]
  29. Glykas, M. Fuzzy cognitive strategic maps in business process performance measurement. Expert Syst. Appl. 2013, 40, 1–14. [Google Scholar] [CrossRef]
  30. Basili, V.; Heidrich, J.; Lindvall, M.; Münch, J.; Regardie, M.; Rombach, D.; Seaman, C.; Trendowicz, A. Bridging the Gap between Business Strategy and Software Development. Available online: aisel.aisnet.org/icis2007/25/ (accessed on 20 March 2017).
  31. Basili, V.; Heidrich, J.; Lindvall, M.; Münch, J.; Regardie, M.; Rombach, D.; Seaman, C.; Trendowicz, A. Linking Software Development and Business Strategy through Measurement. IEEE Comput. 2010, 43, 57–65. [Google Scholar] [CrossRef]
  32. Basili, V.; Lampasona, C.; Ramírez, A.E.O. Aligning Corporate and IT Goals and Strategies in the Oil and Gas Industry. Available online: http://link.springer.com/chapter/10.1007/978-3-642-39259-7_16 (accessed on 23 March 2017).
  33. Van Grembergen, W.; Saull, R.; De Haes, S. Linking the IT balanced scorecard to the business objectives at a major Canadian financial group. J. Inf. Technol. Case Appl. Res. 2003, 5, 23–50. [Google Scholar] [CrossRef]
  34. Figge, F.; Hahn, T.; Schaltegger, S.; Wagner, M. The sustainability balanced scorecard—Linking sustainability management to business strategy. Bus. Strategy Environ. 2002, 11, 269–284. [Google Scholar] [CrossRef]
  35. Kathuria, R.; Joshi, M.P.; Porth, S.J. Organizational alignment and performance: Past, present and future. Manag. Decis. 2007, 45, 503–517. [Google Scholar] [CrossRef]
  36. Ayag, Z. An analytic-hierarchy-process based simulation model for implementation and analysis of computer-aided systems. Int. J. Prod. Res. 2002, 40, 3053–3073. [Google Scholar] [CrossRef]
  37. Palma-Mendoza, J.A. Analytical hierarchy process and SCOR model to support supply chain re-design. Int. J. Inf. Manag. 2014, 34, 634–638. [Google Scholar] [CrossRef]
  38. Wu, H.-Y.; Tzeng, G.-H.; Chen, Y.-H. A fuzzy MCDM approach for evaluating banking performance based on Balanced Scorecard. Expert Syst. Appl. 2009, 36, 10135–10147. [Google Scholar] [CrossRef]
  39. Zadeh, L.A. Fuzzy sets. Inf. Control 1965, 8, 338–353. [Google Scholar] [CrossRef]
  40. Buckley, J.J. Fuzzy hierarchical analysis. Fuzzy Sets Syst. 1985, 17, 233–247. [Google Scholar] [CrossRef]
  41. Zadeh, L.A. The concept of a linguistic variable and its application to approximate reasoning—II. Inf. Sci. 1975, 8, 301–357. [Google Scholar] [CrossRef]
  42. Kaufman, A.; Gupta, M.M. Introduction to Fuzzy Arithmetic; Van Nostrand Reinhold Company: New York, NY, USA, 1991. [Google Scholar]
  43. Negi, D.S. Fuzzy Analysis and Optimization. Ph.D. Thesis, Kansas State University, Kansas, KS, USA, 1989. [Google Scholar]
  44. Zimmermann, H.-J. Fuzzy Control. In Fuzzy Set Theory—and Its Applications; Springer: New York, NY, USA, 2001. [Google Scholar]
  45. Shaverdi, M.; Akbari, M.; Tafti, S.F. Combining fuzzy MCDM with BSC approach in performance evaluation of Iranian private banking sector. Adv. Fuzzy Syst. 2011, 2011, 148712. [Google Scholar] [CrossRef]
  46. Dubois, D.; Prade, H. Operations on fuzzy numbers. Int. J. Syst. Sci. 1978, 9, 613–626. [Google Scholar] [CrossRef]
  47. Giachetti, R.E.; Young, R.E. A parametric representation of fuzzy numbers and their arithmetic operators. Fuzzy Sets Syst. 1997, 91, 185–202. [Google Scholar] [CrossRef]
  48. Moon, J.H.; Kang, C.S. Application of fuzzy decision making method to the evaluation of spent fuel storage options. Prog. Nucl. Energy 2001, 39, 345–351. [Google Scholar] [CrossRef]
  49. Tang, Y.-C. An approach to budget allocation for an aerospace company—Fuzzy analytic hierarchy process and artificial neural network. Neurocomputing 2009, 72, 3477–3489. [Google Scholar] [CrossRef]
  50. Liang, G.-S.; Wang, M.-J.J. A fuzzy multi-criteria decision-making approach for robot selection. Robot. Comput. Integr. Manuf. 1993, 10, 267–274. [Google Scholar] [CrossRef]
  51. Hsieh, T.-Y.; Lu, S.-T.; Tzeng, G.-H. Fuzzy MCDM approach for planning and design tenders selection in public office buildings. Int. J. Proj. Manag. 2004, 22, 573–584. [Google Scholar] [CrossRef]
  52. Saaty, T.L. How to make a decision: The analytic hierarchy process. Eur. J. Oper. Res. 1990, 48, 9–26. [Google Scholar] [CrossRef]
  53. Mon, D.-L.; Cheng, C.-H.; Lin, J.-C. Evaluating weapon system using fuzzy analytic hierarchy process based on entropy weight. Fuzzy Sets Syst. 1994, 62, 127–134. [Google Scholar] [CrossRef]
  54. Saaty, T.L. A scaling method for priorities in hierarchical structures. J. Math. Psychol. 1977, 15, 234–281. [Google Scholar] [CrossRef]
  55. Thomas, S. The Analytic Hierarchy Process: Planning, Priority Setting, Resource Allocation; McGraw-Hill International Book Company: New York, NY, USA, 1980. [Google Scholar]
  56. Saaty, R.W. The analytic hierarchy process—What it is and how it is used. Math. Model. 1987, 9, 161–176. [Google Scholar] [CrossRef]
  57. Saaty, T.L. What Is the Analytic Hierarchy Process? Mathematical Models for Decision Support. Available online: https://link.springer.com/chapter/10.1007/978-3-642-83555-1_5 (accessed on 23 March 2017).
  58. Saaty, T.L. Fundamentals of Decision Making and Priority Theory with the Analytic Hierarchy Process; RWS Publications: Pittsburgh, PA, USA, 1994; Volume 6. [Google Scholar]
  59. Wang, Y.; Xia, Q. A Fuzzy AHP and BSC Approach for Evaluating Performance of a Software Company Based on Knowledge Management. Available online: http://ieeexplore.ieee.org/xpl/mostRecentIssue.jsp?punumber=5454173#TitleHist (23 March 2017).
  60. Ayağ, Z.; Özdemir, R.G. A fuzzy AHP approach to evaluating machine tool alternatives. J. Intell. Manuf. 2006, 17, 179–190. [Google Scholar] [CrossRef]
  61. Chang, D.-Y. Applications of the extent analysis method on fuzzy AHP. Eur. J. Oper. Res. 1996, 95, 649–655. [Google Scholar] [CrossRef]
  62. Bellman, R.E.; Zadeh, L.A. Decision-making in a fuzzy environment. Manag. Sci. 1970, 17, B-141–B-164. [Google Scholar] [CrossRef]
  63. Opricovic, S.; Tzeng, G.-H. Defuzzification within a multicriteria decision model. Int. J. Uncertain. Fuzziness Knowl. Based Syst. 2003, 11, 635–652. [Google Scholar] [CrossRef]
  64. Chen, M.-K.; Wang, S.-C. The use of a hybrid fuzzy-Delphi-AHP approach to develop global business intelligence for information service firms. Expert Syst. Appl. 2010, 37, 7394–7407. [Google Scholar] [CrossRef]
  65. Ren, C.; Dong, J.; Ding, H.; Wang, W. Linking Strategic Objectives to Operations: Towards a More Effective Supply Chain Decision Making. Available online: http://ieeexplore.ieee.org/document/4117767/ (accessed on 23 March 2017).
  66. Taticchi, P.; Tonelli, F.; Cagnazzo, L. A decomposition and hierarchical approach for business performance measurement and management. Meas. Bus. Excell. 2009, 13, 47–57. [Google Scholar] [CrossRef]
  67. Quezada, L.E.; Palominos, P.I.; Gonzalez, M.A. Application of AHP in the Design of a Strategy Map. iBusiness 2013, 5, 133. [Google Scholar] [CrossRef]
  68. Quezada, L.E.; López-Ospina, H.A. A method for designing a strategy map using AHP and linear programming. Int. J. Prod. Econ. 2014, 158, 244–255. [Google Scholar] [CrossRef]
  69. Lu, I.-Y.; Kuo, T.; Lin, T.-S.; Tzeng, G.-H.; Huang, S.-L. Multicriteria decision analysis to develop effective sustainable development strategies for enhancing competitive advantages: Case of the TFT-LCD industry in Taiwan. Sustainability 2016, 8, 646. [Google Scholar] [CrossRef]
  70. Abdolshah, M.; Javadinia, M.; Astanbous, M.; Eslami, M. An integrated approach to analyze strategy map using BSC–FUZZY AHP: A case study of auto industry. Manag. Sci. Lett. 2002, 2, 705–712. [Google Scholar] [CrossRef]
  71. Sorayaei, A.; Abedi, A.; Khazaei, R.; Hossien Zadeh, M.; Agha Maleki, S.M.S.A. An integrated approach to analyze strategy map using BSC–FUZZY AHP: A case study of Dairy companies. Eur. Online J. Nat. Soc. Sci. 2014, 2, 1315–1322. [Google Scholar]
  72. Kaplan, R.S. Conceptual foundations of the balanced scorecard. Handb. Manag. Account. Res. 2008, 3, 1253–1269. [Google Scholar]
  73. Caha, J.; Drážná, A. Information about FuzzyAHP Package for R (ver.0.8.0). Available online: https://goo.gl/DXlLm8 (accessed on 20 March 2017).
  74. Malczewski, J. GIS and Multicriteria Decision Analysis; John Wiley & Sons: New York, NY, USA, 1999. [Google Scholar]
  75. Amrit, C.; Daneva, M.; Damian, D. Human factors in software development: On its underlying theories and the value of learning from related disciplines. A guest editorial introduction to the special issue. Spec. Issue Hum. Factors Softw. Dev. 2014, 56, 1537–1542. [Google Scholar] [CrossRef]
  76. Curtis, B.; Krasner, H.; Iscoe, N. A field study of the software design process for large systems. Commun. ACM 1988, 31, 1268–1287. [Google Scholar] [CrossRef]
  77. Joint Technical Committee. ISO/IEC JTC 1/SC7 ISO/IEC 25010:2011 Systems and Software Engineering—Systems and Software Quality Requirements and Evaluation (SQuaRE)—System and Software Quality Models. Available online: https://www.iso.org/standard/35733.html (accessed on 20 March 2017).
Figure 1. The balanced scorecard (BSC) for a financial software factory (FSF). Adapted from [4].
Figure 1. The balanced scorecard (BSC) for a financial software factory (FSF). Adapted from [4].
Sustainability 09 00527 g001
Figure 2. The strategy map for FSF. Adapted from [4].
Figure 2. The strategy map for FSF. Adapted from [4].
Sustainability 09 00527 g002
Figure 3. Membership function of the triangular fuzzy number (TFN).
Figure 3. Membership function of the triangular fuzzy number (TFN).
Sustainability 09 00527 g003
Figure 4. Membership functions of the linguistic variables for criteria comparisons.
Figure 4. Membership functions of the linguistic variables for criteria comparisons.
Sustainability 09 00527 g004
Figure 5. Performance evaluation framework of the research.
Figure 5. Performance evaluation framework of the research.
Sustainability 09 00527 g005
Figure 6. Hierarchical framework of BSC for FSF.
Figure 6. Hierarchical framework of BSC for FSF.
Sustainability 09 00527 g006
Figure 7. Hierarchical framework of strategy map for FSF.
Figure 7. Hierarchical framework of strategy map for FSF.
Sustainability 09 00527 g007
Figure 8. The strategy map of a FSF with weights for links between KPIs and business goals.
Figure 8. The strategy map of a FSF with weights for links between KPIs and business goals.
Sustainability 09 00527 g008
Figure 9. Perspectives weights radar graph for different stakeholder roles.
Figure 9. Perspectives weights radar graph for different stakeholder roles.
Sustainability 09 00527 g009
Figure 10. KPIs weights radar graph for different stakeholder roles.
Figure 10. KPIs weights radar graph for different stakeholder roles.
Sustainability 09 00527 g010
Figure 11. Business goals weights radar graph for different stakeholder roles.
Figure 11. Business goals weights radar graph for different stakeholder roles.
Sustainability 09 00527 g011
Table 1. Membership function of the linguistic scale.
Table 1. Membership function of the linguistic scale.
Fuzzy NumberLinguistic ScaleTFN ( a ˜ i j ) Reciprocal of a TFN ( a ˜ i j )
1 ˜ Equally important(1, 1, 3)(1/3, 1, 1)
3 ˜ Weakly important(1, 3, 5)(1/5, 1/3, 1)
5 ˜ Essentially important(3, 5, 7)(1/7, 1/5, 1/3)
7 ˜ Very strongly important(5, 7, 9)(1/9, 1/7, 1/5)
9 ˜ Absolutely important(7, 9, 9)(1/9, 1/9, 1/7)
2 ˜ , 4 ˜ , 6 ˜ , 8 ˜ Intermediate value between two adjacent judgements
Table 2. Different stakeholder roles and their relation with a FSF.
Table 2. Different stakeholder roles and their relation with a FSF.
Stakeholder RolesRelation with the FSF
ShareholdersThe shareholders are the owners of the company. They are usually top management of the financial entities involved in the same financial group.
Top managementTop management are the highest ranking executives responsible for the entire FSF. They translate policy into goals and strategies for the future. Top management make decisions affecting everyone in the software factory.
Middle managersThe middle managers are the employees of the FSF who manage at least one subordinate level of managers, and report to the top management in the organisation to ensure smooth functioning of the software factory.
Other employeesOther employees are the lowest level of managers and the rest of the employees of the software factory, including analysts and developers.
CustomersCustomers are the financial entities for which the software factory develops software and offers services to them.
ExpertsExperts are a group of managers of other software factories from different sectors, professors and researchers in relation to software factories.
Table 3. Number and percentage of sent, received and valid questionnaires by role.
Table 3. Number and percentage of sent, received and valid questionnaires by role.
Stakeholder RolesNumber of Sent QuestionnairesNumber of Received QuestionnairesNumber of Valid Received Questionnaires
Shareholders13969.2%666.7%
Top Management12866.7%675.0%
Middle Managers151386.7%861.5%
Other Employees13646.1%583.3%
Customers151493.3%1071.4%
Experts in Software Factories151173.3%981.8%
Total836173.5%4472.1%
Table 4. Fuzzy weights of BSC for a FSF sustainable business index by FAHP.
Table 4. Fuzzy weights of BSC for a FSF sustainable business index by FAHP.
Criteria and Sub-Criteria
(Perspectives and KPIs)
Local Weights
TFN (L, M, U)
Overall Weights
TFN (L, M, U)
BNP 1STD
BNP 2
Rank of Weights
(F) Financial(0.1148; 0.2035; 0.3518) 0.22340.21342
 (F1) Cost Structure(0.2870; 0.4134; 0.5503)(0.0329; 0.0841; 0.1936)0.10360.08774
 (F2) Reduction of Cost(0.1568; 0.2438; 0.3741)(0.0180; 0.0496; 0.1316)0.06640.05629
 (F3) Useful Developments(0.2255; 0.3429; 0.4844)(0.0259; 0.0698; 0.1704)0.08870.07516
(C) Customer(0.2957; 0.4586; 0.5817) 0.44540.42541
 (C1) User Satisfaction(0.3781; 0.5411; 0.6655)(0.1118; 0.2481; 0.3871)0.24900.21091
 (C2) Cost per Use(0.1090; 0.1712; 0.2881)(0.0322; 0.0785; 0.1676)0.09280.07865
 (C3) SLA(0.1745; 0.2876; 0.4568)(0.0516; 0.1319; 0.2657)0.14970.12682
(I) Internal Business Processes(0.1057; 0.1712; 0.2897) 0.18890.18044
 (I1) Work Performance(0.1376; 0.2118; 0.3225)(0.0145; 0.0363; 0.0934)0.04810.040710
 (I2) Employee Productivity(0.0955; 0.1516; 0.2431)(0.0101; 0.0260; 0.0704)0.03550.030112
 (I3) Delay(0.0979; 0.1587; 0.2558)(0.0103; 0.0272; 0.0741)0.03720.031511
 (I4) Software Quality(0.2361; 0.3698; 0.5018)(0.0250; 0.0633; 0.1454)0.07790.06598
 (I5) Budgeting Error(0.0675; 0.1082; 0.1944)(0.0071; 0.0185; 0.0563)0.02730.023113
(L) Learning and Growth(0.1078; 0.1667; 0.2934) 0.18930.18083
 (L1) Employer Branding(0.2644; 0.3708; 0.5154)(0.0285; 0.0618; 0.1512)0.08050.06827
 (L2) Intellectual Capital(0.4846; 0.6292; 0.7356)(0.0522; 0.1049; 0.2158)0.12430.10533
1 BNP (Best non-fuzzy performance) = [(U − L) + (M − L)]/3 + L. 2 STD_BNP: standardised BNP.
Table 5. Fuzzy weights of goals of strategy map for a FSF sustainable business index by FAHP.
Table 5. Fuzzy weights of goals of strategy map for a FSF sustainable business index by FAHP.
Criteria and Sub-Criteria
(HLG and Business Goals)
Local Weights
TFN (L, M, U)
Overall Weights
TFN (L, M, U)
BNP 1STD
BNP 2
Rank of Weights
(HLG1) Improve Productivity(0.6243; 0.7156; 0.8180) 0.71930.70831
 (BG1) Build the Necessary SW(0.1959; 0.2971; 0.4056)(0.1223; 0.2126; 0.3318)0.22220.20431
 (BG2) SW Deliveries on Time(0.1730; 0.2679; 0.3850)(0.1080; 0.1917; 0.3149)0.20490.18832
 (BG3) Improve the SW Quality and Innovation(0.1642; 0.2541; 0.3740)(0.1025; 0.1818; 0.3059)0.19670.18083
 (BG4) Improve the SW Development Processes(0.1197; 0.1810; 0.2881)(0.0747; 0.1295; 0.2357)0.14660.13485
(HLG2) Improve Cost(0.2099; 0.2845; 0.3946) 0.29630.29172
 (BG5) Increase Revenue(0.4340; 0.5550; 0.6875)(0.0911; 0.1579; 0.2713)0.17340.15944
 (BG6) Decrease Cost(0.3602; 0.4450; 0.5821)(0.0756; 0.1266; 0.2297)0.14400.13236
1 BNP (Best non-fuzzy performance) = [(UL) + (ML)]/3 + L. 2 STD_BNP: standardised BNP.
Table 6. Fuzzy weights of links between KPIs and business goals in the strategy map for a FSF.
Table 6. Fuzzy weights of links between KPIs and business goals in the strategy map for a FSF.
KPIs and Business GoalsKPI and Business Goal Overall WeightsLink Weights between KPIs and Business Goals
(F1) Cost Structure0.0877
 (BG4) Improve the Software Development Processes0.13480.0443
 (BG6) Decrease Cost0.13230.0434
(F2) Reduction of Cost0.0562
 (BG5) Increase Revenue0.15950.0562
(F3) Useful Developments0.0751
 (BG1) Build the Necessary Software0.20430.0282
 (BG3) Improve the Software Quality and Innovation0.18080.0249
 (BG5) Increase Revenue0.15950.0220
(C1) User Satisfaction0.2109
 (BG1) Build the Necessary Software0.20430.0588
 (BG2) Software Deliveries on Time0.18830.0542
 (BG3) Improve the Software Quality and Innovation0.18080.0520
 (BG5) Increase Revenue0.15950.0459
(C2) Cost per Use0.0786
 (BG6) Decrease Cost0.13230.0786
(C3) Service Level Agreements (SLA)0.1268
 (BG2) Software Deliveries on Time0.18830.0360
 (BG3) Improve the Software Quality and Innovation0.18080.0346
 (BG4) Improve the Software Development Processes0.13480.0258
 (BG5) Increase Revenue0.15950.0305
(I1) Work Performance0.0407
 (BG2) Software Deliveries on Time0.18830.0168
 (BG4) Improve the Software Development Processes0.13480.0120
 (BG6) Decrease Cost0.13230.0118
(I2) Employee Productivity0.0301
 (BG2) Software Deliveries on Time0.18830.0301
(I3) Delay0.0315
 (BG2) Software Deliveries on Time0.18830.0184
 (BG4) Improve the Software Development Processes0.13480.0131
(I4) Software Quality0.0659
 (BG1) Build the Necessary Software0.20430.0160
 (BG2) Software Deliveries on Time0.18830.0148
 (BG3) Improve the Software Quality and Innovation0.18080.0142
 (BG4) Improve the Software Development Processes0.13480.0106
 (BG6) Decrease Cost0.13230.0104
(I5) Budgeting Error0.0231
 (BG2) Software Deliveries on Time0.18830.0136
 (BG6) Decrease Cost0.13230.0095
(L1) Employer Branding0.0682
 (BG1) Build the Necessary SW0.20430.0197
 (BG2) Software Deliveries on Time0.18830.0182
 (BG3) Improve the Software Quality and Innovation0.18080.0175
 (BG6) Decrease Cost0.13230.0128
(L2) Intellectual Capital0.1053
 (BG1) Build the Necessary Software0.20420.0215
 (BG2) Software Deliveries on Time0.18830.0198
 (BG3) Improve the Software Quality and Innovation0.18080.0190
 (BG4) Improve the Software Development Processes0.13480.0142
 (BG5) Increase Revenue0.15950.0168
 (BG6) Decrease Cost0.13230.0139
Table 7. Weights of KPIs and perspectives of BSC for a FSF sustainable business, index by FAHP according to the different stakeholder roles.
Table 7. Weights of KPIs and perspectives of BSC for a FSF sustainable business, index by FAHP according to the different stakeholder roles.
Criteria and Sub-Criteria/Stakeholder RolesTotal/GlobalShare-HoldersTop ManagementMiddle ManagersOther EmployeesCustomersExperts
(F) Financial0.21340.23150.17330.22100.28090.15970.2471
 (F1) Cost Structure0.08770.13860.05380.09160.10290.06860.0858
 (F2) Reduction of Cost0.05620.04870.05590.06550.05670.03630.0759
 (F3) Useful Developments0.07510.04140.07000.07250.12020.06150.0936
(C) Customer0.42540.48100.44150.41440.27800.43910.4254
 (C1) User Satisfaction0.21090.19470.20090.20040.14370.21550.2223
 (C2) Cost per Use0.07860.17620.09140.04550.05700.06760.0801
 (C3) SLA0.12680.10370.13570.15520.07260.14940.1095
(I) Internal Business Processes0.18040.16200.23980.20000.22960.16350.1379
 (I1) Work Performance0.04070.03330.04470.03880.05870.03920.0379
 (I2) Employee Productivity0.03010.02520.02140.02510.04160.04230.0278
 (I3) Delay0.03150.02760.05410.03760.04270.02300.0242
 (I4) Software Quality0.06590.06580.09770.08690.08830.05800.0346
 (I5) Budgeting Error0.02310.02730.03730.02410.02100.01340.0287
(L) Learning and Growth0.18080.12550.14550.16470.21150.23770.1896
 (L1) Employer Branding0.06820.03040.05430.06970.06040.12000.0665
 (L2) Intellectual Capital0.10530.08720.08290.08720.13450.10530.1132
Table 8. Weights of business goals and high-level goals of strategy map for a FSF sustainable business, index by FAHP according to the different stakeholder roles.
Table 8. Weights of business goals and high-level goals of strategy map for a FSF sustainable business, index by FAHP according to the different stakeholder roles.
Criteria and Sub-Criteria/Stakeholder RolesTotal/GlobalShare-HoldersTop ManagementMiddle ManagersOther EmployeesCustomersExperts
(HLG1) Improve Productivity0.70830.63840.72090.69330.79060.75840.6590
 (BG1) Build the Necessary SW.0.20430.17140.17220.14940.27320.26410.1886
 (BG2) SW Deliveries on Time0.18830.16700.27600.22950.10040.15150.2079
 (BG3) Improve the SW. Q.&I.0.18080.19730.14980.17060.19290.22440.1355
(BG4) Improve SW. Dev. Proc.0.13480.10270.12290.14380.22410.11850.1270
 (HLG2) Improve Cost0.29170.36160.27910.30670.20940.24160.3410
 (BG5) Increase Revenue0.15940.17530.14730.18720.12660.11070.2052
 (BG6) Decrease Cost0.13230.18620.13180.11940.08280.13090.1358

Share and Cite

MDPI and ACS Style

Pérez, C.Á.; Montequín, V.R.; Fernández, F.O.; Balsera, J.V. Integration of Balanced Scorecard (BSC), Strategy Map, and Fuzzy Analytic Hierarchy Process (FAHP) for a Sustainability Business Framework: A Case Study of a Spanish Software Factory in the Financial Sector. Sustainability 2017, 9, 527. https://doi.org/10.3390/su9040527

AMA Style

Pérez CÁ, Montequín VR, Fernández FO, Balsera JV. Integration of Balanced Scorecard (BSC), Strategy Map, and Fuzzy Analytic Hierarchy Process (FAHP) for a Sustainability Business Framework: A Case Study of a Spanish Software Factory in the Financial Sector. Sustainability. 2017; 9(4):527. https://doi.org/10.3390/su9040527

Chicago/Turabian Style

Pérez, César Álvarez, Vicente Rodríguez Montequín, Francisco Ortega Fernández, and Joaquín Villanueva Balsera. 2017. "Integration of Balanced Scorecard (BSC), Strategy Map, and Fuzzy Analytic Hierarchy Process (FAHP) for a Sustainability Business Framework: A Case Study of a Spanish Software Factory in the Financial Sector" Sustainability 9, no. 4: 527. https://doi.org/10.3390/su9040527

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop