A Sustainable Multicriteria Decision Framework for Obsolescence Resolution Strategy Selection

Parts obsolescence has an important impact on the product life cycle, the manufacturing system and the environment leading to operational, logistical, reliability and cost implications. While current resolution models are cost-oriented, multiple studies have revealed that technological obsolescence is strongly involved in the electronic waste problem. In this study, based on academic literature and expert opinions, a sustainable decision framework for obsolescence resolution strategy (ORS) selection is proposed. It consists of economic, environmental, social and technological dimensions, integrating a total of fifteen criteria. Multicriteria decision-making (MCDM) methods are suggested to select the most sustainable solution. A case study was performed where the criteria weights and the alternatives performance were judged by five experts from the fields of environment, economy, human resources and obsolescence and operations management. Results from different MCDM methods were compared to the actual decision to evaluate their effectiveness. Using the suggested framework improved the decision process as integrating sustainability had a drastic impact on the selected strategy and consequently on the company’s performance. In addition to its managerial insights, this paper provides a new research perspective to sustainable and robust obsolescence management to effectively handle the increasing number and severity of obsolete components.


Introduction
Component obsolescence is a significant problem in our modern highly technological market. It is a result of the rapid evolution of technology by introducing new components with higher performance and additional features. It led to a growing pressure to upgrade components and systems. Obsolescence is defined as the loss of functions of a component or a system (hardware or software) so it cannot accomplish its essential purposes or is no longer useful because it is unsustainable, high-priced to repair, defective or the product is no longer available for purchase in its original form from the original manufacturer [1]. It specifically rises due to the mismatch between the life span of the product and the parts of the system. The conflict concerns sustainment-dominated systems, which take many years to design and manufacture and are typically maintained for decades such as aircraft and submarines, as well as nowadays technological products such as computers or mobile phones. They are usually composed of "commercial off-the-shelf (COTS)" components that are highly dependent on market tendencies and technological changes. COTS components have reduced life cycles and experience obsolescence rapidly. As of 2006, QTEC Solutions (an international leader in components obsolescence management) estimated that around 3% of the global pool of electronic parts becomes obsolete every month [2]. A more recent study evaluated that over 350,000 components became obsolete in 2013 [3]. It reflects the extent of the environmental and technological problem; the modern industry is fronting. The rapid pace of technology makes the problem more global and impacts even products with shorter life cycles. Every 24 months, computers' processing speed doubles, known as Moore's law, which leads to constant upgrading of components or systems such as military and technological products. Either at the production step or at the recycling, electronics have an important environmental impact as high-tech parts and equipment production require a broad range of materials as well as energy. Often, technical materials required in electrical and electronics are critical raw materials and rare earth elements. In addition, ultra-clean components and intermediate products require energy, water and chemicals [4]. Thus, electronics waste is one of the world's fastest-growing waste streams with an annual growth rate of four percent [5] whose main driver is technological obsolescence.
Although its history is associated with the (maritime) defense industry, many nondefense systems face similar difficulties, such as avionics, oil well drilling and automotive industry [6]. Nowadays, decisions regarding obsolescence management across all these industries are often based on experience and intuition, leading to an increasing need to reduce the negative effects of obsolescence issues. However, there is a lack of knowledge of how to effectively choose obsolescence mitigation and resolution approaches to reach this goal. Selecting the most suitable obsolescence resolution strategy is then a crucial decision for the system, the manufacturer and the environment where multiple factors are considered [7,8] such as cost, technology, functionalities, etc. Recent studies revealed that the high rate of obsolescence in the electronics industry has led to one of the fastest-growing waste streams in the world [9]. As a simple example, computers are manufactured from over 1000 materials, many of which are toxic and contribute significantly to the e-waste stream, estimated at 53.6 million tonnes in 2019 [10]. Thus, considering sustainable factors becomes crucial as obsolescence is a major cause of component deterioration [11]. Our paper seeks to build a sustainable framework to support decision making in obsolescence management either at the reactive, proactive or strategic level from the design to the end of life of the system. The paper is organized as follows: first, we present a literature review of obsolescence resolution strategy selection models and the considered criteria, alternatives and decision process. Second, the proposed ORS selection framework is presented. Then, the model is applied with an example from the avionics industry. Finally, our conclusions are summarized, and potential studies are discussed.

Literature Review
The study is mainly related to two streams of research in the literature: obsolescence management, in particular the resolution/mitigation strategy selection, and sustainability. The part's obsolescence problem is also referred to as an "end-of-life (EOL) problem" or "DMSMS" (diminishing manufacturing sources and material shortages) in the literature and it can be divided into two branches. One focuses on forecasting the obsolescence risk of parts and the demand trend after obsolescence occurred. Statistical methods are used extensively in these works, and representative research for this branch can be found in [12,13]. Our paper is more related to the second branch which emphasizes the prescriptive perspective, investigating how to minimize part obsolescence impact and maintain satisfactory service levels with various strategies. Obsolescence is unavoidable, and the current methods of mitigating obsolescence are expensive and inefficient. For example, obsolescence is estimated to cost the U.S. Department of Defense (DoD) more than USD 750 million annually. This estimate means that more than USD 9 billion has been wasted over the past 12 years [7]. That is why multiple studies tried to solve the problem at three different management levels: reactive, proactive and strategic [1]. Reactive management addresses the problem after the component or part has already become obsolete or received a product change notification from the original component or part manufacturer. Proactive management addresses obsolescence before it occurs. This strategy is used for critical parts or systems that have a high risk of becoming obsolete or when the availability of the component or system will be low after it becomes obsolete. It employs forecasting methodologies to predict obsolescence dates for the various parts of a product, analyzes the risk of critical parts in a bill of material (BoM) and takes the necessary steps to manage obsolescence [12]. Strategic management uses the system status, forecasts the DMSMS risk and determines the status of expected needs of inventories and spares. It seeks for the optimal mix of reactive mitigation approaches and design refreshes (minor and major) that will minimize life-cycle costs (e.g., maximize cost avoidance) while continuing to meet all system requirements. Strategic management is also used for strategic planning, life-cycle optimization and long-term business case development to support the system, and it often combines reactive and proactive strategies [1,14,15]. Although obsolescence management is recommended over the three described management levels, it is still mainly reactive where decision making represents a crucial part of the process [1,15].
The second stream to which our research is related is sustainability as obsolescence risk is tightly related to environmental concerns such as e-waste and the usage of rare materials in addition to multiple other perspectives such as ecosystem services, economic and financial issues, social issues and operating licenses. Sustainability is not considered an easy task since it involves high levels of corporate management, production and consumption by society. In this sense, ecological, social and economic pressure is increasing in industrial organizations [16] as the pollution generated by them has increased to levels never reached before [17]. The measurement and monitoring of sustainability in industrial organizations based on indicators promote the simplification and quantification of information on triple bottom line aspects [18]. Sustainable production means producing less, with higher quality and durability, lower environmental impacts and higher profitability.
The first attempt to help decision makers in obsolescence management was an approach based on economic analysis [19]. The work provided a formulation of the net present value of last-time buy and design refresh planning. The model looked for a tradeoff between the two possible strategies. It helps obsolescence engineers to develop a solution by providing a break-even year chart that can give the best year for redesign. This model allows a single design refresh at a time. The last-time buy (LTB) strategy is widely studied because of its common use in practice [20]. Reference [21] established a list of factors in cost calculation. It includes procurement cost, inventory cost, disposition cost and penalty cost. Reference [22] proposed a mixed-integer programming formulation to consider parts obsolescence in a two-level lot-sizing problem.
Design refresh has been well studied too. A model developed in reference [23] is based on cost analysis and provides the optimum design refresh plan in order to go through the life sustainment cost of the product. It optimizes the cost over multiple design refreshes. Product life evolution was simulated by [24] using stochastic dynamic programming to make decisions with a Markov decision process. Multiple other studies tried to solve the obsolescence resolution problem using different techniques such as the restless bandit model and Markov decision process [25], integer programming [26], graph theory and mixed linear programming [27]. The limitation of the previous research is that it is costoriented and considers only two resolution strategies (last-time buy and redesign) from all resolution profiles, ignoring then the sustainable dimension of the problem.
Other studies considered obsolescence as a criterion in the decision-making process of many problems such as the maintenance of the drinking water and sewer network [28], for legacy application software obsolescence assessment [29] and in the material purchasing problem where reference [30] considered technology obsolescence and developed a biobjective model to support managers in their decisions in identifying a sustainable quantity purchase when a cap and trade mitigation policy are present. A summary and comparison of the most relevant decision-making papers in obsolescence resolution strategy selection are provided in Appendix A.
To the best knowledge of the authors, only references [3,7] studied the ORS selection more globally by considering multiple criteria and alternatives. While reference [3] applied MAUT (multi-attribute utility theory) to select the best replacement strategy, reference [7] used TOPSIS (technique for order of preference by similarity to ideal solution) and Monte Carlo simulations to rank alternatives during the product design phase. None of them considered sustainability in decision making despite the fact that the environment is directly impacted by electronics waste.
Finally, from a methodological perspective, this paper contributes to the application of a multicriteria decision-making model in obsolescence management. References [10,31] demonstrated the lead role of obsolescence in environmental problems and specifically in accumulation of electronic waste. Our goal in integrating sustainability in obsolescence management is to provide an efficient solution to both ORS selection and waste management problems.
To summarize, based on the extensive literature review, our paper studies the obsolescence resolution strategy selection problem considering sustainability. Obsolescence risk can be considered at any stage of the product life cycle. It will be managed efficiently providing sustainability and robustness. To the best of the authors' knowledge, this research is among the first to consider such a model setting, particularly, including the environment axis in the ORS problem and deriving the most sustainable solutions.

Materials and Methods
Given the multiple elements that affect the ORS selection when a component becomes obsolete such as cost, technological and functional improvement, the stakeholder's constraints and the solution sustainability, no single strategy focusing on a single element can provide a confident assessment. The best resolution strategy for component obsolescence would be based on several criteria rather than a single element. In addition to the complexity of the problem, the subjectivity of ORS selection plays a central role in the obsolescence management process. Reference [15] discussed a similar challenge of optimizing multiple objectives for all obsolescence management levels when looking for the best resolution/mitigation strategy. In this paper, we develop a multicriteria decision-making framework for ORS selection that supports the problem's nature and complexity.
Obsolescence resolution/mitigation strategy goes through four steps: obsolescence notification, gathering information, resolution strategy selection and implementation and documentation. Few decision models were used within step 3, where multiple criteria and alternatives have to be considered in an uncertain and complex decision environment. In this paper, we consider the reactive management level to make it simple and easy to use since it is the most common management level within industry [6].
One of the best-suited tools to help in the decision making considering the uncertainty and the complexity of the decision are the multicriteria decision-making (MCDM) or the multicriteria decision aid (MCDA) methods. Following the guidelines proposed by reference [32] to choose an appropriate MCDM/MCDA method, an outranking noncompensatory approach dealing with a discrete set of alternatives with mixed information structure was adopted. In a non-compensatory strategy, the decision maker may state that the criteria are important enough to refuse any kind of compensation or trade-offs. The usage of non-compensatory strategy provides better satisfaction for the decision makers [33,34]. The adopted decision method is based on a highly regularized operating environment where compensating criteria is not preferred. Thus, compensatory single synthesizing approach such as MAUT (multi-attribute utility theory) or AHP (analytic hierarchy process) was rejected (although some techniques developed within AHP framework were used to determine the criteria weights). Reference [35] related compensation degree and the sustainability strength of the MCDM methods and proved that sustainability and compensation are opposite: the higher compensation is, the weaker sustainability will be. Based on the nature of the problem, reference [32] guidelines and reference [35] study, ELECTRE III (ELimination Et Choix Traduisant la REalité) and PROMETHEE (Preference Ranking Organization Method for Enrichment Evaluations) were selected to be used in this work for their support to the discrete, outranking and non-compensatory nature of the problem and for their substantiated effectiveness in similar contexts.
The major difficulty facing an MCDA methodology lies in the assessment and the modeling of the decision-maker (DM) preferences that affect both the decision process and the solution [32]. In this paper, decision-maker preferences are reflected in the criteria weights and the four binary relations established using the concepts of thresholds, concordance and discordance indexes. The four binary relations, for the pairwise comparison of alternatives, are indifference situation I, preference situation P, weak preference situation Q and incomparability R.
To develop the MCDM framework for the ORS selection problem, the process was divided into two stages: construction and exploitation, as recommended by [32]. First, at the construction stage, relevant criteria were determined based on literature then filtered by experts in the fields of environment, economy, human resources, technological obsolescence and operations management. The final criteria set C to be considered is described in Table 1. Unlike the criteria set which is valuable for all obsolescence cases, criteria weights need to be calculated at each obsolescence notification. It is completely natural that cheap parts' cost will not be the most important criterion in the decision process compared to the ORS implementation time. For critical high-end parts, both requalification and technology readiness will be the most important. Determining weights is, then, performed case by case. Both swing method and pairwise comparison were applied. Sets W 1 and W 2 for weights generated from both techniques are normalized and validated. The exploitation stage involves the aggregation (calculation) and the results (recommendation) steps. The general simplified methodology consists of selecting or recommending the best ORS strategy that satisfies the three actors of the problem: the manufacturer, the customer and the stakeholders. A summary of the research methodology is presented in the Figure 1.

Alternatives
There are many possible resolution strategies to obsolescence problems. Their range in complexity is from a simple part substitution to a major redesign of the product. Reference [1] provided the most complete list of obsolescence resolution strategies. A total of eleven general solutions were identified. They form the alternatives set A in the proposed multicriteria decision framework. Reference [36] ranked these alternatives in approximate order of increasing cost. The negotiation with the manufacturer to keep producing the component and the usage of the existing stock are both cost-free solutions but rarely considered. The reclamation strategy is also a cheap solution that allows one to obtain a small number of obsolete parts by salvaging or cannibalizing used parts that still have a useful remaining life. For medium-cost solutions, alternate part, part substitution, uprating, aftermarket sources and emulation can be considered. While an alternate part is a part with equivalent or greater performance than the replaced part, part substitution is a complete process of selecting a part with fewer capabilities than the part it replaces. The selection process considers the form, fit and function criteria for a component designed as a replacement part. Uprating is a special range of part substitution. It is the process of assessing the ability of a part to meet the functionality and performance requirements of applications where it is necessary to use it outside the manufacturer's specification range. Parts can be sourced from aftermarkets too (aftermarket refers to the period after the original manufacturer has moved a part out of production). This solution has high risks of counterfeit [37]. The choice has to be made carefully between approved sources that provide finished parts or those that remanufacture parts and unapproved sources or brokers. Electronic parts can be emulated. Emulation refers to the process of redesigning obsolete electronics from their slash sheets, datasheets, test vectors and other information. In some other studies, emulation is considered as part substitution of alternate parts.

Criteria
While most of the studies for obsolescence management considered mainly economic and technological factors, Reference [38] believed that considering global sustainability is essential for effective decision making since industrial, social and ecological systems are closely linked. In this paper, a sustainable set of criteria is considered to help make decisions in obsolescence management. In addition to the basic economic and technological criteria categories, environmental and social criteria are added. The strong relationship between technological obsolescence and the increasing stream of e-waste was demonstrated in multiple studies [9,10,39] which made the environmental factors a priority. Another example of a factor influencing the increase in the obsolescence of electronic components is the need to comply with increasingly strict and demanding legislation in the updated European Union regulation in this area of Restriction, Assessment and Authorization of Chemicals (REACH) and the Restriction of Hazardous Substances Directive (RoHS).
The criteria set in this study is based on sustainability indicators for industrial organizations developed by [40], the previous work on obsolescence decision making [7,41] and agreed upon by the case study decision makers. The sustainable framework is inspired by [40,42,43], and the criteria set was divided into 4 subsets: economic, environmental, social and technological as described in Table 1.

Criteria Weights
Criteria weights are used to run the selected outranking methods and should be calculated with the understanding that set W represents weights of relative importance of the different criteria. They are non-negative numbers and independent from the measurement units of the criteria.
The weights have an important role in measuring overall preferences of alternatives. Their assessment of the criteria is not straightforward. It involves the priorities and perceptions of the decision maker. In this study, two weighting methods are used and compared to help express the decision makers' preferences. The first method is the value swinging method. It assigns to the most important criterion the highest weight in a selected weighting range (100 to 1-100 scale). First, voters assign 100 over the value measures based on their importance. They identify and discuss significant differences and revote until they agree on the ranking of value measures. A second tour of voting is performed to determine weights following the earlier agreement. The weights are then normalized, and the outliers are discussed. Voting continues until everybody agrees on the weights [3]. This method's strength is that it considers the range of each criterion, and it is a relatively simple and straightforward method. However, it does not allow participants to directly compare criteria between each other. That is why the second method is the pairwise comparison method. It consists of calculating the relative importance coefficient α ij for all criteria pairs, where α ij = 1 α ji where i and j are two different criteria. α ij value is equal to 1 if criterion i and criterion j are equally important, 3 if i is slightly more important than j, 5 if i is more important than j, 7 if i is strongly more important than j and 9 if i is absolutely more important than j. A pairwise matrix is built and normalized by making equal to 1 the sum of the values on each column. Each normalized matrix entry is calculated by , where m is the number of considered criteria. Finally, the criteria weight vector w is calculated by calculating each row of the normalized pairwise matrix where [44]. The pairwise comparison method was extended later to handle fuzzy criteria comparison for fuzzy hierarchical analysis [45].
Both weights from both methods are compared in order to get the most representative importance of the criteria. Weights are important and might have a large impact on the decision-making process. They will be used as an input to the selected outranking methods. The usage of pairwise comparison is limited to the criteria weights and is different the original technique of AHP.

ELECTRE III
We relied upon outranking multicriteria decision-making process. In this context, ELECTRE III was selected among many other possible techniques for multiple reasons summarized in reference [46]. First, the context requires the use of non-compensatory aggregation procedures as the dropping on a given criterion cannot be compensated by the gain on another one. Second, the aggregation procedures usage is limited to decision problems with more than five criteria and less than twelve which can be a limitation on the use of our model. Under all of these constraints, ELECTRE III is considered the most adequate MCDM method that can support obsolescence resolution strategy selection problems. ELECTRE III is used to rank alternatives. In this case, the alternatives are the resolution strategies. The multiple criteria decision-making method helps express the user preferences when a set of solutions must be ranked according to a set of contradictory criteria [46]. Outranking relations S are used to model preferences. S means "at least as good as". Considering the two alternatives a and b: • aSb and not bSa, i.e., aPb (a is strictly preferred to b); • bSa and not aSb, i.e., bPa (b is strictly preferred to a); • aSb and bSa, i.e., aIb (a is indifferent to b); • Not aSb and not bSa, i.e., aRb (a is incomparable to b) alternatives.
The decision maker contributes to the ranking process by defining the three preference parameters: the indifference thresholds q, preference thresholds p and veto thresholds v. Each objective or criterion has its own thresholds that will be used later to rank the alternatives when it comes to calculating concordance and discordance indexes.
The outranking in ELECTRE III is based on concordance and discordance principle. Alternatives are compared to each other and generating concordance index and discordance index. While the concordance c(aSb) (1) is considered when one alternative is as good as another, discordance d j (aSb) (2) calculates the possible rejection of one solution compared to another, basically when criteria are compared with consideration to thresholds: where the coefficient ϕ j decreases linearly from 1 to 0, and g j describes the range: g j (a) + q j g j (a) , g j (a) + p j g j (a) J s = j ∈ J : g j (a) + q j g j (a) ≥ g j (b) And, J Q = j ∈ J : g j (a) + q j g j (a) < g j (a) ≤ g j (b) + p j g j (b) A credibility index ρ(aSb) (3) might later weaken the c(aSb) index of possible veto effects. A complete preorder is finally suggested considering preorders suggested by the distillation processes.

PROMETHEE
In general, multicriteria problems cannot be treated without additional information related to the preferences and the priorities of the decision makers. The information requested by PROMETHEE is particularly clear and easy to define for both decision makers and analysts. It consists of a preference function associated with each criterion as well as weights describing their relative importance.
Preference modeling regarding dominance relations is quite similar to ELECTRE III. Three dominance relations are considered: P, I and R, respectively, stand for preference, indifference and incomparability. They are defined below: PROMETHEE II is selected to get a complete ranking. Its procedure is based on pairwise comparison of alternatives. After getting the weights set and the decision matrix, the amplitude deviation d j (a, b) and the deviation evaluation P j (a, b) are calculated. It denotes the difference between the evaluations of alternatives a and b on criterion g j .
F j is the preference function. It could be usual, U-shape, V-shape, Level, V-shape with indifference or Gaussian models. The preference function, depending on its model, requires none or many from the following parameters to be defined: q, the threshold of indifference, p, the threshold of strict preference, and s, an intermediate value between q and p. While P j expresses the decision-maker preference for one criterion, the aggregated preference index π(a, b) (7) is calculated to express with which degree a is preferred to b over all the criteria.
As soon as π(a, b) and π(b, a) are computed, positive outranking flow ϕ + (8) and negative outranking flow ϕ − (9) are calculated to help complete ranking alternatives. When PROMETHEE II is considered, all the alternatives are comparable, and either P or I dominances (10) result. No incomparabilities remain, and alternatives are ranked.

Case Study
This case study was conducted at one of the largest international companies of vertical flights. The production facility includes various departments that handle numerous operations including the engineering department where change management is planned and executed. One of the most recurrent changes to make are those related to technological obsolescence. It happens unpredictably to any system at any stage of its life cycle. Technological obsolescence is mainly related to the obsolescence of technology over time which means that it happens necessarily at the end of life of the product [1] or at least after an important period of usage. With the fast technological evolution, technological obsolescence can be faced in the early stages of the product life cycle and even before the product's useful life starts, at the production stage, for example [37]. The problem is more significant for sustainment-dominated systems [15], where the gap between these systems' expected useful life and the interval of technological change continues to expand. The inherent impact of the obsolescence risk is hard to manage. The task of selecting the optimal resolution strategy is difficult. In this case study, the multicriteria decision-making method, described earlier, was applied to select the most suitable obsolescence resolution strategy considering sustainability criteria for one of the most sensitive parts of the system. First, fifteen selection criteria and nine alternatives were identified. The criteria weights were calculated using two different weighting methods involving multiple stakeholders and department managers. Following this, two ranking methods were applied to rank different resolution alternatives to solve the obsolescence case. The performance table is illustrated in Table 2. It includes nine alternatives or different resolution strategies and their performance on the fifteen criteria. The first step after identifying the available alternatives and their performance is to determine the criteria weights. The results after normalization were close. The weights from both methods and the deviation (Table 3) were validated and approved by the decision makers. A total of eight scenarios are considered and compared (Table 4 and Table 6).

Implementing MCDM Ranking Methods
The ranking methods require multiple input parameters for the criteria. On one hand, for ELECTRE III, the criteria, their optimization, the indifference, preference and veto thresholds are in Table 5.
On the other hand, PROMETHEE requires a different format for criteria thresholds as each criterion has its own preference function which requires specific preference parameters. Appendix B describes the criteria data input for the case study.

MCDM Results
To evaluate the impact of the suggested framework, the results from the eight scenarios are described in Table 6.
While considering sustainability criteria, it is important to note that the first three alternatives were not sensitive to the weighting method as scenarios 1 and 3 results were almost the same in the first place. The same was observed for scenarios 5 and 7. Decision making using only cost, procurement, time, functionality, technology readiness level, open architecture and software compatibility was sensitive to the weighting method. It is explained by the fact that criteria weights change their importance when the mindset of the decision maker changes. When sustainability criteria were deleted, the cost and functionality criteria became the most important with large weights. It is not the case when considering sustainable criteria such hazardous material or pollution. In that case, there is no compromise and respecting legislation is a binary decision-one either respects it or not. That is why cost and functionality lose some of their weights.
It is clear that A3 dominates the first place in the sustainable ranking compared to A7 if sustainability is not considered. Comparing these two alternatives shows that the algorithm converged to a cheaper solution with acceptable technological characteristics compared to the best alternatives when the sustainable framework was used. In that case, alternatives respecting the environmental constraints with good technological performance were ranked first as the economical aspect is no longer a priority.

Sensitivity Analysis
Sensitivity analysis is an indispensable concept in the effective use of the quantitative decision model, and the purpose of this analysis is to assess the stability of an optimal solution under changes in parameters, the impact of unmanageability of some parameters and the need for accurate estimation of values of parameters. However, research on sensitivity analysis in multicriteria decision support is limited. The decision support process does not stop when one has an answer. A good decision support process must, generally, study the sensitivity of the parameters that led us to this response and the robustness of the response itself. After obtaining the final ranking of both methods, a sensitivity analysis is essential to measure the solution's robustness. The solution sensitivity to both weights and thresholds can be studied. In our case, sensitivity to thresholds is not studied as these parameters are mostly determined by legal documents and standards. Where ELECTRE III sensitivity analysis was done manually by increasing and decreasing each weight by 10% and checking if the solution changed, PROMETHEE sensitivity analysis was performed using Visual PROMETHEE software. For all scenarios, solutions were stable for the first three alternatives. As an example, Table 7 describes the stability intervals for scenario 7. The solution has multiple industrial contributions such as respecting international standards and legal obligations regarding environmental restrictions. It also defines a clear process ensuring sustainability and competitiveness with an easy preference modeling in a highly subjective decision-making environment. It allows the company to decrease pollution levels and hazardous materials usage while increasing customer satisfaction and technological performance.

Conclusions and Future Work
This paper describes a sustainable multicriteria decision framework to manage obsolescence. Once alternatives were determined, MCDM tools were employed to select the best obsolescence resolution strategy according to a set of sustainable criteria. This helps companies obtain the best trade-off between economic, social, environmental and technological constraints.
Since MCDM tools were employed, it was necessary to determine a set of criteria, their weights and the available alternatives. Prior to this work, quantitative MCDM tools were used but limited in most cases as they support neither qualitative data nor uncertainty. MCDM tools' effectiveness and accuracy depend strongly on the problem and the decision maker. They require strong preference modeling. The case study demonstrated that in all scenarios, a ranking of the solutions was obtained, but it widely depended on the input parameters. It is acceptable to select the least sustainable option, but it may impact the company's engagement and ethics and break legal rules related to the environmental aspect. Incorporating sustainability in the decision making is then important in a complex and constrained decision environment.
The comparison between the weighting methods demonstrated that pairwise is much more appreciated by the decision makers due to its simplicity and its comparison principle. Between ELECTRE III and PROMETHEE II, preference modeling was easier with the second method using preference functions. To support MCDM uncertainty, it is recommended to use both methods as they deal differently with preferences and there is no guarantee that one will always work better than the other. In addition, the sustainability of the decision is also important and is represented by its sensitivity and robustness. The sensitivity to the criteria weights was studied, but sensitivity thresholds could be done for further analysis. As noted previously, the success of the suggested framework is based on data quality and the company engagement in reducing its environmental impact to achieve sustainable global policy.
The results of this study indicate that MCDM ranking methods are effective in ORS selection via the proposed sustainable framework. This was validated with the comparison of the decisions before and after applying the sustainable criteria set. The research findings suggest that integrating sustainability to an unsustainable problem that combines economic, environmental, social and technological factors would provide useful insights to support decision making and improve obsolescence resolution strategies for a sustainable and green system.
Although the capability of the suggested framework and the MCDM ranking methods to handle sustainable decisions in the ORS selection process was approved in the current study, the application was limited to the reactive management level. The framework would be used for future research at the proactive management level to examine the impact of the strategies in the product design, for example. Alternatively, the effectiveness of the proposed MCDM tools could be compared to other decision models such as multi-objective optimization. In the case of the proactive management, dynamic decision making would be more advantageous considering the volatile and uncertain evolution of both technological and environmental parameters. However, more studies should be conducted to assess the environmental impact caused by obsolescence and to work on it proactively, reactively and strategically.    [19] x x x x [47] x x x [23] x x x [21] x x x [24] x x x x [25] x x x x [48] x x x [27] x x x