A Customized IMOEA/D for Bi-Objective Single-Machine Scheduling with Adaptive Preventive Maintenance

: The prolonged operation of machines in the production process can lead to continuous deterioration or even failure, and the necessary maintenance measures can alleviate the above negative effects. For this reason, this study investigates a joint optimization problem of single-machine production and preventive maintenance (PM) considering linear deterioration effects. The objective is to obtain an integrated sequence of degrading jobs and PM activities in order to simultaneously minimize the makespan and the total cost. Based on the problem characteristics, an adaptive PM strategy is ﬁrst designed. To efﬁciently solve the problem, an improved multi-objective evolutionary algorithm based on decomposition (IMOEA/D) is tailored, where the biased-distribution weight vector is proposed to enhance the search capability at both ends of the Pareto front. Five instances are used to evaluate the performance of the customized IMOEA/D and two classical multi-objective evolutionary algorithms. Numerical studies show that the IMOEA/D can substantially improve the hypervolume metric, the maximum spread metric, and the distributivity of the Pareto front at a slight sacriﬁce of the spacing metric.


Introduction
Single-machine scheduling usually refers to the scheduling of a set of production tasks on a single machine to optimize production metrics such as maximum completion time and total operation cost in a discrete manufacturing environment.Depending on the specific constraints and objectives, single-machine scheduling can be subdivided into different combinational optimization problems such as single-machine scheduling with the learning effect and deterioration effect [1], and single-machine scheduling considering time-andresource-dependent processing times [2].Some studies such as Martinelli et al. [3] have conducted a systematic survey of single-machine scheduling.From the above review, it can be seen that common approaches to solving single-machine scheduling include efficient polynomial-time algorithms [4][5][6], heuristics and metaheuristics [7][8][9].
A classic variant of single-machine scheduling is to consider machine unavailability during production scheduling [10][11][12].Both machine breakdowns and preventive maintenance (PM) activities lead to temporary machine unavailability, the former resulting in forced downtime for repairs, while the latter is known in advance.This means that unexpected failures may interrupt jobs being processed, and there is no time overlap between PM planning and production scheduling.Another advantage of PM is that it improves the running condition of the machine, thus reducing the probability of unexpected failures [13][14][15].The relevant literature has also demonstrated that PM plays an indispensable role in smart manufacturing for Industry 4.0 [16][17][18].However, there is a major challenge to develop an appropriate maintenance strategy to balance the coupling conflicts between production and maintenance under a specific manufacturing scenario.
Machines 2023, 11, 897 2 of 14 For this reason, many researchers have been working on the integrated optimization of production scheduling and PM under different constraints and optimization requirements of single-machine manufacturing scenarios in the last two decades.
For example, Liao and Chen [19] assumed that each PM is required after a fixed interval on a single machine and employed the branch-and-bound algorithm and the heuristic, respectively, to solve small-sized and large-sized problems to minimize the maximum tardiness.Jin et al. [20] extended a multi-objective version of the integrated optimization of PM planning and single-machine scheduling proposed by Cassady and Kutanoglu [21] and presented a multi-objective genetic algorithm to simultaneously optimize five objectives.Low et al. [22] proved the studied single-machine scheduling problems with periodic and flexible PM are NP-hard and provided an efficient heuristic to obtain the minimal makespan.Luo et al. [5] considered a variable maintenance duration that increases with the starting time of PM and developed polynomial-time algorithms to deal, respectively, with four problem scenarios with different optimization objectives.Shen and Zhu [23] investigated an integrated scheduling problem of single-machine production and periodic maintenance targeted at minimizing the makespan, where uncertain processing time and maintenance duration were considered.Wang et al. [24] proposed a novel flexible PM mechanism that combines a time-based PM with a condition-based PM, and designed a Q-learning-based solution framework to tackle a single-machine scheduling problem considering the proposed flexible PM.
A review of relevant studies shows that joint optimization problems of single-machine scheduling and PM are more oriented towards single-objective optimization.Practical decision makers usually focus on multiple conflicting optimization objectives, which can be confirmed in other variants of single-machine scheduling.Choobineh et al. [25] considered sequencedependent setup times and proposed a multi-objective tabu search algorithm to minimize the makespan, number of tardy jobs and total tardiness.Tavakkoli-Moghaddam et al. [26] built a fuzzy multi-objective linear programming model with the objective of minimizing the makespan and total weighted tardiness.Che et al. [27] introduced the power-down mechanism in single-machine scheduling and developed an advanced ε-constraint method with local search to minimize the total energy consumption and maximum tardiness simultaneously.Similarly, Wu et al. [28] used ε-constraint-based heuristic algorithms to solve a single-machine scheduling problem considering time-of-use electricity tariffs in order to optimize the makespan and total electricity cost.Compared to the above multi-objective single-machine scheduling problems, the studied integrated optimization problem requires joint decision making between the production and maintenance departments, thus it is more necessary to carry out a multiobjective optimization study for the optimization needs of the two departments.
This study addresses an integrated optimization problem of single-machine scheduling and PM with the objectives of minimizing the maximum completion time and the total cost of production and maintenance processes.Both the deterioration effects and stochastic failures are considered in the proposed integrated optimization problem.To improve these two negative effects as well as to adapt the characteristics of the studied bi-objective optimization, a novel adaptive PM strategy is designed for the trade-off between the maintenance time and maintenance cost.In addition, this study also introduces the minimal repair (MR) strategy to cope with unexpected failures.For efficiently solving the above problem, an improved multi-objective evolutionary algorithm based on decomposition (IMOEA/D) is tailored.The main contributions of the developed algorithm are reflected in the design of the decoding process and the improvement of the weight vector distribution.
The remainder of the study is organized as follows.In Section 2, the studied problem is systematically described and a novel PM strategy is proposed.Section 3 introduces the IMOEA/D that is used to solve the problem, followed by a series of numerical studies in Section 4 to evaluate the performance of the tailored IMOEA/D.Finally, some conclusions and future research directions are summarized in Section 5.

Problem Statement and Assumptions
There are n jobs waiting to be processed on a single machine, and the machine's age increases as the production process proceeds.The increase in the machine's age will result in longer processing times for jobs and increases the probability of machine failures.As a consequence, machine maintenance activities are essential.In case of an unexpected machine breakdown, an MR will be carried out to restore the running condition of the machine without changing the machine's age.To improve the machine's age and reduce the probability of failures, PM is usually integrated into the single-machine scheduling.
The timing of PM intervention is one of the main focuses of the research on the integrated optimization problem.Excessive frequency of PM may result in over-maintenance, costing maintenance as well as loss of production profit due to taking up potential production time, while too long a period of time without PM can exacerbate the deteriorating condition of the machine as well as the probability of malfunctioning, which will result in a greater loss of unplanned downtime.
Different processing sequences have different impacts on machine deterioration, which also can influence the makespan.In addition, each job has a due date, and early delivery may lead to increased storage pressure in the shop floor, while late delivery may affect customer satisfaction.For this reason, in addition to the maintenance cost, the penalty cost of early and late delivery is considered in the total cost.The aim of the studied integrated optimization problem is to simultaneously minimize the makespan and the total cost.In addition, some problem assumptions are listed below.
(1) All jobs can be processed by the machine at time 0 [29].
(2) The processing of any job is not interrupted by proactive PM.
(3) There are no additional constraints on the sequence of operations of the jobs.(4) The machine can only process one job at a time.(5) The processing time of a job increases linearly with the machine's age, i.e., the deteriorating processing time as defined in Wang et al. [24].(6) The initial machine's age is 0. (7) PM is performed to restore the machine's age to 0. (8) MR will be carried out immediately after failures, to restore the running condition of the machine with the machine's age unchanged.

Adaptive PM Strategy
Considering the objective optimization in both time and cost dimensions, this paper proposes an adaptive PM strategy for balancing maintenance time and maintenance cost.In terms of maintenance time, the probability of machine failure increases as the machine runs, the number of MRs increases, and the time taken for MRs may be greater than the time taken for PM, which means that PM carried out at the proper moment can save more maintenance time and greatly improve the machine's age.The PM strategy based on maintenance time is concretely derived as follows.
First, we assume that the probability of machine failures and the age of the machine follow a two-parameter Weibull distribution with θ as the scale parameter and β as the shape parameter.θ reflects the average time of occurrence of random failures, while β determines the trend of the failure probability.When β > 1, the failure rate gradually increases with the machine's age; when β = 1, the failure rate is constant; when β < 1, the machine has a high probability of failures at the initial stage, but the failure rate decreases gradually with the increase in the machine's age.To fit the reality, β > 1 is taken in the proposed problem.The probability density function f (a) and the corresponding cumulative distribution function F(a) of the Weibull distribution are shown in Equations ( 1) and ( 2), respectively, where a denotes the machine's age.
Hence, the mapping relationship between the machine's age and the probability of failures is obtained, as shown in Figure 1.Once the machine's age a j after the completion of the job at the jth position has been determined, the corresponding failure rate F a j can be derived.
mulative distribution function   of the Weibull distribution are shown in Equations ( 1) and ( 2), respectively, where  denotes the machine's age.
Hence, the mapping relationship between the machine's age and the probability of failures is obtained, as shown in Figure 1.Once the machine's age  after the completion of the job at the  position has been determined, the corresponding failure rate   can be derived.Thus, the expectation   of the number of machine failures as the machine's age varies from  to  can be expressed by the following Equation ( 3).Assuming that the times spent on PM and an MR are  and  , respectively, the maintenance threshold  based on the maintenance time decision can be calculated from Equation (4).Similarly, in terms of maintenance cost, supposing that the costs spent on PM and an MR are  and  , respectively, the maintenance threshold  based on the maintenance cost decision can be obtained based on Equation (5).

𝐸 𝑁 𝐹 𝑎
To balance the time-based and cost-based decisions, we calculate the mean value of  and  as the used maintenance threshold  in the subsequent experiments.When a job is processed and the machine's age exceeds , PM will be performed to restore the machine's age to 0. In addition, different processing sequences correspond to different values of , i.e., different PM strategies, which is regarded as an adaptive PM strategy in this paper.

The Developed IMOEA/D
Compared to the traditional non-dominated sorting genetic algorithm (NSGA-II), the MOEA/D algorithm reduces the complexity of the problem by converting the mul- Thus, the expectation E N f of the number of machine failures as the machine's age varies from a 1 to a j can be expressed by the following Equation ( 3).Assuming that the times spent on PM and an MR are T P and T M , respectively, the maintenance threshold A T based on the maintenance time decision can be calculated from Equation (4).Similarly, in terms of maintenance cost, supposing that the costs spent on PM and an MR are C P and C M , respectively, the maintenance threshold A C based on the maintenance cost decision can be obtained based on Equation (5).
A T = min a j T M∑ j m=1 F(a m ) > T P (4) To balance the time-based and cost-based decisions, we calculate the mean value of A T and A C as the used maintenance threshold A in the subsequent experiments.When a job is processed and the machine's age exceeds A, PM will be performed to restore the machine's age to 0. In addition, different processing sequences correspond to different values of A, i.e., different PM strategies, which is regarded as an adaptive PM strategy in this paper.

The Developed IMOEA/D
Compared to the traditional non-dominated sorting genetic algorithm (NSGA-II), the MOEA/D algorithm reduces the complexity of the problem by converting the multiobjective problem into a series of single-objective subproblems.The weight vectors are used to represent the importance of the subproblems, and the neighborhood search strategy is employed to perform an effective local search, so as to find the approximate Pareto optimal solutions in the solution space that satisfy the requirements of different weights.Considering the characteristics of the proposed discrete combinatorial optimization problem, this paper designs an efficient decoding strategy and proposes a biased-distribution weight vector, which are the main innovations in the developed IMOEA/D.Specific details will be given in the following subsections.

Encoding and Decoding
Simple integer coding can represent the scheduling sequence on a single machine, where each integer code represents a job.In the studied integrated optimization problem of single-machine scheduling and PM, in addition to the scheduling of production sequences, the evaluation of machine failures and the judgment of the start time of the MR and PM are required, which are determined in the following decoding process.
Each job is processed sequentially according to the order of the integer encoding.After each job is processed, the probability of machine failures can be calculated based on the machine's age, and thus the expectation of machine failure time can be calculated from the duration of the processing time and the failure rate, and then the expectation number of equivalent MR can be obtained.In addition, based on the adaptive PM strategy in Section 2.2, the PM intervention time can be determined for the current integer encoding.The detailed decoding process is presented in Algorithm 1.

Biased-Distribution Weight Vector
In the standard MOEA/D algorithm, the weight vectors are generated using a uniform distribution in order to realize that the solution space is uniformly searched.This approach is suitable for problems with uniformly distributed solutions and can effectively explore the solution space to obtain more uniformly distributed solutions.By using the standard NSGA-II algorithm to solve the proposed problem, it can be found that the distribution of solutions is higher in the middle section of the Pareto front and lower at the two ends.This also means that the uniformly distributed weight vectors in the standard MOEA/D algorithm cannot focus the search on the regions with less solution distribution.In order to increase the search effort on both ends of the Pareto frontiers, a biased-distribution weight vector is designed as follows.
As shown in Figure 2, more dense weight vectors are configured at both ends of the Pareto frontiers with fewer distributions, while the configuration of weight vectors is appropriately reduced in the middle section of the Pareto frontiers with dense distributions, which improves the maximum spread metric and spacing metric of the Pareto frontiers, but may affect the number of solutions in the middle section of the Pareto frontiers to some extent.Z* is the reference point, where each objective is the minimum value of the corresponding objective set.
standard MOEA/D algorithm cannot focus the search on the regions with less solution distribution.In order to increase the search effort on both ends of the Pareto frontiers, a biased-distribution weight vector is designed as follows.
As shown in Figure 2, more dense weight vectors are configured at both ends of the Pareto frontiers with fewer distributions, while the configuration of weight vectors is appropriately reduced in the middle section of the Pareto frontiers with dense distributions, which improves the maximum spread metric and spacing metric of the Pareto frontiers, but may affect the number of solutions in the middle section of the Pareto frontiers to some extent.Z * is the reference point, where each objective is the minimum value of the corresponding objective set.Let the set of uniformly distributed weight vectors  be as Equation ( 6), where  ~ 0,1 denotes that  obeys a uniform distribution from 0 to 1, and  denotes a total of  weight vectors.Hence, the set of the biased-distribution weight vector  can be defined by Equation (7), where   is a mapping function of  in the uniformly distributed weight vector  ,  to  in the biased-distribution weight vector  ,  .Regarding the settings of   , we were inspired by the function curve in Figure 1 to define Equation ( 8), because this type of function can make the solutions of Equation ( 7) satisfy the characteristics of the biased-distribution weight vector (see Figure 3).We conducted extensive experiments and finally determined a better definition of   with scale parameter  and shape parameter  as 0.5 and 5.  Let the set of uniformly distributed weight vectors W be as Equation ( 6), where x i ∼ U(0, 1) denotes that x i obeys a uniform distribution from 0 to 1, and N denotes a total of N weight vectors.Hence, the set of the biased-distribution weight vector W can be defined by Equation ( 7), where ϕ(x i ) is a mapping function of x i in the uniformly distributed weight vector (x i , y i ) to x i in the biased-distribution weight vector x i , y i .Regarding the settings of ϕ(x i ), we were inspired by the function curve in Figure 1 to define Equation ( 8), because this type of function can make the solutions of Equation ( 7) satisfy the characteristics of the biased-distribution weight vector (see Figure 3).We conducted extensive experiments and finally determined a better definition of ϕ(x i ) with scale parameter θ and shape parameter β as 0.5 and 5.

Overall Framework of the IMOEA/D
The detailed steps of the developed IMOEA/D are given below and the corresponding pseudo code is presented in Algorithm 2.
(1) Initialize the population and then, respectively, calculate two optimization objectives of each individual, and then an initial reference point is determined based on the minimal makespan and minimal total cost among all the individuals.(2) Initialize the list of the biased-distribution weight vector based on Section 3.2.In

Overall Framework of the IMOEA/D
The detailed steps of the developed IMOEA/D are given below and the corresponding pseudo code is presented in Algorithm 2.
(1) Initialize the population and then, respectively, calculate two optimization objectives of each individual, and then an initial reference point is determined based on the minimal makespan and minimal total cost among all the individuals.(2) Initialize the list of the biased-distribution weight vector based on Section 3.2.In addition, the number π of neighbors is given.(3) Find the π nearest neighbors for each individual in the population.Two of these neighbors are randomly selected for two-point crossover to generate new individuals, which is immediately followed by a mutation process that arbitrarily exchanges the two coding positions for the new individuals with a certain probability.

Numerical Study
First, the workshop production data was initialized in this section, and immediately after that, three metrics including the HV metric, the spacing metric and the maximum spread metric were introduced for performance evaluation of the customized IMOEA/D.Finally, the superiority of the IMOEA/D was verified by comparing it with advanced multi-objective optimization algorithms under given instances.All algorithms were implemented in Python 3.8 and run on an Intel(R) Core(TM) i7-8700 CPU (3.20 GHz/16.00GB RAM) PC.

Instance Settings
To evaluate the performance of the customized IMOEA/D, a total of five instances with different job numbers were set up.The job number was selected from {20, 30, 40, 50, 60}.Normal Processing time for each job followed a uniform distribution from 5 to 20.Deteriorating rate of each job was selected from {0.01, 0.02, 0.03, 0.04, 0.05}.Due date of each job was randomly generated from 50 to 600.For further visualization and comparative analysis, instance 2 with 30 deteriorating jobs is given in Table 1.In addition, penalty factors for early and late delivery of jobs were both 1.The two parameters θ and β in the Weibull distribution used to characterize machine failures were set to 220 and 3, respectively.The time and cost consumed by an MR were set to 15, 200, and the time and cost consumed by PM were defined as 30, 600.Regarding the key parameters of IMOEA/D, the maximum iteration number and population number were set to 2000 and 200, and the number π of neighbors was set to 5. In the two-dimensional target space formed by the two objective functions, the HV metric [30] represents the area of the target space dominated by the Pareto front.Before calculating the HV metric, a reference point needs to be selected.The location of this reference point needs to satisfy that the value of each objective function is greater than all the non-dominated solutions on the Pareto front.For convenience, solutions on the Pareto front are usually normalized and then the reference point can be set to (1.01, 1.01).A higher HV metric means that the algorithm performs better.

Spacing Metric
The spacing metric [31] is a measure of the homogeneity and continuity of the Pareto front.It is usually calculated as follows: Euclidean distances between every two neighboring solutions are calculated and the average of these distances is taken.The smaller the average distance is, the closer the Pareto front converges to a uniform and continuous distribution, i.e., the algorithm performs better when the spacing metric is smaller.

Maximum Spread Metric
The maximum spread metric [32] is the maximum value of the difference between the distances of all solutions to the leftmost and rightmost solutions on the Pareto front, which can reflect the distribution of the set of solutions in the domain of objective function values.The larger the maximum spread metric, the better the spread of solutions, i.e., the better the performance of the algorithm.

Performance Evaluation of IMOEA/D
To evaluate the solving performance of the developed IMOEA/D, two classical multiobjective optimization algorithms, including the standard MOEA/D and NSGA-II, were selected as algorithm rivals.It is noted that MOEA/D keeps the same configuration as IMOEA/D except for the biased-distribution weight vector.In addition, all the competing algorithms have the same population size and the same maximum iteration number that allows algorithms to converge.Each algorithm was run independently 10 times under each instance to achieve consistent and reliable results.As shown in Tables 2-4, a detailed comparison of the mean and variance of the algorithm results is presented in terms of the HV metric, the spacing metric, and the maximum spread metric, respectively.It is observed that the developed IMOEA/D outperforms other algorithms in terms of the HV metric and the maximum spread metric, while it performs slightly worse than MOEA/D in terms of the spacing metric under instances 3 and 4. The reason for this is because an increase in the maximum spread metric may make the spacing of the points on the Pareto frontier subsequently increase, resulting in a slight sacrifice of the spacing metric.However, in terms of the HV metric, IMOEAD yields a better Pareto front.To enhance the visualization of comparative results, we conducted further analysis for instance 2 from four perspectives: the Pareto front, the HV metric, the spacing metric, and the maximum spread metric.Some findings and conclusions are summarized as follows.
Firstly, the comparative result in terms of the Pareto front is shown in Figure 4.It can be intuitively seen that the distribution of the solutions of NSGA-II is more concentrated compared to the two MOEA/D algorithms.This indicates that NSGA-II has some limitations when dealing with the studied multi-objective optimization problem.Specifically, this is due to the relative inadequacy of NSGA-II in maintaining population diversity, resulting in its inability to efficiently search for non-dominated solutions in the entire solution space.In contrast, MOEA/D algorithms have better search performance in the target space by bootstrapping based on subproblems with the weight vector.IMOEA/D outperforms MOEA/D because MOEA/D uses the uniformly distributed weight vector, which may cause the algorithm to search insufficiently on both sides of the Pareto front to find more non-dominated solutions.This means that IMOEA/D can increase the search on both sides of the Pareto front to improve MOEA/D.The trend of the number of non-dominated solutions on Pareto front with increasing iteration number is shown in Figure 5.This also reflects the excellent performance of IMOEA/D in the search process.Secondly, the comparative result in terms of the HV metric is illustrated in Figure 6.The HV metric of IMOEA/D is the best, mainly due to the setting of the biased-distribution weight vector and the gain from IMOEA/D searching for more solu- Secondly, the comparative result in terms of the HV metric is illustrated in Figure 6.The HV metric of IMOEA/D is the best, mainly due to the setting of the biased-distribution weight vector and the gain from IMOEA/D searching for more solutions on both sides of the Pareto front.This gain is mainly brought about by the preservation of population diversity during the iteration process.The HV metric of NSGA-II is comparable to that of MOEA/D, but some fluctuations are still present in the later iterations.Next, the comparative result in terms of the spacing metric is given in Figure 7.The arrow points to the local magnification of the change of the spacing metric.It is clear that the spacing metric of the three algorithms converges quickly.The spacing metric of IMOEA/D is the best, followed by MOEA/D.The minimal spacing metric of NSGA-II is comparable to that of MOEA/D, while the convergence process of NSGA-II is not stable.Next, the comparative result in terms of the spacing metric is given in Figure 7.The arrow points to the local magnification of the change of the spacing metric.It is clear that the spacing metric of the three algorithms converges quickly.The spacing metric of IMOEA/D is the best, followed by MOEA/D.The minimal spacing metric of NSGA-II is comparable to that of MOEA/D, while the convergence process of NSGA-II is not stable.Next, the comparative result in terms of the spacing metric is given in Figure 7.The arrow points to the local magnification of the change of the spacing metric.It is clear that the spacing metric of the three algorithms converges quickly.The spacing metric of IMOEA/D is the best, followed by MOEA/D.The minimal spacing metric of NSGA-II is comparable to that of MOEA/D, while the convergence process of NSGA-II is not stable.Finally, the comparative result in terms of the maximum spread metric is given in Figure 8. IMOEA/D has the best spread metric, followed by MOEA/D and NSGA-II.This is mainly due to the fact that IMOEA/D searches for more solutions at both ends of the Pareto front.Therefore, the distribution of solutions obtained by NSGA-II and MOEA/D-I is more centralized and less scalable, as can also be visualized in Figure 4. Finally, the comparative result in terms of the maximum spread metric is given in Figure 8. IMOEA/D has the best spread metric, followed by MOEA/D and NSGA-II.This is mainly due to the fact that IMOEA/D searches for more solutions at both ends of the Pareto front.Therefore, the distribution of solutions obtained by NSGA-II and MOEA/D-I is more centralized and less scalable, as can also be visualized in Figure 4.

Conclusions
This study proposed a customized IMOEA/D for solving a joint optimization of single-machine production scheduling and PM with the objectives of minimizing the makespan and total cost.The main contributions can be summarized as the following two aspects.On the one hand, an adaptive PM strategy was designed for the trade-off between the maintenance time and maintenance cost in order to improve the makespan and total cost to some extent.On the other hand, from the perspective of the algorithm design, an effective decoding strategy as well as the biased-distribution weight vector were introduced to improve the MOEA/D and adapt to the problem characteristics.Numerical studies shows that the developed IMOEA/D outperforms two other mul-

Conclusions
This study proposed a customized IMOEA/D for solving a joint optimization of singlemachine production scheduling and PM with the objectives of minimizing the makespan and total cost.The main contributions can be summarized as the following two aspects.On the one hand, an adaptive PM strategy was designed for the trade-off between the maintenance time and maintenance cost in order to improve the makespan and total cost to some extent.On the other hand, from the perspective of the algorithm design, an effective decoding strategy as well as the biased-distribution weight vector were introduced to improve the MOEA/D and adapt to the problem characteristics.Numerical studies shows that the developed IMOEA/D outperforms two other multi-objective optimization algorithms in terms of the Pareto front, HV metric and maximum spread metric, while the spacing metric of IMOEA/D is slightly worse than that of MOEA/D under some scenarios.
In future research, we will focus on the application of multi-objective integrated optimization of production scheduling and maintenance activities in more complex manufacturing scenarios.Firstly, more realistic constraints should be considered, such as human resources, spatial limitations and time-of-use tariffs.Secondly, more efficient multi-objective evolutionary algorithms need to be developed.The integration of the reinforcement learning algorithm and multi-objective evolutionary algorithms is a potential research trend.Thirdly, how to make decisions with respect to the non-dominated solutions obtained from the Pareto front is also an issue of great interest to decision makers.

Figure 1 .
Figure 1.Mapping relationship between the machine's age and failure probability.

Figure 1 .
Figure 1.Mapping relationship between the machine's age and failure probability.

Figure 2 .
Figure 2. Illustration of the biased-distribution weight vector.

Figure 2 .
Figure 2. Illustration of the biased-distribution weight vector.

( 4 )Algorithm 2
The individual with higher dominance is selected.If two new individuals do not dominate each other, one individual is randomly retained.Then, the reference point is updated.(5) Update the neighbors of each individual by comparing the Chebyshev distance between each neighbor and the reference point with the Chebyshev distance between the corresponding new individual and the reference point.(6) Update the non-dominated solution set based on the new individual.(7) If the number of iterations does not reach the set maximum number of iterations, go to step (3).Pseudo code of the proposed IMOEA/D Input: Maximum number Ω of iterations Output: Non-dominated solution set Γ, i.e., Pareto front 1 Initialize the population with µ individuals and the reference point 2 Initialize the biased-distribution weight vector and the number π of neighbors 3 Let the non-dominated solution set Γ = [] Machines 2023, 11, x FOR PEER REVIEW 11 of 15 solution space.In contrast, MOEA/D algorithms have better search performance in the target space by bootstrapping based on subproblems with the weight vector.IMOEA/D outperforms MOEA/D because MOEA/D uses the uniformly distributed weight vector, which may cause the algorithm to search insufficiently on both sides of the Pareto front to find more non-dominated solutions.This means that IMOEA/D can increase the search on both sides of the Pareto front to improve MOEA/D.The trend of the number of non-dominated solutions on Pareto front with increasing iteration number is shown in Figure 5.This also reflects the excellent performance of IMOEA/D in the search process.

Figure 4 .
Figure 4. Comparison of Pareto front on instance 2.Figure 4. Comparison of Pareto front on instance 2.

Figure 4 .
Figure 4. Comparison of Pareto front on instance 2.Figure 4. Comparison of Pareto front on instance 2.

Figure 4 .
Figure 4. Comparison of Pareto front on instance 2.

Figure 5 .
Figure 5.Comparison of number of non-dominated solutions on instance 2.

Figure 5 .
Figure 5.Comparison of number of non-dominated solutions on instance 2.
Machines 2023, 11, x FOR PEER REVIEW 12 of 15 tions on both sides of the Pareto front.This gain is mainly brought about by the preservation of population diversity during the iteration process.The HV metric of NSGA-II is comparable to that of MOEA/D, but some fluctuations are still present in the later iterations.

Figure 7 .
Figure 7.Comparison of spacing metric on instance 2.Figure 7. Comparison of spacing metric on instance 2.

Figure 7 .
Figure 7.Comparison of spacing metric on instance 2.Figure 7. Comparison of spacing metric on instance 2.

Figure 8 .
Figure 8.Comparison of maximum spread metric on instance 2.

Figure 8 .
Figure 8.Comparison of maximum spread metric on instance 2.

Algorithm 1
Decoding procedure of the studied problem Integrated optimization sequence, makespan, and the total cost 1 Let cumulative time T online since startup be 0 2 Let the number n PM of PMs be 0 3 Let the expectation number n MR of equivalent MR be 0 4 Calculate the PM intervention threshold A for I based on Section 2.2 5 for job in I do 6Obtain the deteriorating processing time ∼P and update the machine's age a 7T online ← T online +

Table 1 .
Basic parameter settings of jobs for instance 2.

Table 2 .
Statistical results of HV metric of three algorithms in all instances.

Table 3 .
Statistical results of spacing metric of three algorithms in all instances.

Table 4 .
Statistical results of maximum spread metric of three algorithms in all instances.