Abstract
The multiple criteria and multiple constraint level (MC) model is a useful tool to deal with the decision programming problems, which concern multiple decision makers and uncertain resource constraint levels. In this paper, by regarding the nonlinear MC problems as a class of mixed implicit variational inequalities, we develop an iterative algorithm to solve the nonlinear MC problems through the resolvent operator technique. The convergence of the generated iterative sequence is analyzed and discussed by a calculation example, and the stability of Algorithm 1 is also verified by error propagation. By comparing with two other MC-algorithms, Algorithm 1 performs well in terms of number of iterations and computation complexity.
1. Introduction
In practical applications, the problem involving multi criteria decision-making has become a research hotspot. The design choices based on multi-criteria data acquisition schemes to determine the specific parameters of the attack were discussed, and a new attack type was proposed in [1]. The optimal mapping of hybrid energy systems based on wind and PV (photovoltaic system) was presented by [2]. In addition, the mixed energy system was also obtained by using HOMER (Hybrid Optimization Model for Multiple Energy Resources) software (National Renewable Energy Laboratory (NREL), CO, Boulder, USA) and the TOPSIS multi criteria algorithm. In [3], a nonlinear programming (NP) model based on the technique for order preference by similarity to ideal solution (TOPSIS) was developed to solve decision-making problems. Suzdaltsev et al. [4] developed the genetic, ant colony and bee algorithms for solving the printed circuit board (PCB) design multi criteria optimization problems.
As an extension of linear programming (LP), the multi criteria and multi constraint level linear programming (MCLP) is a useful tool to handle the decision problems with multiple decision makers and multiple resource constraint levels [5], which can be seen in many economic situations [6]. The concept of MCLP is attractive to practitioners and has been widely applied in many fields such as transportation [7], data mining [8,9], finance [10], telecommunication management [11], management information systems [12,13], and production planning [14,15]. Specifically, the MC branch-and-partition algorithm and the MC branch-and-bound algorithm were presented to solve MC integer linear programs in [16]. Chen et al. [17] illustrated that MC-simplex method was generated by the remarkable LP simplex method, and MC-interior point method was driven by MC-interior point method, as well as introduced the current status and application areas of MCLP. A new MCLP model was proposed based on the structure of MCLP to correct two types of errors in [18]. Nonlinear programming as an important branch of operations research is a mathematical programming with nonlinear constraints or objective functions, which is explained in a mathematical terms, that is,
where each is a mapping from to . Traditional methods for solving nonlinear programming include the steepest descent algorithm, Newton method, feasible direction method, function approximation method and trust region method. Aside from those methods, the enhanced Lagrange method is to solve the problem by replacing the original constraint problem with a series of unconstrained sub-problems, [19] proposed an algorithm for the infeasible constrained nonlinear programming problem based on the large-scale augmented Lagrangian function, and analyzed the global convergence considering the possibility of not being feasible. Sequential quadratic programming (SQP) generates steps by solving quadratic subproblems, which can be applied to small and large problems, as well as problems with important nonlinearity [20]. Algorithms for feasible SQP (Sequential Quadratic Programming) were designed by Craig and André [21] to solve optimization problems with nonlinear constraints. In [22], the original problem was reduced to a bounded-constrained nonlinear optimization problem, with reduced gradient algorithms instead of the penalty method. Regardless of the maturity of MCLP theory and the further study of general nonlinear programming problems, we should notice that there is not yet very much progress in the research of nonlinear MC models. In this paper, we will introduce a novel method for MCNLP problems.
It is well known that the variational inequality theory is a very powerful tool to study the problems arising in nonlinear programming. Mathematical conditions, including a constraint qualification and convexity of the feasible set were shown by Toyasaki et al. [23], which allowed for characterizing the economic problem by using a variational inequality formulation. An iterative algorithm was suggested by the resolvent operator technique to compute approximate solutions of the system of nonlinear set valued variational inclusion [24]. The affine variational inequality problems and the polynomial complementary problems were discussed in [25]; here, it is the extension of the results in [24]. Then, the authors applied their results to discuss the existence of the solutions of weakly homogeneous nonlinear equations, the domains of which are closed convex cones. Motivated and inspired by [26,27], the purpose of this paper is to develop a new iterative algorithm for MCNLP problems by employing the theory of variational inequalities and the resolvent operator technique. Considering the accuracy of solution for MCNLP problems, the convergence and stability of the new algorithm are discussed in this paper. The result of this paper is the generalization of Theorem 2A.8 (Lagrange multiplier rule) in [28].
2. Preliminaries
The MCLP model could be formulated in the following form
where is the decision vector and is the criteria matrix. is the vector of weight parameters. is the resource consumption matrix and stands for the multiple resource availability levels. Each column of D indicates a constraint level. The constraint “” denotes that x is feasible if is contained in the convex set generated by the column vectors of D, and we always denote by D in the following content. Then, this model could be simply extended to the nonlinear case:
where is a nonlinear function and is a nonlinear mapping. As D is a nonempty, closed and convex set, if both f and g are continuously differentiable, there exists the Lagrange multiplier rule the problem (1), which is listed in the book of Dontchev and Rockafellar [28].
Theorem 1.
Let the following constraint qualification condition be fulfilled: for a given , there is no , such that . If f has a local minimum relative to C, then there exists such that
Here, is the gradient of g at x, and is the normal cone to D.
Remark 1.
We should notice that the condition above is necessary and the differentiability assumptions on f and g are not always satisfied, so the Lagrange multiplier rule may not always hold. Thus we need some more generalized method.
First, we should notice that problem (1) is a special case of the following problem when f is differentiable: finding the solution of the inequality such that
which means that any v in the feasible set is always “in the front direction of” u (in the direction that makes the value of f increase). Here, is the scalar product.
Then, let be a continuous linear operator (such as the gradient or the Gateaux derivative of f: , etc.) and be a single-valued mapping. We can see that problem (1) is generalized to the implicit variational inequality problem: for the given , find such that
Here, we can transform problem (2) to a more general case as finding such that
where denotes the subdifferential of . If , where denotes the indicator function of a nonempty closed convex set D, then problem (3) is equivalent to problem (2).
Definition 1.
A mapping is said to be Lipschitz continuous if there exists a constant such that
Definition 2.
A mapping is said to be monotone if
Definition 3.
Let be a proper convex lower semicontinuous function. For some constant , the resolvent operator is defined by
By the definition of , means that . Combining with the definition of subdifferential , we can see , then we have the following lemma.
Lemma 1.
For a given and a point [29] , if and only if
3. Main Results
In this section, an iterative algorithm for problem (3) will be presented, and the related properties will be discussed.
Let be a constant, a single-valued mapping, and a proper monotone convex lower semicontinuous function. Suppose is a monotone and continuous mapping, and each component of g is monotone continuous convex function. Therefore, the compound function is also proper convex lower semicontinuous.
Set
Then, we have the following proposition.
Proposition 1.
Proof of Proposition 1.
If , then
By Lemma 1, for any ,
Thus, the sufficiency is proved. From the above routine, the necessity is obvious. □
We can give the algorithm for problem (3) as follows:
Algorithm 1.
For any , define the iterative sequence as
To verify the convergence of in Algorithm 1, we first introduce the following lemma.
Lemma 2.
Let T, φ and g satisfy the conditions presented at the beginning of this section. Moreover, suppose that T is monotone; then, for any solution of problem (3), the following inequality holds:
Proof of Lemma 2.
Let be the solution of problem (3); then, for any
Moreover, by Lemma 1, we have ,
that is,
By the monotonicity of T, we also have
By Lemma 2, we can get the following convergence theorem.
Theorem 2.
Let be a monotone and Lipschitz continuous mapping with the Lipschitz constant and be the iterative sequence generated by Algorithm 1; then, for the solution of problem (3), the following inequality holds:
Proof of Theorem 2.
It follows from Algorithm 1 that
Since T is monotone and Lipschitz continuous,
When and , we know that is bounded and , which means that converges to a solution of problem (3). Thus, we get the corollary of Theorem 2.
Corollary 1.
Let be a monotone and Lipschitz continuous mapping with the Lipschitz constant and be the iterative sequence generated by Algorithm 1. When , the iterative sequence generated by Algorithm 1 converges to a solution of problem (3).
To verify the above results, next we will construct a simple example.
Example 1.
Let be a dimension variable, , , , ⋯, and , thus , which satisfy all the conditions of Theorem 2. Here, one can easily see that the minima of f is . Then, we will use Algorithm 1to construct a convergent sequence.
Let T be the operator , then , which is Lipschitzian and the Lipschitz constant . For some given ρ, we can see that
thus
Then, by the algorithm, we have that
Thus, the sequence is constructed as
When , the sequence is always convergent to the minima of f. The smaller ρ is, the higher convergence speed will be. By the condition , we can find the smallest ρ to get the highest speed of the algorithm.
Remark 2.
Then, we consider the stability of Algorithm 1.
Theorem 3.
Let be a monotone and Lipschitz continuous mapping with the Lipschitz constant and be the iterative sequence generated by Algorithm 1 for problem
(3), the stability of Algorithm 1 can be guaranteed.
Proof of Theorem 3.
We first prove that the compound resolvent operator is Lipschitz continuous. Let be any given points in ; it follows from Definition 3 that
which implies that
Then,
It follows that
so
Let be the iteration value and be the accurate value. Then, we have
Supposing that is the error between the iteration value and the exact value of the kth iteration, there holds
From Equation (4), we have
Here,
so
According to (12) and (17), we can get
When and , we know that the effect of error on the latter is attenuated, thus the stability of Algorithm 1 is guaranteed. □
4. Application and Comparison
It is well known that linear problems can be seen as special cases of nonlinear problems, so the following application of the oilfield production distribution optimization can be showed based on our results.
The historical data of eight sub-measures and the corresponding influencing factors of a oilfield which were in the mid-later stage from 2000 to 2006 are presented in Table 1. These historical data reflect to some extent the law of dynamic change of its development [30].
Table 1.
The historical data.
The measure cost per unit of output and the coefficient of resource consumption per unit of output in the planning year are as follows:
Suppose that the forecast annual oil price here is , the measure cost per unit of output (Table 2) and the resource consumption coefficient per unit of output (Table 3) in the planning year can be calculated from Table 1 and Formulas (14) and (15).
Table 2.
Objective coefficient (yuan/t).
Table 3.
Unit resource consumption coefficient (yuan/t).
According to the overall historical oil production, investment and workload from 2000 to 2006, as well as the country’s demand for crude oil and the technical level of oilfields, the group headquarters and the oilfield branch determined the resource constraint levels for 2007 in Table 4.
Table 4.
Resource constraint levels yuan.
Here, represents the corresponding constraints as high-level constraints; represents the corresponding constraints as low-level constraints. The new model of the output distribution of the oilfield in 2007 is
Here,
The corresponding relaxation form of this problem is
Here, .
By Algorithm 1, we have
Here, we set , to make problem (18) easier to solve. Then,
Take and , the measure production and the total production in planning year can be calculated with Formulas (18)–(20). Table 5 shows the results of measure production and total production, and Figure 1 shows the convergence of the solution for each measure.
Table 5.
Result of measure production and total production ( t).
Figure 1.
Convergence result of Algorithm 1.
By comparing with -simplex method and -interior point method, some differences can be found in number of iterations and computation complexity.
Table 6 has shown that the computation complexity of the three algorithms differs slightly in this problem. This is because the decision variables, objective functions and constraint levels involved in this problem are relatively small. However, for large-scale problems, the obvious differences in number of iterations and computation complexity could be discovered. Although the number of iterations of Algorithm 1 and -simplex method are the same, we still believe that our method would be efficient if the model turns to a nonlinear case.
Table 6.
Comparison study of the speed of three algorithms.
5. Conclusions
This paper proposed Algorithm 1 for MCNLP problems, and its novelty lies in the application of the theory of variational inequalities and the resolvent operator technique. The convergence of the generated iterative sequence was analyzed by Example 1, and the stability of Algorithm 1 was also verified by error propagation. During the considering and discussion, we found that Lipschitz constant l and the parameter are important factors for Algorithm 1 to maintain convergence and stability. In Section 4, Algorithm 1 was utilized to solve the application problem (17); the comparison with two other algorithms showed that this method performs efficiently for the nonlinear problems.
The multi objective multi criteria programming is an important research topic in operations research and management science, not only because of the multi criteria and multi constraint level nature of most real-world decision problems, but also because there are still many open questions in this area. Algorithm 1 as a new tool to solve multi criteria and multi objective problems in decision systems provides algorithm support for decision makers; the basic structural ideas of this algorithm can be extended to practical linear and nonlinear problems in the future, such as project evaluation, program decision-making, engineering, industrial sector development sequencing and rational allocation of resources, etc., so as to consume fewer resources. In addition, the algorithm proposed will be improved in actual application.
Author Contributions
Conceptualization, C.M.; Writing—original draft, C.M.; Methodology, C.M.; Writing—review and editing, F.F.; Validation, F.F.; Formal analysis, Z.Y. and X.L.
Funding
This paper is supported by the National Natural Science Foundation of China (11526173, 11601451) and the scientific research starting project of Southwest Petroleum University (2015QHZ028).
Conflicts of Interest
The authors declare no conflict of interest.
References
- Murat, T.A.; Alper, B. Robustness analysis of multi-criteria collaborative filtering algorithms against shilling attacks. Expert Syst. Appl. 2018, 115, 386–402. [Google Scholar]
- Diemuodeke, E.O.; Addo, A.; Oko, C.O.; Mulugetta, Y.; Ojapah, M.M. Optimal mapping of hybrid renewable energy systems for locations using multi-criteria decision-making algorithm. Renew. Energy 2019, 134, 461–477. [Google Scholar] [CrossRef] [Scilit]
- Garg, H.; Nancy. Non-linear programming method for multi-criteria decision making problems under interval neutrosophic set environment. Appl. Intell. 2017, 48, 2199–2213. [Google Scholar] [CrossRef] [Scilit]
- Suzdaltsev, I.V.; Chermoshentsev, S.F.; Bogula, N.Y. Bionic algorithms for multi-criteria design of electronic equipment printed circuit board. IEEE Int. Conf. SCM 2017, 394–396. [Google Scholar] [CrossRef] [Scilit]
- Yong, S. MC2 Linear Programming. In Multiple Criteria Multiple Constraint-Level, Linear Programming: Concepts, Techniques and Applications; World Scientific Publishing Co Pte Ltd.: Singapore, 2001; pp. 68–91. [Google Scholar]
- Seiford, L.; Yu, P.L. Potential solutions of linear systems: The multi-criteria multiple constraint levels program. J. Math. Anal. Appl. 1979, 6, 283–303. [Google Scholar] [CrossRef] [Scilit]
- Shi, Y. A Transportation Model with Multiple Criteria and Multiple Constraint Levels. Math. Comput. Model. 1995, 21, 13–28. [Google Scholar] [CrossRef] [Scilit]
- Shi, Y.; Wise, M.; Luo, M.; Lin, Y. Data mining in Credit Card Portfolio management: A multiple criteria decision making approach. In Multiple Criteria Decision Making in the New Millennium; Köksalan, M., Zionts, S., Eds.; Springer: Berlin, Germany, 2001; pp. 420–436. [Google Scholar]
- Li, G.Y.; Tang, X.M.; Zhang, C.Y.; Gao, X. Multi-criteria constraint algorithm for selecting ICESat/GLAS data as elevation control points. J. Remote Sens. 2017, 21, 96–104. [Google Scholar]
- Kwak, W.; Shi, Y.; Eldridge, S.W.; Kou, G. Bankruptcy prediction for Japanese firms: using Multiple Criteria Linear Programming data mining approach. Adv. Inv. Anal. Portf. Manag. 2006, 1, 27–49. [Google Scholar] [CrossRef] [Scilit]
- Zhang, J.L.; Shi, Y.; Zhang, P. Several Multi-criteria Programming Methods for Classification. Comput. Oper. Res. 2009, 36, 823–836. [Google Scholar] [CrossRef] [Scilit]
- Bellare, M.; Namprempre, C.; Neven, G. Lecture Notes in Computer Science. J. Cryptol. 2004, 22, 1–61. [Google Scholar] [CrossRef] [Scilit]
- Costa Batista, A.; Batista, L.S. Demand Side Management Using a Multi-Criteria ϵ-Constraint based Exact Approach. Expert Syst. Appl. 2018, 99, 180–192. [Google Scholar] [CrossRef] [Scilit]
- Kou, G.; Peng, Y.; Zhang, C.; Shi, Y. Multiple Criteria Mathematical Programming for Multi-class Classification and Application in Network Intrusion Detection. Inf. Sci. 2009, 179, 371–381. [Google Scholar] [CrossRef] [Scilit]
- Meghwani, S.S.; Thakur, M. Multi-criteria algorithms for portfolio optimization under practical constraints. Swarm Evol. Comput. 2017, 37, 104–125. [Google Scholar] [CrossRef] [Scilit]
- Shi, Y.; He, J.; Wang, L.; Fan, W. Computer-based algorithms for multiple criteria and multiple constraint level integer linear programming. Comput. Math. Appl. 2005, 49, 903–921. [Google Scholar] [CrossRef] [Scilit]
- Chen, D.; Zhong, Y.; Liao, Y.; Li, L. Review of Multiple Criteria and Multiple Constraint-level Linear Programming. Procedia Comput. Sci. 2013, 17, 158–165. [Google Scholar] [CrossRef] [Scilit]
- Wang, B.; Wang, Y. A Multiple-Criteria and Multiple-Constraint Levels Linear Programming Based Error Correction Classification Model. Procedia Comput. Sci. 2013, 17, 1073–1082. [Google Scholar] [CrossRef] [Scilit]
- Gono̧calves, M.L.N.; Melo, J.G. Augmented Lagrangian methods for nonlinear programming with possible infeasibility. J. Glob. Optim. 2015, 63, 297–318. [Google Scholar]
- Philip, E.G.; Elizabeth, W. Sequential Quadratic Programming Methods. In Mixed Integer Nonlinear Programming; Jon, L., Sven, L., Eds.; Springer: New York, NY, USA, 2012; pp. 147–225. [Google Scholar]
- Craig, T.L.; André, L.T. Nonlinear equality constraints in feasible sequential quadratic programming. Optim. Methods Softw. 2007, 6, 262–285. [Google Scholar]
- Lasdon, L.S.; Fox, R.L.; Ratner, M.W. Nonlinear optimization using the generalized reduced gradient method. Revue Française D’Automatique Informatique Recherche Opé-Rationnelle Recherche Opérationnelle 1974, 8, 73–103. [Google Scholar] [CrossRef] [Scilit]
- Toyasaki, F.; Daniele, P.; Wakolbinger, T. A variational inequality formulation of equilibrium models for end-of-life products with nonlinear constraints. Eur. J. Oper. Res. 2014, 236, 340–350. [Google Scholar] [CrossRef] [Scilit]
- Tang, Y.K.; Chang, S.S.; Salahuddin, S. A system of nonlinear set valued variational inclusions. SpringerPlus 2014, 3, 1–10. [Google Scholar] [CrossRef] [Scilit]
- Gowda, M.S.; Sossa, D. Weakly homogeneous variational inequalities and solvability of nonlinear equations over cones. Math. Program. 2018, 1–23. [Google Scholar] [CrossRef] [Scilit]
- He, B.S. A class of projection and contraction methods for monotone variational inequalities. Appl. Math. Optim. 1997, 35, 69–76. [Google Scholar] [CrossRef] [Scilit]
- Huang, N.J.; Fang, Y.P. A New Iterative Algorithm for a Class of Nonlinear Mixed Implicit Variational Inequalities. Appl. Math. Lett. 2003, 16, 507–511. [Google Scholar] [CrossRef] [Scilit]
- Dontchev, A.L.; Rockafellar, R.T. Solution Mappings for Variational Problems; Set-Valued Analysis of Solution Mappings. In Implicit Functions and Solution Mappings; Thomas, V.M., Sidney, I.R., Eds.; Springer: New York, NY, USA, 2009; pp. 69–212. [Google Scholar]
- Webb, J.R.L. Operateurs Maximaux Monotones et Semi-groups de Contractions dans les Espaces de Hilbert. B Lond. Math. Soc. 1974, 6, 221–222. [Google Scholar] [CrossRef] [Scilit]
- Zhong, Y.H.; Zhao, L.; Zhang, G.L. The oilfield measure structure optimization model of the multi criteria and multi constraint levels and its application. J. Oil. Gas Technol. 2008, 30, 124–128. [Google Scholar]
© 2019 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).
