Abstract
In this paper, we consider optimization problems with stochastic constraints. We derive quantitative stability results for the optimal value function, the optimal solution set and the feasible solution set of optimization models in which the underlying stochastic constraints involve the mathematical expectation of random single-valued and set-valued mappings, respectively. New primal sufficient conditions are developed for the uniform error bound property of the stochastic constraint system for the single-valued case.
Keywords:
stochastic generalized equation; quantitative stability; uniform error bound; metric regularity MSC:
90C15; 90C30; 90C33
1. Introduction
Consider the following optimization problem with stochastic constraint (OPSC):
where is a deterministic function, is the direct constraint set for the decision vector , , is a random variable defined on the probability space with support set and probability distribution P, and denotes the expected value with respect to P.
Model (1) can be viewed as an extension of the classic deterministic mathematical programming problem. It is closely related to the distributionally robust optimization model, as well as optimization problems with stochastic dominance constraints, which have received considerable attention over the past decade for their theoretical importance and extensive applications (for more details, please refer to references [1,2,3,4,5,6,7,8,9,10] and the references therein).
The probability distributiton of random variables in traditional stochastic programs is often assumed complete knowledge. However, in many practical applications, it is usually impossible or expensive for us to know the true probability distribution, while we are able to obtain some partial information, such as regarding prior moments, samples of the random variables, or the historical data, and use them to construct an ambiguity set of probability distributions which contain or approximate the true probability distribution (see references [11,12,13,14,15,16,17,18] and the references therein). This motivates us to consider the following perturbed optimization model:
where Q is taken from the ambiguity set for the possible probability distributions of the random vector on some probability space .
It is of great importance to investigate the quantitative stability of OPSC by analyzing the impact of the variation of probability distributions on the optimal value, the optimal solution set and the feasible solution set. To this end, upon utilizing the Ekeland’s Variational Principle, one of the major tasks of this paper is to develop new primal sufficient conditions for the uniform error bound property of the inequality constraint system in (2), which enables us to derive stability estimation for OPSC (2) as Q approximates P under appropriate metrics. The uniform error bound property plays an essential role in the proof of the main results. For more information regarding the error bounds of deterministic systems, please refer to references [19,20] and the references therein.
OPSC (1) can be viewed as a particular case of the following optimization problem constrained by a stochastic generalized equation (OPSGE):
where , and are closed set-valued mappings, and are subsets of and , respectively, is a random vector defined on a probability space with support set and probability distribution P, and denotes the expected value with respect to P, that is,
The expected value of is widely known as Aumann’s integral of the set-valued mapping (for more details, please refer to references [21,22,23]). Indeed, if we set and (for all ), then is single-valued and OPSGE (3) reduces to OPSC (1).
The stochastic generalized equation (SGE) formulation in model (3) is a natural extension of the deterministic generalized equation [24]. It provides a uniform platform for describing the first order optimality/equilibrium conditions of nonsmooth stochastic optimization problems, stochastic equilibrium problems and stochastic games (see references [15,16] and the references therein). In particular, when is single-valued and is a normal cone of a set, SGE in (3) is known as a stochastic variational inequality which has been studied extensively over the past few years (see references [11,18] and the references therein).
Another major objective of this paper is to establish the quantitative stability result for OPSGE (3) by estimating the variation of the feasible solution set and the optimal value function, respectively, as the underlying probability distribution P perturbs from an ambiguity set. The obtained result is a supplement to and extension of the existing ones in the literature and the proof is completely self-contained.
The rest of the paper is structured as follows. Section 2 contains definitions of the basic properties under consideration and some preliminary results used throughout the following sections. In Section 3, we conduct stability analysis for both OPSC (1) and OPSGE (3) under the perturbation of the underlying probability distribution. Estimations for the variation of the optimal value function, the optimal solution set and the feasible solution set of the aforementioned optimization models are obtained.
2. Preliminaries
Throughout this paper, we use the following notations. Let and denote the natural number set and real number set, respectively. Let denote the Euclidean norm in and , for all . The symbol indicates the closed ball of radius centered at . Given subsets , define the distance from to C by
The excess from C to D is defined by
The Pompeiu–Hausdorff distance between C and D is defined as follows:
We use the convention that , , if and , if . Let denote the set of all Borel probability measures on and represent the ambiguity set for possible probability distributions of P.
Let be a set-valued mapping and its domain and graph be denoted, respectively, by
The symbol stands for the inverse mapping of F with for all .
Next, we recall the notions of metric regularity and Lipschitz continuity of set-valued mappings (cf. reference [25]) which will be employed in our study.
Definition 1.
Let and be a set-valued mapping. If there exists such that
then we say that Φ is metrically regular on with constant κ.
Definition 2.
Let and be a set-valued mapping. We say that Φ is Lipschitz continuous on X with constant , if
Let us finish this section by recalling the well-known Ekeland Variational Principle (cf. reference [26]) which plays a fundamental role in the proofs of our main results.
Lemma 1
(Ekeland Variational Principle). Let X be a complete metric space and be a proper lower semicontinuous function. Let and such that
Then, for any there exists such that
- for all .
3. Stability Analysis of Optimization Problems with Stochastic Constraints
In this section, we aim to investigate the variation of the optimal value function, the optimal solution set and the feasible solution set of optimization problem with stochastic constraints, respectively, when the probability measure is perturbed. The obtained results are twofold. We provide stability analysis for both optimization model (2) and model (3), which cover the cases of single-valued and set-valued SGE constraints.
3.1. Stability Analysis of OPSC (2)
Recall that in optimization model (2), we are looking for candidates such that
where is the direct constraint set for the decision vector and Q is a perturbation of the probability distribution P of the random vector .
To characterize the variation of probability measures with respect to OPSC (2), we define the following pseudometric induced by :
where is a set of random functions:
For convenience, let us denote by the feasible solution set of (2), i.e.,
Furthermore, let and denote the optimal solution set and the optimal value of model (2), respectively.
Definition 3.
We say that system (6) has a uniform error bound with respect to the constraint set X and the ambiguity set , if there exists such that
To start with, we establish the following sufficient condition for the uniform error bound property of constraint system (6) by utilizing the Ekeland’s Variational Principle, which will be beneficial for the proof of our main results.
Proposition 1.
Suppose that the mapping is lower semicontinuous for any . Let be such that, for any and with , there exists , satisfying
Then, we have and
Consequently, system (6) has a uniform error bound with respect to X and .
Proof.
Note that is lower semicontinuous; it follows from reference [27], (Theorem 7.42) that for any , the mapping is also lower semicontinuous. Using (8), we know that for any and with , there exists such that
For any , we claim that . Indeed, if this is not the case, we have
To proceed, we pick a sequence such that
Applying Lemma 1 to the function , we are able to find a sequence such that and
This is a contradiction to (10) and (11). Therefore, , and hence .
Now we are ready to show that (9) holds. To this end, assume, to the contrary, that there exists such that
Then, , which indicates that . Let be close enough to such that
Applying Lemma 1 to the function again, we obtain such that and
Together with (10), we conclude that , and then , which is a contradiction to the fact that
Hence, (9) holds true. □
Without the semicontinuity assumption, we next provide a different primal condition to ensure the uniform error bound property of the system (6).
Proposition 2.
Let and be constants. Suppose that for each and , there exists such that
and
Then, we conclude that (9) holds.
Proof.
To show the validity of (9), we fix any and . If , then (9) holds automatically, hence we may assume that . Let , and suppose that are selected from X such that
If , we set . Otherwise, by inequalities (13) and (14), there exists such that
and
Hence, inductively we obtain a sequence such that and
Therefore,
To proceed, we divide our proof into two cases. (i) Suppose that there exist elements of the sequence which are contained in . For convenience, we set the first term as . Then for all and . Hence,
This shows that (9) holds. (ii) Assume that for all . Then, we have , for any . Note that ; it follows from inequality (15) that
Then,
Letting , we conclude that (9) holds, which completes the proof. □
With the help of the uniform error bound property established in Proposition 1, we obtain the Lipschitz continuity of the feasible solution set as follows when the probability measure varies.
Theorem 1.
Assume that the conditions in Proposition 1 hold. Then,
Proof.
Now we are ready to state the first main result of this section. To this end, we define the growth function of problem (1) by , i.e.,
Its inverse function is , for any . For convenience, let .
By virtue of Theorem 1, we can finally deduce the quantitative stability results with respect to the optimal value function and the optimal solution set of the optimization model (2) when the probability measure is perturbed.
Theorem 2.
Assume that the conditions in Proposition 1 hold. Let X be a bounded subset of and f be Lipschitz continuous on X with constant . Then, we have the following inequalities:
and
Proof.
According to the assumptions, it follows from Proposition 1 that, for any , is a closed subset of X. Then, is compact. It follows from the continuity of f that . To show the first inequality, we pick and . It follows from Theorem 1 that we can choose such that
Then, we have the following estimation:
Since Q and are arbitarily chosen and the general metric is symmetric, we also have . Therefore, (17) holds.
For the second inequality, we pick arbitary and . using Theorem 1, we are able to select such that . Then, we have
Therefore, . By the triangle inequality, we arrive at
Since x is arbitarily chosen from , we conclude that inequality (18) holds. □
Remark 1.
In Theorems 1 and 2, the stability results for the optimization model (2) are obtained under the primal condition (8) which ensures the uniform error bound property of the constraint system (6). It is a supplement to the Slater condition which was imposed for the stability analysis of the distributionally robust model obtained in reference [2] (Theorems 4.3 and 4.4).
3.2. Stability Analysis of OPSGE (3)
In this section, we consider optimization model (3) with a set-valued schochastic generalized equation constraint of the following form:
where is a perturbation of the probability distribution P, and are closed set-valued mappings, , , is a random vector defined on a probability space with support set and probability distribution P.
For convenience, we denote by the feasible solution set of (3), i.e.,
Furthermore, let and denote the optimal solution set and the optimal value of model (3), respectively.
To establish quantitative stability results for OPSGE (3) as the probability distribution perturbs, we need to define the following distance for probability measures induced by :
where consists of all functions generated by the support function over the set , i.e.,
It is well acknowledged that is not a metric unless the set is enriched. Furthermore, is not symmetric (for more details, please refer to reference [28] and the references therein).
Theorem 3.
Let , , be defined as in (20) and be defined as in (21) with . Assume that satisfies . Suppose that the following conditions hold:
- (i)
- and are compact subsets of and , respectively;
- (ii)
- Γ takes convex set values in and is upper semicontinuous with respect to x for every . Furthermore, Γ is bounded by a P-integrable function for ;
- (iii)
- is metrically regular on with constant κ;
- (iv)
- is Lipschitz continuous on X with constant ι.
Then, the feasible solution set is closed and we have the following estimate for the variation of the feasible sets with constant :
Proof.
For any and any sequence with , since is closed, upper semicontinuous and integrably bounded, it follows from reference [29] (Theorem 2.8) that
Therefore, the mapping is closed. Pick any and any sequence with , we have , then there exists such that and (for each ). Since is compact, without loss of generality, we may assume that . Through this and the closedness of and , one has and . Then, , i.e., . Hence, the feasible solution set is closed.
From assumptions (i) and (ii), it is easy to observe that takes convex and compact set values in . Then, it follows from Lemma 2.5 that, for all and ,
According to reference [30], Proposition 3.4, we have
Then, it follows from the definition of that
By assumptions (iii) and (iv), one has
and
Since , it follows from (25) that
and from (26) that
Let be sufficient small such that
To show that (23) holds, we pick any with and let it be fixed, then it suffices to show that
Let , i.e., and . Then, there exists such that and . It follows from (24), (25) and (27) that, there exists such that
If , then , and then . This shows that (30) holds automatically. Let , then . According to (26) and (28), there exists such that
By induction, we construct sequences of points and such that, for ,
with
According to (32), we see that and satisfy (33) and (34) with . Suppose that for some , we have generated and such that (33) and (34) hold. Our goal is to show that there exist and which satisfy (33) and (34). If , we set and . Otherwise, since , it follows from (25) and (27) that there exists such that
Then, by invoking the induction hypothesis (34), we have . And then,
If , we set . If , note that , according to (28) there exists such that
This completes the induction step, and hence (33) and (34) hold true for all .
By virtue of the inequalities for and in (34), we observe that for any positive integers m and n, we have
and
which indicates that both sequences and are Cauchy sequences. Note that and , since and are closed, then there exists such that , and then . This shows that . Utilizing (31) and (34), we finally obtain that
Taking the limit as gives us (30), which completes the proof. □
Remark 2.
In reference [28], the authors provided qualitative stability analysis for feasible solution mapping under a metric regularity assumption on the set-valued mapping . In contrast, Theorem 3 imposes metric regularity on the mapping and Lipschitz continuity on , which does not necessarily guarantee the metric regularity of the mapping . Furthermore, the proof of Theorem 3 is completely self-contained. Hence, Theorem 3 is a supplement to the results in reference [28] (Theorem 3.1 (iii)). In reference [31], the authors focus on the case when the mapping Γ is single-valued and obtained similar stability results. Therefore, Theorem 3 also extends the results in reference [31] (Theorem 8).
With the help of Theorem 3, we are able to deduce the following quantitative stability results regarding the optimal value function.
Theorem 4.
Under the assumptions of Theorem 3, assume that f is Lipschitz continuous on with constant . Then, the optimal solution mapping of model (3) is compact valued, , and
Proof.
It is shown in Theorem 3 that the feasible solution set of model (3) is closed. Since is compact, we know that is compact for all . Due to the continuity of f, we have , for all , hence . Let and with , one has
which indicates that . Taking into account of the fact that is compact, we ascertain that is compact valued.
4. Conclusions
The main contribution of this paper contains two parts. Firstly, we establish a new primal sufficient condition for the uniform error bound property of a constraint system (6) by utilizing the Ekeland’s Variational Principle. Based on that, we then study the quantitative stability for OPSC (2) and OPSGE (3), respectively, by estimating the variation of the optimal value function, the optimal solution set and the feasible solution set of the aforementioned optimization models when the underlying probability distribution perturbs. The obtained results are new, and they are supplementary to and extensions of the existing ones in the literature. The proof is completely self-contained.
Author Contributions
Conceptualization, W.O.; writing—original draft preparation, W.O. and K.M. All authors have read and agreed to the published version of the manuscript.
Funding
This research was funded by the National Natural Science Foundation of China, grant number 11801500 and the Basic Research Program of Yunnan Province, grant number 202301AT070080.
Data Availability Statement
Not applicable.
Conflicts of Interest
The authors declare no conflict of interest.
References
- Claus, M.; Schultz, R. Lipschitzian properties and stability of a class of first-order stochastic dominance constraints. SIAM J. Optim. 2015, 25, 396–415. [Google Scholar] [CrossRef]
- Chen, Z.; Jiang, J. Stability analysis of optimization problems with kth order stochastic and distributionally robust dominance constraints induced by full random recourse. SIAM J. Optim. 2018, 28, 1396–1419. [Google Scholar] [CrossRef]
- Dentcheva, D.; Ruszczyński, A. Optimization with stochastic dominance constraints. SIAM J. Optim. 2003, 14, 548–566. [Google Scholar] [CrossRef]
- Dentcheva, D.; Ruszczyński, A. Robust stochastic dominance and its application to riskaverse optimization. Math. Program. 2010, 123, 85–100. [Google Scholar] [CrossRef]
- Guo, S.; Xu, H.; Zhang, L. Convergence analysis for mathematical programs with distributionally robust chance constraint. SIAM J. Optim. 2017, 27, 784–816. [Google Scholar] [CrossRef]
- Hadar, J.; Russell, W.R. Rules for ordering uncertain prospects. Am. Econ. Rev. 1969, 59, 25–34. [Google Scholar]
- Pflug, G.C.; Pichler, A. Approximations for probability distributions and stochastic optimization problems. In Stochastic Optimization Methods in Finance and Energy; International Series in Operations Research & Management Science; Springer: New York, NY, USA, 2011; Volume 163, pp. 343–387. [Google Scholar]
- Wang, C.; Song, Y.; Zhang, F.; Zhao, Y. Exponential stability of a class of neutral inertial neural networks with multi-proportional delays and leakage delays. Mathematics 2023, 11, 2596. [Google Scholar] [CrossRef]
- Xue, Y.; Han, J.; Tu, Z.; Chen, X. Stability analysis and design of cooperative control for linear delta operator system. AIMS Math. 2023, 8, 12671–12693. [Google Scholar] [CrossRef]
- Zhao, Y.; Wang, L. Practical exponential stability of impulsive stochastic food chain system with time-varying delays. Mathematics 2023, 11, 147. [Google Scholar] [CrossRef]
- Chen, X.; Fukushima, M. Expected residual minimization method for stochastic linear complementarity Problems. Math. Oper. Res. 2005, 30, 1022–1038. [Google Scholar] [CrossRef]
- Jia, Z.; Li, C. Almost sure exponential stability of uncertain stochastic Hopfield neural networks based on subadditive measures. Mathematics 2023, 11, 3110. [Google Scholar] [CrossRef]
- Li, G.D.; Zhang, Y.; Guan, Y.J.; Li, W.J. Stability analysis of multi-point boundary conditions for fractional differential equation with non-instantaneous integral impulse. Math. Biosci. Eng. 2023, 20, 7020–7041. [Google Scholar] [CrossRef] [PubMed]
- Ma, Z.; Yuan, S.; Meng, K.; Mei, S. Mean-square stability of uncertain delayed stochastic systems driven by G-Brownian motion. Mathematics 2023, 11, 2405. [Google Scholar] [CrossRef]
- Ralph, D.; Xu, H. Asympototic analysis of stationary points of sample average two stage stochastic programs: A generalized equations approach. Math. Oper. Res. 2011, 36, 568–592. [Google Scholar] [CrossRef]
- Ravat, U.; Shanbhag, U.V. On the characterization of solution sets of smooth and nonsmooth convex stochastic Nash games. SIAM J. Optim. 2011, 21, 1168–1199. [Google Scholar] [CrossRef]
- Xia, M.; Liu, L.; Fang, J.; Zhang, Y. Stability analysis for a class of stochastic differential equations with impulses. Mathematics 2023, 11, 1541. [Google Scholar] [CrossRef]
- Xu, H. Sample average approximation methods for a class of stochastic variational inequality problems. Asian-Pac. J. Oper. Res. 2010, 27, 103–119. [Google Scholar] [CrossRef]
- Ng, K.F.; Zheng, X.Y. Global weak sharp minima on Banach spaces. SIAM J. Control Optim. 2003, 41, 1868–1885. [Google Scholar] [CrossRef]
- Wu, Z.; Ye, J.J. Sufficient conditions for error bounds. SIAM J. Optim. 2001, 12, 421–435. [Google Scholar] [CrossRef]
- Aubin, J.-P.; Frankowska, H. Set-Valued Analysis; Birkhauser: Boston, MA, USA, 1990. [Google Scholar]
- Aumann, R.J. Integrals of set-valued functions. J. Math. Anal. Appl. 1965, 12, 1–12. [Google Scholar] [CrossRef]
- Hess, C. Set-valued integration and set-valued probability theory: An overview. In Handbook of Measure Theory; E. PAP: Amsterdan, The Netherlands, 2002; pp. 617–673. [Google Scholar]
- Robinson, S.M. Generalized Equations, Mathematical Programming the State of the Art: Bonn 1982; Springer: Berlin/Heidelberg, Germany, 1983; pp. 346–367. [Google Scholar]
- Dontchev, A.L.; Rockafellar, R.T. Implicit Functions and Solution Mappings; Springer: Berlin/Heidelberg, Germany, 2009. [Google Scholar]
- Ekeland, I. On the variational principle. J. Math. Anal. Appl. 1974, 47, 324–353. [Google Scholar] [CrossRef]
- Shapiro, A.; Dentcheva, D.; Ruszczyński, A. Lectures on Stochastic Programming: Modeling and Theory, 2nd ed.; MOS-SIAM Ser. Optim. 16; SIAM: Philadelphia, PA, USA, 2014. [Google Scholar]
- Liu, Y.; Römisch, W.; Xu, H. Quantitative stability analysis of stochastic generalized equations. SIAM J. Optim. 2014, 24, 467–497. [Google Scholar] [CrossRef][Green Version]
- Hiai, F. Convergence of conditional expectations and strong laws of large numbers for multivalued random variables. Trans. Am. Math. Soc. 1985, 291, 603–627. [Google Scholar] [CrossRef]
- Papageorgiou, N. On the theory of Banach space valued multifunctions. 1. Integration and conditional expectation. J. Multivar. Anal. 1985, 17, 185–206. [Google Scholar] [CrossRef]
- Liu, Q.; Zhang, J.; Lin, S.; Zhang, L.W. Stability analysis of stochastic generalized equation via Brouwer’s fixed point theorem. Math. Probl. Eng. 2018, 2018, 8680540. [Google Scholar] [CrossRef]
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2023 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).