Abstract
In this paper, we introduce a new three-step iterative scheme for finding the common solutions of the variational inequality using the technique of updating the solution. We suggest, iterative algorithms involving three-steps for the predictor-corrector method of variational inequality in real Hilbert spaces H. Our results include the Takahashi and Toyoda, extra gradient, Mann and Noor iterations as special cases. We also investigate the convergence criteria of the three-step iterative scheme. As special cases, the earlier findings are included in our results, which can be seen as an advancement and improvement over the previous investigation. This is a new refinement in our existing literature and previously known algorithms. A numerical example is given to illustrate the efficiency and performance of the proposed self-adaptive scheme.
Keywords:
variational inequalities; iterative methods; Hilbert spaces; fixed-point problem; three-step iteration methods; convergence criteria; numerical results MSC:
26A33; 26A51; 26D10
1. Introduction
Making decisions is greatly impacted by uncertainty. It appears that as we get more connected, we uncover more sources of uncertainty. For instance, the price and cost functions for electricity are unpredictable, and transportation, communication, and financial systems have been caused by how these systems function and the way they interact with one another. This raises a number of intriguing issues related to modeling uncertainty and making decisions in the face of ambiguity. Variational principles have practical importance in a variety of industries and commercial situations due to their natural modeling capability for numerous real-world applications. Variational principles provide a framework for optimization, where the target is to get the optimum solution or approximation for a set of possibilities. For more than two centuries, this has been the main area of mathematics, particularly in engineering sciences. Newton, Fermat, Leibniz, Bernoulli, and Lagrange are credited with developing the variational principles, see [1].
Variational inequalities theory is an important and well-established field, representing an enrichment of variational principles. The Variational Inequality Problem (VIP) encompasses several well-known mathematical issues, such as optimization problems, complementarity problems, and fixed-point problems. As a result, the VIP offers a methodological framework for studying various equilibrium issues in engineering and economics. Consequently, it is possible to consider the theory of VIPs as a methodology that facilitates the modeling, analysis, and computations for a variety of real-world applications.
Hartman and Stampacchia first developed variational inequalities in 1966 [2] as a tool for studying partial differential equations, particularly in mechanics, and defined within infinite-dimensional fields.
The finite-dimensional Variational Inequality Problem (VIP) was subsequently generalized from the nonlinear complementarity problem (NCP), which was initially identified by Cottle in his research thesis in 1964 [3]. Since then, this field has evolved into a flourishing branch of mathematical programming, offering a wealth of theory, efficient algorithms for problem solving, connections to a wide range of fields, and numerous significant applications in engineering and economics. VIPs find applications in representing frictional contact problems, traffic equilibrium challenges, engineering scenarios, and economic contexts. For instance, VIPs are employed to gain insights into strategic resources, including wireless and wireline systems within the realm of communication technology and networks [4,5,6].
We applied it to interactions in cognitive radio systems and networks [7]. Furthermore, we tackled contact problems within the engineering field and traffic network equilibria [8,9]. By employing the VIP, we establish the existence of a traffic equilibrium pattern, develop an algorithm for pattern creation, and estimate its convergence rate [10,11].
Notably, these concepts are interconnected with variational inequalities, the static traffic equilibrium model, the market equilibrium problem in dynamics, and extend to continuum cases. Furthermore, a computational method is outlined for identifying solutions to the equilibrium problem and formulating the VI, particularly tailored to the traffic equilibrium system [12]. The principles of variational inequalities are leveraged to construct dynamic and other control-theoretical systems, establishing models for urban network flows that anticipate time-varying conditions [13,14]. Employing the auxiliary principal technique, inequalities derived from variations propose and explore iterative solutions for trifunctional equilibrium challenges [15]. Many of these applications often involve a certain degree of uncertainty, possibly stemming from incomplete data or inherent unpredictability within the problem. Consequently, the investigation of the variational inequality problem (VIP) has captured the attention of mathematicians and, more broadly, the operations research community in recent years.
Later on, the concept of VIP was extended to vector variational inequality problems [16]. Due to the diverse nature of problems across various fields of mathematics, particularly in engineering sciences, VIs have been expanded in numerous directions. GVI, introduced by Noor [17] in 1988, extends the theory of VI and finds numerous applications across various fields. Another class of VI, known as mixed variational inequalities (MVI), incorporates four operators and was introduced by Noor in 2011, as seen in [16,17,18,19]. This class is also referred to as the extended general mixed variational inequality. Cottle, Pang, and Stone conducted a comprehensive analysis of the Linear Complementarity Problem (LCP) see [3]. In the realm of numerical methods development for variational inequalities, Scarf pioneered the first constructive iterative method to approximate a fixed point of continuous mapping and the computation of economic equilibria [20].
Numerous studies have explored numerical approaches for VIs, with many of the pre-2003 findings available in the books of Facchinei and Pang see [21]. Since the publication of Facchinei and Pang’s works, the field has witnessed numerous methodological innovations. There are a large number of publications on self-adaptive methods applied to solving variational inequalities by other authors. For a comprehensive review of these works, please refer to the references therein [22,23,24,25,26,27,28,29,30,31,32,33]. Inertial type self-adaptive iterative algorithms for pseudomonotone equilibrium problems and fixed point problems are mentioned in [25], and convergence analysis of an inertial Tseng’s extragradient algorithm [34] for solving pseudomonotone variational inequalities proved in [24]. In this study, we employ a three-step iterative scheme to propose a modified self-adaptive algorithm for solving VIs. This novel technique builds upon previously established algorithms. Convergence analysis is a crucial step to validate the authenticity of these new algorithms, and we have undertaken this analysis, providing proof under appropriate conditions.
Motivating Examples and Background
Examples of what motivates us to continue our studies include:
- (i)
- In Nash games, participants engage in noncooperative competition, and the Nash equilibrium is a stable point that denotes a set of strategies where unilateral deviation is undesirable.
- (ii)
- The analysis of supplies, demand, and prices of commodities in a network of physically distinct marketplaces is a component of problems involving spatial price equilibrium.
- (iii)
- In addition to being employed in traffic planning and toll collection policy decisions, traffic equilibrium problems seek to anticipate steady-state traffic flows in a crowded network.
- (iv)
- Market arrangements with a few firms are captured by oligopolistic market equilibrium issues, which also allow for strategic interactions between the enterprises. Financial markets, electrical markets, department stores, computer companies, and the automotive, chemical, and mineral extraction industries are a few examples.
In order to tackle these difficult problems we need a standard approach for obtaining approximate solutions to VIs. In the next section, we shall discuss source problems and some basic results of variational inequality theory.
2. Preliminary Results
- Systems of equations: Observe that a VI can be used to model the issue of solving a system of nonlinear equations with the solution It is clear that zeros perfectly satisfy the variational inequality problem.
- Problems related to Optimization: An optimization problem is identified by a set of constraints as well as its objective function, which must either be maximized (profit) or minimized (loss), depending on the task. A problem containing optimization involving objective function f and constraint in a set K is denoted by minimize subject to the constraint .
- Complementarity problems: Consider the complementarity condition , which indicates that if we take q as a positive, it is understood that must be 0 and vice versa. The sets present in the decision variables that represent the equilibrium of supply and demand in economic systems usually interact in complementary ways. The complementarity problem (CP) is also included in the VIP as a special instance; if the VIP’s underlying set K is defined as a cone, then the VIP can be equivalently represented as a Complementarity Problem (CP).
- Problems related to fixed points: A fixed point of a function is a point which the function maps to itself. These functions are closely related to the VIP solutions based on projection mapping. Specifically, all VIP solutions can be represented as fixed points on a designed projection map.
- Variational inequality and its generalization: Let’s examine a real Hilbert space H, where the inner product of two vectors is represented as , and the norm is denoted by . Given a set, typically denoted as K, and a mapping, denoted as , the goal is to find such that:
Here, we assume that the map T is continuous and set K is closed and convex. The given inequality is denoted by VI and called the classical variational inequality problem. A general-variational inequality, or GVI, is the generalization of VI, and it appears when two operators T and g are used in VI, such that:
Lemma 1
([4]). The inequality is satisfied by for , such that;
iff
here is in closed convex set K and nonexpansive projection of H, that is
As a result of Lemma (1), we have
and
Lemma 1 makes it simple to demonstrate that the Problem 1 is equal to the fixed-point problem.
Definition 1
([35]). is called the metric projection of H onto K, if for every point , there exists a unique nearest point in K, such that
where the metric projection is denoted by .
Assumption 1.
H is a finite dimension space.
Assumption 2.
A mapping is said to be strongly monotone that is,
Assumption 3.
Lipschitz continuity for operator T is defined as:
where is a constant. In particular, from the definitions we have,
Assumption 4.
If , then T is non-expensive operator such that:
Lemma 2
([22]). Let us consider is sequence of nonnegative real numbers such that:
where and is a sequence such that; if and limsup, or then lim
Lemma 3
([17]). If satisfies the relation
then the function is a solution of the VI(1), where is a constant. From Lemma 3 we can see that, Variational inequalities and fixed point problems are related concepts in mathematical analysis and optimization theory. They both deal with finding a solution to a given problem. Now we state and prove our main results in the next section.
3. Main Results
It is evident from Lemma 3 that the fixed-point problems and VI are comparable. In the VI studies, this alternative equivalence has played a significant role to suggest the following three-step predictor-corrector iterative technique for finding a common solution of the variational inequalities. To be precise, Noor [32,33] has suggested the three-step iterative scheme for variational inequalities. Let us consider
where for all
And we define the residue vector, as
It is clear is solution of (VI) iff is zero of the equation.
As we know that K is a convex set, for all then q, w, we have
We can rewrite for a positive step, ,
where is extragradient such that;
In this paper, motivated by the iterative schemes (5), (6) and (7), we introduced an iterative process for updating the solution to suggested two-step and three-step projection iterative schemes for solving variational inequalities and related optimization problems. Three-step iterative schemes also known as Noor iterations Algorithm 1. Clearly Noor iterations include Ishikawa (two-step) Algorithm 2 and Mann (one-step) Algorithm 3 iterative methods as special cases. We also use the technique of updating the solution to suggest novel Self-adaptive Iterative Scheme Algorithm 4 for solving the variational inequalities (1).
| Algorithm 1 Three-step predictor–corrector method |
|
| Algorithm 2 Two-step iterative method |
|
| Algorithm 3 One-step iteration method |
|
| Algorithm 4 Self-adaptive Iterative Scheme |
|
- Step 0.
- Given , and set
- Step 1.
- Stopping criteria: Let be defined as To proceed, check if the norm of is less than If this condition holds true, terminate the process. Otherwise, seek the smallest non-negative integer such that, that satisfies,
- Step 2.
- Compute
- Step 3.
- Get next iteration
Otherwise, go to the step 1.
In the upcoming section, we delve into the convergence criteria of the above algorithm, which forms the primary driving force behind our findings and outcomes. The analysis of convergence holds significant importance in establishing the existence of a solution under specific conditions. This theorem encapsulates the convergent aspect of the newly established outcomes.
Theorem 1.
If is a solution of variational inequality and operator is pseudomonotone then
Proof of Theorem 1.
Let is a solution of variational inequality and operator is pseudomonotone operator, then
this implies that
since T is pseudomonotone.
Taking in above equation.
From Lemma 1 we have
Taking
in Equation (10) we have,
Substituting .
Taking
We have
For , we have
By adding (9) and (11), we get;
then we have
We know that , so
Which is the required result. □
Theorem 2.
If is a solution of variational inequality (1) and be the approximate solution obtained from Algorithm 4 then
where is the smallest nonnegative integer that satisfied the given inequality in such a way:
Proof of Theorem 2.
From Algorithm 4, we have
so,
as is non-expansive, then we have
As we know that from (Theorem 1),
so,
Since,
This is the required result. □
Theorem 3.
Let T be a nonlinear operator having Lipschitz continuous property with constant and strongly monotonic property with constant . If , for all and then there exist a constant such that . Afterward, the iterative scheme yields an approximate solution , which ultimately converges to the exact solution q of the variational inequality.
Proof of Theorem 3.
Given that T is strongly monotonic with a constant , and Lipschitz continuous with a constant . Now from Algorithm 4 (Updated self-adaptive Iterative algorithm) we can ascertain the existence of a fixed point , satisfying the following conditions:
Since and q are the solutions of VI (1), it follows from Algorithm 4 that
Using the property of non-expansive of , we obtain the following result:
Consider
As T is strongly monotonic with constant and Lipschitz continuous with constant , we have,
After back subsitution into Equation (16), we obtained the following result
where . Now consider
As is non-expensive, then we have
Similarly consider
As T is strongly monotonic and Lipschitz continuous, so we have.
After back subsitution into Equation (19), we obtained the following result
for , we have which implies:
Thus,
Similarly from (15) and Algorithm 1, we have
as is non-expensive and T is strongly monotonic and Lipschitz continuous, so we have,
For convergence criteria , so we have using this fact, then we have
By subsituting Equations (20) and (22) into Equation (18), we get
Since and , so
The above result shows that the general solution of Algorithm 4 converges to approximate solution q. Since and from Equation (23), the Problem (1) has a unique solution consequently , which is the required result. It also follows from (21) and (22) that the sequences and strongly converge to q in H. These results show that under certain conditions, the solution exists and it is unique. This was the main motivation of the results. In the next section, we provide the numerical example for the solution of the problem. This is the implementation of the defined results. □
4. Numerical Example
In this section, numerical results are presented for the proposed three-step predictor-corrector method. We consider the inequality complimentary problem of finding, such that:
where, , the nonlinear part and linear part of respectively. The matrix , where A is an matrix whose entries are randomly generated in the interval and a skew-symmetric matrix B is generated in the same way. The vector q is generated from a uniform distribution in the interval (easy problems) and (hard problems), respectively. In , the nonlinear part of , the components are , here is a random variable in . With the starting point , we take, , and for the given test. Computation of codes written in matlab begins with and stop as soon as The test results for hard problems are reported in Table 1.
Table 1.
Numerical Results for (−500, 0).
We have compared our numerical results with published work by Noor. et al. (2017) [19]. It has been observed that the number of iterations is less in the three-step predictor-corrector self-adaptive method. So, the new Self-adaptive Iterative Scheme is a better and improved version of previous published work.
5. Conclusions
The three-step method, in particular, is quite generic and includes several innovative and well-known approaches for resolving variational inequalities. This work aims to establish a theoretical foundation for these iterations. Through our analysis, we observed that three-step iterations are considerably more practical and manageable for calculations compared to two- and one-step iterations when dealing with nonlinear problems arising in elasticity and mechanics. Furthermore, we have provided proof for the convergence analysis, which constitutes the primary motivation behind this paper. An example is given to illustrate the efficiency of the proposed method. Comparison with other methods shows that the three-step predictor-corrector self-adaptive method perform better.
Author Contributions
Conceptualization, methodology, and analysis, K.S.; funding acquisition, N.M.A.; investigation, S.U.; supervision, S.U.; visualization, N.M.A.; writing—review and editing, K.S.; proofreading and editing, S.U. and K.S; resources, N.M.A. All authors have read and agreed to the published version of the manuscript.
Funding
The authors would like to acknowledge the support of Qassim University for providing the Article Processing Charges (APC) of this publication.
Data Availability Statement
The manuscript included all required data and implementing information.
Acknowledgments
Researchers would like to thank the Deanship of scientific Research, Qassim University for funding publication of this project.
Conflicts of Interest
The authors declare no conflict of interest.
References
- Jacques-Louis, L.; Stampacchia, G. Variational inequalities. Commun. Pure Appl. Math. 1967, 20, 493–519. [Google Scholar]
- Hartman, P.; Stampacchia, G. On Some Non-Linear Elliptic Differential-Functional Equations; Project Euclid: Durham, NC, USA, 1966; pp. 271–310. [Google Scholar]
- Cottle, R.W.; Pang, J.S.; Stone, R.E. The Linear Complementarity Problems; Academic Press: New York, NY, USA, 1992. [Google Scholar]
- Noor, M.A. Some developments in general variational inequalities. Appl. Math. Comput. 2004, 152, 199–277. [Google Scholar]
- Alpcan, T.; Başar, T. Distributed algorithms for Nash equilibria of flow control games. In Advances in Dynamic Games: Applications to Economics, Finance, Optimization, and Stochastic Control; Birkhäuser: Boston, MA, USA, 2005; pp. 473–498. [Google Scholar]
- Yin, H.; Shanbhag, U.V.; Mehta, P.G. Nash equilibrium problems with scaled congestion costs and shared constraints. IEEE Trans. Autom. Control. 2011, 56, 1702–1708. [Google Scholar]
- Scutari, G.; Palomar, D.P.; Facchinei, F.; Pang, J.S. Monotone games for cognitive radio systems. In Distributed Decision Making and Control; Springer: London, UK, 2011; pp. 83–112. [Google Scholar]
- Noor, M.A. New approximation schemes for general variational inequalities. J. Math. Anal. Appl. 2000, 251, 217–229. [Google Scholar] [CrossRef]
- Yao, Y.; Shahzad, N.; Yao, J.C. Convergence of Tseng-type self-adaptive algorithms for variational inequalities and fixed point problems. Carpathian J. Math. 2021, 37, 541–550. [Google Scholar] [CrossRef]
- Daniele, P.; Giannessi, F.; Maugeri, A. Equilibrium Problems and Variational Models; Kluwer Academic Publishers: London, UK, 2003. [Google Scholar]
- Kinderlehrer, D.; Stampacchia, G. An Introduction to Variational Inequalities and Their Applications; Society for Industrial and Applied Mathematics: Philadelphia, PA, USA, 2000. [Google Scholar]
- Somyot, P.; Punpaeng, R. A general iterative method for equilibrium problems and fixed point problems in Hilbert spaces. J. Math. Anal. Appl. 2007, 336, 455–469. [Google Scholar]
- Colao, V.; López, G.; Marino, G.; Martín-Márquez, V. Equilibrium problems in Hadamard manifolds. J. Math. Anal. Appl. 2012, 388, 61–77. [Google Scholar] [CrossRef]
- Antipin, A.S.; Jacimovic, V.; Jacimovic, M. Dynamics and variational inequalities. Comput. Math. Math. Phy. 2017, 57, 784–801. [Google Scholar] [CrossRef]
- Noor, M.A.; Noor, K.I. Equilibrium problems and variational inequalities. Mathematica 2005, 47, 89–100. [Google Scholar]
- Noor, M.A.; Ullah, S.; Noor, K.I.; Al-Said, E. Iterative methods for solving extended general mixed variational inequalities. Comput. Math. Appl. 2011, 62, 804–813. [Google Scholar] [CrossRef]
- Noor, M.A. General variational inequalities. Appl. Math. Lett. 1988, 1, 119–121. [Google Scholar] [CrossRef]
- Baiocchi, C.; Capelo, A. Variational and Quasi Variationally Inequalities; J. Wiley and Sons: New York, NY, USA, 1984. [Google Scholar]
- Noor, M.A.; Ullah, S. Predictor-corrector self-adaptive methods for variational inequalities. Transylv. Rev. 2017, 25, 4147–4152. [Google Scholar]
- Scarf, H.E.; Hansen, T.B. The Computation of Economic Equilibria; Yale University Press: New Haven, CT, USA, 1973. [Google Scholar]
- Francisco, F.; Pang, J. (Eds.) Finite-Dimensional Variational Inequalities and Complementarity Problems; Springer: New York, NY, USA, 2003. [Google Scholar]
- Xu, H.K. Viscosity approximation methods for nonexpansive mappings. J. Math. Anal. Appl. 2004, 298, 279–291. [Google Scholar] [CrossRef]
- Noor, M.A. Generalized Wiener-Hopf Equations and Onlinear Quasi Variational Inequalities. Korean J. Comput. Appl. Math. 1998, 5, 73–89. [Google Scholar] [CrossRef]
- Liya, L.; Cho, S.Y.; Yao, J. Convergence analysis of an inertial Tseng’s extragradient algorithm for solving pseudomonotone variational inequalities and applications. J. Nonlinear Var. Anal. 2021, 5, 627–644. [Google Scholar]
- Ogbuisi, F.U.; Iyiola, O.S.; Ngnotchouye, J.M.T.; Shumba, T.M.M. On inertial type self-adaptive iterative algorithms for solving pseudomonotone equilibrium problems and fixed point problems. J. Nonlinear Funct. Anal. 2021, 4, 1–18. [Google Scholar]
- Bux, M.; Ullah, S.; Arif, M.S.; Abodayeh, K. A self-Adaptive Technique for Solving Variational Inequalities: A New Approach to the Problem. J. Funct. Spaces 2022, 2022, 7078707. [Google Scholar] [CrossRef]
- Noor, M.A.; Bnouhachem, A.; Ullah, S. Self-adaptive methods for general variational inequalities. Nonlinear Anal. Theory Methods Appl. 2009, 71, 3728–3738. [Google Scholar] [CrossRef]
- Bnouhachem, A.; Noor, M.A.; Al-Shemas, E.H. On self-adaptive method for general mixed variational inequalities. Math. Probl. Eng. 2008, 2008, 280956. [Google Scholar] [CrossRef]
- Ge, Z.; Han, D. Self-adaptive implicit methods for monotone variant variational inequalities. J. Inequalities Appl. 2009, 2009, 458134. [Google Scholar] [CrossRef]
- Noor, M.A.; Noor, K.I.; Treanta, S.; Nonlaopon, K. On three-step iterative schemes associated with general quasi-variational inclusions. Alex. Eng. J. 2022, 61, 12051–12059. [Google Scholar] [CrossRef]
- Mukheimer, A.; Ullah, S.; Bux, M.; Arif, M.S.; Abodayeh, K. New Iterative Scheme Involving Self-Adaptive Method for Solving Mixed Variational Inequalities. Axioms 2023, 12, 310. [Google Scholar] [CrossRef]
- Huang, Z.; Noor, M.A. Strong convergence criteria for nonexpansive and related (r,c)-cocoercive mappings in Hilbert spaces. Preprint 2006. [Google Scholar]
- Noor, M.A. General variational inequalities and nonexpansive mappings. J. Math. Anal. Appl. 2007, 331, 810–822. [Google Scholar] [CrossRef]
- Censor, Y.; Gibali, A.; Reich, S. The subgradient extragradient method for solving variational inequalities in Hilbert space. J. Optim. Theory Appl. 2011, 148, 318–335. [Google Scholar] [CrossRef]
- Goebel, K.; Reich, S. Uniform Convexity, Hyperbolic Geometry, and Non-Expansive Mappings; Wiley: Hoboken, NJ, USA, 1984. [Google Scholar]
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2024 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).