Next Article in Journal
Efficient Computation of Heat Distribution of Processed Materials under Laser Irradiation
Next Article in Special Issue
A Modified Recursive Regularization Factor Calculation for Sparse RLS Algorithm with l1-Norm
Previous Article in Journal
First Solution of Fractional Bioconvection with Power Law Kernel for a Vertical Surface
Previous Article in Special Issue
Oversampling Errors in Multimodal Medical Imaging Are Due to the Gibbs Effect
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Modified Inertial Forward–Backward Algorithm in Banach Spaces and Its Application

by
Yanlai Song
1,† and
Mihai Postolache
2,3,4,5,*,†
1
College of Science, Zhongyuan University of Technology, Zhengzhou 450007, China
2
Department of General Education, China Medical University, Taichung 40402, Taiwan
3
Department of Interior Design, Asia University, Taichung 41354, Taiwan
4
Gh. Mihoc-C. Iacob Institute of Mathematical Statistics and Applied Mathematics, Romanian Academy, 050711 Bucharest, Romania
5
Department of Mathematics and Informatics, University “Politehnica” of Bucharest, 060042 Bucharest, Romania
*
Author to whom correspondence should be addressed.
The authors contributed equally to this work.
Mathematics 2021, 9(12), 1365; https://doi.org/10.3390/math9121365
Submission received: 25 May 2021 / Revised: 5 June 2021 / Accepted: 11 June 2021 / Published: 12 June 2021
(This article belongs to the Special Issue Advances in Computational and Applied Mathematics)

Abstract

:
In this paper, we present a new modified inertial forward–backward algorithm for finding a common solution of the quasi-variational inclusion problem and the variational inequality problem in a q-uniformly smooth Banach space. The proposed algorithm is based on descent, splitting and inertial ideas. Under suitable assumptions, we prove that the sequence generated by the iterative algorithm converges strongly to the unique solution of the abovementioned problems. Numerical examples are also given to demonstrate our results.

1. Introduction

Many authors are now studying algorithms for reckoning a zero point for monotone operators in a Hilbert space. This is the problem of finding a point x H such that
0 T x ,
where T is a monotone operator. The set of zero points of T is denoted by T 1 ( 0 ) . Diverse problems such as convex minimization, monotone variational inequalities over convex sets, equilibrium problems etc. can be stated in the form of (1).
The proximal point algorithm proposed by Martinet [1,2] and generalized by Rockafellar [3,4],
x n + 1 = ( I + α k T ) 1 x n , n N ,
is the classical method for solving (1). Here, ( I + α k T ) 1 is the resolvent operator of maximal monotone operator T, I is the identity mapping and { α n } ( 0 , + ) is a regularization sequence. Meanwhile, Rockafellar [3] and Bruck and Reich [5] proved that the sequence { x n } generated by the proximal point algorithm (2) converges weakly to a point x satisfying 0 T x .
Note that it is difficult to evaluate the resolvent operator, in general. One way is to decompose the given operator into the sum of two (or more) maximal monotone operators whose resolvents are easier to evaluate than the resolvents of the original ones. More precisely, define T = A + B such that the resolvent ( I + α A ) 1 (implicit, backward step) and the evaluation of B (explicit, forward step) are much easier to compute than the full resolvent ( I + α T ) 1 . Then, we have to consider the following monotone inclusion problem: find x H such that
0 A x + B x .
In order to solve the problem (3), the forward–backward splitting method [6,7,8,9,10,11] is usually employed. This is defined in the following manner: x 1 H and
x n + 1 = ( I + r A ) 1 ( I r B ) x n , n N .
The forward–backward method has the advantage of being easier to compute than the backward–backward method, which ensures enhanced applicability to real-life problems. Iterations have lower computational cost and can be computed exactly. Of course, the problem decomposition is not the only consideration; the convergence rate is another (see [12]).
In 2001, Alvarez and Attouch [13] employed the heavy ball method studied in [14,15] for maximal monotone operators on the proximal point algorithm. This algorithm, called the inertial proximal point algorithm, has the following form:
x n + 1 = ( I + r n A ) 1 y n , y n = x n + θ n ( x n x n 1 ) , n 1 .
They proved that if { r n } is non-decreasing and { r n } [ 0 , 1 ) with n = 1 θ n x n x n 1 2 < , then algorithm (5) converges weakly to a zero of B.
Recently, Lorenz and Pock [16] also proposed the following inertial forward–backward algorithm for monotone operators:
x n + 1 = ( I + r n A ) 1 ( y n r n B y n ) , y n = x n + θ n ( x n x n 1 ) , n 1 ,
where { r n } is a positive real sequence. They proved that the algorithm involving the inertial term mentioned above has weak convergence.
However, strong convergence (norm convergence) is often much more desirable than weak convergence (see [17] and references therein). Very recently, in the spirit of the splitting forward–backward method and the hybrid steepest descent method, Liu et al. [12] proposed the following iterative scheme as a new strategy in a Hilbert space; please see Algorithm 1.
Suppose S : H H is strongly monotone and continuous operator, A : H 2 H is a maximally monotone operator and B : H H is a cocoercive operator. Then, they have proved—under certain appropriate assumptions on the sequences { v n } , { μ n } and { η n } —that the sequence { p n } defined by Algorithm 1 converges strongly to the unique element of some variational inequality.
The quasi-variational inclusion problem in the setting of Hilbert spaces has been extensively studied in the literature [18,19,20,21]. However, there is little work in the existing literature on this problem in the setting of Banach spaces. The main difficulties are due to the fact that the inner product structure of a Hilbert space fails to be true in a Banach space. This is the motivation of the present study.
Motivated and inspired by Alvarez and Attouch [13], Lorenz and Pock [16], Liu et al. [12] and Thong and Cholamjiak [19], we put forward the following questions:
(1)
Can the corresponding results in [12,13,16,19] in Hilbert spaces be extended to the framework of Banach spaces (e.g., l p for 1 < p < )?
(2)
Can we extend corresponding results in [12] from one strongly monotone operator to a finite family of strongly accretive operators?
(3)
Can we extend the corresponding results in [12] from one cocoercive operator to a finite family of inverse strongly accretive operators?
(4)
Can the restrictions imposed on the parameters { η n } in [12] be relaxed?
Algorithm 1: The hybrid forward–backward algorithm.
Mathematics 09 01365 i001
The purpose of this work is to give affirmative answers to the questions mentioned above. We introduce a new modified inertial forward–backward algorithm for finding a common solution of the quasi-variational inclusion problem and the variational inequality problem in q-uniformly smooth Banach spaces. Then a numerical analysis is conducted.

2. Preliminaries

To make the article self-contained, some mathematical preliminaries are necessary. In this respect, let us denote by E and E * a real Banach space and the dual space of E respectively. We use Fix ( T ) to denote the set of fixed points of T and B r to denote the closed ball with center zero and radius r. Let C be a subset of E and q > 1 be a real number. The (generalized) duality mapping J q : E 2 E * is given by
J q ( x ) = { x * E * : x , x * = x q , x * = x q 1 }
for all x E . Here · , · denotes the generalized duality pairing between E and E * . If q = 2 , the corresponding duality mapping is called the normalized duality mapping and is denoted by J. It is well known that if E is smooth, then J q and J is single-valued, which is denoted by j q and j, respectively. Clearly, the relation j q ( x ) = x q 2 j ( x ) , x 0 holds.
Let C be a nonempty closed convex subset of a real Banach space E. Let A : C E be a single-valued nonlinear mapping and let B : C 2 E be a multivalued mapping. The so-called quasi-variational inclusion problem consists of finding a z E such that
0 ( A + B ) z .
The variational inequality problem for A : C E consists of finding a point u C such that
A u , j q ( x u ) 0 , x C ,
j q ( x y ) J q ( x y ) . The set of solutions of the variational inequality problem is denoted by V I ( C , A ) . If E : = H is a real Hilbert space, the variational inequality problem reduces to finding a point u C such that
A u , x u 0 , x C .
We also have that, for λ > 0 , u = P C ( I λ A ) u if and only if u V I ( C , A ) .
Definition 1.
Let E be a Banach space. Then, a function δ E : [ 0 , 2 ] [ 0 , 1 ] is called the modulus of convexity of E if
δ E ( ϵ ) = inf { 1 x + y 2 : x 1 , y 1 , x y ϵ } .
If δ E ( ϵ ) > 0 , for all ϵ ( 0 , 2 ] , then E is uniformly convex.
Definition 2.
The function ρ E : [ 0 , 1 ) [ 0 , 1 ) is said to be the modulus of smoothness of E if
ρ E ( t ) = sup { 1 2 ( x + t y + x t y ) 1 : x = y = 1 } .
A Banach space E is called:
(1) 
Uniformly smooth if ρ E ( t ) t 0 as t 0 ;
(2) 
q-Uniformly smooth if there exists a fixed constant c > 0 such that ρ E ( t ) c t q , where q ( 1 , 2 ] .
It is known that a uniformly convex Banach space is reflexive and strictly convex.
Definition 3.
A mapping T : C E is said to be:
(1) 
Nonexpansive if
T x T y x y for all x , y C ;
(2) 
r-Contractive if there exists r [ 0 , 1 ) such that
T x T y r x y for all x , y C ;
(3) 
η-Strongly accretive if for all x , y C there exists η > 0 and j q ( x y ) J q ( x y ) such that
T x T y , j q ( x y ) η x y q ;
(4) 
μ-Inverse-strongly accretive if for all x , y C there exists μ > 0 and j q ( x y ) J q ( x y ) such that
T x T y , j q ( x y ) μ T x T y q .
Definition 4.
A set-valued mapping T : D o m ( T ) 2 E is said to be:
(1) 
Accretive if for any x , y D o m ( T ) there exists j q ( x y ) J q ( x y ) , such that for all u T ( x ) and v T ( y ) ,
u v , j q ( x y ) 0 ;
(2) 
m-Accretive if T is accretive and ( I + ρ T ) ( D o m ( T ) ) = E for every (equivalently, for some) ρ > 0 , where I is the identity mapping.
Let A : D o m ( A ) 2 E be m-accretive. The mapping J A , ρ : E D o m ( A ) defined by
J A , ρ ( u ) = ( I + ρ A ) 1 ( u ) , u E ,
is called the resolvent operator associated with A , where ρ is any positive number and I is the identity mapping. It is well known that J A , ρ is single-valued and nonexpansive.
Recall that if C and D are nonempty subsets of a Banach space E such that C is closed convex and D C , then a mapping Q : C D is sunny provided
Q ( x + t ( x Q ( x ) ) ) = Q ( x )
for all x C and t 0 , whenever Q x + t ( x Q ( x ) ) C . A mapping Q : C D is called a retraction if Q x = x for all x D . Furthermore, Q is a sunny nonexpansive retraction from C onto D if Q is a retraction from C onto D which is also sunny and nonexpansive. A subset D of C is called a sunny nonexpansive retraction of C if there exists a sunny nonexpansive retraction from C onto D.
The following lemmas collect some properties of sunny nonexpansive retractions.
Lemma 1.
([22,23]) Let C be a closed convex subset of a smooth Banach space E. Let D be a nonempty subset of C. Let Q : C D be a retraction and let j , j q be the normalized duality mapping and generalized duality mapping on E, respectively. Then, the following are equivalent:
(i) 
Q is sunny and nonexpansive;
(ii) 
Q x Q y 2 x y , j ( Q x Q y ) , x , y C ;
(iii) 
x Q x , j ( y Q x ) 0 , x C , y D ;
(iv) 
x Q x , j q ( y Q x ) 0 , x C , y D .
Lemma 2.
([24]) Let E be a Banach space and J q be a generalized duality mapping. Then, for any given x , y E , the following inequality holds:
x + y q x q + q y , j q ( x + y ) , j q ( x + y ) J q ( x + y ) .
Lemma 3.
([25,26]) Let C be a nonempty closed convex subset of a real q-uniformly smooth Banach space E. Let the mapping T : C E be a ι-Lipschitz and κ-strongly accretive operator with constants κ , ι > 0 . Let 0 < δ < q κ C q ι q 1 q 1 and τ = δ κ C q δ q 1 ι q q , where C q is the q-uniform smoothness coefficient of E (see [24]). Then, for t ( 0 , min { 1 , 1 τ } ) , the mapping S : C E defined by S : = ( I t δ T ) is a contraction with a constant 1 t τ .
Lemma 4.
([26]) Assume that E is a real uniformly convex and q-uniformly smooth Banach space. Suppose that B : C E is an a-inverse-strongly accretive operator for some a > 0 and A : C D o m ( A ) 2 E is an m-accretive operator. Moreover, denote J r by
J r : = J A , r = ( I + r A ) 1
and T r by
T r : = J r ( I r B ) = ( I + r A ) 1 ( I r B ) .
Then, it holds for all r > 0 that Fix ( T r ) = ( A + B ) 1 ( 0 ) .
Lemma 5.
([9]) Assume that C is a nonempty closed subset of a real uniformly convex and q-uniformly smooth Banach space E. Suppose that B : C E is α-inverse-strongly accretive and A is m-accretive in E, with D o m ( M ) C . Then, it holds that:
(1) 
Given 0 < s r and x E ,
T s x T r x | 1 s r | x T r x a n d x T s x 2 x T r x ;
(2) 
Given k > 0 , there exists a continuous, strictly increasing and convex function ϕ q : [ 0 , ) [ 0 , ) with ϕ q ( 0 ) = 0 such that for all x , y B k ,
T r x T r y q x y q r ( α q r q 1 C q ) B x B y q ϕ q ( ( I J r ) ( I r B ) x ( I J r ) ( I r B ) y ) .
To develop the results in this article, some technical results are necessary, as stated in the three lemmas below.
Lemma 6.
([27]) Let { α n } be a sequence of nonnegative numbers satisfying the property:
α n + 1 ( 1 γ n ) α n + b n + γ n c n , n N ,
where { γ n } , { b n } , { c n } satisfy the restrictions:
(i) 
n = 1 γ n = , lim n γ n = 0 ;
(ii) 
b n 0 , n = 1 b n < ;
(iii) 
lim   sup n c n 0 .
Then, lim n α n = 0 .
Lemma 7.
([28]) Let q > 1 . Then, the following inequality holds for arbitrary positive real numbers a , b :
a q b q q a q 1 ( a b ) .
Lemma 8.
([29]) Let { α n } be a sequence of real numbers such that there exists a subsequence { n i } of { n } such that α n i < α n i + 1 for all i N . Then there exists a nondecreasing sequence { m k } N such that m k and the following properties are satisfied for all (sufficiently large) numbers k N :
α m k α m k + 1 a n d α k α m k + 1 .
In fact, m k = max { j k : α j < α j + 1 } .
We make complete these preliminaries with two results on classes of accretive operators.
Lemma 9.
([30]) Let C be a nonempty closed convex subset of a real smooth Banach space E. Let N 1 be some positive integer, A be m-accretive in E with D o m ( A ) C , B i : C E be β i -inverse-strongly accretive with β = min { β 1 , β 2 , , β N } and i = 1 N ( A + B i ) 1 ( 0 ) . Let { γ i } be a real number sequence in ( 0 , 1 ) with i = 1 N γ i = 1 . Then i = 1 N γ i B i is β-inverse-strongly accretive, and
( A + i = 1 N γ i B i ) 1 ( 0 ) = i = 1 N ( A + B i ) 1 ( 0 ) .
Lemma 10.
Let C be a nonempty closed convex subset of a real smooth Banach space E. Let N 1 be some positive integer, S i : C E be κ i -strongly accretive with κ = min { κ 1 , κ 2 , , κ N } . Let { λ i } be a real number sequence in ( 0 , 1 ) with i = 1 N λ i = 1 . Then, the mapping i = 1 N λ i S i is κ-strongly accretive.
Proof. 
Let x , y C . It follows that
i = 1 N λ i S i x i = 1 N λ i S i y , j q ( x y ) = i = 1 N λ i S i x S i y , j q ( x y ) i = 1 N λ i κ i x y q κ x y q .
Consequently, the mapping i = 1 N λ i S i is κ -strongly accretive. □
Now, we are ready to state and prove our results.

3. Main Results

In this section we present an algorithm for solving quasi-variational inclusion problems and variational inequality problems in Banach spaces. We assume that:
(A1)
E is a uniformly convex and q-uniformly smooth Banach space, and A is m-accretive;
(A2)
B i is β i -inverse-strongly accretive with constants β i > 0 for each i = 1 , 2 , , N , and β = min { β i : 1 i N } ;
(A3)
S i : E E is ι i -Lipschitzian and κ i -strongly accretive with constants ι i , κ i > 0 for each i = 1 , 2 , , N , ι = min { ι i : 1 i N } and κ = min { κ i : 1 i N } ;
(A4)
0 < δ < q κ C q ι q 1 q 1 and Ω = i = 1 N ( A + B i ) 1 ( 0 ) .
The proposed algorithm is of the form:
Theorem 1.
Assume that { η n } , { v n } , { γ n } , { λ n } and { μ n } are real number sequences in [0, 1] satisfying:
(i) 
0 < lim   inf n v n lim   sup n v n < q β C q ι q 1 q 1 ;
(ii) 
lim n η n = 0 , i = 1 η n = ;
(iii) 
lim n μ n η n p n p n 1 = 0 ;
(iv) 
i = 1 N γ n = 1 , i = 1 N λ n = 1 .
Then { p n } generated by Algorithm 2 converges strongly to a point z * Ω , which is also the unique solution of the variational inequalty problem
S z * , j q ( x z * ) 0 , x Ω .
Remark 1.
We note that condition (iii) can be easily implemented since the value of p n p n 1 is known before choosing μ n . Indeed, the parameter μ n can be chosen such that
μ n = w , p n = p n 1 , ξ n p n p n 1 , p n p n 1 ,
where w 0 and { ξ n } is a positive sequence such that ξ n = o ( η n ) .
We now prove Theorem 1.
Proof. 
We first prove that the sequence { p n } is bounded. Writing B = i = 1 N γ i B i , one can then deduce from Lemma 9 that B is β-inverse-strongly accretive. Additionally, letting S = i = 1 N λ i S i , we infer from Lemma 10 and Assumption (A3) that S : C E is ι-Lipschitzian and κ-strongly accretive. Taking any z Ω , we infer from Algorithm 2, Lemma 5 (2) and (i) that
q n z q = ( I + v n A ) 1 ( I v n B ) w n ( I + v n A ) 1 ( I v n B ) z q w n z q v n ( β q v n q 1 C q ) B w n B z q ϕ q ( ( I J v n ) ( I v n B ) w n ( I J v n ) ( I v n B ) z ) ,
which implies
v n ( β q v n q 1 C q ) B w n B z q w n z q q n z 2
and
q n z w n z .
From the definition of w n , we deduce
w n z p n z + μ n p n p n 1 .
Invoking (iii), there exists a positive constant M 1 < such that
μ n η n p n p n 1 M 1 .
Algorithm 2: The modified hybrid forward–backward algorithm.
Mathematics 09 01365 i002
From (13) and (14), Lemma 3, Assumption (A4) and (ii), one obtains
p n + 1 z = ( I δ η n S ) q n ( I δ η n S ) z δ η n S z ( 1 η n τ ) q n z + δ η n S z ( 1 η n τ ) w n z + δ η n S z ( 1 η n τ ) ( p n z + η n M 1 ) + δ η n S z ( 1 η n τ ) p n z + η n M 1 + δ η n S z max { p n z , 1 τ ( M 1 + δ S z ) } max { p 1 z , 1 τ ( M 1 + δ S z ) } ,
where τ = δ κ C q δ q 1 ι q q > 0 . This implies that sequence { p n } is bounded. At the same time, by putting together (13) and (14), one concludes that { q n } and { w n } are bounded. According to Lemma 2, we obtain
w n z q = p n z + μ n ( p n p n 1 ) q p n z q + q μ n p n p n 1 , j q ( w n z ) p n z q + q μ n p n p n 1 w n z q 1 p n z q + μ n η n p n p n 1 M 2 ,
where M 2 = sup n 1 { q η n w n z q 1 } < . By combining (11) with (16), one immediately concludes that
q n z q p n z q + μ n η n p n p n 1 M 2 v n ( β q v n q 1 C q ) B w n B z q ϕ q ( ( I J v n ) ( I v n B ) w n ( I J v n ) ( I v n B ) z ) .
It follows from Lemma 2, Lemma 3, (17) and (ii) that
p n + 1 z q = ( I δ η n S ) q n ( I δ η n S ) z δ η n S z q ( I δ η n S ) q n ( I δ η n S ) z q q δ η n S z , j q ( p n + 1 z ) ( 1 η n τ ) q q n z q + q δ η n S z , j q ( z p n + 1 ) q n z q + q δ η n S z , j q ( z p n + 1 ) p n z q + μ n η n p n p n 1 M 2 v n ( β q v n q 1 C q ) B w n B z 2 ϕ q ( ( I J v n ) ( I v n B ) w n ( I J v n ) ( I v n B ) z ) + η n M 3 ,
where M 3 = sup n 1 q δ S z , j q ( z p n + 1 ) < . Let us rewrite (18) as
v n ( β q v n q 1 C q ) B w n B z q p n z q p n + 1 z q + μ n η n p n p n 1 M 2 + η n M 3 ,
and
ϕ q ( ( I J v n ) ( I v n B ) w n ( I J v n ) ( I v n B ) z ) p n z q p n + 1 z q + μ n η n p n p n 1 M 2 + η n M 3 .
Next, we show that { p n } converges by considering two possible cases.
Case 1. Suppose that there exists N N such that the sequence { p n z * } n N is monotonically decreasing; thus, lim n p n z * exists. Using (i), (ii), (iii) and letting n tend to infinity in (19), one finds that
lim n B w n B z * = 0 .
It follows from (ii), (iii), (20) and the properties of ϕ q (see Lemma 5 (2)) that
lim n ( I J v n ) ( I v n B ) w n ( I J v n ) ( I v n B ) z * = 0 .
We deduce from Lemma 4 and (22) that
lim n ( I v n B ) w n q n ( I v n B ) z * + z * = 0 .
Notice that
w n q n ( I v n B ) w n ( I v n B ) z * q n + z * + v n B w n B z * .
Together with (21) and (23), this implies that
lim n w n q n = 0 .
It follows from (ii), (iii) and the definitions of w n and p n + 1 that
lim n w n p n = lim n μ n p n p n 1 = 0
and
lim n p n + 1 q n = lim n δ η n S q n = 0 .
Resorting to (24)–(26), one deduces that
lim n p n + 1 p n lim n ( p n + 1 q n + q n w n + w n p n ) = 0 .
Denote T v n = ( I + v n A ) 1 ( I v n B ) . Then, it immediately holds that
lim n T v n w n w n = lim n q n w n = 0 .
In view of Lemma 5 (1) and (28), there exists r > 0 such that r v n for all n 1 and
lim n T r w n w n 2 lim n T v n w n w n = 0 .
Setting τ = δ κ C q δ q 1 ι q q and taking a real number η ( 0 , min { 1 , 1 τ } ) , we find by Lemma 3 that ( I η δ S ) is contractive with a constant 1 η τ . Let z t satisfy z t = t ( I η δ S ) z t + ( 1 t ) T r z t . By Lemma 1, Lemma 9 and Xu’s theorem (4.1) [31], we obtain that z t converges strongly to a point z * Fix ( T r ) , which is also the unique solution of variational inequality problem
S z * , j q ( x z * ) 0 , x Fix ( T r ) .
Apply Lemma 4 to obtain that z * is the unique solution of variational inequality problem (10).
Next we show that
lim   sup n S z * , j p ( z * p n ) 0 ,
which is equivalent to
lim   sup n S z * , j ( z * p n ) 0 .
Using Lemma 2, we deduce that
z t w n 2 = t ( ( I η δ S ) z t w n ) + ( 1 t ) ( T r z t w n ) 2 ( 1 t ) 2 T r z t w n 2 + 2 t ( I η δ S ) z t w n , j ( z t w n ) ( 1 t ) 2 ( T r z t T r w n + T r w n w n ) 2 + 2 t ( I η δ S ) z t z t , j ( z t w n ) + 2 t z t w n 2 ( 1 t ) 2 ( z t w n + T r w n w n ) 2 2 t η δ S z t , j ( z t w n ) + 2 t z t w n 2 ( 1 t ) 2 z t w n 2 + M n , t 2 t η δ S z t , j ( z t w n ) + 2 t z t w n 2 ,
where M n , t = T r w n w n ( 2 z t w n + T r w n w n ) ( 0 as n ) . This implies
S z t , j ( z t w n ) t 2 η δ z t w n 2 + 1 2 t η δ M n , t .
It follows that
lim   sup n S z t , j ( z t w n ) t 2 η δ M 4 ,
where M 4 > 0 is a constant such that M 4 z t w n 2 for all n 1 and t ( 0 , 1 ) . Taking the lim sup as t 0 in (31) and noting the fact that the two limits are interchangeable because the duality map J is norm-to-norm uniformly continuous on bounded sets, we obtain (30).
It follows from Lemma 2, Lemma 3 and (13) that
p n + 1 z * q = ( I η n δ S ) q n ( I η n δ S ) z * η n δ S z * q ( I η n δ S ) q n ( I η n δ S ) z * q q η n δ S z * , j q ( p n + 1 z * ) ( 1 η n τ ) q n z * q + δ η n S z * , j q ( z * p n + 1 ) ( 1 η n τ ) w n z * q + δ η n S z * , j q ( z * p n + 1 ) ( 1 η n τ ) ( p n z * + μ n p n p n 1 ) q + δ η n S z * , j q ( z * p n + 1 ) .
Noticing Lemma 7, we infer
( p n z * + μ n p n p n 1 ) q p n z * q + q μ n p n p n 1 ( p n z * + μ n p n p n 1 ) q 1 .
Substituting (33) into (32) and simplifying, we have
p n + 1 z * q ( 1 η n τ ) ( p n z * q + μ n p n p n 1 M 4 ) + δ η n S z * , j q ( z * p n + 1 ) ( 1 η n τ ) p n z * q + μ n p n p n 1 M 4 + δ η n S z * , j q ( z * p n + 1 ) = ( 1 η n τ ) p n z * q + η n μ n η n p n p n 1 M 5 + δ S z * , j q ( z * p n + 1 ) ,
where
M 5 = sup n 1 q ( p n z * + μ n p n p n 1 ) q 1 < .
So doing, Lemma 6 asserts that lim n p n + 1 z * = 0 . Coming back to (25)–(27), one concludes that { p n } , { q n } and { w n } converge strongly to z * .
Case 2. Assume that { p n z * } is not monotonically decreasing. Then, there exists a subsequence { p n i z * } of { p n z * } such that
p n i z * < p n i + 1 z * , i N .
From Lemma 8, there exists a nondecreasing sequence { m k } N such that
max { p m k z * , p k z * } p m k + 1 z * .
Thanks to (19), (20) and (36), one infers that
lim k B w m k B z * = 0
and
lim k ϕ q ( I J v m k ) ( I v m k B ) w m k ( I J v m k ) ( I v m k B ) z * = 0
Repeating the argument for (24), we deduce
lim k w m k q m k = 0
A calculation similar to the proof in Case 1 guarantees that
lim k p m k + 1 p m k = 0 and lim   sup k S z * , j q ( z * p m k + 1 ) 0 .
Because the duality map J q is norm-to-norm uniformly continuous on bounded sets, we obtain that from (11), Lemmas 2 and 3,
lim   sup k S z * , j q ( z * p m k + 1 ) 0 .
From (11), Lemmas 2 and 3, one obtains
p m k + 1 z * q = ( I η m k δ S ) q m k ( I η m k δ S ) z * η m k δ S z * q ( I η m k δ S ) q m k ( I η m k δ S ) z * q q η m k δ S z * , j q ( p m k + 1 z * ) ( 1 η m k τ ) q m k z * q + q δ η m k S z * , j q ( z * p m k + 1 ) ( 1 η m k τ ) w m k z * q + q δ η m k S z * , j q ( z * p m k + 1 ) ( 1 η m k τ ) ( p m k z * + μ m k p n p m k 1 ) q + q δ η m k S z * , j q ( z * p m k + 1 ) .
From (35) and Lemma 7, we derive
( p m k z * + μ n p m k p m k 1 ) q p m k z * q + q μ m k p m k p m k 1 ( p m k z * + μ n p m k p m k 1 ) q 1 p m k + 1 z * q + q μ m k p m k p m k 1 ( p m k z * + μ n p m k p m k 1 ) q 1 .
Substituting (41) into (40) yields
p m k + 1 z * q μ m k η m k p m k p m k 1 M 6 + q δ τ S z * , j q ( z * p m k + 1 ) ,
where M 6 = sup n 1 q ( p m k z * + μ n p m k p m k 1 ) q 1 < . By applying (iii) and (39), we obtain
lim k p m k + 1 z * q = 0 .
Hence,
lim k p m k + 1 z * = 0 .
It thus follows from (36) that
lim k p k z * = 0 .
From the above, one can conclude that the sequences generated by Algorithm 2 converge strongly to a point z * Ω , which is also the unique solution of the variational inequality problem (1). This completes the proof. □
Remark 2.
Theorem 1 extends, improves and develops corresponding results in [12,13,16,19] in the following respects:
  • The results in this paper improve and extend corresponding results in [12,13,16,19] in Hilbert spaces to more general q-uniformly smooth Banach spaces.
  • The results in this paper extend corresponding results in [12] from one strongly monotone operator to a finite family of strongly accretive operators.
  • The results in this paper extend corresponding results in [12] from one cocoercive operator to a finite family of inverse-strongly accretive operators.
  • We omit the condition η n + 1 = O ( η n ) , which is very necessary in Theorem 1 of Liu et al. [12].
  • The proof of our Theorem 1 is very different from the proof of Theorem 1 of Liu et al. [12].
The following result can be obtained from Theorem 1 immediately.
Corollary 1.
Let N = 1 in Theorem 1. Then, { p n } generated by Algorithm 2 converges strongly to a point z * Ω ( = ( A + B 1 ) 1 ( 0 ) ) , which is also the unique solution of the variational inequality problem
S 1 z * , j q ( x z * ) 0 , x Ω .

4. Application to Constrained Convex Minimization Problems

In this section, we shall apply our main results to an approximate constrained convex minimization problem. Let E be the real Euclidean n-space R n and Ω be a nonempty closed convex subset of H. We consider the following constrained convex minimization problem:
min x Ω φ ( x ) ,
where φ : Ω R is a real-valued convex function and assumes that the problem (42) is consistent (i.e., its solution set is nonempty). Let D denote its solution set. For the minimization problem (42), if φ is differentiable, then we have the following lemma.
Lemma 11.
([32]) (Optimality condition) A necessary condition of optimality for a point z Ω to be a solution of the minimization problem (42) is that z solves the variational inequality
φ ( z ) , x z 0 , x Ω .
Equivalently, x Ω solves the fixed point equation
z = Q Ω ( z α φ ( z ) )
for every constant α > 0 . If, in addition, φ is convex, then the optimality condition (43) is also sufficient.
Theorem 2.
Let E be the real Euclidean n-space R n . Assume that φ is differentiable and the gradient φ is ι-Lipschitzian and κ-strongly monotone with constants ι , κ > 0 . Let A be m-accretive and B i be β i -inverse-strongly accretive with constants β i > 0 for each i = 1 , 2 , , N , and β = min { β i : 1 i N } . Assume 0 < δ < 2 κ ι 2 and Ω = i = 1 N ( A + B i ) 1 ( 0 ) . Let { p n } be a sequence generated by
Algorithm 3: The modified hybrid forward–backward algorithm.
Mathematics 09 01365 i003
Assume that { η n } , { v n } , { γ n } and { μ n } are real number sequences in [0, 1] satisfying:
(i) 
0 < lim   inf n v n lim   sup n v n < 2 β ι 2 ;
(ii) 
lim n η n = 0 , i = 1 η n = ;
(iii) 
lim n μ n η n p n p n 1 = 0 ;
(iv) 
i = 1 N γ n = 1 .
Then, { p n } generated by Algorithm 2 converges strongly to a point z Ω , which is also the unique solution of the minimization problem (42).

5. Numerical Examples

The purpose of this section is to give a numerical example supporting Theorem 1.
Example 3.
Let E = R with the inner product defined by x , y = x y for all x , y R and the standard norm | · | . Let A : R R be defined as A x = 3 x for all x R . Let B i : R R be defined as B i x = i 6 x for each i = 1 , 2 , , 30 . Let S i : R R be defined as S i x = x for each i = 1 , 2 , , 30 . It is easy to check that Ω = { 0 } and A is maximal monotone. Additionally, it is easy to check that B i is 6 i -inverse-strongly accretive for each i = 1 , 2 , , 30 and S i is 1-Lipschitzian and 1-strongly monotone for each i = 1 , 2 , , 30 . Let us choose μ n = 0 , η n = 1 n , v n = 1 3 , δ = 1 4 and γ i = 2 3 i + 1 30 × 3 30 for each i { 1 , 2 , , 30 } . Then { μ n } , { η n } , { v n } , { γ n } and δ satisfy all the conditions of Theorem 1. Therefore Algorithm 2 becomes
p n + 1 = 1 2 1 1 4 n 1 1 3 i = 1 30 2 3 i + 1 30 × 3 30 i 6 p n , n 1 .
In this example, we compare the efficiency of Algorithm 2 with Algorithm 1 and the efficiency of Algorithm 2 with (6). It is easily seen that Algorithm 2 is more general while Algorithm 1 and (6) are its special cases. As a matter of fact, if B i = B j and S i = S j for all i , j { 1 , 2 , , 30 } , then Algorithm 2 is reduced to Algorithm 1. Furthermore, if δ = 0 , then Algorithm 2 collapses to (6).
In Algorithm 1, let { μ n } , { η n } , { v n } , { γ n } , δ and A be same as those in Example 3. Let B , S : R R be defined by B x = 1 6 x and S ( x ) = x , respectively. As shown in Table 1 and Figure 1, it is trivial to see that Algorithm 2 clearly converges much more quickly than Algorithm 1.
In addition, if we set δ = 0 , then Algorithm 1 is reduced to (6). As shown in Table 2 and Figure 2, Algorithm 2 still converges more quickly than (6).

6. Conclusions

In this paper, we study a new modified inertial forward–backward algorithm for finding a common solution of the quasi-variational inclusion problem and the variational inequality problem in a q-uniformly smooth Banach space. Under suitable assumptions, we established a strong convergence theorem for approximating the unique solution of the abovementioned problems. Some applications and numerical experiments of the established results are given to further illustrate the applicability of our results. In our future work, we plan to extend our results to more general Banach spaces.

Author Contributions

Conceptualization, Y.S. and M.P.; funding acquisition and supervision, M.P.; writing—original draft preparation, Y.S.; writing—review and editing and software, Y.S. and M.P. All authors have read and agreed to the published version of the manuscript.

Funding

This research was supported by the Key Scientific Research Project for Colleges and Universities in Henan Province (grant number 20A110038).

Data Availability Statement

All data in this research are available at request.

Acknowledgments

The authors would like to thank the reviewers and the editor for their valuable comments, which have helped us to significanly improve the original manuscript.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Martinet, B. Regularisation d’inéquations variationelles par approximations successives. Rev. Fr. Informat. Rech. Oper. 1970, 4, 154–158. [Google Scholar]
  2. Martinet, B. Détermination approchée d’un point fixe d’une application pseudo-contractante. Cas L’Application Prox’ C.R. Acad. Sci Paris Sér. A Math. 1972, 274, 163–165. [Google Scholar]
  3. Rockafellar, R.T. Monotone operators and the proximal point algorithm. SIAM J. Control Optim. 1976, 14, 877–898. [Google Scholar] [CrossRef] [Green Version]
  4. Rockafellar, R.T. Augmented Lagrangians and applications of the proximal point algorithm in convex programming. Math. Oper. Res. 1976, 1, 97–116. [Google Scholar] [CrossRef]
  5. Bruck, R.E.; Reich, S. Nonexpansive projections and resolvents of accretive operators in Banach spaces. Houst. J. Math. 1977, 3, 459–470. [Google Scholar]
  6. Bauschke, H.H.; Combettes, P.L. Convex Analysis and Monotone Operator Theory in Hilbert Spaces; Springer: New York, NY, USA, 2011. [Google Scholar]
  7. Cholamjiak, P. A generalized forward-backward splitting method for solving quasi inclusion problems in Banach spaces. Numer. Algor. 1994, 8, 221–239. [Google Scholar] [CrossRef]
  8. Combettes, P.L.; Wajs, V.R. Signal recovery by proximal forward-backward splitting. Multiscale Model. Simul. 2005, 4, 1168–1200. [Google Scholar] [CrossRef] [Green Version]
  9. López, G.; Martín-Márquez, V.; Wang, F.H.; Xu, H.K. Forward-Backward splitting methods for accretive operators in Banach spaces. Abstr. Appl. Anal. 2012, 2012, 109236. [Google Scholar] [CrossRef] [Green Version]
  10. Dadashi, V.; Postolache, M. Forward-backward splitting algorithm for fixed point problems and zeros of the sum of monotone operators. Arab. J. Math. 2020, 9, 89–99. [Google Scholar] [CrossRef] [Green Version]
  11. Tseng, P. A modified forward-backward splitting method for maximal monotone mappings. SIAM J. Control Optim. 2000, 38, 431–446. [Google Scholar] [CrossRef]
  12. Liu, L.; Qin, X.; Yao, J.C. A hybrid forward-backward algorithm and its optimization application. Mathematics 2020, 8, 447. [Google Scholar] [CrossRef] [Green Version]
  13. Alvarez, F.; Attouch, H. An inertial proximal method for monotone operators via discretization of a nonlinear oscillator with damping. Set-Valued Anal. 2001, 9, 3–11. [Google Scholar] [CrossRef]
  14. Polyak, B.T. Introduction to Optimization; Optimization Software: New York, NY, USA, 1987. [Google Scholar]
  15. Polyak, B.T. Some methods of speeding up the convergence of iterarive metheods. Zh. Vychisl. Mat. Mat. Fiz. 1964, 4, 1–17. [Google Scholar]
  16. Lorenz, D.A.; Pock, T. An inertial forward-backward algorithm for monotone inclusions. J. Math. Imaging Vis. 2015, 51, 311–325. [Google Scholar] [CrossRef] [Green Version]
  17. Bauschke, H.H.; Combettes, P.L. A weak-to-strong convergence principle for Fejér-monotone methods in Hilbert spaces. Math. Oper. Res. 2001, 26, 248–264. [Google Scholar] [CrossRef] [Green Version]
  18. Yao, Y.; Cho, Y.J.; Liou, Y.C. Algorithms of common solutions for variational inclusions, mixed equilibrium problems and fixed point problems. Eur. J. Oper. Res. 2011, 212, 242–250. [Google Scholar] [CrossRef]
  19. Thong, D.V.; Cholamjiak, P. Strong convergence of a forward-backward splitting method with a new step size for solving monotone inclusions. Comput. Appl. Math. 2019, 38, 1–16. [Google Scholar] [CrossRef]
  20. Yao, Z.; Wu, Y.K.; Wen, C.F. Strong convergence analysis of iterative algorithms for solving variational inclusions and fixed-point problems of pseudocontractive operators. J. Math. 2021, 2021, 1–7. [Google Scholar] [CrossRef]
  21. Tan, B.; Qin, X.; Yao, J.C. Strong convergence of self-adaptive inertial algorithms for solving split variational inclusion problems with applications. J. Sci. Comput. 2021, 87, 1–34. [Google Scholar] [CrossRef]
  22. Reich, S. Asymptotic behavior of contractions in Banach spaces. J. Math. Anal. Appl. 1973, 44, 57–70. [Google Scholar] [CrossRef] [Green Version]
  23. Song, Y.L.; Ceng, L.C. A general iteration scheme for variational inequality problem and common fixed point problems of nonexpansive mappings in q-uniformly smooth Banach spaces. J. Glob. Optim. 2013, 57, 1327–1348. [Google Scholar] [CrossRef]
  24. Xu, H.K. Inequalities in Banach spaces with applications. Nonlinear Anal. 1991, 16, 1127–1138. [Google Scholar] [CrossRef]
  25. Pongsakorn, S.; Poom, K. Iterative methods for variational inequality problems and fixed point problems of a countable family of strict pseudo-contractions in a q-uniformly smooth Banach space. Fixed Point Theory Appl. 2012, 2012. [Google Scholar] [CrossRef] [Green Version]
  26. Song, Y.L.; Ceng, L.C. Convergence theorems for accretive operators with nonlinear mappings in Banach spaces. Abstr. Appl. Anal. 2014, 12, 1–12. [Google Scholar] [CrossRef]
  27. Xu, H.K. Iterative algorithm for nonlinear operators. J. Lond. Math. Soc. 2002, 2, 1–17. [Google Scholar] [CrossRef]
  28. Mitrinović, D.S. Analytic Inequalities; Springer: New York, NY, USA, 1970. [Google Scholar]
  29. Maingé, P.E. The viscosity approximation process for quasi-nonexpansive mappings in Hilbert spaces. Comput. Math. Appl. 2010, 59, 74–79. [Google Scholar] [CrossRef] [Green Version]
  30. Song, Y.L.; Ceng, L.C. Strong convergence of a general iterative algorithm for a finite family of accretive operators in Banach spaces. Fixed Point Theory Appl. 2015, 2015, 90. [Google Scholar] [CrossRef] [Green Version]
  31. Xu, H.K. Viscosity approximation methods for nonexpansive mappings. J. Math. Anal. Appl. 2004, 298, 279–291. [Google Scholar] [CrossRef] [Green Version]
  32. Meng, S.; Xu, H.K. Remarks on the gradient-projection algorithm. J. Nonlinear Anal. Optim. 2010, 1, 35–43. [Google Scholar]
Figure 1. Comparison results 2.
Figure 1. Comparison results 2.
Mathematics 09 01365 g001
Figure 2. Comparison results 2.
Figure 2. Comparison results 2.
Mathematics 09 01365 g002
Table 1. Comparison results 1.
Table 1. Comparison results 1.
Iter p 1 = 1 p 1 = 1 2
Algo. 2Algo. 1Algo. 2Algo. 1
n p n p n p n p n
11.0000000000001.0000000000000.5000000000000.500000000000
20.3437500000000.3541666666670.1718750000000.177083333333
30.1378580729170.1463396990740.0689290364580.073169849537
40.0579195375800.0633461197380.0289597687900.031673059869
50.0248873013040.0280438550920.0124436506520.014021927546
60.0108363457760.0125807849930.0054181728880.006290392496
70.0047597143770.0056933876530.0023798571890.002846693827
80.0021036237650.0025925247350.0010518118820.001296262367
90.0009340308640.0011859900480.0004670154320.000592995024
100.0004162058830.0005444938880.0002081029410.000272246944
Table 2. Comparison results 2.
Table 2. Comparison results 2.
Iter p 1 = 1 3 p 1 = 1 6
Algo. 2Algo. (6)Algo. 2Algo. (6)
n p n p n p n p n
10.3333333333330.3333333333330.1666666666670.166666666667
20.1145833333330.1574074074070.0572916666670.078703703704
30.0459526909720.0743312757200.0229763454860.037165637860
40.0193065125270.0351008802010.0096532562630.017550440101
50.0082957671010.0165754156510.0041478835510.008287707825
60.0036121152590.0078272796130.0018060576290.003913639806
70.0015865714590.0036962153730.0007932857300.001848107686
80.0007012079220.0017454350370.0003506039610.000872717519
90.0003113436210.0008242332120.0001556718110.000412116606
100.0001387352940.0003892212390.0000693676470.000194610619
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Song, Y.; Postolache, M. Modified Inertial Forward–Backward Algorithm in Banach Spaces and Its Application. Mathematics 2021, 9, 1365. https://doi.org/10.3390/math9121365

AMA Style

Song Y, Postolache M. Modified Inertial Forward–Backward Algorithm in Banach Spaces and Its Application. Mathematics. 2021; 9(12):1365. https://doi.org/10.3390/math9121365

Chicago/Turabian Style

Song, Yanlai, and Mihai Postolache. 2021. "Modified Inertial Forward–Backward Algorithm in Banach Spaces and Its Application" Mathematics 9, no. 12: 1365. https://doi.org/10.3390/math9121365

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop