Abstract
Mann’s iteration process for finding a fixed point of a nonexpansive mapping in a Banach space is considered. This process is known to converge weakly in some class of infinite-dimensional Banach spaces (e.g., uniformly convex Banach spaces with a Fréchet differentiable norm), but not strongly even in a Hilbert space. Strong convergence is therefore a nontrivial problem. In this paper we provide certain conditions either on the underlying space or on the mapping under investigation so as to guarantee the strong convergence of Mann’s iteration process and its variants.
MSC:
47H09; 47H10; 47J25
1. Introduction
Let X be a real Banach space with norm , let C be a nonempty closed convex subset of X, and let be a nonexpansive mapping (i.e., for ). We use to denote the set of fixed points of T; i.e., . It is known that is nonempty if X is uniformly convex and C is bounded. Mann’s iteration process [1], an averaged iterative scheme, is used to find a point in . This process generates a sequence via the recursive process:
where the initial point is arbitrary and . It is known [2] that if X is uniformly convex with a Fréchet differentiable norm, if is nonempty, and if , then the sequence generated by (1) converges weakly to a point in . However, the counterexample in [3] shows that the algorithm (1) fails, in general, to converge strongly even in Hilbert space unless C is compact [4]. Therefore, efforts have been made to study sufficient conditions to guarantee strong convergence of Mann’s algorithm (1) without assuming compactness of C. For instance, Gwinner [5] imposed the -accretiveness condition on to prove strong convergence of (1) in a uniformly convex Banach space. Some authors have made modifications of Mann’s iteration process in order to get strong convergence (see, e.g., [6,7,8]).
In this paper we continue to study the strong convergence of Mann’s iteration process. We improve Gwinner’s strongly convergent result ([5], Theorem 1) by removing the condition with . We also prove strong convergence of Mann’s iteration process in a reflexive Banach space with Opial’s and Kadec-Klee properties when is -accretive. A regularization method is introduced to approximate a fixed point of T. This method implicitly yields a sequence of approximate solutions and we shall prove (in Theorem 4) its strong convergence to a solution of a variational inequality. Combining this regularization method with Mann’s method, we obtain a new iteration process (see (22)) when the regularizer with f a contraction. We will prove that this process converges strongly in a Banach space whenever the sequence of approximate solutions of the implicit regularization converges strongly.
We use the notation:
- “” stands for the weak convergence of to x,
- “” stands for the strong convergence of to x,
- is the set of all weak accumulation points of the sequence .
2. Preliminaries
2.1. Uniform Convexity
Let X be a real Banach space with norm . Recall that the modulus of convexity of X is defined as (cf. [9])
We say that X is uniformly convex if
Examples of uniformly convex Banach spaces include Hilbert spaces H and (and also ) spaces for . As a matter of fact, the moduli of convexity of these spaces are
and
The following inequality characterization of uniform convexity is convenient in application.
Proposition 1
([10]). Let X be a uniformly convex Banach space. Then for each fixed real number , there exists a strictly increasing continuous function , , satisfying the property:
for all such that and , and .
Recall that a Banach space X is said to satisfy the Kadec-Klee property (also known as property (H)) if the (sequential) weak and strong topologies on the unit sphere coincide; equivalently, given any sequence and a point u in X, the following implication holds:
Every uniformly convex Banach space satisfies the Kadec-Klee property.
2.2. Duality Maps
Let X be a real Banach space with norm . The notion of general duality maps on X was introduced by Browder [11,12,13,14]. By a gauge we mean a function satisfying the properties:
- (i)
- ,
- (ii)
- is continuous and strictly increasing, and
- (iii)
- .
Associated with a gauge is the duality map ([12]) defined by
A special case is given by choosing the gauge for , where . In this case the corresponding duality map, which is denoted by and referred to as the generalized duality map of order p of X, is given by
In particular, we denote J for and call it the normalized duality map. In more detail, J is defined by
For a Hilbert space H, its normalized duality map is identified with the identity map I (with the dual space being identified with H through the Riesz canonical embedding).
Recall that a Banach space X is said to have a (sequentially) weakly continuous duality map if, for some gauge , the duality map is (sequentially) continuous when X is endowed with the weak topology and the dual space endowed with the weak-star topology. It is known that, for , the sequence space has a sequentially weakly continuous duality map ; while the function space does not [15]. However, the normalized duality map J of () is not weakly continuous [16], Proposition 3.2.
Proposition 2.
[17] Assume a Banach space X has a weakly continuous duality map for some gauge μ. If is a sequence in X weakly convergent to a point u, then we have
where Ψ is defined by , . In particular, X satisfies the Opial property ([15]):
whenever is a sequence in X weakly convergent to u.
2.3. Demiclosedness Principle for Nonexpansive Mappings
Let C be a nonempty closed convex subset of a Banach space X and let be a nonexpansive mapping. Recall that is said to be demiclosed if the graph of , is closed in the product space , where is endowed with the weak topology. Equivalently, is demiclosed if and only if the implication below holds:
This is called the demiclosedness principle for nonexpansive mappings, which holds in the following Banach spaces:
- Uniformly convex Banach spaces [12];
- Banach spaces satisfying Opial’s property [15], in particular, Banach spaces with a weakly continuous duality map for some gauge .
2.4. Accretive Operators
Let C be a nonempty closed convex subset of a Banach space X. Recall that an operator is said to be accretive (cf. [18]) if, for each ,
Here is the normalized duality map (or a selection in the case of multivalued).
Definition 1
([5,19]). Let be a continuous, strictly increasing function with and . Then we say that an operator is φ-accretive (or uniformly φ-accretive, respectively) if
for all , or respectively,
for all , where J is the normalized duality map of X.
Notice that if S is -accretive, then the set of zeros of S, , consists of at most one point. In fact, if , we must have This implies .
2.5. A Useful Lemma
The lemma below is helpful in proving strong convergence of a sequence to a point x in a Banach space by proving convergence to zero of the real sequence .
Lemma 1
([20,21] Lemma 2.2). Assume is a sequence of nonnegative real numbers satisfying the condition:
where and are sequences in (0,1) and is a sequence in . Assume
- (i)
- ,
- (ii)
- (or ),
- (iii)
- .
Then .
3. Strong Convergence Analysis of Mann’s Iteration Process
3.1. Strong Convergence of Mann’s Algorithm
Let X be a real Banach space, let C be a nonempty closed convex subset of X, and let be a nonexpansive mapping with a fixed point. We use to note the set of fixed points of T. It is known that if X is strictly convex, then is convex. For finding a fixed point of T, Mann’s iterative algorithm [1] (see also [22]) is often used. This algorithm generates a sequence as follows:
where the initial point is arbitrary, and for all .
Lemma 2.
[23] In a Banach space X, let be a nonexpansive mapping and let be a sequence generated by Mann’s method (10). Then
- (i)
- for each , the sequence is nonincreasing, and
- (ii)
- the sequence is nonincreasing.
Consequently, both and exist.
We begin with a strong convergence result on the Mann algorithm (10), which improves ( [5], Theorem 1) by removing the restriction of with .
Theorem 1.
Let X be a real uniformly convex Banach space, let C be a nonempty closed convex subset of X, and let T be a nonexpansive self-mapping of C with . Suppose is φ-accretive and satisfies the divergence condition
Then converges in norm to a fixed point of T.
Proof.
First observe that the -accretiveness of implies that T has a unique fixed point, i.e., is singleton. Set . By Lemma 2(i), for all n. Applying Proposition 1(i), we get
It turns out that
Consequently,
The divergence condition (11) together with Lemma 2(ii) implies that . By the demiclosedness principle of , we have that . This proves that .
Now using the -accretiveness of , we obtain
It turns out that . Therefore, the Kadec-Klee property of the uniform convexity of X implies that . The proof is complete. □
Remark 1.
The conclusion of Theorem 1 remains true if the uniform convexity of X is weakened to strict convexity together with the Kadec-Klee property, and if is demiclosed.
Theorem 2.
Let X be a reflexive Banach space satisfying Opial’s condition and the Kadec-Klee property, let C be a nonempty closed convex subset of X, and let T be a nonexpansive self-mapping of C with . Suppose is φ-accretive and satisfies the conditions
Then converges in norm to a fixed point of T.
Proof.
We sketch the proof here. Under the condition (13), we have by ([24], Lemma 2) that strongly. Now Opial’s property together with the fact that exists for every [Lemma 2(i)] implies that the sequence converges weakly to a point z in . In the meanwhile, we still have (12) which implies . Now the strong convergence of to z follows from the Kadec-Klee property of X. □
Remark 2.
3.2. Regularization
Finding a fixed point of a nonexpansive mapping T is equivalent to finding a zero of the accretive operator . Thus regularization methods may apply. In [5], Gwinner introduced the regularization operator , where is a regularization parameter and is a mapping which is referred to as regularizer. The following result on this regularization was proved.
Theorem 3
([5] Theorem 2). Let X be a uniformly convex Banach space, C a nonempty closed convex subset of X, and T a nonexpansive self-mapping of C with . Assume is a continuous, bounded, uniformly φ-accretive operator. Assume the normalized duality map is weakly sequentially continuous. Choose positive real numbers and such that
- (i)
- ,
- (ii)
- .
If the approximate solutions satisfy
then the sequence converges strongly to a fixed point of T, which is uniquely determined by the variational inequality:
Remark 3.
The condition in Theorem 3 that the normalized duality map be weakly continuous is quite restrictive because this condition rules out the applicability of Theorem 3 to the uniformly convex sequence space () since the normalized duality map J of () fails to be weakly continuous ([16], Proposition 3.2).Below we use the condition that X admits a weakly continuous duality map for some gauge μ; as a result, our theorem applies to every space () which has a weakly continuous duality map with gauge for .
Our next result improves Theorem 3 (i.e., [5], Theorem 2) twofold: first we remove the uniform convexity of the space X and secondly, we replace the normalized duality map J with a general duality map for some gauge , the latter being more flexible in applications (such as spaces for ).
Theorem 4.
Assume X is a reflexive Banach space with a weakly sequentially continuous duality map for some gauge μ, C a nonempty closed convex subset of X, and a nonexpansive mapping with . Assume is a continuous, bounded, uniformly φ-accretive operator. Assume and satisfy the conditions (i) and (ii) in Theorem 3. Then the sequence of approximate solutions determined by (14) converges strongly to the unique solution of the variational inequality (15).
Proof.
First observe that, since the duality maps and J satisfy the relation
the uniform -accretiveness of R, (8), can equivalently be rephrased as
Now set
where . It turns out from (14) that
Also, since T is nonexpansive (so that is accretive), we have for
for . It follows that
Using (16) and (17), we get, for ,
If , i.e., , then it follows from the last relation that
Consequently, we obtain
Hence, is bounded, and for all n. Now since R is a bounded operator, is also bounded. It then turns out from (14) that Since is demiclosed, . Let and be a subsequence of weakly converging to . Substituting for z in (18) yields
Since and weakly, due to the weak continuity of the duality map , the last relation ensures , which in turns implies that strongly. Returning to (17) via the subsequence and using the continuity of R gives that for all . That is, is a solution to the variational inequality (15). It remains to show that (15) has a unique solution. To see this, we assume and both are solutions of (15). We then have
Adding them up and making use of the uniform -accretiveness of R yields
It follows immediately that and the solution of the variational inequality (15) is unique. Hence, we have verified that the sequence converges strongly to the unique solution of (15). □
Take R to be of the form
where is an -contraction, with . Namely,
Then it is easy to find that R is uniformly -accretive with for (namely, is strongly accretive):
Consequently, the following result is a direct consequence of Theorem 4.
Corollary 1.
Assume X is a reflexive Banach space with a weakly sequentially continuous duality map for some gauge μ, C a nonempty closed convex subset of X, and a nonexpansive mapping with . Assume is an α-contraction for some . Assume and satisfy the conditions (i) and (ii) in Theorem 3. Then the sequence of approximate solutions determined by
converges strongly to the unique solution of the variational inequality:
Remark 4.
Theorem 4 and Corollary 1 both are applicable to spaces for each since the generalized duality map of with gauge is weakly continuous; Gwinner’s theorem ([5], Theorem 2) however is not applicable since the normalized duality map J of for is not weakly continuous.
Applying Mann’s iteration method to the regularized operator with the regularizer R of form (19) leads to the iteration process [5], which we call regularized Mann iteration method:
where the initial point is arbitrary, is an -contraction with , and for .
The convergence of this algorithm depends on the convergence of the approximate scheme (20) as shown below.
Theorem 5.
Assume X is a Banach space, C a nonempty closed convex subset of X, and a nonexpansive mapping with . Assume is an α-contraction with . Assume , , and satisfy the conditions:
- (C1)
- ,
- (C2)
- ,
- (C3)
- ,
- (C4)
- .
Proof.
We rewrite (20) as
where is the error such that for all n. It turns out from (23) that
where is a constant such that for all n. This implies that
Using the definition (22) of , we obtain
Substituting (24) into (25) yields, for ,
where
The conditions (C2)–(C4) assert that . Noticing condition (C1), we can apply Lemma 1 to Equation (26) to conclude . Now since it is assumed that , the unique solution of the variational inequality (21), it is also that . This finishes the proof. □
Remark 5.
It is not hard to find that the four conditions (C1)–(C4) in Theorem 5 are satisfied for the choices of for , where are such that and .
Remark 6.
To the best of our knowledge, it looks to be the first time in the literature to use the approximate solutions to study strong convergence of the regularized Mann’s iteration process (22). Previously, exact solutions were used (see, e.g., [5]). Here is the exact fixed point of the contraction :
A key assumption in Theorem 5 is that the sequence be strongly convergent, which has been proved in a reflexive Banach space with a weakly continuous duality map in Theorem 4. Consequently, we have the following result.
Corollary 2.
Assume X is a reflexive Banach space with a weakly sequentially continuous duality map for some gauge μ (in particular, for ), C a nonempty closed convex subset of X, and a nonexpansive mapping with . Assume is an α-contraction for some . Assume the sequence satisfies (20) and let be generated by the regularized iteration process (22). Suppose satisfy the conditions (C1)–(C4) in Theorem 5. Then converges strongly to the unique solution of the variational inequality (21).
Author Contributions
H.-K.X., N.A. and S.C. contributed equally in this research paper. All authors have read and agreed to the published version of the manuscript.
Funding
The authors extend their appreciation to the Deanship of Scientific Research at King Saud University for funding this work through research group no (RG-1440-058).
Acknowledgments
The authors were grateful to the three anonymous referees for their helpful comments which improved the presentation of this manuscript.
Conflicts of Interest
The authors declare no conflict of interest.
References
- Mann, W.R. Mean value methods in iteration. Proc. Amer. Math. Soc. 1953, 4, 506–510. [Google Scholar] [CrossRef]
- Reich, S. Weak convergence theorems for nonexpansive mappings in Banach spaces. J. Math. Anal. Appl. 1979, 67, 274–276. [Google Scholar] [CrossRef]
- Genel, A.; Lindenstrauss, J. An example concerning fixed points. Israel J. Math. 1975, 22, 81–86. [Google Scholar] [CrossRef]
- Krasnoselski, M.A. Two remarks on the method of successive approximation. Uspehi Mat. Nauk 1955, 10, 123–127. [Google Scholar]
- Gwinner, J. On the convergence of some iteration processes in uniformly convex Banach spaces. Proc. Amer. Math. Soc. 1978, 71, 29–35. [Google Scholar] [CrossRef]
- Kim, T.W.; Xu, H.K. Strong convergence of modified Mann iterations. Nonlinear Anal. 2005, 61, 51–60. [Google Scholar] [CrossRef]
- Nakajo, K.; Takahashi, W. Strong convergence theorems for nonexpansive mappings and nonexpansive semigroups. J. Math. Anal. Appl. 2003, 279, 372–379. [Google Scholar] [CrossRef]
- Yao, Y.; Zhou, H.; Liou, Y. Strong convergence of a modified Krasnoselski-Mann iterative algorithm for non-expansive mappings. J. Appl. Math. Comput. 2009, 29, 383–389. [Google Scholar] [CrossRef]
- Cioranescu, I. Geometry of Banach Spaces, Duality Mappings and Nonlinear Problems; Kluwer Academic Publishers: Dordrecht, The Netherlands, 1990. [Google Scholar]
- Xu, H.K. Inequalities in Banach spaces with applications. Nonlinear Anal. Theory Methods Appl. 1991, 16, 1127–1138. [Google Scholar] [CrossRef]
- Browder, F.E. Fixed point theorems for nonlinear semicontractive mappings in Banach spaces. Arch. Rational Mech. Anal. 1966, 21, 259–269. [Google Scholar] [CrossRef]
- Browder, F.E. Convergence theorems for sequences of nonlinear operators in Banach spaces. Math. Z. 1967, 100, 201–225. [Google Scholar] [CrossRef]
- Browder, F.E. Convergence of approximants to fixed points of nonexpansive non-linear mappings in Banach spaces. Arch. Rational Mech. Anal. 1967, 24, 82–90. [Google Scholar] [CrossRef]
- Browder, F.E. Nonlinear Operators and Nonlinear Equations of Evolution in Banach Spaces. In Proceedings of Symposia in Pure Mathematics; American Mathematical Society: Providence, RI, USA, 1976; Volume 18. [Google Scholar]
- Opial, Z. Weak convergence of the successive approximations for non expansive mappings in Banach spaces. Bull. Amer. Math. Soc. 1967, 73, 591–597. [Google Scholar] [CrossRef]
- Xu, H.K.; Kim, T.W.; Yin, X. Weak continuity of the normalized duality map. J. Nonlinear Convex Anal. 2014, 15, 595–604. [Google Scholar]
- Lim, T.C.; Xu, H.K. Fixed point theorems for asymptotically nonexpansive mappings. Nonlinear Anal. 1994, 22, 1345–1355. [Google Scholar] [CrossRef]
- Dominguez Benavides, T.; López Acedo, G.; Xu, H.K. Iterative solutions for zeros of accretive operators. Math. Nachr. 2003, 248–249, 62–71. [Google Scholar] [CrossRef]
- Brezis, H.; Sibony, M. Methodes d’approximation et d’iteration pour les operateurs monotones. Arch. Rational Mech. Anal. 1968, 28, 59–82. [Google Scholar] [CrossRef]
- López, G.; Martín-Márquez, V.; Xu, H.K. Perturbation techniques for nonexpansive mappings with applications. Nonlinear Anal. Real World Appl. 2009, 10, 2369–2383. [Google Scholar] [CrossRef]
- Xu, H.K. Iterative algorithms for nonlinear operators. J. London Math. Soc. 2002, 66, 240–256. [Google Scholar] [CrossRef]
- Dotson, W.G. On the Mann iterative process. Trans. Amer. Math. Soc. 1970, 149, 65–73. [Google Scholar] [CrossRef]
- Borwein, J.; Reich, S.; Shafrir, I. Krasnoselskii-Mann iterations in normed spaces. Canad. Math. Bull. 1992, 35, 21–28. [Google Scholar] [CrossRef]
- Ishikawa, S. Fixed points and iteration of a nonexpansive mapping in a Banach space. Proc. Amer. Math. Soc. 1976, 59, 65–71. [Google Scholar] [CrossRef]
© 2020 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).