Abstract
In this article, we introduce, for the first time, multivariate symmetrized and perturbed hyperbolic tangent-activated convolution-type operators in three forms. We present their approximation properties, that is, their quantitative convergence to the unit operator via the multivariate modulus of continuity. We continue with the multivariate global smoothness preservation of these operators. We present, in detail, the related multivariate iterative approximation, as well as, multivariate simultaneous approximation, and their combinations. Using differentiability in our research, we produce higher rates of approximation, and multivariate simultaneous global smoothness preservation is also achieved.
Keywords:
symmetrized and perturbed hyperbolic tangent; multidimensional convolution-type operator; quantitative multivariate approximation; global smoothness preservation; simultaneous approximation; iterative approximation MSC:
26A33; 41A17; 41A25; 41A35; 47A58
1. Organization
In Section 2 we give the preliminaries of our theory. In Section 3, we present the basics, as well as an introduction to our multivariate symmetrized and perturbed hyperbolic tangent-activated convolution-type operators and their properties. In Section 4, we present the main multivariate approximation results. We also include the multivariate global smoothness preservation achieved by our operators. We further study the differentiation of these operators, and we introduce their iterations and give their basic properties. Next, we present the convergence of our operators under differentiability, achieving higher rates of approximation. Following this, we present the multivariate simultaneous differential approximation and, in detail, the multivariate simultaneous global smoothness preservation, as well as the multivariate iterative approximation. We finish with the combination of multivariate simultaneous and iterative approximations.
We are motivated and inspired by [1,2,3].
Other related recent interesting developments in this field are given in the works [4,5,6,7,8,9,10,11,12,13,14,15,16,17].
2. Symmetrization Related to -Deformed and -Parametrized Hyperbolic Tangent Function
In this section, all of the initial background information comes from Chapter 18 in [1].
We use (see (1)), and exhibit that it is a sigmoid function and we will present several of its properties related to approximation by neural network operators.
So, let us consider the activation function
We determine that
We also notice that
That is,
and
Hence,
We obtain
i.e.,
Furthermore,
i.e.,
We find that
Therefore, is strictly increasing.
Next, we obtain ():
We observe that
So, in the case of , we determine that is strictly concave up, with
And in the case of , we determine that is strictly concave down.
Clearly, is a shifted sigmoid function with , and (a semi-odd function).
Based on , , we consider the function
; . Notice that , so the x-axis is a horizontal asymptote.
We determine that
Thus,
a deformed symmetry.
Next, we determine that
Let ; then, and (based on being strictly concave up for ), that is, . Hence is strictly increasing over
Now, let ; then, , and , that is,
Therefore is strictly decreasing over
Let us next consider We determine that
Clearly, according to (13), we determine that for
More precisely, is concave down over , and strictly concave down over
Consequently, has a bell-type shape over
Of course, it holds that
At , we have
Thus,
That is, is the only critical number of over . Hence, at achieves its global maximum, which is
Conclusion: The maximum value of is
We mention the following:
Theorem 1
([1], Ch. 18, p. 458). We determine that
Also, the following holds:
Theorem 2
([1], Ch. 18, p. 459). It holds that
So that is a density function on
Similarly, we determine that
so that is a density function.
Furthermore, we observe the important symmetry
Furthermore
is a new density function over , i.e.,
Clearly, then,
An essential property follows:
Theorem 3
([2]). Let , . Then,
We need the following:
Proposition 1
([2]). It holds for () that
We mention the following:
Definition 1.
The modulus of continuity here is defined by
where is bounded and continuous, denoted by , . Similarly, is defined for (uniformly continuous functions). We determine that , iff as
Denote ,
3. Basics
We establish the following:
Remark 1.
We introduce
It has the following properties:
- (i)
- , ∀
- (ii)
Hence,
- (iii)
- (iv)
- according to (23),
That is, Z is a multivariate density function.
- (v)
- Let , . Then, using Theorem 3 and (24), we derive that
The latter is true, because the condition any , implies that there exists at least one , where
Indeed, the following holds for some
We also mention a useful related result.
Theorem 4.
It holds for () that
When , (34) is again valid.
Proof.
We determine that
(according to a convexity argument)
proving the claim. □
We will use the following differentiation result.
Theorem 5
(H. Bauer [18], pp. 103–104). Let be a measure space. Let U be an open subset of , , and let be a function with the following properties:
- (a)
- is μ-integrable for all .
- (b)
- is, at each point in U, partially differentiable with respect to .
- (c)
- There exists a μ-integrable function on Ω such that
Then, the function , defined on U as
is partially differentiable with respect to on all of U. The mapping is μ-integrable, and we have
We give the following:
Definition 2.
Let , . We define the following activated symmetrized and perturbed hyperbolic tangent multivariate convolution-type operators:
The basic one:
The activated Kantorovich type:
Now, let , , , such that
and
where
We define the activated quadrature operators
One can rewrite
and
, ∀
For some , the above operators can exist.
In this work, we study the approximation properties of the operators , and , especially their convergence to the unit operator
4. Main Results
We present the following approximation results:
Theorem 6.
Let , , , . Then,
and
where is the supremum norm.
So, for , we determine that , pointwise and uniformly.
Proof.
Call
and
That is,
We determine that
□
We continue with the following.
Theorem 7.
This theorem is all as in Theorem 6. Then,
and
For we determine that , pointwise and uniformly.
Proof.
We notice that
Thus, it holds that
We observe that
□
Thus, the following are true:
Theorem 8.
This theorem is all as in Theorem 6. Then,
and
For we determine that , pointwise and uniformly.
Proof.
We determine that
□
Next, we describe the global smoothness preservation property of our activated multivariate operators.
Theorem 9.
Here, . Then,
If , then .
Remark 2.
Let f be the projection function onto the coordinate, call it , , where Then, it holds that
Hence,
proving that
for any
So, (59) is an attained sharp inequality.
Furthermore,
and
Thus, is well defined.
Theorem 10.
Let . Then,
If , then .
Inequality (67) is an attained sharp inequality according to ,
Proof.
We do have
Thus, is well defined. □
Theorem 11.
Let . Then,
If , then .
Inequality (73) is an attained sharp inequality according to ,
Proof.
Let ; then,
and
Hence,
That is, (73) is true, and it is an attained sharp inequality according to ,
Thus, is well defined. □
We establish the following:
Remark 3.
Let be fixed. Assume that , . Here, denotes a partial derivative of f, , , , and , where
We also write , and we say it is of the order l.
We assume that any partial for all ,
Through the repeated application of Theorem 5, we obtain
Similarly, we determine that
and
for all ,
So, all of our results in this work can be written in the simultaneous approximation context (see Theorems 15–17).
We establish the following:
Remark 4.
Activated Iterative Multivariate Convolution
We determine that
∀, where
Let , as , and
We determine that
Furthermore, it holds that
according to the dominated convergence theorem, because we determine that
and is integrable over , ∀.
Hence, .
Furthermore it holds that
i.e.,
So, is a bounded positive linear operator.
Clearly, it holds that
And for , we obtain
so the contraction property is valid and is a bounded linear operator.
Remark 5.
Let . We observe that
Then,
Therefore,
Now, let , and as above.
Consequently, it holds, as in [1], Chapter 2, that
Next, we have
Remark 6.
We obtain
Let , as , and
as
This is true according to the bounded convergence theorem, and we determine that
and
where is a cube. Thus,
Therefore, it holds that
and we obtain
as ∀.
Furthermore, we have
with being integrable over .
Therefore according to the dominated convergence theorem,
Hence, is a bounded and continuous in .
Remark 7.
Next, we observe the following: Let , and
Let , as . Then,
as
The latter is obtained according go the dominated convergence theorem:
and
and
as ∀.
Furthermore, it holds that
in which the last function is integrable over .
Therefore,
Hence, is bounded and continuous in .
See the related Theorems 18 and 19, which we describe later.
Next, we greatly improve the speed of convergence of our activated multivariate operators by using the differentiation of functions.
Notation 1.
Let , . Here, denotes a partial derivative of f, , , and , where . We also write , and we say it is of the order l.
We denote
also written as
where is the supremum norm.
Theorem 12.
Let , ; , , with for all , , and , where Then,
- (i)
- (ii)
- Assume that for all , . We havewith a high speed of
- (iii)
- and
- (iv)
We determine that , as , pointwise and uniformly.
Proof.
Consider , ; . Then,
for all
We have the multivariate Taylor’s formula
Notice that . Also, for we have
Furthermore we obtain
So,
Thus, we determine, for , that
where
We see that
Notice here that
We further see that
Conclusion: When , we prove that
We prove, in general, that
Next, let
Then,
We prove that
Next, we estimate
so that the following holds:
We continue with the activated multivariate Kantorovich operators under differentiation.
Theorem 13.
Let , ; , , with , Then,
- (i)
- (ii)
- Assume that for all , ; we havewith a high speed of
- (iii)
- and
- (iv)
- We determine that , as , pointwise and uniformly.
Proof.
It holds that
where
We see that
Notice that
Here we consider ,
We further see that
Conclusion: When , we prove that
We prove, in general, that
Next, we see that
So, when , we obtain
and, in general, it holds that
Furthermore, it holds that
Let
We do have, under ,
Furthermore, we determine that
or, better still,
We prove that
Consequently, we derive that
Finally, we estimate
We derive that
The theorem is proven. □
We continue with the activated multivariate quadrature operators under differentiation.
Theorem 14.
Let , ; , , with Then,
- (i)
- (ii)
- Assume that for all , ; we havewith a high speed of
- (iii)
- and
- (iv)
We determine that , as , pointwise and uniformly.
Proof.
We determine that
where
We see that
Notice that
We further see that
Conclusion: When , we prove that
We establish, in general, that
Next, we observe that
So, when , we obtain
and it holds, in general, that
Furthermore, it holds that
Let
We derive, under ,
Furthermore, we determine that
As in the proof of Theorem 13, we obtain
Consequently, we derive that
At the end, we estimate
(as in the proof of Theorem 13)
The theorem is proven. □
Next comes the simultaneous multivariate activated approximation.
Theorem 15.
Let be fixed, with , . We assume that for , . Here, , , .
Then,
- (i)
- and
- (ii)
- andand
- (iii)
- and
Proof.
We prove Theorems 6–8 and Remark 3. □
Next comes simultaneous global smoothness preservation.
Theorem 16.
Let be fixed, with , . We assume that for , .
Then,
and
If , then , and
Proof.
We prove Theorems 9–11 and Remark 3. □
Under simultaneous activated multivariate extended differentiation, we derive the following result.
Theorem 17.
Let ; , . Let , denote a partial derivative of f, , , , and , where . We assume any for all , .
We further assume that , , with , . Then,
- (i)
- (ii)
- and
- (iii)
Proof.
We prove Theorems 12–14 and Remark 3. □
In the final part of this work, we present our results related to activated iterative approximation. This is a continuation of Remarks 4–6.
Theorem 18.
Let , , . Then,
- (I)
- (II)
- and
- (III)
So, the speed of convergence of , , to unit I is not worse than the speed of convergence of , , to I.
Proof.
We prove Theorems 6–8 and (87). □
We continue with the following:
Theorem 19.
Let , with , ; . Then,
- (I)
- (II)
- and
- (III)
Clearly, we notice that the speed of convergence to the unit operator of the above activated multiply iterated operator is not worse than the speed of operators , , and to the unit, respectively.
Proof.
We prove Theorems 6–8 and (89). □
We finish our work with multivariate simultaneous iterations.
Remark 8.
Let be fixed. Assume that , with , with , ; . Then, according to (87), we obtain
According to (78) and inductively, we obtain
Similarly, we derive that
and
Now, let . Then, based on (89), we find that
Similarly, we determine that
and
Conclusion: Here, we presented a new idea of going from neural networks’ main tools, the activation functions, to multivariate convolution integral approximation. This represents a rare case of applying applied mathematics to theoretical mathematics.
Funding
This research received no external funding.
Data Availability Statement
There are no data available, as this is a theoretical article.
Conflicts of Interest
The authors declare no conflicts of interest.
References
- Anastassiou, G.A. Parametrized, Deformed and General Neural Networks; Springer: Heidelberg, Germany; New York, NY, USA, 2023. [Google Scholar]
- Anastassiou, G.A. Approximation by symmetrized and perturbed hyperbolic tangent activated convolution type operators. Mathematics 2024, 12, 3302. [Google Scholar] [CrossRef]
- Anastassiou, G.A.; Gal, S.G. Approximation Theory; Birkhäuser: Boston, MA, USA; Basel, Switzerland; Berlin, Germany, 2000. [Google Scholar]
- Wang, Y.; Wang, T.; Liam, H. The series expansions and blow-up time estimation for the solutions of convolution Volterra-Hammerstein integral equations. Numer. Algorithms 2024, 95, 637–663. [Google Scholar] [CrossRef]
- Askhabov, S.N. A system of inhomogeneous integral equations of convolution type with power nonlinearity. Sib. Math. J. 2023, 64, 691–698. [Google Scholar] [CrossRef]
- Wang, M.; Dai, X.; Yu, Y.; Xiao, A. Fast θ-Maruyama scheme for stochastic Volterra integral equations of convolution type: Mean-square stability and strong convergence analysis. Comput. Appl. Math. 2023, 42, 108. [Google Scholar] [CrossRef]
- Angeloni, L.; Merentes, N.J.; Valera-López, M.A. Convolution integral operators in variable bounded variation spaces. Mediterr. J. Math. 2023, 20, 141. [Google Scholar] [CrossRef]
- Askhabov, S.N. System of inhomogeneous integral equations of convolution type with power nonlinearity. Vladikavkaz Math. J. 2022, 24, 5–14. (In Russian) [Google Scholar] [CrossRef]
- Khachatryan, K.A.; Petrosyan, A.S. Alternating bounded solutions of a class of nonlinear two-dimensional convolution-type integral equations. Trans. Mosc. Math. Soc. 2021, 82, 259–271. [Google Scholar] [CrossRef]
- Askhabov, S.N. Nonlinear convolution type integral equations in complex spaces. Ufim. Math. J. 2021, 13, 17–30. [Google Scholar] [CrossRef]
- Safaryan, M.H. On generalizations of Fatou’s theorem in Lp for convolution integrals with general kernels. J. Geom. Anal. 2021, 31, 3280–3299. [Google Scholar] [CrossRef]
- Karchevskii, A.L. Solution of the convolution type Volterra integral equations of the first kind by the quadtrature-sum method. Sib. Zh. Ind. Mat. 2020, 23, 40–52. Translation in J. Appl. Ind. Math. 2020, 14, 503–512. (In Russian) [Google Scholar] [CrossRef]
- Karapetrović, B.; Mashreghi, J. Hadamard convolution and area integral means in Bergman spaces. Results Math. 2020, 75, 70. [Google Scholar] [CrossRef]
- Khachatryan, K.A.; Petrosyan, H.S. On a class of convolution type nonlinear integral equations with an even kernel. Internat. J. Modern Phys. A 2022, 37, 2243014. [Google Scholar] [CrossRef]
- Sun, M.; Li, P.; Bai, S. A new efficient method for two classes of singular convolution integral equations of non-normal type with Cauchy kernel. J. Appl. Anal. Comput. 2022, 12, 2057–2074. [Google Scholar] [CrossRef] [PubMed]
- Pleshchinskii, N.B. The over-determined boundary value problems and convolution type integral transformations. Lobachevskii J. Math. 2022, 43, 1260–1269. [Google Scholar] [CrossRef]
- Khachatryan, K.A.; Petrosyan, H.S. On one class of multidimensional integral equations of convolution type with convex nonlinearity. Differ. Equ. 2022, 58, 680–690, Translation of Differ. Uravn. 2022, 58, 686–695.. [Google Scholar] [CrossRef]
- Bauer, H. Maß-und Integrations Theorie; de Gruyter: Berlin, Germany, 1990. [Google Scholar]
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2024 by the author. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).