Next Article in Journal
AgGaGeSe4: An Infrared Nonlinear Quaternary Selenide with Good Performance
Previous Article in Journal
Optimal Solution to the Two-Stage Hybrid Flow Shop Scheduling Problem with Removal and Transportation Times
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Multivariate Symmetric Interpolating Dual Multiwavelet Frames

by
Aleksandr Krivoshein
Faculty of Applied Mathematics and Control Processes, St. Petersburg State University, 7/9 Universitetskaya Emb., 199034 St. Petersburg, Russia
Symmetry 2022, 14(7), 1425; https://doi.org/10.3390/sym14071425
Submission received: 17 June 2022 / Revised: 4 July 2022 / Accepted: 7 July 2022 / Published: 11 July 2022
(This article belongs to the Special Issue Symmetry in Approximation Theory and Functional Analysis)

Abstract

:
The construction of symmetric multiwavelets in the multivariate case with useful in applications properties is a challenging task, mainly due to the complexity of the matrix extension problem. Nevertheless, for the interpolating case, a general technique can be developed. For an appropriate pair of symmetry group H and matrix dilation M and for a given H -symmetric interpolating refinable matrix mask, a method for the construction of H -symmetric dual refinable matrix masks with a preassigned order of sum rule is suggested. Wavelet matrix masks are constructed using a certain explicit matrix extension algorithm, and their symmetry properties are studied via its polyphase components. The resulting multiwavelet systems form dual multiwavelet frames, where wavelet functions have symmetry properties, preassigned order of vanishing moments and preassigned order of the balancing property. Several examples are presented.

1. Introduction

Wavelet systems are widely used in applied mathematics for signal analysis and synthesis, compression tasks, data preprocessing and feature extraction for neural networks and so on in a large number of applications (see, for example, [1,2,3,4,5,6]). The symmetry property is among the most desirable features for wavelets. Multiwavelets are a natural generalization of usual wavelets (see, for example, [7,8,9] for the pioneering works and [10] for the comprehensive treatment of the subject). Their construction is more flexible since multiwavelets can provide similar to usual wavelets properties but with shorter support or even provide incompatible for usual wavelets properties. For instance, in [11], examples of univariate refinable function vectors with dilation factor M = 2 , which are interpolating, orthonormal, continuous and with compact support simultaneously, were constructed. The paper is devoted to the construction of symmetric multiwavelet systems in the multivariate case with several other useful properties such that desirable number of vanishing moments and high order of the balancing property.
Let us briefly highlight current investigations on the problem of the construction of symmetric multiwavelets. In the univariate case, general methods for the construction of orthogonal and biorthogonal multiwavelets with symmetry were suggested in [12,13]. In the multivariate case, the development of the analogous general methods is a much more difficult task, due to the complexity of the matrix extension problem (see Section 4 for details). General results related to the multivariate extension principle for multiwavelets can be found, for example, in [14,15,16] and the references therein. The symmetry properties of wavelets for the multivariate case can be defined using the notion of symmetry groups (for details see Section 2 and also, for example, [17]). For a simple symmetry group H = { I d , I d } , symmetric multiwavelet systems based on lifting scheme were constructed in [18]. Additionally, for the same symmetry group, the construction of symmetric multiwavelet frames as a symmetrization of some multiwavelet frames was suggested in [19]. For a class of appropriate (in some natural sense) symmetry groups H , a numerical method for the construction of interpolating refinable function vectors and their duals with the H -symmetry property, based on solving certain linear systems of equations, was given in [20]. Additionally, a method for getting multiwavelets was suggested in [20], but there were no proofs concerning the properties of the obtained multiwavelet systems, such as symmetry and vanishing moments. A family of symmetric dual multiwavelet frames obtained by convolving scalar wavelets with multiwavelets from [20] in a Kronecker type manner was produced in [21]. To the best of the author’s knowledge, no other approaches related to the construction of symmetric multiwavelets in the multivariate case were suggested.
The results of the paper propose a method for the construction of dual multiwavelet frames, starting from symmetric interpolating refinable function vector in the multivariate case. The construction starts from a pair of appropriate symmetry group H and matrix dilation M (there are some restrictions on the choice of this pair in the interpolating case, see Section 3 for details). The initial symmetric interpolating matrix mask can be constructed using several methods developed in [20] or [22] (see also [23]). Any preassigned order of the sum rule can be provided for the matrix mask (this property is related to approximation properties of the resulting multiwavelet system). Next, a symmetric dual matrix mask is constructed in two steps. Firstly, a dual matrix mask is constructed using the algorithm in [24]. Further, a symmetrization step is completed. Again, any preassigned order of sum rule can be provided for the dual matrix mask. Finally, the matrix extension principle is used for the construction of wavelet matrix masks. The main point here is to extend two known blocks of rows with trigonometric polynomials up to square matrices of trigonometric polynomials such that the columns of these matrices are biorthogonal. Generally speaking, multivariate matrix extension is not a simple process. However, in the interpolating case, matrix extension can be done explicitly and the symmetry properties for wavelet functions can be provided.
The paper is organized as follows. In Section 2, basic notations and definitions are given, including the description of the action of a symmetry group on a set of digits, which is a key point in the description of symmetry properties for wavelet functions and their masks. Section 3 is devoted to the facts related to the construction of H -symmetric refinable matrix masks with a desirable order of sum rule. This is the starting point in the construction of multiwavelets. In Section 4.1, the construction of H -symmetric dual matrix masks with a desirable order of sum rule is presented. Section 4.2 describes the construction of dual multiwavelet systems with symmetry properties. In Section 4.3, the order of vanishing moments and the balancing property of the obtained multiwavelets are discussed together with some other aspects. In Section 5, several examples are presented.

2. Basic Notations and Definitions

For x , y R d , their inner product is denoted by ( x , y ) : =   x 1 y 1 +     + x d y d , x y means that x j y j for j = 1 , , d , 0 = ( 0 , , 0 ) R d , Z + d : = { x Z d :   x   0 } . If α , β Z + d , a , b R d , we set [ α ] = j = 1 d α j , α ! = j = 1 d α j ! , β α = α ! β ! ( α β ) ! , a b = j = 1 d a j b j , D α f = [ α ] f x α ,   δ a b is the Kronecker delta. For n N , Δ n   : =   { α :   α Z + d ,     [ α ] < n } . For β Z + d , β : = { α : α Z + d ,   α β } . The cardinality of a finite set H is denoted by # H . The (i,j)-th element of matrix M is denoted by [ M ] i , j The i-th column of matrix M is denoted by [ M ] i . 0 ( Z d ) denotes the set of sequences on Z d with finitely many non-zero elements.
An integer d × d matrix M is called a dilation matrix if the eigenvalues of M are greater than 1 in absolute value. M * = M ¯ T , I d denotes the d × d identity matrix, m = | det M | . A complete set of representatives of Z d / M Z d is denoted by D ( M ) = { s 1 , , s m } . An element of D ( M ) is called a digit, D ( M ) is called the set of digits (see, for example, [25] Section 2.2). We assume that s 1 = 0 . The coset corresponding to digit s D ( M ) is denoted by s , i.e., s = s + M Z d . By D : = { s 1 , , s m } , we denote the set of cosets. The set of digits will be frequently used as the index set for some objects, so we assume that the digits are ordered somehow such that the first digit is s = 0 .
The Fourier transform of a function f L 1 ( R d ) is f ^ ( ξ ) = R d f ( x ) e 2 π i ( x , ξ )   d x ,   ξ R d . This notion can be naturally extended to L 2 ( R d ) and to tempered distributions. For a column vector of functions Φ = ( φ 1 , , φ r ) T , we set Φ ^ : = ( φ ^ 1 , , φ ^ r ) T , if applicable.
Additionally, the following lemma, which can be proved by direct computations, will be useful.
Lemma 1.
Let A be a d × d invertible real-valued matrix, n N ,   a , b R d . For any sufficiently smooth functions f and g defined on R d , the following statements are equivalent
1. 
D α f ( x ) | x = a = D α g ( x ) | x = a     for all α Δ n ,
2. 
D α ( f ( A * x ) ) | x = M * 1 a = D α ( g ( A * x ) ) | x = M * 1 a     for all α Δ n ,
3. 
D α f ( x ) e 2 π i ( b , x ) | x = a = D α g ( x ) e 2 π i ( b , x ) | x = a     for all α Δ n .

Action of a Symmetry Group on a Set of Digits

A finite set H of d × d unimodular matrices (i.e., integer matrices with determinant equal to ± 1 ) is a symmetry group with respect to the dilation matrix M, if H forms a group under the matrix multiplication and M 1 E M H for all E H . In what follows, we assume that H is a symmetry group with respect to some fixed dilation matrix M.
A function f : R d C is called H -symmetric with respect to the center c f R d , if
f ( E ( · c f ) + c f ) = f E H .
For trigonometric polynomials, we use a slightly different definition, which is compatible with the above definition of symmetric functions, if we are dealing with compactly supported refinable functions.
A trigonometric polynomial t ( ξ ) = k Z d h k e 2 π i ( k , ξ ) ,   h k C , is H -symmetric with respect to the center c R d , if
t ( E * ξ ) = e 2 π i ( E c c , ξ ) t ( ξ ) E H ,
where E c c Z d for all E H . Condition (1) is equivalent to the fact that h E k = h k + E c c   k Z d and E H . We say that c R d is an appropriate symmetry center for H , if E c c Z d for all E H .
It can be checked that for any E H , for any coset s D and any appropriate symmetry center c R d for H , there exists a unique q D such that E s = q + c E c . This fact allows us to define a group action on the set D by the group H (associated with the symmetry center c) as follows (for details see, for example, [26,27])
E [ s ] : = q ,
where q is such that q = E s ( c E c ) .
Further, we need some notions and results from group theory (see, for example, [28]). The orbit of s D is H [ s ] = { E [ s ] , E H } . Clearly, H [ s ] D and two orbits are either equal or disjoint. Denote by Λ the set of representatives from each orbit, then D = s Λ H [ s ] . For convenience, redenote the elements of the set Λ by s p , 1 , where p = 1 , , # Λ , such that s 1 , 1 = 0 .
For a fixed index p = 1 , , # Λ , the stabilizer of s p , 1 is denoted by H p : = { F H : F [ s p , 1 ] = s p , 1 } . Note that H p H and H p is a subgroup of H . A left coset of H by subgroup H p is a set E H p where E H . Any two left cosets are either coincide or disjoint. H / H p denotes the set of left cosets of H by H p .
Let E p be a set of representatives of H / H p ,   E p H . Then H = E E p E H p . Thus, the orbit H [ s p , 1 ] can be represented as
H [ s p , 1 ] = E E p E [ s p , 1 ] .
For a fixed index p, matrices of the set E p will be denoted by E ( i ) , i = 1 , , # E p . We assume that E ( 1 ) = I d . Define
s p , i : = E ( i ) s p , 1 ( c E ( i ) c ) ,   i = 1 , , # E p .
Then E ( i ) [ s p , 1 ] = s p , i and the elements of the orbit H [ s p , 1 ] are s p , i , where i = 1 , , # E p . This redefined after the division by orbits set of digits is called to be associated with the symmetry center c and is denoted by D ( M , c ) = { s p , i , p = 1 , , # Λ , i = 1 , , # E p } .
For fixed p = 1 , , # Λ , by the Lagrange’s theorem # H = # H p · # E p and for each matrix K in H , there exist unique matrices E E p and F H p such that K = E F . The sets E p ,   H p can be considered the "coordinate axes" of the symmetry group H (for each p , these “coordinate axes” of H can be different).
Fix index p = 1 , , # Λ . For a matrix K H consider K [ s p , i ] . There exist matrices E ( i ) E p and F H p such that K = E ( i ) F . Then K [ s p , 1 ] = E ( i ) F [ s p , 1 ] = s p , i . Next, since K [ s p , i ] = K E ( i ) [ s p , 1 ] , there exist matrices E ( j ( i , K ) ) E p and F H p such that K E ( i ) = E ( j ( i , K ) ) F . Then K [ s p , i ] = E ( j ( i , K ) ) F [ s p , 1 ] = s p , j ( i , K ) . Here the notation j ( · , K ) means the map from the set of indices { 1 , , # E p } to itself and the index j ( i , K ) is uniquely determined by index i and matrix K H for a fixed index p . Additionally, by r p , i K , we denote a special vector from Z d such that
K s p , i = s p , j ( i , K ) + M r p , i K + c E c .
For convenience, a brief summary of notations related to the action of symmetry group on the set of cosets D is presented in Table 1.

3. Symmetric Refinable Function Vectors

Consider compactly supported functions φ ν : R d C , ν = 1 , , r , and denote Φ : = ( φ 1 , , φ r ) T . Φ is called a refinable function vector if it satisfies a refinement equation
Φ ( x ) = m k Z d A ( k ) Φ ( M x + k ) ,
where a finitely supported sequence of matrices A = { A ( k ) } k Z d ( 0 ( Z d ) ) r × r is called a mask with multiplicityr. The symbol of sequence A ( 0 ( Z d ) ) r × r is defined by
A ^ ( ξ ) = k Z d A ( k ) e 2 π i ( k , ξ ) ,   ξ R d ,
i.e., A ^ is a matrix of trigonometric polynomials, which we will call a matrix mask. If the Fourier transform is applicable, the refinement Equation (2) can be equivalently written as
Φ ^ ( ξ ) = A ^ ( M * 1 ξ ) Φ ^ ( M * 1 ξ ) , ξ R d .
It is known ([29] Proposition 1) that the compactly supported distributional solution of the refinement equation is unique (up to multiplication by a constant), when matrix mask A ^ ( ξ ) consists of trigonometric polynomials and matrix A ^ ( 0 ) has only one eigenvalue equal to 1 and others are less than 1 in absolute value.
A refinable function vector Φ = ( φ 1 , , φ r ) T is H -symmetric with respect to the row of centers C : = ( c 1 , , c r ) ,   c ν R d ,   ν = 1 , , r , if each function φ ν is H -symmetric with respect to the center c ν . To define the H -symmetry property for matrix masks, we need an additional notation. Suppose E H and denote
S C [ E ] ( ξ ) : = diag ( e 2 π i ( E c 1 , ξ ) , , e 2 π i ( E c r , ξ ) ) , ξ R d .
The obvious properties of S C [ E ] are ( S C [ E ] ) 1 = S C [ E ] , S C [ E + F ] = S C [ E ] · S C [ F ] , S C [ E ] ( F * ξ ) = S C [ F E ] ( ξ ) . Then the H -symmetry property of Φ in terms of the Fourier transform can be written as
Φ ^ ( E * ξ ) = S C [ E I d ] ( ξ ) Φ ^ ( ξ ) E H .
Together with the refinable Equation (3) this yields that E H
Φ ^ ( M * E * ξ ) = A ^ ( E * ξ ) Φ ^ ( E * ξ ) = A ^ ( E * ξ ) S C [ E I d ] ( ξ ) Φ ^ ( ξ ) .
On the other hand, since M 1 E M H , we can write
Φ ^ ( M * E * ξ ) = Φ ^ ( ( M 1 E M ) * M * ξ ) = S C [ M 1 E M I d ] ( M * ξ ) Φ ^ ( M * ξ )   = S C [ E M M ] ( ξ ) A ^ ( ξ ) Φ ^ ( ξ ) .
This is the motivation for the definition of symmetric matrix masks. We say that matrix mask A ^ is H -symmetric with respect to the row of centers C = ( c 1 , , c r ) , if
A ^ ( E * ξ ) = S C [ E M M ] ( ξ ) A ^ ( ξ ) S C [ I d E ] ( ξ ) E H .
Or, equivalently, the ( ν , μ ) th element of the matrix mask A ^ ( ξ ) is H -symmetric with respect to the center M c ν c μ , since
[ A ^ ( E * ξ ) ] ν , μ = [ A ^ ( ξ ) ] ν , μ e 2 π i ( E ( M c ν c μ ) ( M c ν c μ ) , ξ ) E H .
Of course, it should be provided that E ( M c ν c μ ) ( M c ν c μ ) Z d . But we require a little more. Namely, we say that the row of centers C = ( c 1 , , c r ) is appropriate for H , if E c ν c ν Z d for all E H , ν = 1 , , r . A connection between the H -symmetry of refinable function vector and its matrix mask is stated in the following theorem (see [20,22]).
Theorem 1.
Let C = ( c 1 , , c r ) be an appropriate row of centers for H . Suppose Φ = ( φ 1 , , φ r ) T is the unique compactly supported solution of the refinement equation with matrix mask A ^ and the multi-integer shifts of refinable function vector Φ are linearly independent. Then Φ is H -symmetric with respect to the row of centers C if and only if matrix mask A ^ is H -symmetric with respect to the row of centers C .
Here, the linear independence of the multi-integer shifts of Φ means that the synthesis operator T Φ is injective, where T Φ is defined on ( ( Z d ) ) 1 × r as follows T Φ a = ν = 1 r k Z d a ( ν ) ( k ) φ ν ( · + k ) for a = ( a ( 1 ) , , a ( r ) ( ( Z d ) ) 1 × r .
Let n N ,   A ^ be a matrix mask. We say that A ^ obeys sum rule of order n (with respect to the dilation matrix M) if there exist a 1 × r row of functions y : R d C 1 × r such that y ( 0 ) 0 ,
D β [ y ( M * ξ ) A ^ ( ξ ) ] | ξ = 0 = D β y ( ξ ) | ξ = 0 ,   β Δ n
and
D β [ y ( M * ξ ) A ^ ( ξ + M * 1 q ) ] | ξ = 0 = 0 ,   β Δ n ,   q D ( M * ) \ { 0 } .
In fact, to formulate and check these conditions, we only need to know the derivatives of y at the origin up to the order n. However, in the paper, it is more convenient to write and apply these conditions using the row of functions y.
A matrix mask A ^ with sum rule of order n implies the accuracy of order n for the corresponding refinable function vector Φ , which means that polynomials up to order n lies in the shift-invariant space generated by functions φ 1 , , φ r . In more details, suppose that Φ is a refinable vector of compactly supported distributions related to matrix mask A ^ and the sequences { φ ^ ν ( M * 1 q + k ) } k Z d ,   ν = 1 , , r , are linearly independent for all q D ( M * ) . Then the accuracy of order n for Φ is equivalent to the sum rule conditions of order n for A ^ (see ([24] Theorem 2.4) for details). Note that the above conditions about linear independence will be valid if, for example, the multi-integer shifts of Φ are linearly independent, since this fact is equivalent to for examplelinear independence of the sequences { φ ^ ν ( ξ + k ) } k Z d , ν = 1 , , r , for all ξ R d (see, for example, ([30] Theorem 5.1)). The order of accuracy of Φ is related to the approximation order of the corresponding shift-invariant space (see, for example, [31]).
The polyphase component of the mask A corresponding to the digit s D ( M ) is a sequence A s ( 0 ( Z d ) ) r × r defined by
A s ( k ) : = 1 m A ( M k + s ) , k Z d .
The polyphase representation of the matrix mask A ^ is
A ^ ( ξ ) = 1 m s D ( M ) e 2 π i ( s , ξ ) A ^ s ( M * ξ ) .
However, it is more convenient to use another partition for the polyphase components. Consider the ν -th column of A ^ and place the columns of its polyphase components into a matrix A ( ν ) ^ for ν = 1 , , r . In other words, the ν -th column of A ^ s is the column with index s in the matrix A ( ν ) ^ , i.e. [ A ( ν ) ^ ( ξ ) ] s : = [ A s ^ ( ξ ) ] ν for ν = 1 , , r ,   s D ( M ) . We call these matrices A ( ν ) ^ , ν = 1 , , r , the modified polyphase components of A ^ . Note that the following representation is valid
[ A ^ ( ξ ) ] ν = 1 m s D ( M ) [ A ( ν ) ^ ( M * ξ ) ] s e 2 π i ( s , ξ ) , ν = 1 , , r .

3.1. Symmetry of the Polyphase Components

Next, we need to reformulate the H -symmetry conditions of a matrix mask in terms of its modified polyphase components. Let us fix an appropriate row of symmetry centers C = ( c 1 , , c r ) for the symmetry group H . Suppose A ^ is an H -symmetric matrix mask, i.e., (4) is valid. Consider this condition by columns:
[ A ^ ( E * ξ ) ] ν = S C [ M 1 E M I d ] ( M * ξ ) [ A ^ ( ξ ) ] ν e 2 π i ( c ν E c ν , ξ ) E H ,
where [ A ^ ] ν is the ν -th column of matrix A ^ , ν = 1 , , r . Note that the certain columns of matrix mask A ^ turn out to be mutually symmetric and this can be described. Recall that matrix A ( ν ) ^ contains the polyphase components of the column [ A ^ ] ν . It is convenient to index the columns of modified polyphase component A ( ν ) ^ using the digits, while digits are indexed according to their division by orbits with respect to the group action E [ s ] : = q , where q is such that q = E s + E c ν c ν . The corresponding notation for set of digits associated with the symmetry center c ν is the following:
D ( M , c ν ) = { s p , i ( ν ) , p = 1 , , # Λ ν , i = 1 , , # E p ( ν ) } .
The “coordinate axes” for H will be denoted by H p ( ν ) ,   E p ( ν ) . Additionally, later we have to deal with several columns of matrix mask A ^ at the same moment, so it will be convenient to use notation s p ( ν ) , i ( ν ) ( ν ) for digits from D ( M , c ν ) .
Lemma 2.
A matrix mask A ^ is H -symmetric with respect to the appropriate row of centers C = ( c 1 , , c r ) if, and only if, for any fixed ν = 1 , , r and for each p = 1 , , # Λ ν the columns [ A ( ν ) ( ξ ) ] ( p , i ) , i = 1 , , # E p ( ν ) satisfy
[ A ( ν ) ^ ( ( M 1 K M ) * ξ ) ] ( p , i ) = S C [ M 1 K M I d ] ( ξ ) [ A ( ν ) ^ ( ξ ) ] ( p , j ) e 2 π i ( r p , i K , ( ν ) , ξ ) K H ,
where j is such that K E ( i ) = E ( j ) F for matrices E ( i ) , E ( j ) E p ( ν ) and F H p ( ν ) , r p , i K , ( ν ) Z d is such that
K s p , i ( ν ) = s p , j ( ν ) + M r p , i K , ( ν ) + c ν K c ν .
Proof. 
Suppose A ^ is H-symmetric with respect to the appropriate vector of centers C = ( c 1 , , c r ) . Let us fix ν = 1 , , r . Then by (7) and (10) we obtain for the ν -th column of A ^ and K H that
[ A ^ ( K * ξ ) ] ν = 1 m p = 1 # Λ ν i = 1 # E p ( ν ) [ A ( ν ) ( M * K * ξ ) ] ( p , i ) e 2 π i ( K s p , i , ξ ) = 1 m e 2 π i ( c ν K c ν , ξ ) p = 1 # Λ ν i = 1 # E p ( ν ) [ A ( ν ) ( M * K * ξ ) ] ( p , i ) e 2 π i ( M r p , i K , ( ν ) , ξ ) e 2 π i ( s p , j ( ν ) , ξ ) ,
where index j is connected with i by j = j ( i , K ) , i.e., j is such that K E ( i ) = E ( j ) F for matrices E ( i ) , E ( j ) E p ( ν ) and F H p ( ν ) . On the other hand, we have
S C ( M 1 K M I d ) ( M * ξ ) [ A ^ ( ξ ) ] ν e 2 π i ( c ν K c ν , ξ ) = 1 m e 2 π i ( c ν K c ν , ξ ) p = 1 # Λ ν j = 1 # E p ( ν ) S C ( M 1 K M I d ) ( M * ξ ) [ A ( ν ) ( M * ξ ) ] ( p , j ) e 2 π i ( s p , j , ξ ) .
Since the polyphase representation is unique with respect to the chosen set of digits D ( M , c ν ) , we obtain (9). The converse statement can be proved by the analogous straightforward computations. □
In particular, for a fixed ν = 1 , , r and p = 1 , , # Λ ν for any F H p ( ν ) we obtain
[ A ( ν ) ^ ( ( M 1 F M ) * ξ ) ] ( p , 1 ) = S C [ M 1 F M I d ] ( ξ ) [ A ( ν ) ^ ( ξ ) ] ( p , 1 ) e 2 π i ( r p , 1 F , ( ν ) , ξ ) ,
where r p , 1 F , ( ν ) = M 1 F ( c ν + s p , 1 ( ν ) ) M 1 ( c ν + s p , 1 ( ν ) ) . This leads to the fact that matrix element [ A ( ν ) ^ ( ξ ) ] k , ( p , 1 ) is M 1 H p ( ν ) M symmetric with respect to the center c k M 1 ( c ν + s p , 1 ( ν ) ) ,   k = 1 , , r . Additionally, by the choice of s p , i ( ν ) , we obtain
[ A ( ν ) ^ ( ( M 1 E ( i ) M ) * ξ ) ] ( p , 1 ) = S C ( M 1 E ( i ) M I d ) ( ξ ) [ A ( ν ) ^ ( ξ ) ] ( p , i ) ,
for E ( i ) E p ( ν ) , i = 1 , , # E p ( ν ) . By direct computations, it can be checked that matrix element [ A ( ν ) ^ ( ξ ) ] k , ( p , i ) is M 1 H p , i ( ν ) M symmetric with respect to the center c k M 1 ( c ν + s p , i ( ν ) ) ,   k = 1 , , r . Here H p , i ( ν ) is a conjugate subgroup to H p ( ν ) by matrix E ( i ) , namely H p , i ( ν ) : = E ( i ) H p ( ν ) ( E ( i ) ) 1 , where E ( i ) E p ( ν ) , i = 1 , , # E p ( ν ) .

3.2. Interpolating Refinable Function Vector

A refinable function vector Φ = ( φ 1 , , φ r ) T is called interpolating, if multiplicity r is equal to m = | det M | , all components of Φ are continuous functions with compact support and
φ i ( M 1 k ) = δ s i , k i = 1 , , m , k Z d .
Since r = m , we can associate φ i with corresponding digit s i and we can index functions φ i using digits. Condition (13) can be rewritten as
φ s ( M 1 k ) = δ s , k s D ( M ) , k Z d .
Or, since any k Z d can be represented as k = M l + q for some l Z d ,   q D ( M ) , condition (14) is equivalent to
φ s ( l + M 1 q ) = δ l , 0 δ s , q q D ( M ) , l Z d .
An interpolating refinable function vectors related to Shannon-like sampling expansions
f ( x ) = k Z d s D ( M ) f ( M 1 s k ) φ s ( x + k ) .
This expansion allows us to state that the multi-integer translates of Φ are linearly independent. Indeed, if T Φ is the synthesis operator of Φ , then T Φ a = 0 for a ( ( Z d ) ) 1 × r implies that a = 0 by (16).
For an interpolating refinable function vector Φ its matrix mask A ^ should have the following special form of the first column: [ A ^ ( ξ ) ] s , 0 = 1 m e 2 π i ( s , ξ ) , for s D ( M ) . The following theorem states the details.
Theorem 2
([32] Theorem 2.1). Let Φ be a refinable function vector with matrix mask A ( 0 ( Z d ) ) m × m . Then Φ is interpolating refinable function vector if and only if
1. 
( 1 , 1 , , 1 ) Φ ^ ( 0 ) = 1 ;
2. 
ν ( A , M ) > 0 ;
3. 
( 1 , 1 , , 1 ) A ^ ( 0 ) = ( 1 , 1 , , 1 ) and
A ^ ( ξ ) = 1 m a 1 , 2 ^ ( ξ ) a 1 , m ^ ( ξ ) 1 m e 2 π i ( s 1 , ξ ) a 2 , 2 ^ ( ξ ) a 2 , m ^ ( ξ ) 1 m e 2 π i ( s m , ξ ) a m , 2 ^ ( ξ ) a m , m ^ ( ξ ) ,
where a i , j ^ are some trigonometric polynomials, s i D ( M ) .
The quantity ν ( A , M ) is related to L -smoothness exponent of a refinable function vector Φ with dilation matrix M and matrix mask A (see [32] for details). Matrix mask A ^ in (17) is called an interpolating matrix mask.
Let us consider an H -symmetric interpolating refinable function vector Φ with the row of symmetry centers C = { c s } s D ( M ) . From the H -symmetry property and (15) we have
1 = φ s ( M 1 s ) = φ s ( E M 1 s E c s + c s )
for all s D ( M ) and E H . Then
1 = φ s ( M 1 ( M E M 1 s M E c s + M c s ) ) = δ s , M E M 1 s M E c s + M c s .
Hence M E M 1 ( s M c s ) = s M c s for all s D ( M ) and E H . This condition will be satisfied, if s = M c s for all s D ( M ) . So, in the interpolating case the symmetry centers are defined by the digits.
By Theorem 1 for the H -symmetric interpolating refinable function vector Φ with matrix mask A ^ matrix elements [ A ^ ] s , q , s , q D ( M ) , are H -symmetric with respect to the centers M c s c q or s M 1 q . Thus, the natural limitation on the symmetry centers for trigonometric polynomials gives the following restrictions
E ( s M 1 q ) ( s M 1 q ) Z d E H , s , q D ( M ) .
This is equivalent to
E q q M Z d E H , q D ( M ) .
The latter condition reduces possible variants for the appropriate choice of symmetry groups H and dilation matrices M, i.e., (18) should be checked for a chosen pair H and M before the construction.
Additionally, note that if matrix mask A ^ of an interpolating refinable function obeys sum rule of order n, then y is not arbitrary. For instance, the appropriate choice is y ( ξ ) = ( 1 , e 2 π i ( s 2 , ξ ) , , e 2 π i ( s m , ξ ) ) (see, for example, [33]).
Methods for the construction of H -symmetric matrix masks with any preassigned order of sum rule were suggested in [20,22]. Additionally, the canonical form of matrix mask (see, for example, [34]) can be used for the construction of symmetric matrix masks starting from any appropriate refinable mask in the scalar case (see, e.g., [22] for details). For instance, any known interpolating symmetric refinable masks can be used (see, for example, [22,27,35,36,37] for examples of such masks and for methods of their construction). This provides the initial step in the construction of symmetric multiwavelets.

4. Extension Principle

A general scheme for the construction of compactly supported MRA-based wavelet systems was developed in [38] (the Mixed Extension Principle). This scheme is also applicable for the construction of multiwavelet systems.
Let Φ , Φ ˜ be compactly supported refinable function vectors, which satisfy the refinement equation with matrix masks A ^ , A ˜ ^ . For convenience, we use notations B ^ 1 : = A ^ , B ˜ 1 ^ : = A ˜ ^ . Assume that there exist r × r matrices of trigonometric polynomials B ^ ν ,   B ˜ ν ^ , ν = 2 , , u , u m , such that the following u × m matrices of r × r blocks
L : = { B ν ^ ( ξ + M * 1 q ) } ν = 1 , u q D ( M * ) , L ˜ : = { B ˜ ν ^ ( ξ + M * 1 q ) } ν = 1 , u q D ( M * )
satisfy
L * L ˜ I m r .
Wavelet function vectors Ψ ( ν ) , Ψ ˜ ( ν ) ,   ν = 2 , , u , are defined via its Fourier transforms
Ψ ( ν ) ^ ( ξ ) = B ν ^ ( M * 1 ξ ) Φ ^ ( M * 1 ξ ) , Ψ ˜ ( ν ) ^ ( ξ ) = B ˜ ν ^ ( M * 1 ξ ) Φ ˜ ^ ( M * 1 ξ ) .
Then the set of the function vectors { Φ , Ψ ( 2 ) , , Ψ ( u ) } , { Φ ˜ , Ψ ˜ ( 2 ) , , Ψ ˜ ( u ) } is said to be a compactly supported MRA-based dual multiwavelet system generated by the refinable function vectors Φ , Φ ˜ (or their matrix masks A ^ , A ˜ ^ ).
The set of function vectors { Φ , Ψ ( 2 ) , , Ψ ( u ) } is a multiwavelet frame in L 2 ( R d ) , if there exist positive constants C 1 and C 2 such that
C 1 f L 2 ( R d ) 2 k Z d f , Φ 0 k 2 + j = 0 ν = 2 u k Z d f , Ψ j k ( ν ) 2 C 2 f L 2 ( R d ) 2 , f L 2 ( R d ) .
Here, Ψ j k ( ν ) = m j / 2 Ψ ( ν ) ( M j · + k ) and f , Φ = ( f , φ 1 , , f , φ r ) . We say that a pair of sets { Φ , Ψ ( 2 ) , , Ψ ( u ) } and { Φ ˜ , Ψ ˜ ( 2 ) , , Ψ ˜ ( u ) } is a dual multiwavelet frame in L 2 ( R d ) , if each set is a multiwavelet frame in L 2 ( R d ) and
f = k Z d f , Φ ˜ 0 k Φ 0 k + j = 0 ν = 2 u k Z d f , Ψ ˜ j k ( ν ) Ψ j k ( ν ) ,
where the series converge unconditionally.
It is known (see, for example, ([15] Theorem 2.1)) that compactly supported MRA-based dual multiwavelet system { Φ , Ψ ( 2 ) , , Ψ ( u ) } , { Φ ˜ , Ψ ˜ ( 2 ) , , Ψ ˜ ( u ) } is a dual multiwavelet frame in L 2 ( R d ) if Φ , Φ ˜ ( L 2 ( R d ) ) r × 1 , Φ ^ ( 0 ) * Φ ˜ ^ ( 0 ) = 1 and Ψ ( ν ) ( 0 ) = 0 , Ψ ˜ ( ν ) ( 0 ) = 0 , ν = 2 , , u (i.e., all wavelet function vectors have vanishing moments at least of order 1).
Since wavelet matrix masks B ^ ν , B ˜ ν ^ are matrices of trigonometric polynomials, then the wavelet function vectors Ψ ( ν ) , Ψ ˜ ( ν ) , ν = 1 , , u , are linear combinations of function vectors Φ 1 k ,   Φ ˜ 1 k , respectively. Therefore, wavelet functions in vectors Ψ ( ν ) , Ψ ˜ ( ν ) also have compact support and they are in the same function space as functions from refinable function vectors.
For the realization of the extension principle starting from some initial symmetric matrix mask A ^ , we need to construct symmetric dual matrix mask A ˜ ^ and we need to obtain symmetric wavelet matrix masks B ν ^ ,   B ˜ ν ^   ν = 2 , , u , such that the equality (20) is valid. In this paper, we set u = m , i.e., the extended matrices L and L ˜ are square block matrices.

4.1. Symmetric Dual Matrix Mask

Firstly, we need to obtain a symmetric dual matrix mask. Let A ^ be a matrix mask. For a finitely supported sequence of matrices A ˜ ( 0 ( Z d ) ) r × r its symbol A ˜ ^ is called a dual matrix mask for A ^ , if
q D ( M * ) A ^ ( ξ + M * 1 q ) A ˜ ^ ( ξ + M * 1 q ) * = I r .
A dual matrix mask for A ^ with preassigned order of sum rule can be constructed using the following result (see ([24] Theorem 3.4) for the constructive proof).
Theorem 3.
Let A ^ be a matrix mask such that A ^ has at least one dual matrix mask. Then for any n ˜ N , there exists a dual matrix mask A ˜ ^ which obeys sum rule of order n ˜ .
Note that for the interpolating matrix mask A ^ , at least one trivial dual matrix mask always exists (see Section 4.2). In order to provide the H -symmetry property for the dual matrix mask A ˜ ^ we need several additional considerations. Let A ˜ ^ be a dual matrix mask, constructed by Theorem 3. Its symmetrization can be done as follows:
A ˜ ^ s y m ( ξ ) : = 1 # H E H S C [ M E M ] ( ξ ) A ˜ ^ ( E * ξ ) S C [ E I d ] ( ξ ) .
Below, we prove that A ˜ ^ s y m , indeed, is a dual matrix mask for A ^ with the H -symmetry property and with the same order of sum rule as A ˜ ^ .
Theorem 4.
Matrix mask A ˜ ^ s y m is an H -symmetric dual matrix mask for an H -symmetric matrix mask A ^ .
Proof. 
First, let us show that A ˜ ^ s y m is H -symmetric with respect to the same row of centers C as the primal mask A ^ . For K H , consider
A ˜ ^ s y m ( K * ξ ) : = 1 # H E H S C [ K M K E M ] ( ξ ) A ˜ ^ ( E * K * ξ ) S C [ K E K ] ( ξ ) = 1 # H S C [ K M M ] ( ξ ) E H S C [ M K E M ] ( ξ ) A ˜ ^ ( E * K * ξ ) S C [ K E I d ] ( ξ ) S C [ I d K ] ( ξ ) = S C [ K M M ] ( ξ ) A ˜ ^ s y m ( ξ ) S C [ I d K ] ( ξ ) .
Thus, A ˜ ^ s y m is H -symmetric with respect to the same row of centers C. Next, we show that A ˜ ^ s y m is a dual matrix mask for A ^ , i.e.,
q D ( M * ) A ˜ ^ s y m ( ξ + M * 1 q ) A ^ ( ξ + M * 1 q ) * = I r .
Inserting the definition of A ˜ ^ s y m into the left-hand side of (23), using (4) for A ^ and the following equality
S C [ M E M ] ( ξ + M * 1 q ) = S C [ I d M 1 E M ] ( M * ξ + q ) = S C [ M E M ] ( ξ ) ,
the left-hand side of (23) is equal to
1 # H E H q D ( M * ) S C [ M E M ] ( ξ ) A ˜ ^ ( E * ξ + E * M * 1 q ) A ^ ( E * ξ + E * M * 1 q ) * S C [ M E M ] ( ξ ) * .
It remains to note that the inner sum over q D ( M * ) can be rewritten as
q D ( M * ) A ˜ ^ ( E * ξ + E * M * 1 q ) A ^ ( E * ξ + E * M * 1 q ) * =   q D ( M * ) A ˜ ^ ( E * ξ + M * 1 ( M 1 E M ) * q ) A ^ ( E * ξ + M * 1 ( M 1 E M ) * q ) * = I r ,
since M 1 E M H and ( M 1 E M ) * q = q n e w + M * k for some q n e w D ( M * ) , k Z d . Thus, if q is running over D ( M * ) , i.e., over the complete set of representatives of Z d / M * Z d , then ( M 1 E M ) * q is also running over the complete set of representatives of Z d / M * Z d , but may be in another order and may be across some other representatives. Nevertheless, due to the periodicity of A ^ we get the equality A ^ ( E * ξ + M * 1 ( M 1 E M ) * q ) = A ^ ( E * ξ + M * 1 q n e w ) and the same for A ˜ ^ . Therefore, since A ˜ ^ is a dual matrix mask to A ^ , then the right-hand side of the last formula is indeed equal to I r . □
Next, we check the new dual matrix mask A ˜ ^ s y m has the same order of sum rule as the old dual matrix mask A ˜ ^ . If the dual matrix mask obeys sum rule of order n ˜ , then Equations (5) and (6) for A ˜ ^ are valid with some row of trigonometric polynomials y ˜ . However, y ˜ cannot be arbitrary. It is known that the derivatives D β y ˜ ( 0 ) for β Δ n are uniquely defined (up to a multiplication by a constant) and can be found based on the equality (22). This fact is stated in Theorem 3.1 in [24]. In more details, y ˜ should satisfy the following conditions:
D β A ^ ( M * 1 ξ ) y ˜ * ( M * 1 ξ ) | ξ = 0 = D β y ˜ * ( 0 ) ,   β Δ n ˜ ,
or equivalently
D β A ^ ( ξ ) y ˜ * ( ξ ) | ξ = 0 = D β y ˜ * ( M * ξ ) | ξ = 0 ,   β Δ n ˜ .
Theorem 5.
Let A ^ be an H -symmetric matrix mask and let A ˜ ^ be its dual matrix mask with sum rule of order n ˜ . Then matrix mask A ˜ ^ s y m obeys sum rule of order n ˜ .
Proof. 
The fact that equality (25) is valid with symmetric matrix mask A ^ imposes some conditions on the choice of y ˜ . Indeed, from the one hand (25) can be rewritten as
D β A ^ ( E * ξ ) y ˜ ( E * ξ ) * | ξ = 0 = D β y ˜ ( M * E * ξ ) * | ξ = 0 ,     β Δ n ˜
for E H . On the other hand, by the H -symmetry of A ^ , we obtain
D β S C [ M E M ] ( ξ ) A ^ ( E * ξ ) S C [ E I d ] ( ξ ) y ˜ ( ξ ) * | ξ = 0 = D β y ˜ ( M * ξ ) * | ξ = 0 ,     β Δ n ˜ .
Or by Lemma 1, the last equality is equivalent to
D β A ^ ( E * ξ ) S C [ E I d ] ( ξ ) y ˜ ( ξ ) * | ξ = 0 = D β S C [ E M M ] ( ξ ) y ˜ ( M * ξ ) * | ξ = 0 ,     β Δ n ˜ .
Comparing Equations (26) and (27) and using the fact that the derivatives of y ˜ are uniquely defined by (25), we get that
D β y ˜ ( E * ξ ) * | ξ = 0 = D β S C [ E I d ] ( ξ ) y ˜ ( ξ ) * | ξ = 0 .
Since only the derivatives of y ˜ are needed, we can assume that
y ˜ ( E * ξ ) = y ˜ ( ξ ) S C [ I d E ] ( ξ ) .
Next, show that A ˜ ^ s y m also obeys sum rule of order n ˜ with the row of trigonometric polynomials y ˜ . Consider,
D β y ˜ ( M * ξ ) A ˜ ^ s y m ( ξ ) | ξ = 0 = 1 # H E H D β y ˜ ( M * ξ ) S C [ M E M ] ( ξ ) A ˜ ^ ( E * ξ ) S C [ E I d ] ( ξ ) | ξ = 0 = 1 # H E H D β y ˜ ( M * E * ξ ) A ˜ ^ ( E * ξ ) S C [ E I d ] ( ξ ) | ξ = 0 = 1 # H E H D β y ˜ ( E * ξ ) S C [ E I d ] ( ξ ) | ξ = 0 = D β y ˜ ( 0 ) .
Next, for any q D ( M * ) \ { 0 } conditions
D β [ y ˜ ( M * ξ ) A ˜ ^ ( ξ + M * 1 q ) ] | ξ = 0 = 0 , β Δ n ˜
by Lemma 1 are equivalent to
D β [ y ˜ ( M * E * ξ ) A ˜ ^ ( E * ξ + M * 1 q ) S C [ E I d ] ( ξ + M * 1 q ) ] | ξ = 0 = 0 ,     β Δ n ˜ .
Additionally, by (24) and (28) we have
y ˜ ( M * ξ ) S C [ M E M ] ( ξ + M * 1 q ) = y ˜ ( M * ξ ) S C [ I d M 1 E M ] ( M * ξ ) = y ˜ ( M * E * ξ ) .
Therefore, we obtain that
D β y ˜ ( M * ξ ) A ˜ ^ s y m ( ξ + M * 1 q ) | ξ = 0   = 1 # H E H D β y ˜ ( M * E * ξ ) A ˜ ^ ( E * ξ + E * M * 1 q ) S C [ E I d ] ( ξ + M * 1 q ) | ξ = 0 = 0
by the fact that A ˜ ^ ( E * ξ + E * M * 1 q ) = A ˜ ^ ( E * ξ + M * 1 ( M 1 E M ) * q ) = A ˜ ^ ( E * ξ + M * 1 q n e w ) , where q n e w D ( M * ) \ { 0 } is such that ( M 1 E M ) * q q n e w M * Z d and, thus, (29) can be applied. □

4.2. Symmetric Wavelet Matrix Masks

Let H be a symmetry group with respect to the dilation matrix M, such that E s s M Z d for all E H and for all s D ( M ) . Let Φ = ( φ 1 , , φ r ) , r = m , be an interpolating refinable function vector which is H -symmetric with respect to the centers c s = M 1 s , s D ( M ) . Let A ^ be the corresponding matrix mask. Then mask A ^ is also H -symmetric, i.e., (4) is valid or the matrix element [ A ^ ] s , q is H -symmetric with respect to the center M 1 q s , s , q D ( M ) . Let A ˜ ^ be an H -symmetric dual matrix mask.
It is more convenient to write the process of matrix extension using the modified polyphase components. First, note that for the modified polyphase representation of each column of matrix mask A ^ , we will use its own set of digits. Namely, for a fixed ν = 1 , , m , consider the set of digits D ( M , c ν ) associated with the symmetry center c ν . In what follows, the modified polyphase components of the column ν of A ^ are defined using the set of digits D ( M , c ν ) . The modified polyphase representation of [ A ^ ] ν defined in (8) can be alternatively written as
[ A ^ ( ξ ) ] ν = A ( ν ) ^ ( M * ξ ) [ P c ν ] 1 ( ξ ) ,
where P c ν is the matrix defined by
P c ν ( ξ ) = 1 m { e 2 π i ( s , ξ + M * 1 q ) } s D ( M , c ν ) q D ( M * ) .
It is known that P c ν is a unitary matrix, i.e., P c ν ( ξ ) P c ν * ( ξ ) = I m . Denote by P a block-diagonal matrix diag { P c 1 , , P c m } . Clearly, P is also a unitary matrix. Let e 1 , , e m be the standard basis in R m . Then
A ^ ( ξ ) = A ( 1 ) ^ ( M * ξ ) , , A ( m ) ^ ( M * ξ ) P ( ξ ) ( I m e 1 ) ,
where A B is the Kronecker product of matrices A and B.
Now, return to the extended matrices L and L ˜ defined in (19) with u = m . Since these matrices are square matrices, then L * L ˜ I m 2 is equivalent to L L ˜ * I m 2 . Consider the first block row of matrix L and denote it by T ( ξ ) : = { A ^ ( ξ + M * 1 q ) } q D ( M * ) . Additionally, denote the row of matrices A ( ν ) ^ ,   ν = 1 , , m , by T ( ξ ) : = ( A ( 1 ) ^ ( M * ξ ) , , A ( r ) ^ ( M * ξ ) ) . These matrices are connected by m 2 × m 2 matrix V : = P ( I m e 1 , , I m e m ) , i.e.,
T ( ξ ) = T ( ξ ) V .
Lemma 3.
Let A and A ˜ be in ( 0 ( Z d ) ) r × r . Define the rows T , T ˜ , T , T ˜ by
T ( ξ ) = { A ^ ( ξ + M * 1 q ) } q D ( M * ) ,   T ˜ ( ξ ) = { A ˜ ^ ( ξ + M * 1 q ) } q D ( M * )
and T ( ξ ) = { A ( ν ) ^ ( M * ξ ) } ν = 1 , m ¯ , T ˜ ( ξ ) = { A ˜ ( ν ) ^ ( M * ξ ) } ν = 1 , m ¯ , where A ( ν ) ^ and A ˜ ( ν ) ^ , ν = 1 , , m , are the modified polyphase components of A ^ and A ˜ ^ , respectively. Then
q D ( M * ) A ^ ( ξ + M * 1 q ) A ˜ ^ ( ξ + M * 1 q ) * = ν = 1 m A ( ν ) ^ ( M * ξ ) A ˜ ( ν ) ^ ( M * ξ ) *
or T T ˜ * = T T ˜ * .
Proof. 
Note that matrix V is a unitary matrix since it is a product of unitary matrices P and ( I m e 1 , , I m e m ) , where the latter matrix is just a rearrangement of columns of I m 2 . Hence V V * = I m 2 and
T T ˜ * = T V V * T ˜ * = T T ˜ * .
This lemma allows us to extend matrices L and L ˜ from the initial first block row in terms of the modified polyphase components. Consider the row of the modified polyphase components of matrix mask A ^ . Due to Theorem 2 its first block has a special form: ( I m , A ( 2 ) ^ , , A ( m ) ^ ) . This consideration easily implies the fact that interpolating matrix mask A ^ always has at least one dual matrix mask, since the row of the modified polyphase components of such dual matrix mask can be taken as ( I m , 0 m × m , , 0 m × m ) . Denote P : = ( A ( 2 ) ^ , , A ( m ) ^ ) . Next, let A ˜ ^ be a dual matrix mask constructed in Section 4.1 and consider its row of the modified polyphase components. Denote ( A ˜ ( 1 ) ^ , P ˜ ) : = ( A ˜ ( 1 ) ^ , A ˜ ( 2 ) ^ , , A ˜ ( m ) ^ ) . These two block rows of the modified polyphase components are biorthogonal by design. Starting from these rows, the required matrix extension up to square matrices can be done explicitly as follows
N = I m P P ˜ * I m ( m 1 ) P ˜ * P ,   N ˜ = A ˜ ( 1 ) ^ P ˜ P * I m ( m 1 ) .
By direct computations, it can be checked that N N ˜ * = I m m . These matrices contain the modified polyphase components of all masks, and they can be transformed back into matrices L , L ˜ using the transformation matrix V. By Lemma 3, N N ˜ * = I m 2 is equivalent to L L ˜ * = I m 2 . The next theorem describes the symmetry properties of the obtained by (30) wavelet matrix masks.
Theorem 6.
Let A ^ be an interpolating H -symmetric matrix mask with respect to row of centers C = { c s } s D ( M ) , where c s = M 1 s . Let A ˜ ^ be a dual H -symmetric matrix mask with respect to the row of centers C. Let B ν ^ , B ˜ ν ^ , ν = 2 , , m be wavelet matrix masks, obtained via the matrix extension based on (30).
Then wavelet function vectors Ψ ( ν ) and Ψ ˜ ( ν ) contain wavelet functions, which are mutually symmetric in the following sense. For fixed ν = 2 , , m each wavelet function from the vector Ψ ( ν ) = ( ψ 1 ( ν ) , , ψ m ( ν ) ) can be associated with a digit from D ( M , c ν ) , i.e., s ( p , i ) ( ν ) can be associated with ψ ( p , i ) ( ν ) , p = 1 , , # Λ ν ,   i = 1 , , # E p ( ν ) , same for Ψ ˜ ( ν ) . Then for K H
ψ ( p , i ) ( ν ) ^ ( ( M 1 K M ) * ξ ) = ψ ( p , j ) ( ν ) ^ ( ξ ) e 2 π i ( r p , i K , ( ν ) , ξ ) ,   ψ ˜ ( p , i ) ( ν ) ^ ( ( M 1 K M ) * ξ ) = ψ ˜ ( p , j ) ( ν ) ^ ( ξ ) e 2 π i ( r p , i K , ( ν ) , ξ ) ,
where j is such that K [ s p , i ( ν ) ] = s p , j ( ν ) for the group action associated with the symmetry center c ν and r p , i K , ( ν ) is defined in (10).
Proof. 
Let B ν ( μ ) ^ denote the modified polyphase component of B ν , namely, B ν ( μ ) ^ contains the polyphase components of the μ -th column of matrix mask B ν ^ . Additionally, let B ^ 1 = A ^ and B ˜ 1 ^ = A ˜ ^ . Using these notations, the matrices in (30) can be written as
N = B 1 ( 1 ) ^ B 1 ( 2 ) ^ B 1 ( m ) ^ B 2 ( 1 ) ^ B 2 ( 2 ) ^ B 1 ( m ) ^ B m ( 1 ) ^ B m ( 2 ) ^ B m ( m ) ^ ,   N ˜ = B ˜ 1 ( 1 ) ^ B ˜ 1 ( 2 ) ^ B ˜ 1 ( m ) ^ B ˜ 2 ( 1 ) ^ B ˜ 2 ( 2 ) ^ B ˜ 2 ( m ) ^ B ˜ m ( 1 ) ^ B ˜ m ( 2 ) ^ B ˜ m ( m ) ^ .
Next, we check the symmetry properties of wavelet matrix masks and then show how these properties will reflect on wavelet function vectors.
Let us start with matrix N ˜ . Fix ν = 2 , , m and the corresponding set of digits D ( M , c ν ) . Consider block B ˜ ν ( 1 ) ^ in matrix N ˜ and its elements [ B ˜ ν ( 1 ) ^ ( ξ ) ] ( p , i ) , l , here l = 1 , , m ,   p = 1 , , # Λ ν ,   i = 1 , , # E p ( ν ) . By (30) [ B ˜ ν ( 1 ) ^ ( ξ ) ] ( p , i ) , l = [ A ( ν ) ^ ( ξ ) ] l , ( p , i ) ¯ . According to Lemma 2 for the column with index ( p , i ) of matrix A ( ν ) ^ , we have the following relation for K H :
[ A ( ν ) ^ ( ( M 1 K M ) * ξ ) ] ( p , i ) = S C ( M 1 K M I d ) ( ξ ) [ A ( ν ) ^ ( ξ ) ] ( p , j ) e 2 π i ( r p , i K , ( ν ) , ξ ) ,
where j is such that K E ( i ) = E ( j ) F for matrices E ( i ) , E ( j ) E p ( ν ) and F H p ( ν ) , r p , i K , ( ν ) Z d is defined in (10). For the column elements, after applying the complex conjugation, we obtain
[ A ( ν ) ^ ( ( M 1 K M ) * ξ ) ] l , ( p , i ) ¯ = e 2 π i ( c l M 1 K M c l , ξ ) [ A ( ν ) ^ ( ξ ) ] l , ( p , j ) ¯ e 2 π i ( r p , i K , ( ν ) , ξ ) .
Thus,
[ B ˜ ν ( 1 ) ^ ( ( M 1 K M ) * ξ ) ] ( p , i ) , l = e 2 π i ( c l M 1 K M c l , ξ ) e 2 π i ( r p , i K , ( ν ) , ξ ) [ B ˜ ν ( 1 ) ^ ( ξ ) ] ( p , j ) , l .
Since c l = M 1 s l , then e 2 π i ( c l M 1 K M c l , ξ ) = e 2 π i ( s l K s l , M * 1 ξ ) . Hence, changing M * 1 ξ by ξ , we can rewrite
[ B ˜ ν ( 1 ) ^ ( M * K * ξ ) ] ( p , i ) , l e 2 π i ( K s l , ξ ) = e 2 π i ( s l , ξ ) e 2 π i ( r p , i K , ( ν ) , M * ξ ) [ B ˜ ν ( 1 ) ^ ( M * ξ ) ] ( p , j ) , l .
Summing over l = 1 , , m and using the modified polyphase representation, we can get the first column of the wavelet matrix mask B ˜ ν ^ . Namely, since
l = 1 m [ B ˜ ν ( 1 ) ^ ( M * ξ ) ] ( p , i ) , l e 2 π i ( s l , ξ ) = [ B ˜ ν ^ ( ξ ) ] ( p , i ) , 1 ,
then (32) implies that
[ B ˜ ν ^ ( K * ξ ) ] ( p , i ) , 1 = e 2 π i ( K c ν c ν + K s p , i ( ν ) s p , j ( ν ) , ξ ) [ B ˜ ν ^ ( ξ ) ] ( p , j ) , 1 ,
where j is such that K [ s p , i ( ν ) ] = s p , j ( ν ) with the group action associated with the symmetry center c ν and (10) is used.
The other columns of wavelet matrix mask B ˜ ν ^ ,   ν = 2 , , m , are equal to 0 m × 1 except the ν -th column, since the corresponding block with the modified polyphase component B ˜ ν ( ν ) ^ ( ξ ) is equal to I m . Then ν -th column of wavelet matrix mask B ˜ ν ^ contains elements [ B ˜ ν ^ ( ξ ) ] ( p , i ) , ν = e 2 π i ( s p , i ( ν ) , ξ ) , p = 1 , , # Λ ν ,   i = 1 , , # E p ( ν ) . It’s not hard to see that
[ B ˜ ν ^ ( K * ξ ) ] ( p , i ) , ν = e 2 π i ( K s p , i ( ν ) , ξ ) = e 2 π i ( s p , j ( ν ) + K s p , i ( ν ) s p , j ( ν ) , ξ ) = [ B ˜ ν ^ ( ξ ) ] ( p , j ) , ν e 2 π i ( K s p , i ( ν ) s p , j ( ν ) , ξ ) .
Overall, we obtain the following relation:
[ B ˜ ν ^ ( K * ξ ) ] ( p , i ) , l = [ B ˜ ν ^ ( ξ ) ] ( p , j ) , l e 2 π i ( K c ν c ν ( K c l c l ) + K s p , i ( ν ) s p , j ( ν ) , ξ ) ,
which is true for l = 1 by (33), since c 1 = M 1 s 1 = 0 , and for l = ν by (34), and also for all other l = 2 , , m , since the elements in the l-th column, l ν , are just zeros.
Next, let us obtain the analogous relations for wavelet matrix masks obtained from the matrix N . The blocks B ^ 1 ( ν ) obviously gives the result similar to (33), since the symmetry properties of the elements of the rows P and P ˜ are the same. Therefore,
[ B ν ^ ( K * ξ ) ] ( p , i ) , 1 = e 2 π i ( K c ν c ν + K s p , i ( ν ) s p , j ( ν ) , ξ ) [ B ν ^ ( ξ ) ] ( p , j ) , 1 ,
where j is such that K [ s p , i ( ν ) ] = s p , j ( ν ) with the group action associated with the symmetry center c ν .
Next, consider other blocks of matrix N . Note that each block has the form B ν ( μ ) ^ = δ ν , μ I m A ˜ ( ν ) ^ * A ( μ ) ^ , ν , μ = 2 , , m . Consider each block element-wise, where elements are indexed by double index as follows: the rows are indexed using ( p ( ν ) , i ( ν ) ) , i.e., using indexing of the digits in D ( M , c ν ) and the columns are indexed using ( p ( μ ) , i ( μ ) ) , i.e., using indexing of the digits in D ( M , c μ ) . Using the symmetry properties of the modified polyphase components A ˜ ( ν ) ^ and A ( μ ) ^ from Lemma 2, we obtain
[ B ν ( μ ) ^ ( M * K * M * 1 ξ ) ] ( p ( ν ) , i ( ν ) ) , ( p ( μ ) , i ( μ ) ) = δ ν , μ I m t = 1 m [ A ˜ ( ν ) ^ ( M * K * M * 1 ξ ) ¯ ] t , ( p ( ν ) , i ( ν ) ) [ A ( μ ) ^ ( M * K * M * 1 ξ ) ] t , ( p ( μ ) , i ( μ ) )
= [ B ν ( μ ) ^ ( ξ ) ] ( p ( ν ) , j ( ν ) ) , ( p ( μ ) , j ( μ ) ) e 2 π i ( r p , i K , ( ν ) r p , i K , ( μ ) , ξ ) ,
where j ( ν ) is such that is such that K [ s p ( ν ) , i ( ν ) ( ν ) ] = s p ( ν ) , j ( ν ) ( ν ) with the group action associated with the symmetry center c ν and j ( μ ) such that K [ s p ( μ ) , i ( μ ) ( μ ) ] = s p ( μ ) , j ( μ ) ( μ ) with the group action associated with the symmetry center c μ , r p , i K , ( μ ) is defined as
r p , i K , ( μ ) = M 1 ( K s p ( μ ) , i ( μ ) ( μ ) s p ( μ ) , j ( μ ) ( μ ) + K c μ c μ ) =
M 1 K s p ( μ ) , i ( μ ) ( μ ) M 1 s p ( μ ) , j ( μ ) ( μ ) + M 1 ( K c μ c μ )
and similar for r p , i K , ( ν ) .
Next, consider the modified polyphase representation in order to obtain the elements from the μ -th column of wavelet matrix mask B ν ^
( p ( μ ) , i ( μ ) ) [ B ν ( μ ) ^ ( ξ ) ] ( p ( ν ) , i ( ν ) ) , ( p ( μ ) , i ( μ ) ) e 2 π i ( s p ( μ ) , i ( μ ) ( μ ) , M * 1 ξ ) = [ B ν ^ ( M * 1 ξ ) ] ( p ( ν ) , i ( ν ) ) , μ ,
where the sum is taken over all indices of digits s p ( μ ) , i ( μ ) ( μ ) from D ( M , c μ ) . Then relation (36) implies that
[ B ν ^ ( K * M * 1 ξ ) ] ( p ( ν ) , i ( ν ) ) , μ = [ B ν ^ ( M * 1 ξ ) ] ( p ( ν ) , i ( ν ) ) , μ e 2 π i ( r p , i K , ( ν ) M 1 ( K c μ c μ ) , ξ )
or
[ B ν ^ ( K * ξ ) ] ( p ( ν ) , i ( ν ) ) , μ = [ B ν ^ ( ξ ) ] ( p ( ν ) , i ( ν ) ) , μ e 2 π i ( M r p , i K , ( ν ) ( K c μ c μ ) , ξ ) .
This gives the required symmetry relation similar to (35).
Next, we check how the obtained symmetry relation for wavelet matrix masks will affect on wavelet function vectors. Recall that
Ψ ( ν ) ^ ( M * ξ ) = B ν ^ ( ξ ) Φ ^ ( ξ ) ,   Ψ ˜ ( ν ) ^ ( M * ξ ) = B ˜ ν ^ ( ξ ) Φ ˜ ^ ( ξ ) ,
ν = 2 , , m .
Since only two columns of B ˜ ν ^ ( ξ ) are non-zero, then
Ψ ˜ ( ν ) ^ ( M * ξ ) = [ B ˜ ν ^ ( ξ ) ] 1 φ ^ 1 ( ξ ) + [ B ˜ ν ^ ( ξ ) ] ν φ ^ ν ( ξ ) .
By default, Ψ ˜ ( ν ) ^ = ( ψ ˜ 1 ( ν ) ^ , , ψ ˜ m ( ν ) ) ^ . However, it is more convenient, if wavelet functions are indexed in the same way as digits from D ( M , c ν ) . Namely, consider ψ ˜ ( p , i ) ( ν ) ^ , where p = 1 , , # Λ ν ,   i = 1 , , # E p ( ν ) . Then for K H equality (35) implies that
ψ ˜ ( p , i ) ( ν ) ^ ( M * K * ξ ) = [ B ˜ ν ^ ( K * ξ ) ] ( p , i ) , 1 φ ^ 1 ( K * ξ ) + [ B ˜ ν ^ ( K * ξ ) ] ( p , i ) , ν φ ^ ν ( K * ξ ) = e 2 π i ( K c ν c ν + K s p , i ( ν ) s p , j ( ν ) , ξ ) [ B ˜ ν ^ ( ξ ) ] ( p , j ) , 1 φ ^ 1 ( ξ ) + [ B ˜ ν ^ ( ξ ) ] ( p , j ) , ν e 2 π i ( K s p , i ( ν ) s p , j ( ν ) , ξ ) φ ^ ν ( ξ ) e 2 π i ( K c ν c ν , ξ ) = e 2 π i ( K c ν c ν + K s p , i ( ν ) s p , j ( ν ) , ξ ) ψ ˜ ( p , j ) ( ν ) ^ ( M * ξ ) .
Or
ψ ˜ ( p , i ) ( ν ) ^ ( ( M 1 K M ) * ξ ) = ψ ˜ ( p , j ) ( ν ) ^ ( ξ ) e 2 π i ( r p , i K , ( ν ) , ξ ) ,
where j is such that K [ s p , i ( ν ) ] = s p , j ( ν ) with the group action associated with the symmetry center c ν . This means that functions of wavelet function vector Ψ ˜ ( ν ) are mutually symmetric with each other.
Similar relations can be established for wavelet functions in vector Ψ ( ν ) ^ . Fix ψ ( p , i ) ( ν ) ^ , where p = 1 , , # Λ ν ,   i = 1 , , # E p ( ν ) . Then for K H equality (37) implies that
ψ ( p , i ) ( ν ) ^ ( M * K * ξ ) = μ = 1 m [ B ν ^ ( K * ξ ) ] ( p , i ) , μ φ ^ μ ( K * ξ ) = μ = 1 m [ B ν ^ ( ξ ) ] ( p , j ) , μ e 2 π i ( M r p , i K , ( ν ) ( K c μ c μ ) , ξ ) φ ^ μ ( ξ ) e 2 π i ( K c μ c μ , ξ ) = e 2 π i ( M r p , i K , ( ν ) , ξ ) ψ ( p , j ) ( ν ) ^ ( M * ξ ) ,
where j is such that K [ s p , i ( ν ) ] = s p , j ( ν ) with the group action associated with the symmetry center c ν . □
Relations (31) describe the symmetry properties of the resulting wavelets. If the set of digits D ( M , c ν ) associated with symmetry center c ν is such that all orbits contain only one element, i.e., D ( M , c ν ) = { s p , 1 ( ν ) , p = 1 , , m } , then all wavelet functions are, indeed, H -symmetric. If some orbit has more than one element, then the corresponding wavelet functions are mutually symmetric, which means that for some matrices K H , one wavelet function transforms into another according to relations (31). For some symmetry groups, additional symmetrization step can be done, which helps to obtain truly H -symmetric wavelets from mutually symmetric ones. The idea of this symmetrization step and details can be found in [27].

4.3. Further Details and Discussion

The above considerations give a method for the construction of compactly supported MRA-based dual multiwavelet system with symmetry properties. It remains to check that the obtained system of multiwavelets is, indeed, a dual multiwavelet frame. Recall that functions in vectors Φ and Φ ˜ should be in L 2 ( R d ) and vanishing moments at least of order 1 for all wavelet functions should be provided. The fact that refinable functions belong to L 2 ( R d ) can be checked after the construction of matrix masks. Moreover, it is known (see ([39] Theorem 2.2)) that if compactly supported refinable functions are in L 2 ( R d ) , then they are in W 2 ν ( R d ) with some ν > 0 . This value ν can be computed using the algorithm in [34]. Regarding the vanishing moments of wavelet functions, the following lemma, which is the generalization to the multivariate case of Theorem 2.1 in [40], will be helpful.
Lemma 4.
Let L and L ˜ be the matrices defined in (19) with u = m . Then B 1 ^ obeys sum rule of order n with a row of functions y if and only if
D α [ y ^ ( ξ ) B ˜ ν ^ ( ξ ) * ] | ξ = 0 = δ 1 , ν D α y ^ ( M * ξ ) | ξ = 0 , α Δ n , ν = 1 , , m .
Proof. 
The sum rule condition of order n for matrix mask B 1 ^ can be rewritten as follows
D α [ y ( M * ξ ) B 1 ^ ( ξ + M * 1 s j ) ] | ξ = 0 = δ 1 , j D α y ( 0 ) , j = 1 , , m .
Since L L ˜ * I m r then
j = 1 m B 1 ^ ( ξ + M * 1 s j ) [ B ˜ ν ^ ( ξ + M * 1 s j ) ] * = δ 1 , ν I r , ν = 1 , , m .
Multiplying the last equality from the left by the column vector y ( M * ξ ) , we obtain
j = 1 m y ( M * ξ ) B 1 ^ ( ξ + M * 1 s j ) [ B ˜ ν ^ ( ξ + M * 1 s j ) ] * = δ 1 , ν y ( M * ξ ) ,   ν = 1 , , m .
Taking the derivatives of order α Δ n at the origin, we obtain
δ 1 , ν D α y ( M * ξ ) | ξ = 0 = j = 1 m β α α β D α β [ y ( M * ξ ) B 1 ^ ( ξ + M * 1 s j ) ] | ξ = 0 D β [ B ˜ ν ^ ( ξ + M * 1 s j ) ] * | ξ = 0 .
By (38) and since s 1 = 0 we obtain
δ 1 , ν D α y ( M * ξ ) | ξ = 0 = β α α β D α β y ( ξ ) | ξ = 0 D β [ B ˜ ν ^ ( ξ ) ] * | ξ = 0 .
Conversely, since L L ˜ * I m r is equivalent to L ˜ * L I m r , then
ν = 1 m [ B ˜ ν ^ ( ξ ) ] * B ν ^ ( ξ + M * 1 q ) = δ 0 , q I r ,   q D ( M * ) .
Multiplying the last equality from the left by y ( ξ ) , we obtain
ν = 1 m y ( ξ ) [ B ˜ ν ^ ( ξ ) ] * B ν ^ ( ξ + M * 1 q ) = δ 0 , q y ( ξ ) ,   q D ( M * ) .
Taking the derivatives of order α Δ n at the origin, we obtain
ν = 1 m β α α β D β [ y ( ξ ) B ˜ ν ^ ( ξ ) * ] | ξ = 0 D α β B ν ^ ( ξ + M * 1 q ) | ξ = 0 = δ 0 , q D α y ( 0 ) , β α α β D β y ( M * ξ ) | ξ = 0 D α β B ˜ 1 ^ ( ξ + M * 1 q ) | ξ = 0 = δ 0 , q D α y ( 0 ) ,
which is equivalent to sum rule condition of order n. □
This result allows us to check that MRA-based multiwavelets are provided with vanishing moments of order 1. Indeed, if the initial matrix mask A ^ = B ^ 1 obeys sum rule at least of order 1, then Lemma 4 says that
y ( 0 ) B ˜ 1 ^ ( 0 ) * = y ( 0 )   and   y ( 0 ) B ˜ ν ^ ( 0 ) * = 0 , ν = 2 , , m .
Note that Ψ ˜ ( ν ) ^ ( 0 ) = B ˜ ν ^ ( 0 ) Φ ˜ ^ ( 0 ) and Φ ˜ ^ ( 0 ) is the unique 1-eigenvector of B ˜ 1 ^ ( 0 ) , therefore B ˜ 1 ^ ( 0 ) Φ ˜ ^ ( 0 ) = Φ ˜ ^ ( 0 ) . Hence, Φ ˜ ^ ( 0 ) is equal to y ( 0 ) * up to a multiplication by a constant and Ψ ˜ ( ν ) ^ ( 0 ) = 0 . By duality, it is also true that Ψ ( ν ) ^ ( 0 ) = 0 , if the dual matrix mask obeys sum rule at least of order 1.
Moreover, in practice, dual wavelet function vectors Ψ ˜ ( ν ) are used for the analysis operations, and it is good to provide these functions with high order of vanishing moments. This is indeed the case, namely, the order of vanishing moments for Ψ ˜ ( ν ) is equal to n (i.e., equal to the order of sum rule of the initial matrix mask A ^ ). Note that by Lemma 4
D α [ B ˜ ν ^ ( ξ ) y * ( ξ ) ] | ξ = 0 = 0 , α Δ n , ν = 2 , , m .
We have to check that D α y * ( 0 ) = D α Φ ˜ ^ ( 0 ) , since this equality provides vanishing moments for Ψ ˜ ( ν ) . Indeed, equalities
D α [ Ψ ˜ ( ν ) ^ ( M * ξ ) ] | ξ = 0 = D α [ B ˜ ν ^ ( ξ ) Φ ˜ ^ ( ξ ) ] | ξ = 0 = D α [ B ˜ ν ^ ( ξ ) y * ( ξ ) ] | ξ = 0 = 0 , α Δ n ,
ν = 2 , , m , imply that D α Ψ ˜ ( ν ) ^ ( 0 ) = 0 , α Δ n ,   ν = 2 , , m . By the refinement equation, it is true that
D α Φ ˜ ^ ( M * ξ ) | ξ = 0 = D α [ A ˜ ^ ( ξ ) Φ ˜ ^ ( ξ ) ] | ξ = 0 .
Note that by duality and by Equation (25), the derivatives of y at the origin are related with the derivatives of A ˜ ^ as follows
D α A ˜ ^ ( ξ ) y * ( ξ ) | ξ = 0 = D α [ y * ( M * ξ ) ] | ξ = 0 , α Δ n .
Since this relation defines the derivatives of y at the origin uniquely (up to a multiplication by a constant), then comparing it with (39), we obtain the required connection D α y * ( 0 ) = D α Φ ˜ ^ ( 0 ) .
It is also worth noting that the constructed symmetric multiwavelets have the balancing property. For a filter bank related to some wavelet system, the high number of vanishing moments for wavelets ψ ˜ ν is equivalent to the same number of vanishing moment for the corresponding wavelet masks b ˜ ν . In practice, this means that during the analysis step of the discrete wavelet transform high frequency components of the input sequence vanish. For a multiwavelet filter bank ( A ^ , B ^ 2 , , B ^ r ) and ( A ˜ ^ , B ˜ 2 ^ , , B ˜ r ^ ) , generally, this is not the case. This property should be provided specifically, and the related notion is called the balancing property. However, in the interpolating case, balancing order for the analysis filter bank ( A ˜ ^ , B ˜ 2 ^ , , B ˜ r ^ ) is equal to the order of sum rule of matrix mask A ^ . The necessary and sufficient conditions are stated in ([41] Proposition 3.1, Theorem 4.1) (see, also, ([16] Theorem 2.1)). The balancing property of order n is provided for the analysis filter bank ( A ˜ ^ , B ˜ 2 ^ , , B ˜ r ^ ) if y ( ξ ) = { e 2 π i ( M 1 s , ξ ) } s D ( M ) , and
D α [ y ( ξ ) B ˜ ν ^ ( ξ ) * ] | ξ = 0 = 0 , α Δ n ,
D α [ y ( ξ ) A ˜ ^ ( ξ ) * ] | ξ = 0 = D α y ^ ( M * ξ ) | ξ = 0 , α Δ n .
For the interpolating matrix mask A ^ , a vector of functions y is taken exactly as required. The last two conditions are true due to Lemma 4.
Next, we discuss several additional aspects. Let us compare the obtained results with the approach proposed in [20] for the same problem. In [20] the construction of matrix masks is done by transferring all required conditions into the form of systems of linear equations. The coefficients of initial matrix mask and dual matrix mask are obtained as a numerical solution of such systems. The existence of solution for any appropriate set of initial parameters is out of consideration. Wavelet matrix masks are obtained by an explicit procedure, but the study of their symmetry and approximation properties is not carried out. The approach proposed in the current paper describes the inner structure of symmetric matrix masks in terms of the modified polyphase components; coefficients of the matrix masks can be obtained even analytically, if needed. Additionally, the description of symmetry in terms of the modified polyphase components helps to study the symmetry properties of the obtained wavelet matrix masks.
In fact, the interpolating property leads to some limitations on the choice of a pair of appropriate symmetry group and dilation matrix (see condition (18)). Additionally, the interpolating property means that the number r of functions in refinable function vector is equal to | det M | , and the symmetry centers are defined by digits. On the other hand, in the non-interpolating case, general matrix extension with symmetry becomes a challenging problem. In the scalar case, several methods were developed (see, for example, [42,43,44] and the references therein). This is a question for future investigations, whether these methods can be modified for multiwavelets.
Finally, multivariate wavelet frames are successively used in applications related to signal processing and numerical solution of PDEs (for example, in [5] 2D multiwavelet transform is used in the iris biometric technique for person authentication, in [1] 2D multiwavelets are used for dimensionality reduction and features extraction in the algorithm of face recognition, in [21] 2D multiwavelets are applied to variational image denoising and in [4] 2D multiwavelets are used for the compression, analysis and assembly of hydrodynamic model data within Godunov-type solvers based on second-order discontinuous Galerkin methods). Mostly, 2D multiwavelets in the above-mentioned applications and in the literature are separable, i.e., they are obtained as a tensor product of 1D multiwavelets. However, there are several results that non-separable wavelets provide some advantages in certain applications compared to separable ones (see, for example, [45,46] for wavelet and [47] for multiwavelets). The proposed method for the construction of symmetric non-separable multiwavelets can help to obtain multiwavelets, which potentially can lead to improvements in the mentioned and other applications. We leave these problems for future research.

5. Examples

1. Consider simple symmetry group in R 2 : H = { I 2 , I 2 } and quincunx dilation matrix M = 1 1 1 1 . The set of digits is D ( M ) = { ( 0 , 0 ) , ( 1 , 0 ) } . Clearly, condition E s s M Z d is valid for all E H and s D ( M ) . For interpolating matrix mask the row of symmetry centers is C = ( ( 0 , 0 ) , ( 1 2 , 1 2 ) ) .
Consider matrix mask A ^ defined by
A ^ ( ξ ) = 1 2 3 16 + 1 16 y + 3 16 x y + 1 16 x x 2 3 x 16 + x 16 y + 1 16 + 3 16 y .
Here (and below) x = e 2 π i ξ 1 , y = e 2 π i ξ 2 . This matrix mask is H -symmetric with respect to the row of centers C. The matrix of symmetry centers for each matrix element is ( 0 , 0 ) ( 1 2 , 1 2 ) ( 1 , 0 ) ( 1 2 , 1 2 ) . This matrix mask obeys the sum rule of order 2. Additionally, the eigenvalues of A ^ ( 0 ) are 1 and 0. The Sobolev smoothness of the corresponding refinable functions here and below can be computed using algorithm developed in [34]. Here φ i , i = 1 , 2 , are at least in W 2 1.58411 ( R 2 ) . See Figure 1 for the graph of φ 1 (note that φ 2 is just a shifted copy of φ 1 ). The dual matrix mask A ˜ ^ can be taken as follows:
A ˜ ^ ( ξ ) = 3 32 y x x 32 + 13 16 y 32 1 32 x 1 32 y 3 32 x y 1 4 + 1 4 x y 3 32 y x 2 x 2 32 + 13 x 16 y x 32 x 32 y 1 32 3 32 y x 4 + 1 4 y .
It is also H -symmetric with respect to the same row of centers C and it obeys sum rule of order 1. The eigenvalues of A ˜ ^ ( 0 ) are 1 and 0. The corresponding refinable functions are at least in W 2 0.10204 ( R 2 ) . After the matrix extension is obtained, the wavelet matrix masks are
B ^ 2 ( ξ ) = x y 4 1 4 3 32 y x x 32 + 13 16 y 32 1 32 x 1 32 y 3 32 x y y x 2 4 x 4 3 32 y x 2 x 2 32 + 13 x 16 y x 32 x 32 y 1 32 3 32 y , B ˜ 2 ^ ( ξ ) = 3 16 y x x 16 y 16 3 16 1 2 3 16 y x 2 x 2 16 y x 16 3 x 16 x 2 .
Note that in this case, the sets of digits associated with symmetry centers are: D ( M , c 1 ) = { s 1 , 1 ( 1 ) = ( 0 , 0 ) , s 2 , 1 ( 1 ) = ( 1 , 0 ) } and D ( M , c 2 ) = { s 1 , 1 ( 2 ) = ( 0 , 0 ) , s 2 , 1 ( 2 ) = ( 1 , 0 ) } . This means that each trigonometric polynomial in wavelet matrix masks is H -symmetric, which implies simple symmetry of the corresponding wavelets.
2. Consider axis symmetry group in R 2 :
H = 1 0 0 1 , 1 0 0 1 , 1 0 0 1 , 1 0 0 1 .
Let M = 0 1 2 0 . The set of digits is D ( M ) = { ( 0 , 0 ) , ( 0 , 1 ) } . Clearly, condition E s s M Z d is valid for all E H and s D ( M ) . For interpolating matrix mask the row of symmetry centers is C = ( ( 0 , 0 ) , ( 1 2 , 0 ) ) .
Consider matrix mask A ^ defined by
A ^ ( ξ ) = 1 2 1 2 1 2 + 1 2 x y 2 1 2 y 2 + y 2 x .
Here (and below) x = e 2 π i ξ 1 , y = e 2 π i ξ 2 . This matrix mask is H -symmetric with respect to the row of centers C. The matrix of symmetry centers for each matrix elements is ( 0 , 0 ) ( 1 2 , 0 ) ( 0 , 1 ) ( 1 2 , 1 ) . This matrix mask obeys sum rule of order 2. Also, the eigenvalues of A ^ ( 0 ) are 1 and 0. The corresponding refinable functions are at least in W 2 1.5 ( R 2 ) . See Figure 2 for the graph of φ 1 (note that φ 2 is just a shifted copy of φ 1 ). The dual matrix mask A ˜ ^ can be taken as follows
A ˜ ^ ( ξ ) = x 8 + 3 4 1 8 x 1 4 + 1 4 x 3 y 4 x y 8 y 8 x y 4 + y 4 x .
It is also H -symmetric with respect to the same row of centers C, and it obeys sum rule of order 2. Additionally, the eigenvalues of A ˜ ^ ( 0 ) are 1 and 0. The corresponding dual refinable functions are at least in W 2 0.440765 ( R 2 ) . After the matrix extension is obtained, the wavelet matrix masks are
B ^ 2 ( ξ ) = x 4 1 4 x 8 + 3 4 1 8 x x y 4 y 4 3 y 4 x y 8 y 8 x ,   B ˜ 2 ^ ( ξ ) = x 4 1 4 1 2 x y 4 y 4 y 2 .
Note that in this case, the sets of digits associated with symmetry centers are: D ( M , c 1 ) = { s 1 , 1 ( 1 ) = ( 0 , 0 ) , s 2 , 1 ( 1 ) = ( 0 , 1 ) } and D ( M , c 2 ) = { s 1 , 1 ( 2 ) = ( 0 , 0 ) , s 2 , 1 ( 2 ) = ( 0 , 1 ) } . This means that each trigonometric polynomial in wavelet matrix masks is H -symmetric, which implies axis symmetry of the corresponding wavelets.
3. Consider hexagonal abelian symmetry group
H = I 2 , 0 1 1 1 , 1 1 1 0
and dilation matrix M = 2 1 1 1 . The set of digits are D ( M ) = { ( 0 , 0 ) , ( 0 , 1 ) , ( 1 , 1 ) } . It can be checked that E s s M Z d is valid for all E H and s D ( M ) . The row of symmetry centers for interpolating matrix mask is C = { ( 0 , 0 ) , ( 1 / 3 , 2 / 3 ) , ( 2 / 3 , 1 / 3 ) } .
Consider matrix mask A ^ defined by
A ^ ( ξ ) = 1 3 4 27 + 4 27 x y + 4 27 y 1 9 + 1 9 x y + 1 9 x y 3 x y 81 + 10 y 81 y 81 x + 10 81 + 10 81 x 1 81 x y y 9 + y 9 x + 1 9 x x y 3 2 81 y x 2 + 8 y x 81 + 8 x 81 2 y 81 + 8 81 2 81 y x y 9 + y 9 + 1 9 .
Here (and below) x = e 2 π i ξ 1 , y = e 2 π i ξ 2 . This matrix mask is H -symmetric with respect to the row of centers C. The matrix of symmetry centers for each matrix elements is ( 0 , 0 ) ( 1 3 , 2 3 ) ( 2 3 , 1 3 ) ( 0 , 1 ) ( 1 3 , 1 3 ) ( 2 3 , 2 3 ) ( 1 , 1 ) ( 2 3 , 1 3 ) ( 1 3 , 2 3 ) .
This matrix mask obeys the sum rule of order 2. Additionally, the eigenvalues of A ^ ( 0 ) are 1, 0 and 0. The corresponding refinable functions are at least in W 2 1.6726 ( R 2 ) . See Figure 3, Figure 4 and Figure 5 for the graphs of φ 1 , φ 2 , φ 3 . The dual matrix mask A ˜ ^ can be taken as follows
A ˜ ^ ( ξ ) = a 1 , 1 ( ξ ) 1 6 + 1 6 x y + 1 6 y 4 27 + 4 27 x y + 4 27 x y 0 0 a 1 , 3 ( ξ ) y x 6 + x 6 + 1 6 x y 2 27 + x y 9 + y 9 + x 27 + 1 9 + 1 27 x ,
where
a 1 , 1 ( ξ ) = 7 81 y x 17 x 162 + 17 27 17 y 162 7 81 x 7 81 y 17 162 x y ,
a 1 , 3 ( ξ ) = 10 81 y x 2 17 y 2 x 2 162 + 20 y x 27 10 y 2 x 81 17 x 162 10 81 17 y 162 .
It is also H -symmetric with respect to the same row of centers C and it obeys sum rule of order 1. Additionally, the eigenvalues of A ˜ ^ ( 0 ) are 1, 1 2 and 0. The corresponding dual refinable functions are at least in W 2 0.136994 ( R 2 ) . Again, the matrix extension allows us to construct wavelet matrix masks. For instance, dual wavelet masks are
B ˜ 2 ^ ( ξ ) = 8 81 y x + x 81 4 27 10 y 81 + 2 81 x 1 3 0 2 x 2 y 3 81 4 x y 2 27 10 x 2 y 2 81 8 x y 81 + y 81 x y 3 0 x y 3 81 4 x y 2 27 8 y 2 81 + 2 x y 81 10 y 81 y 3 0 ,
B ˜ 3 ^ ( ξ ) = y x 9 x 9 1 9 0 1 3 y x 2 9 x 2 9 x 9 0 x 3 1 9 y 2 x 2 y x 2 9 y x 9 0 x y 3 .
Analogously, primal wavelet masks can be obtained. Note that in this case the sets of digits associated with symmetry centers are: D ( M , c 1 ) = { s 1 , 1 ( 1 ) = ( 0 , 0 ) , s 2 , 1 ( 1 ) = ( 0 , 1 ) , s 3 , 1 ( 1 ) = ( 1 , 1 ) } and D ( M , c 2 ) = { s 1 , 1 ( 2 ) = ( 0 , 0 ) , s 1 , 2 ( 2 ) = ( 1 , 1 ) , s 1 , 3 ( 3 ) = ( 0 , 1 ) } , D ( M , c 3 ) = { s 1 , 1 ( 2 ) = ( 0 , 0 ) , s 1 , 2 ( 2 ) = ( 1 , 0 ) , s 1 , 3 ( 3 ) = ( 1 , 1 ) } . This means that trigonometric polynomials in columns of wavelet matrix masks are mutually symmetric, which implies mutual symmetry of the corresponding wavelets.

Funding

The research was supported by the Russian Science Foundation (grant No. 18-11-00055).

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Not applicable.

Acknowledgments

The author thanks the anonymous referees for their valuable comments and suggestions that have improved the original version of this work.

Conflicts of Interest

The author declares no conflict of interest.

References

  1. Aldhahab, A.; Mikhael, W.B. Face Recognition Employing DMWT Followed by FastICA. Circ. Syst. Sign. Process. 2018, 37, 2045–2073. [Google Scholar] [CrossRef]
  2. Alexandridis, A.K.; Zapranis, A.D. Wavelet Neural Networks: With Applications in Financial Engineering, Chaos, and Classification; Wiley: Hoboken, NJ, USA, 2014. [Google Scholar]
  3. Hinders, M.K. Intelligent Feature Selection for Machine Learning Using the Dynamic Wavelet Fingerprint; Springer: Cham, Switzerland, 2020. [Google Scholar]
  4. Kesserwani, G.; Sharifian, M.K. (Multi)wavelets increase both accuracy and efficiency of standard Godunov-type hydrodynamic models: Robust 2D approaches. Adv. Water Resour. 2020, 144, 103693. [Google Scholar] [CrossRef]
  5. Rajput, M.R.; Sable, G.S.; Gite, H.R. Iris Biometric Technique for Person Authentication Based on Fusion of Radon and 2D Multi-Wavelet Transform. In Proceedings of the 2018 International Conference On Advances in Communication and Computing Technology (ICACCT), Sangamner, India, 8–9 February 2018; pp. 410–415. [Google Scholar]
  6. Rufenacht, D. Novel Motion Anchoring Strategies for Wavelet-based Highly Scalable Video Compression; Springer: Singapore, 2018. [Google Scholar]
  7. Alpert, B. Sparse Representation of Smooth Linear Operators; Technical Report YALEU/DCS/RR-814; Yale University: New Haven, CT, USA, 1990. [Google Scholar]
  8. Donovan, G.C.; Geronimo, J.S.; Hardin, D.P.; Massopust, P.R. Construction of orthogonal wavelets using fractal interpolation functions. SIAM J. Math. Anal. 1996, 27, 1158–1192. [Google Scholar] [CrossRef]
  9. Geronimo, J.; Hardin, D.; Massopust, P. Fractal functions and wavelet expansions based on several scaling functions. J. Approx. Theory 1994, 78, 373–401. [Google Scholar] [CrossRef] [Green Version]
  10. Keinert, F. Wavelets and Multiwavelets. In Studies in Advanced Mathematics; Chapman and Hall/CRC Press: Boca Raton, FL, USA, 2003; Volume 42. [Google Scholar]
  11. Selesnick, I.W. Interpolating multiwavelet bases and the sampling theorem. IEEE Trans. Sign. Process. 1999, 47, 1615–1621. [Google Scholar] [CrossRef]
  12. Han, B.; Zhuang, X.S. Matrix extension with symmetry and its application to symmetric orthonormal multiwavelets. SIAM J. Math. Anal. 2010, 42, 2297–2317. [Google Scholar] [CrossRef] [Green Version]
  13. Zhuang, X.S. Matrix extension with symmetry and construction of biorthogonal multiwavelets with any integer dilation. Appl. Comput. Harmon. Anal. 2012, 33, 159–181. [Google Scholar] [CrossRef] [Green Version]
  14. Atreas, N.D.; Papadakis, M.; Stavropoulos, T. Extension Principles for Dual Multiwavelet Frames of L2(Rs) constructed from Multirefinable Generators. J. Fourier Anal. Appl. 2016, 22, 854–877. [Google Scholar] [CrossRef]
  15. Han, B.; Lu, R. Multivariate quasi-tight framelets with high balancing orders derived from any compactly supported refinable vector functions. Sci. China Math. 2022, 65, 81–110. [Google Scholar] [CrossRef]
  16. Lu, R. Compactly supported multivariate dual multiframelets with high vanishing moments and high balancing orders. Functional Analysis. arXiv 2020, arXiv:2009.10309. [Google Scholar]
  17. Han, B. Symmetric multivariate orthogonal refinable functions. Appl. Comput. Harmon. Anal. 2004, 17, 277–292. [Google Scholar] [CrossRef] [Green Version]
  18. Gao, X.; Xiao, F.; Li, B. Construction of arbitrary dimensional biorthogonal multiwavelet using lifting scheme. IEEE Trans. Image Process. 2009, 18, 942–955. [Google Scholar] [PubMed]
  19. Li, Y.; Yang, S.; Yuan, D. Bessel multiwavelet sequences and dual multiframelets in Sobolev spaces. Adv. Comput. Math. 2013, 38, 491–529. [Google Scholar] [CrossRef]
  20. Koch, K. Multivariate Symmetric Interpolating Scaling Vectors with Duals. J. Fourier Anal. Appl. 2009, 15, 1–30. [Google Scholar] [CrossRef]
  21. Ehler, M.; Koch, K. The Construction of Multiwavelet Bi-Frames and Applications to Variational Image Denoising. Int. J. Wavelets Multiresolut. Inf. Process. 2010, 8, 431–455. [Google Scholar] [CrossRef]
  22. Krivoshein, A. Multivariate symmetric refinable functions and function vectors. Int. J. Wavelets Multiresolut. Inform. Process. 2016, 14, 1650034. [Google Scholar] [CrossRef]
  23. Chui, C.; Jiang, Q. Matrix-valued symmetric templates for interpolatory surface subdivisions: I. Regular vertices. Appl. Comput. Harmon. Anal. 2005, 19, 303–339. [Google Scholar] [CrossRef] [Green Version]
  24. Han, B. Approximation Properties and Construction of Hermite Interpolants and Biorthogonal Multiwavelets. J. Approx. Theory 2010, 110, 18–53. [Google Scholar] [CrossRef] [Green Version]
  25. Novikov, I.; Protasov, V.; Skopina, M. Wavelet Theory. Am. Math. Soc. 2011, 239, 506p. [Google Scholar]
  26. Krivoshein, A.; Protasov, V.; Skopina, M. Multivariate wavelet frames. In Industrial and Applied Mathematics; Springer: Singapore, 2016. [Google Scholar]
  27. Krivoshein, A. Symmetric interpolatory dual wavelet frames. St. Petersburg Math. J. 2017, 28, 323–343. [Google Scholar] [CrossRef] [Green Version]
  28. Cameron, P.J. Permutation Groups; Cambridge University Press: Cambridge, UK, 1999. [Google Scholar]
  29. Cabrelli, C.; Heil, C.; Molter, U. Accuracy of several multidimensional refinable distributions. J. Fourier Anal. Appl. 2000, 6, 483–502. [Google Scholar] [CrossRef]
  30. Jia, R.Q.; Micchelli, C.A. Using the refinement equation for the construction of pre-wavelets. II. Power of two. In Curves and Surfaces; Laurent, P.J., Le Mehaute, A., Schumaker, L.L., Eds.; Academic Press: New York, NY, USA, 1991; pp. 209–246. [Google Scholar]
  31. Jia, R.Q.; Jiang, Q. Approximation power of refinable vectors of functions, in Wavelet analysis and applications. AMS/IP Stud. Adv. Math 2002, 25, 155–178. [Google Scholar]
  32. Han, B.; Zhuang, X.S. Analysis and Construction of Multivariate Interpolating Refinable Function Vectors. Acta Appl. Math. 2009, 107, 143–171. [Google Scholar] [CrossRef] [Green Version]
  33. Koch, K. Multivariate orthonormal interpolating scaling vectors. Appl. Comput. Harmon. Anal. 2007, 2, 198–216. [Google Scholar] [CrossRef] [Green Version]
  34. Han, B. Vector cascade algorithms and refinable function vectors in Sobolev spaces. J. Appl. Theory 2003, 124, 44–88. [Google Scholar] [CrossRef] [Green Version]
  35. Diao, C.; Han, B. Quasi-tight framelets with high vanishing moments derived from arbitrary refinable functions. Appl. Comput. Harmon. Anal. 2020, 49, 123–151. [Google Scholar] [CrossRef]
  36. Han, B. Symmetry property and construction of wavelets with a general dilation matrix. Linear Algebr. Its Appl. 2002, 353, 207–225. [Google Scholar] [CrossRef] [Green Version]
  37. Krivoshein, A. On construction of multivariate symmetric MRA-based wavelets. Appl. Comput. Harmon. Anal. 2014, 36, 215–238. [Google Scholar] [CrossRef]
  38. Ron, A.; Shen, Z. Affine systems in L2(Rd) II: Dual systems. J. Fourier Anal. Appl. 1997, 3, 617–637. [Google Scholar] [CrossRef]
  39. Han, B. Compactly supported tight wavelet frames and orthonormal wavelets of exponential decay with a general dilation matrix. J. Comput. Appl. Math. 2003, 155, 43–67. [Google Scholar] [CrossRef] [Green Version]
  40. Keinert, F. Raising Multiwavelet Approximation Order Through Lifting. SIAM J. Math. Anal. 2001, 32, 1032–1049. [Google Scholar] [CrossRef] [Green Version]
  41. Han, B. The structure of balanced multivariate biorthogonal multiwavelets and dual multiframelets. Math. Comput. 2010, 79, 917–951. [Google Scholar] [CrossRef] [Green Version]
  42. Arenas, M.L.; San Antolín, A. On Symmetric Compactly Supported Wavelets with Vanishing Moments Associated to E d ( 2 ) ( Z ) Dilations. J. Fourier Anal. Appl. 2020, 26, 72. [Google Scholar] [CrossRef]
  43. Jiang, Q.T. Biorthogonal wavelets with 6-fold axial symmetry for hexagonal data and triangle surface multiresolution processing. Int. J. Wavelets Multiresolut. Inf. Process. 2011, 9, 773–812. [Google Scholar] [CrossRef] [Green Version]
  44. Krivoshein, A. From frame-like wavelets to wavelet frames keeping approximation properties and symmetry. Appl. Math. Comput. 2019, 344–345, 204–218. [Google Scholar] [CrossRef] [Green Version]
  45. Belov, A.M. Comparison of the efficiencies of image compression algorithms based on separable and nonseparable two-dimensional Haar wavelet bases. Pattern Recognit. Image Anal. 2008, 18, 602–605. [Google Scholar] [CrossRef]
  46. Zhang, J. A Comparative Study of Non-separable Wavelet and Tensor-product Wavelet in Image Compression. CMES-Comput. Model. Eng. Sci. 2007, 22, 91–96. [Google Scholar]
  47. Tymczak, C.J.; Niklasson, A.; Röder, H. Separable and Nonseparable Multiwavelets in Multiple Dimensions. J. Comput. Phys. 2002, 175, 363–397. [Google Scholar] [CrossRef]
Figure 1. The 3D and contour plots of centrally symmetric refinable function φ 1 .
Figure 1. The 3D and contour plots of centrally symmetric refinable function φ 1 .
Symmetry 14 01425 g001
Figure 2. The 3D and contour plots of axially symmetric refinable function φ 1 .
Figure 2. The 3D and contour plots of axially symmetric refinable function φ 1 .
Symmetry 14 01425 g002
Figure 3. The 3D and contour plots on hexagonal lattice of hexagonally symmetric refinable function φ 1 .
Figure 3. The 3D and contour plots on hexagonal lattice of hexagonally symmetric refinable function φ 1 .
Symmetry 14 01425 g003
Figure 4. The 3D and contour plots on hexagonal lattice of hexagonally symmetric refinable function φ 2 .
Figure 4. The 3D and contour plots on hexagonal lattice of hexagonally symmetric refinable function φ 2 .
Symmetry 14 01425 g004
Figure 5. The 3D and contour plots on hexagonal lattice of hexagonally symmetric refinable function φ 3 .
Figure 5. The 3D and contour plots on hexagonal lattice of hexagonally symmetric refinable function φ 3 .
Symmetry 14 01425 g005
Table 1. Summary of notations.
Table 1. Summary of notations.
NotationComments
s : = s + M Z d the coset corresponding to digit s D ( M )
D : = Z d / M Z d the set of cosets
E [ s ] : = E s ( c E c ) action of a matrix E H on the coset s
H [ s ] : = { E [ s ] , E H } the orbit of s D
Λ : = { s p , 1 } p = 1 , , # Λ the set of representatives from each orbit
H p : = { F H : F [ s p , 1 ] = s p , 1 } the stabilizer of s p , 1
E p is such that H = E p H p the set of representatives of H / H p
s p , i : = E ( i ) [ s p , 1 ] , i = 1 , , # E p , the elements of the orbit H [ s p , 1 ] , E ( i ) E p , E ( 1 ) = I d .
j ( i , K ) is such that K E ( i ) = E ( j ( i , K ) ) F index j ( i , K ) is uniquely defined by i and K
for K H , E ( i ) E p , F H p for fixed p.
r p , i K = M 1 ( K s p , i s p , j ( i , K ) + E c c ) a special vector in R d
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Krivoshein, A. Multivariate Symmetric Interpolating Dual Multiwavelet Frames. Symmetry 2022, 14, 1425. https://doi.org/10.3390/sym14071425

AMA Style

Krivoshein A. Multivariate Symmetric Interpolating Dual Multiwavelet Frames. Symmetry. 2022; 14(7):1425. https://doi.org/10.3390/sym14071425

Chicago/Turabian Style

Krivoshein, Aleksandr. 2022. "Multivariate Symmetric Interpolating Dual Multiwavelet Frames" Symmetry 14, no. 7: 1425. https://doi.org/10.3390/sym14071425

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop