1. Introduction
This work is devoted to an application of the Krawtchouk–Sobolev type polynomials, previously introduced in [
1] and orthogonal with respect to the inner product
in the framework of a watermarking process. Here,
,
denotes the forward difference operator defined by
,
, and
stands for the classical Gamma function. Notice that when one considers
in the above expression, one finds the standard classical discrete Krawtchouk inner product. The key point of the application we present here relies on their novel properties related to their norm, and on the construction of the so-called
weighted Krawtchouk–Sobolev type orthogonal polynomials. The use of orthogonal polynomials (and orthogonal moments) in a watermarking scheme is widely spread in the scientific community (see, for example [
2,
3,
4,
5,
6,
7,
8,
9] among many other references). Nevertheless, and to the best of our knowledge, it is the first time that any Sobolev-type orthogonal polynomial family has been considered in such an application, achieving reasonably different, and in some cases, positive results. In this concern, new open problems come up from this novel direction of research which are subject of a future study, such as the optimality of the parameters in the definition of the Krawtchouk–Sobolev polynomials, which compromise a secure watermarking scheme and similarity of the cover and the watermarked image. Such parameters involve not only the boundary points of the support of Krawtchouk measure and the level in which such points interfere in the Sobolev inner product, but also the order of the difference operators involved.
The interest of orthogonal polynomials associated to inner products involving differences on a uniform lattice as (
1), started with a series of seminal papers by Herman Bavinck in the 1900s (see [
10,
11,
12]) by analogy with the so-called discrete Sobolev inner products under the action of usual derivatives (see the comprehensive survey [
13]). It is well known that this kind of inner products give place to novel families of non-standard orthogonal polynomials, meaning that the action of multiplication by
x is not symmetric with respect to such an inner product, i.e.,
and therefore the usual properties of standard orthogonal polynomials disappear: for non-standard inner products, there is not a three term recurrence relation (see, for example [
14,
15,
16]), the zeros of consecutive polynomials could not interlace, or it could not be real, etc. Since those first three seminal papers, many researchers have made advances on the Sobolev-type case for a bunch of discrete orthogonality measures, mainly describing and providing properties of the corresponding new discrete Sobolev-type new orthogonal polynomial families (check again [
13] and the references given there). Having said that, the idea here is not to describe the new properties of the Krawtchouk–Sobolev type orthogonal polynomials (which has already been done in [
1]), but rather to apply for the first time this new discrete non-standard orthogonal polynomials family in watermarking and steganography techniques. We also refer to [
17,
18] as research using similar techniques.
The procedure of watermarking an image
consists, roughly speaking, on embedding some information in the image (the cover image) in order to obtain a modified image
(the watermarked image) in such a way that both images remain as close as possible. In this work, the tool which serves as a bridge from the first to the second image is the matrix of Krawtchouk–Sobolev type orthogonal moments (see Equation (
18)) which satisfies that
approaches
due to the properties of the defined Sobolev-type polynomials. The algorithm of embedding the watermark in the cover image is shown in
Section 5 and is applied in concrete examples, comparing the results obtained with respect to other families of classical polynomials in experimental analysis.
The structure of the present work is as follows. In
Section 2 we recall the definition and main properties of the classical Krawtchouk
and Krawtchouk–Sobolev type
orthogonal polynomials introduced in [
1]. Most of the results in this section are presented without proof, and those necessary can be found in that previous work. Polynomials in
are defined after a Sobolev type modification, located at the boundary points of the support of the classical Krawtchouk polynomials, of the inner product corresponding to
. We also deepen in the properties relating both families, and the Section concludes with the novel result relating the norms of both families of polynomials.
Section 3 is devoted to define the weighted Krawtchouk–Sobolev type polynomials, based on the knowledge of the norms previously obtained. The key result here is Lemma 3, describing a quasi-orthogonality condition, which is applied in
Section 4 to show that the matrix of orthogonal inverse moments defined in (
19) gets close to the cover image. In
Section 5, we put forward the application of polynomials in
in the framework of a watermarking scheme through an embedding algorithm. The statements relating the theory and the application are described and motivated in
Section 4. Finally, we include a last section of directions of future work at the end of the paper.
2. Krawtchouk and Krawtchouk–Sobolev Type Orthogonal Polynomials
In this first section, we recall the main definitions and results related to the elements involved in the construction of the weighted Krawtchouk–Sobolev type polynomials, to be studied in
Section 3. More precisely, we deal with Krawtchouk and Krawtchouk–Sobolev type orthogonal polynomials in
Section 2.2 and
Section 2.3, respectively.
2.1. Basic Definitions
Definition 1. Given , the shifted factorial of x, also known as Pochhammer symbol [19] is defined by andfor every positive integer n. For every positive integer k and a finite tuple , we write Definition 2. Let and be two finite sets of complex numbers such that for every one has that for . The hypergeometric series is the formal power series [20] 2.2. Krawtchouk Polynomials
Let
and let
N be a non negative integer. The sequence of monic Krawtchouk orthogonal polynomials
are orthogonal with respect to the inner product
where
Given
, the polynomial
can be explicitly written in the form
In the next result we recall some basic properties of Krawtchouk orthogonal polynomials, which can be found in the references [
20] and [
21].
Proposition 1. Let , and let be an integer. We consider the sequence of classical Krawtchouk monic orthogonal polynomials, .
- 1.
The following recurrence relation holds for all :with Here, we have considered , and .
- 2.
Squared norm. For every , it holds that - 3.
Let . The forward shift operator is defined bywhere denotes the falling factorial
which is given by and - 4.
The sequence of classical Krawtchouk monic orthogonal polynomials satisfies the following second-order difference equation (hypergeometric type equation)where Δ
and ∇
denote the forward and backward difference operators defined by and , respectively, with
Let and .
Definition 3. Let be the sequence of classical Krawtchouk monic orthogonal polynomials. The n-th reproducing kernel is defined byHere, stands for the Euclidean norm. Concerning the partial finite difference of
with respect to each variable, we use the following notation for every pair
:
2.3. Krawtchouk–Sobolev Type Orthogonal Polynomials
In this subsection, we consider the sequence of monic polynomials orthogonal with respect to a Sobolev-type inner product, as defined in [
1]. We include the details of their main properties for the sake of completeness, and refer to [
1] for further information and the detailed proofs. Let
,
and
. We define the Sobolev-type inner product
by
It holds that for all integers
one can write the elements of the sequence
, consisting of the family of monic orthogonal polynomials with respect to the previous inner product, in terms of the classical Krawtchouk monic orthogonal polynomials as follows:
where
and
with
where
We observe that and do not make sense for . When , you get for . It is worth mentioning the coincidence of and for every , that we present later in Proposition 2.
Lemma 1. Let be a polynomial of degree h. Assume that . Then, one .
Proof. This property follows from an induction argument on
h. If
h is a constant polynomial, it is straight that
for every
. If we assume the property is valid for all integers up to
h, and consider a polynomial
of degree
, and
, then one has that
and
is a polynomial of degree less or equal to
h and the induction hypothesis can be applied. □
Proposition 2. The polynomals and coincide for every .
Proof. Let
and consider any polynomial
of degree
. Then, in view of Lemma 1 and the definition of
one has
This concludes the proof. □
Figure 1 illustrates the Krawtchouk–Sobolev type polynomials for the values
,
, and with
. Observe in this case that the first ones coincide with the classical Krawtchouk polynomials in view of Proposition 2.
For the sake of a more compact writing of the forthcoming properties associated with such a family of polynomials, we put
and
We observe that the choice of the elements involved in the definition of the Krawtchouk–Sobolev type orthogonal polynomials is implicitly made, and will be omitted for simplicity. The properties of the sequence determine analogous properties for this novel sequence of orthogonal Sobolev-type orthogonal polynomials.
Proposition 3. Let be the sequence of monic Krawtchouk–Sobolev orthogonal polynomials defined by (6). Then, the following statements hold. - 1.
Hypergeometric representation. Given positive integers and j, one haswhereand - 2.
Structure relations.andwhereand - 3.
Second-order difference equations.andwhereand - 4.
The recurrence relation for the classical Krawtchouk monic orthogonal polynomials determines that, for the Krawtchouk–Sobolev type orthogonal polynomials, as follows:whereandwith initial conditions , and .
In the remaining part of this Section, we complete the previous properties with the norm of the elements in
, stated in Theorem 1. This result is derived from the Proposition 4, whose proof is a direct result of the following technical Lemma, together with (
6).
Lemma 2. For every one can apply the definition of the inner product to arrive at Proposition 4. Let be the sequence of monic Krawtchouk–Sobolev orthogonal polynomials defined by (6). Then, one haswhereandwith and given in (7)–(8) and (9), respectively. We denote the norm associated with the product .
Theorem 1. Let be the sequence of monic Krawtchouk–Sobolev orthogonal polynomials defined by (6). Then, for every , , and the norm of these orthogonal polynomials with respect to (5),where and are determined in (9). Proof. It is straightforward to check that
for every monic polynomial
of degree
. In addition, from (
11) we have
Next we use the connection Formula (
12). Taking into account that
(see (
13)) is a monic polynomial of degree exactly
and
(see (
14)) is a polynomial of degree exactly
with the leading coefficient
we deduce
which leads to (
15). □
3. Weighted Krawtchouk–Sobolev Type Polynomials
This section is devoted to define the so-called weighted Krawtchouk–Sobolev type polynomials, and describe their main properties, which will be used in
Section 5 in an application to watermarking schemes. The knowledge of the norm obtained in Theorem 1 is of great importance in order to define such weighted Krawtchouk–Sobolev type polynomials. It is worth remarking that, despite their name, the elements of the sequence of weighted Krawtchouk–Sobolev type polynomials are no longer polynomials. We have maintained this and other denominations to maintain the one used in applications such as that of
Section 5. We refer to [
22] for more information in this concern.
As in the previous sections, we fix the parameters defining the norm of a Krawtchouk–Sobolev sequence of monic orthogonal polynomials.
Definition 4. Let be the sequence of monic Krawtchouk–Sobolev orthogonal polynomials defined by (6) and let (15) be the norm of such polynomials. The weighted Krawtchouk–Sobolev type polynomial is defined byfor every . In the next result, we obtain the asymptotic behavior as
and
approach zero, which leads to the asymptotic behavior of the matrix of orthogonal direct moments, as defined in
Section 5.
Lemma 3. Let be the sequence of weighted Krawtchouk–Sobolev type polynomials defined by (16). Then, it holds thatHere, stands for the Kronecker delta. Proof. From the definition of the Krawtchouk–Sobolev type orthogonal polynomials in (
5), we then observe that
From the previous equality, one can conclude that
Therefore,
□
The following recurrence relation holds for the sequence of weighted Krawtchouk–Sobolev type polynomials.
Proposition 5. Let be the sequence of weighted Krawtchouk–Sobolev type polynomials defined in (16). Then, the following recurrence relation holds:where Proof. A direct application of (
10) yields
The previous equation is equivalent to
and the result follows from here. □
4. Krawtchouk–Sobolev Type Orthogonal Moments
In this section, we briefly describe the mathematical statements to be considered in the application for a watermarking scheme. For this reason, the notation stated in this section will be maintained in the last section of applications.
Assume one considers an image, the cover image, stored in matrix
. Such a matrix is divided into matrices of size
bytes. The
-th image block of
is denoted by
. Let us write
Definition 5. Let be the -th image block of a cover image . We define its matrix of orthogonal direct moments bywherefor some fixed j. The purpose of a steganographic image, created from a cover image, relies on the fact that the steganographic image hides some data within it, while maintaining a similar shape as that of the cover image, hiding secret data in it. The results obtained in
Section 3, in particular Lemma 3, guarantees that
, where
denote the identity matrix.
The previous fact motivates the following transformation associated to .
Definition 6. Let be the matrix of orthogonal direct moments. The matrix of orthogonal inverse moments is given by According to Lemma 3 and (
17), one has that
and therefore, one concludes
Therefore, one can choose such that the watermarked image remains as close as needed to the cover image.
5. Application: Watermarking Scheme
In this section a watermarking scheme is presented as an application of the Krawtchouk–Sobolev type orthogonal moments. The embedding algorithm obtaining a watermarked image from a cover image is deduced following the procedure explained in the previous section. The present work concludes with the experimental analysis of the proposed scheme.
5.1. Arnold Transform
The Arnold transform is an invertible method that can be used for pixel scrambling. This important transform has been widely used in various watermarking schemes proposed by several authors. Arnold transform can be used in order to eliminate the high correlation of pixels, see [
23]:
The watermark is scrambled from
into
. Here,
y
represent the pixels of
and
, respectively. In particular, we take
and
, being
the control parameter, which is used as a private key during the watermark embedding and extraction processes.
The watermark that will be used in this contribution is that of
Figure 2:
Thus, considering
Figure 3, it is deduced that the control parameter
should satisfy that
, since for
the watermark is recovered in the process of applying the Arnold transform.
5.2. Zigzag Scan
Following the notation considered in [
22], we write
for the operator transforming a
matrix into a vector of length 64 after the ordering given to the elements of the matrix determined by the zigzag scan (see
Figure 4). The inverse operator
sends a vector of length 64 to a matrix of order 8 with
being the identity sending a matrix of order 8 to itself, and
is the operator sending a vector of length 64 to itself. The symbol ∘ stands for the composition operator.
5.3. Dither Modulation
Dither Modulation (DM) is a special form of quantization index molulation that is applied in an image watermarking system in order to assign one bit to each transformation coefficient. In case of a uniform scalar quantization, see [
24,
25], the watermarked signal is given by
where
denotes the quantization step size that controls the embedding strength of the watermark bit. In addition,
is defined as follows
where round
denotes the round function to the nearest integer. Moreover,
represents the signal,
the dither value,
m the message, and
L denotes the number of elements of
m. In an uncoded case of binary dither modulation with an embedding rate one, the quantizers are constructed with the constraint
which complies with the following
In particular, in this contribution we have taken
.
For this embedding method, the received signal
is a possibly corrupted version of
, which is re-quantized with the family of quantizers used during embedding to determine the bit of the embedded message
where argmin returns the indices of the minimum values along an axis.
5.4. Embedding and Extraction Watermark Algorithm
First, the embedding watermark algorithm scrambles the watermark by the Arnold transform (
20) for a control parameter
, with
, see
Figure 3, and then it is organized into a binary sequence
,
. Next, this scheme splits the cover image
into non-overlapping blocks
of size
, where the number of blocks coincide with the number of watermark bits. On the other hand, it applies the direct moments (
17) to each block of
. Next, the zigzag scan is applied to the resultant coefficients block, see
Figure 4, with the purpose to align frequency coefficients in ascending order. Then, it selects a coefficient of (
17), in this case, the coefficient number is 28. Thus, the secret bits are embedded in the selected coefficient by applying the Dither Modulation (DM). Finally, the inverse moment transform (
19) is applied in order to reconstruct the image, obtaining the watermarked image
.
Algorithm 1 describes the procedure explained in
Section 4 at the time of watermarking a cover image
.
Algorithm 1 Embedding Algorithm |
- 1:
Input: Cover image , watermark - 2:
Output: Watermarked image - 3:
scrambled watermark by the Arnold transform ( 20). - 4:
Divide into non-overlapping blocks of bytes - 5:
for eachdo - 6:
: according to ( 17) - 7:
: Apply the zigzag scan - 8:
watermark bit is embedded in the selected coefficient by using Dither Modulation. - 9:
- 10:
: According to ( 19) - 11:
end for - 12:
return
|
The extraction process is similar to the embedding process detailed above.
5.5. Experimental Analysis
In this section we describe the experimental results of the proposed scheme. Changes in the cover image pixel values appear due to the cover image being altered to embed the secret data. The changes made on the image need to be analyzed since it directly affect the imperceptibility of the output stego image.
For the experimental analysis several color images of size (
) were used from two different datasets: a first image dataset of 1500 RGB-BMP images, transformed from Caltech birds’ dataset in JPEGC format [
26] (Dataset I) and a second image dataset of 1500 RGB-BMP images, transformed from NRC dataset in TIFF format [
26] (Dataset II). Since the cover images are of size
and the watermark is
bits, see
Figure 2, then the watermark bits are distributed in each block throughout the original image. The algorithm proposed in the present work is implemented in Python 3.8.10.
The results of the experimental analysis are displayed in the following figures in which the PSNR values of the watermarked images corresponding to each of the two datasets are considered. More precisely, we show the values of PSNR of Krawtchouk polynomials (K) and the proposed Krawtchouk–Sobolev type polynomials (KSX), where determines the value of j in the definition of such polynomials. In addition, a comparison of the proposed method for Krawtchouk moments (KMs, ) with respect to the method proposed for Krawtchouk–Sobolev type orthogonal moments (KS1Ms with , , KS2Ms with , , and KS3Ms with , ) is included in this section.
Moreover, a comparison of the proposed moments with respect to the moments proposed by Yamni et al., Fractional Moments of Charlier (FrCMs) [
27] and Yamni et al., Fractional Moments of Charlier–Meixner (FrCMMs) [
28] is included in this section. The following attacks to measure robustness were applied: Cropping noise, Gaussian noise, Salt & Pepper noise, and Median filter noise.
In order to make a fair comparison with the FrCMs and FrCMMs moments in relation to KMs, KS1Ms, KS2Ms, and KS3Ms, the quantization steps and were chosen for the experiments, maintaining a PSNR value close to 50 dB. For the moments KMs, KS1Ms, KS2Ms, and KS3Ms, was used. The performance of the proposed approach has been studied using the following of statistical measures.
5.6. Imperceptibility Test
The measure of the quality of the watermarked image is made in terms of PSNR (Peak Signal to Noise Ratio) of different datasets. PSNR is widespread and a top notch metric is used in order to measure the quality of the watermarked image. It analyzes the mean squared error value, comparing the cover and the stego image [
29].
PSNR is defined by
with
and
represent the cover image and the stego image, respectively, of size
, with
, and
.
The index set
sums over the set
where
for gray scale images and
for 24-bit color images.
In the first experiment, we use the PSNR as a measure to evaluate the level of imperceptibility and distortion as well as to measure the difference between cover and watermarked images. The experimental results showed that the proposed moments produced good quality watermarked images with good PSNR values, see
Figure 5, which is in correspondence with the heuristic values of PSNR. On the other hand, in
Figure 5, it is possible to observe that as the quantization step increases, the average PSNR decreases. Moreover, this experiment showed that for the two datasets, the results of imperceptibility corresponding to the KMs, KS1Ms, KS2Ms, and KS3Ms are similar. This is interesting, since a priori no differences are shown. However, the next study demonstrates the strength of KS1Ms, KS2Ms, and KS3Ms in relation to KMs.
5.7. Robustness Test
The robustness is measured as the bit error rate (BER) corresponding to incorrectly formed binary values of the watermark image. The BER value is calculated by using the equation
where
and
are binary bits (0 or 1) of the original watermark and the extracted watermark. Moreover,
L is the number of bits of the watermark.
In order to evaluate the robustness, the following attacks were applied: Cropping noise, Gaussian noise, Salt and Pepper noise, and Median filter noise. Their parameters appear in
Table 1.
In this experiment, it is shown in the results displayed in
Figure 6,
Figure 7 and
Figure 8, that robustness of the watermarking scheme based on KS1Ms, KS2Ms, and KS3Ms is much higher than that of the schemes based on KMs, KMs, and FrCMs. Moreover, the KMs do not resist well to the attacks performed in this contribution since the BER values are higher, see
Figure 9Figure 10. On the other hand, for Salt & Pepper noise displayed in
Figure 11, the moments FrCMs and FrCMMs seem to be more robust with respect to the schemes based on KS1Ms, KS2Ms, KS3Ms, and KMs.
The BER values are close to zero, obtained after applying the attacks (Cropping noise and Gaussian noise), corresponding to KS1Ms, KS2Ms, and KS3Ms. This means that the extracted watermarks are recognizable and very similar to the original watermarks, see
Figure 9 and
Figure 10.
The noises (salt & pepper noise and median filter noise) were more aggressive in all cases, so that the studied moments are less robust to these attacks, see
Figure 8 and
Figure 11.