A Novel Technique for Achieving the Approximated ISI at the Receiver for a 16QAM Signal Sent via a FIR Channel Based Only on the Received Information and Statistical Techniques

A single-input-multiple-output (SIMO) channel is obtained from the use of an array of antennas in the receiver where the same information is transmitted through different sub-channels, and all received sequences are distinctly distorted versions of the same message. The inter-symbol-interference (ISI) level from each sub-channel is presently unknown to the receiver. Thus, even when one or more sub-channels cause heavy ISI, all the information from all the sub-channels was still considered in the receiver. Obviously, if we know the approximated ISI of each sub-channel, we will use in the receiver only those sub-channels with the lowest ISI level to get improved system performance. In this paper, we present a systematic way for obtaining the approximated ISI from each sub-channel modelled as a finite-impulse-response (FIR) channel with real-valued coefficients for a 16QAM (16 quadrature amplitude modulation) source signal transmission. The approximated ISI is based on the maximum entropy density approximation technique, on the Edgeworth expansion up to order six, on the Laplace integral method and on the generalized Gaussian distribution (GGD). Although the approximated ISI was derived for the noiseless case, it was successfully tested for signal to noise ratio (SNR) down to 20 dB.


Introduction
Let us consider for a moment the digital communication case where during transmission, a source signal undergoes a convoluted distortion between its symbols and the channel impulse response. This distortion is referred to as the inter-symbol-interference (ISI) which causes harmful distortions, and presents a major difficulty in the recovery process [1]. In order to recover the sent sequence, a single-input-multiple-output (SIMO) blind adaptive equalization method may be applied where several receive antennas are used at the receiver side [2][3][4][5]. All the received sequences from the different receive antennas will be distinctly distorted versions of the same message (SIMO configuration) [6]. The information from all the received antennas is driven to an array of blind adaptive equalizers (SIMO case [7,8]) that outputs the estimated sent sequence. Until now, the information from all the received antennas was used in the recovery process even if one or more received piece of information was heavily damaged due to the channel because there was no way to know if the received information from a specific received antenna contained heavy ISI. Obviously, if we can estimate the initial ISI from the different receive antennas, we will take to the recovery process only the information from those receive antennas having the lowest initial ISI. Thus, we may acquire a faster convergence speed of the blind adaptive equalizer, which may lead to a faster recovery process of the sent sequence on one hand, and on the other hand may leave the system with improved performance from the residual ISI point of view, which may lead to a lower bit-error-rate (BER) of the recovered sent sequence.
In this paper, we propose for the 16 quadrature amplitude modulation (16QAM) input constellation case, a systematic way to obtain the approximated initial ISI obtained from each receive antenna where each path from the sent antenna to the specific receive antenna is modeled as a finite-impulse-response (FIR) channel with real-valued coefficients. For the noiseless case, the equalized output signal is built up from the recovered sent signal in addition to an error called the convolutional noise [9]. This convolutional noise is very high at the early stages of the iterative deconvolution process (equalization process) and is considered as small at the latter stages of the iterative deconvolution process where the process is close to optimality [10]. A high convolutional noise means that the equalizer leaves the system with a high residual ISI, whereas a small convolutional noise at the equalized output means that the equalizer leaves the system with a relative small residual ISI. At the early stages of the deconvolution process, the convolutional noise probability density function (pdf) is more a uniform distribution [10,11], whereas at the latter stages of the iterative deconvolution process, the convolutional noise probability density function (pdf) is approximately Gaussian [10,11]. Thus, during the iterative deconvolution process, the shape of the convolutional noise pdf changes.
The main idea in our systematic approach for obtaining the approximated initial ISI is using two different approaches for estimating the real part of the equalized output signal pdf for the noiseless case, and then comparing between them. On the one hand, the real part of the equalized output signal pdf is approximated with the maximum entropy density approximation technique [12][13][14][15] with Lagrange multipliers up to order four. On the other hand, the real part of the equalized output signal pdf is calculated using Bayes rules where the conditional pdf of the real part of the equalized output signal, given the real part of the input signal is obtained via the real part of the convolutional noise pdf, and the real part of the input sequence pdf that is approximated with the maximum entropy density approximation technique [12][13][14][15] with Lagrange multipliers up to order four. Please note that the Lagrange multipliers of the real part of the source and equalized output signal pdf are not the same. The real part of the convolutional noise pdf is approximated with the generalized Gaussian distribution (GGD) [16], where changes in the shape parameter of the GGD presentation change the shape of the pdf, which may have a Laplacian or double exponential distribution, a Gaussian distribution or a uniform distribution for a shape parameter equal to one, two and infinity respectively [16]. Since the integral of the real part of the input signal pdf multiplied by the conditional pdf of the real part of the equalized output signal given the real part of the input signal is a difficult task to carry out due to the fact that the shape parameter which appears at the exponent may be a fraction, the GGD is approximated with the Edgeworth expansion [17][18][19] up to order six where the different moments needed for the Edgeworth expansion are calculated according to [16]. Finally, this integral (the integral of the approximated real part of the input signal pdf multiplied by the approximated conditional pdf of the real part of the equalized output signal, given the real part of the input signal) is carried out with the Laplace Integral method [12,20].
Although the approximated ISI was derived for the noiseless case, it was successfully tested for signal to noise ratio (SNR) down to 20 dB.
The paper is organized as follows: After having described the systematic way for obtaining the approximated initial ISI in Section 2, we introduce in Section 3 our simulation results. Finally, the conclusion is presented in Section 4.

The Systematic Approach for Getting the Approximated Initial ISI
In this section, we present our systematic approach for achieving the approximated initial ISI for the 16QAM constellation input for the noiseless case. Let us consider the following system (Figure 1), where we make the following assumptions:  The equalizer's input sequence y[n] is given by: where " * " stands for the convolutional operation. With the help of (1), the equalized output sequence can be written as: where | () | stands for the absolute value of (). The ISI is often used as a measure of performance in equalizers' applications, defined by: where |s| max is the component ofs, given in (3), having the maximal absolute value. Figure 2 shows the equalizer's performance from the residual ISI point of view as a function of the iteration number for the noiseless and 16QAM input constellation case. Please note that at each iteration number, corresponding to a specific ISI level, the convolutional noise can be obtained with the help of (2) and (3) via where At the latter stages of the iterative deconvolution process when the residual ISI is relative low, the input sequence x[n] and the convolutional noise p[n] may be considered as independent [10]. Thus we may write for the noiseless case: which can be written with the help of (2) for the noiseless case as: Based on (6) and (9) we may write for the noiseless case: Please note that at the latter stages of the iterative deconvolution process when the residual ISI is relative low, Godard's [22] algorithm leaves the system with |s| max approximately equal to one.

Theorem 1.
For the noiseless case, the approximated ISI can be calculated via the following equations: and whereλ 2 , λ 2 ,λ 4 and λ 4 were derived via [12]: where m k i , λ 2 i and λ 4 i for (i = 1, 2) were defined in this paper as: and where Γ and E[·] stand for the Gamma function and expectation operator respectively.
Proof of Theorem 1. At first, we will show the steps that led us to (15). After that, we will show and explain how we derived the rest of the above equations. For the 16QAM constellation, the real and imaginary parts of x[n] are independent. Thus, in the following we will focus only on the real part of the input and equalized output signal. In addition, for simplicity, we use x r , z r and p r for the real parts of x[n], z[n] and p[n], respectively. Therefore, based on (7) we have for the noiseless case: Based on (10) and (19) we may write for the latter stages of the iterative deconvolution process when the residual ISI is relative low and for the noise less case that: Based on (20), we have for the noiseless case that at the latter stages of the iterative deconvolution process when the residual ISI is relative low, Q = σ 2 x r . However, (20) does not hold at the early stages of the iterative deconvolution process, wherein the input sequence x[n] is dependent with the convolutional noise p[n]. Thus, at the early stages of the iterative deconvolution process, Q may be different from σ 2 x r . Now, if we carry out L Monte Carlo trials of the equalizer's performance from the residual ISI point of view, then we have at each iteration number, corresponding to a specific ISI level, L samples of the convolutional noise. In the following, we denote p r i,ISI j as the real part of the convolutional noise corresponding to iteration number j with residual ISI of ISI j , belonging to the i-th Monte Carlo trial. According to [16], the generalized Gaussian function ratio (ggfr) is given by: where ρ is the shape parameter. The relationship between the approximated shape parameter (defined in the following asρ) and approximated M (ρ) (defined in the following asM (ρ)) is given by [16]: leading to the notation ofρ ISI j forρ. Please note that L stands for the total number of Monte Carlo trials.
Since L may not be very large, the expression forM ISI j (ρ) may be a little too "jumpy", thereby leading to an incorrect value forρ in (22). Therefore, we apply some averaging operation on the obtainedρ from (22):ρ where [j, j + t − 1] in (24) means that we use t samples at each Monte Carlo trial for the averaging operation onρ (obtained from (22)) which we denoted earlier asρ ISI j . Since at each iteration number, the residual ISI is different (is decreasing), the step-size parameter µ in the equalizer's update mechanism (4) is set in such a way that this difference is relatively small, considering. In other words, the step-size parameter µ is set to be relatively very small. Now, based on (19), (22), (23) and (24), the connection between the approximated shape parameter (an approximation for ρ) and the residual ISI is obtained for a specific channel. Figure 3 shows the approximated shape parameter as a function of the residual ISI in dB units for the 16QAM constellation input sent via three different channels (CH1, CH2 and CH3) for the noiseless case. In addition, the approximated average curve for the three channels as a function of the residual ISI in dB units is also derived and denoted as "Avg". The three channels (CH1, CH2 and CH3) are defined as follows: CH1 (initial ISI = 0.88): The channel parameters are determined according to [23]: The step-size parameter µ was set for channel CH1, CH2 and CH3 to 0.0000027, 0.00001 and 0.0000025 respectively. The equalizer's tap length N was set for channel CH1, CH2 and CH3 to 15, 21 and 57 respectively. Based on the approximated average curve ("Avg") for the three channels as a function of the residual ISI in dB units, the coefficients of a polynomial P(ISI) of degree four that fit the approximated shape parameter best in a least-squares sense were obtained via the polyfit function from the Matlab software. Thus, we obtained the approximated shape parameter as a polynomial function of the residual ISI in dB units which is given in (15 Figure 3. The approximated shape parameter as a function of the residual ISI in dB units for the 16QAM constellation input sent via three different channels (CH1, CH2 and CH3) for the noiseless case. The parameters L and t were set to 300 and 1000 respectively. The simulation length (the total number of iteration number) used for CH1, CH2 and CH3 was set to 500414, 190414 and 190414 respectively.
Next, we turn to show the various steps that led us to the rest of the equations from the above theorem. As already was mentioned earlier, the convolutional noise pdf is unknown and its shape is changing during the deconvolutional process. Thus, we apply in the following the GGD [16] for approximating the real part of the convolutional noise pdf: wheref p r (p r ) is the approximated pdf for f p r (p r ) and ρ is defined as the shape parameter. Please notice, when ρ = 1, the GGD (25) corresponds to a Laplacian or double exponential distribution; ρ = 2 corresponds to a Gaussian distribution, whereas in the limiting cases ρ → +∞ the pdf in (25) converges to a uniform distribution in − √ 3σ, √ 3σ [16]. The pdf of the real part of the input sequence is approximated with the maximum entropy density technique [12][13][14][15]: wheref x r (x r ) is the approximated pdf for f x r (x r ). λ 2 and λ 4 are the Lagrange multipliers corresponding to the real part of the input sequence pdf and A is a constant. According to Bayes rules, the real part of the equalized output pdf is defined as: where based on (25) f z r |x r (z r |x r ) ∼ = 1 with B (ρ, σ) given in (26). Now, substituting (29) and (27) into (28) and carrying out the integral, an approximated expression for f z r (z r ) is obtained. However, carrying out the integral in (28) is not an easy task, especially when the shape parameter ρ is not known and may even be a fraction. In order to overcome the problem, we use the Edgeworth expansion [17][18][19] up to order six for approximating the approximated pdf for the real part of the convolutional noise pdf (25): wheref p r (p r ) is the approximation forf p r (p r ). According to [16] we have: Now, based on (30) we may have for f z r |x r (z r |x r ) the following expression: Next, we substitute (32) and (27) into (28) and obtain: The integral in (34) can be solved with the Laplace's integral method [20] following [12]: where () and () denote the second and fourth derivative of (), respectively. The function Ψ (x 0 ) and x 0 are obtained via: By using (37) and (36), the integral in (34) can be written as: g (x 0 ) = A exp λ 2 z 2 r + λ 4 z 4 r ã 2λ 2 z r + 4λ 4 z 3 r 4 + 6ã 2λ 2 + 12λ 4 z 2 r 2λ 2 z r + 4λ 4 z 3 r 2 + 12b 2λ 2 z r + 4λ 4 z 3 r 2 + 3ã 2λ 2 + 12λ 4 z 2 r 2 + 96ãλ 4 z r 2λ 2 z r + 4λ 4 z 3 r + 12b 2λ 2 + 12λ 4 z 2 r + 24ãλ 4 + 24c others to zero. In addition, the step-size parameter µ is set to zero which means that the equalizer's coefficients are not updated. Since the expression for the initial ISI (11) is a function of the moments of the real part of the equalized output sequence, we first wish to see how different sizes of samples from the real part of the equalized output sequence influence on the approximated expression for the ISI (11). For simplicity, we denote "K" as the amount of samples participating in the calculations of the various moments of the real part of the equalized output sequence. Although the approximated ISI (11) was derived for the noiseless case, it will be tested in the following also for SNR values of 30 and 20 dB. In the following we denote ISI cal and ISI sim as the approximated ISI calculated via (11) and the simulated ISI respectively. Tables 1-15 show the performance of ISI cal compared with ISI sim for nine different channels, with different sizes of K and with two different values for the SNR (SNR = 30db, SNR = 20db). The nine different channels are defined as: According to Tables 1-5, there is no need to apply a large number of samples of the real part of the equalized output sequence for calculating the various moments appearing in (11). According to Tables 1-5, the obtained value for ISI cal is very close to the obtained value for ISI sim for CH2, while the difference between the values for ISI cal and ISI sim for CH1 and CH3 is higher. But still, according to Tables 1-5, we are able to say which are the easiest and worst channels from the ISI point of view. Thus, we can choose to select the easiest channel which is in this case CH1 with an initial ISI of 0.88 and not the worst channel (CH3) with initial ISI of 1.715. In addition, we see that although ISI cal was derived for the noiseless case, it works also for SNR values down to 20 db. The expression for ISI cal depends on (15) which was obtained with the help of channel CH1, CH2 and CH3, as explained earlier in the previous section. Thus, next we wish to test the performance of ISI cal with other channels than only with CH1, CH2 and CH3. Tables 6-15 show the performance of ISI cal compared with ISI sim for various values for Q, K, types of channels and values for SNR. According to Tables 6-15, a very high correlation is obtained between the calculated ISI (ISI cal ) and the simulated one (ISI sim ). This means that if we apply the right value for Q for the chosen channels, then excellent performance from the ISI point of view can be obtained from ISI cal , even down to SNR values of 20db. Please note, according to Table 8, the same Q is applied for a very easy channel (CH4) and for a much harder channel (CH5) having approximately twice the intial ISI of CH4.   The Laplace's integral method [12,20] used in (36) is a general technique for obtaining the asymptotic behavior as β → 0 of integrals in which the large parameter 1/β appears in the exponent. It turns out in practice that analysis that is based on low noise, making the Laplace integral and singular perturbation method feasible, can be extended to the region where the noise is not low. Note, for example, the papers [27,28] wherein the Laplace integral and the singular perturbation method were applied under low noise assumption and the results could be very well extended to the medium and high noise range (as a matter of fact, these methods were rather successful in calculating even the threshold region) [12]. That is also the case in this paper where good results are obtained for the very high ISI condition.

Conclusions
In this paper, we proposed a systematic approach for achieving the approximated ISI from each sub-channel modeled as a FIR channel with real-valued coefficients for a 16QAM source signal transmission. The approximated ISI is based on the maximum entropy density approximation technique, on the Edgeworth expansion up to order six, on the Laplace integral method and on the GGD. Although the approximated ISI was derived for the noiseless case, it was successfully tested for SNR values down to 20 dB. As a by-product, we obtained a new presentation for the real part of the convolutional noise pdf based on the GGD where the shape parameter is a function of the residual ISI. Thus, the real part of the convolutional noise pdf has the ability of changing its shape during the iterative deconvolution process. Therefore, it might be useful in the derivation of a new approximated closed-form expression for the conditional expectation (the expectation of the input signal given the equalized output sequence), associated with the blind adaptive deconvolution problem, that will be carried out in a future work. It should be pointed out that the approximated expression for the ISI, proposed in this paper, can be applied also to other input sequences where the real and imaginary parts of the input signal are independent, as long as the expression for the shape parameter as a function of the ISI is given for this new input sequence, and the approximated input pdf can be modeled with the maximum entropy density approximation technique with Lagrange multipliers up to order four. Thus, this paper can be extended with a new derivation for the shape parameter as a function of the ISI for the general input case where the real and imaginary parts of the input signal are independent and where the approximated input pdf can be modeled with the maximum entropy density approximation technique with Lagrange multipliers up to order four.