Next Article in Journal
Correction: Alshehri, N.; Guediri, M. Projective Vector Fields on Semi-Riemannian Manifolds. Mathematics 2024, 12, 2914
Previous Article in Journal
Recursive Estimation of the Expectile-Based Shortfall in Functional Ergodic Time Series
Previous Article in Special Issue
A High-Feasibility Real-Time Trajectory-Planning Method for Parafoils Based on a Flexible Dynamic Model
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Regression of Likelihood Probability for Time-Varying MIMO Systems with One-Bit ADCs

1
Department of Electronic Engineering, Gachon University, Seongnam 13120, Republic of Korea
2
School of Electronic and Electrical Engineering, Kyungpook National University, Daegu 41566, Republic of Korea
*
Author to whom correspondence should be addressed.
Mathematics 2024, 12(24), 3957; https://doi.org/10.3390/math12243957
Submission received: 14 November 2024 / Revised: 5 December 2024 / Accepted: 14 December 2024 / Published: 17 December 2024
(This article belongs to the Special Issue Applied Mathematical Modeling and Intelligent Algorithms)

Abstract

:
This study proposes a regression-based approach for calculating the likelihood probability in time-varying multi-input multi-output (MIMO) systems using one-bit analog-to-digital converters. These time-varying MIMO systems often face performance challenges because of the difficulty in tracking changes in the likelihood probability. To address this challenge, the proposed method leverages channel statistics and decoded outputs to refine the likelihood. An optimization problem is then formulated to minimize the mean-squared error between the true and refined likelihood probabilities. A linear regression approach is derived to solve this problem, and a regularization technique is applied to further optimize the calculation. The simulation results indicate that the proposed method improves reliability by effectively tracking temporal variations in the likelihood probability and outperforms conventional methods in terms of performance.

1. Introduction

Millimeter-wave (mmWave) and terahertz (THz) communications are critical for advancing wireless standards, especially for applications that demand extremely high data rates, often in the gigabit-per-second range [1,2,3,4,5,6]. However, the use of large bandwidths in mmWave bands brings significant technical challenges, particularly around power consumption, which scales linearly with bandwidth and exponentially with the number of quantization bits [7,8]. This makes conventional systems that typically use 10–14 quantization at the receiver unsuitable for mmWave and THz applications. Communication systems that leverage low-resolution analog-digital-converters (ADCs) have emerged as a solution [9,10,11,12,13,14], enabling reduced power consumption with minimal performance degradation.
Recent studies introduced one-bit ADCs to address the power consumption problem in mmWave and THz systems [15,16,17,18,19,20,21]. Although promising, these ADCs lead to performance degradation in multi-input multi-output (MIMO) systems owing to their nonlinearity, which complicates optimal maximum likelihood (ML) detection [17]. This necessitates practical alternatives, such as convex optimization [18], sphere decoding [19], soft-decision ML detection [20], and deep learning-based detection [21]. However, these methods rely on idealized assumptions of perfect channel information, which is difficult to attain with one-bit ADCs owing to their inherent nonlinearity.
Channel estimation techniques for one-bit ADCs have been extensively studied [22,23,24,25,26,27,28,29,30,31]. Most studies often assumed a Gaussian quantization error model [24]. Based on the Gaussian error model, standard linear approaches, such as least-squares and minimum mean-squared error (MMSE) estimations can be derived [25,26]. However, these methods are constrained by inaccuracies in the quantization error model. Instead of linear approaches, iterative approaches like expectation-maximization [27] and approximate message passing [28] can improve the estimation performance. Furthermore, machine learning approaches have been employed to address the nonlinearity in channel estimation [29,30,31]. However, they result in significant computational complexity.
To address these limitations, recent studies have shifted toward methods that directly calculate likelihood probabilities without relying on explicit channel estimations [32,33,34,35,36,37,38,39]. For example, supervised learning techniques have been used to estimate likelihood probabilities based on pilot transmissions [35,36], although their performance suffers when the pilot lengths are insufficient. To resolve this challenge, [37] introduced an efficient learning method that minimizes the mean-squared error (MSE) between the true likelihood probability and learned likelihood probability using input–output samples from the data detector. Because the learning method involves significant complexity, a low-complexity algorithm was introduced in [39], where the pilot- and data-based likelihood probabilities are learned offline. The learning method in [37] was extended to time-varying channels, and a dynamic update model was proposed in [38]. This model captures temporal variations by defining a Markov Decision Process (MDP) aimed at maximizing the accuracy of the likelihood probability. A reinforcement learning (RL) algorithm was used to solve the MDP. Despite its performance benefits, the learning method in [38] involves high computational complexity owing to the intricate update model and a large number of possible state transitions, making it impractical for low-power applications, particularly in the mmWave and THz bands.

1.1. Contributions

This study introduces a regression model for the likelihood probability in time-varying MIMO systems using one-bit ADCs. To successfully achieve this, two types of likelihood probabilities are considered: the channel-based likelihood probability, which captures the variations in the channel over time, and the sample-based likelihood probability, which represents the likelihood probability of decoded data affected by the time-varying channels. The proposed method formulates a regression problem that aims to optimize the difference between the true likelihood probability and the regression of the channel- and sample-based likelihood probabilities. Key contributions include the following:
  • Two probabilities influenced by time-varying channels are derived. Channel-based likelihood probability, which tracks the change in the likelihood probability based on the channel model, is simplified to reduce computational complexity compared to [38]. In addition, a sample-based likelihood probability is introduced to exploit the received data that contain the likelihood information. Unlike the conventional sample-based likelihood probability in [37] which relies on a detected symbol, the proposed approach leverages the output of the decoder. These two probabilities are then used to estimate the true probability.
  • An optimization problem is formulated to minimize the MSE between the true and estimated likelihood probabilities derived from the channel- and sample-based likelihood probabilities. Unlike previous work [19], which requires complex algorithms such as RL algorithms, the proposed method solves this problem using a regression model, eliminating the need for such intensive computation. Instead of heavy computation, the proposed method exploits the precomputed optimal weights stored in memory to calculate the regression-based likelihood probability efficiently. To further optimize the calculation, LASSO regression is introduced, allowing the model to adapt to gradual channel changes under the assumption of slow time-varying channels.
  • Simulations demonstrate that the proposed method outperforms conventional methods on both slow and fast time-varying channels. This improvement results from the optimal weights, which enhance the reliability of the channel- and sample-based likelihood probabilities by fully utilizing the channel statistics and output of the decoder.

1.2. Related Works

In this subsection, the proposed method is compared with the state-of-the-art methods in terms of scalability and complexity for time-varying channels.
  • The proposed method learns the likelihood probability in time-varying channels. The original approach of learning likelihood probability, initially introduced in [37], efficiently exploited input–output samples from the data detector using reinforcement learning. However, the approach in [37] was designed for time-invariant channels and faces limitations in scalability when applied to time-varying channels. To address this limitation, a channel-based likelihood probability is derived following the methodology outlined in [38]. Additionally, unlike [37], this study introduces a sample-based likelihood leveraging the decoder’s output to enhance scalability further.
  • The proposed method reduces detection complexity, making it more applicable to practical systems. While a learning method that updates likelihood probability was proposed in [38] based on the on the time-varying channel model, the complexity remains a significant barrier to practical implementation. This study proposes a reduced-complexity algorithm to efficiently update the likelihood probability in time-varying channels. To achieve this, an offline learning method inspired by [39] is developed for time-varying channels. Especially, a regression-based approach is proposed to efficiently integrate channel- and sample-based likelihood probabilities.

1.3. Organization

The remainder of this study is organized as follows: Section 2 outlines the frame structure and details of the MIMO receiver with one-bit ADCs. Section 3 introduces channel and the sample-based likelihood probabilities. In addition, an optimization problem is designed to minimize the MSE between the true- and proposed likelihood probabilities. Section 4 describes the proposed solution to the optimization problem. Section 5 presents simulation results and demonstrates the effectiveness of the proposed solution. Finally, Section 6 concludes the study and discusses the main findings.

1.4. Notation

Key notations of this study are summarized in Table 1.

2. System Model

This section describes the model considered for the time-varying MIMO system using one-bit ADCs. The transmitter is equipped with N t antennas, and the receiver has N r antennas. The transmission frame is first explained, followed by the received signal. Finally, the considered detector is described using the likelihood.

2.1. Transmitter

Each transmission frame consists of a pilot block with N p symbols and D data blocks. The d-th data block contains N d symbols, where d { 1 , 2 , , D } as shown in Figure 1. The set of symbol indices in the d data block is defined as N d = { ( d 1 ) N d + 1 , , d N d } . The information bits are encoded using a channel encoder with code rate R c , and then mapped to M-ary quadrature amplitude modulation (QAM) symbols by s ¯ [ n ] C N t × 1 . The QAM symbol set is X ¯ = { s ¯ 1 , , s ¯ K } where K = { 1 , 2 , , K } is the index set of possible QAM symbol. The size | K | = M N t is determined by the modulation order M and the number of transmit antennas N t .

2.2. Receiver

The wireless channel follows a Rayleigh fading model and is assumed to be time-variant. When the Gaussian Markov process is used to describe the time-varying nature of the channel, the channel H ¯ [ n ] C N r × N t at time n is given by
H ¯ [ n ] = ϵ H ¯ [ n 1 ] + 1 ϵ 2 Δ ¯ [ n ] ,
where ϵ [ 0 , 1 ] is the temporal correlation coefficient, which is defined as ϵ = J 0 ( 2 π f c v T s c ) , where f c , v, T s , and c denote the carrier frequency, vehicle velocity, symbol duration, and speed of light, respectively. Δ ¯ [ n ] C N tx × N rx is a channel evolution matrix. Given a transmitted QAM symbol s ¯ [ n ] X ¯ , the received signal r ¯ [ n ] C N r × 1 can be expressed as
r ¯ [ n ] = H ¯ [ n ] s ¯ [ n ] + n ¯ [ n ] ,
where n ¯ [ n ] is an additive white Gaussian noise with CN ( 0 , σ n 2 ) .
To simplify the model, the complex-valued expressions in (2) are converted into real-valued expressions as follows:
r [ n ] = Re { r ¯ [ n ] } Im { r ¯ [ n ] } , H [ n ] = Re { H ¯ [ n ] } Im { H ¯ [ n ] } Im { H ¯ [ n ] } Re { H ¯ [ n ] } , s [ n ] = Re { s ¯ [ n ] } Im { s ¯ [ n ] } , n [ n ] = Re { n ¯ [ n ] } Im { n ¯ [ n ] } ,
where r [ n ] R 2 N r × 1 , H [ n ] R 2 N r × 2 N t , s [ n ] R 2 N t × 1 , and  n [ n ] R 2 N r × 1 .

2.3. ML Detection

After receiving signal r [ n ] , a one-bit operation is applied to each real and imaginary component as
q [ n ] = sign ( r [ n ] ) = sign H [ n ] s [ n ] + n [ n ] ,
To detect the transmitted symbol optimally, ML detection is applied as follows:
k ^ [ n ] = argmax k K P ( q [ n ] | s [ n ] = s k ) ,
where s k = [ Re ( s ¯ k ) T , Im ( s ¯ k ) T ] T is an element of the real-valued constellation set X = { s 1 , , s K } .
The likelihood probability for ML detection with one-bit ADCs is given by
P ( q [ n ] | s [ n ] = s k ) = r R P ( q r [ n ] | s [ n ] = s k ) = r : q r [ n ] = + 1 p r , k [ n ] r : q r [ n ] = 1 1 p r , k [ n ] ,
where q r [ n ] is the r-th row of q [ n ] and the receiver antenna index is r R = { 1 , 2 , , 2 N r } . The probability p r , k in [19] is computed as follows:
p r , k [ n ] = Φ 2 σ n 2 h r H [ n ] s k = Φ g r , k [ n ] ,
where h r H [ n ] is the r-th row of H [ n ] and g r , k [ n ] = 2 σ n 2 h r H [ n ] s k . Then, the symbol index of the ML estimate is calculated as
k ^ [ n ] = argmax k K r : q r [ n ] = 1 p r , k [ n ] r : q r [ n ] = 1 ( 1 p r , k [ n ] ) .
Using this symbol index, the ML estimate is expressed as s k ^ [ n ] .
Because the true channel H [ n ] is unknown at the receiver, channel estimation is performed during the pilot transmission. After obtaining the initial estimate H ^ [ 0 ] from the channel estimator, the initial likelihood probability p r , k [ 0 ] can be computed using (7). However, the accuracy of the initial probability is gradually degraded because of the time-varying nature of the channel. This is because the difference between the initially obtained channel estimate H ^ [ 0 ] and true channel H [ n ] increases as the time index n increases.

3. Proposed Problem

This section defines the problem of improving the accuracy of the likelihood probability. To achieve this, two probabilities that can track the variation in likelihood probability are first introduced. By learning these probabilities, the optimization problem is formulated to minimize the MSE between the true and learned likelihood probabilities. Subsequently, a regression algorithm is applied to the optimization problem.

3.1. Channel-Based Likelihood Probability

This subsection introduces the channel-based likelihood probability, defined as the expected variation in the likelihood probability. Thus, the channel-based likelihood probability dynamically adjusts changes in the channel over time. Using (1), the likelihood probability is formulated as a function of the time index m, given by
p r , k [ n ] = Φ ϵ g r , k [ n 1 ] + δ r , k [ n ] = Φ ϵ n m g r , k [ m ] + δ r , k [ n , m ] ,
where δ r , k [ u ] = 2 ( 1 ϵ 2 ) σ n 2 Δ r , k H [ n ] s k for u { m + 1 , , n } and δ r , k [ n , m ] = u = m + 1 n ϵ n u δ r , k [ u ] . Thus, δ r , k [ n , m ] N ( 0 , ν k [ n m ] ) with ν k [ u ] = ( 1 ϵ 2 u ) | | x k | | 2 σ 2 .
Assuming the channel evolves according to a time-variant Gaussian Markov process with ϵ 1 , the difference in likelihood probabilities between times n and m is calculated as follows:
p r , k [ n ] p r , k [ m ] = Φ ϵ n m g r , k [ m ] + δ r , k [ n , m ] Φ g r , k [ m ] ( a ) ( ( 1 ϵ n m ) g r , k [ m ] δ r , k [ n , m ] ) ϕ ( 1 ϵ n m ) g r , k [ m ] + δ r , k [ n , m ] 2 = 2 ( ( 1 ϵ n m ) g r , k [ m ] δ r , k [ n , m ] ) 1 2 π × 4 e δ r , k [ n , m ] + ( 1 + ϵ n m ) g r , k [ m ] 2 2 × 4 ,
where the approximation in ( a ) is valid as Φ ( x ) Φ ( a ) ( x a ) Φ ( x + a 2 ) when x a under the assumption ϵ 1 . Here, Φ ( x ) = ϕ ( x ) = 1 2 π exp ( x 2 2 ) .
With an assumed expected value of E [ p r , k [ m ] ] = p ^ r , k [ m ] , the expectation of (10) can be further simplified to
E [ p r , k [ n ] ] p ^ r , k channel [ m ] 2 ( 1 ϵ n m ) g ^ r , k [ m ] E 1 2 π × 4 e δ r , k [ n , m ] + ( 1 + ϵ n m ) g ^ r , k [ m ] 2 2 × 4 ( a ) p ^ r , k channel [ m ] 2 ( 1 ϵ n m ) g ^ r , k [ m ] 2 π ( ν k [ n m ] + 4 ) e ( 1 + ϵ n m ) g ^ i , k [ m ] 2 2 ( ν k [ n m ] + 4 ) ,
where E 1 2 π σ 2 e ( X μ ) 2 2 σ 2 = 1 2 π ( ν 2 + σ 2 ) e μ 2 2 ( ν 2 + σ 2 ) is applied in ( a ) when X N ( 0 , ν 2 ) .
The derivation in (11), which removes the term δ r , k [ n , m ] , differs from that in [38], resulting in reduced computational complexity.
Consequently, the channel-based likelihood probability under the assumption that E [ p r , k [ m ] ] = p ^ r , k channel [ m ] , and tracking from time m, is given by
p r , k channel [ n ] = p ^ r , k channel [ m ] f ( Φ 1 ( p ^ r , k channel [ m ] ) , ν k n m , ϵ n m ) ,
where f ( g , ν , ϵ ) = 2 ( 1 ϵ ) g 2 π ( ν + 4 ) e ( ( 1 + ϵ ) g ) 2 2 ( ν + 4 ) .

3.2. Sample-Based Likelihood Probability

This subsection details the derivation of the sample-based likelihood probability constructed based on the received signals. The probability p r , k in (7) can be defined using the conditional probability formula:
p r , k = P ( q r [ n ] = 1 | s [ n ] = s k ) = P ( q r [ n ] = 1 , s [ n ] = s k ) P ( s [ n ] = s k ) ,
where each probability term in (13) is defined as follows:
P ( q r [ n ] = 1 , s [ n ] = s k ) = lim m n 1 { k [ m ] = k } m n q ˜ r [ m ] 1 { k [ m ] = k } n , P ( s [ n ] = s k ) = lim m n 1 { k [ m ] = k } m n 1 { k [ m ] = k } n .
where q ˜ r [ n ] is a function that assumes the value of 1 if q r [ n ] = 1 and 0 otherwise.
As the transmitted symbol index k [ m ] is not available at the receiver, the probabilities in (14) cannot be computed directly; instead, they are approximated using the detected symbol index k ^ [ m ] , given by
P ( q r [ n ] = 1 , s [ n ] = s k ) m n q ˜ r [ m ] 1 { k ^ [ m ] = k } n , P ( s [ n ] = s k ) m n 1 { k ^ [ m ] = k } n .
These approximations converge to the true probabilities when n becomes sufficiently large [19].
However, the detected symbol index k ^ [ n ] is often inaccurate compared to the true symbol index with a high probability. To address this, symbol refinement is proposed, in which the decoder’s capability is exploited to estimate the true symbol index k [ n ] . Thus, unlike in [19], the re-detected symbol index k ^ dec [ n ] is used to obtain the sample-based probability as follows:
p r , k sample [ n ] m n q ˜ r [ m ] 1 { k ^ dec [ m ] = k } m n 1 { k ^ dec [ m ] = k } .
Notably, the proposed likelihood probability in (17) occurs after each data block and the decoder output is available to calculate the sample-based likelihood probability.

3.3. Optimization Problem

The proposed likelihood probability, p ^ r , k [ n ] , is formulated as a linear regression of the channel-based likelihood probability in (12) and the sample-based likelihood probability in (16). This approach is used because the channel-based likelihood probability captures the change in channel statistics, whereas the sample-based likelihood probability trains the true likelihood probability from the quantized received signal and re-detected symbol index. The model for the proposed likelihood is expressed as follows:
p ^ r , k [ n ] ( Θ n ) = θ n 0 + θ n 1 p r , k channel [ n ] + θ n 2 p r , k sample [ n ] ,
where Θ n = [ θ n 0 , θ n 1 , θ n 2 ] T is the model parameter. Using this model, the optimization problem is defined as follows:
Θ n = argmin Θ n r R k K p r , k [ n ] p ^ r , k [ n ] ( Θ n ) 2 ,
where Θ n = [ ( θ n 0 ) , ( θ n 1 ) , ( θ n 2 ) ] T .
Directly solving the optimization problem in (18) is difficult due to the nonlinear nature of the function Φ ( · ) , and the fact that sample-based likelihood probability cannot be readily represented in a mathematically convenient form. To address these issues, linear regression is used as an alternative approach to determine the model parameter Θ n .

4. Proposed Solution

This section formulates the proposed likelihood probability to solve the optimization problem in (18). To address this problem, a linear regression approach is applied to (18). Because the channel is slowly varying in realistic scenarios, a regularization technique is introduced to further optimize the algorithm. Consequently, the structure of the proposed receiver is outlined, along with the algorithmic procedure.

4.1. Linear Regression

This subsection introduces a linear regression approach to obtain the model parameter Θ n . However, solving the regression for individual time index n increases the complexity of both learning and applying Θ n . To address this issue, learning and applications are considered on a per-data-block basis. Subsequently, the optimization problem in (18) is re-formulated as follows:
Θ d = argmin Θ d n N d r R k K p r , k [ n ] p ^ r , k [ n ] ( Θ d ) 2 ,
where Θ d = = [ θ d 0 , θ d 1 , θ d 2 ] T . Linear regression is a well-known technique for solving the optimization problem in (19). To achieve this outcome, the matrices X d R N d × 3 and y d R N d × 1 are, respectively, defined as
Φ d = 1 p r , k channel [ ( d 1 ) N d + 1 ] p r , k sample [ ( d 1 ) N d + 1 ] 1 p r , k channel [ ( d 1 ) N d + 2 ] p r , k sample [ ( d 1 ) N d + 2 ] 1 p r , k channel [ d N d ] p r , k sample [ d N d ] , y d = p r , k [ ( d 1 ) N d + 1 ] p r , k [ ( d 1 ) N d + 2 ] p r , k [ d N d ] .
Then, the optimal parameter Θ d of (19) can be derived as follows:
Θ d = ( Φ d T Φ d ) 1 Φ d T y d .
The optimal parameters in (21) are suboptimal because they are obtained from a limited number of samples. Using the optimal parameters, the proposed probability at the end of the d-th data block is expressed as follows:
p ^ r , k pro ( Θ d ) = ( θ d 0 ) + ( θ d 1 ) p r , k channel [ d N d ] + ( θ d 2 ) p r , k sample [ d N d ] .

4.2. Regularization

In this subsection, the effective regression technique is discussed under the slow-fading channel. The linear regression in (19) provides a reasonable solution for approximating the true probability. However, under the assumption of a slow-fading channel, the probability changes slowly. Regularization techniques such as ridge and LASSO regressions are effective in preventing abrupt changes. In this study, LASSO regression is employed because it not only prevents sudden changes but also eliminates irrelevant parameters. This elimination improves memory utilization by reducing the number of weights and by simplifying the computation in (22). To achieve this, LASSO regression is formulated as follows:
Θ d = argmin Θ d n N d r R k K p r , k [ n ] p ^ r , k [ n ] ( Θ d ) 2 + λ Θ d ,
where λ is a tuning value that controls the trade-off between fit and sparsity in the regression coefficient estimates. In particular, LASSO regression exploits the L 1 norm, which encourages certain parameters to be exactly zero, promoting sparsity in the solution. This allows significant parameters to be identified and extracted using a regularization technique. Although solving the LASSO regression is more complicated than solving the linear regression, the proposed method utilizes the pre-computed optimal parameters. By eliminating insignificant parameters, this approach helps efficiently calculate the proposed likelihood probability in (22) during transmission.

4.3. Proposed Receiver

This subsection describes the proposed receiver structure. The receiver initiates by estimating the channel during pilot transmission. The initial probability p ^ r , k [ 0 ] can then be obtained using the channel estimate. During data transmission, the receiver calculates the probability proposed in (12). The calculated likelihood probability is used in the log-likelihood ratio (LLR) calculation, given by
L L R ( b i , j [ n ] ) = log P ( q [ n ] | b i , j [ n ] = 1 ) P ( q [ n ] | b i , j [ n ] = 0 ) = log s k X i , j 1 P ( q [ n ] | s [ n ] = s k ) s k X i , j 0 P ( q [ n ] | s [ n ] = s k ) = ( a ) log s k X i , j 1 P ^ ( q [ n ] | s [ n ] = s k ) s k X i , j 0 P ^ ( q [ n ] | s [ n ] = s k ) = log s k X i , j 1 r : q r [ n ] = 1 p ^ r , k pro r : q r [ n ] = 1 ( 1 p ^ r , k pro ) s k X i , j 0 r : q r [ n ] = 1 p ^ r , k pro r : q r [ n ] = 1 ( 1 p ^ r , k pro ) ,
where the proposed likelihood probability in (17) is applied to the true likelihood probability ( a ) . b i , j [ n ] { 0 , 1 } is the j-th bit of the i-th stream and X i , j b is the set of symbols s k for which b i , j = b { 0 , 1 } . This LLR value is used to obtain the decoded data b ^ i , j from the channel decoder.
At the end of the data block, the receiver computes the channel-based likelihood probability p r , k channel using (12) and the sample-based likelihood probability using (16) based on the channel decoder output. Following these calculations, the proposed receiver updates the combined likelihood probabilities p ^ r , k pro by integrating both the channel- and sample-based likelihood values. The optimal weights Θ d , stored in memory, are selected according to the data block index d to effectively combine two likelihood probabilities. The complete step-by-step procedure of the proposed receiver is presented in Algorithm 1.
Algorithm 1: Procedure of the Proposed Receiver
 1 Pilot Block
 2 Obtain initial channel estimate H ^ [ 0 ] = h ^ 1 [ 0 ] , , h ^ N r [ 0 ] .
 3 Calculate the initial channel-based likelihood probability p r , k channel [ 0 ] , r R , k K from H ^ [ 0 ] .
 4 Set the proposed likelihood probability p ^ r , k pro p r , k channel [ 0 ] , r R , k K .
 5 Data Block
 6 for  d = 1 to D do (
 7   for  n = 1 to N d  do (
 8     Compute LLR in (24) based on the proposed likelihood probability p ^ r , k pro .
 9     Obtain decoded data b ^ i , j from the channel decoder.
10   end (
11   Bring the optimal weight Θ d in memory trained using (21).
12   Update channel-based likelihood probability p r , k channel from (12) and E [ p r , k [ d N d ] ] = p ^ r , k channel [ d N d ] .
13   The sample-based likelihood probabilities p r , k sample are updated from the decoding output in (16).
14   Calculate the proposed likelihood probability p ^ r , k pro ( θ d 0 ) + ( θ d 1 ) p r , k channel [ d N d ] + ( θ d 2 ) p r , k sample [ d N d ] using (22).
15 end

5. Simulation Results

Simulations are performed using Matrix Laboratory (MATLAB). The optimal weights in (19) and (23) are obtained through the statistics and machine learning toolbox. The obtained optimal weights are then used in simulations to evaluate the frame error rate (FER) and MSE over 10,000 iterations. The antenna configuration used is ( N t , N r ) = ( 4 , 8 ) . For the time-variant channel, a carrier frequency f c = 3.5 GHz, and a sampling period of T s = 16.67 μ s is considered, as specified in [40]. Velocities of v = 5 km/h and v = 40 km/h, represent slow and fast time-varying channels, respectively. The information bits are encoded using a turbo encoder at a rate R c = 1 2 . A modulation order of 4- Q A M is applied to the encoded bits, resulting in a constellation size of K = M N t = 256 . The frame structure consists of one pilot with N p = 32 and D = 20 data blocks with N d = 128 . A linear MMSE method was applied to obtain the initial channel estimation during pilot transmission. The signal-to-noise ratio (SNR), denoted as E b / N 0 , is defined as 1 log 2 | X | σ n 2 .
For performance benchmarking, the following methods are considered:
  • Perfect CSI: This represents the optimal case in time-invariant channels, where the likelihood probability is obtained using perfect channel state information (CSI) of H [ 0 ] . Note that the resulting likelihood probability remains constant over time, and thus is not optimal in time-varying channels.
  • Conv.: This conventional method calculates the probability p r , k channel [ 0 ] based on channel estimates H ^ [ 0 ] obtained during pilot transmission. In this method, the likelihood probability remains fixed during data transmission.
  • Robust: Developed in [37] for time-invariant MIMO channels. This method calculates the likelihood probability using an RL algorithm, where the initial likelihood probability is optimally combined with the empirical-based likelihood probability obtained from the detected symbol.
  • RL-TV: Introduced in [38] for time-varying MIMO channels, this method calculates the likelihood probability using an RL algorithm, where the model-based likelihood probability and the quantized received signal are optimally combined. Notably, the sample refinement scheme is not used in this study where all input–output samples are used to update the likelihood probability when the cyclic redundancy check (CRC) is correct. This exclusion is intended to ensure a fair comparison with other methods.
  • Proposed: The proposed method exploits the likelihood probability from (22), where both the channel- and the sample-based likelihood probabilities are learned via linear regression. The proposed (Reg) denotes the case when the optimization problem in (19) is applied, while the proposed (LASSO) refers to when the regularization technique in (23) is applied. The precise definitions for the channel- and sample-based likelihood probabilities differ from those in [37] and [38], respectively.
In Figure 2, the channel- and sample-based likelihood probabilities are compared with true likelihood probability in (7) under fast-fading channels. In Figure 2a, the conventional model-based likelihood probability from [38] is compared with the channel-based likelihood probability in (12). While the conventional model-based likelihood probability shows a gradual response to changes in the true likelihood probabilities in (7), the channel-based likelihood probability more efficiently captures these changes. Note that the channel-based likelihood probability is derived in (10) under the assumption of slow-fading channels ϵ 1 . As a result, it exhibits slower changes compared to the true likelihood probability in fast-fading channels. In Figure 2b, the sample-based likelihood probability in (16) outperforms the conventional empirical-based likelihood probability from [37] in capturing rapid changes in the true likelihood probability. This improvement is attributed to the decoder’s output, which provides more accurate information about the channel.
In Figure 3, the optimal weights of the linear regression for the proposed method are shown as a function of d. As the number of data blocks increases, the accuracy of the sample-based likelihood improves. Thus, the weight θ d 2 for the sample-based likelihood probability increases, while the weight θ d 1 for the channel-based likelihood probability decreases. In contrast, the constant weight θ d 0 approaches zero with the increase in d in the slow-fading channels. In addition, when the SNR increases, the convergence speed increases because the correctly decoded output improves the accuracy of the sample-based likelihood probability. Compared to slow-fading channels, the increase in the sample-based likelihood probability is smaller in the fast-fading channels, where the channel-based likelihood probability dominantly affects the overall likelihood probability.
The optimal weights for the LASSO regression are simulated with λ = 10 2 for slow fading channels and λ = 10 1 for fast fading channels, as shown in Figure 4. Both figures show a similar overall trend to the linear regression in Figure 3. However, in the LASSO regression, the optimal weight θ d 0 is exactly zero, indicating that the constant weight is less significant than the weights for the channel- and sample-based likelihood probabilities. Compared to slow-fading channels, the weights for the channel-based likelihood probability in fast-fading channels are larger, as the channel-based likelihood probability can more effectively track changes in the likelihood probability for the subsequent block.
The FERs for the different detection methods are plotted in Figure 5 to demonstrate the effectiveness of the proposed method in both the slow and fast fading channels. For the LASSO method, the optimal weights from Figure 4 are applied in both channel conditions. The Conv. and Robust methods exhibit poor performance owing to their inability to track the true likelihood probability. The FER of the RL-TV exhibits a slight improvement, indicating that it struggles to follow the channel variations. This result contrasts with [38], where the sample-refinement scheme primarily addresses temporal channel variation compensation. The proposed (Reg) and proposed (LASSO) methods achieve SNR gains of approximately 0.8 dB and 0.7 dB over the RL-TV in slow fading channels at an FER of 10 1 , while the SNR gain in fast fading channels is substantial compared to conventional methods. This improvement is attributed to the proposed methods’ ability to track changes in the likelihood probability by optimally combining both channel- and sample-based likelihood probabilities. Note that the proposed (LASSO) method uses only two weights to calculate the proposed likelihood probability, while the proposed (Reg) method uses three weights.
Figure 6 presents the MSE between the true and proposed likelihood probabilities, i.e., E { p r , k p ^ r , k 2 } . The proposed method achieves a lower MSE compared to the conventional methods in both slow and fast fading channels. The MSEs of the perfect CSI and Conv. methods are gradually degraded in time-varying channels because they do not update the likelihood probability and fail to adapt to channel variations. In contrast, the MSEs of RL-TV and proposed methods improve as d increases in slow-fading channels, as both methods derive the likelihood probabilities based on time-varying channel models. The proposed method outperforms the RL-TV method due to its ability to learn the optimal weights that minimize the MSE between the true and learned likelihood probabilities, which effectively tracks temporal variations in the channel.

6. Conclusions

A regression-based approach for tracking changes in the likelihood in time-varying MIMO systems using one-bit ADCs was introduced. The proposed method utilized channel statistics to derive a channel-based likelihood probability and the decoded output to derive a sample-based likelihood probability. The optimization problem for the weighted linear combination of the two probabilities was formulated by minimizing the expected MSE. A linear regression method was applied to solve the problem, with a regularization technique incorporated to optimize the calculation. In particular, simulation results demonstrated that the proposed method outperformed conventional methods by effectively capturing the changes in the likelihood.
The future direction of this study is to explore other regression techniques such as polynomial and Bayesian regressions. These advanced regression methods can improve the fit to the true likelihood probability. In addition to exploring different regression techniques, better features should be extracted from the channel model and received symbols. Features that provide more relevant information about the channel can further improve the regression performance. Further improvement will address the power consumption and computational complexity challenges associated with mmWave and THz communications in time-varying MIMO systems using one-bit ADCs.

Author Contributions

Conceptualization, T.-K.K.; Methodology, T.-K.K.; Software, T.-K.K.; Validation, T.-K.K.; Formal analysis, T.-K.K.; Investigation, M.M.; Resources, M.M.; Data curation, M.M.; Writing—original draft, T.-K.K.; Writing—review & editing, M.M.; Project administration, M.M. All authors have read and agreed to the published version of the manuscript.

Funding

This work was supported in part by the National Research Foundation of Korea (NRF) grant funded by the Korea government (MSIT) under Grant 2023R1A2C1004034, and in part by the BK21 FOUR Project funded by the Ministry of Education, South Korea, under Grant 4199990113966.

Data Availability Statement

The data presented in this study are available on request from the corresponding author.

Conflicts of Interest

The authors declare no conflicts of interest.

References

  1. Swindlehurst, A.L.; Ayanoglu, E.; Heydari, P.; Capolino, F. Millimeter-Wave Massive MIMO: The Next Wireless Revolution? IEEE Commun. Mag. 2014, 52, 56–62. [Google Scholar] [CrossRef]
  2. Rangan, S.; Rappaport, T.S.; Erkip, E. Millimeter-Wave Cellular Wireless Networks: Potentials and Challenges. Proc. IEEE 2014, 102, 366–385. [Google Scholar] [CrossRef]
  3. Busari, S.A.; Huq, K.M.S.; Mumtaz, S.; Dai, L.; Rodriguez, J. Millimeter-Wave Massive MIMO Communication for Future Wireless Systems: A survey. IEEE Commun. Surv. Tutor. 2017, 20, 836–869. [Google Scholar] [CrossRef]
  4. Wang, X.; Kong, L.; Kong, F.; Qiu, F.; Xia, M.; Arnon, S.; Chen, G.; Rodriguez, J. Millimeter Wave Communication: A Comprehensive Survey. IEEE Commun. Surv. Tutor. 2018, 20, 1616–1653. [Google Scholar] [CrossRef]
  5. Uwaechia, A.N.; Mahyuddin, N.M. A Comprehensive Survey on Millimeter Wave Communications for Fifth-Generation Wireless Networks: Feasibility and Challenges. IEEE Access 2020, 8, 62367–62414. [Google Scholar] [CrossRef]
  6. Bang, J.; Chung, H.; Hong, J.; Seo, H.; Choi, J.; Kim, S. Millimeter-Wave Communications: Recent Developments and Challenges of Hardware and Beam Management Algorithms. IEEE Commun. Mag. 2021, 59, 86–92. [Google Scholar] [CrossRef]
  7. Walden, R.H. Analog-to-Digital Converter Survey and Analysis. IEEE J. Sel. Areas Commun. 1999, 17, 539–550. [Google Scholar] [CrossRef]
  8. Murmann, B. ADC Performance Survey 1997–2024. [Online]. Available online: https://github.com/bmurmann/ADC-survey (accessed on 13 November 2024).
  9. Fan, L.; Jin, S.; Wen, C.K.; Zhang, H. Uplink Achievable Rate for Massive MIMO Systems With Low-Resolution ADC. IEEE Commun. Lett. 2015, 19, 2186–2189. [Google Scholar] [CrossRef]
  10. Roth, K.; Nossek, J.A. Achievable Rate and Energy Efficiency of Hybrid and Digital Beamforming Receivers With Low Resolution ADC. IEEE J. Sel. Areas Commun. 2017, 35, 2056–2068. [Google Scholar] [CrossRef]
  11. He, H.; Wen, C.K.; Jin, S. Bayesian Optimal Data Detector for Hybrid mmWave MIMO-OFDM Systems with Low-Resolution ADCs. IEEE J. Sel. Signal Process. 2018, 12, 469–483. [Google Scholar] [CrossRef]
  12. Zhang, J.; Dai, L.; Li, X.; Liu, Y.; Hanzo, L. On Low-Resolution ADCs in Practical 5G Millimeter-Wave Massive MIMO Systems. IEEE Commun. Mag. 2018, 56, 205–211. [Google Scholar] [CrossRef]
  13. Wang, H.; Shih, W.T.; Wen, C.K.; Jin, S. Reliable OFDM Receiver with Ultra-Low Resolution ADC. IEEE Trans. Commun. 2019, 67, 3566–3579. [Google Scholar] [CrossRef]
  14. Liu, J.; Luo, Z.; Xiong, X. Low-Resolution ADCs for Wireless Communication: A Comprehensive Survey. IEEE Access 2019, 7, 91291–91324. [Google Scholar] [CrossRef]
  15. Khalili, A.; Shirani, F.; Erkip, E.; Eldar, Y.C. MIMO Networks with One-Bit ADCs: Receiver Design and Communication Strategies. IEEE Trans. Commun. 2021, 70, 1580–1594. [Google Scholar] [CrossRef]
  16. Nguyen, L.V.; Swindlehurst, A.L.; Nguyen, D.H. Linear and Deep Neural Network-based Receivers for Massive MIMO Systems with One-Bit ADCs. IEEE Trans. Wirel. Commun. 2021, 20, 7333–7345. [Google Scholar] [CrossRef]
  17. Choi, J.; Love, D.J.; Brown, D.R.; Boutin, M. Quantized Distributed Reception for MIMO Wireless Systems Using Spatial Multiplexing. IEEE Trans. Signal Process. 2015, 63, 3537–3548. [Google Scholar] [CrossRef]
  18. Choi, J.; Mo, J.; Heath, R.W. Near Maximum-Likelihood Detector and Channel Estimator for Uplink Multiuser Massive MIMO Systems with One-Bit ADCs. IEEE Trans. Commun. 2016, 64, 2005–2018. [Google Scholar] [CrossRef]
  19. Jeon, Y.S.; Lee, N.; Hong, S.N.; Heath, R.W. One-Bit Sphere Decoding for Uplink Massive MIMO Systems with One-Bit ADCs. IEEE Trans. Wirel. Commun. 2018, 17, 4509–4521. [Google Scholar] [CrossRef]
  20. Hong, S.N.; Lee, N. Soft-Output Detector for Uplink MU-MIMO Systems with One-Bit ADCs. IEEE Commun. Lett. 2018, 22, 930–933. [Google Scholar] [CrossRef]
  21. Sant, A.; Rao, B.D. Insights Into Maximum Likelihood Detection for 1-bit Massive MIMO Communications. IEEE Trans. Wirel. Commun. 2024, 23, 16275–16289. [Google Scholar] [CrossRef]
  22. Wang, F.; Fang, J.; Li, H.; Chen, Z.; Li, S. One-Bit Quantization Design and Channel Estimation for Massive MIMO Systems. IEEE Trans. Veh. Technol. 2018, 67, 10921–10934. [Google Scholar] [CrossRef]
  23. Nguyen, L.V.; Swindlehurt, A.L.; Nguyen, D.H.N. SVM-Based Channel Estimation and Data Detection for One-Bit Massive MIMO Systems. IEEE Trans. Signal Process. 2021, 69, 2086–2099. [Google Scholar] [CrossRef]
  24. Wang, S.; Li, Y.; Wang, J. Multiuser Detection in Massive Spatial Modulation MIMO with Low-Resolution ADCs. IEEE Trans. Wirel. Commun. 2015, 14, 2156–2168. [Google Scholar] [CrossRef]
  25. Mollen, C.; Choi, J.; Larsson, E.G.; Heath, R.W. Uplink Performance of Wideband Massive MIMO with One-Bit ADCs. IEEE Trans. Wirel. Commun. 2017, 16, 87–100. [Google Scholar] [CrossRef]
  26. Li, Y.; Tao, C.; Seco-Granados, G.; Mezghani, A.; Swindlehurst, A.L.; Liu, L. Channel Estimation and Performance Analysis of One-Bit Massive MIMO Systems. IEEE Trans. Signal Process. 2017, 65, 4075–4089. [Google Scholar] [CrossRef]
  27. Mo, J.; Schniter, P.; Gonzalez-Prelcic, N.; Heath, R.W. Channel Estimation in Millimeter Wave MIMO Systems with One-Bit Quantization. In Proceedings of the 48th Asilomar Conference on Signals, Systems and Computers, Pacific Grove, CA, USA, 2–5 November 2014; pp. 957–961. [Google Scholar]
  28. Wen, C.K.; Wang, C.J.; Jin, S.; Wong, K.K.; Ting, P. Bayes-Optimal Joint Channel-and-Data Estimation for Massive MIMO with Low-Precision ADCs. IEEE Trans. Signal Process. 2016, 64, 2541–2556. [Google Scholar] [CrossRef]
  29. Wang, H.; Memon, F.H.; Wang, X.; Li, X.; Zhao, N.; Dev, K. Machine Learning-enabled MIMO-FBMC Communication Channel Parameter Estimation in IIoT: A Distributed CS Approach. Digit. Commun. Netw. 2023, 9, 306–312. [Google Scholar] [CrossRef]
  30. Fesl, B.; Turan, N.; Bock, B.; Utschick, W. Channel Estimation for Quantized Systems based on Conditionally Gaussian Latent Models. IEEE Trans. Signal Process. 2024, 72, 1475–1490. [Google Scholar] [CrossRef]
  31. Rahman, M.H.; Sejan, M.A.S.; Aziz, M.A.; Tabassum, R.; Baik, J.I.; Song, H.K. Deep Learning Based One Bit-ADCs Efficient Channel Estimation Using Fewer Pilots Overhead for Massive MIMO System. IEEE Access 2024, 12, 64823–64836. [Google Scholar] [CrossRef]
  32. Jeon, Y.S.; Kim, D.; Hong, S.N.; Lee, N.; Heath, R.W. Artificial Intelligence for Physical-Layer Design of MIMO Communications with One-Bit ADCs. IEEE Commun. Mag. 2022, 60, 76–81. [Google Scholar] [CrossRef]
  33. Kim, T.K.; Jeon, Y.S.; Min, M. Low-Complexity MIMO Detection Based on Reinforcement Learning with One-Bit ADCs. IEEE Trans. Veh. Technol. 2021, 70, 9022–9035. [Google Scholar] [CrossRef]
  34. Choi, J.; Cho, Y.; Evans, B.L.; Gatherer, A. Robust Learning-based ML Detection for Massive MIMO Systems with One-Bit Quantized Signals. In Proceedings of the 2019 IEEE Global Communications Conference (GLOBECOM), Big Island, HI, USA, 9–13 December 2019. [Google Scholar]
  35. Jeon, Y.S.; Hong, S.N.; Lee, N. Supervised-Learning-Aided Communication Framework for MIMO Systems with Low-Resolution ADCs. IEEE Trans. Veh. Technol. 2018, 67, 7299–7313. [Google Scholar] [CrossRef]
  36. Kim, S.; Hong, S.N. A Supervised-Learning Detector for Multihop Distributed Reception Systems. IEEE Trans. Veh. Technol. 2019, 68, 1958–1962. [Google Scholar] [CrossRef]
  37. Jeon, Y.S.; Lee, N.; Poor, H.V. Robust Data Detection for MIMO Systems with One-Bit ADCs: A Reinforcement Learning Approach. IEEE Trans. Wirel. Commun. 2020, 19, 1663–1676. [Google Scholar] [CrossRef]
  38. Jeon, Y.S.; Lee, N.; Poor, H.V. Reinforcement-Learning-Aided Detector for Time-Varying MIMO Systems with One-Bit ADCs. In Proceedings of the 2019 IEEE Global Communications Conference (GLOBECOM), Big Island, HI, USA, 9–13 December 2019. [Google Scholar]
  39. Kim, T.K. Improved Likelihood Probability in MIMO systems Using One-Bit ADCs. Sensors 2023, 23, 5542. [Google Scholar] [CrossRef] [PubMed]
  40. 3GPP TS 38.104; 3rd Generation Partnership Project; Technical Specification Group Radio Access Network; NR; Base Station (BS) Radio Transmission and Reception (Release 15), V1.0.0. 2017. Available online: https://portal.3gpp.org/desktopmodules/Specifications/SpecificationDetails.aspx?specificationId=3202 (accessed on 13 November 2024).
Figure 1. Transmission frame consisting of one pilot block and D data block.
Figure 1. Transmission frame consisting of one pilot block and D data block.
Mathematics 12 03957 g001
Figure 2. Channel- and sample-based likelihood probabilities compared to conventional methods when v = 40 km/h and SNR = 0 dB.
Figure 2. Channel- and sample-based likelihood probabilities compared to conventional methods when v = 40 km/h and SNR = 0 dB.
Mathematics 12 03957 g002
Figure 3. Optimal weights for the linear regression according to the number of data blocks in time-varying channels.
Figure 3. Optimal weights for the linear regression according to the number of data blocks in time-varying channels.
Mathematics 12 03957 g003
Figure 4. Optimal weights for the LASSO regression according to the number of data blocks in time-varying channels.
Figure 4. Optimal weights for the LASSO regression according to the number of data blocks in time-varying channels.
Mathematics 12 03957 g004
Figure 5. FER for the proposed regression based on different detection methods in time-varying channels.
Figure 5. FER for the proposed regression based on different detection methods in time-varying channels.
Mathematics 12 03957 g005
Figure 6. MSE for the proposed regression based on different detection methods at SNR = 0 dB.
Figure 6. MSE for the proposed regression based on different detection methods at SNR = 0 dB.
Mathematics 12 03957 g006
Table 1. Key notations in this study.
Table 1. Key notations in this study.
NotationsDescriptions
( · ) H conjugate transpose
( · ) T transpose
R set of real number
C set of complex numbers
Re ( · ) real component of the complex number
Im ( · ) imaginary component of the complex number
Sign ( x ) function whose output is 1 for x 0 and −1 otherwise
Φ ( · ) cumulative distribution of the standard normal random variable
Q ( · ) standard Q-function
| · | cardinality of the set
1 { E } one if the event E is true; otherwise, it is 0
P ( · ) probability operation
E ( · ) expectation operation
J 0 ( · ) the 0-th order Bessel function of the first kind
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Kim, T.-K.; Min, M. Regression of Likelihood Probability for Time-Varying MIMO Systems with One-Bit ADCs. Mathematics 2024, 12, 3957. https://doi.org/10.3390/math12243957

AMA Style

Kim T-K, Min M. Regression of Likelihood Probability for Time-Varying MIMO Systems with One-Bit ADCs. Mathematics. 2024; 12(24):3957. https://doi.org/10.3390/math12243957

Chicago/Turabian Style

Kim, Tae-Kyoung, and Moonsik Min. 2024. "Regression of Likelihood Probability for Time-Varying MIMO Systems with One-Bit ADCs" Mathematics 12, no. 24: 3957. https://doi.org/10.3390/math12243957

APA Style

Kim, T.-K., & Min, M. (2024). Regression of Likelihood Probability for Time-Varying MIMO Systems with One-Bit ADCs. Mathematics, 12(24), 3957. https://doi.org/10.3390/math12243957

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop