Abstract
In this study, the maximum error-free transmission rate of an additive white Gaussian noise channel with a symmetric analog-to-digital converter (ADC) was derived as a composite function of the binary entropy function, Gaussian Q-function, and the square root function, assuming that the composite function was convex on the set of all non-negative real numbers. However, because mathematically proving this convexity near zero is difficult, studies in this field have only presented numerical results for small values in the domain. Because the low-signal-to-noise (SNR) regime is considered to be a major application area for one-bit ADCs in wireless communication, deriving a concrete proof of the convexity of the composite function on small SNR values (non-negative values near zero) is important. Therefore, this study proposes a novel proof for convexity, which is satisfied for all non-negative values, based on the continuity of the involved functions.
MSC:
94A05
1. Introduction
The capacity of a communication channel is defined as the maximum data rate that can be transmitted over the channel with an arbitrarily small error probability. In information theory, the channel capacity is given by the supremum of the mutual information between the input and output of the channel [1]. For example, consider the channel , where and are input and output random variables, respectively; is an additive noise independent of X and follows a zero-mean Gaussian distribution; and denotes the set of real numbers. This type of channel is referred to as an additive white Gaussian noise (AWGN) channel, and its capacity is given by , where is the signal-to-noise ratio (SNR) defined as . In recent decades, extensive research on wireless communications has been conducted based on the aforementioned channel capacity and its convexity [2,3].
To satisfy the consistently increasing demand for data rates, recent standards for wireless communication have focused on a large amount of unused bandwidth in the millimeter-wave (mmWave) and terahertz frequency bands [4,5,6,7]. This is because using a significantly wider bandwidth available in a higher-frequency band, such as the mmWave band, is a good solution to satisfy the fast-growing demand for higher data rates. However, such an increase in the bandwidth can cause dissipation of an extensive amount of power when using conventional high-resolution analog-to-digital converters (ADCs) because the power consumption of ADCs linearly increases with increasing sampling rates [8]. This power consumption issue is critical for mobile devices because it is directly related to the battery lifetime as well as the available power resources for uplink communications.
Receiver structures based on low-resolution ADCs have attracted considerable attention as a useful solution for exploiting the abundant resources available in extremely high-frequency bands while achieving low power consumption [9]. In particular, an extreme case that uses one-bit ADCs at the receivers has been widely studied because it is the most power-efficient solution. Extensive studies have been devoted to the evaluation of the performance of communication channels with one-bit ADCs [9,10,11,12,13,14,15,16,17,18,19,20,21,22]. The capacity of a single-input and single-output (SISO) real-valued additive white Gaussian noise (AWGN) channel with one-bit ADCs was derived in [10]. In [10], a symmetric one-bit ADC was assumed, such that the channel output was given by , where denotes the quantization function defined as
The channel capacity of this one-bit quantized AWGN channel was derived as [10], where and Q denote the binary entropy and Gaussian Q-functions, respectively. Further extending this result, the capacity of complex fading channels with multiple transmit and receive antennas was considered in [11]. For example, assuming perfect channel state information at the transmitter, the capacity of a multiple-input and single-output (MISO) complex fading channel was derived for the given channel components. Moreover, certain upper and lower bounds were presented for multiple-input and multiple-output (MIMO) complex channels. Furthermore, numerous important studies have derived the capacities of various wireless channels with one-bit ADCs [12,13,14,15,16]. In [12], the tradeoffs between the achievable rates and energy rates were considered when one-bit ADC receivers were used. The authors of [13] used a one-bit ADC for an uplink massive MIMO system, and the corresponding throughput was analyzed. The performance of a one-bit quantized channel with limited channel state information at the transmitter was considered in [14]. In addition to using ADCs in receivers, the application of one-bit digital-to-analog converters to transmitters was considered in [15]. The secrecy capacity of a Gaussian wiretap channel with one-bit ADCs was analyzed in [16]. The detection performance of fading channels with one-bit ADCs was also studied [17,18,19,20,21,22].
Several studies so far have been based on the capacity of the one-bit quantized SISO AWGN channel, which was first derived in [10]. However, when it was derived in [10], the authors assumed that the composite function was convex for , although the convexity was proved by restricting the domain to for a constant c. Thus, the authors did not provide a concrete mathematical proof when x was close to zero; only a numerical result was presented to support their claim of convexity when [10,23]. Because a low-SNR regime is an important application of a one-bit ADC [11], we need to prove the convexity on for the exact derivation of the capacity for all SNR regions. Systems with one-bit ADCs have been extensively studied for the further evolution of 5G and 6G communication. Thus, providing a concrete proof for the convexity of , for all , will be an important supplement to the theoretical completeness of previous results derived assuming this convexity. Furthermore, the corresponding results can be used to derive unknown channel capacities with one-bit ADCs for various important communication applications, such as multiple-input and multiple-output channels. These results can also be used to solve various optimization problems associated with the design of appropriate resource allocation strategies as the convexity of the capacity function can guarantee the existence of a unique solution depending on the system parameters [24,25].
In this regard, this study proves that the composite function is convex for all possible values of the input SNR, i.e., for all .
2. Notations and Preliminaries
The function denotes a logarithmic function with base e. In addition, we use the following notations throughout this paper for simplicity.
Notation 1.
D is defined as the set of nonnegative real numbers: . The function denotes the Gaussian Q-function defined as follows, and is defined as the n-th order derivative of :
The function denotes the binary entropy function defined as
Notation 2.
The function is defined as follows, and is defined as the n-th order derivative of on D:
Notation 3.
The functions and are defined as follows, and and are defined as the n-th order derivatives of and on D, respectively:
Based on direct differentiation using the chain rule, we can easily derive the followings (see Appendix A for the derivation):
Moreover, the limiting value of and can be obtained as follows.
Lemma 1.
The functions and have the following limits:
Moreover, for all , the following inequalities are satisfied:
Proof.
See Appendix A. □
Lemma 1 includes a summary of inequalities that are essential for deriving the main results presented in the following section. Each result in this lemma does not have a specific physical meaning. Nevertheless, the results play key roles in proving the convexity of as described in the following section.
3. Proof of Convexity
Based on Lemma 1, we can derive the following results.
Lemma 2.
For all , we have
Proof.
First, a proof by contradiction is used to prove that for all . To this end, suppose that there exists a positive real value a that satisfies , or equivalently, for some . Because is continuous for , there must be an open interval inside domain D with some on which . Let be the supremum of all possible values of . If is finite, there exists a such that on and on , by the definition of . However, by (5), with the inequalities in Lemma 1, implies that on , which further implies that is strictly decreasing on . As is strictly decreasing on , we must have . Because is continuous, this contradicts the assumption that on , which was induced by assuming a finite value of . Similarly, if diverges to infinity, then must be strictly decreasing on . As , this implies that , but this contradicts (8). Therefore, we conclude that for all .
Similarly, a proof by contradiction is used to prove that for all . For the sake of contradiction, suppose that there exists a positive real value b that satisfies , or equivalently, , for some . Because is continuous for , there must be an open interval inside domain D with some on which . Let be the supremum of all possible values of . If , there exists a such that on and on , by the definition of . However, by (6), with the inequalities in Lemma 1, implies that on , which further implies that is strictly decreasing on . As is strictly decreasing on , we must have . Because is continuous, this contradicts the assumption that on . Similarly, if , must be strictly decreasing on . As , this implies that , but this contradicts (8). Therefore, we conclude that for all . □
Figure 1 verifies Lemma 2, which can be used to derive the following result.
Figure 1.
Verification for Lemma 2.
Lemma 3.
For all , the following inequality is true.
Proof.
In Figure 2, function is depicted to demonstrate the result in Lemma 3.
Figure 2.
Verification for Lemma 3.
Lemma 4.
The composite function is convex on D if and only if
on D.
Proof.
A real-valued twice differentiable function of one variable is convex if and only if its derivative is nondecreasing (i.e., the second-order derivative is nonnegative). Thus, we investigate the derivative of , which can be calculated using (2) and (3), as
Thus, is nondecreasing if and only if , where . Then, can be calculated as
Hence, if and only if
or, by multiplying both sides by , it follows that if and only if
Therefore, we conclude that is convex on D if and only if on D. Because the function has a one-to-one correspondence from D to D, proving that for all is equivalent to proving that for all ; thus, the proof is complete. □
Lemma 5.
If on a subset of D, then
on the subset.
Proof.
The left-hand side of (16) can be calculated as
As we know that on D by Lemma 3, implies that . □
Theorem 1.
The composite function is convex on D.
Proof.
For simplicity, let . First, by applying L’Hôpital’s rule, we have
Thus, by Lemma 4, the proof is complete if is true for all .
For the sake of contradiction, suppose that there exists a real value on which . Because both and are continuous, this implies that there exists an open interval inside D on which . Moreover, because , there must exist an and a corresponding open interval that satisfies
and
4. Discussion and Conclusions
This letter provides a mathematical proof for the convexity of the capacity function of one-bit quantized AWGN channel. Specifically, the continuity of involved functions are used to provide a proof by contradiction. The corresponding result can be an important supplement for the theoretical completeness of previous studies as numerous important studies have derived the capacities of various wireless channels with one-bit ADCs assuming that the convexity is true without providing a mathematical proof when SNR is near zero.
For example, in the proof of Theorem 2 provided in [10], Jensen’s inequality was applied to the conditional entropy , which is derived as
if is the one-bit quantized output of an AWGN channel such that , where X is the transmit signal, N is the zero-mean Gaussian noise with variance , and is the quantization function defined in (1). The convexity of guarantees the following result based on Jensen’s inequality:
Because there exists a transmit signal distribution that satisfies the equality in (20) (e.g., binary phase shift keying (BPSK)), this result implies that the capacity of a one-bit quantized AWGN channel is given by , where is the SNR. Although this derivation of the capacity assumes the convexity of , an analytical proof was presented assuming that , and only numerical results were provided for the case of . Thus, our complete proof of convexity can be a theoretical supplement to this result. In short, the proof guarantees that the capacity cannot be larger than and that BPSK signaling achieves this upper bound. In Figure 3, the mutual information between X and , denoted as , is compared with the capacity . BPSK signaling with equal probabilities is used as the probability distribution of X. The numerical results are consistent with the analysis results. In [11], authors extended this result to the multi-antenna complex fading channels. For MISO cases, the capacity was derived based on the convexity of on by directly extending the capacity of the SISO channel with a one-bit ADC. Moreover, an upper bound for the capacity of the MIMO channels was derived, and this derivation was also based on the convexity of . Thus, our results could supplement these results.
Figure 3.
Verification for the capacity function.
The convexity of the capacity function can also be used for optimization problems to provide appropriate resource allocation. In such cases, the convexity of the objective function can be used to clarify the existence of an optimal solution and identify it. For example, in [25], an optimal power allocation problem was formulated and solved based on the convexity of ; however, the convexity was assumed with only some numerical results.
With one-bit quantization, deriving the exact capacity is difficult because the quantization function is difficult to analyze. Thus, although analyzing the conventional capacity with infinite-resolution ADCs is feasible, obtaining the capacity for channels with one-bit ADCs may be extremely difficult. For example, the capacity of MIMO channels with one-bit ADCs is generally unknown, although the exact capacity of the MIMO channels with infinite-resolution ADCs is already known. Thus, our results can provide a valid mathematical basis for further derivations of unknown capacities and various optimization problems that use the capacity function of a one-bit quantized AWGN channel.
Author Contributions
Conceptualization, S.L. and M.M.; methodology, S.L.; software, S.L. and M.M.; validation, S.L. and M.M.; formal analysis, S.L. and M.M.; investigation, S.L. and M.M.; resources, M.M.; data curation, S.L.; writing—original draft preparation, S.L.; writing—review and editing, S.L. and M.M.; visualization, S.L.; supervision, M.M.; project administration, S.L. and M.M.; and funding acquisition, S.L. and M.M. All authors have read and agreed to the published version of the manuscript.
Funding
This work was supported in part by the National Research Foundation of Korea (NRF), funded by the Korean government (MSIT) (Grant No. 2020R1F1A1071649), and in part by the BK21 FOUR Project, funded by the Ministry of Education, Korea (4199990113966).
Data Availability Statement
Not applicable.
Conflicts of Interest
The authors declare that there is no conflict of interest.
Appendix A. Proof of Lemma 1
Appendix A.1. Derivations of (2) and (3)
The Q-function is defined as
Thus, the derivative is
where (a) follows from Leibniz’s rule. Hence, the second-order derivative is
Similarly, (3) can be proved through direct differentiation using .
Appendix A.2. Derivations of (4)–(8)
By definition,
where is used for (a), and and are used for (b). As is symmetric with respect to the origin, so it follows that . Thus, and can be calculated as follows:
where is used for (a). By differentiating this,
where (4) is used for (a).
Finally, the limiting values in (8) are obtained as follows:
where L’Hôpital’s rule is used for (a) and (c), and is used for (b) and (d). The authors in [26] showed that , which is equivalent to as . Because , we have ; thus, from (A1), we finally have .
From (2), , and by definition, . Thus,
Appendix A.3. Proofs of (9)–(11)
By definition, for . Moreover, and for . Thus, for all , it is clear that , , , and . For (11), we use , which was derived in [26]. That is,
References
- Thomas, J.A.; Cover, T.M. Elements of Information Theory; Wiley: Hoboken, NJ, USA, 2001. [Google Scholar]
- Tse, D.; Viswanath, P. Fundamentals of Wireless Communication; Cambridge University Press: Cambridge, UK, 2005. [Google Scholar]
- Heath, R.W., Jr.; Lozano, A. Foundations of MIMO Communication; Cambridge University Press: Cambridge, UK, 2018. [Google Scholar]
- Swindlehurst, A.L.; Ayanoglu, E.; Heydari, P.; Capolino, F. Millimeter-wave massive MIMO: The next wireless revolution? IEEE Commun. Mag. 2014, 52, 56–62. [Google Scholar] [CrossRef]
- Larsson, E.G.; Edfors, O.; Tufvesson, F.; Marzetta, T.L. Massive MIMO for next generation wireless systems. IEEE Commun. Mag. 2014, 52, 186–195. [Google Scholar] [CrossRef]
- Busari, S.A.; Huq, K.M.S.; Mumtaz, S.; Dai, L.; Rodriguez, J. Millimeter-Wave Massive MIMO Communication for Future Wireless Systems: A Survey. IEEE Commun. Surv. Tut. 2017, 20, 836–869. [Google Scholar] [CrossRef]
- Saleem, A.; Cui, H.; He, Y.; Boag, A. Channel propagation characteristics for massive multiple-input/multiple-output systems in a tunnel environment. IEEE Antennas Propag. Mag. 2022, 126–142. [Google Scholar] [CrossRef]
- Walden, R. Analog-to-Digital Converter Survey and Analysis. IEEE J. Select. Areas Commun. 1999, 17, 539–550. [Google Scholar] [CrossRef]
- Zhang, J.; Dai, L.; Li, X.; Liu, Y.; Hanzo, L. On low-resolution ADCs in practical 5G millimeter-wave massive MIMO systems. IEEE Commun. Mag. 2018, 56, 205–211. [Google Scholar] [CrossRef]
- Singh, J.; Dabeer, O.; Madhow, U. On the limits of communication with low-precision analog-to-digital conversion at the receiver. IEEE Trans. Commun. 2009, 57, 3629–3639. [Google Scholar] [CrossRef]
- Mo, J.; Heath, R.W., Jr. Capacity Analysis of One-Bit Quantized MIMO Systems with Transmitter Channel State Information. IEEE Trans. Signal Process. 2015, 63, 5498–5512. [Google Scholar] [CrossRef]
- Mo, J.; Alkhateeb, A.; Abu-Surra, S.; Heath, R.W., Jr. Hybrid architectures with few-bit ADC receivers: Achievable rates and energy-rate tradeoffs. IEEE Trans. Wirel. Commun. 2017, 16, 2274–2287. [Google Scholar] [CrossRef]
- Jacobsson, S.; Durisi, G.; Coldrey, M.; Gustavsson, U.; Studer, C. Throughput analysis of massive MIMO uplink with low-resolution ADCs. IEEE Trans. Wirel. Commun. 2017, 16, 4038–4051. [Google Scholar] [CrossRef]
- Mo, J.; Heath, R.W., Jr. Limited feedback in single and multi-user MIMO systems with finite-bit ADCs. IEEE Trans. Wirel. Commun. 2018, 17, 3284–3297. [Google Scholar] [CrossRef]
- Nam, Y.; Do, H.; Jeon, Y.-S.; Lee, N. On the Capacity of MISO Channels with One-Bit ADCs and DACs. IEEE J. Sel. Areas Commun. 2019, 37, 2132–2145. [Google Scholar] [CrossRef]
- Nam, S.H.; Lee, S.H. Secrecy Capacity of a Gaussian Wiretap Channel With ADCs is Always Positive. IEEE Trans. Inf. Theory 2022, 68, 1186–1196. [Google Scholar] [CrossRef]
- Choi, J.; Mo, J.; Heath, R.W., Jr. Near Maximum-Likelihood Detector and Channel Estimator for Uplink Multiuser Massive MIMO Systems with One-Bit ADCs. IEEE Trans. Commun. 2016, 64, 2005–2018. [Google Scholar] [CrossRef]
- Mollén, C.; Choi, J.; Larsson, E.G.; Heath, R.W., Jr. Uplink Performance of Wideband Massive MIMO with One-Bit ADCs. IEEE Trans. Wirel. Commun. 2017, 16, 87–100. [Google Scholar] [CrossRef]
- Hong, S.-N.; Kim, S.; Lee, N. A Weighted Minimum Distance Decoding for Uplink Multiuser MIMO Systems with Low-Resolution ADCs. IEEE Trans. Commun. 2018, 66, 1912–1924. [Google Scholar] [CrossRef]
- Jeon, Y.-S.; Lee, N.; Hong, S.-N.; Heath, R.W., Jr. One-Bit Sphere Decoding for Uplink Massive MIMO Systems with One-Bit ADCs. IEEE Trans. Wirel. Commun. 2018, 17, 4509–4521. [Google Scholar] [CrossRef]
- Jeon, Y.-S.; Do, H.; Hong, S.-N.; Lee, N. Soft-Output Detection Methods for Sparse Millimeter Wave MIMO Systems with Low-Precision ADCs. IEEE Trans. Commun. 2019, 67, 2822–2836. [Google Scholar] [CrossRef]
- Li, Y.; Tao, C.; Seco-Granados, G.; Mezghani, A.; Swindlehurst, A.L.; Liu, L. Channel Estimation and Performance Analysis of One-Bit Massive MIMO Systems. IEEE Trans. Signal Process. 2017, 65, 4075–4089. [Google Scholar] [CrossRef]
- Dabeer, O.; Singh, J.; Madhow, U. On the limits of communication performance with one-bit analog-to-digital conversion. In Proceedings of the 2006 IEEE 7th Workshop on Signal Processing Advances in Wireless Communications, Cannes, France, 2–5 July 2006; pp. 1–5. [Google Scholar]
- Boyd, S.; Vandenberghe, L. Convex Optimization; Cambridge University Press: Cambridge, UK, 2004. [Google Scholar]
- Min, M. Optimal Power Allocation for Multiple Channels With One-Bit Analog-to-Digital Converters. IEEE Trans. Vehi. Tech. 2022, 71, 4438–4443. [Google Scholar] [CrossRef]
- Borjesson, P.; Sundberg, C.-E. Simple Approximations of the Error Function Q(x) for Communications Applications. IEEE Trans. Commun. 1979, 27, 39–643. [Google Scholar] [CrossRef]
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations. |
© 2022 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).