Next Article in Journal
Quantum Correlation Dynamics in Controlled Two-Coupled-Qubit Systems
Previous Article in Journal
Do Liquidity Proxies Based on Daily Prices and Quotes Really Measure Liquidity?
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

On the Capacity Regions of Degraded Relay Broadcast Channels with and without Feedback

1
School of Information Science and Technology, ShanghaiTech University, Shanghai 201210, China
2
Shanghai Institute of Microsystem and Information Technology, Chinese Academy of Sciences, Shanghai 200050, China
3
University of Chinese Academy of Sciences, Beijing 100049, China
*
Author to whom correspondence should be addressed.
This paper is an extended version of our paper published in IEEE International Symposium on Information Theory (ISIT), Vail, CO, USA, 17–22 July 2018.
Entropy 2020, 22(7), 784; https://doi.org/10.3390/e22070784
Submission received: 11 June 2020 / Revised: 10 July 2020 / Accepted: 13 July 2020 / Published: 17 July 2020
(This article belongs to the Section Information Theory, Probability and Statistics)

Abstract

:
The four-node relay broadcast channel (RBC) is considered, in which a transmitter communicates with two receivers with the assistance of a relay node. We first investigate three types of physically degraded RBCs (PDRBCs) based on different degradation orders among the relay and the receivers’ observed signals. For the discrete memoryless (DM) case, only the capacity region of the second type of PDRBC is already known, while for the Gaussian case, only the capacity region of the first type of PDRBC is already known. In this paper, we step forward and make the following progress: (1) for the first type of DM-PDRBC, a new outer bound is established, which has the same rate expression as an existing inner bound, with only a slight difference on the input distributions; (2) for the second type of Gaussian PDRBC, the capacity region is established; (3) for the third type of PDRBC, the capacity regions are established both for DM and Gaussian cases. Besides, we also consider the RBC with relay feedback where the relay node can send the feedback signal to the transmitter. A new coding scheme based on a hybrid relay strategy and a layered Marton’s coding is proposed. It is shown that our scheme can strictly enlarge Behboodi and Piantanida’s rate region, which is tight for the second type of DM-PDRBC. Moreover, we show that capacity regions of the second and third types of PDRBCs are exactly the same as that without feedback, which means feedback cannot enlarge capacity regions for these types of RBCs.

1. Introduction

In the classical three-node relay channel [1,2], a relay node helps the communication between the transmitter and receiver. If the relay node also wants to decode a private message sent by the transmitter, then this channel turns out to be a partially cooperative relay broadcast channel (RBC) [3,4]. The capacity region of partially cooperative RBC is established for the case of degraded message sets [4], where the transmitter has a common message for both destinations and a private message for the relay. The fully cooperative RBC [3] is a more general model where both destinations can serve as the relay and receiver. A two-user degraded broadcast channel with conferencing and degraded message sets was studied in [5]. In [6], a degraded RBC was studied and an achievable rate region and distortion performance based on the decode-forward relay strategies proposed. In [7], the physically degraded and state-dependent RBC with cooperating decoders was investigated. A compress-forward inner bound was established for RBC with confidential messages in [8]. Partially and fully cooperative state-dependent relay broadcast channels with perfect causal channel state information (CSI) were considered in [9]. In [10], rate regions for two types of partially cooperative RBC with non-causal side information were established. The fully and partially cooperative RBCs with rate-limited feedback were studied in [11].
In many practical scenarios, receivers are unwilling to serve as relay nodes for other users due to the concern for privacy leakage or energy overuse. It is thus more practical to introduce exclusive relay nodes to assist the communication, leading to the so-called dedicated RBCs [12,13]. This model is particularly common in modern communication systems such as 4G or 5G cellular network, where relay nodes are incorporated into networks to improve the communication rate and enlarge the service range as well. The dedicated RBCs have been widely studied in the literature. In [14], the capacity region of a single-relay dedicated Gaussian RBC was established when one receiver’s observed signal was a degraded form of the other receiver’s, and the stronger receiver’s observed signal was a degraded form of the relay’s. In [15], an RBC with three parallel unmatched subchannels was studied, which was shown to enlarge the family of RBCs and relay channels for which the capacity region was known. For r-relay ( r 2 ) dedicated RBCs, the general outer bounds and capacity results for several classes of broadcast relay channels were investigated in [16], in which the capacity region of the so-called semi-degraded BC was established. The achievable rate region for K-receiver RBCs with one dedicated relay node was proposed in [17]. Multiple-input multiple-output (MIMO) RBC with direct links based on a weighted sum-rate criterion was studied in [18]. A new achievable rate region generalizing Marton’s coding to two-relay two-user RBCs was proposed in [19]. For multiple-relay RBC, single relay selection schemes using either selective digital relaying or selective analog relaying were proposed, which were shown to improve significantly the bit error probability performance [20]. Inner bounds were proposed for a single-relay dedicated RBC with fast fading and state feedback in [21].
In spite of the enormous amount of prior work on dedicated RBCs, the capacity region is still unknown. Moreover, it has been shown that feedback cannot enlarge the capacity region for some three-node degraded communication channels, such as degraded BCs and the degraded relay channel. Whether this result still holds for the four-node degraded RBCs is also an interesting problem. In this paper, we revisit the four-node dedicated RBC p Y 1 Y 2 Y 3 | X X 3 ( y 1 , y 2 , y 3 | x , x 3 ) , as depicted in Figure 1, where X is a symbol sent by the transmitter, Y 3 and Y k , for k { 1 , 2 } , are symbols observed by the relay and receiver k, respectively, and X 3 is a symbol created by observing Y 3 and to be sent by the relay. Even for the degraded case, the capacity region is still unknown, except for some special cases. The main challenges to establish its capacity region mainly come from the following three parts:
  • Various definitions of degraded RBCs: Due to the five channel parameters ( X , X 3 , Y 1 , Y 2 , Y 3 ) , there could be multiple definitions of degraded RBCs, which poses difficulties finding a unified single-letter capacity region for all types of degraded RBCs. For example, in [16], Behboodi and Piantanida defined RBC as degraded/semi-degraded if it satisfied one of the following conditions.
    -
    Condition 1: X ( X 3 , Y 3 ) ( Y 1 , Y 2 ) and ( X , X 3 ) Y 1 Y 2 .
    -
    Condition 2: X ( X 3 , Y 3 ) Y 2 and X ( X 3 , Y 1 ) Y 3 .
    In [16], the RBC satisfying Condition 1 was called degraded RBC and the RBC satisfying Condition 2 semi-degraded degraded RBC. In Condition 1, the relay’s observed signal is “stronger” than both receivers’. In Condition 2, the relay’s observed signal is “stronger” than one receiver’s, but “weaker” than the other receiver’s. Apart from these conditions, one can also define new types of degraded RBCs by changing the location of X 3 in the Markov chains or assuming that the relay’s observed signal is “weaker” than both receivers’, e.g., satisfying:
    -
    Condition 3: X ( X 3 , Y 1 ) Y 2 Y 3 .
    Notice that for the discrete memoryless (DM) degraded RBCs satisfying the three conditions above, only the capacity region of RBC satisfying Condition 2 is already known, while for the Gaussian case, only the capacity region of RBC satisfying Condition 1 is already known [14].
  • Achievability proof: To establish the capacity regions of different types of degraded RBCs, an ideal solution is to find a general inner bound and outer bound that match for all types of degraded RBCs. Since the capacity results for the degraded broadcast channel (BC) and degraded relay channel are already known, one may come up with a mixed scheme by combining the optimal schemes used in these channels. Unfortunately, this mixed scheme turns out to be not always optimal [13,14]. An alternative way is to exploit the degradation structure and carefully the design coding scheme for each specific type, such as the work done in [14,16]. Note that this is not an easy work, either. For example, the capacity region of the degraded RBC that satisfies the aforementioned Condition 1 is still unknown, except for the Gaussian case.
  • Converse proof: The cut-set bound is strictly suboptimal, since it is not even tight for the degraded BCs. An outer bound for the degraded BCs satisfying the aforementioned Condition 1 or Condition 2 was established in [16]. It is not known whether this outer bound is optimal, as this outer bound does not match with the proposed inner bound in the given rate expressions. Moreover, the outer bound could be invalid for other types of degraded RBCs. Thus, it would be necessary to build outer bounds for different types of degrade RBCs and prove their tightness.
Now, we summarize the main contributions of this paper as follows:
  • For DM-physically degraded RBCs (PDRBCs) satisfying Condition 1, a new outer bound is established, which has the same rate expression as an existing inner bound, with only a slight difference on the input distributions; for Gaussian PDRBCs satisfying Condition 2, the capacity region is established based on entropy power inequality (EPI) [22] and an appropriate relay strategy; for PDRBCs satisfying Condition 3, the capacity regions are established both for the DM and Gaussian cases.
  • We propose a new coding scheme for general RBC with relay feedback where the relay node can send the feedback signal to the transmitter. The new scheme is based on a hybrid relay strategy and a layered Marton’s coding. It is shown that our scheme can strictly enlarge Behboodi and Piantanida’s rate region, which is tight for the second type of DM-PDRBC. Moreover, we show that capacity regions of the second and third types of PDRBCs are exactly the same as that without feedback, which means that feedback cannot enlarge capacity regions for these types of RBCs.
The rest of the paper is organized as follows. The system model is introduced in Section 2. Various definitions of degraded RBCs are given in Section 3. In Section 4, we state our main capacity results for DM and Gaussian PDRBC. The result on RBC with feedback is give in Section 5, and its proof is given in Section 6. The proof of the outer bounds on the capacity regions of DM-PDRBC with feedback are stated in Section 7. The proof of capacity regions for Gaussian PDRBC is presented in Section 8. Section 9 concludes this paper.
Notation: We use capital letters to denote random variables and small letters for their realizations, e.g., X and x. Define a function C ( x ) : = 1 2 log 2 ( 1 + x ) . For nonnegative integers k , j , let X k j : = ( X k , 1 , , X k , j ) . Given a random variable X, we write its probability mass function (pmf) p X ( x ) as p ( x ) for short. For an integer N, we use [ 1 : N ] to denote {1,…,N}. Given a real value α with 0 α 1 , let α ¯ : = 1 α . Considering K sequences X 1 n , , X K n each of n-length, the joint typical set T ϵ ( n ) p ( x 1 , x 2 , , x K ) denotes the set of all sequences ( X 1 n , , X K n ) when they are join typical, where the parameter ϵ is a positive value involved in the definition of joint typicality and tends to zero as the length n goes to infinity. More details and properties about T ϵ ( n ) p ( x 1 , x 2 , x K ) can be found in [22] (p. 29).

2. System Model

Consider a four-node discrete memoryless relay broadcast channel (DM-RBC) in which there is one transmitter, two receivers, and one relay that helps the transmitter to communicate with the receivers, as depicted in Figure 1. This channel consists of five finite alphabets ( X , X 3 , Y 1 , Y 2 , Y 3 ) and a collection of pmf p ( y 1 , y 2 , y 3 | x , x 3 ) on Y 1 × Y 2 × Y 3 , one for each X × X 3 . Here, x X is a symbol sent by the transmitter, y 3 Y 3 and y k Y k , for k { 1 , 2 } , are symbols observed by the relay and receiver k, respectively, and x 3 X 3 is a symbol created by observing y 3 and will be sent by the relay.
The transmitter wishes to communicate a message M k [ 1 : 2 n R k ] to receiver k, for k { 1 , 2 } , with the assistance of a relay node, where n denotes the block length of transmission. In the following subsections, we introduce the DM-RBC without and with feedback, respectively.

2.1. RBC without Feedback

A ( 2 n R 1 , 2 n R 2 , n ) -code for DM-RBC has:
  • two message sets M 1 = [ 1 : 2 n R 1 ] and M 2 = [ 1 : 2 n R 2 ] ,
  • a source encoder that maps messages ( M 1 , M 2 ) to the channel input X i ( M 1 , M 2 ) , for each time i [ 1 : n ] ,
  • a relay encoder that maps Y 3 i 1 to a sequence X 3 , i ( Y 3 i 1 ) , where Y 3 i 1 : = ( Y 3 , 1 , , Y 3 , i 1 ) , for time i [ 1 : n ] ,
  • two decoders that estimate M ^ 1 and M ^ 2 based on Y 1 n and Y 2 n , respectively, where Y k n : = ( Y k , 1 , , Y k , n ) , for k = 1 , 2 .
Suppose M k is uniformly distributed over the message set M k . A rate region ( R 1 , R 2 ) is called achievable if for every blocklength n, there exists a ( 2 n R 1 , 2 n R 2 , n ) -code such that the average probability of error:
P e ( n ) = Pr [ M ^ 1 M 1 or M ^ 2 M 2 ]
tends to zero as n tends to infinity. The capacity region C NoFb is the closure of the set of all achievable rate pairs ( R 1 , R 2 ) .

2.2. RBC with Feedback

Consider a DM-RBC with feedback from the relay and users to the transmitter. A ( 2 n R 1 , 2 n R 2 , n ) -code for this channel has:
  • two message sets M 1 = [ 1 : 2 n R 1 ] and M 2 = [ 1 : 2 n R 2 ] ,
  • a source encoder that maps messages ( M 1 , M 2 , Y 1 i 1 , Y 2 i 1 , Y 3 i 1 ) to the channel input X i ( M 1 , M 2 ) , for each time i [ 1 : n ] ,
  • a relay encoder that maps Y 3 i 1 to a sequence X 3 , i ( Y 3 i 1 ) , for i [ 1 : n ] ,
  • two decoders that estimate M ^ 1 and M ^ 2 based on Y 1 n and Y 2 n , respectively.
Suppose M k is uniformly distributed over the message set M k . A rate region ( R 1 , R 2 ) is called achievable if for every blocklength n, there exists a ( 2 n R 1 , 2 n R 2 , n ) -code such that the average probability of error:
P e ( n ) = Pr [ M ^ 1 M 1 or M ^ 2 M 2 ]
tends to zero as n tends to infinity. The capacity region C Fb is the closure of the set of all achievable rate pairs ( R 1 , R 2 ) .

3. Definitions of Various PDRBCs

In this paper, we mainly focus on the PDRBC. Let C PD denote the capacity region of PDRBC. Without loss of generality, assume Y 2 is a random degradation of Y 1 , which implies that output Y 1 is “stronger” than Y 2 . According to the degradation order among Y 1 , Y 2 and Y 3 , we consider three types of PDRBC.
Definition 1.
An RBC p ( y 1 , y 2 , y 3 | x , x 3 ) is said to be
  • Type-I PDRBC if X ( X 3 , Y 3 ) ( Y 1 , Y 2 ) and ( X , X 3 ) Y 1 Y 2 form Markov chains.
  • Type-II PDRBC if X ( X 3 , Y 3 ) Y 2 and X ( X 3 , Y 1 ) Y 3 form Markov chains.
  • Type-III PDRBC if X ( X 3 , Y 1 ) Y 2 Y 3 forms a Markov chain.
Type-I PDRBC and Type-II PDRBC are not new, which were introduced by [16]. In Type-I DM-PDRBC, the relay observes a “stronger” symbol than both receivers, and its capacity region is still unknown, except for the Gaussian case [14]. In Type-II PDRBC, the relay observes a “stronger” signal than one receiver, but a “weaker” signal than another receiver. For the DM case, the capacity region of Type-II PDRBC was established in [16] (Theorem 7), which is the set of rate pairs ( R 1 , R 2 ) such that:
R 2 min I ( U , X 3 ; Y 2 ) , I ( U ; Y 3 | X 3 ) ,
R 1 + R 2 min I ( U , X 3 ; Y 2 ) , I ( U ; Y 3 | X 3 ) + I ( X ; Y 1 | U , X 3 ) ,
for some pmf p ( u , x 3 ) p ( x | u ) . Type-III PDRBC is newly defined, in which the relay’s observed signal is “weaker” than both receivers’. Type-II and Type-III PDRBCs could characterize some practical communication scenarios when some receivers are closer to the transmitter and thus have a better received signal than relay nodes.
More generally, stochastically degraded RBC is defined as below.
Definition 2.
An RBC p ( y 1 , y 2 , y 3 | x , x 3 ) is said to be:
  • Type-I stochastically degraded RBC if there exist random variables ( Y ˜ 1 , Y ˜ 3 ) such that p ( y ˜ 1 | x , x 3 ) = p Y 1 | X X 3 ( y ˜ 1 | x , x 3 ) and p ( y ˜ 3 | x , x 3 ) = p Y 3 | X X 3 ( y ˜ 3 | x , x 3 ) and X ( X 3 , Y ˜ 3 ) ( Y ˜ 1 , Y 2 ) and ( X , X 3 ) Y ˜ 1 Y 2 form Markov chains.
  • Type-II stochastically degraded RBC if there exist random variables ( Y ˜ 1 , Y ˜ 3 ) such that p ( y ˜ 1 | x , x 3 ) = p Y 1 | X X 3 ( y ˜ 1 | x , x 3 ) and p ( y ˜ 3 | x , x 3 ) = p Y 3 | X X 3 ( y ˜ 3 | x , x 3 ) and X ( X 3 , Y ˜ 3 ) Y 2 and X ( X 3 , Y ˜ 1 ) Y ˜ 3 form Markov chains.
  • Type-III stochastically degraded RBC if there exist random variables ( Y ˜ 1 , Y ˜ 2 ) such that p ( y ˜ 1 | x , x 3 ) = p Y 1 | X X 3 ( y ˜ 1 | x , x 3 ) and p ( y ˜ 2 | x , x 3 ) = p Y 2 | X X 3 ( y ˜ 3 | x , x 3 ) and X ( X 3 , Y ˜ 1 ) Y ˜ 2 Y 3 forms a Markov chain.
Remark 1.
Following the similar proof in [14] (Lemma 1), when p ( y 1 , y 2 , y 3 | x , x 3 ) = p ( y 3 | x , x 3 ) p ( y 1 , y 2 | y 3 , x 3 ) , the capacity region of RBC depends only on the marginal conditional distributions p ( y 1 | x 3 , y 3 ) and p ( y 2 | x 3 , y 3 ) . Thus, the capacity region of Type-I PDRBC holds when it is stochastically degraded.

Gaussian PDRBCs

Consider the Gaussian RBC, which can be described as:
Y k = X + X 3 + Z k , k = 1 , 2 , Y 3 = X + Z 3 ,
where Z 1 , Z 2 , and Z 3 are Gaussian noise components with zero mean and variances σ 1 2 , σ 2 2 , and σ 3 2 , respectively. Assume average transmission power constraint P on the transmitter and P r on the relay.
Similar to the discrete memoryless case, Gaussian PDRBC can be divided into three types according to the degradation order among the outputs received at the receivers and relay:
  • Type-I Gaussian PDRBC: The channel outputs ( Y 1 , Y 2 , Y 3 ) are equivalent to:
    Y 3 = X + Z 3 , Y 1 = X + X 3 + Z 3 + Z ^ a , Y 2 = X + X 3 + Z 3 + Z ^ a + Z ˜ a ,
    where Z ^ a N ( 0 , σ 1 2 σ 3 2 ) and Z ˜ a N ( 0 , σ 2 2 σ 1 2 ) are independent. Note that in this case, X ( X 3 , Y 3 ) ( Y 1 , Y 2 ) and ( X , X 3 ) Y 1 Y 2 form Markov chains, and the noise variances satisfy:
    σ 2 2 σ 1 2 σ 3 2 .
  • Type-II Gaussian PDRBC: The channel outputs ( Y 1 , Y 2 , Y 3 ) are equivalent to:
    Y 1 = X + X 3 + Z 1 , Y 3 = X + Z 1 + Z ^ b , Y 2 = X + X 3 + Z 1 + Z ^ b + Z ˜ b ,
    where Z ^ b N ( 0 , σ 3 2 σ 1 2 ) and Z ˜ b N ( 0 , σ 2 2 σ 3 2 ) are independent. Note that in this case, X ( X 3 , Y 3 ) Y 2 and X ( X 3 , Y 1 ) Y 3 form Markov chains, and the noise variances satisfy:
    σ 2 2 σ 3 2 σ 1 2 .
  • Type-III Gaussian PDRBC: The channel outputs ( Y 1 , Y 2 , Y 3 ) are equivalent to:
    Y 1 = X + X 3 + Z 1 , Y 2 = X + X 3 + Z 1 + Z ^ c , Y 3 = X + Z 1 + Z ^ c + Z ˜ c ,
    where Z ^ c N ( 0 , σ 2 2 σ 1 2 ) and Z ˜ c N ( 0 , σ 3 2 σ 2 2 ) are independent. Note that in this case, X ( X 3 , Y 1 ) Y 2 Y 3 forms a Markov chain, and the noise variances satisfy:
    σ 3 2 σ 2 2 σ 1 2 .
Remark 2.
For Type-I Gaussian PDRBC, the capacity region was established in [14], which is the set of rate pairs ( R 1 , R 2 ) such that:
R 1 min C α ¯ θ P σ 3 2 , C θ P + θ r P r + 2 α θ θ r P P r σ 1 2 ,
R 2 C θ ¯ P + θ ¯ r P r + 2 β θ ¯ θ ¯ r P P r θ P + θ r P r + 2 α θ θ r P P r + σ 2 2 ,
R 1 + R 2 C β ¯ θ ¯ P + α ¯ θ P σ 3 2 ,
where 0 α , β , θ , θ r 1 . The capacity regions of Type-II and Type-III Gaussian PDRBC are still unknown.

4. Capacity Results for PDRBC without Feedback

4.1. Discrete Memoryless PDRBC

Theorem 1.
For Type-I PDRBC, the inner bound on the capacity region consists of all rate pairs ( R 1 , R 2 ) such that:
R 2 I ( U , V ; Y 2 ) ,
R 1 + R 2 I ( U , V ; Y 2 ) + I ( X ; Y 3 | U , V , X 3 ) ,
R 1 + R 2 I ( U , V ; Y 2 ) + I ( X , X 3 ; Y 1 | U , V ) ,
R 1 + R 2 I ( X ; Y 3 | V , X 3 ) ,
for some pmf p ( u , v ) p ( x 3 | v ) p ( x | u , x 3 ) . The outer bound on the capacity region has the same rate constraints as (6), but under the pmf p ( u , v ) p ( x 3 | u ) p ( x | u , x 3 ) and H ( V | U ) = 0 .
For Type-III PDRBC, the capacity region is the set of rate pairs ( R 1 , R 2 ) such that:
R 1 I ( X ; Y 1 | U , X 3 = x 3 ) ,
R 2 I ( U ; Y 2 | X 3 = x 3 ) ,
for some value x 3 X 3 and pmf p ( u , x ) .
Proof. 
For Type-I PDRBC, the inner bound is obtained by letting ( V , X 3 , U ) satisfy the Markov chain V X 3 U in the inner bound presented in [16] (Theorem 9), and the outer bound is proven in Section 7.1. For Type-III PDRBC, the outer bound is given in Section 7.3, and the achievable scheme is to let the relay send a constant value x 3 and the transmitter use the traditional superposition coding to send the source messages, i.e., the weak receiver’s intended message is stored in a cloud center codeword u n and will be decoded by both receivers, and the strong receiver’s intended message is conveyed through a satellite codeword x n , which will be decoded by the strong receiver. □

4.2. Gaussian PDRBC

Theorem 2.
For Type-II Gaussian PDRBC, the capacity region is the set of rate pairs ( R 1 , R 2 ) such that:
R 1 C α P σ 1 2 ,
R 2 min C α ¯ P + P r α P + σ 2 2 , C ( β α ) P α P + σ 3 2 ,
where 0 α , β 1 , and β α .
For Type-III Gaussian PDRBC, the capacity region is the set of rate pairs ( R 1 , R 2 ) such that:
R 1 C α P σ 1 2 , R 2 C α ¯ P α P + σ 2 2 ,
where 0 α 1 .
Proof. 
See the proof in Section 8.1 and Section 8.2. □
In Figure 2, we plot numerical results on the capacity regions for the three types of PDRBC. The chosen channel parameters are the same as those in [14], i.e., P = 5 , P r = 10 , σ π ( 1 ) 2 = 1 , σ π ( 2 ) 2 = 2.5 , and σ π ( 3 ) 2 = 11 , where π ( · ) is some permutation on {1,2,3} such that the conditions in (2), (3), and (4) are satisfied for the corresponding types of PDRBCs. From this figure, we can see that Type-I Gaussian PDRBC has the largest capacity region, while Type-III Gaussian PDRBC has the smallest. This is reasonable because in Type-I, the relay observes the best signal and thus can help the receivers’ decoding to the largest extent, while in Type-III, the relay observes the weakest signal and thus cannot offer much help on receivers’ decoding as Type-I and Type-II PDRBCs. We observe that the boundary of the capacity region for Type-III PDRBC is not smooth in the middle, and this is mainly due to the existing minimum term in (8b).

5. Results on RBC with Feedback

Theorem 3.
For the four-node RBC with feedback from the relay to the transmitter, the capacity region includes the set of rate pairs ( R 1 , R 2 ) such that:
R 1 I A + I C I ( U 0 ; X 3 | V ) ,
R 2 I ( V , U 0 , U 2 ; Y 2 ) I ( Y ^ 3 ; Y 3 | U 0 , U 2 , V , Y 2 ) I ( U 2 ; X 3 | U 0 , V ) ,
R 1 + R 2 I A + I ( U 2 ; Y ^ 3 , Y 2 | U 0 , V ) I ( U 2 ; U 1 , X 3 | U 0 , V ) ,
R 1 + R 2 I B + I ( U 0 , U 2 , V ; Y 2 ) I ( Y ^ 3 ; Y 3 | U 0 , U 2 , V , Y 2 ) I ( U 2 ; U 1 , X 3 | U 0 , V ) ,
for some pmf p ( v , u 0 , u 1 , u 2 , u 3 ) P ( y ^ 3 | y 3 , u 0 ) and a function x = f ( v , u 0 , u 1 , u 2 , u 3 ) , where:
I A = min { I ( U 0 , V ; Y 1 ) + I ( X 3 ; U 0 , Y 1 | V ) + I ( U 1 ; Y 1 | U 0 , V 0 , X 3 ) I ( Y ^ 3 ; Y 3 | U 0 , U 1 , V , X 3 , Y 1 ) ,
I ( U 0 ; X 3 , Y 3 | V ) + I ( U 1 ; Y 3 | U 0 , V , X 3 ) } ,
I B = min { I ( U 1 ; Y 3 | U 0 , V , X 3 ) , I ( X 3 ; U 0 , Y 1 , Y ^ 3 | V ) + I ( U 1 ; Y ^ 3 , Y 1 | U 0 , V , X 3 ) } ,
I C = I ( U 3 ; Y ^ 3 , Y 1 | U 0 , U 1 , V , X 3 ) I ( U 3 ; U 2 | U 0 , V , U 1 , X 3 ) .
Proof. 
In our scheme, source message M 1 is split into three independent sub-messages ( M 1 , c , M 1 , p 1 , M 1 , p 2 ) , and M 2 is split into two independent sub-messages ( M 2 , c , M 2 , p ) . Here, M 1 , c [ 1 : 2 n R 1 , c ] and M 2 , c [ 1 : 2 n R 2 , c ] are sub-messages that can be considered as a common part of the source messages since in our scheme, they will be decoded by both the relay and two receivers, M 1 , p 1 [ 1 : 2 n R 1 , p 1 ] is the sub-message that will be decoded by the relay and Receiver 1, M 1 , p 2 [ 1 : 2 n R 1 , p 2 ] is the sub-message that will be solely decoded by Receiver 1, and M 2 , p [ 1 : 2 n R 2 , p ] is the sub-message that will be solely decoded by Receiver 2. Hence, R 1 = R 1 , c + R 1 , p 1 + + R 1 , p 2 and R 2 = R 2 , c + R 2 , p . The transmitter uses a layered Marton’s coding in which ( M 1 , c , M 2 , c ) is stored in the cloud center U 0 and will be decoded by the relay and both receivers, M 1 , p 1 is contained in U 1 , a satellite of U 0 , and will be decoded by the relay and Receiver 1, M 1 , p 2 is contained in U 3 , a satellite of U 1 , and will be solely decoded by Receiver 1, and M 2 , p is contained in U 2 , a satellite of U 0 , and will be solely decoded by Receiver 2. Apart from decoding ( M 1 , c , M 2 , c ) and M 1 , p 1 , the relay also performs compress-forward to compress its observed symbol Y 3 as Y ^ 3 and sends the compression index back to the transmitter. The feedback message is sent by the transmitter in a cloud center V and will be decoded by both receivers. Each receiver decodes this compression message, reconstructs Y ^ 3 , and then, uses it as side information to assist the decoding of source message. See the details in Section 6. □
Remark 3.
Note that by exchanging the index “1” and “2” in (10), the corresponding rate region is still achievable. This new rate region can be achieved by a similar scheme presented in Section 6, with simply exchanging the indices of Receiver 1 and Receiver 2. The union of both regions provides a potentially larger achievable rate region.
Our scheme can strictly enlarge Behboodi and Piantanida’s rate regions in [16]. This can be seen by the following example.
Example 1.
Consider a special case when R 2 = 0 . In this case, the four-node RBC is equivalent to the classical three-node relay channel, where Receiver 2 can be ignored since it does not decode or send anything. Now, consider the Gaussian RBC with perfect feedback from the relay to the transmitter. The channel outputs are:
Y 3 = g 1 X + Z 3 , Y 1 = g 2 X + g 3 X 3 + Z 2 ,
where g 1 , g 2 , and g 3 are channel gains, E | X 2 | P and E | X 3 2 | P r , and Z 1 N ( 0 , 1 ) and Z 2 N ( 0 , 1 ) are independent Gaussian noises.
For this channel, it can be easily checked that Behboodi and Piantanida’s scheme in [16] reduces to either the decode-forward or compress-forward relay strategy. In (10), by setting U 1 , U 2 to be constant, V 0 = U , V = X 3 , and U 3 = X , our achievable rate region in Theorem 3 turns out to be:
R 1 min { I ( X , X 3 ; Y 1 ) I ( Y ^ 3 ; Y 3 | U , X , X 3 , Y 1 ) , I ( U ; Y 3 | X 3 ) + I ( X ; Y ^ 3 , Y 1 | U , X 3 ) } .
In our previous paper [11], we showed that when P = 5 , P r = 1 , g 1 = 1 / d , g 2 = 1 , and g 3 = 1 / | 1 d | , for d = 0.73 , 0.74 , 0.75 , 0.76 , the rate (11) is strictly larger than the rate achieved by the decode-forward and compress-forward relay strategies.
In [14], it was shown that for Type-I PDRBC with feedback from the users to the relay and transmitter, feedback cannot enlarge the capacity region. We obtain similar results for Type-II and Type-III PDRBCs as follows:
Theorem 4.
For Type-II PDRBC and Type-III PDRBC with feedback from the relay and users to the transmitter, the capacity regions C Fb are exactly the same as those without feedback, which means that feedback cannot enlarge the capacity regions for these types of RBCs.
Proof. 
The achievable rate regions are the same as the rate regions of the non-feedback case. The converse proof is given in Section 8. □

6. Coding Schemes for RBC with Feedback

We present a scheme based on block-Markov coding [22] that consists of B + 1 blocks, where messages M 1 , b [ 1 : 2 n R 1 ] and M 2 , b [ 1 : 2 n R 2 ] , for b [ 1 : B ] , are sent to the receivers over B + 1 blocks. Split message M 1 , b into ( M 1 , c , b , M 1 , p 1 , b , M 1 , p 2 , b ) , where M 1 , c , b [ 1 : 2 n R 1 , c ] and M 1 , p i , b [ 1 : 2 n R 1 , p i ] , for i = 1 , 2 , are independent of each other. Split message M 2 , b into ( M 2 , c , b , M 2 , p , b ) , where M 2 , c , b [ 1 : 2 n R 2 , c ] and M 2 , p , b [ 1 : 2 n R 2 , p ] , are independent of each other. Define:
M c , b ( M 1 , c , b , M 2 , c , b ) , R c R 1 , c + R 2 , c .
Let messages M 1 , B + 1 = M 2 , B + 1 = 1 , and assume ( M 1 , B + 1 , M 2 , B + 1 ) are known by the relay and receivers before communication. Note that the transmission takes place over B + 1 blocks, and the messages ( M 1 , B + 1 , M 2 , B + 1 ) are deterministic; thus, the transmission rates of messages M 1 and M 2 are in fact equal to R 1 B B + 1 and R 2 B B + 1 , respectively. In the limit n and B , R 1 and R 2 approach these transmission rates. Therefore, we neglect this technicality in the following.

6.1. Codebook

Fix the pmf p V U 0 U 1 U 2 U 3 ( v , u 0 , u 1 , u 2 , u 3 ) P Y ^ 3 | Y 3 U 0 ( y ^ 3 | y 3 , u 0 ) and a function x = f ( v , u 0 , u 1 , u 2 , u 3 ) , where V is an auxiliary random variable (RV) in a cloud center and plays two roles: building dependence between the transmitter’s and relay’s sending symbols and containing the feedback message and the common part of the source message of previous block M c , b 1 ; U 0 represents the satellite of V that contains M c , b and will be decoded by the relay and two receivers; U 1 represents the satellite of U 0 that contains sub-message M 1 , p 1 , b to be decoded by the relay and Receiver 1; U 2 represents the satellite of U 0 that contains sub-message M 2 , p , b to be solely decoded by Receiver 2; U 3 represents the satellite of U 1 that contains sub-message M 1 , p 2 , b to be solely decoded by Receiver 1; Y ^ 3 represents the satellite of V containing the compression version of the relay’s observed symbol Y 3 . Here, RVs ( V , U 0 , U 1 , U 2 , U 3 ) are related to the transmitter’s encoding and ( V , Y ^ 3 ) are related to the the relay’s encoding.
For each block b [ 1 : B + 1 ] , randomly and independently generate 2 n ( R c + R ^ 3 ) sequences v b n ( m c , b 1 , l b 1 ) i = 1 n p V ( v b , i ) , with l b 1 [ 1 : 2 n R ^ 3 ] . For each ( m c , b 1 , l b 1 ) , randomly and independently generate 2 n R c sequences u 0 , b n ( m c , b | m c , b 1 , l b 1 ) i = 1 n p U 0 | V ( u 0 , b , i | v b , i ) . For each ( m c , b 1 , l b 1 ) , randomly and independently generate 2 n ( R 1 , p 1 + R ^ 1 ) sequences x 3 , b n ( m 1 , p 1 , b 1 , j 1 , b 1 | m c , b 1 , l b 1 ) i = 1 n p X 3 | V ( x 3 , b , i | v b , i ) , with j 1 , b 1 [ 1 : 2 n R ^ 1 ] . For each ( m c , b , m c , b 1 , l b 1 ) , randomly and independently generate 2 n ( R 1 , p 1 + R ^ 1 ) sequences u 1 , b n ( m 1 , p 1 , b , j 1 , b | m c , b , m c , b 1 , l b 1 ) i = 1 n p U 1 | V U 0 ( u 1 , b , i | u 0 , b , i , v b , i ) . For each ( m c , b , m c , b 1 , l b 1 ) , randomly and independently generate 2 n ( R 2 , p + R ^ 2 ) sequences u 2 , b n ( m 2 , p , b , j 2 , b | m c , b , m c , b 1 , l b 1 ) i = 1 n p U 2 | V U 0 ( u 2 , b , i | u 0 , b , i , v b , i ) , with j 2 , b [ 1 : 2 n R ^ 2 ] . For each ( m 1 , p 1 , b , m 1 , p 1 , b 1 , j 1 , b , m c , b , m c , b 1 , l b 1 ) , randomly and independently generate 2 n ( R 1 , p 2 + R ^ ^ 1 ) sequences u 3 , b n ( m 1 , p 2 , b , j 3 , b | m 1 , p 1 , b , m 1 , p 1 , b 1 , j 1 , b , m c , b , m c , b 1 , l b 1 ) i = 1 n p U 3 | U 0 U 1 V X 3 ( u 3 , b , i | u 0 , b , i , u 1 , b , i , v b , i , x 3 , b , i ) , with j 3 , b [ 1 : 2 n R ^ ^ 1 ] . For each ( m c , b 1 , l b 1 ) , randomly and independently generate 2 n R ^ 3 sequences y ^ 3 , b n ( l b | m c , b 1 , l b 1 ) i = 1 n p Y ^ 3 | V ( y ^ 3 , b , i | v b , i ) .

6.2. Transmitter’s Encoding

The transmitter performs a layered Marton’s coding. More specifically, in each block b [ 1 : B + 1 ] , the transmitter looks for a message j 1 , b 1 such that:
( u 0 , b n , v b n , x 3 , b n ) T ϵ n ( p ( u 0 , v , x 3 ) ) .
Then, it looks for a pair of message ( j 1 , b , j 2 , b ) such that:
( u 0 , b n , u 1 , b n , u 2 , b n , v b n , x 3 , b n ) T ϵ n ( p ( u 0 , u 1 , u 2 , v , x 3 ) ) .
By the covering lemma [22], ( j 1 , b 1 , j 1 , b , j 2 , b ) can be found with high probability if:
R ^ 1 I ( U 0 ; X 3 | V ) + δ ( ϵ ) ,
R ^ 2 I ( U 2 ; X 3 | U 0 , V ) + δ ( ϵ ) ,
R ^ 1 + R 2 I ( U 2 ; U 1 , X 3 | U 0 , V ) + δ ( ϵ ) .
In the next step, the transmitter looks for j 3 , b such that:
( u 0 , b n , u 1 , b n , u 2 , b n , u 3 , b n , x 3 , b n , v b n ) T ϵ n ( p ( u 0 , u 1 , u 2 , x 3 , v ) ) .
By the covering lemma [22], j 3 , b 1 can be found with high probability if:
R ^ ^ 1 I ( U 3 ; U 2 | U 0 , U 1 , X 3 , V ) + δ ( ϵ ) .
Finally, the transmitter sends the channel input x b n = f ( v n , u 0 n , u 1 , b n , u 2 , b n , u 3 , b n ) .

6.3. Relay’s Encoding

The relay performs a hybrid strategy combining partial decode-forward and compress-forward. More specifically, in each block b [ 1 : B + 1 ] , the relay first looks for a tuple of messages ( m ^ c , b ( 3 ) , m ^ 1 , p 1 , b ( 3 ) , j 1 , b ( 3 ) ) such that:
( u 0 , b n ( m ^ c , b ( 3 ) | m c , b 1 , l b 1 ) , u 1 , b n ( m ^ 1 , p 1 , b ( 3 ) , j 1 , b ( 3 ) | m ^ c , b ( 3 ) , m c , b 1 , l b 1 ) , v b n ( m c , b 1 , l b 1 ) , x 3 , b n ( m 1 , p 1 , b 1 , j 1 , b 1 | m c , b 1 , l b 1 ) , y 3 , b n ) T ϵ n ( p ( u 0 , u 1 , v , x 3 , y 3 ) ) .
Notice that l b 1 is the message generated by the relay (which can be seen soon) and thus is already known; m c , b 1 and j 1 , b 1 can be obtained from the decoding of the previous block. By the packing lemma [22], the decoding is successful with high probability if:
R 1 , p 1 + R ^ 1 I ( U 1 ; Y 3 | U 0 , V , X 3 ) δ ( ϵ ) ,
R c + R 1 , p 1 + R ^ 1 I ( U 0 ; X 3 , Y 3 | V ) + I ( U 1 ; Y 3 | U 0 , V , X 3 ) δ ( ϵ ) .
Then, it compresses y 3 , b n by looking for l b such that:
v b n , y 3 , b n , y ^ 3 , b n T ϵ n ( p ( v , y 3 , y ^ 3 ) ) .
By the covering lemma, it is successful with high probability if:
R ^ 3 I ( Y ^ 3 ; Y 3 | V ) + δ ( ϵ ) .
A the end of block b, the relay forwards l b to the transmitter through the feedback link. If the feedback link’s capacity is sufficiently large such the capacity is larger than the rate of l b , then l b can be perfectly known by the transmitter.
After decoding ( m c , b , l b , m 1 , p 1 , b , j 1 , b ) , the relay sends x 3 , b + 1 n ( m 1 , p 1 , b , j 1 , b | m c , b , l b ) in block b + 1 .

6.4. Decoding

Receiver 2 applies backward decoding to decode ( v b n , u 0 , b n , u 2 , b n , y ^ 3 , b n ) , for b [ 1 : B ] . Specifically, after ( B + 1 ) -block transmission, assuming Receiver 2 has already successfully decoded ( m c , b , l b ) based on y 2 , b + 1 n , it looks for ( m ^ c , b 1 ( 2 ) , l ^ b 1 ( 2 ) , m ^ 2 , p , b , j ^ 2 , b ) such that:
( v b n ( m ^ c , b 1 ( 2 ) , l ^ b 1 ( 2 ) ) , u 0 , b n ( m c , b | m ^ c , b 1 ( 2 ) , l ^ b 1 ( 2 ) ) , u 2 , b n ( m ^ 2 , p , b , j ^ 2 , b | m c , b , m ^ c , b 1 ( 2 ) l ^ b 1 ( 2 ) ) , y ^ 3 , b n ( l b | m ^ c , b 1 ( 2 ) , l ^ b 1 ( 2 ) ) , y 2 , b n ) T ϵ n ( p ( v , u 0 , u 2 , y ^ 3 , y 2 ) ) .
By the packing lemma and the induction on backward decoding, the decoding is successful with high probability if:
R 2 , p + R ^ 2 I ( U 2 ; Y ^ 3 , Y 2 | U 0 , V ) δ ( ϵ ) ,
R c + R ^ 3 + R 2 , p + R ^ 2 I ( U 0 , U 2 , V ; Y 2 ) + I ( Y ^ 3 ; U 0 , U 2 , Y 2 | V ) δ ( ϵ ) .
Receiver 1 applies backward decoding to decode ( v b n , u 0 , b n , u 1 , b n , u 3 , b n , y ^ 3 , b n ) , for b [ 1 : B + 1 ] . More specifically, after ( B + 1 ) -block transmission, assuming Receiver 1 has already successfully decoded ( m c , b , l b ) based on y 1 , b + 1 n , it first looks for a tuple of messages ( m ^ c , b 1 ( 1 ) , l ^ b 1 ( 1 ) , m ^ 1 , p 1 , b ( 1 ) , j ^ 1 , b ( 1 ) ) such that:
( v b n ( m ^ c , b 1 ( 1 ) , l ^ b 1 ( 1 ) ) , u 0 , b n ( m c , b | m ^ c , b 1 ( 1 ) , l ^ b 1 ( 1 ) ) , u 1 , b n ( m ^ 1 , p 1 , b ( 1 ) , j ^ 1 , b ( 1 ) | m c , b , m ^ c , b 1 ( 1 ) , l ^ b 1 ( 1 ) ) , x ^ 3 , b n ( m ^ c , b 1 ( 1 ) , l ^ b 1 ( 1 ) ) , y ^ 3 , b n ( l b | m ^ c , b 1 ( 1 ) , l ^ b 1 ( 1 ) ) , y 2 , b n ) T ϵ n ( p ( v , u 0 , u 1 , x 3 , y ^ 3 , y 1 ) ) .
By the packing lemma and the induction on backward decoding, the decoding is successful with high probability if:
R 1 , p 1 + R ^ 1 I ( X 3 ; Y ^ 3 , Y 1 , U 0 | V ) + I ( U 1 ; Y ^ 3 , Y 1 | U 0 , V , X 3 ) δ ( ϵ ) , R c + R ^ 3 + R 1 , p 1 + R ^ 1 I ( U 0 , V ; Y 1 ) + I ( X 3 ; Y 1 , U 0 | V ) + I ( U 1 ; Y 1 | U 0 , V , X 3 ) ,
+ I ( Y ^ 3 ; U 0 , U 1 , X 3 , Y 1 | V ) δ ( ϵ ) .
After successfully decoding ( m c , b 1 , l b 1 , m 1 , p 1 , b , j 1 , b ) , Receiver 1 continues decoding u 3 , b n by looking for ( m ^ 1 , p 2 , b , j ^ 3 , b ) such that:
( u 3 , b n ( m ^ 1 , p 2 , b , j ^ 3 , b | m 1 , p 1 , b , m 1 , p 1 , b 1 , j 1 , b , m c , b , m c , b 1 , l b 1 ) , v b n , u 0 , b n , u 1 , b n , x 3 , b n , y ^ 3 , b n , y 1 , b n ) T ϵ n ( p ( v , u 0 , u 1 , u 3 , x 3 , y ^ 3 , y 1 ) ) .
By the packing lemma and the induction on backward decoding, the decoding is successful with high probability if:
R 1 , p 2 + R ^ ^ 1 I ( U 3 ; Y 1 , Y ^ 3 | U 0 , U 1 , V , X 3 ) δ ( ϵ ) .
Using Fourier–Motzkin elimination [22] to eliminate R 1 , p 1 , R 1 , p 2 , R 2 , p , R c , R ^ 1 , R ^ 2 , R ^ 3 , and R ^ ^ 1 and since δ ( ϵ ) tends to zero when n goes to , we obtain the inner bound in Theorem 3.

7. Outer Bounds for PDRBC with Feedback

In this section, we present outer bounds for the three types of PDRBC with feedback. Note that these outer bounds are also valid for cases without feedback.

7.1. Outer Bound for Type-I PDRBC with Feedback

Define:
U i = ( M 2 , Y 1 i 1 , Y 2 i 1 ) , V i = ( Y 1 i 1 , Y 2 i 1 ) .
Introduce a time-sharing random variable Q that is uniformly distributed over [ 1 : n ] and independent of ( M 1 , M 2 , U n , V n , X n , X 3 n , Y 1 n , Y 2 n , Y 3 n ) .
By Fano’s inequality, we have:
n R 1 I ( M 1 ; Y 1 n , Y 2 n | M 2 ) + n ϵ n = ( a ) i = 1 n I ( M 1 , Y 1 i 1 , Y 2 i 1 ; Y 1 , i , Y 2 , i | U i , V i ) + n ϵ n ( b ) i = 1 n I ( X i , X 3 , i , M 1 ; Y 1 , i , Y 2 , i | U i , V i ) + n ϵ n = ( c ) i = 1 n I ( X i , X 3 , i ; Y 1 , i , Y 2 , i | U i , V i ) + n ϵ n = i = 1 n I ( X i , X 3 , i ; Y 1 , i , Y 2 , i | U i , V i , Q = i ) + n ϵ n = n I ( X Q , X 3 , Q ; Y 1 , Q , Y 2 , Q | U Q , V Q , Q ) + n ϵ n ,
where ϵ n is a positive value that tends to zero as n by Fano’s inequality; (a) holds by the definition of U i , V i ; (b) follows because X i is a function of ( M 1 , M 2 , Y 1 i 1 , Y 2 i 1 , Y 3 i 1 ) ; (c) follows from Markov chain ( U i , V i , M 1 ) ( X i , X 3 , i ) ( Y 1 , i , Y 2 , i ) . Here, the auxiliary random variable Q is not part of the channel variables and represents a convex combination of all rate points obtained in the absence of Q.
Similarly,
n ( R 1 + R 2 ) I ( M 1 , M 2 ; Y 1 n , Y 2 n , Y 3 n ) + n ϵ n = ( a ) i = 1 n I ( M 1 , M 2 ; Y 1 , i , Y 2 , i , Y 3 , i | V i , Y 3 i 1 ) + n ϵ n = ( b ) H ( Y 1 , i , Y 2 , i , Y 3 , i | V i , X 3 , i , Y 3 i 1 ) H ( Y 1 , i , Y 2 , i , Y 3 , i | X i , X 3 , i , V i ) + n ϵ n i = 1 n I ( X i ; Y 1 , i , Y 2 , i , Y 3 , i | X 3 , i , V i ) + n ϵ n = ( c ) i = 1 n I ( X i ; Y 3 , i | X 3 , i , V i ) + n ϵ n = n I ( X Q ; Y 3 , Q | X 3 , Q , V Q , Q ) + n ϵ n ,
where (a) follows by the definition of V i ; (b) holds because X 3 , i is a function of Y 3 i 1 , X i is a function of ( M 1 , M 2 , Y 1 i 1 , Y 2 i 1 , Y 3 i 1 ) , and ( M 1 , M 2 , V i , Y 3 i 1 ) ( X i , X 3 , i ) ( Y 1 , i , Y 2 , i , Y 3 , i ) forms a Markov chain; (c) follows from the property of Type-I PDRBC, which has Markov chain X i ( X 3 , i , Y 3 , i , V i ) ( Y 1 , i , Y 2 , i ) .
In addition,
n R 2 I ( M 2 ; Y 2 n ) + n ϵ n = i = 1 n I ( M 2 ; Y 2 , i | Y 2 i 1 ) + n ϵ n i = 1 n I ( M 2 , Y 2 i 1 ; Y 2 , i ) + n ϵ n i = 1 n I ( M 2 , Y 2 i 1 , Y 1 i 1 ; Y 2 , i ) + n ϵ n = i = 1 n I ( U i , V i ; Y 2 , i ) + n ϵ n = n I ( U Q , V Q ; Y 2 , Q | Q ) + n ϵ n n I ( U Q , V Q , Q ; Y 2 , Q ) + n ϵ n .
Furthermore,
n R 1 I ( M 1 ; Y 1 n , Y 2 n , Y 3 n | M 2 ) + n ϵ n = ( a ) i = 1 n I ( X i , M 1 ; Y 1 , i , Y 2 , i , Y 3 , i | U i , V i , X 3 , i , Y 3 i 1 ) + n ϵ n i = 1 n I ( X i ; Y 1 , i , Y 2 , i , Y 3 , i | U i , V i , X 3 , i ) + n ϵ n = ( b ) i = 1 n I ( X i ; Y 3 , i | U i , V i , X 3 , i ) + n ϵ n = n I ( X Q ; Y 3 , Q | U Q , V Q , X 3 , Q , Q ) + n ϵ n ,
where (a) holds by the definition of ( U i , V i ) and since X 3 , i is a function of Y 3 i 1 ; (b) holds due to the property of Type-I PDRBC, which has Markov chain X i ( U i , V i , X 3 , i , Y 3 , i ) ( Y 1 , i , Y 2 , i ) .
Define U = ( Q , U Q ) , V = ( Q , V Q ) , X = X Q , X 3 = X 3 Q , Y 1 = Y 1 Q , Y 2 = Y 2 Q and Y 3 = Y 3 Q . By the definition of ( U i , V i ) in (20), we have V = ( Q , V Q ) = ( Q , Y 1 Q 1 , Y 2 Q 1 ) and U = ( Q , U Q ) = ( Q , M 2 , Y 1 Q 1 , Y 2 Q 1 ) , and thus:
H ( V | U ) = H ( Q , Y 1 Q 1 , Y 2 Q 1 | Q , M 2 , Y 1 Q 1 , Y 2 Q 1 ) = 0 ,
and Markov chains X 3 U V and V ( X 3 , U ) X hold, leading to pmf p ( u , v ) p ( x 3 | u , v ) p ( x | x 3 , u ) for this outer bound.
By Fano’s inequality [22], we know that ϵ n tends to zero as n . Combining (22)–(24), we obtain an outer bound as shown in Theorem 6.

7.2. Outer Bound for Type-II PDRBC with Feedback

Define:
U i = ( M 2 , Y 1 i 1 , Y 2 i 1 , Y 3 i 1 ) .
Introduce a time-sharing random variable Q that is uniformly distributed over [ 1 : n ] and independent of ( M 1 , M 2 , U n , X n , X 3 n , Y 1 n , Y 2 n , Y 3 n ) .
By Fano’s inequality, we have:
n R 1 I ( M 1 ; Y 1 n , Y 2 n , Y 3 n | M 2 ) + n ϵ n = ( a ) i = 1 n I ( X i , M 1 ; Y 1 , i , Y 2 , i , Y 3 , i | U i , X 3 , i ) + n ϵ n = ( b ) i = 1 n I ( X i ; Y 1 , i , Y 2 , i , Y 3 , i | U i , X 3 , i ) + n ϵ n = ( c ) i = 1 n I ( X i ; Y 1 , i | U i , X 3 , i ) + n ϵ n = n I ( X Q ; Y 1 , Q | U Q , X 3 , Q , Q ) + n ϵ n ,
where (a) holds because X 3 , i is a function of Y 3 i 1 and X i is a function of ( M 1 , M 2 , Y 1 i 1 , Y 2 i 1 , Y 3 i 1 ) ; (b) follows from the Markov chain M 1 ( U i , X i , X 3 , i ) ( Y 1 , i , Y 2 , i , Y 3 , i ) ; (c) holds due to the property of Type-II PDRBC, which has Markov chain X i ( U i , X 3 , i , Y 1 , i ) ( Y 2 , i , Y 3 , i ) .
In addition,
R 2 I ( M 2 ; Y 2 n ) + n ϵ n = i = 1 n I ( M 2 ; Y 2 , i | Y 2 i 1 ) + n ϵ n i = 1 n I ( M 2 , Y 1 i 1 , Y 2 i 1 , Y 3 i 1 ; Y 2 , i ) + n ϵ n = i = 1 n I ( U i , X 3 , i ; Y 2 , i ) + n ϵ n = n I ( U Q , X 3 , Q ; Y 2 , Q | Q ) + n ϵ n n I ( U Q , X 3 , Q , Q ; Y 2 , Q ) + n ϵ n .
Furthermore,
n R 2 I ( M 2 ; Y 2 n , Y 3 n ) + n ϵ n = ( a ) i = 1 n I ( M 2 ; Y 2 , i , Y 3 , i | Y 2 i 1 , Y 3 i 1 , X 3 , i ) + n ϵ n i = 1 n I ( M 2 , Y 1 i 1 , Y 2 i 1 , Y 3 i 1 ; Y 2 , i , Y 3 , i | X 3 , i ) + n ϵ n = ( b ) i = 1 n I ( U i ; Y 2 , i , Y 3 , i | X 3 , i ) + n ϵ n = ( c ) i = 1 n I ( U i ; Y 3 , i | X 3 , i ) + n ϵ n = n I ( U Q ; Y 3 , Q | X 3 , Q , Q ) + n ϵ n n I ( U Q , Q ; Y 3 , Q | X 3 , Q ) + n ϵ n ,
where (a) holds since X 3 , i is a function of Y 3 i 1 ; (b) holds by the definition of U i ; (c) holds due to the property of Type-II PDRBC, which has Markov chain U i ( X 3 , i , Y 3 , i ) Y 2 , i . Here, the auxiliary random variable Q is not part of the channel variables and represents a convex combination of all rate points obtained in the absence of Q.
Define U = ( Q , U Q ) , X = X Q , X 3 = X 3 Q , Y 1 = Y 1 Q , Y 2 = Y 2 Q , and Y 3 = ( Q , Y 3 Q ) . By the definition of U i in (25), we have U = ( Q , U Q ) = ( Q , M 2 , Y 1 Q 1 , Y 2 Q 1 , Y 3 Q 1 ) , and since X 3 = X 3 , Q is a function of Y 3 Q 1 , we have Markov chain X 3 U X , leading to pmf p ( u , x 3 ) p ( x | u ) for this outer bound.
By Fano’s inequality [22], ϵ n tends to zero as n . Combining (26)–(28), we obtain an outer bound the same as the inner bound of Theorem 1.

7.3. Outer Bound for Type-III PDRBC with Feedback

Define:
U i = ( M 2 , Y 2 i 1 , Y 3 i 1 ) .
Introduce a time-sharing random variable Q that is uniformly distributed over [ 1 : n ] and independent of ( M 1 , M 2 , X n , X 3 n , Y 1 n , Y 2 n , Y 3 n ) .
By Fano’s inequality, we have:
n R 1 I ( M 1 ; Y 1 n ) + n ϵ n = ( a ) i = 1 n I ( X i , M 1 ; Y 1 , i , Y 2 , i , Y 3 , i | U i , X 3 , i ) + n ϵ n = ( b ) i = 1 n I ( X i ; Y 1 , i , Y 2 , i , Y 3 , i | U i , X 3 , i ) + n ϵ n = ( c ) i = 1 n I ( X i ; Y 1 , i | U i , X 3 , i ) + n ϵ n = n I ( X Q ; Y 1 , Q | U Q , X 3 , Q , Q ) + n ϵ n ,
where (a) holds since X 3 , i is a function of Y 3 i 1 and X i is a function of ( M 1 , M 2 , Y 1 i 1 , Y 2 i 1 , Y 3 i 1 ) ; (b) follows from the Markov chain M 1 ( U i , X i , X 3 , i ) ( Y 1 , i , Y 2 , i , Y 3 , i ) ; (c) holds due to the property of Type-III PDRBC, which has Markov chain X i ( U i , X 3 , i , Y 1 , i ) ( Y 2 , i , Y 3 , i ) .
Furthermore,
n R 2 I ( M 2 ; Y 2 n , Y 3 n ) + n ϵ n = I ( M 2 ; Y 2 , i , Y 3 , i | Y 2 i 1 , Y 3 i 1 ) + n ϵ n = I ( M 2 ; Y 2 , i , Y 3 , i | Y 2 i 1 , Y 3 i 1 , X 3 , i ) + n ϵ n ( a ) I ( U i ; Y 2 , i , Y 3 , i | X 3 , i ) + n ϵ n = ( b ) I ( U i ; Y 2 , i | X 3 , i ) + n ϵ n I ( U Q , Q ; Y 2 , Q | X 3 , Q ) + n ϵ n ,
where (a) holds by the definition of U i ; (b) holds due to the property of Type-III PDRBC, which has Markov chain U i ( X 3 , i , Y 2 , i ) Y 3 , i . Here, the auxiliary random variable Q is not part of the channel variables and represents a convex combination of all rate points obtained in the absence of Q.
Define U = ( Q , U Q ) , X = X Q , X 3 = X 3 Q , Y 1 = Y 1 Q , Y 2 = Y 2 Q , and Y 3 = ( Q , Y 3 Q ) . By the definition of U i in (29), we have U = ( Q , U Q ) = ( Q , M 2 , Y 2 Q 1 , Y 3 Q 1 ) , and since X 3 = X 3 , Q is a function of Y 3 Q 1 , we have Markov chain X 3 U X , leading to pmf p ( u , x 3 ) p ( x | u ) for this outer bound.
By Fano’s inequality [22], ϵ n tends to zero as n . Combing (31) and (30), we obtain the outer bound as below.
R 2 I ( U ; Y 2 | X 3 ) = x 3 X 3 I ( U ; Y 2 | X 3 = x 3 ) , R 1 I ( X ; Y 1 | U , X 3 ) = x 3 X 3 I ( X ; Y 1 | U , X 3 = x 3 ) ,
for some pmf p ( u , x 3 ) p ( x | u ) . Note that I ( U ; Y 2 | X 3 = x 3 ) and I ( X ; Y 1 | U , X 3 = x 3 ) both are linear functions of p ( x , u ) , and since X 3 is constant, the boundary points on the outer bound:
x 3 X 3 I ( U ; Y 2 | X 3 = x 3 ) + I ( X ; Y 1 | U , X 3 = x 3 )
are maximized at an extreme point. Thus, the corresponding outer bound can be characterized as:
R 2 I ( U ; Y 2 | X 3 ) = I ( U ; Y 2 | X 3 = x 3 ) , R 1 I ( X ; Y 1 | U , X 3 ) = I ( X ; Y 1 | U , X 3 = x 3 ) ,
for some value x 3 X 3 and pmf p ( x , u ) , which completes the converse.

8. Proof of Theorem 2

A rigorous proof that the inner bounds in Equation (1) and Theorem 1 both hold for the Gaussian PDRBC is omitted for brevity. In the following subsections, we will first prove the achievability of rate region (8) and (9) and then show that these inner bounds are tight.

8.1. Capacity Region on Type-II Gaussian PDRBC

(1)
Proof of the achievability:
Let:
U = ρ 1 X 3 + W 1 , X = ρ 2 U + W 2 ,
where ( X 3 , W 1 , W 2 ) are independent of each other and X 3 N ( 0 , P r ) , ρ 2 W 1 N ( 0 , ( β α ) P ) , ρ 2 U N ( 0 , α ¯ P ) , and W 2 N ( 0 , α P ) , with 0 ρ 1 , ρ 2 , α , β 1 , and β α . With the choice above, we obtain:
R 2 I ( U , X 3 ; Y 2 ) = C α ¯ P + P r α P + σ 2 2 , R 2 I ( U ; Y 3 | X 3 ) = C ( β α ) P α P + σ 3 2 , R 1 I ( X ; Y 1 | U , X 3 ) = C α P σ 1 2 ,
where 0 ρ 1 , ρ 2 , α , β 1 , and β α .
(2)
Proof of the converse:
Consider:
I ( U ; Y 3 | X 3 ) = h ( Y 3 | X 3 ) h ( Y 3 | X 3 , U ) ,
since:
1 2 log 2 π e σ 3 2 = h ( Z 3 ) h ( Y 3 | X 3 ) h ( X + Z 3 ) 1 2 log 2 π e ( P + σ 3 2 ) ,
there must exist a β [ 0 , 1 ] such that:
h ( Y 3 | X 3 ) = 1 2 log 2 π e ( β P + σ 3 2 ) .
Similarly, since:
1 2 log 2 π e σ 3 2 = h ( Z 3 ) h ( Y 3 | U , X 3 ) h ( Y 3 | X 3 ) = 1 2 log 2 π e ( β P + σ 3 2 ) ,
there must exist an α [ 0 , β ] such that:
h ( Y 3 | U , X 3 ) = 1 2 log 2 π e ( α P + σ 3 2 ) .
Thus,
R 2 I ( U ; Y 3 | X 3 ) = C ( β α ) P α P + σ 3 2 .
Next, consider:
I ( U , X 3 ; Y 2 ) = h ( Y 2 ) h ( Y 2 | U , X 3 ) 1 2 log 2 π e ( P + P r + σ 2 2 ) h ( Y 2 | U , X 3 ) .
By (32) and the conditional EPI in [22], we have:
h ( Y 2 | U , X 3 ) = h ( Y 3 + Z ˜ b | U , X 3 ) 1 2 log 2 2 h ( Y 3 | U , X 3 ) + 2 2 h ( Z ˜ b | U , X 3 ) = 1 2 log 2 π e ( α P + σ 3 2 ) + 2 π e ( σ 2 2 σ 3 2 ) = 1 2 log 2 π e ( α P + σ 2 2 ) .
Thus,
R 2 I ( U , X 3 ; Y 2 ) C α ¯ P + P r α P + σ 2 2 .
Now, consider:
I ( X ; Y 1 | U , X 3 ) = h ( Y 1 | U , X 3 ) h ( Z 1 ) = h ( Y 1 | U , X 3 ) 1 2 log 2 π σ 1 2 ,
since:
h ( Y 3 | U , X 3 ) = h ( Y 1 + Z ^ b | U , X 3 ) 1 2 log 2 2 h ( Y 1 | U , X 3 ) + 2 2 h ( Z ^ b | U , X 3 ) = 1 2 log 2 2 h ( Y 1 | U , X 3 ) + 2 π e ( σ 3 2 σ 1 2 ) .
Combining (32) with (33), we obtain:
2 π e ( α P + σ 3 2 ) 2 2 h ( Y 1 | U , X 3 ) + 2 π e ( σ 3 2 σ 1 2 ) .
Thus,
h ( Y 1 | U , X 3 ) 1 2 log 2 π e ( α P + σ 1 2 ) ,
which implies:
R 1 I ( X ; Y 1 | U , X 3 ) C α P σ 1 2 .
This completes the proof of the converse.

8.2. Capacity Region on Type-III Gaussian PDRBC

(1)
Proof of the achievability:
The achievability follows by the traditional superposition coding and by shutting down the relay, i.e., set:
X = U + V ,
where U N ( 0 , α ¯ P ) and V N ( 0 , α P ) are independent of each other. With this choice, it is easy to obtain the rate region in (8).
(2)
Proof of the converse
Consider:
I ( U ; Y 2 | X 3 ) = h ( Y 2 | X 3 ) h ( Y 2 | U , X 3 ) 1 2 log 2 π e ( P + P r + σ 2 2 ) h ( Y 2 | U , X 3 ) .
Since:
1 2 log 2 π e σ 2 2 = h ( Z 2 ) h ( Y 2 | U , X 3 ) h ( Y 2 | X 3 ) 1 2 log 2 π e ( P + σ 2 2 ) ,
there must exist an α [ 0 , 1 ] such that:
h ( Y 2 | U , X 3 ) = 1 2 log 2 π e ( α P + σ 2 2 ) .
Thus:
R 2 I ( U ; Y 2 | X 3 ) C α ¯ P α P + σ 2 2 .
Next, consider:
I ( X ; Y 1 | U , X 3 ) = h ( Y 1 | U , X 3 ) h ( Y 1 | X , X 3 ) = h ( Y 1 | U , X 3 ) 1 2 log ( 2 π e σ 1 2 ) .
Using the conditional EPI, we obtain:
h ( Y 2 | U , X 3 ) = h ( Y 1 + Z ^ c | U , X 3 ) . 1 2 log 2 2 h ( Y 1 | U , X 3 ) + 2 2 h ( Z ^ c | U , X 3 ) = 1 2 log 2 2 h ( Y 1 | U , X 3 ) + 2 π e ( σ 2 2 σ 1 2 ) .
Combining (34) and (35), we have:
2 π e ( α P + σ 2 2 ) 2 2 h ( Y 1 | U , X 3 ) + 2 π e ( σ 2 2 σ 1 2 ) ,
which implies:
h ( Y 1 | U , X 3 ) 1 2 log 2 π e ( α P + σ 1 2 ) ,
and hence:
R 1 I ( X ; Y 1 | U , X 3 ) C α P σ 1 2 .
This completes the proof of the converse.

9. Conclusions

In this paper, we consider three types of PDRBCs that vary with different degradation orders among the relay and receiver’s observed signals. For the first type of DM-PDRBC, a new outer bound is established having the same rate expression as an existing inner bound, with only a slight difference in the input distributions; for the second type of Gaussian PDRBC, the capacity region is established; for the third type of PDRBC, the capacity regions are established both for DM and the Gaussian case. Furthermore, we propose a new scheme for the general RBC with feedback from the relay node to the transmitter. It is shown that our scheme can strictly enlarge Behboodi and Piantanida’s rate region, which achieves the capacity region of the second type of DM-PDRBC. Moreover, we show that capacity regions of the second and third types of PDRBCs are exactly the same as those without feedback, which means that feedback cannot enlarge capacity regions for these types of RBCs.

Author Contributions

Conceptualization, B.H. and Y.W.; methodology, Y.W.; validation, B.H., K.W., and Y.M.; formal analysis, B.H., K.W., and Y.M.; writing, original draft preparation, B.H. and K.W.; writing, review and editing, Y.W.; supervision, Y.W. All authors read and agreed to the published version of the manuscript.

Funding

This research was funded by NSFC (No. 61901267).

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Van Der Meulen, E.C. Three-terminal communication channels. Adv. Appl. Probab. 1971, 3, 120–154. [Google Scholar] [CrossRef]
  2. Cover, T.; Gamal, A.E. Capacity theorems for the relay channel. IEEE Trans. Inf. Theory 1979, 25, 572–584. [Google Scholar] [CrossRef] [Green Version]
  3. Liang, Y.; Veeravalli, V.V. Cooperative relay broadcast channels. IEEE Trans. Inf. Theory 2007, 53, 900–928. [Google Scholar] [CrossRef]
  4. Liang, Y.; Kramer, G. Rate regions for relay broadcast channels. IEEE Trans. Inf. Theory 2007, 53, 3517–3535. [Google Scholar] [CrossRef]
  5. Steinberg, Y. Instances of the relay-broadcast channel and cooperation strategies. In Proceedings of the 2015 IEEE International Symposium on Information Theory (ISIT), Hong Kong, China, 14–19 June 2015; pp. 2653–2657. [Google Scholar]
  6. Padidar, P.; Ho, P.H.; Ho, J. End-to-end distortion analysis of multicasting over orthogonal receive component decode-forward cooperative broadcast channels. In Proceedings of the 2016 IEEE Wireless Communications and Networking Conference, Doha, Qatar, 3–6 April 2016; pp. 1–6. [Google Scholar]
  7. Dikstein, L.; Permuter, H.H.; Steinberg, Y. On state-dependent degraded broadcast channels with cooperation. IEEE Trans. Inf. Theory 2016, 62, 2308–2323. [Google Scholar] [CrossRef]
  8. Dai, B.; Yu, L.; Ma, Z. Compress-and-forward strategy for the relay broadcast channel with confidential messages. In Proceedings of the 2016 IEEE International Conference on Communications Workshops (ICC), Kuala Lumpur, Malaysia, 23–27 May 2016; pp. 254–259. [Google Scholar]
  9. Khosravi-Farsani, R.; Akhbari, B.; Mirmohseni, M.; Aref, M.R. Cooperative relay-broadcast channels with causal channel state information. In Proceedings of the 2009 IEEE International Symposium on Information Theory, Seoul, Korea, 28 June–3 July 2009; pp. 1174–1178. [Google Scholar]
  10. Zaidi, A.; Vandendorpe, L. Rate regions for the partially-cooperative relay broadcast channel with non-causal side information. In Proceedings of the 2007 IEEE International Symposium on Information Theory, Nice, France, 24–29 June 2007; pp. 1246–1250. [Google Scholar]
  11. Wu, Y. Achievable rate regions for cooperative relay broadcast channels with rate-limited feedback. In Proceedings of the 2016 IEEE international symposium on information theory (ISIT), Barcelona, Spain, 10–15 July 2016; pp. 1660–1664. [Google Scholar]
  12. Dabora, R.; Servetto, S.D. Broadcast channels with cooperating decoders. IEEE Trans. Inf. Theory 2006, 52, 5438–5454. [Google Scholar] [CrossRef] [Green Version]
  13. Kramer, G.; Gastpar, M.; Gupta, P. Cooperative strategies and capacity theorems for relay networks. IEEE Trans. Inf. Theory 2005, 51, 3037–3063. [Google Scholar] [CrossRef]
  14. Bhaskaran, S.R. Gaussian degraded relay broadcast channel. IEEE Trans. Inf. Theory 2008, 54, 3699–3709. [Google Scholar] [CrossRef]
  15. Khosravi-Farsani, R.; Akhbari, B.; Aref, M.R. The capacity region of a class of Relay-Broadcast Channels and relay channels with three parallel unmatched subchannels. In Proceedings of the 2010 International Symposium On Information Theory & Its Applications, Taichung, Taiwan, 17–20 October 2010; pp. 818–823. [Google Scholar]
  16. Behboodi, A.; Piantanida, P. Cooperative strategies for simultaneous and broadcast relay channels. IEEE Trans. Inf. Theory 2012, 59, 1417–1443. [Google Scholar] [CrossRef]
  17. Chen, L. On rate region bounds of broadcast relay channels. In Proceedings of the 2010 44th Annual Conference on Information Sciences and Systems (CISS), Princeton, NJ, USA, 17–19 March 2010; pp. 1–6. [Google Scholar]
  18. Wan, H.; Chen, W.; Wang, X. Joint source and relay design for MIMO relaying broadcast channels. IEEE Commun. Lett. 2013, 17, 345–348. [Google Scholar] [CrossRef]
  19. Salehkalaibar, S.; Ghabeli, L.; Aref, M. An achievable rate region for a class of Broadcast-Relay Networks. In Proceedings of the 2010 IEEE Information Theory Workshop on Information Theory (ITW 2010, Cairo), Cairo, Egypt, 6–8 January 2010; pp. 1–5. [Google Scholar]
  20. Hakim, H.; Boujemaa, H.; Ajib, W. Single relay selection schemes for broadcast networks. IEEE Trans. Wirel. Commun. 2013, 12, 2646–2657. [Google Scholar] [CrossRef]
  21. He, C.; Yang, S.; Piantanida, P. An achievable rate region of broadcast relay channel with state feedback. In Proceedings of the 2015 IEEE International Conference on Communications (ICC), London, UK, 8–12 June 2015; pp. 4193–4198. [Google Scholar]
  22. El Gamal, A.; Kim, Y.H. Network Information Theory; Cambridge University Press: Cambridge, UK, 2011. [Google Scholar]
Figure 1. Relay broadcast channel.
Figure 1. Relay broadcast channel.
Entropy 22 00784 g001
Figure 2. Capacity regions of three types of Gaussian physically degraded relay broadcast channel (PDRBC) when P = 5 , P r = 10 , σ π ( 1 ) 2 = 1 , σ π ( 2 ) 2 = 2.5 , and σ π ( 3 ) 2 = 11 .
Figure 2. Capacity regions of three types of Gaussian physically degraded relay broadcast channel (PDRBC) when P = 5 , P r = 10 , σ π ( 1 ) 2 = 1 , σ π ( 2 ) 2 = 2.5 , and σ π ( 3 ) 2 = 11 .
Entropy 22 00784 g002

Share and Cite

MDPI and ACS Style

Hu, B.; Wang, K.; Ma, Y.; Wu, Y. On the Capacity Regions of Degraded Relay Broadcast Channels with and without Feedback. Entropy 2020, 22, 784. https://doi.org/10.3390/e22070784

AMA Style

Hu B, Wang K, Ma Y, Wu Y. On the Capacity Regions of Degraded Relay Broadcast Channels with and without Feedback. Entropy. 2020; 22(7):784. https://doi.org/10.3390/e22070784

Chicago/Turabian Style

Hu, Bingbing, Ke Wang, Yingying Ma, and Youlong Wu. 2020. "On the Capacity Regions of Degraded Relay Broadcast Channels with and without Feedback" Entropy 22, no. 7: 784. https://doi.org/10.3390/e22070784

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop