Capacity to within 3 bits for a class of Gaussian Interference Channels with a Cognitive Relay
The InterFerence Channel with a Cognitive Relay (IFC-CR) consists of a classical two-user interference channel in which the two independent messages are also non-causally known at a cognitive relay node. In this work a special class of IFC-CRs in which the sources do not create interference at the non-intended destinations is analyzed. This special model results in a channel with two non-interfering point-to-point channels whose transmission is aided by an in-band cognitive relay, which is thus referred to as the Parallel Channel with a Cognitive Relay (PC-CR). We determine the capacity of the PC-CR channel to within 3 bits/s/Hz for all channel parameters. In particular, we present several new outer bounds which we achieve to within a constant gap by proper selection of Gaussian input distributions in a simple rate-splitting and superposition coding-based inner bound. The inner and outer bounds are numerically evaluated to show that the actual gap can be far less than 3 bits/s/Hz.
The concepts of interference, cognition – or non-causal message knowledge at a subset of network nodes – and relaying have all been of great recent interest. While capacities of the interference, cognitive and relay channels remain open for the general discrete memoryless channel models, they are known for certain classes of channels, and known to within constant gaps for the Gaussian noise counterparts. In this work we focus on a particular channel model which illustrates the power of cognition and simultaneous relaying which we term the Parallel Channel with a Cognitive Relay (PC-CR), which encompasses several multi-user and cognitive/cooperative channel models, such as the Broadcast Channel (BC) and the Cognitive InterFerence Channel (CIFC).
The PC-CR is a sub-channel of the more general interference channel with a cognitive relay (IFC-CR). The IFC-CR consists of a classical two-user interference channel in which the two independent messages, each known at the corresponding source node, are also non-causally known at a third, in-band transmitter node, which we term the cognitive relay. This five-node channel generalizes a number of known channels including the BC, the IFC, and the CIFC. The PC-CR consists of an IFC-CR in which the two sources do not interfere at the non-intended destinations (see Fig. 1) thus resulting into two parallel point-to-point channels whose communication is aided by a single cognitive relay which knows both messages non-causally. As such, the emphasis is placed on the transmission strategy of the single cognitive relay: it may choose to help one source, the other, or both and it is this tradeoff that the PC-CR seeks to characterize.
Past Work. The PC-CR has not been explicitly considered aside from the authors’ previous work , where an outer bound for the general discrete memoryless IFC-CR was presented and then tightened for certain deterministic channels. We then demonstrated that this outer bound is capacity for the high-SNR linear deterministic approximation of the Gaussian PC-CR. In this work, we go beyond our previous work in  by considering the Gaussian PC-CR model for finite SNR.
More generally, as the PC-CR is a subset of the IFC-CR, the literature for the latter channel is of direct relevance. The IFC with a relay was first introduced in  and , where the message knowledge at the relay was obtained causally and non-causally, respectively. Here we focus on the non-causal version of the problem , also termed the “broadcast channel with cognitive relays” , and thus we omit the body of work related to the causal (i.e., non-cognitive) relay model. In , dirty-paper coding, beamforming and interference reduction techniques are combined in the derivation of an achievable rate region for the Gaussian single-input single-output (SISO) IFC-CR. In , the achievable region of  is further improved upon and a sum-rate outer bound based on the MIMO Gaussian C-IFC is proposed. In , an achievable rate region that contains all previously known regions is proposed.
Contributions and Paper Organization. In this work we study the Gaussian PC-CR (GPC-CR). We expand upon the limited prior work on the PC-CR, never explicitly considered in Gaussian noise, by:
determining capacity to within 3 bits/s/Hz by selecting Gaussian inputs in the achievable scheme that mimic the capacity achieving scheme of the corresponding high-SNR linear deterministic approximation channel  (Section V),
numerically evaluating inner and outer bounds, which indicate an even small than 3 bits/s/Hz gap (Section V).
Section VI concludes the paper.
Ii Channel Model
where and where the inputs are subject to a power constraint , . The channel links , can be taken to be real-valued without loss of generality because receivers and transmitters can compensate for the phase of the output signals. The correlation among the noises is irrelevant because the capacity of the channel without receiver cooperation only depends on the noise marginal distributions .
A rate-pair is achievable if there exist a sequence of encoding functions over channel uses , , and (where we note the non-causal message knowledge at the relay), for messages and independent and uniformly distributed on and , respectively, and a sequence of decoding functions , such that as for . The capacity region is the convex closure of the set of achievable -pairs.
Iii Outer Bounds
In this section we derive a series of outer bounds to the capacity region of the GPC-CR. Our first outer bound is obtained by evaluating the outer bound we derived in [1, Th. III.1] for a general memoryless IFC-CR (which, as in Sato’s outer bound for the BC , exploits the fact that the capacity region only depends on the conditional marginal distributions of the channel) for the GPC-CR model. The resulting outer bound is the tightest known for the GPC-CR but it is expressed as a function of four correlation parameters, which make its analytical manipulation difficult. For this reason, we then proceed to derive a simpler (expression-wise) piecewise linear approximation of our first outer bound that will be used to derive the constant gap result in the “large SNR” regime. Then, by following the approach of [9, Th. III.7], we derive other two outer bounds by transforming the GPC-CR into a channel for which tight bounds are available. These two bounds will be used in the derivation of the constant gap results in the “small SNR” regime.
Iii-a Tightest known outer bound
The capacity of a GPC-CR is contained in the region:
for all such that .
Consider the outer bound in [1, Th. III.1] for a general IFC-CR, given by:
for some input distribution that factors as . By specializing the above bound to the GPC-CR, the “Gaussian maximizes entropy” theorem  guarantees that the following Gaussian input:
exhausts the outer region (because every mutual information term contains all the inputs). The covariance matrix in (3) is positive semi-definite if and only if . Evaluating the outer bound region for the jointly Gaussian input in (3) yields the region in (2). The minimization over in each of the sum-rate bounds is possible because the joint conditional distribution can be chosen so as to tighten the bound. ∎
Given that our outer bound in Th. 1 is expressed as the union over all feasible correlation coefficients that satisfy , it is not immediately useful in the derivation of the constant gap result. To address this, we loosen the outer bound in Th. 1 and in doing so obtain a new, simpler piecewise linear outer bound expression, which will be used in constant gap result in Section V.
Piecewise linear outer bound. The region in Th. 1 is included into:
Iii-B Outer bounds by transformation
We now present two additional outer bounds that are obtained by transforming the GPC-CR in the spirit of [10, Th. II.7]. In particular, we show that the capacity of the PC-CR is contained into: 1) the capacity region of a cognitive IFC and a point-to-point (P2P) channel in parallel, and 2) the capacity region of two P2P channels and a BC channel all in parallel. The proofs can be found in the Appendix and basically follows by showing that independent coding across the transformed parallel channels is optimal.
CIFC+P2P outer bound. The capacity of the GPC-CR is contained into the outer bound to the capacity region of the channel in Fig. 3 given by:
taken over the union of all , for any .
Parallel P2P+BC outer bound. The capacity of the GPC-CR is contained into the capacity region of the channel in Fig. 3 given by:
union over all , for any such that
Iv Inner Bound
We now present a simple inner bound for the GPC-CR based on rate splitting and superposition coding. Somewhat surprisingly, we will show that this simple region achieves to within 3 bits/s/Hz of the outer bounds derived in the previous section. The two sources split their message into common and private (sub)messages as in the classical Han and Kobayashi scheme for the IFC , while the cognitive relay aids the two sources by relaying each of the (sub)messages. Although this inner bound may be cast as a special case of the inner bound in , it may alternatively be directly derived from the Han and Kobayashi region for the IFC  as follows.
An achievable rate region for the GPC-CR is the set of all non-negative -pairs satisfying:
over the set of input distributions that factorize as .
V Constant Gap
In this section we show that the inner bound derived in Section IV lies to within a constant gap of the outer bounds derived in Section III. To prove this result we take inspiration from the capacity achieving scheme for the high-SNR linear deterministic approximation of the GPC-CR we derived in  (which we do not repeat this here due to space constraints). We do however note that in deriving the capacity result in , different achievability schemes were needed for different parameter regimes. In deriving the constant gap result for the Gaussian Pc-CR, we will directly mimic, or choose, the inputs as the Gaussian analogy to the high-SNR capacity-achieving scheme in . In fact, the different subcases shown in Table I directly parallel the regimes for the high-SNR deterministic model, as further elaborated upon in .
The inner bound of Th. 5 achieves capacity to within 3 bit/sec/Hz.
To establish this constant gap result we take inspiration from the proof of the capacity of the high-SNR linear deterministic PC-CR in [1, Cor. IV.2] and we partition the parameter space into three regions, each of which uses an achievability scheme inspired by the deterministic counterpart in the corresponding regime. The full and lengthy proof is provided in , we outline some of the key ideas next. The “piece-wise linear” outer bound region in (4) 111 For “large SNR” , i.e. , we compare the inner bound with the outer bound in Th. 2. For “small SNR” the same proof applies, but instead of the Th. 2 one must use Th. 3 and Th. 4 (see ). has two Pareto optimal corner points (see Fig. 4):
For each parameter regime we show the achievability of the two corner points A and B; because of the min-expressions in (8) we will have to consider different sub-cases. In the following we assume without loss of generality that (4d) dominates (4c). Table I summarizes the different schemes used to achieve a constant gap from the corner points in (8) in the right column When/why each of these schemes are useful may be found in the Appendix and  in the following the different sub-cases are briefly discussed.
Case W: “weak cognition at both decoders” regime
When and , that is, when the power of the signal from the source to its destination is stronger than the power of the signal from the relay to the destination, the corner points A and B in (8) coincide. By leaving the relay silent (i.e., ) and transmitting (i.e., ) we can achieve , , which is to within two bits the outer bound in Th. 2. In this regime there is no critical advantage in using the cognitive relay to relay the message of either source because the cognitive relay is received at small power.
Case S: “strong cognition at both decoders” regime
If and , the gain of the link from the cognitive relay to each destination is larger than the direct link from the source to the destination. Consider achieving corner point A in (8a) (point B may be achieved in an similar way by reversing the role of the users): here the cognitive relay cooperates with source 1 in sending a common message and with source 2 in sending a private message. Since , the common message of source 1 can be decoded at destination 2 without any rate penalty. The power allocated to the private message of source 2 by the cognitive relay is such that the interference it creates at destination 1 is at or below the noise floor, as in  for the classical IFC. This choice of transmit powers causes a gap of at most one bit for the achievable rate from point A on the outer bound, but results in a gap of three bits for the achievable rate .
Case M: “mixed cognition” regime
When and the direct link between source 1 and destination 1 has a smaller gain than the link from the cognitive relay to destination 1, while the opposite holds for source 2. In trying to achieve corner point A in (8a), both transmitters send a private message to the intended destination while the cognitive relay relays sends a common message for source 1. Decoding the common message of source 1 allows destination 2 to strip the interference from its channel output. In trying to achieve corner B in (8b), the cognitive relay employs a strategy similar to the “strong cognition at both decoders” regime: it cooperates with the both sources simultaneously and relays the private message of source 1 with such amplitude as to cause an interference at destination 2 at or below the noise floor. This specific choice of power levels causes a loss of performance of one bit for rate but significantly boosts the achievable rate . ∎
Vi Conclusion and Future Work
While the exact capacity of the GPC-CR is still unknown, we demonstrated inner and outer bounds which lie to within 3 bits/s/Hz from each other. This gap result was arrived at through insights gained from the capacity achieving schemes for the high-SNR linear deterministic approximation of the GPC-CR. We view this channel as a building block toward the more general IFC-CR in which interfering links between the two non-cognitive users are present. The PC-CR has allowed us to focus on the role of cognitive cooperation first, before incorporating interference created by the non-intended transmitter, which is the subject of ongoing work.
The work of the authors was partially funded by NSF under awards number 0643954 and 1017436. The contents of this article are solely the responsibility of the authors and do not necessarily represent the official views of the NSF.
-  S. Rini, D. Tuninetti, and N. Devroye, “Outer Bounds for the Interference Channel with a Cognitive Relay,” Proc. IEEE Information Theory Workshop (ITW), Dublin, Ireland. Arxiv preprint arXiv:1004.4944, Sep. 2010.
-  O. Sahin and E. Erkip, “Achievable rates for the Gaussian interference relay channel,” in Proc. IEEE Global Telecommun. Conf. (GLOBECOM), 2007, pp. 1627–1631.
-  ——, “On achievable rates for interference relay channel with interference cancelation,” in Signals, Systems and Computers, 2007. ACSSC 2007. Conference Record of the Forty-First Asilomar Conference on. IEEE, 2008, pp. 805–809.
-  J. Jiang, I. Maric, A. Goldsmith, and S. Cui, “Achievable rate regions for broadcast channels with cognitive radios,” Proc. of IEEE Information Theory Workshop (ITW), Taormina, Italy, pp. 500–504, Oct. 2009.
-  S. Sridharan, S. Vishwanath, S. Jafar, and S. Shamai, “On the capacity of cognitive relay assisted Gaussian interference channel,” in Proc. IEEE International Symposium on Information Theory (ISIT), Toronto, Canada, 2008, pp. 549–553.
-  S. Rini, D. Tuninetti, and N. Devroye, “New Inner and Outer bounds for the Interference Channel with a Cognitive Relay and capacity in Very Strong Interferenece,” Proc. IEEE International Symposium on Information Theory (ISIT), 2011 St. Petersburg, Russia, submitted to, 2010.
-  T. Cover, J. Thomas, and J. Wiley, Elements of Information Theory. Wiley Online Library, 1991.
-  H. Sato, “An Outer Bound to the Capacity Region of Broadcast Channels (Corresp.),” IEEE Trans. Inf. Theory, vol. 24, no. 3, pp. 374–377, 1978.
-  S. Rini, D. Tuninetti, and N. Devroye, “Inner and outer bounds for the gaussian cognitive interference channel and new capacity results,” IEEE Trans. Inf. Theory, 2010, to be submitted.
-  ——, “New Inner and Outer Bounds for the Discrete Memoryless Cognitive Channel and Some Capacity Results,” IEEE Trans. Inf. Theory, 2010, accepted for publication, Arxiv preprint arXiv:1003.4328.
-  T. Han and K. Kobayashi, “A New Achievable Rate Region for the Interference Channel,” IEEE Trans. Inf. Theory, vol. 27, no. 1, pp. 49–60, Jan 1981.
-  J. Jiang, I. Maric, A. Goldsmith, and S. Cui, “Achievable Rate Regions for Broadcast Channels With Cognitive Relays,” Proc. IEEE Information Theory Workshop (ITW), Taormina, Italy, 2009.
-  S. Rini, D. Tuninetti, and N. Devroye, “Capacity of a Class of Gaussian Interference Channels with Cognitive Relays to within 3 bits/s/Hz,” IEEE Trans. Inf. Theory, 2011, to be submitted.
-  R. Etkin, D. Tse, and H. Wang, “Gaussian interference channel capacity to within one bit,” IEEE Trans. Inf. Theory, vol. 54, no. 12, pp. 5534–5562, 2008.
-  R. Gallager, “Capacity and Coding for Degraded Broadcast Channels,” Problems in the Transmission of Information, vol. 10, no. 3, pp. 3–14, 1974.
Appendix A Proof of Th.3
where , , independent of , where the inputs are subject to , . Since , the capacity of the transformed channel is no smaller than the capacity of the original channel. By Fano’s inequality:
where in (10a) we have used “conditioning reduces entropy” to drop in and the fact that is independent of everything else once conditioned on .
For the sum-rate, by Fano’s inequality:
where (11a) follows from steps similar to those used to derive the -bound. The outer bound is obtained as the union over all the distributions that factors . Moreover, by the ”Gaussian maximizes entropy property” , we have that zero-mean complex Gaussian inputs maximize all the bounds in (5) and thus we let
Note that we can fix wlg since none of the rate bounds depends on the correlation of these two RVs. The expression in (5) is finally obtained by maximizing the sum rate bound of (11), with the inputs parametrization of (12), over the joint distribution of for fixed marginals and as in .
Appendix B Proof of Th. 4
for , , independent of , and , independent of , and where the inputs are subject to , . Note the transformed channel in Fig. 3 consists of two point-to-point channels and a BC all in parallel. The original channel in Fig. 1 is a degraded version of the channel in Fig. 3 since , . As in the proof of Th. 3, we first show that independent coding across the parallel channels is optimal and then obtain the capacity region of the channel as the sum of the capacity of parallel channels. By Fano’s inequality:
where (14a) follows from the same steps as (10), and (14b) from the rate bound for the degraded BC in , where the auxiliary random variable forms the Markov chain under the condition (7). Similarly we have that
where (15a) follows from the same steps as (10) for user 2, and (15b) from the rate bound for the degraded BC in  for the same as in (14). The bounds of (14) and (15) do not depend on the joint distribution of but only on the marginal distribution of each RV. For this reason we can take and wlg while by definition. From this consideration and the “Gaussian maximizes entropy” property of , it follows that the optimal distribution of and is zero-mean complex Gaussian while from the “entropy power inequality” of  it follows that the optimal and must be proper complex Gaussian. The expression of (6) is obtained by noting that bounds are maximized when the power constraint is met with equality.