Capacity Bounds for Bandlimited Gaussian Channels With Peak-to-Average-Power-Ratio Constraint
We revisit Shannon’s problem of bounding the capacity of bandlimited Gaussian channel (BLGC) with peak power constraint, and extend the problem to the peak-to-average-power-ratio (PAPR) constrained case. By lower bounding the achievable information rate of pulse amplitude modulation with independent and identically distributed input under a PAPR constraint, we obtain a general capacity lower bound with respect to the shaping pulse. We then evaluate and optimize the lower bound by employing some parametric pulses, thereby improving the best existing result. Following Shannon’s approach, capacity upper bound for PAPR constrained BLGC is also obtained. By combining our upper and lower bounds, the capacity of PAPR constrained BLGC is bounded to within a finite gap which tends to zero as the PAPR constraint tends to infinity. Using the same approach, we also improve existing capacity lower bounds for bandlimited optical intensity channel at high SNR.
In Part IV of his 1948 landmark paper , Shannon introduced a bandlimited Gaussian channel (BLGC) as
where is bandlimited to Hz, and is additive white Gaussian noise (AWGN) of power spectral density on . Two types of input constraint were considered: 1) an average power (AP) constraint , and 2) a peak power (PP) or amplitude constraint as . For brevity we denote these two cases as AP-BLGC and PP-BLGC, respectively, and use similar notations for other kinds of channels subsequently. For an AP-BLGC of signal-to-noise-ratio , Shannon established the famous formula
But for PP-BLGC, Shannon only provided upper and lower bounds on its capacity, and almost no further results have been known since then. An exception is , which improved Shannon’s capacity lower bound for PP-BLGC by 0.567 dB.
A related topic is the capacity problem of the PP constrained discrete-time Gaussian channel (DTGC) as
where the channel input satisfies (possibly combined with an AP constraint as ), and the Gaussian noise is memoryless. The capacity of PP-DTGC can be numerically evaluated using techniques initiated in . However, PP-DTGC only models intersymbol-interference-free (ISI-free) transmission, which cannot achieve optimal bandwidth efficiency in BLGC with PP constraint. The reason is that, for a Nyquist shaping pulse, a smaller excess bandwidth causes larger sidelobes, whose superposition sharply increases the peak of continuous-time signal waveform as the excess bandwidth tends to zero .
In this paper, we revisit the continuous-time scenario and consider an extended version of PP-BLGC, namely, BLGC with a peak-to-average-power-ratio (PAPR) constraint. In Sec. II we establish a general capacity lower bound for PAPR-BLGC by lower bounding the information rate of constrained pulse amplitude modulation (PAM) with independent and identically distributed (i.i.d.). input symbols. The bound has a form similar to (2) except for a pre-SNR factor determined by the shaping pulse. We maximize the pre-SNR factor by optimizing the pulse, and the tightest lower bound obtained outperforms the result on PP-BLGC in  by 0.926 dB. Moreover, our bound reduces to (2) when the PAPR constraint tends to infinity. Capacity upper bound for PAPR-BLGC is also provided based on Shannon’s approach for bandlimited channels with PP constraint in . In Sec. III, using the same techniques, we establish new capacity lower bounds for bandlimited optical intensity channels (BLOIC) [4, 5, 6], improve capacity lower bounds in  at high SNR, and disprove a conjecture therein. Our result also outperforms the capacity lower bound of AP-BLOIC in  obtained by a sphere packing argument.
Ii Capacity Bounds for PAPR-BLGC
Following , the capacity of a BLGC is defined as
is the mutual information per degree-of-freedom (DoF) between and , and are Nyquist sample sequences of and , respectively. For a PAPR-BLGC, the constraint on the input waveform is
where . We refer to (6) as a PAPR constraint .
In , by deriving high and low peak-to-noise ratio (PNR) asymptotic results, Shannon showed that the capacity of PP-BLGC with can be expressed as
where is an unknown pre-PNR factor satisfying . When is sufficiently small, the PP constraint dominates and the PAPR-BLGC behaves like a PP-BLGC. When tends to infinity the PAPR-BLGC behaves like an AP-BLGC. So we can infer that the capacity of PAPR-BLGC can be written as
The pre-SNR factor is a non-decreasing function of satisfying and .
Ii-a Capacity Lower Bound
We derive capacity lower bounds for PAPR-BLGC by lower bounding the information rate of PAM waveform ensemble like
under the PAPR constraint, where the shaping pulse is an (i.e., finite-energy) funtion normalized as
We denote the Fourier transform of by . Let the input symbols be i.i.d. satisfying , . To achieve the maximum pre-log factor, we let be bandlimited to and . Since the power of an i.i.d. PAM ensemble as (9) is given by [References, Sec. 14.5.1], to meet the AP constraint in (6) we let . To meet the PP constraint in (6), first we let satisfy . Define
which evaluates the maximum possible superposition of peak caused by pulse shaping. Then and the PP constraint in (6) is equivalent to .
Lemma 1: The achievable information rate of the i.i.d. PAM ensemble (9) is lower bounded by
where is the differential entropy of , and
||“Better than Nyquist” pulse .|
1) When , the maxentropic distribution is a truncated Gaussian distribution with probability density function (PDF)
and the parameter is the unique solution of
The corresponding differential entropy is
2) When , the maxentropic distribution is a uniform distribution with PDF
and the corresponding differential entropy is
Ii-B Pulse Optimization
The general lower bound (20) can be evaluated using specific pulses. Table I lists the pulses considered in this paper, all of which are normalized to satisfy (10). Fig. 1 shows the Fourier transform of these pulses. Since no analytic solution for (16) is known, for our result, the pre-SNR factor (21) is evaluated numerically. Although the exact value of is difficult to find analytically for arbitrary pulses, the sidelobes of the pulses in Table I decay asymptotically as or faster as . This makes reliable numerical evaluation of possible. For parametric pulses such as the RC pulse, we optimize it over to maximize for each .
In Fig. 5, our numerical results for the pre-SNR factor lower bound (21) is provided. The BTN pulse shows the best performance. Fig. 5 provides the optimal value of for the BTN pulse and the PL pulse for each (the step size for optimizing is 0.01). Fig. 5 provides the pre-SNR factor lower bounds obtained by using the BTN pulses with some specific values of , and the best lower bound obtained by optimizing the BTN pulse over (denoted “BTN-OPT LB”). The optimal value decreases as the PAPR constraint increases. As , it appears that tends to zero for both the BTN pulse and the PL pulse, i.e. both pulses tend to the sinc pulse. The following result shows that the lower bounds for the BTN, PL and RC pulses in Fig. 5 tend to one as .
By noting that the RHS of (22) tends to one when , we can prove that if , then and , for a finite . Thus when , for a given . Using a parametric pulse which tends to the sinc pulse as (e.g., the BTN pulse), we can make arbitrarily close to one as grows without bound.
By replacing in the second case of Proposition 1 with , we revisit a capacity lower bound for PP-BLGC established in , which is equivalent to
Using the SC pulse, in 
was obtained, which improved (24) by 0.567 dB. According to Fig. 2, both the BTN and PL pulses outperform the SC pulse. In particular, employing the BTN pulse we obtain
This tightens the existing PP-BLGC result (25) by dB.
Ii-C Capacity Upper Bound
In , by proving an asymptotic upper bound for the PP-BLGC as , Shannon essentially established the following general upper bound for the capacity of bandlimited channels with an amplitude constraint.
Lemma 2: Let the input of a BLGC be constrained by an amplitude constraint , where . The capacity of this channel is upper bounded by
where is the capacity of a DTGC as (3) satisfying and .
By combining this and the numerical computation technique in , we provide numerical upper bound (denoted “UB”) for the PAPR-BLGC in Fig. 5. It is shown that the gap between our capacity upper and lower bounds is still large for small , and the gap decreases as increases. For example, when , the high SNR gap is about 2.30 dB; see Fig. 5. As the gap diminishes, as indicated by Proposition 2.
Iii Capacity Bounds for PAPR-BLOIC
In intensity modulation and direct detection based optical communications, a well-known channel model is the BLOIC,
where is the transmitted optical intensity (i.e., the optical power transferred per unit area), which is bandlimited to due to the limited available bandwidth of optoelectronic components, and is the same as that in (1). We consider a PAPR constraint on the input optical power as
The capacity of the BLOIC has been studied in the literature; see [5, 7, 6] and references therein. In particular, capacity bounds for the PAPR-BLOIC was derived in  using the bounding techniques in Sec. II, and the lower bound is like
where , and the pre-OSNR factor is given by
In , although the benefit of pulse optimization had been recognized, only the S2 and SC pulses were used to evaluate the lower bound (30). Now we further consider the BTN and the ICIT pulses in Table I. Fig. 7 shows the spectra of these pulses, Fig. 7 gives the corresponding results on the pre-OSNR factor, and Fig. 8 gives the corresponding optimal parameters. Compared to the results in Fig 5, the pre-OSNR factor lower bounds in Fig. 7 behave differently. The ICIT based lower bound performs the best at low PAPR (although it performs almost the same as the BTN based one when ), but it begins decreasing at . The BTN based lower bound decreases slower at high PAPR region, but our further calculation reveals that in fact it tends to zero as . The S2 based lower bound is the only non-decreasing bound which tends to . Since a PAM waveform ensemble with a given PAPR is still admissible in channels with higher PAPR constraints, the pre-OSNR factor of capacity, , is always non-decreasing with . So our optimal lower bound in Fig. 7 is also non-decreasing:
It was conjectured in  that at high OSNR, the maximum achievable pre-OSNR factor using i.i.d. PAM ensemble in the AP-BLOIC is , which is achieved using the S2 pulse. The present results show that the ICIT and BTN pulses perform better (but the input alphabet for must be carefully chosen), and the former one achieves a pre-OSNR factor 0.06606, which outperforms by 0.26 dB. Moreover, this result also outperforms the result obtained by a sphere packing argument in , which shows that for the AP-BLOIC (i.e., PAPR-BLOIC as ).
This work was supported in part by the Key Research Program of Frontier Sciences of CAS under Grant QYZDY-SSW-JSC003, by the National Natural Science Foundation of China under Grant 61722114, and by the Fundamental Research Funds for the Central Universities under Grants WK3500000003 and WK3500000005.
-  C. E. Shannon, “A mathematical theory of communication,” Bell Syst. Tech. J., vol. 27, pp. 379–423 and pp. 623–656, July and Oct. 1948.
-  S. Shamai (Shitz), “On the capacity of a Gaussian channel with peak power and bandlimited input signals,” Archiv für Electronik und Übertragungstechnik (AEÜ), vol. 42, no. 6, pp. 340–346, Nov.-Dec. 1988.
-  J. G. Smith, “The information capacity of amplitude- and variance constrained scalar Gaussian channels,” Inf. Contr., vol. 18, no. 3, pp. 203–219, Feb. 1971.
-  M. Tavan, E. Agrell, and J. Karout, “Bandlimited intensity modulation,” IEEE Trans. Commun., vol. 60, no. 11, pp. 3429–3439, Nov. 2012.
-  S. Hranilovic and F. R. Kschischang, “Capacity bounds for power- and band-limited optical intensity channels corrupted by Gaussian noise,” IEEE Trans. Inf. Theory, vol. 50, no. 5, pp. 784–795, May 2004.
-  J. Zhou and W. Zhang, “On the capacity of bandlimited optical intensity channels with Gaussian noise,” IEEE Trans. Commun., vol. 65, no. 6, pp. 2481–2493, Jun. 2017.
-  S. Haghighatshoar, P. Jung, and G. Caire, “Capacity and degree-of-freedom of OFDM channels with amplitude constraint,” In Proc. 2016 IEEE Int. Symp. Inf. Theory (ISIT), Barcelona, Spain, July 2016, pp. 900–904.
-  A. Lapidoth, A Foundation in Digital Communication, Cambridge University Press, 2009.
-  T. Cover and J. A. Thomas, Elements of Information Theory, 2nd ed., John Wiley Sons, Inc., 2006.
-  N. C. Beaulieu and M. O. Damen, “Parametric construction of Nyquist-I pulses,” IEEE Trans. Commun., vol. 52, no. 12, pp. 2134–2142, Dec. 2004.
-  N. C. Beaulieu, C. C. Tan, and M. O. Damen, “A ¡¯better than¡¯ Nyquist pulse,” IEEE Commun. lett., vol. 5, no. 9, pp. 367–368, Sept. 2001.
-  S. D. Assimonis, M. Matthaiou, and G. K. Karagiannidis, “Two-parameter Nyquist pulses with better performance,” IEEE Commun. Letters, vol. 12, no. 11, pp. 807–809, Nov. 2008.