Capacity Bounds for Bandlimited Gaussian Channels With Peak-to-Average-Power-Ratio Constraint

Capacity Bounds for Bandlimited Gaussian Channels With Peak-to-Average-Power-Ratio Constraint

Yizhu Wang, Jing Zhou, and Wenyi Zhang CAS Key Laboratory of Wireless-Optical Communications
University of Science and Technology of China, Hefei, China
Email: wyz94@mail.ustc.edu.cn; jzee@ustc.edu.cn; wenyizha@ustc.edu.cn
Abstract

We revisit Shannon’s problem of bounding the capacity of bandlimited Gaussian channel (BLGC) with peak power constraint, and extend the problem to the peak-to-average-power-ratio (PAPR) constrained case. By lower bounding the achievable information rate of pulse amplitude modulation with independent and identically distributed input under a PAPR constraint, we obtain a general capacity lower bound with respect to the shaping pulse. We then evaluate and optimize the lower bound by employing some parametric pulses, thereby improving the best existing result. Following Shannon’s approach, capacity upper bound for PAPR constrained BLGC is also obtained. By combining our upper and lower bounds, the capacity of PAPR constrained BLGC is bounded to within a finite gap which tends to zero as the PAPR constraint tends to infinity. Using the same approach, we also improve existing capacity lower bounds for bandlimited optical intensity channel at high SNR.

I Introduction

In Part IV of his 1948 landmark paper [1], Shannon introduced a bandlimited Gaussian channel (BLGC) as

(1)

where is bandlimited to Hz, and is additive white Gaussian noise (AWGN) of power spectral density on . Two types of input constraint were considered: 1) an average power (AP) constraint , and 2) a peak power (PP) or amplitude constraint as . For brevity we denote these two cases as AP-BLGC and PP-BLGC, respectively, and use similar notations for other kinds of channels subsequently. For an AP-BLGC of signal-to-noise-ratio , Shannon established the famous formula

(2)

But for PP-BLGC, Shannon only provided upper and lower bounds on its capacity, and almost no further results have been known since then. An exception is [2], which improved Shannon’s capacity lower bound for PP-BLGC by 0.567 dB.

A related topic is the capacity problem of the PP constrained discrete-time Gaussian channel (DTGC) as

(3)

where the channel input satisfies (possibly combined with an AP constraint as ), and the Gaussian noise is memoryless. The capacity of PP-DTGC can be numerically evaluated using techniques initiated in [3]. However, PP-DTGC only models intersymbol-interference-free (ISI-free) transmission, which cannot achieve optimal bandwidth efficiency in BLGC with PP constraint. The reason is that, for a Nyquist shaping pulse, a smaller excess bandwidth causes larger sidelobes, whose superposition sharply increases the peak of continuous-time signal waveform as the excess bandwidth tends to zero [4].

In this paper, we revisit the continuous-time scenario and consider an extended version of PP-BLGC, namely, BLGC with a peak-to-average-power-ratio (PAPR) constraint. In Sec. II we establish a general capacity lower bound for PAPR-BLGC by lower bounding the information rate of constrained pulse amplitude modulation (PAM) with independent and identically distributed (i.i.d.). input symbols. The bound has a form similar to (2) except for a pre-SNR factor determined by the shaping pulse. We maximize the pre-SNR factor by optimizing the pulse, and the tightest lower bound obtained outperforms the result on PP-BLGC in [2] by 0.926 dB. Moreover, our bound reduces to (2) when the PAPR constraint tends to infinity. Capacity upper bound for PAPR-BLGC is also provided based on Shannon’s approach for bandlimited channels with PP constraint in [1]. In Sec. III, using the same techniques, we establish new capacity lower bounds for bandlimited optical intensity channels (BLOIC) [4, 5, 6], improve capacity lower bounds in [6] at high SNR, and disprove a conjecture therein. Our result also outperforms the capacity lower bound of AP-BLOIC in [7] obtained by a sphere packing argument.

Ii Capacity Bounds for PAPR-BLGC

Following [1], the capacity of a BLGC is defined as

(4)

where

(5)

is the mutual information per degree-of-freedom (DoF) between and , and are Nyquist sample sequences of and , respectively. For a PAPR-BLGC, the constraint on the input waveform is

(6)

where . We refer to (6) as a PAPR constraint .

In [1], by deriving high and low peak-to-noise ratio (PNR) asymptotic results, Shannon showed that the capacity of PP-BLGC with can be expressed as

(7)

where is an unknown pre-PNR factor satisfying . When is sufficiently small, the PP constraint dominates and the PAPR-BLGC behaves like a PP-BLGC. When tends to infinity the PAPR-BLGC behaves like an AP-BLGC. So we can infer that the capacity of PAPR-BLGC can be written as

(8)

The pre-SNR factor is a non-decreasing function of satisfying and .

Ii-a Capacity Lower Bound

We derive capacity lower bounds for PAPR-BLGC by lower bounding the information rate of PAM waveform ensemble like

(9)

under the PAPR constraint, where the shaping pulse is an (i.e., finite-energy) funtion normalized as

(10)

We denote the Fourier transform of by . Let the input symbols be i.i.d. satisfying , . To achieve the maximum pre-log factor, we let be bandlimited to and . Since the power of an i.i.d. PAM ensemble as (9) is given by [References, Sec. 14.5.1], to meet the AP constraint in (6) we let . To meet the PP constraint in (6), first we let satisfy . Define

(11)

which evaluates the maximum possible superposition of peak caused by pulse shaping. Then and the PP constraint in (6) is equivalent to .

We use the following lemma to derive our lower bound. The lemma is essentially due to Shannon [1], and can also be proved using Szegö’s theorem [2].

Lemma 1: The achievable information rate of the i.i.d. PAM ensemble (9) is lower bounded by

(12)

where is the differential entropy of , and

(13)
Name
Definition
Remark
S2
,
Square of sinc pulse, used in [1].
SC
Spectral-cosine pulse, used in [2],
also called duobinary pulse.
RC
Raised cosine filter [8].
PL
Parametric linear pulse [10].
BTN
“Better than Nyquist” pulse [11].
ICIT
Inverse-cosine inverse-tangent
pulse [12]. No explicit time-
domain expression is known.
TABLE I: List of Pulses Used ( for all cases)

We tighten (12) by finding a maxentropic distribution for under the constraints and . According to [References, Theorem 12.1.1] we obtain the following solution.

1) When , the maxentropic distribution is a truncated Gaussian distribution with probability density function (PDF)

(14)

where ,

(15)

and the parameter is the unique solution of

(16)

The corresponding differential entropy is

(17)

2) When , the maxentropic distribution is a uniform distribution with PDF

(18)

and the corresponding differential entropy is

(19)

Substituting (17) and (19) into (12) yields the following result.

Proposition 1: The capacity of the BLGC as (1) with a PAPR constraint given by (6), is lower bounded by

(20)

where

(21)

and are defined by (11) and (13), respectively, with respect to a pulse normalized as (10), and is the unique solution of (16).

Ii-B Pulse Optimization

The general lower bound (20) can be evaluated using specific pulses. Table I lists the pulses considered in this paper, all of which are normalized to satisfy (10). Fig. 1 shows the Fourier transform of these pulses. Since no analytic solution for (16) is known, for our result, the pre-SNR factor (21) is evaluated numerically. Although the exact value of is difficult to find analytically for arbitrary pulses, the sidelobes of the pulses in Table I decay asymptotically as or faster as . This makes reliable numerical evaluation of possible. For parametric pulses such as the RC pulse, we optimize it over to maximize for each .

In Fig. 5, our numerical results for the pre-SNR factor lower bound (21) is provided. The BTN pulse shows the best performance. Fig. 5 provides the optimal value of for the BTN pulse and the PL pulse for each (the step size for optimizing is 0.01). Fig. 5 provides the pre-SNR factor lower bounds obtained by using the BTN pulses with some specific values of , and the best lower bound obtained by optimizing the BTN pulse over (denoted “BTN-OPT LB”). The optimal value decreases as the PAPR constraint increases. As , it appears that tends to zero for both the BTN pulse and the PL pulse, i.e. both pulses tend to the sinc pulse. The following result shows that the lower bounds for the BTN, PL and RC pulses in Fig. 5 tend to one as .

Fig. 1: Spectra of pulses considered in PAPR-BLGC.222For clarity, we only show a half of the spectrum of each pulse here (and in Fig. 7). Note that the spectrum of them are symmetric with respect to .

Proposition 2: For the PAPR-BLGC, as grows without bound, there exists a parametric pulse such that tends to one and (20) tends to (2).

Outline of Proof: By substituting (15) into (16) we obtain

(22)

By noting that the RHS of (22) tends to one when , we can prove that if , then and , for a finite . Thus when , for a given . Using a parametric pulse which tends to the sinc pulse as (e.g., the BTN pulse), we can make arbitrarily close to one as grows without bound.

By replacing in the second case of Proposition 1 with , we revisit a capacity lower bound for PP-BLGC established in [2], which is equivalent to

(23)

where is the pre-PNR factor in (7). Thus we can compare our results with known capacity lower bounds for PP-BLGC. Using the S2 pulse, in [1] it was shown that

(24)

Using the SC pulse, in [2]

(25)

was obtained, which improved (24) by 0.567 dB. According to Fig. 2, both the BTN and PL pulses outperform the SC pulse. In particular, employing the BTN pulse we obtain

(26)

This tightens the existing PP-BLGC result (25) by dB.

Fig. 2: Pre-SNR factors of capacity lower bounds of PAPR-BLGC.
Fig. 3: Optimal value of for BL and BTN pulses in PAPR-BLGC (the step size for optimizing is 0.01).
Fig. 4: Pre-SNR factors for specific BTN pulses.
Fig. 5: Capacity bounds for PAPR-BLGC when .

Ii-C Capacity Upper Bound

In [1], by proving an asymptotic upper bound for the PP-BLGC as , Shannon essentially established the following general upper bound for the capacity of bandlimited channels with an amplitude constraint.

Lemma 2: Let the input of a BLGC be constrained by an amplitude constraint , where . The capacity of this channel is upper bounded by

(27)

where is the capacity of a DTGC as (3) satisfying and .

By combining this and the numerical computation technique in [3], we provide numerical upper bound (denoted “UB”) for the PAPR-BLGC in Fig. 5. It is shown that the gap between our capacity upper and lower bounds is still large for small , and the gap decreases as increases. For example, when , the high SNR gap is about 2.30 dB; see Fig. 5. As the gap diminishes, as indicated by Proposition 2.

Iii Capacity Bounds for PAPR-BLOIC

Fig. 6: Spectra of pulses considered in PAPR-BLOIC.
Fig. 7: Pre-OSNR factors of capacity lower bounds of PAPR-BLOIC.
Fig. 8: Optimal value of for BTN and ICIT pulses in PAPR-BLOIC.

In intensity modulation and direct detection based optical communications, a well-known channel model is the BLOIC,

(28)

where is the transmitted optical intensity (i.e., the optical power transferred per unit area), which is bandlimited to due to the limited available bandwidth of optoelectronic components, and is the same as that in (1). We consider a PAPR constraint on the input optical power as

(29)

The capacity of the BLOIC has been studied in the literature; see [5, 7, 6] and references therein. In particular, capacity bounds for the PAPR-BLOIC was derived in [6] using the bounding techniques in Sec. II, and the lower bound is like

(30)

where , and the pre-OSNR factor is given by

(31)

where and are defined as (11) and (13), respectively, with respect to an pulse normalized as , and is the unique solution of

(32)

In [6], although the benefit of pulse optimization had been recognized, only the S2 and SC pulses were used to evaluate the lower bound (30). Now we further consider the BTN and the ICIT pulses in Table I. Fig. 7 shows the spectra of these pulses, Fig. 7 gives the corresponding results on the pre-OSNR factor, and Fig. 8 gives the corresponding optimal parameters. Compared to the results in Fig 5, the pre-OSNR factor lower bounds in Fig. 7 behave differently. The ICIT based lower bound performs the best at low PAPR (although it performs almost the same as the BTN based one when ), but it begins decreasing at . The BTN based lower bound decreases slower at high PAPR region, but our further calculation reveals that in fact it tends to zero as . The S2 based lower bound is the only non-decreasing bound which tends to . Since a PAM waveform ensemble with a given PAPR is still admissible in channels with higher PAPR constraints, the pre-OSNR factor of capacity, , is always non-decreasing with . So our optimal lower bound in Fig. 7 is also non-decreasing:

(33)

It was conjectured in [6] that at high OSNR, the maximum achievable pre-OSNR factor using i.i.d. PAM ensemble in the AP-BLOIC is , which is achieved using the S2 pulse. The present results show that the ICIT and BTN pulses perform better (but the input alphabet for must be carefully chosen), and the former one achieves a pre-OSNR factor 0.06606, which outperforms by 0.26 dB. Moreover, this result also outperforms the result obtained by a sphere packing argument in [7], which shows that for the AP-BLOIC (i.e., PAPR-BLOIC as ).

Acknowledgment

This work was supported in part by the Key Research Program of Frontier Sciences of CAS under Grant QYZDY-SSW-JSC003, by the National Natural Science Foundation of China under Grant 61722114, and by the Fundamental Research Funds for the Central Universities under Grants WK3500000003 and WK3500000005.

References

  • [1] C. E. Shannon, “A mathematical theory of communication,” Bell Syst. Tech. J., vol. 27, pp. 379–423 and pp. 623–656, July and Oct. 1948.
  • [2] S. Shamai (Shitz), “On the capacity of a Gaussian channel with peak power and bandlimited input signals,” Archiv für Electronik und Übertragungstechnik (AEÜ), vol. 42, no. 6, pp. 340–346, Nov.-Dec. 1988.
  • [3] J. G. Smith, “The information capacity of amplitude- and variance constrained scalar Gaussian channels,” Inf. Contr., vol. 18, no. 3, pp. 203–219, Feb. 1971.
  • [4] M. Tavan, E. Agrell, and J. Karout, “Bandlimited intensity modulation,” IEEE Trans. Commun., vol. 60, no. 11, pp. 3429–3439, Nov. 2012.
  • [5] S. Hranilovic and F. R. Kschischang, “Capacity bounds for power- and band-limited optical intensity channels corrupted by Gaussian noise,” IEEE Trans. Inf. Theory, vol. 50, no. 5, pp. 784–795, May 2004.
  • [6] J. Zhou and W. Zhang, “On the capacity of bandlimited optical intensity channels with Gaussian noise,” IEEE Trans. Commun., vol. 65, no. 6, pp. 2481–2493, Jun. 2017.
  • [7] S. Haghighatshoar, P. Jung, and G. Caire, “Capacity and degree-of-freedom of OFDM channels with amplitude constraint,” In Proc. 2016 IEEE Int. Symp. Inf. Theory (ISIT), Barcelona, Spain, July 2016, pp. 900–904.
  • [8] A. Lapidoth, A Foundation in Digital Communication, Cambridge University Press, 2009.
  • [9] T. Cover and J. A. Thomas, Elements of Information Theory, 2nd ed., John Wiley Sons, Inc., 2006.
  • [10] N. C. Beaulieu and M. O. Damen, “Parametric construction of Nyquist-I pulses,” IEEE Trans. Commun., vol. 52, no. 12, pp. 2134–2142, Dec. 2004.
  • [11] N. C. Beaulieu, C. C. Tan, and M. O. Damen, “A ¡¯better than¡¯ Nyquist pulse,” IEEE Commun. lett., vol. 5, no. 9, pp. 367–368, Sept. 2001.
  • [12] S. D. Assimonis, M. Matthaiou, and G. K. Karagiannidis, “Two-parameter Nyquist pulses with better performance,” IEEE Commun. Letters, vol. 12, no. 11, pp. 807–809, Nov. 2008.
Comments 0
Request Comment
You are adding the first comment!
How to quickly get a good reply:
  • Give credit where it’s due by listing out the positive aspects of a paper before getting into which changes should be made.
  • Be specific in your critique, and provide supporting evidence with appropriate references to substantiate general statements.
  • Your comment should inspire ideas to flow and help the author improves the paper.

The better we are at sharing our knowledge with each other, the faster we move forward.
""
The feedback must be of minimum 40 characters and the title a minimum of 5 characters
   
Add comment
Cancel
Loading ...
224236
This is a comment super asjknd jkasnjk adsnkj
Upvote
Downvote
""
The feedback must be of minumum 40 characters
The feedback must be of minumum 40 characters
Submit
Cancel

You are asking your first question!
How to quickly get a good answer:
  • Keep your question short and to the point
  • Check for grammar or spelling errors.
  • Phrase it like a question
Test
Test description