# Delay Constrained Scheduling over Fading Channels:

Optimal Policies for Monomial Energy-Cost FunctionsThe work of J. Lee is supported by a Motorola Partnership in Research Grant.

## Abstract

A point-to-point discrete-time scheduling problem of transmitting information bits within hard delay deadline slots is considered assuming that the underlying energy-bit cost function is a convex monomial. The scheduling objective is to minimize the expected energy expenditure while satisfying the deadline constraint based on information about the unserved bits, channel state/statistics, and the remaining time slots to the deadline. At each time slot, the scheduling decision is made without knowledge of future channel state, and thus there is a tension between serving many bits when the current channel is good versus leaving too many bits for the deadline. Under the assumption that no other packet is scheduled concurrently and no outage is allowed, we derive the optimal scheduling policy. Furthermore, we also investigate the dual problem of maximizing the number of transmitted bits over time slots when subject to an energy constraint.

## 1Introduction

An opportunistic scheduling policy that adapts to the time-varying behavior of a wireless channel can achieve energy-efficient communication on the average in a long-term perspective. However, this opportunistic approach may not be appropriate for short-term deadline constrained traffic. This paper considers scheduling a packet over a finite time horizon while efficiently adapting to wireless (fading) channel variations and taking care of the deadline constraint.

Our primal problem setting is the minimization of energy expenditure subject to a hard deadline constraint (i.e., a packet of bits must be scheduled within finite discrete-time slots) assuming that the scheduler has *causal* knowledge of the channel state information (CSI). Causal CSI means that the scheduler knows the past and current CSI perfectly, but does not know future CSI. The scheduler is then required to make a decision at each time slot given the number of unserved bits, the number of slots left before the deadline, and causal CSI, in order to minimize the total energy expenditure. At each time slot, the scheduler deals with the tension between serving more bits when the channel is good and leaving too many bits to the end. Likewise, we consider the dual (scheduling over a finite time-horizon) problem of maximizing the transmitted bits subject to a finite energy constraint. We also briefly discuss scheduling problems when the CSI is available non-causally. We assume that no other packet is scheduled simultaneously and the hard delay deadline must be met (i.e., no outage is allowed). These finite-time horizon scheduling problems can be applicable to regularly arriving packets with hard delay deadlines, e.g., VoIP and video streaming.

Delay constrained scheduling over fading channel has been studied for various traffic models and delay constraints. Uysal-Biyikoglu and El Gamel [1] considered scheduling random packet arrivals over a fading channel and thus adapt (transmit power/rate) to both the channel state and queue state, and generally try to minimize *average* delay. Many references can be found in [1]. Most cases do not admit analytical closed-form solution for causal (or online) scheduling. Instead, they proposed causal algorithms with heuristic modifications from non-causal (offline) policies. References [2] take a slightly different perspective: single packet scheduling (no queue) with a hard delay deadline rather than an average delay constraint.

The subject of this paper is the single-packet scheduling problem of [2] specialized to the case where the required energy to transmit bits under channel state is governed by a convex monomial function, i.e., , where denotes the monomial order. The biggest advantage of using this monomial cost function is that it yields closed-form solutions in various scenarios, unlike the Shannon-cost function setting described in [4]. As a result, it provides intuition on the interplay between the monomial order, delay deadline, and the channel states so that it ultimately suggests general ideas for a more general energy-cost function. Although the monomial cost does not hold for operating at capacity in an AWGN channel, according to Zafer and Modiano [5] and their reference [6], there is a practical modulation scheme that exhibits an energy-bit relation that can be well approximated by a monomial. Actually, Zafer and Modinano [5] considered the same problem but for a continuous-time Markov process channel in continuous-time scheduling, i.e., the scheduler can transmit at any time instant rather than discrete slotted time. Although they provided a solution in the form of a set of differential equations, it is not possible to give a closed-form solution. On the other hand, we are able to derive a closed-form description of the optimal scheduler for the simpler block fading model (note that the continuous model is somewhat incompatible with block fading).

In this paper, we derive optimal scheduling policies for delay-constrained scheduling when the energy-bit cost is a convex monomial function. We also investigate the dual problem of maximizing the number of bits to transmit with a finite energy budget over a finite time horizon. In all cases, we are able to find analytical expressions that are functions of the queue state variables (energy state for the dual problem), current channel state and a quantity related to the fading distribution.

The resulting optimal schedulers determine the ratio of the number of bits to be allocated in the current slot to the deferred bits. For example, the optimal scheduling ratio of the number of bits to serve (from the remaining bits) at slot ( denotes the number of remaining slots to the deadline) to the number of bits to defer for the primal energy minimization problem is given by

where is the order of monomial cost function, denotes the current channel state, and denotes a statistical quantity determined by the channel distribution and the number of remaining slots . It will be shown later that is increasing with respect to . If is small, . However, as term increases, gets more affected by the channel state . This suggests that the scheduler behaves very opportunistically when the deadline is far away ( large) but less so as the deadline approaches, since is an increasing function of .

## 2Primal Problem: Energy Minimization

We consider the scheduling of a packet of bits in discrete time slots over a wireless channel as illustrated in Figure 1.

The scheduler determines the number of bits to allocate at each time slot using the fading realization/statistics to minimize the total transmit energy while satisfying the delay deadline constraint. To make the scheduling problem tractable, we assume that no other packets are to be scheduled simultaneously and that no outage is allowed.

Throughout the paper, we use the following notations:

The channel states are assumed to be independently and identically distributed (i.i.d.). If the scheduler has only causal knowledge of the channel state (i.e., at slot , the scheduler knows but does not know ), we refer to this as *causal scheduling*. If the scheduler has non-causal knowledge of the channel state in advance (i.e., at slot , the scheduler knows ), we refer to it as *non-causal scheduling*. This paper mainly deals with causal scheduling problems.

In this paper, we assume that the energy expenditure is inversely proportional^{1}

where denotes the order of monomial. If , the resulting optimization becomes a linear program and thus a “one-shot” policy is optimal [7]. We assume that (to be convex) and ( is not necessarily an integer), where denotes the real number set. A practical modulation scheme that exhibits a monomial energy-cost behavior was illustrated in [5], where the monomial order is .

A scheduler is a sequence of functions with . For causal scheduling, depends only on the current channel state and not on the past and future states because of the i.i.d. assumption and causality^{2}

where denotes the expectation operator.

## 3Causal Energy Minimization Scheduling

As done in [2][4], a sequential formulation of the optimal causal scheduling of can be established by introducing a state variable as in standard dynamic programming [8]. As defined in Section 2, denotes the remaining bits that summarizes the bit allocation up until the previous time step. At time step , are unknown but is known. Thus, the optimization becomes:

With , we obtain the following DP:

where the first term denotes the current energy cost and the second term denotes the cost-to-go function, which is the expected future energy cost (because future channel states are unknown, only expectations can be considered) to serve bits in slots if the optimal control policy is used at each future step. Thus, the optimal bit allocation is determined by balancing the current energy cost and the expected future energy cost. Because of the hard delay constraint, all the unserved bits must be served at regardless of the channel condition, i.e., and thus the resulting energy cost is given by . This dynamic optimization can be solved:

We use mathematical induction to find and . At , and are true by definition. If we suppose that is true for , the optimization becomes

whose solution is obtained by differentiating the objective and setting to zero to result in . Substituting into and then taking expectation with respect to , we obtain . Therefore, the result follows by induction.

The scheduling function can be intuitively explained in the following way. The ratio of the number of allocated bits to the number of deferred bits is equal to the ratio of to , i.e.,

where . As expected, the optimal scheduler is *opportunistic* in that the number of transmitted bits are proportional to the channel quality. Furthermore, the thresholds are increasing in (shown later) which implies that the scheduler is more *selective* when the delay deadline is far away (large ). When the deadline is far away, the scheduler transmits a large fraction of the unserved bits only when the channel state is very good; because many slots remain until the deadline, there is still a good chance of seeing a very good channel state. On the other hand, as the deadline approaches (small ) the scheduler is still opportunistic but must become less selective because only a few opportunities for good channel states remain before the deadline is reached.

Figure 2 illustrates and for a truncated exponential distribution.

As can be seen in Figure 2a, increases with respect to and this can be shown analytically:

where the inequality is due to . This shows the delay-limited opportunistic behavior mentioned before. From , the value denotes the expected energy cost for a unit bit, i.e., . Thus, , as illustrated in Figure 2b, shows how much the expected energy unit cost (for transmitting one bit) can be reduced as the time span increases.

Another interesting fact is that the policy utilizes^{3}

### 3.1Special Cases

In this subsection, we examine the optimal policy for two values of : and .

#### Quadratic Cost ()

By substituting in and , we have

where

Thus, the allocated bits and the deferred bits have the same ratio with and .

#### Infinite Order Cost ()

We examine the limiting behavior of the scheduling policy as . First, we observe that

This can be shown by the induction. When , holds trivially. If we suppose holds for , then

where the last equality is due and denotes the “effective upper bound” of (see Chap. 6 in [9] for mathematical technicality). Hence, the induction follows.

Figure 2a illustrates the values of for the truncated exponential variable. This shows that is increasing linearly with respect to for large , which agrees with Lemma ?.

With the limit in Lemma ?, we can immediately reach the simplified scheduling policy summarized below:

That is, when the order of monomial cost function tends to infinity, scheduling equal number of bits at every slot regardless of the channel state becomes the optimal policy. Note that we considered only monomial orders in the derivation, as when , the optimal policy is the one-shot policy [7], which completely depends on the channel state. From these two extreme cases, we can deduce that the effect of channel state on the scheduling function decreases as the order of monomial cost function increases, or in other words the optimal scheduler becomes less opportunistic as the monomial order increases.

## 4Dual Problem: Rate Maximization

Thus far, we have considered problems of minimizing energy expenditure to transmit fixed information bits in a finite time horizon . It is of interest to consider the dual of this, i.e., maximizing the number of bits transmitted with a finite energy over a finite time horizon . We refer to this as the *dual scheduling problem*, while referring to the original problem as the *primal scheduling problem*. Negi and Cioffi [3] considered this dual problem for the Shannon energy-bit cost function and provided solutions in DP, but not in closed form. In this work, we investigate this dual scheduling problem and obtain the optimal closed-form solution for monomial cost functions.

Since the energy-bit function is assumed to be , the associated bit-energy cost function is given by inverting:

Then the dual problem is given by

To derive a DP for causal dual scheduling, we introduce a state variable that denotes the remaining energy at slot . Thus, the optimization can be formulated as

where denotes the cost-to-go function for the dual scheduling problem. This dynamic optimization can be solved similar to the primal problem and its optimal solution is summarized as follows:

The optimal energy scheduler has very similar interpretation with the optimal bit scheduler from their scheduling formulations. That is, the ratio of the amount of energy to schedule to the amount of energy to defer is equal to the ratio of to , and thus, the similar delay-limited opportunistic scheduling interpretation can be applied. Notice that the quantities and are different.

## 5Non-Causal Scheduling

This section briefly considers the case where the scheduler has knowledge of the channel states non-causally in advance, i.e., are known at .

### 5.1Energy Minimization Scheduling

In this non-causal setting, the optimization is simply given by

subject to and for all . This is a convex optimization and can be solved as:

The standard Lagrangian method [10] yields the solution:

If we express this solution with the queue state variable , we obtain the result.

The scheduling policy can be interpreted with the ratio argument as with the causal cases, i.e.,

### 5.2Rate Maximization Scheduling

Similarly we can fomulate the non-causal rate maximition as

subject to and for all .

Like , we can also observe that

and thus, we obtain

This implies that the optimal bit distribution ratio during the slots for the primal problem is identical to the energy distribution ratio for the dual problem.

## 6Conclusion

We have investigated the problem of bit/energy scheduling over a finite time duration assuming that the energy-bit cost function is a monomial. In both the primal (minimizing energy expenditure subject to a bit constraint) scheduling and the dual (maximizing bit transmission under an energy constraint) scheduling problem, we derived closed-form scheduling functions. The optimal bit/energy allocations are determined by the ratio of and a channel statistical quantity. From the monotonicity of this statistical quantity, we interpreted that the optimal scheduler behaves more opportunistically in the initial time steps and less so as the deadline approaches.

### Footnotes

- The dependence is due to the fact that the received energy is the product of the transmitted energy and the channel state . Note, however, that any other decreasing function of could be considered by simply performing a change of variable on .
- The i.i.d. assumption makes us ignore the past CSI and the causality does not allow to exploit the future CSI . As a result, the decision at each time slot should be made based only on the current CSI , i.e., instead of .
- A time slot is called
*utilized*if a positive bit is scheduled, i.e., .

### References

- E. Uysal-Biyikoglu and A. E. Gamel, “On adaptive transmission for energy efficient in wireless data networks,”
*IEEE Trans. Inform. Theory*, vol. 50, 2004. - A. Fu, E. Modiano, and J. N. Tsitsiklis, “Optimal transmission scheduling over a fading channel with energy and deadline constraints,”
*IEEE Trans. Wireless Commun.*, vol. 5, no. 3, pp. 630–641, Mar. 2006. - R. Negi and J. M. Cioffi, “Delay-constrained capacity with causal feedback,”
*IEEE Trans. Inform. Theory*, vol. 48, no. 9, pp. 2478–2494, Sep. 2002. - J. Lee and N. Jindal, “Energy-efficient scheduling of delay constrained traffic over fading channels,” to appear:
*IEEE Trans. Wireless Communu.*(preprint available at http://arxiv.org/abs/0807.3332). - M. Zafer and E. Modiano, “Delay constrained energy efficient data transmission over a wireless fading channel,” in
*Workshop on Inf. Theory and Appl.*, La Jolla, CA, Jan./Feb. 2007, pp. 289–298. - M. J. Neely, E. Modiano, and C. E. Rohrs, “Dynamic power allocation and routing for time varying wireless networks,” in
*Proc. IEEE INFOCOM*, 2003, pp. 745–755. - J. Lee and N. Jindal, “Asymptotic optimal energy-efficient delay constrained schedulers over fading channels,” in preparation.
- D. P. Bertsekas,
*Dynamic Programming and Optimal Control*, 3rd ed. 1em plus 0.5em minus 0.4emMass.: Athena Scientific, 2005, vol. 1. - G. Hardy, J. E. Littlewood, and G. Pólya,
*Inequalities*, 2nd ed. 1em plus 0.5em minus 0.4emCambridge, 2001. - S. Boyd and L. Vandenberghe,
*Convex Optimization*.1em plus 0.5em minus 0.4emCambridge, UK: Cambridge Univ. Press, 2004.