Joint Channel and Queue Aware Scheduling for Wireless Links with Multiple Fading States
Abstract
In this work, we address the delay optimal scheduling problem for wireless transmission with fixed modulation over multistate fading channels. We propose a stochastic scheduling policy which schedules the source to transmit with probability jointly based on the buffer and channel states, with an average power constraint at the transmitter. Our objective is to minimize the average queueing delay by choosing the optimal transmission probabilities. Using Markov chain modeling, we formulate a powerconstrained delay minimization problem, and then transform it into a Linear Programming (LP) one. By analyzing its property, we can derive the optimal thresholdbased scheduling policy together with the corresponding transmission probabilities. Our theoretical analysis is corroborated by simulation results.
I Introduction
Wireless networks accommodate various multimedia traffics with different Qualities of Service (QoS) for mobile users. For highspeed realtime applications, the average delay packets experience and energy efficiency become more critical considerations [1], when data packets are delivered over timevarying wireless fading channels. Therefore, it is important to schedule data transmissions to minimize the average delay given precious system resources (e.g., average power and energy). This naturally leads to a crosslayer design issue, since the average power and delay are metrics of physical and Medium Access Control (MAC) layers, respectively.
In wireless networks, crosslayer design on powerefficient and delayminimal transmission has been an everpresent important issue [2, 3, 4]. A crosslayer scheduling policy was firstly proposed in [2] to transmit data over a discretetime twostate channel under the constraints of the average delay and peak transmitter power. In [3], Berry and Gallager considered a general crosslayer model where the user’s transmission power and data rate were allocated according to the current buffer state and the channel state in each slot. The asymptotic optimal powerdelay tradeoff was derived for the largedelay and smalldelay regimes in [3] and [4], respectively. The existence of stationary average delay optimal policy was shown and some structural results were obtained in [5]. In these works, the crosslayer scheduling problems were formulated using the theory of Markov decision processes and the optimal solutions were numerically computed using the dynamic programming technique.
Recently, different optimization techniques were applied to find the optimal power/energyefficient scheduling policies under various constraints on rate, delay and maximum transmission power [6, 7, 8, 9]. Meanwhile, the attempts to find analytical solutions have been made for pursuit of deep insights in protocol designs. In [8], an energy efficient scheduling problem was studied for transmitting the packets within a certain amount of time. Through probabilistic analysis, the authors derived the optimal offline scheduling algorithm with an infinite delay constraint and Poisson data arrival. In [9], we considered a crosslayer scheduling problem for a twostate wireless channel. The transmission power is adjusted according to the channel quality to achieve the target Bit Error Rate (BER). To exploit the power efficiently, the source transmits one packet in each slot if the channel state is “good”, and otherwise transmits with probability based on the buffer length. The optimal policy was to transmit based on a critical threshold on the queue length.
In this paper, we generalize the work in [9] to the scenario where data packets of realtime traffics are delivered over multistate wireless fading channels. The transmission power is adapted in response to the channel state and fixed modulation is applied to reduce the complexity of the transceivers and delay jitter. We propose a stochastic scheduling policy where the source transmits with probability based on both the channel and buffer states. Using Markov chain modeling, we formulate a powerconstrained delay minimization problem, and then transform it into a Linear Programming (LP) one. By exploiting its properties, we are able to obtain an elegant closedform expression for the optimal solution, from which we can finally determine the optimal probabilistic transmission parameters. We show that there is a critical threshold imposed on the queue length associated with each channel state and vice versa. For example, the transmitter of the source is inactive if the data queue length is below the critical threshold, and active otherwise. We also validate the optimality of the proposed policy in [9] for a twostate wireless channel.
The rest of this paper is organized as follows. Section II introduces the system model and the stochastic scheduling scheme. In Section III, a discretetime Markov chain model is constructed and an LP problem is formulated. The optimal scheduling policy is analyzed in Section IV. Section V demonstrates the simulation results and Section VI concludes this paper. Throughout this paper, the proofs are omitted due to limited space.
Ii System Model
Iia System Description
We consider a wireless link, where a source node transmits to its destination over a timevarying channel. The source node employs a buffer to store the data packets randomly generated from higherlayer applications, as shown in Fig.1. The system is assumed to be timeslotted.
Suppose that data packets arrive at the source buffer according to a Bernoulli process [10] with probability . This simple yet widely adopted traffic model allows tractable analysis [11, 12], and provides insights for further study. The data buffer has a capacity of (). and mean that the buffer capacity is infinite and finite, respectively. Let be the number of backlogged data packets in the buffer at the end of slot , updated as
(1) 
where and denote the number of data packets arriving and delivered in each time slot , respectively. The probability mass function of can be expressed as .
The channel is assumed to experience state block fading, as shown in Fig.2. The channel state in slot is denoted by . Assuming independent and identically distributed () channel fading model, we denote by the probability that the channel stays at state . The probability mass function of is given by , which satisfies . If the channel state is , the source will transmit with power to achieve a target BER. In practice, the transmission power can be adjusted based on the received signaltonoise ratio (SNR) at the destination. Such Channel State Information (CSI) can be fed back to the source over control channel. Intuitively, more power is required to transmit one packet per slot when the received SNR is smaller. Therefore, we naturally assume in accordance with deteriorating channel conditions. In this sense, state channel model is reasonable. Transmission schemes with adaptive modulation and coding will be considered in our future work.
IiB Stochastic Scheduling
To improve the energy efficiency, the source is willing to wait for better channel conditions, since it can thus spend less power on each data transmission. However, the waiting time could be undesirably long if the channel stays at very poor states for a long time. To reduce the latency, the source may have to transmit its backlogged data packets when the current channel state is not so good. This will certainly cost more valuable power resource. Hence, there exists a delaypower tradeoff in the wireless transmissions.
Our objective is to find a scheduling policy that minimizes the average queueing delay under the constraint of a maximum average transmission power. To this end, we propose a stochastic scheduling scheme which decides whether to transmit in slot according to the current channel state and data queue state . We define two sets of probabilistic parameters: and (). Specifically, with and , if there is new data arrival in this slot, , , the source node transmits one data packet with probability and holds from transmission with probability , respectively; If no new data packet arrives, , , it transmits with probability and holds with probability , respectively.
According to the proposed scheduling policy, the service process depends on the queue status and the arrival process , as described below.

Case 1: and
In this case, the source transmits a newly arriving data packet with probability in the current time slot , and the service process can be expressed as
(2) 
where means ’with the probability’.

Case 2: () and
In this case, the source transmits a packet with probability or depending on whether there is a new data arrival or not. The service process can be expressed as
(3) 
Iii Problem Formulation
Iiia Markov Chain Model
In our system, the queueing system can be modeled as a discretetime onedimensional Markov chain, each state of which represents the buffer status, as shown in Fig.3.
Let denote the onestep transition probability of the Markov chain, which is homogeneous by the scheme description. The index can be omitted below if no confusion will be caused. According to the case when one data packet newly arrives while no transmission takes place, the transition probability that the queue length is increased by one is obtained as
(4) 
When one data packet is transmitted with no new data arrival, the transition probability that the queue length is decreased by one is given by
(5) 
Thus, the probability that the queue status remains the same can be expressed as
(6) 
Let denote the steadystate probability that the data queue length is equal to . The steadystate probability vector satisfies and . In particular, the local balance equation at state is given by
(7) 
Hence, the steadystate probability of the Markov chain can be computed as
(8) 
Thus, given the transmission parameters and , we can compute the stationary distribution of the buffer state and further analyze the system performance.
IiiB Queueing Delay and Power Consumption
The system performance is measured in terms of the average queueing delay and the average power consumption. By the Little’s law, the average queueing delay is related to the average buffer occupancy[3], and can be computed as
(9) 
Let denote the transmission power in slot . Let denote the conditional probability that the transmission power is given the data queue state and the channel state . In this case, the source transmits at a power with probability if one data packet newly arrives, and with probability if no data packet arrives, respectively. Hence, conditioned on and , the probability that the transmission power is equal to can be expressed as
(10) 
and . Hence, the average power is expressed as
(11) 
The event of packet loss occurs when there is one new data arrival while the data buffer is full. Thus, the probability of buffer overflow can be given by
(12) 
Note that the average queueing delay can be appropriately defined by (9) only when the event of buffer overflow does not take place. From (12), the packet loss probability is zero if is zero. This happens in two cases: 1) the buffer capacity is infinite with and the queueing system is stable; 2) the parameter is set to zero for a finite buffer with . We will discuss the optimal scheduling under the assumption that no buffer overflow occurs.
IiiC Optimization Problem
In this work, we aim to study the optimal scheduling policy which minimizes the average delay subject to the average power constraint by determining the optimal transmission parameters and . To this end, we formulate an optimization problem as
(13) 
where the constraint (a) is the maximum average power constraint, the constraints (b) and (c) stem directly from the property of the Markov chain, and the constraint (d) points out the range of the probabilistic parameters and . Note that the average power (c.f. (11)) and the steadystate probabilities (c.f. (4), (5), (8)) are nonlinear functions of the parameters and . Therefore, it is rather difficult to solve the above optimization problem (13). Motivated by the methods applied in [11, 12], we will transform the optimization problem (13) into an LP problem, and exploit its special structure to analyze the globally optimal solution in the next section.
Iv Analysis of Delay Optimal Scheduling
Iva LP Problem Formulation
To formulate an LP problem, we introduce a set of new variables as:
(14) 
where . The variable can be interpreted as the conditional probability that the queue state is equal to after one data transmission over the wireless channel with state . By substituting (4) and (5) into the local balance equation (7), we have , from which we can further obtain
(15) 
In Lemma 1, we show that the average delay and power are both linear functions of the variables .
Lemma 1.
The average delay and the average power consumption can be expressed as
(16) 
As a result, we can transform the problem (13) into an LP problem as follows:
(17) 
In (17), the power constraint (a) and the normalization constraint (b) are derived directly from the constraints (a) and (c) of (13). From (14) and (15), we can derive the constraint (c) by varying the probabilistic parameters and within their range . The optimal solution and the optimal value of (17) are denoted by and , respectively.
IvB Structure of the Optimal Solution
We first consider the case when the maximum average power is sufficiently large such that the source is able to transmit whenever its queue is not empty. This means that the power constraint (17.a) can be omitted. In this case, we can obtain the minimum average delay by setting and , which satisfies the constraints (17.b) and (17.c). Accordingly, we obtain the power threshold as .
Then, we focus on the case when the power constraint (17.a) becomes tight, , . By exploiting the property of the LP problem (17), we can present the structure of the optimal solution in the following theorem.
Theorem 2.
The optimal solution to (17) has a threshold structure. That is, there exists a threshold on the data queue length associated with each channel state such that and the optimal solution takes the form as
(18) 
And there is at most one such that may hold, and for .
Corollary 3.
for all and .
For all and , we have and . This means that the length of the packet queue never exceeds the threshold . Therefore, no packet loss will be induced, , , as long as the finite queue capacity is larger than .
1) There exists a threshold on the data queue length associated with each channel state ;
2) And there is a threshold imposed on the channel state given the queue state .
As shown by the shadow area in Fig.4, we have for or , and otherwise for or . The dotted area shown in Fig.4 means that for and . Based on the threshold based policy, the source should transmit one backlogged packet in each slot when the queue length reaches the threshold (associated with the channel state ) so as to minimize the average delay. As plotted in Fig.4, the thresholds take the stairstep shape, which is the optimum way to exploit the limited power resource over wireless channels.
IvC Derivation of the Optimal Transmission Parameters
Based on the property of the optimal solution presented in Theorem 2, we will show how to derive the optimal solution and determine the optimal transmission parameters and thereafter. For ease of expression, we define two functions as:
(19) 
(20) 
We also define two series of probabilities and () as
(21) 
(22) 
Based on the probabilities and , we can define two more parameters as
(23) 
(24) 
which are linear combinations of the power levels .
Theorem 4.
Let and . The optimal steadystate probability can be expressed as a linear function of the optimal steadystate probability :
(25) 
where is obtained as
(26) 
Once obtaining the steadystate probabilities given by (25), we can compute the optimal solution as
(27) 
From its definition (c.f. (14)), we can further determine the optimal transmission probabilities and .
Theorem 5.
The pair of the optimal transmission probabilities and satisfy
(28) 
for any channel state and for
(29) 
Remark: In Theorem 5, we show that the delay optimal scheduling algorithm is a thresholdbased transmission scheme. When the channel state is , the source transmits one backlogged packet with power if the queue length reaches the threshold , and otherwise remains silent. Note that the optimal threshold is when the channel state is . This implies that the source transmits one data packet, either newly arriving or stored, in each slot provided the channel condition is the best. There may exist multiple pairs of transmission probabilities and which satisfy the equation (29).
It is not trivial to derive the integer thresholds . Fortunately, we are able to reduce the computational complexity significantly by exploiting the monotonic property . For example, nested bisection methods can be applied to find the optimal thresholds . Then, we show that an elegant expression of the optimal thresholds can be derived in the case with .
Corollary 6.
In the twostate channel case with , the optimal transmission probabilities can be expressed as for all , and
(30) 
where the threshold is given by
(31) 
V Simulation Results
In this section, simulation results are presented to demonstrate the performance of the proposed scheduling scheme and validate our theoretical analysis. Each simulation runs over time slots. In each slot, the packet transmissions are scheduled according to our proposed policy. In the figures, the solid lines and the marks ’o’ indicate theoretical and simulation results, respectively. One can see that theoretical and simulation results match well.
Fig.5 plots the optimal delaypower tradeoff performance for the data arrival rate , and , respectively. We set , , the buffer capacity is set to , and the transmission power levels (watt). It is observed from Fig.5 that the minimum average queueing delay monotonically decreases with the increase of the power constraint . When more power can be consumed, the packets can be delivered more quickly since the source does not necessarily wait for the channel quality to turn better. When the power resource is sufficient with , each newly arriving packet can be delivered immediately regardless of the channel state and thus the queueing delay is zero. We also notice that to achieve a same average delay , the source consumes more power when data packets arrive more frequently with larger .
In Fig.6, we plot the optimal threshold on the queue length for the channel state , and , respectively, when the data arrival rate is . The thresholds satisfy for any power constraint. This means that the source should exploit relatively better channel conditions to transmit as possible. When the channel quality is the best with , the optimal threshold is equal to , regardless of the average power constraint . When or , the optimal threshold steps down with the increase of the power . Meanwhile, a smaller minimum average delay is observed from Fig.5, since highly depends on the largest queue length . When the average power is sufficiently large, , , all the thresholds are equal to zero and the minimum average delay is zero.
Vi Conclusions
In this paper, we investigated the delay optimal scheduling problem over a state wireless channel with fixed modulation. For a target BER, the source adjusts its transmission power according to the channel state . In this system, we proposed a stochastic scheduling policy: the source transmits one packet with probability or , depending on whether there is new data arrival, when the queue length is and the channel state is . By Markov chain modeling and variable substitution, we constructed an LP problem to minimize the average delay under the average power constraint. By exploiting the property of the LP problem, we revealed the structure of the optimal solution and then derived the optimal probabilities or . It was found that the source should always transmit as long as the channel quality is best. Otherwise, the source holds from transmission when the queue length is below the optimal threshold , and transmits with power when the data queue length exceeds the threshold , given the channel state . Simulation results confirmed our theoretical analysis.
References
 J. G. Andrews, S. Buzzi, W. Choi, S. V. Hanly, A. Lozano, A. C. K. Soong, and J. C. Zhang, “What will 5g be?” IEEE J. Sel. Areas Commun., vol. 32, no. 6, pp. 1065–1082, June 2014.
 B. E. Collins and R. L. Cruz, “Transmission policies for time varying channels with average delay constraints,” in in Proc. Ailerton Conference on Communication, Control, and Computing, Monticello, IL., 1999.
 R. A. Berry and R. G. Gallager, “Communication over fading channels with delay constraints,” IEEE Trans. Info. Theory, vol. 48, pp. 1135–1149, May 2002.
 R. A. Berry, “Optimal powerdelay tradeoffs in fading channel–smalldelay asymptotics,” IEEE Trans. Inf. Theory, vol. 59, no. 6, pp. 3939–3952, June 2013.
 M. Goyal, A. Kumar, and V. Sharma, “Power constrained and delay optimal policies for scheduling transmission over a fading channel,” in Proc. IEEE INFOCOM, 30 March3 April 2003, pp. 311–320.
 A. Helmy, L. Musavian, and T. LeNgoc, “Energyefficient power adaptation over a frequencyselective fading channel with delay and power constraints,” IEEE Trans. Wireless Commun., vol. 12, no. 9, pp. 4529–4541, Sep. 2013.
 M. Kalil, A. Shami, and A. AlDweik, “QoSaware powerefficient scheduler for LTE uplink,” IEEE Trans. Mobile Computing, to appear.
 E. UysalBiyikoglu, B. Prabhakar, and A. El Gamal, “Energyefficient packet transmission over a wireless link,” IEEE/ACM Trans. Networking, vol. 10, no. 4, pp. 487–499, Aug. 2002.
 W. Chen, Z. Cao, and K. B. Letaief, “Optimal delaypower tradeoff in wireless transmission with fixed modulation,” in Proc. International Workshop on Cross Layer Design (IWCLD), Jinan, Sep. 2007, pp. 60–64.
 T. G. Robertazzi, Computer Networks and Systems: Queueing Theory and Performance Evaluation, 3rd ed. SpringerVerlag New York, Inc., 2000.
 J. Yang and S. Ulukus, “Delayminimal transmission for average power constrained multiaccess communications,” IEEE Trans. Commun., vol. 9, no. 9, pp. 2754–2767, Sep. 2010.
 W. Chen, K. B. Letaief, and Z. Cao, “Bufferaware network coding for wireless networks,” IEEE/ACM Trans. Networking, vol. 20, no. 5, pp. 1389–1401, Oct. 2012.