Asynchronous Iterative Waterfilling for Gaussian Frequency-Selective Interference Channels
Revised September 25, 2007. Accepted January 14, 2008.††thanks: Part of this work was presented in IEEE Workshop on Signal Processing Advances in Wireless Communications, (SPAWC-2006), July 2-5, 2006, and in Information Theory and Applications (ITA) Workshop, Jan. 29 - Feb. 2, 2007. This work was supported by the SURFACE project funded by the European Community under Contract IST-4-027187-STP-SURFACE.
This paper considers the maximization of information rates for the
Gaussian frequency-selective interference channel, subject to power
and spectral mask constraints on each link. To derive decentralized
solutions that do not require any cooperation among the users, the
optimization problem is formulated as a static noncooperative game
of complete information. To achieve the so-called Nash equilibria
of the game, we propose a new distributed algorithm called asynchronous
iterative waterfilling algorithm. In this algorithm, the users update
their power spectral density in a completely distributed and asynchronous
way: some users may update their power allocation more frequently
than others and they may even use outdated measurements of the received
interference. The proposed algorithm represents a unified framework
that encompasses and generalizes all known iterative waterfilling
algorithms, e.g., sequential and simultaneous versions.
The main result of the paper consists of a unified set of conditions that guarantee the
global converge of the proposed algorithm to the (unique) Nash equilibrium
of the game.
Index Terms: Game theory, Gaussian frequency-selective interference channel, Nash equilibrium, totally asynchronous algorithm, iterative waterfilling algorithm.
1 Introduction and Motivation
In this paper we focus on the frequency selective interference channel with Gaussian noise. The capacity region of the interference channel is still unknown. Only some bounds are available (see, e.g., [1, 4] for a summary of the known results about the Gaussian interference channel). A pragmatic approach that leads to an achievable region or inner bound of the capacity region is to restrict the system to operate as a set of independent units, i.e., not allowing multiuser encoding/decoding or the use of interference cancelation techniques. This achievable region is very relevant in practical systems with limitations on the decoder complexity and simplicity of the system. With this assumption, multiuser interference is treated as noise and the transmission strategy for each user is simply his power allocation. The system design reduces then to finding the optimum Power Spectral Density (PSD) for each user, according to a specified performance metric.
Within this context, existing works  considered the maximization of the information rates of all the links, subject to transmit power and (possibly) spectral mask constraints on each link. The latter constraints are especially motivated in adaptive scenarios, e.g., cognitive radio, where previously allocated spectral bands may be reused, but provided that the generated interference falls below specified thresholds . In [9, 12], a centralized approach based on duality theory was proposed to compute, under technical conditions, the largest achievable rate region of the system (i.e., the Pareto-optimal set of the achievable rates). Our interest, in this paper, is focused on finding distributed algorithms with no centralized control and no cooperation among the users. Hence, we cast the system design under the convenient framework of game theory. In particular, we formulate the rate maximization problem as a strategic non-cooperative game of complete information, where every link is a player that competes against the others by choosing the spectral power allocation that maximizes his own information rate. An equilibrium for the whole system is reached when every player is unilaterally optimum, i.e., when, given the current strategies of the others, any change in his own strategy would result in a rate loss. This equilibrium constitutes the celebrated notion of Nash Equilibrium (NE) .
The Nash equilibria of the rate maximization game can be reached using Gaussian signaling and a proper PSD from each user . To obtain the optimal PSD of the users, Yu, Ginis, and Cioffi proposed the sequential Iterative WaterFilling Algorithm (IWFA)  in the context of DSL systems, modeled as a Gaussian frequency-selective interference channel. The algorithm is an instance of the Gauss-Seidel scheme : the users maximize their own information rates sequentially (one after the other), according to a fixed updating order. Each user performs the single-user waterfilling solution given the interference generated by the others as additive (colored) noise. The most appealing features of the sequential IWFA are its low-complexity and distributed nature. In fact, to compute the waterfilling solution, each user only needs to measure the noise-plus-interference PSD, without requiring specific knowledge of the power allocations and the channel transfer functions of all other users. The convergence of the sequential IWFA has been studied in a number of works , , each time obtaining milder convergence conditions. However, despite its appealing properties, the sequential IWFA may suffer from slow convergence if the number of users in the network is large, just because of the sequential updating strategy. In addition, the algorithm requires some form of central scheduling to determine the order in which users update their PSD.
To overcome the drawback of slow speed of convergence, the simultaneous IWFA was proposed in [24, 30, 33]. The simultaneous IWFA is an instance of the Jacobi scheme : at each iteration, the users update their own strategies simultaneously, still according to the waterfilling solution, but using the interference generated by the others in the previous iteration. The simultaneous IWFA was shown to converge to the unique NE of the rate maximization game faster than the sequential IWFA and under weaker conditions on the multiuser interference than those given in [15, 18],  for the sequential IWFA. Furthermore, differently from [15, 18, 36, 42], the algorithm as proposed in  takes explicitly into account the spectral masks constraints. However, the simultaneous IWFA still requires some form of synchronization, as all the users need to be updated simultaneously. Clearly, in a real network with many users, the synchronization requirement of both sequential and simultaneous IWFAs goes against the non-cooperation principle and it might be unacceptable.
This paper generalizes the existing results for the sequential and simultaneous IWFAs and develops a unified framework based on the so-called asynchronous IWFA, that falls within the class of totally asynchronous schemes of . In this more general algorithm, all users still update their power allocations according to the waterfilling solution, but the updates can be performed in a totally asynchronous way (in the sense of ). This means that some users may update their power allocations more frequently than others and they may even use an outdated measurement of the interference caused from the others. These features make the asynchronous IWFA appealing for all practical scenarios, either wired or wireless, as it strongly relaxes the need for coordinating the users’ updating schedule.
The main contribution of this paper is to derive sufficient conditions for the global convergence of the asynchronous IWFA to the (unique) NE of the rate maximization game. Interestingly, our convergence conditions are shown to be independent of the users’ update schedule. Hence, they represent a unified set of conditions encompassing all existing algorithms, either synchronous or asynchronous, that can be seen as special cases of our asynchronous IWFA. Our conditions also imply that both sequential and simultaneous algorithms are robust to situations where some users may fail to follow their updating schedule. Finally, we show that our sufficient conditions for the convergence of the asynchronous IWFA coincide with those given recently in  for the convergence of the (synchronous) sequential and simultaneous IWFAs, and are larger than conditions obtained in [15, 18],  for the convergence of the sequential IWFA in the absence of spectral mask constraints.
The paper is organized as follows. Section 2 provides the system model and formulates the optimization problem as a strategic non-cooperative game. Section 3 contains the main result of the paper: the description of the proposed asynchronous IWFA along with its convergence properties. Section 4 recovers the sequential and simultaneous IWFAs as special cases of the asynchronous IWFA and then, as a by product, it provides a unified set of convergence conditions for both algorithms. Finally, Section 5 draws some conclusions.
2 System Model and Problem Formulation
In this section we clarify the assumptions and the constraints underlying the system model and we formulate the optimization problem addressed in this paper explicitly.
2.1 System model
We consider a Gaussian frequency-selective interference channel composed by multiple links. Since our goal is to find distributed algorithms that require neither a centralized control nor a coordination among the users, we focus on transmission techniques where interference cancelation is not possible and multiuser interference is treated by each receiver as additive colored noise. The channel frequency-selectivity is handled, with no loss of optimality, adopting a multicarrier transmission strategy.111Multicarrier transmission is a capacity-lossless strategy for sufficiently large block length [60, 63]. Given the above system model, we make the following assumptions:
A.1 Each channel changes sufficiently slowly to be considered fixed during the whole transmission, so that the information theoretic results are meaningful;
A.2 The channel from each source to its own destination is known to the intended receiver, but not to the other terminals; each receiver is also assumed to measure with no errors the overall PSD of the noise plus interferences generated by the other users. Based on this information, each receiver computes the optimal power allocation across the frequency bins for its own transmitter and feeds it back to its transmitter through a low bit rate (error-free) feedback channel.222In practice, both measurements and feedback are inevitably affected by errors. This scenario can be studied by extending our formulation to games with partial information [66, 69], but this goes beyond the scope of the present paper.
A.3 All the users are block-synchronized with an uncertainty at most equal to the cyclic prefix length. This imposes a minimum length of the cyclic prefix that will depend on the maximum channel delay spread.
We consider the following constraints:
Co.1 Maximum overall transmit power for each user:
where contains the symbols transmitted by user on the carriers, denotes the power allocated by user over carrier and is power in units of energy per transmitted symbol.
Co.2 Spectral mask constraints:
where represents the maximum power that is allowed to be allocated on the -th frequency bin from the -th user. Constraints like (2) are imposed to limit the amount of interference generated by each transmitter over pre-specified bands.
The main goal of this paper is to obtain the optimal vector power allocation , for each user, according to the optimality criterion introduced in the next section.
2.2 Problem formulation as a game
We consider a strategic non-cooperative game [66, 69], in which the players are the links and the payoff functions are the information rates on each link: Each player competes rationally333The rationality assumption means that each user will never chose a strictly dominated strategy. A strategy profile is strictly dominated by if for a given admissible where denotes the payoff function of player against the others by choosing the strategy that maximizes his own rate, given constraints Co.1 and Co.2. A NE of the game is reached when every user, given the strategy profile of the others, does not get any rate increase by changing his own strategy.
Using the signal model described in Section 2.1, the achievable rate for each player is computed as the maximum information rate on the -th link, assuming all the other received signals as additive colored noise. It is straightforward to see that a (pure or mixed strategy) NE is obtained if each user transmits using Gaussian signaling, with a proper PSD. In fact, for each user, given that all other users use Gaussian codebooks, the optimal codebook maximizing mutual information is also Gaussian .444Observe that, in general, Nash equilibria achievable using arbitrary non-Gaussian codes may exist. In this paper, we focus only on transmission using Gaussian codebooks. Hence, the maximum achievable rate for the -th user is given by 
with denoting the Signal-to-Interference plus Noise Ratio (SINR) on the -th carrier for the -th link:
where denotes the frequency-response of the channel between source and destination excluding the path-loss with exponent and is the distance between source and destination ; is the variance of the zero mean circularly symmetric complex Gaussian noise at receiver over the carrier ; and for the convenience of notation, we have introduced the normalized quantities and .
Observe that in the case of practical coding schemes, where only finite order constellations can be used, we can use the gap approximation analysis [72, 75] and write the number of bits transmitted over the substreams from the -th source still as in (3) but replacing in (4) with where is the gap. The gap depends only on the family of constellation and on ; for -QAM constellations, for example, if the symbol error probability is approximated by the resulting gap is [72, 75].
In summary, we have a game with the following structure:
where denotes the set of the active links, is the set of admissible (normalized) power allocation strategies, across the available carriers, for the -th player, defined as555In order to avoid the trivial solution for all , is assumed for all . Furthermore, in the feasible strategy set of each player, we can replace, without loss of generality, the original inequality power constraint with equality since, at the optimum, this constraint must be satisfied with equality.
with and is the payoff function of the -th player, defined in (3).
The optimal strategy for the -th player, given the power allocation of the others, is then the solution to the following maximization problem666In the optimization problem in (7), any concave strictly increasing function of the rate can be equivalently considered as payoff function of each player. The optimal solutions of this new set of problems coincide with those of (7).
The solutions of (7) are the well-known Nash Equilibria, which are formally defined as follows.
A (pure) strategy profile is a Nash Equilibrium of the game in 5 if
Observe that, for the payoff functions defined in (3), we can indeed limit ourselves to adopt pure strategies w.l.o.g., as we did in (5), since every NE of the game is proved to be achievable using pure strategies in .
According to (7), all the (pure) Nash equilibria of the game, if they exist, must satisfy the waterfilling solution for each user, i.e., the following system of nonlinear equations:
with the waterfilling operator defined as
where denotes the Euclidean projection of onto the interval .777The Euclidean projection , with , is defined as follows: , if , , if , and , if . The water-level is chosen to satisfy the power constraint
Observe that in the absence of spectral mask constraints (i.e., when , ), the Nash equilibria of game are given by the classical simultaneous waterfilling solutions [15, 18], where in (9) is still obtained from (10) simply setting , Interestingly, the presence of spectral mask constraints does not affect the existence of a pure-strategies NE of game , as stated in the following.
The game in (5) always admits at least one pure-strategy NE, for any set of channel realizations, power and spectral mask constraints.
In general, the game may admit multiple equilibria, depending on the level of multiuser interference . In the forthcoming sections, we provide sufficient conditions ensuring the uniqueness of the NE and we address the problem of how to reach such an equilibrium in a totally distributed way.
3 Asynchronous Iterative Waterfilling
To reach the NE of game , we propose a totally asynchronous distributed iterative waterfilling procedure, which we name asynchronous Iterative WaterFilling Algorithm. The proposed algorithm can be seen as an instance of the totally asynchronous scheme of : all the users maximize their own rate in a totally asynchronous way. More specifically, some users are allowed to update their strategy more frequently than the others, and they might perform their updates using outdated information about the interference caused from the others. What we show is that the asynchronous IWFA converges to a stable NE of game , whichever the updating schedule is, under rather mild conditions on the multiuser interference. Interestingly, these conditions are also sufficient to guarantee the uniqueness of the NE.
To provide a formal description of the asynchronous IWFA, we need to introduce some preliminary definitions. We assume, without any loss of generality, that the set of times at which one or more users update their strategies is the discrete set Let denote the vector power allocation of user at the -th iteration, and let denote the set of times at which user updates his power vector (thus, implying that, at time is left unchanged). Let denote the most recent time at which the interference from user is perceived by user at the -th iteration (observe that satisfies ). Hence, if user updates its power allocation at the -th iteration, then it waterfills, according to (10), the interference level caused by the power allocations of the others:
The overall system is said to be totally asynchronous if the following weak assumptions are satisfied for each : A1) ; A2) ; and A3) ; where is a sequence of elements in that tends to infinity. Assumptions A1A3 are standard in asynchronous convergence theory , and they are fulfilled in any practical implementation. In fact, A1 simply indicates that, at any given iteration , each user can use only the interference vectors allocated by the other users in the previous iterations (to preserve causality). Assumption A2 states that, for any given iteration index the values of the components of in (11) generated prior to are not used in the updates of , when becomes sufficiently larger than ; which guarantees that old information is eventually purged from the system. Finally, assumption A3 indicates that no user fails to update its own strategy as time goes on.
Given game let denote the set (possibly) deprived of the carrier indices that user would never use as the best response set to any strategies adopted by the other users :
with the convention that the maximum in (13) is zero if is empty. In (13), each set can be chosen as any subset of such that , with defined in (12). Using the above notation, the asynchronous IWFA is described in Algorithm 1 (where denotes the number of iterations).
Algorithm 1: Asynchronous Iterative Waterfilling Algorithm
Set and any feasible power allocation;
The convergence of the algorithm is guaranteed under the following sufficient conditions.
Assume that the following condition is satisfied:
where is defined in (13) and denotes the spectral radius888The spectral radius of the matrix is defined as , with denoting the set of eigenvalues of . of . Then, as , the asynchronous IWFA described in Algorithm 1 converges to the unique NE of game , for any set of feasible initial conditions and updating schedule.
Proof. The proof consists in showing that, under (C1), conditions of the Asynchronous Convergence Theorem in  are satisfied. A key point in the proof is given by the following property of the multiuser waterfilling mapping based on the interpretation of the waterfilling solution (10) as a proper projector :
To give additional insight into the physical interpretation of the convergence conditions of Algorithm 1, we provide the following corollary of Theorem 1.
Note that, according to the definition of in (13), one can always choose in (C1) and (C2)-(C3). However, less stringent conditions are obtained by removing unnecessary carriers, i.e., the carriers that, for the given power budget and interference levels, are never going to be used.
Remark 1 - Global convergence and robustness of the algorithm: Even though the rate maximization game in (7) and the consequent waterfilling mapping (10) are nonlinear, condition (C1) guarantees the global convergence of the asynchronous IWFA. Observe that Algorithm 1 contains as special cases a plethora of algorithms, each one obtained by a possible choice of the scheduling of the users in the updating procedure (i.e., the parameters and ). The important result stated in Theorem 1 is that all the algorithms resulting as special cases of the asynchronous IWFA are guaranteed to reach the unique NE of the game, under the same set of convergence conditions (provided that A1A3 are satisfied), since condition (C1) does not depend on the particular choice of and
Remark 2 - Physical interpretation of convergence conditions: As expected, the convergence of the asynchronous IWFA and the uniqueness of NE are ensured if the interferers are sufficiently far apart from the destinations. In fact, from (C2)-(C3) one infers that, for any given set of channel realizations and power constraints, there exists a distance beyond which the convergence of the asynchronous IWFA (and the uniqueness of NE) is guaranteed, corresponding to the maximum level of interference that may be tolerated by each receiver [as quantified, e.g., in (C2)] or that may be generated by each transmitter [as quantified, e.g., in (C3)]. But the most interesting result coming from (C1) and (C2)-(C3) is that the convergence of the asynchronous IWFA is robust against the worst normalized channels in fact, the subchannels corresponding to the highest ratios (and, in particular, the subchannels where is vanishing) do not necessarily affect the convergence of the algorithm, as their carrier indices may not belong to the set .
Remark 3 - Distributed nature of the algorithm: Since the asynchronous IWFA is based on the waterfilling solution (10), it can be implemented in a distributed way, where each user, to maximize his own rate, only needs to measure the PSD of the overall interference-plus-noise and waterfill over it. More interestingly, according to the asynchronous scheme, the users may update their strategies using a potentially outdated version of the interference. Furthermore, some users are even allowed to update their power allocation more often than others, without affecting the convergence of the algorithm. These features strongly relax the constraints on the synchronization of the users’ updates with respect to those imposed, for example, by the simultaneous or sequential updating schemes.
We can generalize the asynchronous IWFA given in Algorithm 1 by introducing a memory in the updating process, as given in Algorithm 2. We call this new algorithm smoothed asynchronous IWFA.
Algorithm 2: Smoothed Asynchronous Iterative Waterfilling Algorithm
Set and any feasible power allocation and ;
Each factor in Algorithm 2 can be interpreted as a forgetting factor: The larger is, the longer the memory of the algorithm is.101010In this paper, we are only considering constant channels. Nevertheless, in a time-varying scenario, (16) could be used to smooth the fluctuations due to the channel variations. In such a case, if the channel is fixed or highly stationary, it is convenient to take close to ; conversely, if the channel is rapidly varying, it is better to take a small . Interestingly the choice of ’s does not affect the convergence capability of the algorithm (although it may affect the speed of convergence ), as proved in the following.
Assume that condition of Theorem 1 is satisfied. Then, as , the smoothed asynchronous IWFA described in Algorithm 2 converges to the unique NE of game , for any set of feasible initial conditions, updating schedule, and with .
Proof. See Appendix A.
Remark 4 - Asynchronous IWFA in the presence of intercarrier interference: The proposed AIWFA can be extended to the case where the transmission by the different users contains time and frequency synchronization offsets. In [54, 57] we showed that the Asynchronous IWFA is robust against the intercarrier interference due to time and/or frequency offsets among the links and we derived sufficient conditions guaranteeing its convergence in the presence of such time/frequency misalignments.
4 Two Special Cases: Sequential and Simultaneous IWFAs
In this section, we specialize our asynchronous IWFA to two special cases: the sequential and the simultaneous IWFAs. As a by-product of the proposed unified framework, we show that both algorithms converge to the NE under the same sufficient conditions, that are larger than conditions obtained for the convergence of the sequential IWFA in [15, 18], ,  (without considering the spectral mask constraints) and  (including the spectral mask constraints).
Sequential Iterative Waterfilling: The sequential IWFA is an instance of the Gauss-Seidel scheme by which each user is sequentially updated  based on the waterfilling mapping (10). In fact, in sequential IWFA each player, sequentially and according to a fixed order, maximizes his own rate (3), performing the single-user waterfilling solution in (10), given the others as interference. This scheme can also be seen as a particular case of the general asynchronous IWFA with the following parameters: and Using this settings in Algorithm 1, the sequential IWFA can be written in compact form as in Algorithm 4.
Algorithm 3: Sequential Iterative Waterfilling Algorithm
Set and any feasible power allocation;
Simultaneous Iterative Waterfilling: The simultaneous IWFA can be interpreted as the synchronous Jacobi instance of the asynchronous IWFA. In fact, in the simultaneous IWFA, all the users update their own covariance matrix simultaneously at each iteration, performing the single user waterfilling solution (10), given the interference generated by the other users in the previous iteration. This is a particular case of the asynchronous IWFA in Algorithm 1 with the following parameters: and which leads to Algorithm 4.
Algorithm 4: Simultaneous Iterative Waterfilling Algorithm
Set and any feasible power allocation;
Remark 5 - Algorithm robustness: It follows form Theorem 3 that slight variations of the sequential or simultaneous IWFAs that fall within the unified framework of the asynchronous IWFA, are still guaranteed to converge, under the condition in Theorem 1. This means that, using for example Algorithm 4, if the order in the users’ updates changes during time, or some user skips some update, or he uses an outdated version of the interference PSD, this does not affect the convergence of the algorithm. What is affected is only the convergence time. Moreover, as for the smoothed asynchronous IWFA, also for the sequential and simultaneous IWFAs described in Algorithm 4 and 4, respectively, one can introduce a memory in the updating process , still guaranteeing convergence under conditions of Theorem 3.
Remark 6 - Comparison with previous convergence conditions: Algorithm 4 generalizes the well-known sequential iterative waterfilling algorithm proposed by Yu et al. in  to the case where the spectral mask constraints are explicitly taken into account. In fact, the algorithm in  can be obtained as a special case of Algorithm 4, by removing the spectral mask constraints in each set in (6), (i.e. setting ), so that the waterfilling operator in (10) becomes the classical waterfilling solution , i.e., where and with . The convergence of the sequential IWFA has been studied in a number of works, either in the absence [15, 18, 21, 36, 42] or in the presence [30, 39] of spectral mask constraints. Interestingly, conditions in [15, 18, 21, 36, 42] and  imply our condition (C1), which is more relaxed as shown next. Let
with and denoting the strictly lower and strictly upper triangular part of the matrix , respectively, and is defined similar to in (13), but taking the maximum over the whole set The relationship between (sufficient) conditions for the convergence of sequential IWFA as derived in [15, 18, 21, 36, 39, 42] and condition (C1)111111Recall that condition (C1) guarantees also the convergence of the more general asynchronous IWFA, as stated in Theorem 1. is given in the following corollary of Theorem 3.
Proof. See Appendix B.
Since the convergence conditions in Corollary 2 depend on the channel realizations and on the distances there is a nonzero probability that they are not satisfied for a given channel realization, drawn from a given probability space. To compare the range of validity of our conditions vs. the conditions available in the literature, we tested them over a set of channel impulse responses generated as vectors composed of i.i.d. complex Gaussian random variables with zero mean and unit variance (multipath Rayleigh fading model). Each user transmits over a set of subcarriers. We consider a multicell cellular network as depicted in Figure 1(a), composed by (regular) hexagonal cells, sharing the same band. Hence, the transmissions from different cells typically interfere with each other. For the simplicity of representation, we assume that in each cell there is only one active link, corresponding to the transmission from the base station (BS) to a mobile terminal (MT) placed at a corner of the cell. According to this geometry, each MT receives a useful signal that is comparable, in average sense, with the interference signal transmitted by the BSs of two adjacent cells. The overall network is modeled as a set of seven wideband interference channels. In Figure 1(b), we plot the probability that conditions (C1), (C4) and (C6) are satisfied versus the (normalized) distance (see Figure 1(a)), between each MT and his BS (assumed to be equal for all the MT/BS pairs). We tested our conditions considering the set obtained using the algorithm described in .
As expected, the probability of guaranteeing convergence increases as each MT approaches his BS (i.e., ). What is worthwhile noticing is that our condition (C1) significantly enlarges (C4) and (C6), since the probability that (C1) is satisfied is always much larger than (C4) and (C6).
Remark 7 - Sequential versus simultaneous IWFA: Since the simultaneous IWFA in Algorithm 4 is still based on the waterfilling solution (10), it keeps the most appealing features of the sequential IWFA, namely its low-complexity and distributed nature. In addition, it allows all the users to update their optimal power allocation simultaneously. Hence, the simultaneous IWFA is faster than the sequential IWFA, especially if the number of active users in the network is large. A quantitative comparison between the sequential and simultaneous IWFAs, in terms of convergence speed, is given in . In , we also provided a closed form expression of the error estimates as a function of the iteration index, obtained by the sequential and simultaneous IWFAs.
In this paper, we have studied the maximization of the information rates for the Gaussian frequency-selective interference channel, given constraints on the transmit power and the spectral masks on each link. We have formulated the optimization problem as a strategic noncooperative game and we have proposed a novel, totally asynchronous iterative distributed algorithm, named asynchronous IWFA, to reach the Nash equilibria of the game. This algorithm contains as special cases the well-known sequential IWFA and the recently proposed simultaneous IWFA, where the users update their strategies sequentially and simultaneously, respectively. The main advantage of the proposed algorithm is that no rigid scheduling in the updates of the users is required: Users are allowed to choose their own strategies whenever they want and some users may even use an outdated version of the measured multiuser interference. This relaxes the coordination requirements among the users significantly. Finally, we have provided the conditions ensuring the global convergence of the asynchronous IWFA to the unique NE of the game. Interestingly, our convergence conditions do not depend on the specific updating scheduling performed by the users and, hence, they represent a unified set of convergence conditions for all the algorithms that can be seen as special cases of the asynchronous IWFA.
Properties of the waterfilling mapping. For technical reasons, we define the admissible set where
is the subset of containing all the feasible power allocations of user , with zero power over the carriers that user would never use in any of its waterfilling solutions (10), against any admissible strategy of the others. Observe that the game does not change if we use instead of the original . For any given with let be the mapping defined, for each as
where is the waterfilling operator defined in (10). Observe that all the Nash equilibria of game correspond to the fixed points in of the mapping in (21). Hence, the existence of at least one fixed point for is guaranteed by Proposition 1.
where is the Euclidean norm. Let be the vector weighted maximum norm defined as 
and let denote the matrix norm induced by defined as 
Finally, we introduce the matrix defined as
Theorem 4 (Contraction property of mapping )
Asynchronous convergence theorem . Let be given sets, and let be their Cartesian product, i.e.,
Let be a given vector function and let be the mapping from to , defined as and assumed to admit a fixed point Consider the following distributed asynchronous iterative algorithm to reach
with and denoting the set of times at which is updated and satisfying A1A3 of Section 3. Assume that:
(Nesting Condition) There exists a sequence of nonempty sets with
satisfying the next two conditions.
Synchronous Convergence Condition
Furthermore, if is a sequence such that for every then every limit point of is a fixed point of
Box Condition For every there exist sets such that
Then we have the following .
Theorem 5 ([51, Proposition 2.1])
We are now ready to prove Theorems 1 and 2 through the following two steps:
Step 1. We first show that the asynchronous IWFA in Algorithms 1 and 2 is an instance of the totally asynchronous iterative algorithm in (28). Then, using Theorem 4, we derive sufficient conditions for C.1-C.3.
Step 1. It is straightforward to see that the asynchronous IWFA coincides with the algorithm given in (28), under the following identifications
where and are defined in (20) and (21), respectively. Observe that, to study the convergence of the asynchronous IWFA, there is no loss of generality in considering the mapping defined in instead of since all the points produced by the algorithm (except possibly the initial point, which does not affect the convergence of the algorithm in the subsequent iterations) as well as the Nash equilibria of the game are confined, by definition, in .
We consider now conditions C.1-C.3 separately.
C.1 (Nested Condition) Let be a fixed point of in (21) (or, equivalently of in (28)) and be any starting point of the asynchronous IWFA. Using the block-maximum norm as defined in (22), where is any positive vector, we define the set in (29) as
then we obtain the desired result, i.e.,
A necessary and sufficient condition for (35) is
We will assume in the following that (36) is satisfied.
C.2 (Synchronous Convergence Condition) Let Then, from (33), it must be that
Let . Then, we have
the sequence generated from by the mapping using the simultaneous updating scheme in (30) must converge to . Moreover, it follows from (36) and Theorem 4 that the fixed point of is unique (implied from the fact that the mapping is a block-contraction [51, Proposition 1.1]).
C.3 (Box Condition) For every the set in (33) can be decomposed as with
Step 2. Under (36), Theorem 5 is satisfied if the starting point of the asynchronous IWFA is such that The asynchronous IWFA, as given in Algorithm 1 and Algorithm 2, is allowed to start from any arbitrary point in However, after the first iteration from all the users, the asynchronous IWFA provides a point in for any Hence, under (36), the asynchronous IWFA satisfies Theorem 5, after the first iteration, which still guarantees that every limit point of the sequence generated by the asynchronous IWFA is a NE of the game . Since condition (36) is also sufficient for the uniqueness of the NE [recall that, under (36), the mapping in (21) is a block-contraction], the asynchronous IWFA must converge to this unique NE.