Disaggregated Bundle Methods for Distributed Market Clearing in Power Networks

Disaggregated Bundle Methods for Distributed Market Clearing in Power Networks


A fast distributed approach is developed for the market clearing with large-scale demand response in electric power networks. In addition to conventional supply bids, demand offers from aggregators serving large numbers of residential smart appliances with different energy constraints are incorporated. Leveraging the Lagrangian relaxation based dual decomposition, the resulting optimization problem is decomposed into separate subproblems, and then solved in a distributed fashion by the market operator and each aggregator aided by the end-user smart meters. A disaggregated bundle method is adapted for solving the dual problem with a separable structure. Compared with the conventional dual update algorithms, the proposed approach exhibits faster convergence speed, which results in reduced communication overhead. Numerical results corroborate the effectiveness of the novel approach.


Aggregators, decomposition algorithms, demand response, disaggregated bundle method, market clearing.

1 Introduction

Demand response (DR) has been identified as an important resource management task in modern power networks promising to enable end-user interaction with the grid. DR aggregators serving large numbers of residential users will be able to participate in the market clearing by offering bids depending on the elasticity for power consumption of their end users. Bidirectional communication between aggregators and users is provided by the Advanced Metering Infrastructure (AMI) [1], with smart meters used as the end-users’ terminals.

The principal challenge for large-scale incorporation of DR from residential end-users is to account for the user scheduling preferences and intertemporal flexibility in a way that also protects user privacy. The advantages of intertemporal load scheduling flexibility are for instance demonstrated in [2, 3], but without considering small-scale users and pertinent distributed algorithms. Aggregation of small-scale user loads into the system scheduling has been the theme of [4, 5], but an array of issues ranging from incorporation of user utility functions and user privacy to algorithm convergence, are not fully addressed. Algorithms for market clearing with large-scale integration of DR from small loads with different utility functions are developed in [6] based on Lagrangian dual decomposition. The disaggregated cutting plane method (CPM) is proposed therein for updating the Lagrange multipliers.

This paper proposes a market clearing approach distributed among the market operator, aggregators, and the user smart meters by building upon the earlier work in [6]. Each end-user has preferences for smart appliance scheduling captured by utility functions and intertemporal constraints. The objective is to minimize the social net cost for day-ahead market clearing, while transmission network constraints are included in the form of DC power flows. To cope with the challenges of respecting end-user privacy and large-scale DR, dual decomposition is applied to the resulting optimization problem. Leveraging Lagrangian relaxation of the coupling constraints, the large-scale optimization decomposes into manageable small problems solved by the market operator (MO) and the aggregators in conjunction with the residential smart meters. Exploiting the separable structure of the problem at hand, a disaggregated bundle method is introduced for solving the dual problem with guaranteed convergence of the Lagrange multipliers. The developed solver yields faster convergence than its CPM counterpart, implying less communication overhead between the MO and the aggregators.

The remainder of this paper is organized as follows. Section 2 presents the market clearing problem involving large-scale DR. The decomposition algorithm along with the disaggregated bundle method solver is developed in Section 3. Numerical tests are in Section 4, while conclusions and future directions are offered in Section 5.

2 Market Clearing Formulation

Consider a power network comprising generators, buses, lines, and aggregators, each serving a large number of residential end-users with controllable smart appliances. The scheduling horizon of interest is (e.g., one day ahead). Let and denote the generator power outputs, and the power consumption of the aggregators at slot , respectively.1 Define further the sets and . Each aggregator serves a set of residential users, and each user has a set of controllable smart appliances. Let be the power consumption of smart appliance and user corresponding to aggregator across the horizon. The power consumption of each smart appliance across the horizon must typically satisfy operating constraints captured by a set , and may also give rise to user satisfaction represented by a concave utility function . Moreover, the generation cost is captured by convex functions , and the fixed base load demands across the network buses at slot is denoted by the vector .

For brevity, vector is used to collect all , , and network nodal angles ; while vector () collects all smart appliance consumptions corresponding to aggregator . With the goal of minimizing the system net cost, the DC optimal power flow (OPF) based market clearing stands as follows:

s. t. (1b)

Linear equality (1b) represents the nodal balance constraint. Limits of generator outputs and ramping rates are specified in constraints (1c) and (1d). Network line flow constraints are accounted for in (1e). Without loss of generality, the first bus can be set as the reference bus with zero phase (1f). Constraint (1g) captures the lower and upper bounds on the energy consumed by the aggregators. Equality (1h) amounts to the aggregator-users power balance equation; finally, (1i) gives the smart appliance constraints.

A smart appliance example is charging a PHEV battery, which typically amounts to consuming a prescribed total energy over a specific horizon from a start time to a termination time . The consumption must remain within a range between and per period. With , set takes the form


Further examples of and can be found in [6], where it is argued that is a convex set for several appliance types of interest.

Matrices and are defined as follows. With denoting the reactance of line , the bus admittance matrix has elements

where if line does not exist. Matrix has entries so that if line connects buses and , then

Finally, examples detailing the entries of matrices and in (1b) can be found in [6].

Problem (1) can be principally solved at the MO in a central fashion. However, there are two major challenges when it comes to solving (1) with large-scale DR: i) functions and sets are private, and cannot be revealed to the MO; ii) including the sheer number of variables would render the overall problem intractable for the MO, regardless of the privacy issue. The aggregator plays a critical role in successfully addressing these two challenges through decomposing the optimization tasks that arises, as detailed in the ensuing section.

3 Decomposition Algorithm

3.1 Dual Decomposition

Leveraging the dual decomposition technique, problem (1) can be decoupled into simpler subproblems tackled by the MO and the aggregators. Specifically, consider dualizing the linear coupling constraint (1h) with corresponding Lagrange multiplier . Upon straightforward re-arrangements, the partial Lagrangian can be written as




The dual function is thus obtained by minimizing the partial Lagrangian over the primal variables as


The dual decomposition essentially iterates between two steps: S1) Lagrangian minimization with respect to given the current multipliers, and S2) multiplier update, using the obtained primal minimizers. It is clear from (3) that the Lagrangian minimization can be decoupled into minimizations, where one is performed by the MO, and the rest by the corresponding aggregators.

Specifically, let index iterations. Given the multipliers , the subproblems at iteration solved by the MO and each residential end-user are given as follows

(7a) (7b)

Note that subproblem (7a) is a standard DC-OPF while the convex subproblem (7b) can be handled efficiently by the smart meters. In fact, with the feasible set in (2) and upon setting , (7b) boils down to the fractional knapsack problem, which can be solved in closed form. To this end, the multipliers needed can be transmitted to the user’s smart meter via the AMI.

With the obtained quantities of , , and , the ensuing section develops the approach to updating the multipliers using the so-termed bundle methods.

3.2 Multiplier Update via Bundle Methods

The choice of the multiplier update method is crucial, because fewer update steps imply less communication between the CPM and the aggregators. A popular method of choice in the context of dual decomposition is the subgradient method, which is very slow typically. In this paper, the bundle method with disaggregated cuts is proposed for the multiplier update. It is better suited to the problem of interest yielding faster convergence, because it exploits the special structure of the dual function which can be written as a sum of separate terms [cf. (6)], while it overcomes the drawbacks of the cutting plane one developed in [6]. Numerical tests in Section 4 illustrate differences in terms of convergence speed.

The following overview of the disaggregated bundle method in a general form is useful to grasp its role in the present context; see e.g., [7, Ch. 6] for detailed discussions. Consider the following separable convex minimization problem with linear constraints:

s. t. (8b)

For problem (1), constraint (8b) corresponds to (1h). Set captures constraints (1b)–(1g), while , , corresponds to (1i).

The dual function can be obtained by dualizing constraint (8b) with the multiplier vector . Thus, the dual problem is to maximize the dual objective as


where strong duality holds here due to the polyhedral feasible set (8b).

The basic idea of bundle methods (also CPM) is to approximate the epigraph of a convex (possibly non-smooth) objective function as the intersection of a number of supporting hyperplanes (also called cuts in this context). The approximation is gradually refined by generating additional cuts based on subgradients of the objective function.

Specifically, suppose that the method has so far generated the iterates after steps. Let be the primal minimizer corresponding to . Observe that the vector is a subgradient of function at point , and it thus holds for all such that


Clearly, the minimum of the right-hand side of (10) over is a polyhedral approximation of , and is essentially a concave and piecewise linear overestimator of the dual function.

The bundle method with disaggregated cuts generates a sequence with guaranteed convergence to an optimal solution. Specifically, the iterate is obtained by maximizing the polyhedral approximations of with a proximal regularization

s. t.

where the proximity weight is to control stability of the iterates; and the proximal center is updated according to a query for ascent

where , and . Finally, the bundle algorithm can be terminated when holds for a prescribed tolerance (cf. [7, Ch. 6]).

Remark 1 .

(Bundle methods versus CPM). When , problem (11) boils down to the CPM with disaggregated cuts for solving the dual, which is however known to be unstable and converges slowly on some practical instances [8]. The proximal regularization in the bundle methods is thus introduced to improve stability of the iterates, while the smart prox-center updating rule enhances further the convergence speed compared with the proximal CPM. A further limitation of CPM is that a compact set containing the optimal solution has to be included, as is the case with in [6]. The CPM convergence performance depends on the choice of this set, while there is no such issue for the bundle methods. Note further that the dual problem of (11) is a quadratic program (QP) over a probability simplex. Such a special structure can be exploited by off-the-shelf QP solvers, and hence it is efficiently solvable. As a result, solving (11) does not require much more computational work than solving a linear program (LP), which is the case for the CPM. Finally, it is worth stressing that the disaggregated bundle method takes advantage of the separability of (8). In a nutshell, offering state-of-the-art algorithms for solving non-smooth convex programs, the stable and fast convergent bundle methods are well motivated here for clearing the market distributedly.

Specifically, applying the disaggregated bundle method to problem (9) at hand, the multiplier update at iteration amounts to solving the following problem:

(12a) s. t. (12b) (12c)
Figure 1: Power system example featuring 6 buses, 3 generators, 4 aggregators, and base loads at three of the buses.

Problem (12) that yields the updated multipliers and the approximate dual value can be solved at the MO. To this end, the quantities are needed from each aggregator per iteration as the problem input. Note that , where is the optimal value of problem (7b). Thus, it is clear that all these required quantities can be formed at the aggregator level as summations over all end-users, and then transmitted to the MO. The highlight here is that the proposed decomposition scheme respects user privacy, since and are never revealed.

4 Numerical tests

In this section, simulation results are presented to verify the merits of the disaggregated bundle method. The power system tested for market clearing and large-scale DR is illustrated in Fig. 1, where each of the 4 aggregators serves 1,000 residential end-users. The scheduling horizon starts from 1am until 12am, for a total of 24 hours.

Time-invariant generation cost functions are set to be quadratic as for all and . Each end-user has a PHEV to charge overnight. All detailed parameters of the generators and loads are listed in Tables 1 and 2. The utility functions are set to be zero for simplicity. The upper bound on each aggregator’s consumption is MW while MW. At a base of 100 MVA, the values of the network reactances are p.u. Finally, no flow limits are imposed across the network. The resulting optimization problems (7a) and (12) are modeled via YALMIP [9], and solved by Gurobi [10].

1 0.3 3 60 2.4 50
2 0.15 20 50 0 35
3 0.2 50 50 0 40
Table 1: Generator parameters. The units of and are $/(MWh) and $/MWh, respectively. the rest are in MW.
(kWh) Uniform on {10, 11, 12}
(kWh) Uniform on {2.1, 2.3, 2.5}
(kWh) 0
6am w.p. 70%, 7am w.p. 30%
Table 2: Parameters of residential appliances. All listed hours are the ending ones; w.p. means with probability.

Figs. 2 and 3 illustrate the convergence performance of the proposed disaggregated bundle method vis-à-vis the disaggregated CPM. The pertinent parameters are set as , , , and (cf. [6]). Fig. 2 depicts the evolution of the objective values of the dual and the approximate dual . It is clearly seen that the bundle method converges much faster (more than three times) than its CPM counterpart. Note that due to the effect of the proximal penalty (cf. (11a)), quantity for the bundle may not always serve as an upper bound of as the one for the CPM. Finally, convergence of the Lagrange multiplier sequence is shown in Fig. 3, which also corroborates the merit of the bundle method for its faster parameter convergence over the CPM. It is interesting to observe that the distance-to-optimal curve of the bundle method is quite smooth compared with the CPM one. This again illustrates the effect of the proximal regulation penalizing large deviations.

Figure 2: Convergence of the objective values of the dual and the approximated one (denoted as and in the caption).
Figure 3: Convergence of the Lagrange multipliers.

5 Conclusions and Future Directions

In this work, a fast convergent and scalable distributed solver is developed for market clearing with large-scale residential DR. Leveraging the dual decomposition technique, only the aggregator-users balance constraint is dualized in order to separate problems for the MO and each aggregator, while respecting end-user privacy concerns. Simulated tests highlight the merits of the proposed approach for multiplier updates based on the disaggregated bundle method.

A number of interesting research directions open up, including the incorporation of load and renewable energy production uncertainty, the issue of primal recovery, as well as cut aggregation techniques for further computational speed up.


  1. denotes transpose of the vector .


  1. A. M. Giacomoni, S. M. Amin, and B. F. Wollenberg, “Reconfigurable interdependent infrastructure systems: Advances in distributed sensing, modeling, and control,” in Proc. American Control Conf., San Francisco, CA, June–July 2011.
  2. C.-L. Su and D. Kirschen, “Quantifying the effect of demand response on electricity markets,” IEEE Trans. Power Systems, vol. 24, no. 3, pp. 1199–1207, Aug. 2009.
  3. J. Wang, S. Kennedy, and J. Kirtley, “A new wholesale bidding mechanism for enhanced demand response in smart grids,” in Proc. IEEE PES Conf. Innovative Smart Grid Tech., Gaithersburg, MD, Jan. 2010.
  4. J.-Y. Joo and M. D. Ilić, “Adaptive load management (ALM) in electric power systems,” in Proc. Int. Conf. Networking, Sensing, and Control, Chicago, IL, Apr. 2010, pp. 637–642.
  5. K. Trangbeak, M. Petersen, J. Bendtsen, and J. Stoustrup, “Exact power constraints in smart grid control,” in Proc. 50th IEEE Conf. Decision and Control and European Control Conf., Orlando, FL, Dec. 2011, pp. 6907–6912.
  6. N. Gatsis and G. B. Giannakis, “Decomposition algorithms for market clearing with large-scale demand response,” IEEE Trans. Smart Grid, 2013 (to appear).
  7. D. P. Bertsekas, Convex Optimization Theory.   Belmont, MA: Athena Scientific, 2009.
  8. J. B. Hiriart-Urruty and C. Lemaréchal, Convex Analysis and Minimization Algorithms.   Berlin Heidelberg New York: Springer-Verlag, 1993, vol. II.
  9. J. Löfberg, “YALMIP: A toolbox for modeling and optimization in MATLAB,” in Proceedings of the CACSD Conference, Taipei, Taiwan, 2004. [Online]. Available: http://users.isy.liu.se/johanl/yalmip
  10. Gurobi Optimization, Inc., “Gurobi optimizer reference manual,” 2013. [Online]. Available: http://www.gurobi.com
This is a comment super asjknd jkasnjk adsnkj
The feedback cannot be empty
Comments 0
The feedback cannot be empty
Add comment

You’re adding your first comment!
How to quickly get a good reply:
  • Offer a constructive comment on the author work.
  • Add helpful links to code implementation or project page.